Skip to content

Huawei Cloud DIS

Collect Huawei Cloud DIS Metrics

Configuration

Install Func

It is recommended to activate TrueWatch Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed, please proceed with the script installation

If deploying Func manually, refer to Manual Deployment of Func

Install Script

Note: Please prepare the Huawei Cloud AK in advance (for simplicity, you can directly grant global read-only permissions ReadOnlyAccess)

  1. Log in to the Func console, click 【Script Market】, enter the TrueWatch Script Market, and search for integration_huaweicloud_dis

  2. Click 【Install】, then enter the corresponding parameters: Huawei Cloud AK, SK, and account name

  3. Click 【Deploy Startup Script】, the system will automatically create the Startup script set and configure the corresponding startup script

  4. After enabling, you can see the corresponding automatic trigger configuration in 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to immediately execute once without waiting for the scheduled time. Wait a moment, you can view the execution task records and corresponding logs

Verification

  1. In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and check the corresponding task records and logs for any exceptions
  2. In TrueWatch, 「Infrastructure - Resource Catalog」, check if there is asset information
  3. In TrueWatch, 「Metrics」, check if there is corresponding monitoring data

Metrics

Configure Huawei Cloud DIS Metrics, you can collect more metrics through configuration Huawei Cloud DIS Metrics Details

Metric ID Metric Name Metric Description Value Range Measurement Object (Dimension) Monitoring Period (Original Metric)
dis01_stream_put_bytes_rate Total Input Traffic This metric is used to count the amount of data uploaded to the channel within a specified time range. Unit: byte/s. ≥ 0 bytes/s Channel 1 minute
dis02_stream_get_bytes_rate Total Output Traffic This metric is used to count the amount of data downloaded from the channel within a specified time range. Unit: byte/s. ≥ 0 bytes/s Channel 1 minute
dis03_stream_put_records Total Input Records This metric is used to count the number of records uploaded to the channel within a specified time range. Unit: Count/s. ≥ 0 Count/s Channel 1 minute
dis04_stream_get_records Total Output Records This metric is used to count the number of records downloaded from the channel within a specified time range. Unit: Count/s. ≥ 0 Count/s Channel 1 minute
dis05_stream_put_requests_succeed Successful Upload Requests This metric is used to count the number of successful upload requests to the channel within a specified time range. Unit: Count/s. ≥ 0 Count/s Channel 1 minute
dis06_stream_get_requests_succeed Successful Download Requests This metric is used to count the number of successful download requests from the channel within a specified time range. Unit: Count/s. ≥ 0 Count/s Channel 1 minute
dis07_stream_put_req_average_latency Average Upload Request Processing Time This metric is used to count the average latency of upload requests to the channel within a specified time range. Unit: ms. 0~50ms Channel 1 minute
dis08_stream_get_req_average_latency Average Download Request Processing Time This metric is used to count the average latency of download requests from the channel within a specified time range. Unit: ms. 0~50ms Channel 1 minute
dis09_stream_traffic_control_put_records Upload Requests Rejected Due to Traffic Control This metric is used to count the number of upload requests rejected due to traffic control within a specified time range. Unit: Count/s. 0~1Count/s Channel 1 minute
dis10_stream_traffic_control_get_records Download Requests Rejected Due to Traffic Control This metric is used to count the number of download requests rejected due to traffic control within a specified time range. Unit: Count/s. 0~1Count/s Channel 1 minute

Objects

The collected Huawei Cloud DIS object data structure can be seen in 「Infrastructure -」

{
  "measurement": "huaweicloud_dis",
  "tags": {
    "RegionId"    : "cn-north-4",
    "data_type"   : "BLOB",
    "name"        : "dis-YoME",
    "project_id"  : "c631f04625xxxxexxxxxx253c62d48585",
    "status"      : "RUNNING",
    "stream_name" : "dis-YoME",
    "stream_type" : "COMMON"
  },
  "fields": {
    "partition_count"    : 1,
    "retention_period"   : 24,
    "auto_scale_enabled" : false,
    "create_time"        : 1691484876645,
    "message"            : "{Instance JSON Data}"
  }
}

Some parameter descriptions are as follows:

Field Type Description
create_time integer The creation time of the channel, a 13-digit timestamp.
retention_period integer Data retention period, in hours.
status str The current status of the channel. CREATING: Creating RUNNING: Running TERMINATING: Deleting TERMINATED: Deleted
stream_type str Channel type. COMMON: Common channel, indicating 1MB bandwidth. ADVANCED: Advanced channel, indicating 5MB bandwidth.
data_type str Source data type. BLOB: A set of binary data stored in a database management system. JSON: An open file format based on human-readable text, used to transmit data objects composed of attribute values or sequential values. CSV: Table data stored in plain text, with the default separator being a comma. Default: BLOB.
auto_scale_enabled bool Whether auto-scaling is enabled. true: Auto-scaling is enabled. false: Auto-scaling is disabled. Default is disabled. Default: false

Note: Fields in tags, fields may change with subsequent updates

Tip 1: tags.name value is the instance ID, used as the unique identifier

Tip 2: The following fields are all JSON serialized strings

  • fields.message