Huawei Cloud DIS
Collect Huawei Cloud DIS Metrics
Configuration¶
Install Func¶
It is recommended to activate TrueWatch Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed, please proceed with the script installation
If deploying Func manually, refer to Manual Deployment of Func
Install Script¶
Note: Please prepare the Huawei Cloud AK in advance (for simplicity, you can directly grant global read-only permissions
ReadOnlyAccess
)
-
Log in to the Func console, click 【Script Market】, enter the TrueWatch Script Market, and search for
integration_huaweicloud_dis
-
Click 【Install】, then enter the corresponding parameters: Huawei Cloud AK, SK, and account name
-
Click 【Deploy Startup Script】, the system will automatically create the
Startup
script set and configure the corresponding startup script -
After enabling, you can see the corresponding automatic trigger configuration in 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to immediately execute once without waiting for the scheduled time. Wait a moment, you can view the execution task records and corresponding logs
Verification¶
- In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and check the corresponding task records and logs for any exceptions
- In TrueWatch, 「Infrastructure - Resource Catalog」, check if there is asset information
- In TrueWatch, 「Metrics」, check if there is corresponding monitoring data
Metrics¶
Configure Huawei Cloud DIS Metrics, you can collect more metrics through configuration Huawei Cloud DIS Metrics Details
Metric ID | Metric Name | Metric Description | Value Range | Measurement Object (Dimension) | Monitoring Period (Original Metric) |
---|---|---|---|---|---|
dis01_stream_put_bytes_rate | Total Input Traffic | This metric is used to count the amount of data uploaded to the channel within a specified time range. Unit: byte/s. | ≥ 0 bytes/s | Channel | 1 minute |
dis02_stream_get_bytes_rate | Total Output Traffic | This metric is used to count the amount of data downloaded from the channel within a specified time range. Unit: byte/s. | ≥ 0 bytes/s | Channel | 1 minute |
dis03_stream_put_records | Total Input Records | This metric is used to count the number of records uploaded to the channel within a specified time range. Unit: Count/s. | ≥ 0 Count/s | Channel | 1 minute |
dis04_stream_get_records | Total Output Records | This metric is used to count the number of records downloaded from the channel within a specified time range. Unit: Count/s. | ≥ 0 Count/s | Channel | 1 minute |
dis05_stream_put_requests_succeed | Successful Upload Requests | This metric is used to count the number of successful upload requests to the channel within a specified time range. Unit: Count/s. | ≥ 0 Count/s | Channel | 1 minute |
dis06_stream_get_requests_succeed | Successful Download Requests | This metric is used to count the number of successful download requests from the channel within a specified time range. Unit: Count/s. | ≥ 0 Count/s | Channel | 1 minute |
dis07_stream_put_req_average_latency | Average Upload Request Processing Time | This metric is used to count the average latency of upload requests to the channel within a specified time range. Unit: ms. | 0~50ms | Channel | 1 minute |
dis08_stream_get_req_average_latency | Average Download Request Processing Time | This metric is used to count the average latency of download requests from the channel within a specified time range. Unit: ms. | 0~50ms | Channel | 1 minute |
dis09_stream_traffic_control_put_records | Upload Requests Rejected Due to Traffic Control | This metric is used to count the number of upload requests rejected due to traffic control within a specified time range. Unit: Count/s. | 0~1Count/s | Channel | 1 minute |
dis10_stream_traffic_control_get_records | Download Requests Rejected Due to Traffic Control | This metric is used to count the number of download requests rejected due to traffic control within a specified time range. Unit: Count/s. | 0~1Count/s | Channel | 1 minute |
Objects¶
The collected Huawei Cloud DIS object data structure can be seen in 「Infrastructure -」
{
"measurement": "huaweicloud_dis",
"tags": {
"RegionId" : "cn-north-4",
"data_type" : "BLOB",
"name" : "dis-YoME",
"project_id" : "c631f04625xxxxexxxxxx253c62d48585",
"status" : "RUNNING",
"stream_name" : "dis-YoME",
"stream_type" : "COMMON"
},
"fields": {
"partition_count" : 1,
"retention_period" : 24,
"auto_scale_enabled" : false,
"create_time" : 1691484876645,
"message" : "{Instance JSON Data}"
}
}
Some parameter descriptions are as follows:
Field | Type | Description |
---|---|---|
create_time |
integer | The creation time of the channel, a 13-digit timestamp. |
retention_period |
integer | Data retention period, in hours. |
status |
str | The current status of the channel. CREATING: Creating RUNNING: Running TERMINATING: Deleting TERMINATED: Deleted |
stream_type |
str | Channel type. COMMON: Common channel, indicating 1MB bandwidth. ADVANCED: Advanced channel, indicating 5MB bandwidth. |
data_type |
str | Source data type. BLOB: A set of binary data stored in a database management system. JSON: An open file format based on human-readable text, used to transmit data objects composed of attribute values or sequential values. CSV: Table data stored in plain text, with the default separator being a comma. Default: BLOB. |
auto_scale_enabled |
bool | Whether auto-scaling is enabled. true: Auto-scaling is enabled. false: Auto-scaling is disabled. Default is disabled. Default: false |
Note: Fields in
tags
,fields
may change with subsequent updatesTip 1:
tags.name
value is the instance ID, used as the unique identifierTip 2: The following fields are all JSON serialized strings
- fields.message