• Tencent Cloud summary: 'The metrics displayed by Tencent Cloud CKafka include message throughput, latency, concurrent connections, and reliability, which reflect CKafka's performance and reliability guarantees in handling large-scale message delivery and real-time data streams.' __int_icon: 'icon/tencent_ckafka' dashboard:

• desc: 'Tencent Cloud CKafka Monitoring Dashboard' path: 'dashboard/en/tencent_ckafka'

monitor: - desc: 'Tencent CKafka Monitor' path: 'monitor/en/tencent_ckafka'

Tencent Cloud CKafka¶

The metrics displayed by Tencent Cloud CKafka include message throughput, latency, concurrent connections, and reliability, which reflect CKafka's performance and reliability guarantees in handling large-scale message delivery and real-time data streams.

Configuration¶

Install Func¶

It is recommended to activate the TrueWatch integration - extension - hosted Func: all prerequisites are automatically installed, please proceed with the script installation.

If you deploy Func manually, refer to Manual Func Deployment

Install CKafka Collection Script¶

Note: Please prepare the Tencent Cloud AK in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess).

To synchronize CKafka monitoring data, we install the corresponding collection script: 「TrueWatch Integration (Tencent Cloud-CKafka)」(ID: integration_tencentcloud_ckafka).

After clicking 【Install】, enter the relevant parameters: Tencent Cloud AK, Tencent Cloud account name.

Click 【Deploy Startup Script】, the system will automatically create the Startup script set and configure the corresponding startup scripts.

After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】 to immediately execute it once without waiting for the scheduled time. After a short while, you can check the execution task records and corresponding logs.

We have collected some configurations by default, see the metrics section for details Configure Custom Cloud Object Metrics

Verification¶

1. In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and check the corresponding task records and logs for any exceptions.
2. In TrueWatch, check if the asset information exists in 「Infrastructure / Custom」.
3. In TrueWatch, check if there is corresponding monitoring data in 「Metrics」.

Metrics¶

After configuring Tencent Cloud Cloud Monitoring, the default metrics are as follows, more metrics can be collected through configuration Tencent Cloud Cloud Monitoring Metrics Details

Performance Metrics¶

System Metrics¶

Cumulative Usage Metrics¶

Objects¶

The collected Tencent Cloud CKafka object data structure can be seen in 「Infrastructure - Custom」.

{
  "Healthy": "1",
  "account_name": "xxxx",
  "InstanceType": "profession",
  "RenewFlag": "0",
  "SubnetId": "subnet-bp2jqhcj",
  "Vip": "172.17.32.16",
  "Bandwidth": "160",
  "ZoneId": "200002",
  "message": "{\"AllowDowngrade\": true, \"Bandwidth\": 160, \"ClusterType\": \"CLOUD_EKS_TSE\", \"CreateTime\": 1692066710, \"Cvm\": 1, \"DiskSize\": 200, \"DiskType\": \"CLOUD_BASIC\", \"ExpireTime\": -62170009580, \"Features\": [], \"Healthy\": 1, \"HealthyMessage\": \"\", \"InstanceId\": \"ckafka-jamo82wo\", \"InstanceName\": \"\\u672a\\u547d\\u540d\", \"InstanceType\": \"profession\", \"IsInternal\": 0, \"MaxPartitionNumber\": 400, \"MaxTopicNumber\": 200, \"PartitionNumber\": 3, \"PublicNetwork\": 3, \"PublicNetworkChargeType\": \"BANDWIDTH_POSTPAID_BY_HOUR\", \"RebalanceDeadLineTimeStamp\": \"0000-00-00 00:00:00\", \"RebalanceTime\": \"0000-00-00 00:00:00\", \"RegionId\": \"ap-shanghai\", \"RenewFlag\": 0, \"Status\": 1, \"SubnetId\": \"subnet-bp2jqhcj\", \"Tags\": [], \"TopicNum\": 1, \"Version\": \"2.4.1\", \"Vip\": \"172.17.32.16\", \"VipList\": [{\"Vip\": \"172.17.32.16\", \"Vport\": \"9092\"}], \"VpcId\": \"vpc-kcphyzty\", \"Vport\": \"9092\", \"ZoneId\": 200002, \"ZoneIds\": [200002, 200003]}",
  "__docid": "CO_31e0187c3c5c2842b60f88a87c11eca0",
  "InstanceId": "ckafka-jamo82wo",
  "InstanceName": "未命名",
  "Status": "1",
  "VpcId": "vpc-kcphyzty",
  "Cvm": "1",
  "__namespace": "custom_object",
  "cloud_provider": "tencentcloud",
  "create_time": 1692089426315,
  "DiskType": "CLOUD_BASIC",
  "ExpireTime": "-62170009580",
  "TopicNum": "1",
  "VipList": "[{\"Vip\": \"172.17.32.16\", \"Vport\": \"9092\"}]",
  "time": 1692089425851,
  "IsInternal": "0",
  "Vport": "9092",
  "class": "tencentcloud_ckafka",
  "date": 1692089425000,
  "date_ns": 0,
  "name": "ckafka-jamo82wo",
  "CreateTime": "1692066710",
  "DiskSize": "200",
  "RegionId": "ap-shanghai",
  "Version": "2.4.1"
}

Note: The fields in tags and fields may change with subsequent updates.

Appendix¶

TencentCloud-CKafka「Regions and Availability」¶

Please refer to the official Tencent documentation:

• TencentCloud-CKafka Region List