Alibaba Cloud RocketMQ4¶
The display metrics of Alibaba Cloud RocketMQ 4.0 include message throughput, latency, reliability, and horizontal scalability.
Configuration¶
Install Func¶
It is recommended to enable the TrueWatch integration - extension - DataFlux Func (Automata): all prerequisites are automatically installed. Please continue with the script installation.
If you deploy Func on your own, refer to Self-deployed Func
Installation Script¶
Note: Please prepare the required Alibaba Cloud AK in advance (for simplicity, you can directly grant global read-only permission
ReadOnlyAccess
)
To synchronize the monitoring data of Alibaba Cloud RocketMQ4, we install the corresponding collection script: TrueWatch Integration (Alibaba Cloud-RocketMQ 4.0)
After clicking [Install], enter the corresponding parameters: Alibaba Cloud AK, Alibaba Cloud account name.
Click [Deploy Startup Script], and the system will automatically create a Startup
script set and automatically configure the corresponding startup script.
In addition, you can see the corresponding automatic trigger configuration in [Manage / Automatic Trigger Configuration]. Click [Execute] to immediately execute it once without waiting for the scheduled time. After a short wait, you can view the execution task records and corresponding logs.
We default collect some configurations, details are shown in the metrics section.
Customize cloud object metrics configuration
Verification¶
- In [Manage / Automatic Trigger Configuration], confirm whether the corresponding task has the corresponding automatic trigger configuration. You can also check the corresponding task records and logs to see if there are any abnormalities.
- On the TrueWatch platform, under [Infrastructure / Custom], check if there is asset information.
- On the TrueWatch platform, under [Metrics], check if there is corresponding monitoring data.
Metrics¶
After configuring Alibaba Cloud - Cloud Monitoring, the default metric sets are as follows. More metrics can be collected through configuration. Alibaba Cloud Cloud Monitoring Metric Details
Metric Id | Metric Name | Dimensions | Statistics | Unit |
---|---|---|---|---|
ReadyMessages | Ready messages count(Group) | account_name,InstanceName | Average,Maximum | count |
ReadyMessagesPerGidTopic | Ready messages count(Group&Topic) | account_name,InstanceName | Average,Maximum | count |
ReceiveMessageCountPerGid | Number of messages received by consumer per minute(Group) | account_name,InstanceName | Average,Maximum | count/min |
ReceiveMessageCountPerGidTopic | Number of messages received by consumer per minute(Group&Topic) | account_name,InstanceName | Average,Maximum | count/min |
ReceiveMessageCountPerInstance | Number of messages received by consumer per minute(Instance) | account_name,InstanceName | Average,Maximum | count/min |
ReceiveMessageCountPerTopic | Number of messages received by consumer per minute(Topic) | account_name,InstanceName | Average,Maximum | count/min |
SendDLQMessageCountPerGid | Number of dead-letter messages generated per minute(Group) | account_name,InstanceName | Average,Maximum | count/min |
SendDLQMessageCountPerGidTopic | Number of dead-letter messages generated per minute(Group&Topic) | account_name,InstanceName | Average,Maximum | count/min |
SendMessageCountPerInstance | Number of messages sent by producer per minute(Instance) | account_name,InstanceName | Average,Maximum | count/min |
SendMessageCountPerTopic | Number of messages sent by producer per minute(Topic) | account_name,InstanceName | Average,Maximum | count/min |
ThrottledReceiveRequestsPerGid | Number of throttling occurrences when consuming per minute(GroupId) | account_name,InstanceName | Average,Maximum | counts/min |
ThrottledReceiveRequestsPerGidTopic | Number of throttling occurrences when consuming per minute(GroupId&Topic) | account_name,InstanceName | Average,Maximum | counts/min |
ThrottledReceiveRequestsPerInstance | Number of throttling occurrences when consuming per minute(Instance) | account_name,InstanceName | Average,Maximum | counts/min |
ThrottledSendRequestsPerInstance | Number of throttling occurrences when sending per minute(Instance) | account_name,InstanceName | Average,Maximum | counts/min |
ThrottledSendRequestsPerTopic | Number of throttling occurrences when sending per minute(Topic) | account_name,InstanceName | Average,Maximum | counts/min |
Objects¶
The object data structure of Alibaba Cloud RocketMQ4 that has been collected can be seen in the object data from [Infrastructure - Custom]
{
"Endpoints": "{\"HttpInternalEndpoint\": \"http://xxx.mqrest.cn-hangzhou-internal.aliyuncs.com\", \"HttpInternetEndpoint\": \"http://xxx.mqrest.cn-hangzhou.aliyuncs.com\", \"HttpInternetSecureEndpoint\": \"\", \"TcpEndpoint\": \"http://MQ_INST_xxx.cn-hangzhou.mq-vpc.aliyuncs.com:8080\", \"TcpInternetEndpoint\": \"http://MQ_INST_xxx.cn-hangzhou.mq.aliyuncs.com:80\"}",
"Remark": "xxx",
"time": 1692250532822,
"IndependentNaming": "True",
"InstanceId": "MQ_INST_xxx",
"InstanceName": "xxx",
"InstanceStatus": "5",
"__namespace": "custom_object",
"account_name": "Aliyun",
"cloud_provider": "aliyun",
"date_ns": 0,
"name": "MQ_INST_xxx",
"spInstanceType": "1",
"CreateTime": "1692163416000",
"class": "aliyun_rocketmq",
"create_time": 1692250533041,
"date": 1692250532000,
"message": "{\"CreateTime\": 1692163416000, \"Endpoints\": {\"HttpInternalEndpoint\": \"http://xxx.mqrest.cn-hangzhou-internal.aliyuncs.com\", \"HttpInternetEndpoint\": \"http://xxx.mqrest.cn-hangzhou.aliyuncs.com\", \"HttpInternetSecureEndpoint\": \"\", \"TcpEndpoint\": \"http://MQ_INST_xxx.cn-hangzhou.mq-vpc.aliyuncs.com:8080\", \"TcpInternetEndpoint\": \"http://MQ_INST_xxx.cn-hangzhou.mq.aliyuncs.com:80\"}, \"IndependentNaming\": true, \"InstanceId\": \"MQ_INST_xxx\", \"InstanceName\": \"xxx\", \"InstanceStatus\": 5, \"InstanceType\": 1, \"Remark\": \"xxx\", \"spInstanceId\": \"\", \"spInstanceType\": 1}",
"InstanceType": "1",
"__docid": "CO_54a991d1b5a86d2dc82d796110ee3476"
}