Skip to content

Alibaba Cloud RocketMQ5

The displayed metrics of Alibaba Cloud RocketMQ 5.0 include message throughput, latency, reliability, and horizontal scalability.

Configuration

Install Func

It is recommended to activate TrueWatch Integration - Extensions - DataFlux Func (Automata)

If you deploy Func by yourself, refer to Self-deployed Func

Activate Script

Note: Please prepare an Alibaba Cloud AK that meets the requirements in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess)

Automata Activation Script

  1. Log in to the TrueWatch console
  2. Click the 【Integration】 menu and select 【Cloud Account Management】
  3. Click 【Add Cloud Account】, select 【Alibaba Cloud】, and fill in the required information on the interface. If you have already configured the cloud account information before, ignore this step
  4. Click 【Test】, and if the test is successful, click 【Save】. If the test fails, please check whether the relevant configuration information is correct and test again
  5. Click 【Cloud Account Management】, and you can see the added cloud account in the list. Click the corresponding cloud account to enter the details page
  6. Click the 【Integration】 button on the cloud account details page, find Alibaba Cloud RocketMQ5 under the Not Installed list, and click the 【Install】 button to pop up the installation interface for installation.

Manual Activation Script

  1. Log in to the Func console, click 【Script Market】, enter the TrueWatch script market, and search for: integration_alibabacloud_rocketmq5

  2. Click 【Install】, then enter the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.

  3. Click 【Deploy Startup Script】, the system will automatically create the Startup script set and configure the corresponding startup script.

  4. After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. After a while, you can view the execution task record and corresponding logs.

Metrics

MetricName MetricCategory MetricDescribe Dimensions Statistics Unit MinPeriods
ConsumerLag rocketmq Message backlog (Group) userId,instanceId,groupId Sum count 60 s
ConsumerLagLatencyPerGid rocketmq Message processing latency (GroupId) userId,instanceId,groupId Maximum milliseconds 60 s
ConsumerLagLatencyPerGidTopic rocketmq Message processing latency (GroupId&Topic) userId,instanceId,topic,groupId Maximum milliseconds 60 s
ConsumerLagPerGidTopic rocketmq Message backlog (Group&Topic) userId,instanceId,groupId,topic Sum count 60 s
InstanceApiCallTps rocketmq Instance API call frequency (Instance) userId,instanceId Sum countSecond 60 s
InstanceInternetFlowoutBandwidth rocketmq 5.0 series instance public network downstream traffic bandwidth userId,instanceId Sum bytes/Second 60 s
InstanceReceiveApiCallTps rocketmq 5.0 series instance consumption API call TPS peak userId,instanceId Maximum countSecond 60 s
InstanceSendApiCallTps rocketmq 5.0 series instance send API call TPS peak userId,instanceId Maximum countSecond 60 s
InstanceStorageSize rocketmq 5.0 series instance storage size userId,instanceId Sum Bytes 60 s
ReadyMessageQueueTime rocketmq Ready message queue time (Group) userId,instanceId,groupId Maximum milliseconds 60 s
ReadyMessageQueueTimePerGidTopic rocketmq Ready message queue time (Group&Topic) userId,instanceId,groupId,topic Maximum milliseconds 60 s
ReadyMessages rocketmq Ready message count (Group) userId,instanceId,groupId Sum count 60 s
ReadyMessagesPerGidTopic rocketmq Ready message count (Group&Topic) userId,instanceId,groupId,topic Sum count 60 s
ReceiveMessageCountPerGid rocketmq Consumer receives message count per minute (Group) userId,instanceId,groupId Sum count/min 60 s
ReceiveMessageCountPerGidTopic rocketmq Consumer receives message count per minute (Group&Topic) userId,instanceId,topic,groupId Sum count/min 60 s
ReceiveMessageCountPerInstance rocketmq Consumer receives message count per minute (Instance) userId,instanceId Sum count/min 60 s
ReceiveMessageCountPerTopic rocketmq Consumer receives message count per minute (Topic) userId,instanceId,topic Sum count/min 60 s
SendDLQMessageCountPerGid rocketmq Dead letter message count per minute (Group) userId,instanceId,groupId Sum count/min 60 s
SendDLQMessageCountPerGidTopic rocketmq Dead letter message count per minute (Group&Topic) userId,instanceId,groupId,topic Sum count/min 60 s
SendMessageCountPerInstance rocketmq Producer sends message count per minute (Instance) userId,instanceId Sum count/min 60 s
SendMessageCountPerTopic rocketmq Producer sends message count per minute (Topic) userId,instanceId,topic Sum count/min 60 s
ThrottledReceiveRequestsPerGid rocketmq Throttled consumption count per minute (GroupId) userId,instanceId,groupId Sum counts/min 60 s
ThrottledReceiveRequestsPerGidTopic rocketmq Throttled consumption count per minute (GroupId&Topic) userId,instanceId,topic,groupId Sum counts/min 60 s
ThrottledReceiveRequestsPerInstance rocketmq Throttled consumption count per minute (Instance) userId,instanceId Sum counts/min 60 s
ThrottledSendRequestsPerInstance rocketmq Throttled send count per minute (Instance) userId,instanceId Sum counts/min 60 s
ThrottledSendRequestsPerTopic rocketmq Throttled send count per minute (Topic) userId,instanceId,topic Sum counts/min 60 s

Object

The collected object data structure of Alibaba Cloud RocketMQ5 can be viewed in 「Infrastructure - Custom」

{
  "serviceCode": "rmq",
  "__namespace": "custom_object",
  "createTime": "2023-08-21 10:54:25",
  "expireTime": "2123-08-22 00:00:00",
  "time": 1692600804692,
  "topicCount": "1",
  "userId": "1067807587588864",
  "__docid": "CO_d3bed3ab447566645796455f37fcb66c",
  "message": "{\"accountInfo\": {\"username\": \"If02i2f3f4nYtUsA\"}, \"aclInfo\": {\\"aclType\\": \\"default\\"}, \\"bid\\": \\"26842\\", \\"commodityCode\\": \\"ons_rmqpost_public_cn\\", \\"createTime\\": \\"2023-08-21 10:54:25\\", \\"expireTime\\": \\"2123-08-22 00:00:00\\", \\"extConfig\\": {\\"aclType\\": \\"default\\", \\"autoScaling\\": false, \\"flowOutBandwidth\\": 1, \\"flowOutType\\": \\"payByBandwidth\\", \\"internetSpec\\": \\"enable\\", \\"messageRetentionTime\\": 72, \\"msgProcessSpec\\": \\"rmq.s1.micro\\", \\"sendReceiveRatio\\": 0.5, \\"supportAutoScaling\\": false}, \\"groupCount\\": 1, \\"instanceId\\": \\"rmq-cn-wwo3cwoyn0b\\", \\"instanceName\\": \\"rmq-cn-wwo3cwoyn0b\\", \\"instanceQuotas\\": [{\\"quotaName\\": \\"MAX_TPS\\", \\"totalCount\\": 500}, {\\"quotaName\\": \\"SCALING_TPS_MAX\\", \\"totalCount\\": 0}, {\\"quotaName\\": \\"STORAGE_SIZE\\", \\"usedCount\\": 0.109}, {\\"quotaName\\": \\"TOPIC_COUNT\\", \\"totalCount\\": 100, \\"usedCount\\": 1}, {\\"quotaName\\": \\"CONSUMER_GROUP_COUNT\\", \\"totalCount\\": 1000, \\"usedCount\\": 1}], \\"networkInfo\\": {\\"endpoints\\": [{\\"endpointType\\": \\"TCP_VPC\\", \\"endpointUrl\\": \\"rmq-cn-wwo3cwoyn0b-vpc.cn-hangzhou.rmq.aliyuncs.com:8080\\"}, {\\"endpointType\\": \\"TCP_INTERNET\\", \\"endpointUrl\\": \\"rmq-cn-wwo3cwoyn0b.cn-hangzhou.rmq.aliyuncs.com:8080\\"}], \\"internetInfo\\": {\\"flowOutBandwidth\\": 1, \\"flowOutType\\": \\"payByBandwidth\\", \\"internetSpec\\": \\"enable\\"}, \\"vpcInfo\\": {\\"vSwitchId\\": \\"vsw-bp1qzepqz845moheet831\\", \\"vpcId\\": \\"vpc-bp1pftfpllxna4t75e73v\\"}}, \\"paymentType\\": \\"PayAsYouGo\\", \\"productInfo\\": {\\"autoScaling\\": false, \\"messageRetentionTime\\": 72, \\"msgProcessSpec\\": \\"rmq.s1.micro\\", \\"sendReceiveRatio\\": 0.5, \\"supportAutoScaling\\": false}, \\"regionId\\": \\"cn-hangzhou\\", \\"releaseTime\\": \\"2123-08-29 00:00:00\\", \\"resourceGroupId\\": \\"rg-acfmv3ro3xnfwaa\\", \\"seriesCode\\": \\"standard\\", \\"serviceCode\\": \\"rmq\\", \\"software\\": {\\"maintainTime\\": \\"02:00-06:00\\", \\"softwareVersion\\": \\"5.0-rmq-20230818-2\\"}, \\"startTime\\": \\"2023-08-21 10:54:24\\", \\"status\\": \\"RUNNING\\", \\"subSeriesCode\\": \\"single_node\\", \\"tags\\": [{\\"key\\": \\"acs:rm:rgId\\", \\"value\\": \\"rg-acfmv3ro3xnfwaa\\"}], \\"topicCount\\": 1, \\"updateTime\\": \\"2023-08-21 10:57:31\\", \\"userId\\": \\"1067807587588864\\"}",
  "paymentType": "PayAsYouGo",
  "regionId": "cn-hangzhou",
  "startTime": "2023-08-21 10:54:24",
  "accountInfo": "{\"username\": \"If02i2f3f4nYtUsA\"}",
  "class": "aliyun_rocketmq",
  "instanceQuotas": "[{\"quotaName\": \"MAX_TPS\", \"totalCount\": 500}, {\"quotaName\": \"SCALING_TPS_MAX\", \"totalCount\": 0}, {\"quotaName\": \"STORAGE_SIZE\", \"usedCount\": 0.109}, {\"quotaName\": \"TOPIC_COUNT\", \"totalCount\": 100, \"usedCount\": 1}, {\"quotaName\": \"CONSUMER_GROUP_COUNT\", \"totalCount\": 1000, \"usedCount\": 1}]",
  "releaseTime": "2123-08-29 00:00:00",
  "create_time": 1692600804719,
  "groupCount": "1",
  "networkInfo": "{\"endpoints\": [{\"endpointType\": \"TCP_VPC\", \"endpointUrl\": \"rmq-cn-wwo3cwoyn0b-vpc.cn-hangzhou.rmq.aliyuncs.com:8080\"}, {\"endpointType\": \"TCP_INTERNET\", \"endpointUrl\": \"rmq-cn-wwo3cwoyn0b.cn-hangzhou.rmq.aliyuncs.com:8080\"}], \"internetInfo\": {\"flowOutBandwidth\": 1, \"flowOutType\": \"payByBandwidth\", \"internetSpec\": \"enable\"}, \"vpcInfo\": {\"vSwitchId\": \"vsw-bp1qzepqz845moheet831\", \"vpcId\": \"vpc-bp1pftfpllxna4t75e73v\"}}",
  "instanceName": "rmq-cn-wwo3cwoyn0b",
  "resourceGroupId": "rg-acfmv3ro3xnfwaa",
  "commodityCode": "ons_rmqpost_public_cn",
  "seriesCode": "standard",
  "subSeriesCode": "single_node",
  "status": "RUNNING",
  "updateTime": "2023-08-21 10:57:31",
  "account_name": "xxxxx",
  "bid": "26842",
  "date": 1692600804000,
  "name": "rmq-cn-wwo3cwoyn0b",
  "cloud_provider": "aliyun",
  "date_ns": 0,
  "instanceId": "rmq-cn-wwo3cwoyn0b",
  "productInfo": "{\"autoScaling\": false, \"messageRetentionTime\": 72, \"msgProcessSpec\": \"rmq.s1.micro\", \"sendReceiveRatio\": 0.5, \"supportAutoScaling\": false}"
}