Volcengine Message Queue RocketMQ

Collect metrics data from Volcengine Message Queue RocketMQ

Configuration¶

Install Func¶

It is recommended to enable TrueWatch Integration - Extensions - DataFlux Func (Automata): all prerequisites are automatically installed. Please proceed with the script installation.

If you need to deploy Func manually, refer to Manual Func Deployment

Install Script¶

Note: Please prepare the required Volcengine AK in advance (for simplicity, you can grant the global read-only permission ReadOnlyAccess)

To synchronize monitoring data for the Message Queue RocketMQ resources, we install the corresponding collection script: "TrueWatch Integration (Volcengine-RocketMQ Collection)" (ID: integration_volcengine_rocketmq)

Click 【Install】, then input the relevant parameters: Volcengine AK, Volcengine account name, and Regions.

Click 【Deploy Startup Script】, the system will automatically create the Startup script set and configure the corresponding startup scripts.

After enabling, you can see the corresponding automatic trigger configuration under 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to immediately run it once without waiting for the scheduled time. Wait for a moment, and you can check the execution task records and corresponding logs.

Verification¶

Under 「Manage / Automatic Trigger Configuration」, confirm if the corresponding task has the automatic trigger configuration, and check the task records and logs for any anomalies
In TrueWatch, check if asset information exists under 「Infrastructure - Resource Catalog」
In TrueWatch, check if the corresponding monitoring data is available under 「Metrics」

Metrics¶

To configure monitoring metrics for Volcengine Message Queue RocketMQ, you can collect more metrics by configuration Volcengine Message Queue RocketMQ Metrics Details

Volcengine Message Queue RocketMQ Monitoring Metrics¶

The Message Queue RocketMQ metrics are located under the volcengine_VCM_RocketMQ Measurement. Here are the relevant metric descriptions

`MetricName`	`Subnamespace`	Metric Name	MetricUnit	Dimension
`CapUtil`	`Instance`	Instance Disk Utilization	Percent	ResourceID
`ConsumerConnectionCount`	`Instance`	Consumer Connection Count	Count	ResourceID
`CpuUtil`	`Instance`	CPU Utilization	Percent	ResourceID
`InstanceBigMsgCount`	`Instance`	Big Message Count	Count	ResourceID
`InstanceConnectionRate`	`Instance`	Instance Connection Utilization	Percent	ResourceID
`InstanceSendFailedMsgNum`	`Instance`	Failed Message Count	Count	ResourceID
`InstanceTPSUsedRatio`	`Instance`	Instance TPS Utilization	Percent	ResourceID
`InstanceTopicNum`	`Instance`	Topic Count	Count	ResourceID
`MaxDiskCapUtil`	`BalanceStatus`	Maximum Disk Utilization	Percent	ResourceID
`MemUtil`	`BalanceStatus`	Memory Utilization	Percent	ResourceID
`MinDiskCapUtil`	`BalanceStatus`	Minimum Disk Utilization	Percent	ResourceID
`MsgProductionRate`	`Instance`	Message Production Rate	Count/Second	ResourceID
`MsgPutLatencyP99`	`Instance`	Message Production P99 Latency	Millisecond	ResourceID
`MsgPutTime`	`Instance`	Average Message Production Time	Millisecond	ResourceID
`NodeMaxConnectionRate`	`BalanceStatus`	Node Maximum Connection Utilization	Percent	ResourceID
`NodeMaxConsumeRate`	`BalanceStatus`	Node Maximum Consumption Rate	Count/Second	ResourceID
`NodeMaxProduceRate`	`BalanceStatus`	Node Maximum Production Rate	Count/Second	ResourceID
`NodeMaxQueueCount`	`BalanceStatus`	Node Maximum Queue Count	Count	ResourceID
`ProduceConnectionCount`	`BalanceStatus`	Producer Connection Count	Count	ResourceID
`QueueCountSkew`	`BalanceStatus`	Queue Count Skew Rate	Percent	ResourceID
`TopicProductionSizeRate`	`Topic`	Message Production Traffic Rate	Bytes/Second(IEC)	ResourceID

Objects¶

The collected Volcengine RocketMQ object data structure can be viewed under 「Infrastructure - Resource Catalog」

  {
    "measurement": "volcengine_rocketmq",
    "tags": {
    "RegionId"        : "cn-beijing",
    "ComputeSpec"     : "rocketmq.n1.x2.micro",
    "ChargeDetail.ChargeType" : "PostPaid",
    "InstanceName"    : "test",
    "InstanceStatus"  : "Running",
    "SubnetId"        : "subnet-13fpvlahzboxsxxxxxxxxxx",
    "Version"         : "x.x.x",
    "StorageType"     : "300",
    "VpcId"           : "vpc-13fpvlahzboxsxxxxxxxxxx",
    "ZoneId"          : "cn-beijing-a",
    "EipId"           : "eip-2ze1j9xxxxxxxxxxxxxxxx",
    "ProjectName"     : "default",
    },
    "fileds": {
      "InstanceDescription": "cn-beijing-a",
      "AvailableQueueNumber": "333",
      "CreateTime": "2025-04-22T04:01:52Z",
      "FileReservedTime": "72",
      "StorageSpace": "300",
      "UsedGroupNumber": "0",
      "UsedTopicNumber": "0",
      "UsedStorageSpace": "1",
      "Tags": "[]"
    }
  }

Note: The fields in tags and fields may change with subsequent updates ```