Skip to content

Huawei Cloud DMS RocketMQ

Collect Huawei Cloud DMS RocketMQ Metrics data

Configuration

Install Func

It is recommended to activate the TrueWatch Integration - Extensions - DataFlux Func (Automata): all prerequisites are automatically installed, please proceed with the script installation.

If you need to deploy Func manually, refer to Deploy Func Manually

Install Script

Note: Please prepare the Huawei Cloud AK in advance (for simplicity, you can grant the global read-only permission ReadOnlyAccess)

  1. Log in to the Func console, click 【Script Market】, enter the TrueWatch Script Market, and search for ID: integration_huaweicloud_rocketmq

  2. Click 【Install】, then enter the corresponding parameters: Huawei Cloud AK, SK, and account name

  3. Click 【Deploy Startup Script】, the system will automatically create the Startup script set and configure the corresponding startup script

  4. After enabling, you can see the corresponding automatic trigger configuration in 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. Wait a moment, and you can view the execution task records and corresponding logs

Verification

  1. In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding task has the automatic trigger configuration, and check the task records and logs for any exceptions
  2. In TrueWatch, check if the asset information exists in 「Infrastructure - Resource Catalog」
  3. In TrueWatch, check if there are corresponding monitoring data in 「Metrics」

Metrics

Configure Huawei Cloud DMS RocketMQ metrics, you can collect more metrics through configuration Huawei Cloud DMS RocketMQ Metrics Details

Metric ID Metric Name Metric Meaning Value Range Measurement Object Monitoring Period (Original Metric)
instance_produce_msg Message Production Count The number of messages received by the instance in one minute unit: Count >0 RocketMQ Instance 1 minute
instance_consume_msg Message Consumption Count The number of messages consumed by the instance in one minute unit: Count >0 RocketMQ Instance 1 minute
current_topics Topic Count The number of topics in the instance unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance 1 minute
current_queues Queue Count The number of queues in the instance unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance 1 minute
instance_accumulation Accumulated Messages Count The total number of accumulated messages for all consumer groups in the instance unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance 1 minute
broker_produce_msg Message Production Count The number of messages received by the node in one minute unit: Count >0 RocketMQ Instance Node 1 minute
broker_consume_msg Message Consumption Count The number of messages consumed by the node in one minute unit: Count >0 RocketMQ Instance Node 1 minute
broker_produce_rate Message Production Rate The number of messages received by the node per second unit: Count/s >0 RocketMQ Instance Node 1 minute
broker_consume_rate Message Consumption Rate The number of messages consumed by the node per second unit: Count/s >0 RocketMQ Instance Node 1 minute
broker_total_bytes_in_rate Network Inbound Traffic The inbound network traffic per second for the node unit: Byte/s >0 RocketMQ Instance Node 1 minute
broker_total_bytes_out_rate Network Outbound Traffic The outbound network traffic per second for the node unit: Byte/s >0 RocketMQ Instance Node 1 minute
broker_cpu_core_load CPU Core Load This metric is used to count the average load per core of the node's virtual machine CPU >0 RocketMQ Instance Node 1 minute
broker_disk_usage Disk Usage Rate This metric is used to count the disk usage rate of the node's virtual machine unit: % 0~100 RocketMQ Instance Node 1 minute
broker_memory_usage Memory Usage Rate This metric is used to count the memory usage rate of the node's virtual machine unit: % 0~100 RocketMQ Instance Node 1 minute
broker_alive Node Alive Status Node alive statusimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. 1: Alive 0: Offline RocketMQ Instance Node 1 minute
broker_connections Connection Count The number of connections used by the virtual machine unit: CountimgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
broker_cpu_usage CPU Usage Rate The CPU usage rate of the virtual machine unit: %imgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
broker_disk_read_rate Disk Read Traffic Disk read operation traffic unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
broker_disk_write_rate Disk Write Traffic Disk write operation traffic unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Node 1 minute
topic_produce_msg Message Production Count The number of messages received by the Topic in one minute unit: Count >0 RocketMQ Instance Queue 1 minute
topic_consume_msg Message Consumption Count The number of messages consumed by the Topic in one minute unit: Count >0 RocketMQ Instance Queue 1 minute
topic_produce_rate Message Production Rate The number of messages received by the Topic per second unit: Count/s >0 RocketMQ Instance Queue 1 minute
topic_consume_rate Message Consumption Rate The number of messages consumed by the Topic per second unit: Count/s >0 RocketMQ Instance Queue 1 minute
topic_bytes_in_rate Production Traffic The production traffic of the current topic unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Queue 1 minute
topic_bytes_out_rate Consumption Traffic The consumption traffic of the current topic unit: Byte/simgNote: Instances purchased on or after May 16, 2022 support this monitoring item. >=0 RocketMQ Instance Queue 1 minute

Object

After the data is synchronized normally, you can view the data in TrueWatch's 「Infrastructure - Resource Catalog」.

{
  "measurement": "huaweicloud_rocketmq",
  "tags": {      
    "RegionId"              : "cn-north-4",
    "project_id"            : "756ada1aa17e4049b2a16ea41912e52d",
    "enterprise_project_id" : "o78hhbss-xxxx-xxxx-xxxx-cba3d38cf2f9",
    "instance_id"           : "c0b0ea90-xxxx-xxxx-xxxx-cba3d38cf2f9",
    "instance_name"         : "rocketmq-xxxxx",
    "engine"                : "reliability",
    "status"                : "RUNNING"  
  },
  "fields": {
    "charging_mode"      : "1",
    "type"               : "cluster.small",
    "engine_version"     : "4.8.0",
    "description"        : "",
    "specification"      : "rocketmq.4u8g.cluster.small * 1 broker",
    "storage_space"      : 250,
    "used_storage_space" : 0,
    "resource_spec_code" : "xxxx",
    "created_at"         : "1687158517888",
    "maintain_begin"     : "02:00:00",
    "maintain_end"       : "06:00:00",
    "enable_publicip"    : false,
    "publicip_address"   : "12.xx.xx.32",
    "publicip_id"        : "xxxxxxxxxxxxxxxxxxxss",
    "total_storage_space": 300,
    "available_zones"    : "xxxxxx"
  }
}

Partial field descriptions are as follows:

Field Type Description
specification String Instance specification.
charging_mode String Billing mode, 1 indicates pay-as-you-go, 0 indicates subscription.
created_at String Creation completion time. The format is a timestamp, which refers to the total milliseconds from 00:00:00 on January 1, 1970, Greenwich Mean Time to the specified time.
resource_spec_code String Resource specification
maintain_begin String Maintenance window start time, format is HH🇲🇲ss
maintain_end String Maintenance window end time, format is HH🇲🇲ss

Note: The fields in tags and fields may change with subsequent updates

Tip 1: The value of tags.instance_id is the instance ID, used as a unique identifier.