Skip to content

Alibaba Cloud

Alibaba Cloud MongoDB replica set Metrics display, including CPU usage, memory usage, disk usage, data disk space usage, log disk space usage, statements executed per second, number of requests, number of connections, network traffic, replication delay, QPS, etc.

Alibaba Cloud MongoDB sharded cluster Metrics display, including CPU usage, memory usage, disk usage, data disk space usage, log disk space usage, statements executed per second, number of requests, number of connections, network traffic, replication delay, QPS, etc.

Alibaba Cloud MongoDB single node instance Metrics display, including CPU usage, memory usage, disk usage, data disk space usage, statements executed per second, number of requests, number of connections, network traffic, QPS, etc.

Configuration

Install Func

It is recommended to activate TrueWatch Integration - Extensions - DataFlux Func (Automata)

If you want to deploy Func yourself, refer to Deploy Func Yourself

Activate Script

Note: Please prepare the Alibaba Cloud AK that meets the requirements in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess)

Activate Script for DataFlux Func (Automata)

  1. Log in to the TrueWatch console
  2. Click the 【Integration】 menu and select 【Cloud Account Management】
  3. Click 【Add Cloud Account】, select 【Alibaba Cloud】, and fill in the required information on the interface. If you have already configured the cloud account information, ignore this step
  4. Click 【Test】, and after the test is successful, click 【Save】. If the test fails, please check whether the relevant configuration information is correct and test again
  5. Click 【Cloud Account Management】, and you can see the added cloud account in the list. Click the corresponding cloud account to enter the details page
  6. Click the 【Integration】 button on the cloud account details page, find Alibaba Cloud MongoDB in the Not Installed list, and click the 【Install】 button to pop up the installation interface and install it.

Activate Script Manually

  1. Log in to the Func console, click 【Script Market】, enter the TrueWatch script market, and search for: integration_alibabacloud_mongodb

  2. Click 【Install】, and then enter the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.

  3. Click 【Deploy Startup Script】, the system will automatically create the Startup script set and automatically configure the corresponding startup script.

  4. After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. Wait a moment, you can view the execution task records and corresponding logs.

Verification

  1. In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can also view the corresponding task records and logs to check for any exceptions
  2. In TrueWatch, check whether asset information exists in 「Infrastructure / Custom」
  3. In TrueWatch, check whether there is corresponding monitoring data in 「Metrics」

Metrics

After configuring Alibaba Cloud CloudMonitor, the default collected Metrics are as follows. More Metrics can be collected through configuration. For more Metrics, please refer to: Alibaba Cloud CloudMonitor Metrics Details

Alibaba Cloud MongoDB - Replica Set

Metric Id MetricCategory Metric Name Dimensions Statistics Unit Min Periods
CPUUtilization mongodb_replicaset CPU Usage userId,instanceId,role Average,Minimum,Maximum % 60 s
ConnectionAmount mongodb_replicaset Number of Connections userId,instanceId,role Average,Minimum,Maximum Count 60 s
ConnectionUtilization mongodb_replicaset Connection Utilization userId,instanceId,role Average,Minimum,Maximum % 60 s
DataDiskAmount mongodb_replicaset Data Disk Space Usage userId,instanceId,role Average,Minimum,Maximum bytes 60 s
DiskUtilization mongodb_replicaset Disk Utilization userId,instanceId,role Average,Minimum,Maximum % 60 s
IOPSUtilization mongodb_replicaset IOPS Utilization userId,instanceId,role Average,Minimum,Maximum % 60 s
InstanceDiskAmount mongodb_replicaset Instance Disk Space Usage userId,instanceId,role Average,Minimum,Maximum bytes 60 s
IntranetIn mongodb_replicaset Network Inbound Traffic userId,instanceId,role Average,Minimum,Maximum bytes 60 s
IntranetOut mongodb_replicaset Network Outbound Traffic userId,instanceId,role Average,Minimum,Maximum bytes 60 s
LogDiskAmount mongodb_replicaset Log Disk Space Usage userId,instanceId,role Average,Minimum,Maximum bytes 60 s
MemoryUtilization mongodb_replicaset Memory Utilization userId,instanceId,role Average,Minimum,Maximum % 60 s
NumberRequests mongodb_replicaset Number of Requests userId,instanceId,role Average,Minimum,Maximum Count 60 s
OpCommand mongodb_replicaset Command Operations userId,instanceId,role Average,Minimum,Maximum Frequency 60 s
OpDelete mongodb_replicaset Delete Operations userId,instanceId,role Average,Minimum,Maximum Frequency 60 s
OpGetmore mongodb_replicaset Getmore Operations userId,instanceId,role Average,Minimum,Maximum Frequency 60 s
OpInsert mongodb_replicaset Insert Operations userId,instanceId,role Average,Minimum,Maximum Count 60 s
OpQuery mongodb_replicaset Query Operations userId,instanceId,role Average,Minimum,Maximum Frequency 60 s
OpUpdate mongodb_replicaset Update Operations userId,instanceId,role Average,Minimum,Maximum Frequency 60 s
QPS mongodb_replicaset Average SQL Queries Per Second userId,instanceId,role Average,Minimum,Maximum Count 60 s
ReplicationLag mongodb_replicaset Replication Delay userId,instanceId,role Average,Maximum,Minimum,cms_null seconds 60 s

Alibaba Cloud MongoDB - Sharded Cluster

Metric Id MetricCategory Metric Name Dimensions Statistics Unit Min Periods
ShardingCPUUtilization mongodb_sharding CPU Usage userId,instanceId,subinstanceId,role Average,Minimum,Maximum % 60 s
ShardingConnectionAmount mongodb_sharding Number of Connections userId,instanceId,subinstanceId,role Average,Minimum,Maximum Count 60 s
ShardingConnectionUtilization mongodb_sharding Connection Utilization userId,instanceId,subinstanceId,role Average,Minimum,Maximum % 60 s
ShardingDataDiskAmount mongodb_sharding Data Disk Space Usage userId,instanceId,subinstanceId,role Average,Minimum,Maximum Bytes 60 s
ShardingDataDiskAmountOriginal mongodb_sharding ShardingDataDiskAmountOriginal userId,instanceId,subinstanceId,role Average,Minimum,Maximum - 60 s
ShardingDiskUtilization mongodb_sharding Disk Utilization userId,instanceId,subinstanceId,role Average,Minimum,Maximum % 60 s
ShardingIOPSUtilization mongodb_sharding IOPS Utilization userId,instanceId,subinstanceId,role Average,Minimum,Maximum % 60 s
ShardingInstanceDiskAmount mongodb_sharding Instance Disk Space Usage userId,instanceId,subinstanceId,role Average,Minimum,Maximum Bytes 60 s
ShardingIntranetIn mongodb_sharding Network Inbound Traffic userId,instanceId,subinstanceId,role Average Bytes 60 s
ShardingIntranetOut mongodb_sharding Network Outbound Traffic userId,instanceId,subinstanceId,role Average Bytes 60 s
ShardingLogDiskAmount mongodb_sharding Log Disk Space Usage userId,instanceId,subinstanceId,role Average,Minimum,Maximum Bytes 60 s
ShardingMemoryUtilization mongodb_sharding Memory Utilization userId,instanceId,subinstanceId,role Average,Minimum,Maximum % 60 s
ShardingNumberRequests mongodb_sharding Number of Requests userId,instanceId,subinstanceId,role Average Count 60 s
ShardingOpCommand mongodb_sharding Command Operations userId,instanceId,subinstanceId,role Average,Minimum,Maximum Count 60 s
ShardingOpDelete mongodb_sharding Delete Operations userId,instanceId,subinstanceId,role Average,Minimum,Maximum Count 60 s
ShardingOpGetmore mongodb_sharding Getmore Operations userId,instanceId,subinstanceId,role Average,Minimum,Maximum Count 60 s
ShardingOpInsert mongodb_sharding Insert Operations userId,instanceId,subinstanceId,role Average,Minimum,Maximum Count 60 s
ShardingOpQuery mongodb_sharding Query Operations userId,instanceId,subinstanceId,role Average,Minimum,Maximum Count 60 s

Alibaba Cloud MongoDB - Single Node Instance

Metric Id MetricCategory Metric Name Dimensions Statistics Unit Min Periods
SingleNodeCPUUtilization mongodb_singlenode CPU Usage userId,instanceId Average,Minimum,Maximum % 60 s
SingleNodeConnectionAmount mongodb_singlenode Number of Connections userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeConnectionUtilization mongodb_singlenode Connection Utilization userId,instanceId Average,Minimum,Maximum % 60 s
SingleNodeDataDiskAmount mongodb_singlenode Data Disk Space Usage userId,instanceId Average,Minimum,Maximum bytes 60 s
SingleNodeDiskUtilization mongodb_singlenode Disk Utilization userId,instanceId Average,Minimum,Maximum % 60 s
SingleNodeIntranetIn mongodb_singlenode Network Inbound Traffic userId,instanceId Average,Minimum,Maximum bytes 60 s
SingleNodeIntranetOut mongodb_singlenode Network Outbound Traffic userId,instanceId Average,Minimum,Maximum bytes 60 s
SingleNodeMemoryUtilization mongodb_singlenode Memory Utilization userId,instanceId Average,Minimum,Maximum % 60 s
SingleNodeNumberRequests mongodb_singlenode Number of Requests userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeOpCommand mongodb_singlenode Command Operations userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeOpDelete mongodb_singlenode Delete Operations userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeOpGetmore mongodb_singlenode Getmore Operations userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeOpInsert mongodb_singlenode Insert Operations userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeOpQuery mongodb_singlenode Query Operations userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeOpUpdate mongodb_singlenode Update Operations userId,instanceId Average,Minimum,Maximum Count 60 s
SingleNodeQPS mongodb_singlenode QPS userId,instanceId Average,Minimum,Maximum Count 60 s

Object

The collected Alibaba Cloud MongoDB object data structure can be seen in 「Infrastructure - Custom」

{
  "measurement": "aliyun_mongodb",
  "tags": {
    "name"                 : "dds-bpxxxxxxxx",
    "DBInstanceType"       : "replicate",
    "ChargeType"           : "PrePaid",
    "Engine"               : "MongoDB",
    "DBInstanceClass"      : "dds.xxxxxxxx",
    "DBInstanceId"         : "dds-bpxxxxxxx",
    "ZoneId"               : "cn-hangzhou",
    "RegionId"             : "cn-hangzhou-h",
    "VPCId"                : "vpc-bpxxxxxxxx",
    "EngineVersion"        : "4.2",
    "CurrentKernelVersion" : "mongodb_20210204_4.0.14",
    "StorageEngine"        : "WiredTiger",
    "DBInstanceDescription": "Business System",
    "LockMode"             : "Unlock",
  },
  "fields": {
    "ExpireTime"       : "2020-11-18T08:47:11Z",
    "DBInstanceStorage": "20",
    "ReplicaSets"      : "{Connection Address JSON Data}",
    "message"          : "{Instance JSON Data}",
  }
}

Logging

Slow Query Log

Prerequisites

Note: The code execution of this script depends on the MongoDB instance object collection. If the custom object collection of MongoDB is not configured, the slow log script cannot collect slow log data

Install Slow Query Collection Script

On the basis of the previous steps, you need to install a corresponding MongoDB Slow Query Collection Script

In 「Script Market - Official Script Market」, enter 「Details」, click to install the corresponding script package:

  • 「TrueWatch Integration (Alibaba Cloud-MongoDB Slow Query Log Collection)」(ID: integration_alibabacloud_mongodb)

After the data is synchronized normally, you can view the data in TrueWatch「Logging」.

The reported data example is as follows:

{
  "measurement": "aliyun_mongodb_slowlog",
  "tags": {
    "name"                 : "dds-bpxxxxxxxx",
    "DBInstanceType"       : "replicate",
    "ChargeType"           : "PrePaid",
    "Engine"               : "MongoDB",
    "DBInstanceClass"      : "dds.xxxxxxxx",
    "DBInstanceId"         : "dds-bpxxxxxxx",
    "ZoneId"               : "cn-hangzhou",
    "RegionId"             : "cn-hangzhou-h",
    "VPCId"                : "vpc-bpxxxxxxxx",
    "EngineVersion"        : "4.2",
    "CurrentKernelVersion" : "mongodb_20210204_4.0.14",
    "StorageEngine"        : "WiredTiger",
    "DBInstanceDescription": "Business System",
    "DBName"               : "local",
    "AccountName"          : "Script Development Alibaba Cloud Account",
    "HostAddress"          : "11.xxx.xxx.xx",
    "TableName"            : "oplog",
  },
  "fields": {
    "SQLText"           : "{SQL Statement}",
    "ExecutionStartTime": "1",
    "QueryTimes"        : "1",
    "ReturnRowCounts"   : "1",
    "KeysExamined"      : "1",
    "DocsExamined"      : "1",
  }
}

Partial parameter descriptions are as follows:

Field Type Description
QueryTimes Int Execution duration, in milliseconds
ExecutionStartTime Str Execution start time, UTC time

Note: The fields in tags, fields may change with subsequent updates

Note: fields.message is a JSON serialized string ```