Alibaba Cloud¶
Alibaba Cloud MongoDB replica set Metrics display, including CPU usage, memory usage, disk usage, data disk space usage, log disk space usage, statements executed per second, number of requests, number of connections, network traffic, replication delay, QPS, etc.
Alibaba Cloud MongoDB sharded cluster Metrics display, including CPU usage, memory usage, disk usage, data disk space usage, log disk space usage, statements executed per second, number of requests, number of connections, network traffic, replication delay, QPS, etc.
Alibaba Cloud MongoDB single node instance Metrics display, including CPU usage, memory usage, disk usage, data disk space usage, statements executed per second, number of requests, number of connections, network traffic, QPS, etc.
Configuration¶
Install Func¶
It is recommended to activate TrueWatch Integration - Extensions - DataFlux Func (Automata)
If you want to deploy Func yourself, refer to Deploy Func Yourself
Activate Script¶
Note: Please prepare the Alibaba Cloud AK that meets the requirements in advance (for simplicity, you can directly grant the global read-only permission
ReadOnlyAccess)
Activate Script for DataFlux Func (Automata)¶
- Log in to the TrueWatch console
- Click the 【Integration】 menu and select 【Cloud Account Management】
- Click 【Add Cloud Account】, select 【Alibaba Cloud】, and fill in the required information on the interface. If you have already configured the cloud account information, ignore this step
- Click 【Test】, and after the test is successful, click 【Save】. If the test fails, please check whether the relevant configuration information is correct and test again
- Click 【Cloud Account Management】, and you can see the added cloud account in the list. Click the corresponding cloud account to enter the details page
- Click the 【Integration】 button on the cloud account details page, find
Alibaba Cloud MongoDBin theNot Installedlist, and click the 【Install】 button to pop up the installation interface and install it.
Activate Script Manually¶
-
Log in to the Func console, click 【Script Market】, enter the TrueWatch script market, and search for:
integration_alibabacloud_mongodb -
Click 【Install】, and then enter the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.
-
Click 【Deploy Startup Script】, the system will automatically create the
Startupscript set and automatically configure the corresponding startup script. -
After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. Wait a moment, you can view the execution task records and corresponding logs.
Verification¶
- In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can also view the corresponding task records and logs to check for any exceptions
- In TrueWatch, check whether asset information exists in 「Infrastructure / Custom」
- In TrueWatch, check whether there is corresponding monitoring data in 「Metrics」
Metrics¶
After configuring Alibaba Cloud CloudMonitor, the default collected Metrics are as follows. More Metrics can be collected through configuration. For more Metrics, please refer to: Alibaba Cloud CloudMonitor Metrics Details
Alibaba Cloud MongoDB - Replica Set¶
| Metric Id | MetricCategory | Metric Name | Dimensions | Statistics | Unit | Min Periods |
|---|---|---|---|---|---|---|
CPUUtilization |
mongodb_replicaset |
CPU Usage | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
ConnectionAmount |
mongodb_replicaset |
Number of Connections | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
ConnectionUtilization |
mongodb_replicaset |
Connection Utilization | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
DataDiskAmount |
mongodb_replicaset |
Data Disk Space Usage | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
DiskUtilization |
mongodb_replicaset |
Disk Utilization | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
IOPSUtilization |
mongodb_replicaset |
IOPS Utilization | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
InstanceDiskAmount |
mongodb_replicaset |
Instance Disk Space Usage | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
IntranetIn |
mongodb_replicaset |
Network Inbound Traffic | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
IntranetOut |
mongodb_replicaset |
Network Outbound Traffic | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
LogDiskAmount |
mongodb_replicaset |
Log Disk Space Usage | userId,instanceId,role | Average,Minimum,Maximum | bytes | 60 s |
MemoryUtilization |
mongodb_replicaset |
Memory Utilization | userId,instanceId,role | Average,Minimum,Maximum | % | 60 s |
NumberRequests |
mongodb_replicaset |
Number of Requests | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
OpCommand |
mongodb_replicaset |
Command Operations | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpDelete |
mongodb_replicaset |
Delete Operations | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpGetmore |
mongodb_replicaset |
Getmore Operations | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpInsert |
mongodb_replicaset |
Insert Operations | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
OpQuery |
mongodb_replicaset |
Query Operations | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
OpUpdate |
mongodb_replicaset |
Update Operations | userId,instanceId,role | Average,Minimum,Maximum | Frequency | 60 s |
QPS |
mongodb_replicaset |
Average SQL Queries Per Second | userId,instanceId,role | Average,Minimum,Maximum | Count | 60 s |
ReplicationLag |
mongodb_replicaset |
Replication Delay | userId,instanceId,role | Average,Maximum,Minimum,cms_null | seconds | 60 s |
Alibaba Cloud MongoDB - Sharded Cluster¶
| Metric Id | MetricCategory | Metric Name | Dimensions | Statistics | Unit | Min Periods |
|---|---|---|---|---|---|---|
ShardingCPUUtilization |
mongodb_sharding |
CPU Usage | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingConnectionAmount |
mongodb_sharding |
Number of Connections | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingConnectionUtilization |
mongodb_sharding |
Connection Utilization | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingDataDiskAmount |
mongodb_sharding |
Data Disk Space Usage | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Bytes | 60 s |
ShardingDataDiskAmountOriginal |
mongodb_sharding |
ShardingDataDiskAmountOriginal | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | - | 60 s |
ShardingDiskUtilization |
mongodb_sharding |
Disk Utilization | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingIOPSUtilization |
mongodb_sharding |
IOPS Utilization | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingInstanceDiskAmount |
mongodb_sharding |
Instance Disk Space Usage | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Bytes | 60 s |
ShardingIntranetIn |
mongodb_sharding |
Network Inbound Traffic | userId,instanceId,subinstanceId,role |
Average | Bytes | 60 s |
ShardingIntranetOut |
mongodb_sharding |
Network Outbound Traffic | userId,instanceId,subinstanceId,role |
Average | Bytes | 60 s |
ShardingLogDiskAmount |
mongodb_sharding |
Log Disk Space Usage | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Bytes | 60 s |
ShardingMemoryUtilization |
mongodb_sharding |
Memory Utilization | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | % | 60 s |
ShardingNumberRequests |
mongodb_sharding |
Number of Requests | userId,instanceId,subinstanceId,role |
Average | Count | 60 s |
ShardingOpCommand |
mongodb_sharding |
Command Operations | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpDelete |
mongodb_sharding |
Delete Operations | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpGetmore |
mongodb_sharding |
Getmore Operations | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpInsert |
mongodb_sharding |
Insert Operations | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
ShardingOpQuery |
mongodb_sharding |
Query Operations | userId,instanceId,subinstanceId,role |
Average,Minimum,Maximum | Count | 60 s |
Alibaba Cloud MongoDB - Single Node Instance¶
| Metric Id | MetricCategory | Metric Name | Dimensions | Statistics | Unit | Min Periods |
|---|---|---|---|---|---|---|
SingleNodeCPUUtilization |
mongodb_singlenode |
CPU Usage | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeConnectionAmount |
mongodb_singlenode |
Number of Connections | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeConnectionUtilization |
mongodb_singlenode |
Connection Utilization | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeDataDiskAmount |
mongodb_singlenode |
Data Disk Space Usage | userId,instanceId | Average,Minimum,Maximum | bytes | 60 s |
SingleNodeDiskUtilization |
mongodb_singlenode |
Disk Utilization | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeIntranetIn |
mongodb_singlenode |
Network Inbound Traffic | userId,instanceId | Average,Minimum,Maximum | bytes | 60 s |
SingleNodeIntranetOut |
mongodb_singlenode |
Network Outbound Traffic | userId,instanceId | Average,Minimum,Maximum | bytes | 60 s |
SingleNodeMemoryUtilization |
mongodb_singlenode |
Memory Utilization | userId,instanceId | Average,Minimum,Maximum | % | 60 s |
SingleNodeNumberRequests |
mongodb_singlenode |
Number of Requests | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpCommand |
mongodb_singlenode |
Command Operations | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpDelete |
mongodb_singlenode |
Delete Operations | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpGetmore |
mongodb_singlenode |
Getmore Operations | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpInsert |
mongodb_singlenode |
Insert Operations | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpQuery |
mongodb_singlenode |
Query Operations | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeOpUpdate |
mongodb_singlenode |
Update Operations | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
SingleNodeQPS |
mongodb_singlenode |
QPS | userId,instanceId | Average,Minimum,Maximum | Count | 60 s |
Object¶
The collected Alibaba Cloud MongoDB object data structure can be seen in 「Infrastructure - Custom」
{
"measurement": "aliyun_mongodb",
"tags": {
"name" : "dds-bpxxxxxxxx",
"DBInstanceType" : "replicate",
"ChargeType" : "PrePaid",
"Engine" : "MongoDB",
"DBInstanceClass" : "dds.xxxxxxxx",
"DBInstanceId" : "dds-bpxxxxxxx",
"ZoneId" : "cn-hangzhou",
"RegionId" : "cn-hangzhou-h",
"VPCId" : "vpc-bpxxxxxxxx",
"EngineVersion" : "4.2",
"CurrentKernelVersion" : "mongodb_20210204_4.0.14",
"StorageEngine" : "WiredTiger",
"DBInstanceDescription": "Business System",
"LockMode" : "Unlock",
},
"fields": {
"ExpireTime" : "2020-11-18T08:47:11Z",
"DBInstanceStorage": "20",
"ReplicaSets" : "{Connection Address JSON Data}",
"message" : "{Instance JSON Data}",
}
}
Logging¶
Slow Query Log¶
Prerequisites¶
Note: The code execution of this script depends on the MongoDB instance object collection. If the custom object collection of MongoDB is not configured, the slow log script cannot collect slow log data
Install Slow Query Collection Script¶
On the basis of the previous steps, you need to install a corresponding MongoDB Slow Query Collection Script
In 「Script Market - Official Script Market」, enter 「Details」, click to install the corresponding script package:
- 「TrueWatch Integration (Alibaba Cloud-MongoDB Slow Query Log Collection)」(ID:
integration_alibabacloud_mongodb)
After the data is synchronized normally, you can view the data in TrueWatch「Logging」.
The reported data example is as follows:
{
"measurement": "aliyun_mongodb_slowlog",
"tags": {
"name" : "dds-bpxxxxxxxx",
"DBInstanceType" : "replicate",
"ChargeType" : "PrePaid",
"Engine" : "MongoDB",
"DBInstanceClass" : "dds.xxxxxxxx",
"DBInstanceId" : "dds-bpxxxxxxx",
"ZoneId" : "cn-hangzhou",
"RegionId" : "cn-hangzhou-h",
"VPCId" : "vpc-bpxxxxxxxx",
"EngineVersion" : "4.2",
"CurrentKernelVersion" : "mongodb_20210204_4.0.14",
"StorageEngine" : "WiredTiger",
"DBInstanceDescription": "Business System",
"DBName" : "local",
"AccountName" : "Script Development Alibaba Cloud Account",
"HostAddress" : "11.xxx.xxx.xx",
"TableName" : "oplog",
},
"fields": {
"SQLText" : "{SQL Statement}",
"ExecutionStartTime": "1",
"QueryTimes" : "1",
"ReturnRowCounts" : "1",
"KeysExamined" : "1",
"DocsExamined" : "1",
}
}
Partial parameter descriptions are as follows:
| Field | Type | Description |
|---|---|---|
QueryTimes |
Int | Execution duration, in milliseconds |
ExecutionStartTime |
Str | Execution start time, UTC time |
Note: The fields in
tags,fieldsmay change with subsequent updatesNote:
fields.messageis a JSON serialized string ```