Alibaba Cloud RDS MySQL¶

Display of Alibaba Cloud RDS MySQL Metrics, including CPU usage, memory usage, IOPS, network bandwidth, InnoDB, TPS, QPS, etc.

Configuration¶

Install Func¶

It is recommended to enable TrueWatch integration - extension - DataFlux Func (Automata): all prerequisites are automatically installed. Please continue with the script installation.

If you deploy Func yourself, refer to Self-deployed Func

GSE version deployment is recommended.

Installation Script¶

Note: Please prepare an Alibaba Cloud AK that meets the requirements in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess).

To synchronize monitoring data of RDS cloud resources, we install the corresponding collection script: "TrueWatch Integration (Alibaba Cloud - RDS Collection)" (ID: truewatch_aliyun_rds).

After clicking [Install], input the corresponding parameters: Alibaba Cloud AK, Alibaba Cloud account name.

Click [Deploy Startup Script], and the system will automatically create a Startup script set and automatically configure the corresponding startup script.

In addition, you can see the corresponding automatic trigger configuration in "Manage / Automatic Trigger Configuration". Click [Execute] to run it immediately without waiting for the scheduled time. After a while, you can view the execution task records and corresponding logs.

We default collect some configurations; for details, see the metrics section.

Configure custom cloud object metrics

Verification¶

1. In "Manage / Automatic Trigger Configuration", confirm whether the corresponding task has the corresponding automatic trigger configuration, and check the corresponding task records and logs for any abnormalities.
2. On the TrueWatch platform, under "Infrastructure / Custom", check if there is asset information.
3. On the TrueWatch platform, under "Metrics", check if there are corresponding monitoring data.

Metrics¶

After configuring Alibaba Cloud - Cloud Monitoring, the default metric set is as follows. You can collect more metrics through configuration Alibaba Cloud Cloud Monitoring Metric Details

Objects¶

The collected Alibaba Cloud SLB object data structure can be viewed in "Infrastructure - Custom".

{
  "measurement": "aliyun_rds",
  "tags": {
    "name": "rm-xxxxx",
    "DBInstanceType": "Primary",
    "PayType": "Prepaid",
    "Engine": "MySQL",
    "DBInstanceClass": "rds.mysql.s2.large",
    "DBInstanceId": "rm-xxxxx",
    "ZoneId": "cn-shanghai-h",
    "RegionId": "cn-shanghai",
    "DBInstanceDescription": "Business System",
    "LockMode": "Unlock",
    "Category": "Basic",
    "ConnectionMode": "Standard",
    "DBInstanceNetType": "Intranet",
    "DBInstanceStorageType": "local_ssd"
  },
  "fields": {
    "CreationTime": "2022-12-13T16:00:00Z",
    "ExpireTime": "2022-12-13T16:00:00Z",
    "DiskUsed": "10000",
    "BackupSize": "10000",
    "LogSize": "10000",
    "BackupLogSize": "10000",
    "BackupDataSize": "10000",
    "ConnectionString": "{Connection address JSON data}",
    "DBInstanceStorage": "100",
    "accounts": "{User privilege information JSON data}",
    "databases": "{Database information JSON data}",
    "SSLExpireTime": "2022-10-11T08:16:43Z",
    "message": "{Instance JSON data}"
  }
}

Logs¶

Slow Query Statistics¶

Prerequisites for Slow Query Statistics¶

Note 1: The code execution of this script depends on the collection of RDS instance objects. If the custom object collection for RDS is not configured, the slow log script cannot collect slow log data. Note 2: Due to a 6~8 hour delay in returning statistics from Alibaba Cloud, the collector's data update may also have a delay. Refer to the Alibaba Cloud documentation: Cloud Database RDS Slow Log Statistics Query. Note 3: This collector supports all versions of MySQL (except the basic edition of MySQL 5.7), SQL Server 2008 R2, and MariaDB 10.3 type databases. To collect other types of databases, please use the Alibaba Cloud - RDS Slow Query Detail collector.

Slow Query Statistics Installation Script¶

Based on the previous setup, you need to install another script for RDS Slow Query Statistics Log Collection.

In "Management / Script Market," click and install the corresponding script package:

• "TrueWatch Integration (Alibaba Cloud - RDS Slow Query Statistics Log Collection)" (ID: truewatch_aliyun_rds_slowlog)

After the data synchronizes normally, you can view the data in the "Logs" section of TrueWatch.

An example of the reported data is as follows:

{
  "measurement": "aliyun_rds_slowlog",
  "tags": {
    "name": "rm-xxxxx",
    "DBName": "cloudcare_core",
    "DBInstanceId": "rm-bp1xxxxxxxxxx",
    "RegionId": "cn-hangzhou",
    "DBInstanceType": "Primary",
    "PayType": "Prepaid",
    "Engine": "MySQL",
    "DBInstanceClass": "rds.mysql.s2.large",
    "ZoneId": "cn-shanghai-h",
    "DBInstanceDescription": "Business System"
  },
  "fields": {
    "SQLHASH": "436f9dd030e0a87920bbcd818b34f271",
    "SQLText": "{SQL statement}",
    "CreateTime": "2022-06-05Z",
    "SQLServerTotalExecutionTimes": 0,
    "MaxExecutionTime": 1,
    "MaxLockTime": 0,
    "AvgExecutionTime": 0,
    "MySQLTotalExecutionTimes": 0,
    "SQLServerTotalExecutionTimes": 1,
    "SQLServerTotalExecutionCounts": 0,
    "MySQLTotalExecutionCounts": 0,
    "SQLServerAvgExecutionTime": 0,
    "message": "{Log JSON data}"
  }
}

Descriptions of some parameters are as follows:

Note: Fields such as AvgExecutionTime, SQLServerAvgExecutionTime, SQLServerTotalExecutionTimes, etc., are only supported by SQL Server instances. > Note: Fields in tags and fields may change with subsequent updates.

Slow Query Details¶

Prerequisites for Slow Query Details¶

Note: The code execution of this script depends on the collection of RDS instance objects. If the custom object collection for RDS is not configured, the slow log script cannot collect slow log data.

Slow Query Details Installation Script¶

Based on the previous setup, you need to install another script for RDS Slow Query Details Log Collection.

In "Management / Script Market," click and install the corresponding script package:

• "TrueWatch Integration (Alibaba Cloud - RDS Slow Query Details Log Collection)" (ID: truewatch_aliyun_rds_slowlog_record)

After the data synchronizes normally, you can view the data in the "Logs" section of TrueWatch.

Configure Cloud Database RDS Slow Query Details

An example of the reported data is as follows:

{
  "measurement": "aliyun_rds_slowlog",
  "tags": {
    "name": "rm-xxxxx",
    "DBName": "cloudcare_core",
    "DBInstanceId": "rm-bp1xxxxxxxxxx",
    "RegionId": "cn-hangzhou",
    "DBInstanceType": "Primary",
    "PayType": "Prepaid",
    "Engine": "MySQL",
    "DBInstanceClass": "rds.mysql.s2.large",
    "ZoneId": "cn-shanghai-h",
    "DBInstanceDescription": "Business System",
    "HostAddress": "xxxx",
    "UserName": "xxxx",
    "ClientHostName": "xxxx",
    "ApplicationName": "xxxx"
  },
  "fields": {
    "SQLHASH": "436f9dd030e0a87920bbcd818b34f271",
    "SQLText": "{SQL statement}",
    "QueryTimes": 0,
    "QueryTimesMS": 0,
    "ReturnRowCounts": 0,
    "ParseRowCounts": 0,
    "ExecutionStartTime": "2022-02-02T12:00:00Z",
    "CpuTime": 1,
    "RowsAffectedCount": 0,
    "LastRowsAffectedCount": 0,
    "message": "{Log JSON data}"
  }
}

Descriptions of some fields are as follows:

Note: Fields such as CpuTime, RowsAffectedCount, LastRowsAffectedCount are only supported by SQL Server instances. > Note: Fields in tags and fields may change with subsequent updates. Note: fields.message is a JSON serialized string.