Alibaba Cloud RDS PostgreSQL¶

Alibaba Cloud RDS PostgreSQL Metrics Display, including CPU usage, memory usage, etc.

Configuration¶

Install Func¶

It is recommended to activate the TrueWatch integration - extension - DataFlux Func (Automata): all prerequisites are automatically installed. Please continue with script installation.

If you deploy Func yourself, refer to Self-deployed Func

It is recommended to deploy the GSE version.

Installation Script¶

Note: Please prepare an appropriate Alibaba Cloud AK in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess).

To synchronize monitoring data of RDS cloud resources, we install the corresponding collection script: "TrueWatch Integration (Alibaba Cloud - RDS Collection)" (ID: truewatch_aliyun_rds)

After clicking [Install], enter the corresponding parameters: Alibaba Cloud AK and Alibaba Cloud account name.

Click [Deploy Startup Script], and the system will automatically create a Startup script set and automatically configure the corresponding startup script.

In addition, you can see the corresponding automatic trigger configuration under "Manage / Automatic Trigger Configuration". Clicking [Execute] will immediately execute once without waiting for the scheduled time. After a short wait, you can view the execution task records and corresponding logs.

We collect some configurations by default; for more details, see the metrics section Customize Cloud Object Metrics

Verification¶

1. In "Manage / Automatic Trigger Configuration", confirm whether the corresponding tasks have the corresponding automatic trigger configuration, and at the same time, you can check the corresponding task records and logs for any abnormalities.
2. On the TrueWatch platform, under "Infrastructure / Custom", check if asset information exists.
3. On the TrueWatch platform, under "Metrics", check if there are corresponding monitoring data.

Metrics¶

Configure Alibaba Cloud - Cloud Monitoring, the default metric set is as follows. You can collect more metrics via configuration Alibaba Cloud Cloud Monitoring Metric Details

Objects¶

The collected Alibaba Cloud RDS PostgreSQL object data structure can be viewed from "Infrastructure - Custom"

{
  "measurement": "aliyun_rds",
  "tags": {
    "name": "rm-xxxxx",
    "DBInstanceType": "Primary",
    "PayType": "Prepaid",
    "Engine": "MySQL",
    "DBInstanceClass": "rds.mysql.s2.large",
    "DBInstanceId": "rm-xxxxx",
    "ZoneId": "cn-shanghai-h",
    "RegionId": "cn-shanghai",
    "DBInstanceDescription": "Business System",
    "LockMode": "Unlock",
    "Category": "Basic",
    "ConnectionMode": "Standard",
    "DBInstanceNetType": "Intranet",
    "DBInstanceStorageType": "local_ssd"
  },
  "fields": {
    "CreationTime": "2022-12-13T16:00:00Z",
    "ExpireTime": "2022-12-13T16:00:00Z",
    "DiskUsed": "10000",
    "BackupSize": "10000",
    "LogSize": "10000",
    "BackupLogSize": "10000",
    "BackupDataSize": "10000",
    "ConnectionString": "{JSON connection address data}",
    "DBInstanceStorage": "100",
    "accounts": "{JSON user permissions data}",
    "databases": "{JSON database data}",
    "SSLExpireTime": "2022-10-11T08:16:43Z",
    "message": "{JSON instance data}"
  }
}

Logs¶

Slow Query Statistics¶

Prerequisites for Slow Query Statistics¶

Note 1: The operation of this script's code depends on the collection of RDS instance objects. If the custom object collection for RDS is not configured, the slow log script cannot collect slow log data. Note 2: Due to the 6~8 hours delay in returning statistics data from Alibaba Cloud, there may be delays in updating the collector's data. For more details, refer to the Alibaba Cloud documentation: Cloud Database RDS Query Slow Log Statistics. Note 3: This collector supports all versions of MySQL (except the basic edition of MySQL 5.7), SQL Server 2008 R2, MariaDB 10.3 type databases. To collect other types of databases, use the Alibaba Cloud-RDS Slow Query Detail collector.

Slow Query Statistics Installation Script¶

On top of the previous setup, you need to install another script corresponding to RDS Slow Query Statistics Log Collection.

In "Manage / Script Market," click and install the corresponding script package:

• "TrueWatch Integration (Alibaba Cloud - RDS Slow Query Statistics Log Collection)" (ID: truewatch_aliyun_rds_slowlog)

Once the data is synchronized correctly, you can view it under the "Logs" section of TrueWatch.

An example of the reported data is as follows:

{
  "measurement": "aliyun_rds_slowlog",
  "tags": {
    "name": "rm-xxxxx",
    "DBName": "cloudcare_core",
    "DBInstanceId": "rm-bp1xxxxxxxxxx",
    "RegionId": "cn-hangzhou",
    "DBInstanceType": "Primary",
    "PayType": "Prepaid",
    "Engine": "MySQL",
    "DBInstanceClass": "rds.mysql.s2.large",
    "ZoneId": "cn-shanghai-h",
    "DBInstanceDescription": "Business System"
  },
  "fields": {
    "SQLHASH": "436f9dd030e0a87920bbcd818b34f271",
    "SQLText": "{SQL Statement}",
    "CreateTime": "2022-06-05Z",
    "SQLServerTotalExecutionTimes": 0,
    "MaxExecutionTime": 1,
    "MaxLockTime": 0,
    "AvgExecutionTime": 0,
    "MySQLTotalExecutionTimes": 0,
    "SQLServerTotalExecutionTimes": 1,
    "SQLServerTotalExecutionCounts": 0,
    "MySQLTotalExecutionCounts": 0,
    "SQLServerAvgExecutionTime": 0,
    "message": "{Log JSON data}"
  }
}

Some parameter explanations are as follows:

Note: Fields such as AvgExecutionTime, SQLServerAvgExecutionTime, SQLServerTotalExecutionTimes, etc., are only supported by SQL Server instances. > Note: Fields in tags and fields may change with subsequent updates.

Slow Query Details¶

Prerequisites for Slow Query Details¶

Note: The operation of this script's code depends on the collection of RDS instance objects. If the custom object collection for RDS is not configured, the slow log script cannot collect slow log data.

Slow Query Details Installation Script¶

On top of the previous setup, you need to install another script corresponding to RDS Slow Query Detail Log Collection.

In "Manage / Script Market," click and install the corresponding script package:

• "TrueWatch Integration (Alibaba Cloud-RDS Slow Query Detail Log Collection)" (ID: truewatch_aliyun_rds_slowlog_record)

Once the data is synchronized correctly, you can view it under the "Logs" section of TrueWatch.

Configuration Cloud Database RDS Slow Query Details

An example of the reported data is as follows:

{
  "measurement": "aliyun_rds_slowlog",
  "tags": {
    "name": "rm-xxxxx",
    "DBName": "cloudcare_core",
    "DBInstanceId": "rm-bp1xxxxxxxxxx",
    "RegionId": "cn-hangzhou",
    "DBInstanceType": "Primary",
    "PayType": "Prepaid",
    "Engine": "MySQL",
    "DBInstanceClass": "rds.mysql.s2.large",
    "ZoneId": "cn-shanghai-h",
    "DBInstanceDescription": "Business System",
    "HostAddress": "xxxx",
    "UserName": "xxxx",
    "ClientHostName": "xxxx",
    "ApplicationName": "xxxx"
  },
  "fields": {
    "SQLHASH": "436f9dd030e0a87920bbcd818b34f271",
    "SQLText": "{SQL Statement}",
    "QueryTimes": 0,
    "QueryTimesMS": 0,
    "ReturnRowCounts": 0,
    "ParseRowCounts": 0,
    "ExecutionStartTime": "2022-02-02T12:00:00Z",
    "CpuTime": 1,
    "RowsAffectedCount": 0,
    "LastRowsAffectedCount": 0,
    "message": "{Log JSON data}"
  }
}

Some parameter explanations are as follows:

Note: Fields such as CpuTime, RowsAffectedCount, LastRowsAffectedCount, etc., are only supported by SQL Server instances. > Note: Fields in tags and fields may change with subsequent updates. Note: fields.message is a JSON serialized string.