Tencent Cloud PostgreSQL¶

Use the "TrueWatch Cloud Sync" series script packages in the script market to synchronize cloud monitoring and cloud asset data to TrueWatch

Configuration¶

Install Func¶

It is recommended to enable TrueWatch integration - extension - DataFlux Func (Automata): all prerequisites are automatically installed, please continue with the script installation

If you deploy Func on your own, refer to Self-deploy Func

Install PostgreSQL collection script¶

Note: Please prepare a qualified Tencent Cloud AK in advance (for simplicity, you can directly grant global read-only permission ReadOnlyAccess)

To synchronize PostgreSQL monitoring data, we install the corresponding collection script: "TrueWatch Integration (Tencent Cloud-PostgreSQL Collection)" (ID: truewatch_tencentcloud_postgresql)

After clicking [Install], enter the corresponding parameters: Tencent Cloud AK, Tencent Cloud account name.

Click [Deploy Start Script], the system will automatically create a Startup script set and automatically configure the corresponding start script.

After enabling, you can see the corresponding automatic trigger configuration in "Manage / Automatic Trigger Configuration". Click [Execute], it can be executed immediately without waiting for the regular time. After a while, you can view the execution task records and corresponding logs.

If you want to collect the corresponding logs, you also need to enable the corresponding log collection script. If you want to collect bills, you need to enable the cloud bill collection script.

We default to collecting some configurations, for more details see Configuration Custom Cloud Object Metrics

Verification¶

1. In "Manage / Automatic Trigger Configuration", confirm whether the corresponding tasks have the corresponding automatic trigger configuration, and check the corresponding task records and logs for any abnormalities.
2. On the TrueWatch platform, under "Infrastructure / Custom", check if there is asset information.
3. On the TrueWatch platform, under "Metrics", check if there is corresponding monitoring data.

Metrics¶

After configuring Tencent Cloud - Cloud Monitoring, the default metric set is as follows. You can collect more metrics through configuration Tencent Cloud Cloud Monitoring Metric Details

Monitoring Metrics¶

Objects¶

Collected Tencent Cloud postgresql object data structure, can be seen from "Infrastructure-Custom" objects data

{
  "measurement": "tencentcloud_postgresql",
  "tags": {
    "ClusterType": "0",
    "InstanceId": "cmxxxx",
    "InstanceName": "test_01",
    "InstanceType": "1",
    "MongoVersion": "MONxxxx",
    "NetType": "1",
    "PayMode": "0",
    "ProjectId": "0",
    "RegionId": "ap-nanjing",
    "Status": "2",
    "VpcId": "vpc-nf6xxxxx",
    "Zone": "ap-nanjing-1",
    "name": "cmxxxx"
  },
  "fields": {
    "CloneInstances": "[]",
    "CreateTime": "2022-08-24 13:54:00",
    "DeadLine": "2072-08-24 13:54:00",
    "ReadonlyInstances": "[]",
    "RelatedInstance": "{Instance JSON Data}",
    "ReplicaSets": "{Instance JSON Data}",
    "StandbyInstances": "[]",
    "message": "{Instance JSON Data}"
  }
}

Logs¶

Slow Query Statistics¶

Prerequisites¶

Note 1: The code execution of this script depends on PostgreSQL instance object collection. If PostgreSQL custom object collection is not configured, the slow log script cannot collect slow log data.

Install Log Collection Script¶

On top of the previous setup, you need to install another corresponding PostgreSQL slow query statistics log collection script

In "Manage / Script Market", click and install the corresponding script package:

• "TrueWatch Integration (Tencent Cloud-PostgreSQL Slow Query Log Collection)" (ID: truewatch_tencentcloud_postgresql_slowlog)

After data synchronization is normal, you can view the data in the "Logs" section of TrueWatch.

Example of reported data:

{
  "measurement": "tencentcloud_postgre_slowlog",
  "tags": {
    "AppId": "137185",
    "ClientAddr": "",
    "DBCharset": "UTF8",
    "DBEngine": "postgresql",
    "DBEngineConfig": "",
    "DBInstanceClass": "cdb.pg.ts1.2g",
    "DBInstanceId": "postgres-3coh1xgm",
    "DBInstanceName": "Unnamed",
    "DBInstanceStatus": "running",
    "DBInstanceType": "primary",
    "DBInstanceVersion": "standard",
    "DBVersion": "10.17",
    "DatabaseName": "postgres",
    "PayType": "postpaid",
    "ProjectId": "0",
    "Region": "ap-shanghai",
    "RegionId": "ap-shanghai",
    "SubnetId": "subnet-bp2jqhcj",
    "Type": "TS85",
    "Uid": "4147",
    "UserName": "postgres",
    "VpcId": "vpc-kcpy",
    "Zone": "ap-shanghai-2",
    "name": "postgres-3coh1xgm"
  },
  "fields": {
    "NormalQuery": "select $1 from information_schema.tables where table_schema = $2 and table_name = $3",
    "AvgCostTime": "101.013005",
    "CostTime": "101.013025",
    "FirstTime": "2021-07-27 03:12:01",
    "LastTime": "2021-07-27 03:12:01",
    "MaxCostTime": "101.828125",
    "MinCostTime": "101.828125",
    "message": "{Slow Query JSON Data}"
  }
}

Note: Fields in tags, fields may change with subsequent updates. Note 1: tags values are supplemented by custom objects. Note 2: fields.message is a JSON serialized string.

Appendix¶

TencentCloud-PostgreSQL "Regions"¶

Refer to the official Tencent documentation:

• TencentCloud-MongoDB Region ID

TencentCloud-PostgreSQL "Slow Log Information Documentation"¶

Refer to the official Tencent documentation:

• TencentCloud-PostgreSQL Slow Log Detailed Information Documentation