Skip to content

Alibaba Cloud Lindorm

Use the "TrueWatch Cloud Sync" script package in the script market to synchronize cloud monitoring and cloud asset data to TrueWatch.

Configuration

Install Func

It is recommended to activate the TrueWatch Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed, please proceed with the script installation.

If you want to deploy Func manually, refer to Manual Deployment of Func

Install Func

It is recommended to activate the TrueWatch Integration - Extensions - DataFlux Func (Automata)

If you want to deploy Func manually, refer to Manual Deployment of Func

Activate Script

Note: Please prepare the Alibaba Cloud AK with the required permissions in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess)

Activate Script in Automata Version

  1. Log in to the TrueWatch console
  2. Click the 【Integration】 menu, and select 【Cloud Account Management】
  3. Click 【Add Cloud Account】, select 【Alibaba Cloud】, and fill in the required information on the interface. If you have already configured the cloud account information, skip this step
  4. Click 【Test】, and if the test is successful, click 【Save】. If the test fails, please check whether the relevant configuration information is correct and test again
  5. Click 【Cloud Account Management】, and you can see the added cloud account in the list. Click the corresponding cloud account to enter the details page
  6. Click the 【Integration】 button on the cloud account details page, and find Alibaba Cloud Lindorm in the Not Installed list. Click the 【Install】 button, and the installation interface will pop up for installation.

Activate Script Manually

  1. Log in to the Func console, click 【Script Market】, enter the TrueWatch script market, and search: integration_alibabacloud_lindorm

  2. Click 【Install】, and enter the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.

  3. Click 【Deploy Startup Script】, the system will automatically create the Startup script set, and automatically configure the corresponding startup script.

  4. After activation, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click 【Execute】, and you can execute it immediately without waiting for the scheduled time. After a while, you can check the execution task record and corresponding logs.

Verification

  1. In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can also check the corresponding task record and logs to see if there are any exceptions
  2. In TrueWatch, check whether the asset information exists in 「Infrastructure / Custom」
  3. In TrueWatch, check whether there is corresponding monitoring data in 「Metrics」

Metrics

After configuring Alibaba Cloud Cloud Monitoring, the default Measurement is as follows. You can collect more Metrics by configuring Alibaba Cloud Cloud Monitoring Metrics Details

Note: You need to install the monitoring plugin in the Aliyun Lindorm console

MetricName MetricDescribe Dimensions Statistics Unit MinPeriods
load_one 5-minute average load userId,instanceId,host Average,Maximum,Minimum load 60 s
load_five 5-minute average load userId,instanceId,host Average,Maximum,Minimum load 60 s
cpu_system CPU utilization System userId,instanceId,host Average,Maximum,Minimum % 60 s
cpu_user CPU utilization User userId,instanceId,host Average,Maximum,Minimum % 60 s
cpu_idle CPU idle rate userId,instanceId,host Average,Maximum,Minimum % 60 s
cpu_wio CPU utilization IOWait userId,instanceId,host Average,Maximum,Minimum % 60 s
mem_total Total memory (total) userId,instanceId,host Average,Maximum,Minimum bytes 60 s
mem_used_percent Memory usage ratio userId,instanceId,host Average,Maximum,Minimum % 60 s
mem_free Free memory size (free) userId,instanceId,host Average,Maximum,Minimum bytes 60 s
mem_buff_cache Cache size (buff/cache) userId,instanceId,host Average,Maximum,Minimum bytes 60 s
mem_shared Shared memory size (shared) userId,instanceId,host Average,Maximum,Minimum bytes 60 s
bytes_in Network inflow per second userId,instanceId,host Average,Maximum,Minimum bytes/s 60 s
bytes_out Network outflow per second userId,instanceId,host Average,Maximum,Minimum bytes/s 60 s
storage_used_percent Storage space usage ratio userId,instanceId,host Average,Maximum,Minimum % 60 s
storage_used_bytes Storage space usage userId,instanceId,host Average,Maximum,Minimum bytes 60 s
storage_total_bytes Total storage space userId,instanceId,host Average,Maximum,Minimum bytes 60 s
hot_storage_used_percent Hot storage usage ratio userId,instanceId,host Average,Maximum % 60 s
hot_storage_used_bytes Hot storage usage userId,instanceId,host Average,Maximum bytes 60 s
hot_storage_total_bytes Hot storage total capacity userId,instanceId,host Average,Maximum bytes 60 s
cold_storage_used_percent Cold storage usage percentage userId,instanceId,host Average,Maximum,Minimum % 60 s
cold_storage_used_bytes Cold storage usage userId,instanceId,host Average,Maximum,Minimum bytes 60 s
cold_storage_total_bytes Cold storage total capacity userId,instanceId,host Average,Maximum,Minimum bytes 60 s
cold_storage_token_percent Cold storage read token usage ratio userId,instanceId,host Average,Maximum,Minimum % 60 s
store_locality Storage localization rate userId,instanceId,host Average,Maximum,Minimum % 60 s
disk_readbytes Disk read traffic userId,instanceId,host Average,Maximum,Minimum bytes/s 60 s
disk_writebytes Disk write traffic userId,instanceId,host Average,Maximum,Minimum bytes/s 60 s
table_cold_storage_used_bytes Wide table cold storage usage userId,instanceId,host Average,Maximum,Minimum bytes 60 s
table_hot_storage_used_bytes Wide table hot storage usage userId,instanceId,host Average,Maximum,Minimum Byte 60 s
read_ops Read requests userId,instanceId,host Average,Maximum,Minimum countS 60 s
read_rt Read average RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
read_data_kb Read traffic userId,instanceId,host Average,Maximum,Minimum KB/s 60 s
get_num_ops Get requests userId,instanceId,host Average,Maximum,Minimum countS 60 s
get_rt_avg Get average RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
get_rt_p99 Get operation P99 latency userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
scan_num_ops Scan requests userId,instanceId,host Average,Maximum,Minimum countS 60 s
scan_rt_avg Scan average latency userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
scan_rt_p99 Scan P99 latency userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
thrift_call_num_ops Thrift requests userId,instanceId Average count 60 s
thrift_call_mean Thrift request average time userId,instanceId Average milliseconds 60 s
thrift_call_time_in_queue_ops Thrift request queue wait count userId,instanceId Average count 60 s
thrift_call_time_in_queue Thrift request queue wait time userId,instanceId Average ms 60 s
write_ops Write requests userId,instanceId,host Average,Maximum,Minimum countS 60 s
write_rt Write average RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
write_data_kb Write traffic userId,instanceId,host Average,Maximum,Minimum KB/s 60 s
put_num_ops Put requests userId,instanceId,host Average,Maximum,Minimum countS 60 s
put_rt_avg Put average RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
put_rt_p99 Put P99 latency userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
above_memstore_count Exceed memstore limit count userId,instanceId,host Average,Maximum,Minimum frequency 60 s
lql_connection sql connections userId,instanceId,host Average,Maximum count 60 s
lql_select_ops Select requests userId,instanceId,host Average,Maximum countSecond 60 s
lql_upsert_avg_rt upsert request average time userId,instanceId,host Average,Maximum milliseconds 60 s
lql_upsert_ops upsert requests userId,instanceId,host Average,Maximum countSecond 60 s
lql_select_p99_rt Select p99 time userId,instanceId,host Average,Maximum milliseconds 60 s
lql_select_avg_rt Select request average time userId,instanceId,host Average,Maximum milliseconds 60 s
lql_upsert_p99_rt upsert p99 time userId,instanceId,host Average,Maximum milliseconds 60 s
lql_delete_ops Delete requests userId,instanceId,host Average,Maximum countSecond 60 s
lql_delete_avg_rt Delete request average time userId,instanceId,host Average,Maximum milliseconds 60 s
lql_delete_p99_rt Delete p99 time userId,instanceId,host Average,Maximum milliseconds 60 s
regions_per_ldserver RegionServer managed Region count userId,instanceId,host Average,Maximum,Minimum count 极速型实例
handler_queue_size HandlerQueue length userId,instanceId,host Average,Maximum,Minimum count 60 s
compaction_queue_size Compaction queue length userId,instanceId,host Average,Maximum,Minimum count 60 s
tsdb_jvm_used_percent JVM memory usage userId,instanceId,host Average,Maximum,Minimum % 60 s
tsdb_disk_used Disk usage userId,instanceId,host Average,Maximum,Minimum Gbyte 60 s
`tsdb_hot_storage_极速型实例 60 s
tsdb_cold_storage_used_bytes Time series cold storage usage userId,instanceId,host Average,Maximum,Minimum bytes 60 s
tsdb_datapoints_added Data point count userId,instanceId,host Average,Maximum,Minimum count 60 s
search_cold_storage_used_bytes Search cold storage usage userId,instanceId,host Average,Maximum,Minimum bytes 60 s
search_hot_storage_used_bytes Search hot storage usage userId,instanceId,host Average,Maximum,Minimum bytes 60 s
search_select_count Select total count userId,instanceId,host Average,Maximum,Minimum count 60 s
search_select_meanRate Select average ops userId,instanceId,host Average,Maximum,Minimum countS 60 s
search_select_mean_rt Select average RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_select_p95_rt Select p95 RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_select_p999_rt Select p999 RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_select_p99_rt Select p99 RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_update_count Update total count userId,instanceId,host Average,Maximum,Minimum count 60 s
search_update_meanRate Update average ops userId,极速型实例 60 s
search_update_mean_rt Update average RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_update_p95_rt Update p95 RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_update_p99_rt Update p99 RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
search_update_p999_rt Update p999 RT userId,instanceId,host Average,Maximum,Minimum milliseconds 60 s
worker_count Worker node count userId,instanceId,host Average,Maximum,Minimum count 60 s
failed_job_count Failed job count userId,instanceId,host Average,Maximum,Minimum count 60 s
warn_job_count Abnormal job count userId,instanceId,host Average,Maximum,Minimum count 60 s
task_delay_max Maximum task delay userId,instanceId,host Average,Maximum,Minimum ms 60 s
## Objects
The collected Alibaba Cloud Lindorm object data structure can be seen in 「Infrastructure - Custom」 
{
  "measurement": "aliyun_lindorm",
  "tags": {
    "name"           : "r-bp12xxxxxxx",
    "InstanceId"     : "r-bp12xxxxxxx",
    "InstanceStatus" : "CREATING",
    "NetworkType"    : "vpc",
    "PayType"        : "POSTPAY",
    "RegionId"       : "cn-hangzhou",
    "ServiceType"    : "lindorm_standalone",
    "VpcId"          : "vpc-bp1pxxxxxx4t75e73v",
    "ZoneId"         : "cn-hangzhou-f",
    "account_name"   : "xxx account",
    "cloud_provider" : "aliyun"
  },
  "fields": {
    "CreateTime"      : "2023-07-14 10:54:05",
    "EnableStream"    : "False",
    "InstanceStorage" : "20",
    "message"         : "{Instance JSON data}"
  }
}

Note: The fields in tags, fields may change with subsequent updates

Tip 1: The value of tags.name is the instance ID, used as the unique identifier

Tip 2: fields.message is the JSON serialized string

```