Skip to content

Alibaba Cloud ClickHouse

Alibaba Cloud ClickHouse Metrics display, including service status, log traffic, operation count, overall QPS, etc.

Configuration

Install Func

It is recommended to activate TrueWatch Integration - Extensions - DataFlux Func (Automata)

If deploying Func manually, refer to Deploy Func Manually

Activate Script

Note: Please prepare an Alibaba Cloud AK that meets the requirements in advance (for simplicity, you can directly grant the global read-only permission ReadOnlyAccess)

Activate Script for Automata

  1. Log in to the TrueWatch console
  2. Click the 【Integration】 menu, select 【Cloud Account Management】
  3. Click 【Add Cloud Account】, select 【Alibaba Cloud】, and fill in the required information on the interface. If the cloud account information has been configured before, ignore this step
  4. Click 【Test】, and after successful testing, click 【Save】. If the test fails, please check whether the relevant configuration information is correct and test again
  5. In the 【Cloud Account Management】 list, you can see the added cloud account. Click the corresponding cloud account to enter the details page
  6. Click the 【Integration】 button on the cloud account details page, find Alibaba Cloud-ClickHouse Community Edition in the Not Installed list, and click the 【Install】 button to pop up the installation interface for installation.

Activate Script Manually

  1. Log in to the Func console, click 【Script Market】, enter the TrueWatch script market, and search for: integration_alibabacloud_clickhouse_community

  2. Click 【Install】, then enter the corresponding parameters: Alibaba Cloud AK ID, AK Secret, and account name.

  3. Click 【Deploy Startup Script】, the system will automatically create the Startup script set and automatically configure the corresponding startup script.

  4. After activation, you can see the corresponding automatic trigger configuration in 「Manage / Automatic Trigger Configuration」. Click 【Execute】 to execute it immediately without waiting for the scheduled time. After a while, you can check the execution task records and corresponding logs.

Verification

  1. In 「Manage / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can also check the corresponding task records and logs to check for any exceptions
  2. In TrueWatch, check whether asset information exists in 「Infrastructure / Custom」
  3. In TrueWatch, check whether there is corresponding monitoring data in 「Metrics」

Metrics

After configuring Alibaba Cloud Cloud Monitor, the default Measurement is as follows. More Metrics can be collected through configuration Alibaba Cloud Cloud Monitor Metrics Details

Metric Id Metric Name Dimensions Statistics Unit
clickhouse_cold_storage_data_cc Cold Storage Usage userId,clusterId,app,pod Byte Frequency
clickhouse_conn_usage_count_cc Connection Count userId,clusterId,app,pod Sum Frequency
clickhouse_cpu_utilization_cc CPU Utilization userId,clusterId,app,pod % Frequency
clickhouse_delayed_inserts_cc Delayed Insert Count userId,clusterId,app,pod Count Count
clickhouse_disk_utilization_cc Disk Utilization userId,clusterId,app,pod % Lines
clickhouse_distributed_files_count_cc Distributed Table File Count userId,clusterId,app,pod Count Lines/Minute
clickhouse_failed_insert_query_cc Failed Insert Query Count userId,clusterId,app,pod Count Count
clickhouse_failed_query_cc Failed Query Count userId,clusterId,app,pod Count Count
clickhouse_failed_select_query_cc Failed Select Query Count userId,clusterId,app,pod Count Count
clickhouse_http_conn_usage_count_cc HTTP Connection Count userId,clusterId,app,pod Count Count
clickhouse_memory_utilization_cc Memory Utilization userId,clusterId,app,pod % bytes
clickhouse_network_rx_rate_cc Network Throughput In Rate userId,clusterId,app,pod bps bps
clickhouse_network_tx_rate_cc Network Throughput Out Rate userId,clusterId,app,pod bps bps
clickhouse_qps_cc QPS userId,clusterId,app,pod Count Count