GCP BigQuery¶
Collect GCP BigQuery metrics.
Configuration¶
Install Func¶
We recommend enabling TrueWatch Integration - Extensions - Managed Func. All prerequisites are installed automatically; continue with the script installation.
If you deploy Func yourself, see Self-deploying Func.
Install Script¶
- Log in to the Func console, click [Script Market], open the TrueWatch Script Market, and search for
integration_gcp_bigquery. - Click [Install], then enter the required parameters: account file name, Target Principal, and account name.
- Click [Deploy Startup Script]. The system automatically creates a
Startupscript set and configures the corresponding startup script. - After enabling it, find the automatic trigger configuration under "Management / Automatic Trigger Configuration". Click [Execute] to run it immediately, then review the task record and logs.
Verification¶
- Under "Management / Automatic Trigger Configuration", confirm that the task exists and check its task records and logs for errors.
- In TrueWatch, check "Infrastructure / Custom" for the corresponding asset information.
- In TrueWatch, check "Metrics" for the corresponding measurement and monitoring data.
Metrics¶
GCP BigQuery metrics are stored in the gcp_bigquery measurement. The original metrics come from the Cloud Monitoring bigquery.googleapis.com/ namespace. The table below lists key metrics; see GCP BigQuery metrics for the complete metric catalog.
| Metric | Original Metric | Description | Unit |
|---|---|---|---|
| query_count | query/count |
Query count | Count |
| query_execution_count | query/execution_count |
Query execution count | Count |
| query_execution_times | query/execution_times |
Query execution times | s |
| query_scanned_bytes | query/scanned_bytes |
Query scanned bytes | Bytes |
| query_scanned_bytes_billed | query/scanned_bytes_billed |
Query scanned bytes billed | Bytes |
| query_statement_scanned_bytes | query/statement_scanned_bytes |
Query statement scanned bytes | Bytes |
| slots_allocated | slots/allocated |
Slots allocated | Count |
| slots_allocated_for_project | slots/allocated_for_project |
Slots allocated for project | Count |
| slots_allocated_for_project_and_job_type | slots/allocated_for_project_and_job_type |
Slots allocated for project and job type | Count |
| slots_capacity_committed | slots/capacity_committed |
Slots capacity committed | Count |
| storage_stored_bytes | storage/stored_bytes |
Storage stored bytes | Bytes |
| storage_table_count | storage/table_count |
Storage table count | Count |
| storage_uploaded_bytes | storage/uploaded_bytes |
Storage uploaded bytes | Bytes |
| storage_uploaded_bytes_billed | storage/uploaded_bytes_billed |
Storage uploaded bytes billed | Bytes |
| storage_uploaded_row_count | storage/uploaded_row_count |
Storage uploaded row count | Count |