Skip to content

GCP BigQuery

Collect GCP BigQuery metrics.

Configuration

Install Func

We recommend enabling TrueWatch Integration - Extensions - Managed Func. All prerequisites are installed automatically; continue with the script installation.

If you deploy Func yourself, see Self-deploying Func.

Install Script

  1. Log in to the Func console, click [Script Market], open the TrueWatch Script Market, and search for integration_gcp_bigquery.
  2. Click [Install], then enter the required parameters: account file name, Target Principal, and account name.
  3. Click [Deploy Startup Script]. The system automatically creates a Startup script set and configures the corresponding startup script.
  4. After enabling it, find the automatic trigger configuration under "Management / Automatic Trigger Configuration". Click [Execute] to run it immediately, then review the task record and logs.

Verification

  1. Under "Management / Automatic Trigger Configuration", confirm that the task exists and check its task records and logs for errors.
  2. In TrueWatch, check "Infrastructure / Custom" for the corresponding asset information.
  3. In TrueWatch, check "Metrics" for the corresponding measurement and monitoring data.

Metrics

GCP BigQuery metrics are stored in the gcp_bigquery measurement. The original metrics come from the Cloud Monitoring bigquery.googleapis.com/ namespace. The table below lists key metrics; see GCP BigQuery metrics for the complete metric catalog.

Metric Original Metric Description Unit
query_count query/count Query count Count
query_execution_count query/execution_count Query execution count Count
query_execution_times query/execution_times Query execution times s
query_scanned_bytes query/scanned_bytes Query scanned bytes Bytes
query_scanned_bytes_billed query/scanned_bytes_billed Query scanned bytes billed Bytes
query_statement_scanned_bytes query/statement_scanned_bytes Query statement scanned bytes Bytes
slots_allocated slots/allocated Slots allocated Count
slots_allocated_for_project slots/allocated_for_project Slots allocated for project Count
slots_allocated_for_project_and_job_type slots/allocated_for_project_and_job_type Slots allocated for project and job type Count
slots_capacity_committed slots/capacity_committed Slots capacity committed Count
storage_stored_bytes storage/stored_bytes Storage stored bytes Bytes
storage_table_count storage/table_count Storage table count Count
storage_uploaded_bytes storage/uploaded_bytes Storage uploaded bytes Bytes
storage_uploaded_bytes_billed storage/uploaded_bytes_billed Storage uploaded bytes billed Bytes
storage_uploaded_row_count storage/uploaded_row_count Storage uploaded row count Count