GCP Dataflow¶

Collect GCP Dataflow metrics.

Configuration¶

Install Func¶

We recommend enabling TrueWatch Integration - Extensions - Managed Func. All prerequisites are installed automatically; continue with the script installation.

If you deploy Func yourself, see Self-deploying Func.

Install Script¶

1. Log in to the Func console, click [Script Market], open the TrueWatch Script Market, and search for integration_gcp_dataflow.
2. Click [Install], then enter the required parameters: account file name, Target Principal, and account name.
3. Click [Deploy Startup Script]. The system automatically creates a Startup script set and configures the corresponding startup script.
4. After enabling it, find the automatic trigger configuration under "Management / Automatic Trigger Configuration". Click [Execute] to run it immediately, then review the task record and logs.

Verification¶

1. Under "Management / Automatic Trigger Configuration", confirm that the task exists and check its task records and logs for errors.
2. In TrueWatch, check "Infrastructure / Custom" for the corresponding asset information.
3. In TrueWatch, check "Metrics" for the corresponding measurement and monitoring data.

Metrics¶

GCP Dataflow metrics are stored in the gcp_dataflow measurement. The original metrics come from the Cloud Monitoring dataflow.googleapis.com/ namespace. The table below lists key metrics; see GCP Dataflow metrics for the complete metric catalog.