AWS Firehose¶

Collect AWS Firehose Metrics

Configuration¶

Install Func¶

It is recommended to activate the TrueWatch Integration - Extensions - DataFlux Func (Automata): All prerequisites are automatically installed. Please proceed with the script installation.

If you need to deploy Func manually, refer to Manual Deployment of Func

Install Script¶

Note: Please prepare the required Amazon AK in advance (for simplicity, you can directly grant global read-only permissions ReadOnlyAccess)

Automata Version Activation Script¶

1. Log in to the TrueWatch console
2. Click on the 【Integration】 menu, select 【Cloud Account Management】
3. Click on 【Add Cloud Account】, select 【AWS】, and fill in the required information on the interface. If you have already configured the cloud account information before, ignore this step
4. Click on 【Test】, and if the test is successful, click on 【Save】. If the test fails, please check the relevant configuration information and test again
5. Click on the 【Cloud Account Management】 list to see the added cloud account, click on the corresponding cloud account to enter the details page
6. Click on the 【Integration】 button on the cloud account details page, find AWS Firehose under the Not Installed list, and click on the 【Install】 button to pop up the installation interface and install it.

Manual Activation Script¶

1. Log in to the Func console, click on 【Script Market】, enter the TrueWatch script market, and search for aws_firehose

2. Click on 【Install】, and enter the corresponding parameters: AWS AK ID, AK Secret, and account name.

3. Click on 【Deploy Startup Script】, the system will automatically create a Startup script set and automatically configure the corresponding startup script.

4. After enabling, you can see the corresponding automatic trigger configuration in 「Management / Automatic Trigger Configuration」. Click on 【Execute】 to immediately execute it once without waiting for the scheduled time. Wait for a moment, and you can check the execution task record and corresponding logs.

Verification¶

1. In 「Management / Automatic Trigger Configuration」, confirm whether the corresponding task has the corresponding automatic trigger configuration, and you can also check the corresponding task record and logs to see if there are any exceptions
2. In TrueWatch, check whether the asset information exists in 「Infrastructure / Custom」
3. In TrueWatch, check whether there is corresponding monitoring data in 「Metrics」

Metrics¶

After configuring Amazon CloudWatch, the default Measurement is as follows. You can collect more Metrics through configuration:

Amazon CloudWatch AWS Firehose Metrics Details

AWS Firehose¶

Delivery to Amazon Redshift¶

Delivery to Amazon S3 (Primary Destination)¶

Delivery to Snowflake¶

Delivery to Splunk¶

Delivery to HTTP Endpoint¶

Delivery to OpenSearch Service¶

Amazon S3¶

Delivery to OpenSearch Serverless¶