Changelog (2023)¶

This document records the release notes of TrueWatch for each deployment, including DataKit, TrueWatch Best Practices, TrueWatch Integration Documentation, and TrueWatch.

December 28, 2023¶

TrueWatch Updates¶

• Monitoring:
  • Added User Access Intelligent Detection: Supports performance anomalies and error analysis for websites/APPs, with related detection Metrics such as LCP, FID, CLS, etc.
  • Infrastructure Survival Detection V2: Added Infrastructure Survival V2 version, optimized detection logic, and resolved several triggering issues related to V1 and process detection.
• User Access Monitoring (RUM):
  • Added Public DataWay method to receive RUM data, no collector installation required; Web-type applications support direct upload of SourceMap in the console, allowing multiple files to be uploaded based on different versions and environments.
  • Error Explorer > Error Details: Added Formatted error information page, displaying error information parsed by Sourcemap files, supporting switching between formatted and original error information. If no Sourcemap file is configured or no match is found after upload, only the original format error information is displayed.
• Application Performance Monitoring (APM):
  • Optimized Service Map: Adjusted the display styles for viewing upstream and downstream, nodes, service names, etc.
  • Optimized Service Details: Bound performance view dashboard to display current service performance Metrics, also supports custom user views with the same name for overlay updates, and supports drill-down analysis.
  • Optimized Trace Details flame chart and waterfall chart display: Added execution time and execution percentage display to the flame chart; waterfall chart supports switching between relative time and absolute time display.
• Chart Optimization:
  • Time Series Table Chart added Display Columns configuration: Supports user setting of query data display columns, also supports user-defined manual input of column names; supports manual adjustment of column width in edit mode, and the list information can be displayed according to the column width after saving; supports drag-and-drop adjustment of display column order.
  • Chart links added Value Variables for link jumps.
• Dashboard:
  • Dashboard added Home Dashboard: Supports workspace configuration of home dashboard.
• Infrastructure:
  • Host Explorer added Only Show Online Hosts switch filter: Optimized the logic for obtaining the online host list, supports selecting whether to list only hosts that have reported data in the last 10 minutes.

TrueWatch Deployment Plan Updates¶

• Supports embedding TrueWatch pages in external platforms, using parameters in the URL to hide the left and header menu bars, and supports hiding floating operations.
• Supports embedding TrueWatch dashboard or explorer pages in external platforms through iframe.

New Integrations¶

• Added integration Kubecost

December 14, 2023¶

TrueWatch Updates¶

• Monitoring:
  • Added Intelligent Monitoring:
    • Host Intelligent Detection: Supports sudden increase/decrease/interval rise in CPU, sudden increase/decrease/interval rise in memory detection.
    • Log Intelligent Detection: Supports sudden increase/decrease in log volume, sudden increase in error log detection.
    • Application Intelligent Detection: Supports sudden increase/decrease in request volume, sudden increase in error request volume, sudden increase/decrease/interval rise in request latency detection.
  • Mutation Detection: Added trigger rule preconditions, mutation detection rules are executed when the detection value meets the condition, improving monitoring accuracy.
• Billing:
  • Added Data Forwarding Usage Analysis list: View the forwarding volume of all data forwarding rules in the current workspace. If the forwarding rule is to the TrueWatch backup log module, the corresponding retention policy will be displayed. Also supports time widget filtering for the required data forwarding situation list, facilitating quick viewing of historical log backup overall situation.
• Events:
  • Added Intelligent Monitoring Event Explorer: View all event information generated by intelligent monitoring.
• Logs:
  • Data Access added [Only Show Rules Related to Me] configuration: When enabled, only access rules affecting the current account's data query are displayed.
  • Logs > Explorer: Added data access rule restriction prompts.
• Infrastructure > Containers > Kubernetes:
  • Added Kubernetes Analysis Dashboard: Container object analysis dashboard, helping you understand the infrastructure situation in Kubernetes from different dimensions.
  • Containers > Explorer: Optimized page UI.
• Metrics:
  • Metrics > Explorer:
    • Table chart added [Query Tool] mode: Returns results consistent with Shortcut > Query Tool; if multiple queries are added, the first query result is returned by default; this mode supports exporting up to 1000 query records.
    • Added query condition [Copy] function, optimizing page experience.
    • Query component optimization: Simple query [by grouping] supports free drag-and-drop adjustment of order.
• Explorer:
  • Adjusted all explorers, hiding trend chart display in analysis mode.
• SSO:
  • Optimized SSO user workspace listing logic, fixed the issue of automatic logout due to no access permissions.

TrueWatch Deployment Plan Updates¶

• Added Independent Alert Notification Sending configuration: When enabled, if the alert policy selects [Alert Not Aggregated], each event will send an alert notification, helping you efficiently manage alert notifications.
• Added Event Link Login-Free View configuration: When enabled, all alert notification event links sent by the workspace can be accessed without login. If disabled, all historical login-free links will become invalid, ensuring data security.
• Optimized [Scheduled Reports]: Supports custom query range configuration, the upper limit adjusted from 30 days to 360 days, meeting your extended needs for scheduled reports.

New/Updated Integrations¶

• Added APISIX
• Updated Alibaba Cloud KafKa
• Updated Dameng

November 30, 2023¶

TrueWatch Updates¶

• Monitoring:
  • New Monitor > Event Content > Insert Link: Supports automatic generation of jump links based on detection Metrics, allowing adjustment of filter conditions and time range after inserting the link; supports custom jump links.
  • Alert Strategy Management: Added [Intelligent Aggregation] mode, allowing clustering of events generated within the grouping cycle based on "Title" or "Content", each group will generate an alert notification.
• Management:
  • Optimized the overall style of the module menu page.
  • Added [Attribute Claims]: Helps quickly identify and perform joint queries globally through fixed fields organization, business.
  • Added [Regular Expressions]: Supports switching between [Custom] and [Template Library] lists; supports user-defined regular expression templates and application to [Snapshot Sharing] and [Data Access Rules].
  • Ticket Management:
    • Tickets adjusted from "Account Level" to "Workspace Level", all members can view all tickets within the workspace.
    • Added [All Tickets] list, [Submitter], and [My Tickets] list.
  • Workspace Management: Added risk confirmation prompt for workspace dissolution operation.
  • Workspace [Description] function offline.
  • Data Forwarding: Query and statistics adjustment optimization
    • Query side: Adjusted content display data range, default display excludes time and other data content.
    • Made some robustness optimizations for the data forwarding function.
• Logs:
  • Data Access:
    • Added data desensitization rules, supports configuring multiple fields and applying multiple regular expressions.
    • Supports configuring all [Indexes] and [Roles].
    • Added desensitization preview to judge whether the rules can meet the requirements.
• Snapshot > Share Snapshot:
  • Share link validity period added 1, 3, 7 days, default selected 1 day.
  • Data Desensitization: Supports configuring multiple fields and applying multiple regular expressions.
  • Supports previewing snapshots, allowing you to preview all configured page effects in advance.
• RUM: [New Application] page layout adjustment, optimized user experience.
• Pattern:
  • RUM > Error Explorer & APM > Incident: Adjusted to drain() algorithm aggregation logic in Pattern mode; added input box to modify clustering fields, default is error_message, up to 3 fields can be input, or custom clustering fields can be defined as needed.

TrueWatch Deployment Plan Updates¶

• Added support for custom email header and footer and Logo display text.
• TrueWatch will cancel the Banner information setting, no longer providing support for maintaining Banner information.

New Integrations¶

• Added logstash

New Best Practices¶

• Best Practices for Bidirectional Linkage Between Incident and JIRA

November 21, 2023¶

TrueWatch Updates¶

• Management: [Settings] page added MFA Security Authentication switch, once enabled by the administrator/owner, all users (regular members / SSO members) need to complete MFA authentication before entering the workspace.

TrueWatch Deployment Plan Updates¶

• Added MFA Security Authentication switch, supports identity authentication through system default or custom methods.

November 16, 2023¶

TrueWatch Updates¶

• Monitor:
  • [Alert Mute] function returned, still supports defining the time interval for repeated alert notifications through alert mute configuration.
  • Removed the restriction that "Urgent", "Important", "Warning" trigger conditions must be configured, now supports arbitrary configuration of urgent, important, warning, data interruption, information trigger conditions.
  • Infrastructure Survival Monitoring: Supports Metrics configuration for infrastructure survival detection, allowing higher frequency survival detection configuration through this mode.
• Scenarios
  • Charts:
    • Advanced Settings: [Original Interval] parameter configuration offline, default configuration adjusted to [Auto Align], supports custom selection of chart default data time interval.
    • Time Series Chart: [Display Density] adjusted to [Maximum Return Points], default value is 720, supports defining any integer between 2-1000.
    • Fixed the issue of alias function failure caused by PromQL linkage view variables.
  • Service Management:
    • Added built-in switch dropdown, allowing direct service switching without returning to the list.
    • POD page in details page offline.
    • [Resource Invocation] performance chart changed to combination chart display, optimizing page display experience.
• Management
  • SSO Management:
    • When logging in via SSO, the workspace supports listing all authorized workspaces under the current [Identity Provider ID]; supports locating the target workspace through [Search].
    • [User SSO] added [Import/Export] function, allowing quick configuration of single sign-on for multiple workspaces.
  • Workspace Language:
    • Adjusted the default display language logic of the console, default follows browser language display configuration.
    • When modifying the workspace language version, event, alert, SMS, and other notification templates will use the modified language template.
• Event linkage Incident added linkage identifier:
  • Unrecovered event list can understand whether the current event is linked to an Incident through Icon.
  • Incident: If there is event information created by the monitor synchronization linkage, you can quickly understand the number of linked events through Icon.
• Infrastructure > Hosts: Optimized the issue of inaccurate Metrics data sorting in Host Explorer.
• Pipeline user experience optimization:
  • Data source selection column added text prompt for configured Pipeline scripts.
  • Log data acquisition test samples added "Index" selection, solving the issue of not being able to obtain sample data due to not using the default index.

TrueWatch Deployment Plan Updates¶

• Single Sign-On: Supports dynamically appending phone number information based on returned user information when user accounts log in via OIDC.

New Integrations¶

• Added argocd, fluentd, redis-sentinel

November 9, 2023¶

TrueWatch Updates¶

• Monitor > Alert Strategy Management:
  • Notification configuration: Logic changed to configure single or multiple notification targets for a single anomaly level.
  • Recovery notification logic change: When historical sent anomaly alert events recover, TrueWatch will send recovery notifications to the corresponding notification targets.
  • Added [Alert Aggregation]: Supports alert notification aggregation based on rule configuration, aggregation methods include:
    • No Aggregation: In this mode, merge into one alert notification every 20 seconds and send to the corresponding notification target.
    • Rule Aggregation: Supports four aggregation rules and sends alert notifications based on the aggregation cycle.
  • Added [Aggregation Cycle]: In rule aggregation mode, new events within 1-30 minutes will be aggregated into notifications, new events beyond the aggregation cycle will be aggregated into new alert notifications.
• Management > Data Forwarding: Supports custom time range query, supports selecting multiple dates and defining start and end times.

November 2, 2023¶

TrueWatch Updates¶

• Management:
  • SSO Management: Supports OIDC / Oauth2.0 protocol single sign-on configuration.
  • Data Permission Management: Added [Role] when adding authorization, after configuring the role, the authorized workspace will judge data query access restrictions and desensitization restrictions based on the selected role range.
• Data Forwarding:
  • Navigation position adjusted to [Management] module, still accessible through the secondary menu of the original [Logs], [User Access Monitoring], [Application Performance Monitoring] navigation bar.
  • AWS S3 and Alibaba Cloud OSS support "Cross-Account Authorization" configuration, simplifying the configuration process by allowing mutual authorization of data permissions between two accounts.
• Billing:
  • Supports data forwarding to TrueWatch internal storage, statistics the data capacity size saved to TrueWatch storage objects when daily billing.
• Events > Unrecovered Events:
  • Currently, the unrecovered event list saves event data within the last 24 hours.
  • Added display preference: Default display [Standard] mode, supports selecting [Extended] mode to open event detection result value historical trend.
  • Supports exporting the current event list to CSV.
  • Event details page added Extended Fields Tab page; Basic Attributes Tab page optimized.
• Infrastructure > Network:
  • Optimized [Overview] template, added quick filter, users can filter and view network paths. Added 5 statistical charts, supports analyzing send/receive bytes, TCP retransmission and other network Metrics information.
  • Added [Network Flow] Explorer, can view all L4(netflow), L7(httpflow) network flow data on the timeline.
  • Other explorer details pages added [Topology] mode display, directly view the current object's network upstream and downstream relationships and some key network Metrics.
• Scenarios:
  • View Variables: Supports adding PromQL method query.
  • Charts:
    • Added [Data Sampling] for workspaces with Doris data storage.
    • Time auto-align function optimization: For all Metrics data and Doris data chart queries, when time auto-align function is enabled, the returned data time points will align to "whole seconds/whole minutes/whole hours".
    • Top List, Overview Chart, Table Chart: Added [Rule Mapping], supports configuring corresponding font color/background color for data within the mapping value range.
  • Explorer: Analysis mode optimization, supports free aggregation query based on data, and displays analysis in chart form.
  • Service Management > Resource Invocation: Resource Top List added [Requests Per Second] option.
• Synthetic Tests > Tasks: Supports import, export.
• Doris log data engine temporarily does not support with_labels linkage query.

TrueWatch Deployment Plan Updates¶

• Supports custom configuration of account session invalidation duration, uniformly setting Login Session Keep Time for front-end users.

October 19, 2023¶

TrueWatch Updates¶

• Billing: Billing item [Data Forwarding] statistics logic changed to "based on data forwarding rules" statistics forwarding data size.
• Management
  • SSO Management: Supports creating multiple SSO IDP configurations, and supports enabling, disabling operations, and enabling SAML mapping for a single IDP configuration.
  • Data Permission Management > Sensitive Data Desensitization: Supports configuring sensitive data masking rules based on role level, supports using regular expressions for desensitization during configuration, supports configuring desensitization rules for fields under a certain data type, and added desensitization rule preview test.
• Monitor: Added External Event Detection, generating TrueWatch event data by sending exception events or records generated by third-party systems to the HTTP server through a specified URL address via POST request.
• Scenarios
  • Service Management > Resource Invocation: Added quantity sorting for the corresponding list, default from large to small.
  • Chart Links: Added based on the start time and end time of the currently selected data point for parameter passing, variables are #{timestamp.start}, #{timestamp.end}.
  • Chart Aliases: Based on legend sequence configuration.
  • Table Chart: Added [Time Series Table Chart].
• Metrics > Metrics Analysis: Table Chart added [Time Series Mode].

TrueWatch Deployment Plan Updates¶

• Added Custom Mapping Rule Configuration: When enabled, the corresponding workspace can customize mapping rules. The workspace's custom mapping rules have higher priority than the management background's mapping rules.
• Added Query Quantity Limit: Customized query quantity limits for different user workspaces, avoiding low cluster query performance due to large query data volume, affecting product usage experience.
• Local accounts added password change.

Integration Updates¶

• Anomaly Events and PagerDuty Linkage: When our applications or systems encounter anomalies, timely handling is usually required to ensure the normal operation of the system. To better manage and track anomaly events, we can send these events to PagerDuty to create events, allowing us to track, analyze, and resolve these issues in PagerDuty, providing better management and tracking capabilities for anomaly events, thus better ensuring the normal operation of the system. At the same time, this method can also help us better analyze and solve problems, improving system stability and reliability.

September 26, 2023¶

TrueWatch Updates¶

• Scenarios > Service Management: Resource Invocation added [Upstream and Downstream Topology] component, users can view the upstream and downstream resource invocation relationships of the current resource.

September 21, 2023¶

TrueWatch Updates¶

• Logs:
  • Data Forwarding: Added external storage forwarding rule data query; supports enabling/disabling forwarding rules.
  • Bind Index: Logs added tag binding, achieving finer-grained data range query authorization capability.
• Infrastructure > Custom:
  • [Default Attributes] concept changed to [Required Attributes]: The reported data must contain this attribute field, otherwise the report will fail.
  • Supports adding Resource Catalog to the secondary menu for easy viewing.
  • Custom Explorer added quick filter.
• Scenarios:
  • Scheduled Reports: Added [DingTalk], [WeCom], [Lark] three notification methods.
  • Charts: [Time Series Chart, Pie Chart, Bar Chart, Histogram, Scatter Chart, Bubble Chart, Table Chart, Treemap, Funnel Chart, Top List, Map, Hexbin Chart] added data format, can define [Decimal Places] and [Thousand Separator].
• Monitoring > Notification Targets Management: Mail group type offline, created ones are not affected.
• Snapshot: Share Snapshot: Added IP whitelist access restriction.
• Incident: [Level] supports custom creation; supports enabling/disabling default levels.
• Integration > Extensions: DataFlux Func (Automata) and RUM Headless now support international sites: Oregon, Frankfurt, Singapore.

Integration Updates¶

Huawei Cloud:

• Huawei CCE: TrueWatch supports monitoring the running status and service capabilities of various resources in CCE, including Containers, Pods, Services, Deployments, Clusters, Nodes, Replica Sets, Jobs, Cron Jobs, etc. You can install DataKit in Kubernetes through DaemonSet, thereby completing data collection for Kubernetes resources. Finally, in TrueWatch, real-time monitoring of various Kubernetes resources' running status is achieved.

• Huawei CSS(Elasticsearch): The core performance Metrics of Huawei Cloud Search Service CSS for Elasticsearch include query latency, indexing speed, search speed, disk usage, and CPU usage, which are key Metrics for evaluating and optimizing Elasticsearch performance.

• Huawei SYS.AS: The core performance Metrics of Huawei SYS.AS include CPU utilization, memory usage, disk I/O, network throughput, and system load, which are key Metrics for evaluating and optimizing auto-scaling system performance.

• Huawei ASM: Huawei Cloud's ASM trace data output to TrueWatch for viewing and analysis.

AWS:

• AWS CloudFront: The core performance Metrics of AWS CloudFront include total requests, data transfer volume, HTTP error rate, cache hit rate, and latency, which can help users evaluate and optimize the performance of content delivery networks.

• AWS MediaConvert: AWS MediaConvert includes data transfer, video errors, job count, padding, etc.

• AWS Aurora Serverless V2: AWS Aurora Serverless V2 includes connection count, IOPS, queue, read/write latency, network throughput, etc.

• AWS Redshift: The core performance Metrics of AWS Redshift include query performance, disk space usage, CPU utilization, database connection count, and disk I/O operations, which are key Metrics for evaluating and optimizing data warehouse performance.

• AWS Simple Queue Service: The display Metrics of AWS Simple Queue Service include the approximate existence time of the oldest undeleted message in the queue, the number of delayed and unreadable messages, the number of messages in flight, the number of messages available for retrieval from the queue, etc.

• AWS Timestream: The display Metrics of AWS Timestream include system error count (internal service error count), the sum of invalid requests for the current AWS region and current AWS account, the time taken for successful requests and sample count, the amount of data stored in memory, and the amount of data stored in magnetic storage, etc.

• AWS Neptune Cluster: The display Metrics of AWS Neptune Cluster include cold start time, execution time, concurrent execution count, and memory usage, which reflect the response speed, scalability, and resource utilization of Neptune Cluster functions.

September 7, 2023¶

TrueWatch Updates¶

• Scenarios > Dashboard/Explorer: Added global Cross-Workspace Query configuration.
• Scenarios > Chart Query: Time widget range less than or equal to [Last 15 Minutes], auto-align time interval added "1 second" display.
• Scenarios > Service Management:
  • Service List added binding multiple built-in views to analysis dashboard; added association, team information.
  • Added Resource Invocation Analysis Dashboard.
  • Supports saving snapshots.
• Logs > Backup Logs:
  • Officially changed to Data Forwarding.
  • Added Trace, User Access data sources.
  • Original backup logs billing item name changed to data forwarding billing item.
• Logs > Explorer: Added new monitor entry; supports snapshot saving for explorer details page.
• Management:
  • Global Tags: Added global tag function, unified management of tags.
  • Field Management: Added alias, set display columns.
  • Workspace Management: Function integration and page optimization.
  • Member Management: Original member group definition officially changed to team.
  • Sensitive Data Scan: Added scan rule count statistics; added jump links.
• Monitoring:
  • Synthetic Testing Anomaly Detection: Added testing Metrics, can detect based on [Metrics] dimension.
  • Mutation, Outlier, Interval Detection: Supports selecting all data sources.

Integration Updates¶

Alibaba Cloud:

• aliyun_analyticdb_postgresql: Alibaba Cloud AnalyticDB PostgreSQL Metrics display, including CPU, memory, disk, coordinator node, instance query, etc.
• aliyun_clickhouse_community: Alibaba Cloud ClickHouse Metrics display, including service status, log traffic, operation count, overall QPS, etc.
• aliyun_kafka: Alibaba Cloud KafKa includes message throughput, latency, concurrent connection count, and reliability, which reflect Kafka's performance and reliability in handling large-scale message delivery and real-time data streams.
• aliyun_lindorm: Includes high-throughput, low-latency data read/write capabilities, supports high-concurrency transaction processing, and strong consistency and high-reliability data storage and query services.
• aliyun_polardb_1.0: Alibaba Cloud PolarDB Distributed 1.0 display Metrics include CPU utilization, memory utilization, network bandwidth, and disk IOPS.
• aliyun_polardb_2.0: Alibaba Cloud PolarDB Distributed 2.0 display Metrics for computing layer and storage nodes, including CPU utilization, connection usage, disk usage, disk usage rate, memory utilization, network bandwidth, etc.
• aliyun_rds_postgresql: Alibaba Cloud RDS PostgreSQL Metrics display, including CPU usage, memory usage, etc.
• aliyun_rocketmq5: Alibaba Cloud RocketMQ 5.0 display Metrics include message throughput, latency, reliability, and horizontal scalability.

AWS:

• aws_dynamodb_DAX: AWS DynamoDB DAX display Metrics include CPU usage of nodes or clusters, bytes received or sent on all network interfaces, packet count, etc., which reflect the running status of DynamoDB DAX.
• aws_memorydb: AWS MemoryDB core performance Metrics include low-latency memory read/write capabilities, high-concurrency transaction processing capabilities, and linearly scalable storage capacity and throughput.

Huawei Cloud:

• huawei_functiongraph: HUAWEI FunctionGraph display Metrics include invocation count, error count, rejected count, concurrent count, reserved instance count, running time (including maximum running time, minimum running time, average running time), etc., which reflect FunctionGraph function running status.
• huawei_kafka: Includes message throughput, latency, concurrent connection count, and reliability, which reflect Kafka's performance and reliability in handling large-scale message delivery and real-time data streams.
• huaweiyun_SYS_DDMS: 'Huawei Cloud SYS.DDMS monitoring view display Metrics include message throughput, latency, concurrent connection count, and reliability, which reflect DDMS's performance and reliability in handling large-scale message delivery and real-time data streams.

Tencent Cloud:

• tencent_keewidb: Tencent Cloud KeeWiDB Metrics display, including connection count, requests, cache, key, slow query, etc.
• tencent_mariadb: Includes high-performance read/write capabilities, low-latency query response time, and supports high-concurrency transaction processing and scalability.
• tencent_memcached: Includes high-speed memory read/write capabilities, low-latency data access time, and high-concurrency access processing capabilities.
• tencent_tdsql_c_mysql: Includes high-throughput read/write capabilities, low-latency query response time, and supports high-concurrency transaction processing and scalability.

Others:

• openai: OpenAI display Metrics include total requests, response time, request count, request error count, and token consumption.
• monitor_jira: When our applications or systems encounter anomalies, timely handling is usually required to ensure the normal operation of the system. To better manage and track anomaly events, we can send these events to Jira to create events, allowing us to track, analyze, and resolve these issues in Jira, providing better management and tracking capabilities for anomaly events, thus better ensuring the normal operation of the system. At the same time, this method can also help us better analyze and solve problems, improving system stability and reliability.

August 29, 2023¶

TrueWatch Updates¶

• Scenarios > SLO Chart: Added fault time display.
• Deployment Plan: Management background Mapping Rules added only applying adaptation rules to newly joined members, when users enable this option, mapping rule adaptation only applies to first-time joining members.

August 24, 2023¶

TrueWatch Updates¶

• Billing Items:
  • Backup Logs: Added OSS, OBS, AWS S3, Kafka four archive type billing items, based on the user-selected corresponding archive type statistics summary forwarding traffic size, and billing according to the data.
  • Application Performance Trace, User Access PV added 30-day/60-day data retention policies.
• Monitoring:
  • Mute Rules: Supports configuring alert mute based on different dimensions.
  • Monitor: Supports adding tags to monitors, filtering lists based on tags; monitor list added quick filter column, and made some optimizations to the list.
  • SLO: Added Fault Time display column.
• Logs > Backup Logs: Added Kafka Message Queue external storage.
• Explorer/Dashboard: Added Auto Refresh Function.
• Explorer Details Page: Added Bind Built-in View entry.

Integration Updates¶

• Alibaba Cloud RDS MariaDB: Alibaba Cloud RDS MariaDB display Metrics include response time, concurrent connection count, QPS, and TPS.
• Alibaba Cloud RocketMQ4: Alibaba Cloud RocketMQ 4.0 display Metrics include message throughput, latency, reliability, and horizontal scalability.
• Alibaba Cloud Tair Community Edition: Alibaba Cloud Tair Community Edition Metrics display includes CPU usage, memory usage, proxy total QPS, network traffic, hit rate, etc.
• AWS DynamoDB: AWS DynamoDB display Metrics include throughput capacity units (Capacity Units), latency, concurrent connection count, and read/write throughput, which reflect DynamoDB's performance and scalability in handling large-scale data storage and access.
• AWS EventBridge: AWS EventBridge display Metrics include event delivery latency, throughput, event scale, and scalability, which reflect EventBridge's performance and reliability in handling large-scale event streams and real-time data delivery.
• AWS Lambda: AWS Lambda display Metrics include cold start time, execution time, concurrent execution count, and memory usage, which reflect Lambda function response speed, scalability, and resource utilization.
• HUAWEI SYS.AS: HUAWEI SYS.AS display Metrics include response time, concurrent connection count, throughput, and reliability, which reflect SYS.AS's performance and stability in handling application requests and data interaction.
• HUAWEI SYS.CBR: HUAWEI SYS.CBR display Metrics include bandwidth utilization, latency, packet loss rate, and network throughput, which reflect CBR's performance and quality assurance in network transmission and bandwidth management.
• Huawei Cloud GaussDB-Cassandra: Huawei Cloud GaussDB-Cassandra display Metrics include read/write throughput, latency, data consistency, and scalability, which reflect GaussDB-Cassandra's performance and reliability in handling large-scale distributed data storage and access.
• Huawei Cloud GaussDB for MySQL: Huawei Cloud GaussDB for MySQL display Metrics include response time, concurrent connection count, read/write throughput, and scalability, which reflect GaussDB for MySQL's performance and reliability in handling large-scale relational database operations.
• Huawei Cloud GaussDB-Influx: Huawei Cloud GaussDB-Influx display Metrics include write throughput, query latency, data retention policy, and scalability, which reflect GaussDB-Influx's performance and reliability in handling large-scale time-series data storage and query.
• Huawei Cloud GaussDB-Redis: Huawei Cloud GaussDB-Redis display Metrics include read/write throughput, response time, concurrent connection count, and data persistence, which reflect GaussDB-Redis's performance and reliability in handling high-concurrency data storage and caching.
• Huawei Cloud GaussDB SYS.GAUSSDBV5: Huawei Cloud GaussDB SYS.GAUSSDBV5, providing CPU, memory, disk, deadlock, SQL response time Metrics, etc.
• Huawei Cloud MongoDB: Huawei Cloud MongoDB display Metrics include read/write throughput, latency, concurrent connection count, and data reliability, which reflect MongoDB's performance and scalability in handling large-scale document storage and query.
• Huawei Cloud RDS PostgreSQL: Huawei Cloud RDS PostgreSQL display Metrics include query performance, transaction throughput, concurrent connection count, and data reliability, which reflect RDS PostgreSQL's performance and reliability in handling large-scale relational data storage and transaction processing.
• Tencent Cloud CKafka: Tencent Cloud CKafka display Metrics include message throughput, latency, concurrent connection count, and reliability, which reflect CKafka's performance and reliability in handling large-scale message delivery and real-time data streams.
• Zadigx: Zadigx display includes overview, automated build, automated deployment, automated testing, etc.
• Lark and Incident Linkage: To more timely and conveniently obtain new Issues in Incident, you can create a Lark, DingTalk, or WeCom robot in the internal group to receive reminders of new Issues or new replies in Incident, helping to handle Issues in a timely manner; you can also quickly reply to Issues through @robot, improving our incident handling efficiency.

August 17, 2023¶

TrueWatch Updates¶

• Management: Added Sensitive Data Scan function: By creating desensitization rules for data, information masking is achieved.
• Added Billing Item: Sensitive Data Scan Traffic: Based on scan rules statistics the original traffic size of scanned sensitive data (per GB / day).
• Billing: Consumption analysis section temporarily offline due to optimization.

August 10, 2023¶

TrueWatch Updates¶

• Added Billing Items:
  • Scheduled Reports: Billing based on the number of scheduled reports sent per day in the workspace.
• Scenarios:
  • Added *Service Management*: Service Management is a centralized entry for accessing key information of all services, allowing users to view the performance and business data of different services within the current workspace and all associated analysis information, quickly locating and solving service-related issues.
  • Charts support PromQL query and expression query.
• Logs: Supports directly viewing Context Logs in the log details page; supports selecting context retrieval range.
• Explorer: Open a data details page, supports one-click Export current data as JSON file.
• Application Performance Monitoring > Service > Invocation Topology: Added upstream and downstream invocation relationship table of the current service, displaying one-way relationship request count, average response time, and error count.
• Monitor > Threshold Detection: Detection Metrics added Convert to PromQL Query.
• Infrastructure > Containers: Pods, Services, Deployments, Nodes, Replica Sets, Cron Jobs, Daemonset details page added Kubernets Events component.

July 27, 2023¶

TrueWatch Updates¶

• Scenarios > Dashboard: Added Scheduled Report Function, supports users creating reports based on a dashboard, and can configure scheduled email sending.
• Navigation bar added *Invite Members* entry, allowing quick invitation of members through this entry. In the management page, added Invitation Approval button. When this button is enabled, after sending an invitation to a member, the invitation record must be moved to the approval management member join application.
• Logs > Backup Logs has the following adjustments:
  • TrueWatch default archive type offline:
    • Newly created backup rules will no longer support the [TrueWatch] default option.
    • Historically created backup rules still take effect.
  • Added support for backup to external storage Alibaba Cloud OSS.
• Monitoring > New: Supports saving monitors as Custom Template Library, allowing users to quickly create the same type of monitor detection in the future.
• Monitoring > New Monitor > Custom New: Except for [Mutation Detection], [Interval Detection], [Outlier Detection], all detection rules' detection frequency added [Last 12 Hours], [Last 24 Hours] options.
• *Incident: New Issue page added **Delivery Channel configuration entry, supports multiple selection; level added *Unknown** option, default selected this option.
• To meet user data compliance requirements, Snapshot supports desensitizing certain content through regular syntax for fields.
• Scenarios > Log Flow Chart added Copy as cURL, export as CSV file function.
• User Access Monitoring > Explorer > Error: Added *Pattern* function, convenient for viewing frequently occurring errors.
• Added data limit prompt: When log, trace, and other data volumes reach today's limit, data reception will stop, if adjustment is needed, please contact the account manager.

July 11, 2023¶

TrueWatch Updates¶

• Integration upgrade: Click any integration solution to understand the full-link usage plan from configuration access, data collection to data application on the same page.
• *Monitor > Template* function optimization: Supports creating or batch creating based on a single detection rule; supports filtering based on the detection library.
• Application Performance Monitoring > Trace: Span List page added Waterfall Chart Mode, helping users analyze Span data information from a more intuitive perspective; *Service Invocation Relationship* changed from service (service) to service resource (service / resource) level, drilling down to the interface level to better analyze the corresponding performance and invocation issues, thus helping users find problem points faster through interface-level invocation.
• *Charts > Overview Chart: Added thousand separator; **Unit > Value changed "Default" to "Ten Thousand System"; *Value Mapping** added null value mapping.
• *Charts > Treemap*: Added display value option, selected can directly display query result value in the chart.
• *Charts > Add Link*: Added query parameter, deleted tags, search two parameters.
• Application Performance Monitoring > Service list supports export.

Intelligent Inspection Updates¶

Function Optimization:

• Application Performance Inspection: Added default detection threshold change entry, now when starting inspection, the detection service trigger value can be modified synchronously.
• RUM Performance Inspection: Optimized the root cause display logic in the page details module, after optimization, root cause positioning is more accurate.
• Workspace Asset Inspection: Added default configuration (7 days), now starting inspection does not require parameters to run.

Added Scripts:

• Cloud Message Queue RocketMQ4.0
• Huawei Cloud-CSS
• Huawei Cloud-RocketMQ
• Huawei Cloud-RabbitMQ
• Huawei Cloud-WAF-Event List
• Huawei Cloud-WAF-Event Overview

June 29, 2023¶

TrueWatch Updates¶

This update simplifies the registration process:

• International Site TrueWatch Product Service officially launched, users can purchase on AWS overseas cloud market.

• International Site TrueWatch product adopts US dollar-based pricing system. China site's Oregon site registered workspace data will be billed according to the adjusted price.

• TrueWatchEnterprise Account concept officially changed to Billing Center Account.

Other Updates:

• Snapshot Permissions: Read-only members support creating and deleting Only Visible to Self snapshots.

June 20, 2023¶

TrueWatch Updates¶

• RUM (Real User Monitoring) collector is used to collect user access monitoring data reported by web or mobile. Now provides RUM Headless One-Click Service, achieving automated installation and deployment in TrueWatch cloud host, automatically completing DataKit installation, RUM collector deployment. Only manual application access is required.
• Explorer: Optimized filtering, search interaction conversion and other logic, allowing users to truly achieve what you see is what you get, and can freely switch between UI and handwritten mode. Also: Log explorer supported DQL handwritten mode will be offline after the new version is launched.
• Logs > Backup Logs: Added external storage type selection, supports Write to S3(AWS) Object Storage, supports Huawei Cloud OBS Data Writing.
• Logs > Index: Added Logs Data Binding Configuration Entry.
• Dashboard/Built-in Views support Root Cause Analysis and Drill-Down Analysis.
• Management > Role Management: Supports Cloning Existing User Roles to reduce operation steps, quickly add or remove permissions and create roles.
• Infrastructure > Containers: Added Daemonset Object Data display, can drag and change object classification display order.
• Infrastructure > Containers: Deployments, Pods support directly associating kubernetes event logs, can view specific log information in the details page.
• Added Incident OpenAPI Interface.
• Management > Member Management list, Monitoring > Notification Targets Management > Mail Group, Incident > View Members, all places selecting notification targets support searching by member nickname.
• Ticket status update or new reply, remind customers to pay attention through the interface or email.
• Text input box input illegal characters or length limit prompt optimization.

Intelligent Inspection Updates¶

• Added Inspection

  • AWS Cloudtrail Anomaly Event Inspection: AWS CloudTrail is a service for tracking, logging, and monitoring AWS account activities. It records operations performed in the AWS account, including management console access, API calls, resource changes, etc. We can monitor CloudTrail error events to timely discover potential security issues. For example, unauthorized API calls, access denied resources, abnormal authentication attempts, etc. This helps protect your AWS account and resources from unauthorized access and malicious activities; you can also understand the types, frequency, and impact scope of failures in the system. This helps you quickly identify problems and take appropriate corrective measures to reduce service interruption time and business impact.

• Added Scripts

  • TrueWatch Integration (Alibaba Cloud-RDS Error Logs): Collect Alibaba Cloud RDS error logs for RDS error information diagnosis.
  • filebeats Data Collector: Collect FileBeats performance data for observing FileBeats performance, latency, etc.
  • logstash Data Collector: Collect Logstash performance data for observing Logstash performance, latency, etc.

June 6, 2023¶

TrueWatch Updates¶

• To further meet user data viewing needs, Commercial Plan Billing added Set High Consumption Warning Function, added consumption analysis list, supports viewing various expenditure consumption statistics.
• When creating a workspace, added Menu Style Selection, supports selecting different workspace style attributes.
• Optimized log data access Permission Related Rules adaptation, further clarifying multi-role data query permissions and permission control corresponding relationships.
• Event details page under basic attributes Detection Dimension added association query, supports viewing and filtering all field values under the current detection dimension association data.
• Alert Strategy Management supports Different Level Alerts to Different Notification Targets.
• Member Management added add nickname note function, standardizing member usernames within the workspace, supports searching members by nickname note.
• Dashboard, Explorer, Monitoring, Member Management, Share Management page lists added batch operation function.
• Application Performance Monitoring Service supports Modify Color, Supports Table Header Sorting Adjustment.
• Logs, Application Performance Monitoring > Incident Explorer Pattern supports document count sorting, default descending.
• Supports saving login selected language version to browser local, automatically displaying the last login selected language version when logging in again.
• Generate Metrics frequency option adjustment, supports selecting 1 minute, 5 minutes, 15 minutes.

TrueWatch Deployment Plan Updates¶

• Management background added Password Security Policy: Added password 8-digit length limit and password validity period function.

Intelligent Inspection Updates¶

• Added Inspection

  • Workspace Asset Inspection: For service inspection, it should ensure the normal operation of the service, timely discover failures or anomalies, and reduce business losses. Secondly, inspection helps improve service availability and stability, discover and solve potential problems. It also improves operation and maintenance efficiency, accelerates problem diagnosis and resolution, and optimizes resource allocation. Ensures business security. Through regular inspection of hosts, K8s, containers, and other services, operation and maintenance personnel can ensure these services can efficiently and stably support business, providing enterprises with continuous and reliable operating environment.

• Added Scripts

  • Gitlab R&D Efficiency Analysis: According to Gitlab's code submission frequency and each code volume, display team R&D efficiency by team, individual, and time dimensions.

June 1, 2023¶

TrueWatch Updates¶

DataFlux Func is the extended programming platform of TrueWatch, used for synchronizing cloud platform data, function development, management, and execution. Now supports DataFlux Func (Automata) One-Click Service in all domestic sites, after opening, Func can be automatically deployed in the cloud host, in the workspace's Integration can quickly log in to the corresponding Func platform.

May 22, 2023¶

TrueWatch Updates¶

• RUM Application Configuration added Custom Type and associated view viewing analysis
• DQL Function supports Regular Aggregation data statistics display return, added string regular expression parsing function, extract fields according to regular expressions, judge whether there are substrings in the field that conform to the regular expression
• Added PromQL Syntax Query Entry, supports PromQL Query time series data
• show_tag_value() Function supports querying corresponding Metrics field associated tags
• Mini Program SDK supports collecting startup parameter related information; Added Custom Add Error.
• Status Page supports Subscribe to Fault Notifications
• Added Field Management Function, in Monitor, Chart Query, Explorer and other positions if related fields are selected, the corresponding description and unit information are displayed
• Metrics Analysis added table function, supports download
• Ticket Status adjustment
• Added Incident Guide Page, Channel added Time Range Filter
• Backup Logs Optimization:
  • Added Backup rule entry moved to Backup Logs > Backup Management.
  • Added all backup logic: No filter means saving all log data

TrueWatch Deployment Plan Updates¶

• Management background added Audit Event record

Intelligent Inspection Updates¶

• Added Inspection

  • Cloud Idle Resource Inspection: Cloud computing, as a brand new IT service method, develops rapidly, providing enterprises and individuals with convenient, fast, and elastic IT infrastructure and application services, and bringing extremely high efficiency and economy. However, as cloud resources gradually become the main component of enterprise data centers, the huge waste problem of cloud resources becomes more and more significant. Especially within the enterprise, due to demand fluctuations and department isolation, some cloud resources cannot be fully utilized, forming a large number of idle resources. This situation will cause the enterprise's cloud service costs to rise sharply, resource efficiency to decline, and may also reduce security and performance levels. To better manage and optimize cloud idle resources, improve the use efficiency and resource utilization of cloud computing, cloud idle resource inspection is very necessary. Through inspection, unnecessary resources in the current cloud service can be discovered, timely processed, avoiding long-term unnecessary resource use and the resulting cost overhead, data leakage, poor performance, etc.

  • Host Restart Inspection: Host abnormal restart monitoring is an important part of modern internet system operation and maintenance. On the one hand, the stability and reliability of computer systems are crucial for the smooth operation of business and user experience. When the host encounters abnormal restart and other problems, it will cause system crash, service interruption, and data loss risks, thus affecting business operation and user satisfaction. On the other hand, in cloud computing and virtualization environments, the number and scale of hosts continue to increase, system complexity also continues to increase, the probability of problems also continues to increase, this requires system administrators to use related system monitoring tools for real-time monitoring, and timely discover and solve abnormal restart and other problems. Therefore, reasonably realizing host abnormal restart monitoring can help enterprises quickly diagnose problems, reduce business risks, improve operation and maintenance efficiency, and user experience.

• Function Optimization

  • Idle Host Inspection: Added cloud host type association adding cost related information.

More Intelligent Inspection Updates can refer to Intelligent Inspection Version History.

April 27, 2023¶

TrueWatch Updates¶

• Overview Chart supports displaying multiple same-period comparison dimensions (day-on-day/week-on-week/month-on-month/...)
• Standard Members added Snapshot Sharing Function
• DQL Query renamed Query Tool, added execution button
• Host List Display Optimization, hosts under alert mute added mute prompt
• SLO Alert Notification Content Optimization, added workspace and site information
• Optimized Workspace ID and Token Display Logic, default hidden, supports viewing and copying
• Free Plan Workspace added Session Replay, Profile usage restrictions

April 23, 2023¶

TrueWatch Billing Updates:¶

• TrueWatch self-developed time series database officially launched, time series data storage and billing will be adjusted as follows:

  • Infrastructure (DataKit) billing item offline, original "DataKit + Time Series", "Only Time Series" two billing modes according to only self-developed time series database time series as billing logic use.
  • Self-developed Time Series Database Time Series: Statistics the number of active time series on the day for billing, unit price as low as ￥0.6 / per thousand time series.

• User Access Monitoring "Session Replay" officially started billing, according to the actual collected session replay data session count for billing, ￥10 / per thousand Sessions.

More details can refer to the document Billing Method.

TrueWatch Function Updates:¶

• Self-developed Time Series Database officially launched
• Incident new function launched
• Cross-Site Workspace Authorization function launched
• SLS added Third-Party Authorization opening
• Bind Index Configuration Page Optimization, supports custom adding mapping field configuration
• Chart Optimization
  • Command Panel added local Func's custom function selection
  • Time Series Chart added Advanced Functions, supports local Func secondary processing based on DQL query results and return display
• Workspace added Timezone Configuration, users can custom configure the current workspace query time's timezone
• Integration > DataKit Page Guidance Optimization
• Explorer Bar Distribution Chart added statistics time interval display
• Navigation Menu supports right-click select new page open
• Blacklist duplicate import issue fixed

TrueWatch Deployment Plan Updates¶

• Added Account Login Mapping Rule Configuration, dynamically assign members to join the workspace and corresponding roles according to different mapping rules.

DataKit Updates¶

New Features:

• Added Pinpoint API access

Function Optimization:

• Optimized Windows installation script and upgrade script output method, convenient for direct paste and copy in the terminal
• Optimized Datakit's own document build process
• Optimized OpenTelemetry field processing
• Prom collector supports collecting info type labels and appending them to all associated Metrics (default enabled)
• In system collector, added CPU and memory usage percentage Metrics
• Datakit added data point mark (X-Points) in the sent data, convenient for center related Metrics construction
  • Also optimized Datakit HTTP's User-Agent mark, changed to datakit-<os>-<arch>/<version> form
• KafkaMQ:
  • Supports processing Jaeger data
  • Optimized SkyWalking data processing process
  • Added third-party RUM access function
• SkyWalking added HTTP access function
• Added the following integration tests:
  • Apache
  • JVM
  • Memcached
  • MongoDB
  • RabbitMQ
  • Statsd
  • Tomcat
  • etcd

More DataKit Updates can refer to DataKit Version History.

April 13, 2023¶

Intelligent Inspection Updates¶

• Script Market Intelligent Inspection Script Set:

  • Optimized opening steps, no need to create new scripts, no need to create new schedules, click install from the official script market, automatically complete creation and scheduling, configure parameters to open.
  • Updated Disk Usage Inspection: Optimized disk usage inspection trend judgment algorithm, providing users with more accurate problem location.

• Script Market Cloud Synchronization Script Set:

  • Optimized opening steps, no need to create new scripts, no need to create new schedules, click install from the official script market, automatically complete creation and scheduling, configure parameters to open.
  • Added AWS synchronization multiple authentication methods.
  • Added AWS Cloudwatch Logs synchronization.

More Intelligent Inspection Updates can refer to Intelligent Inspection Version History.

April 11, 2023¶

TrueWatch Updates¶

Added Huawei Cloud Cloud Store Opening Process¶

• TrueWatch added Huawei Cloud Cloud Store one-click opening TrueWatch process, after subscribing to TrueWatch product in Huawei Cloud Cloud Store, you can directly open and use TrueWatch. More details can refer to the document Huawei Cloud Cloud Store Opening TrueWatch Commercial Plan.

April 6, 2023¶

TrueWatch Updates¶

• Logs added 3-day data retention policy and pricing, billing related please refer to the document Billing Method.
• Logs added Data Access permission control, supports granting log data viewing permissions within a certain range to related roles
• Role Permission List added each function module data query permissions, supports custom role configuration corresponding module data query permissions entry
• Standard Members added "Snapshot Management" permissions, supports snapshot add and delete operations
• Snapshot Sharing supports search function. (Logs DQL query mode does not support adjusting search range)
• Supports local Func creating Custom Notification Targets through websocket protocol, achieving external notification channels receiving alert notifications
• Explorer added copy as cURL data query function
• Dashboard Chart Configuration Interaction Optimization
  • Overview Chart added value unit option configuration, supports selecting Chinese scientific notation (default) and short scale system (short scale)
  • Added View Variables whether to apply to chart effect display
  • When the chart has grouping conditions, supports reversing applying a grouping condition value to view variables to achieve linkage filtering
  • When the chart has grouping conditions, selecting a grouping condition corresponding time series or data point supports other charts with the same grouping linkage highlight display
  • Chart drag effect optimization
• Account No Operation Session Expiration Time default adjusted to 3 hours, this adjustment only applies to accounts that have not edited the no operation session expiration time configuration, does not affect accounts that have edited the no operation session expiration time configuration.
• Filter History added search condition saving
• User Access Monitoring Application SDK Access guidance optimization
• Generate Metrics configuration optimization, supports configuring units and descriptions for newly generated Metrics
• Host Explorer supports multi-line display, multi-line mode label will start a new line display
• Time Series Chart, Pie Chart added return display count configuration

DataKit Updates¶

New Features

• Added servo service, used to manage Datakit upgrade
• Added troubleshooting function

Function Optimization

• Optimized upgrade function, avoiding datakit.conf file being damaged
• Optimized cgroup configuration, removed CPU minimum limit
• Optimized self collector, we can choose whether to enable this collector, also made some performance optimizations for its collection
• Prom collector allows adding instance tag, to keep consistent with native Prometheus system
• DCA added Kubernetes deployment method
• Optimized log collection disk cache performance
• Optimized Datakit's own Metrics system, exposing more Prometheus Metrics
• Optimized /v1/write
• Optimized installation process token error prompt
• monitor supports automatically obtaining connection address from datakit.conf
• Canceled eBPF's mandatory kernel version check, trying to support more kernel versions
• Kafka subscription collection supports multi-line json function
• Optimized IO module configuration, added upload worker count configuration field

Compatibility Adjustment

• This update removed most Sinker functions, only retained Sinker function on Dataway. Also sinker's host installation configuration and Kubernetes installation configuration were adjusted, the configuration method is also different from before, please pay attention to adjust when upgrading
• Old version's send failure disk cache due to performance issues, we replaced the implementation method. The new implementation method, its cache binary format is no longer compatible, if upgrading, old data will not be recognized. It is recommended to manually delete old cache data (old data may affect new version disk cache), then upgrade to the new version of Datakit. Even so, the new version's disk cache is still an experimental function, please use with caution
• Datakit's own Metrics system was updated, original DCA obtained Metrics will have certain missing, but does not affect DCA's own function operation

More DataKit Updates can refer to DataKit Version History.

March 23, 2023¶

TrueWatch Updates¶

• Help Document Search Function Optimization

• Backup Logs added extended field saving logic, default only backup message content to backup logs, if "Sync Backup Extended Fields" is checked, will backup the entire log data that meets the filter conditions

• Explorer/Dashboard Time Widget added "Timezone Selection" and "Global Lock" function

• Monitor Optimization

  • Supports viewing last historical configuration, supports clicking to restore to Historical Configuration Version
  • List and page added creation, change information display
  • Mutation Detection added comparison dimension, supports selecting comparison logic with "Yesterday", "Last Hour" statistical Metrics

• Intelligent Inspection events added effect feedback entry

• Snapshot sharing supports adding "Creator" watermark display
• Registration Opening Process Optimization, Cloud Market Opening Path added site selection
• Note creation logic and add content interaction adjustment
• Chart Query added label reverse selection logic
• Trace details page Span list display logic adjustment, sorted by "Duration" descending
• Member Management triggered audit process role modification logic adjustment
• Explorer column width saving, log display multi-line and other logic adjustment

March 9, 2023¶

TrueWatch Updates¶

Data Retention Policy Change Optimization¶

Canceled the logic that data retention policy can only be modified once a day, supports users adjusting data retention policy multiple times within the day.

Note: Except for the first modification of the data retention policy on the day, which takes effect immediately, other modification operations will take effect the next day according to the last adjustment record. For how to change, please refer to the document Data Retention Policy.

Chart Link Configuration Optimization¶

Chart link configuration interaction upgrade, based on text box input, supports freely combining to generate final chart associated link URL through parameter configuration. More details can refer to the document Custom Links.

Added Support for Creating Duplicate Named Dashboards, Notes, Custom Explorers¶

Optimized dashboard, note, custom explorer import function, if duplicate named files are found, supports custom selecting "Skip", "Still Create", "Cancel" and other operations. Involved import modules:

• Scenarios: Dashboard, Note, Explorer
• Management: Settings - Configuration Migration

Note: If "Cancel" is selected for import, the selected files for this time will not be imported. More details can refer to the document Configuration Migration.

DQL Parameter Effective Priority Adjustment¶

If you use handwritten DQL mode to query data, the time parameter configuration in DQL will take priority over the time widget input range. Involved functions:

• Dashboard: View Variables Default Value Query, Chart Query
• Metrics Analysis
• DQL Query Tool

Log Message Data Display Optimization¶

Log view list supports selecting to display all message content. Involved functions:

• Log Explorer
• Each explorer details page associated log page

Monitor Configuration Page Optimization¶

When configuring monitor event notifications:

• Supports custom "Data Interruption" event notification template
• Event content supports adding jump links, in addition to the official provided default links, you can also customize jump links

More details can refer to the document Monitor Configuration.

SSO Related Optimization¶

• SSO users support modifying account information and session keep time and other policies
• SAML account mapping rule configuration optimization, compatible with "Email" multiple case formats
• Single sign-on link acquisition logic optimization, for SSO users who have already joined the workspace, priority listing the joined workspace login link

Other Function Optimization¶

• Commercial Plan opening process supports "TrueWatch Direct Opening", "Alibaba Cloud Market Opening" and "Amazon Cloud Market Opening" three methods optional.
• Explorer left * query function range adjustment, newly opened workspaces no longer default support left * query, if needed, please contact the account manager.
• SLIMIT limit adjustment, time series chart query if group by grouping exists, default returns up to 20 data.
• Newly created workspace novice guidance process optimization.

DataKit Updates¶

New Features

• Pipeline supports key deletion
• Pipeline added new KV operations
• Pipeline added time functions
• netstat supports IPV6
• diskio supports io wait Metrics
• Container collection allows Docker and Containerd coexistence
• Integrated Datakit Operator configuration document

Function Optimization

• Optimized Point Checker
• Optimized Pipeline replace performance
• Optimized Windows Datakit installation process
• Optimized confd configuration processing process
• Added Filebeat integration test capability
• Added Nginx integration test capability
• Refactored OTEL Agent
• Refactored Datakit Monitor information

More DataKit Updates can refer to DataKit Version History.

February 28, 2023¶

TrueWatch Updates¶

Added Session Replay Function¶

Session replay is a reconstructed demonstration of the user experience of the website, by capturing clicks, mouse movements, and page scrolls, generating video records, deeply understanding the user's operation experience. More details can refer to the document Session Replay.

Optimized AWS Opening Process¶

TrueWatch optimized AWS cloud market one-click opening TrueWatch process, after subscribing to TrueWatch product in AWS cloud market, you can directly open and use TrueWatch. More details can refer to the document Open TrueWatch in AWS.

February 23, 2023¶

TrueWatch Updates¶

User Access Monitoring Optimization¶

Added User Access Monitoring Automated Tracking¶

User Access Monitoring added automated tracking, through "browser plugin" implementation, using the browser to record user access behavior, creating no-code end-to-end tests. More details can refer to the document Automated Tracking.

User Access Monitoring Application List, Explorer, Analysis Dashboard Layout Overall Adjustment¶

• User Access Monitoring application list display layout adjustment, supports jumping to view the current application's "Analysis Dashboard" and "Explorer" content details in the application list.

• User Access Monitoring "Explorer" supports viewing all applications' user access data, you can filter and analyze different applications' data by filtering "Application ID".

• User Access Monitoring "Analysis Dashboard" supports switching to view Web, Mobile, Mini Program scenario analysis views.

Added CDN Quality Analysis¶

User Access Monitoring added CDN vendor information collection, through analysis charts to perform quality analysis on different vendors' CDN. More configuration can refer to User Access Monitoring Collector Configuration.

Added UniAPP Application Access¶

User Access Monitoring added UniAPP application access, current version supports Android and iOS platforms. More details can refer to UniApp Application Access.

Scenarios Optimization¶

Added Custom Explorer Navigation Menu¶

In the scenario explorer list, added support for adding the current explorer to Infrastructure, Metrics, Logs, Application Performance Monitoring, User Access Monitoring, Synthetic Tests, Security Check, CI Visualization navigation menu. More details can refer to Add Explorer Navigation Menu.

Enhanced Scenario View Variables Cascading Function¶

In scenario view variables configuration cascading query, supports using =, != exact match variable values, supports using match (re), not match (re), wildcard, not wildcard fuzzy match variable values. More details can refer to the document View Variables.

Pie Chart Added Merge Configuration Option¶

Pie chart added merge configuration option, supports users merging redundant data points into "Other" display, improving pie chart readability. More details can refer to the document Pie Chart.

Adjusted Chart Query Operator Translation Logic¶

Chart query match / not match operator translation logic adjustment, log data match removed default added right * match logic, if needed, can manually add in the input box.

Other Function Optimization¶

• TrueWatch Commercial Plan Registration process supports binding TrueWatch Billing Center account.
• When configuring Monitor, "Detection Dimension" supports non-mandatory.

DataKit Updates¶

New Features

• Command line added parse line protocol function
• Datakit yaml and helm support resource limit configuration
• Datakit yaml and helm support CRD deployment
• Added SQL-Server integration test
• RUM supports resource CDN labeling

Function Optimization

• Optimized testing logic
• Optimized Windows installation prompt
• Optimized powershell installation script template
• Optimized k8s Pod, ReplicaSet, Deployment association method
• Refactored point data structure and function
• Datakit built-in eBPF collector binary installation

More DataKit Updates can refer to DataKit Version History.

February 16, 2023¶

TrueWatch Updates¶

Optimized Workspace Permission Management¶

Added Member Roles and Permission List Management¶

TrueWatch added role management function, supports setting different TrueWatch function access permissions for employees in the enterprise, achieving permission isolation between different employees.

TrueWatch provides four default member roles, namely "Owner", "Administrator", "Standard", and "Read-only", besides default roles, TrueWatch supports creating new roles in role management, and granting permission ranges to roles, meeting different users' permission needs. More details can refer to the document Role Management.

Optimized Member Invitation, Added Select Member Permissions¶

In the current space, invited new members, default permission is read-only member, added support for selecting one or more roles to set new member permissions, more details can refer to the document Member Management.

Added Batch Modify Member Permissions¶

In member management, added batch modify permissions function, click "Batch Modify Permissions", select members to batch modify permissions, click "OK", in the pop-up dialog box select permissions for members and click "OK". More details can refer to the document Member Management.

Optimized SSO Management, Added SAML Mapping Function¶

TrueWatch added based on configuring SAML mapping relationship, providing enterprises with finer single sign-on solutions, after enabling SAML mapping, supports dynamically assigning access permissions to enterprise employees, employees can access TrueWatch according to the assigned role permissions.

In TrueWatch workspace "Management" - "Member Management" - "SSO Management" - "SSO Login", enable "SAML Mapping", and configure mapping relationship in "SAML Mapping". More details can refer to the document SSO Management.

Member Management Page Display Optimization¶

In member management, added custom role management function, adjusted search, quick filter and other layouts. More details can refer to the document Member Management.

Permission Change Audit Optimization¶

Based on the added role permission management, adjusted Billing Center audit trigger conditions, when user roles are granted Token viewing, operation permissions, triggers TrueWatch Billing Center audit. More details can refer to the document Permission Change Audit.

Added Login Session Keep Time Setting¶

TrueWatch supports setting session keep time for accounts logged into the workspace, including SSO single sign-on accounts and workspace registered accounts, supports setting "No Operation Login Session Keep Time" and "Login Session Maximum Keep Time" for logged-in accounts, after setting, timeout login sessions will become invalid.

• No Operation Login Session Keep Time: Supports setting range 30 ~ 1440 minutes, default is 30 minutes.
• Login Session Maximum Keep Time: Supports setting range 0 ~ 7 days, where 0 means never timeout, default is 7 days.

Added Ticket Management¶

For problems encountered in TrueWatch, users can consult and suggest through submitting tickets, official will timely process and feedback. For example: encountering difficult problems during use, purchase and billing related consultation, proposing demand suggestions to TrueWatch, etc.

The ticket system is based on personal account level, users can view all tickets submitted by themselves in ticket management, not distinguishing workspaces. Ticket management entry: bottom left "Account" - "Ticket Management". More details can refer to the document Ticket Management.

Other Function Optimization¶

• Workspace creation added language selection, language option affects workspace event, alert, SMS and other templates, if English is selected, the above corresponding templates will use English templates by default.
• Optimized workspace lock function, if Billing Center account arrears or cloud market subscription exceptions and other situations will cause workspace lock, after workspace lock, new data will stop reporting, TrueWatch provides 14 days buffer period, you can continue to view and analyze historical data during this period, and continue to use TrueWatch by unlocking. More details can refer to the document Workspace Lock.

Intelligent Inspection Updates¶

• RUM Performance Inspection: Supports affecting user session ID jump to view problem Session, providing more professional optimization methods in inspection event reports.
• Cloud Account Instance Dimension Billing Inspection: Added support for AWS account instance dimension billing inspection.

More Intelligent Inspection Updates can refer to Intelligent Inspection Changelog.

Best Practices Updates¶

• Cloud Platform Access
  • Alibaba Cloud - Alibaba Cloud Event Bus EventBridge Best Practices

More Best Practices Updates can refer to Best Practices Version History.

February 9, 2023¶

DataKit Updates¶

New Features

• Datakit host installation can customize default collector enable
• Provides OTEL error tracking
• Provides RUM Session replay capability

Function Optimization

• Datakit pyroscope profiling multi-program language recognition
• Optimized CPU, Disk, EBPF, Net and other Chinese and English documents
• Optimized elasticsearch, postgresql, dialtesting and other English documents
• Optimized DCA, Profiling documents
• Optimized log collection process
• iploc yaml configuration method document support

More DataKit Updates can refer to DataKit Version History.

Intelligent Inspection Updates¶

Added Inspection¶

• RUM Performance Inspection: Real User Monitoring (RUM) is an application performance monitoring technology, aimed at evaluating website performance by simulating real user behavior when browsing the website. The purpose of RUM is to understand website performance from the user's perspective, understand website loading time, webpage rendering effect, page element loading situation, and interaction response. The usage scenario of RUM performance inspection is mainly for client-type websites, such as: e-commerce websites, financial websites, entertainment websites, etc., these websites need to provide users with a fast and smooth access experience. Through RUM performance result analysis, it can quickly help developers understand the user's actual experience, in order to quickly improve website performance.
• Kubernetes Health Inspection: Nowadays Kubernetes has swept the entire container ecosystem, it acts as the brain of container distributed deployment, aimed at managing service-oriented applications using containers distributed across host clusters. Kubernetes provides mechanisms for application deployment, scheduling, update, service discovery, and scaling, but how to ensure the health of Kubernetes nodes, through intelligent inspection, can retrieve and discover problems based on the current node's resource status, application performance management, service failure logs and other information, thereby accelerating incident investigation, reducing engineer pressure, reducing average repair time, and improving end-user experience.

More Intelligent Inspection Updates can refer to Intelligent Inspection Changelog.

January 17, 2023¶

TrueWatch English Version Launched¶

January 12, 2023¶

TrueWatch Updates¶

Added TrueWatch Site Service Status Page¶

TrueWatch provides Status Page, helping you to view the service status of different sites of TrueWatch in real time. If you have logged into TrueWatch, you can view the service status of each site of TrueWatch by clicking the bottom left Help > Status Page. More details can refer to the document Status Page.

Added Bind Self-built Elasticsearch / OpenSearch Index¶

TrueWatch added support for binding self-built Elasticsearch / OpenSearch index, helping you to quickly view and analyze your log data in a unified manner. More details can refer to the document Bind Index.

Added Network Explorer List Mode¶

In "Infrastructure" - "Network", select "Host / Pod / Deployment / Service", supports switching to the corresponding network list to view source IP/port and target IP/port TCP retransmission count, TCP connection count, TCP close count, TCP latency, send bytes, receive bytes, status code, etc. More details can refer to the document Network.

Added Frontend Application Span Request Time Distribution Display¶

In trace details page, if the current trace belongs to frontend application invocation generated Span, you can view the request time distribution in the trace details, including Queueing (queue), First Byte (first packet), Download (download) request time percentage, helping you to intuitively view a Span's process consumption percentage in the frontend.

Note: User Access Monitoring SDK must be 2.2.10 and above to see this part of data display, if cross-domain situation exists, header configuration needs to be adjusted, more details can refer to the document Web Application Access.

Optimized User Access Monitoring Session Interaction Logic¶

• Session explorer removed all record list.
• Session details page display optimization: type display optimization, supports switching to the session's absolute time, added service column, details page display optimization, error information optimization.
• Session update logic optimization: Session data update changed from append logic to session_id cover logic.
• If there are frontend application invocation generated Spans in the trace, the Span's corresponding service value will be filled according to the current user access data's service value, if there is no service information in the user access data, it will be filled with "browser" by default.

More details can refer to the document Session (Session).

Pod Metrics Data Collection Default Off¶

In the latest DataKit version, container collector's Pod Metrics data configuration adjusted to default off enable_pod_metric = false. More details can refer to the document Container Data Collection.

Other Function Optimization¶

• Bind MFA authentication adjusted to email verification.
• Registration adjusted phone verification to email verification.
• Login security verification adjusted to slider verification.
• Workspace creation added TrueWatch Exclusive Plan guidance.
• Workspace added note display function.
• Cloud account settlement users added viewing bill list in TrueWatch Billing.
• Table chart supports setting alias based on "by grouping".
• Optimized monitor configuration's time series chart, only displays after selecting dimensions.
• Optimized log data data interruption alert configuration.
• OpenAPI added create workspace interface.

DataKit Updates¶

• **confconfd added Nacos backend
• Log collector added LocalCache feature
• Supports C/C++ Profiling data
• RUM Session Replay file reporting

• WEB DCA supports remote update config

• Optimized SQL data resource occupation high issue

• Optimized Datakit Monitor

More DataKit Updates can refer to DataKit Version History.

Best Practices Updates¶

• Cloud Platform Access
  • AWS - EKS Deployment DataKit.
• Monitoring
  • Application Performance Monitoring (APM) - Trace - Using datakit-operator to inject dd-java-agent.

More Best Practices Updates can refer to Best Practices Version History.