Changelog (2025)¶

December 24, 2025¶

Feature Updates¶

Role Permissions¶

Dashboard Permission Refinement: Added an independent "Dashboard Create" permission. The original "Dashboard Management" permission still includes all operations. Assigning the "Create" permission will automatically enable basic view permissions for dashboards and views.
The navigation bar dynamically displays based on user permissions. If a role does not have any permissions in a specified module, that module will not appear in their left navigation bar. This rule applies to the following modules: Cloud Billing, Billing, Scenarios, Events, Infrastructure, Logs, Metrics, APM, RUM, LLM Monitoring, Synthetic Tests, Monitoring, Incident, Security Monitoring.

Monitoring¶

Alert Strategies:
- Simultaneously supports searching and filtering to filter alert strategies; newly added support for precise filtering by monitor name (checker_title) and member (member);
- Repeat Alerts: Newly added support for setting separate non-sending time intervals for repeat alerts based on different alert levels (e.g., Critical, Severe, Warning, etc.);
- Added new notification aggregation rule: "Custom". Supports freely specifying field combinations for alert aggregation based on business needs. Input field names (multiple fields separated by English commas), and the system will strictly aggregate based on this combination: aggregation alerts will only be triggered when event data contains all specified fields and their values are valid.
DQL functions built into Arbiter support querying data from a specified workspace by passing workspace parameters. Applicable to scenarios for creating and modifying Programmable Monitors and SIEM detection rules.

APM¶

Performance Metrics:
- Added Apdex statistics to quantify user satisfaction with application performance;
- Statistical Metrics Time Series Visualization: Upgraded core statistical metrics in the service list, such as average request count, response time, and error count, from numerical display to time series chart format, intuitively presenting change trends.
Service Details:
- Supports displaying OpenTelemetry service languages;
- Added new Tab pages: Service Map, Profile, Dashboard.

Scenarios¶

Added new chart type "Change Comparison Chart": Quantitatively compares the value of a specified metric in the current period with its value in the same historical period (e.g., same time yesterday, same day last week) or with other metrics, and visually displays the change magnitude, enabling quick identification of abnormal fluctuations;
When creating a new Pie Chart (Donut Chart), when the legend is not hidden, you can choose whether to display the Value and Value percentage.
Chart Y-axis: Optimized raw value display.

Snapshots¶

Overall optimization of snapshot list style;
Save Snapshot: Added "Save as static time" setting.

Metrics¶

Metric Analysis: Numerical values in query results now support flexible display format settings, allowing configuration of decimal places and full-precision result display.

Management¶

Cross-workspace Authorization: When "Metrics" is selected as the data scope, detailed configuration of the metric authorization scope is supported;
Share Management: Added quick filtering by type and search box.

Pipelines¶

Each data type now supports setting two default Pipelines (including local and central Pipeline).

Open API¶

Dashboard cross-workspace queries support specifying the default selected workspace.

Deployment Plan¶

Management Console:
- Workspace List > Tenant Configuration Management:
  - Added "Max Segment Time" setting, which defines the maximum time search range for a single query. Once sufficient data is obtained within this range, the search stops immediately;
  - Extended "Sampling Threshold" configuration, allowing free definition.
- Supports batch import of members by uploading a member list file;
- Security Settings > Login Method Management: Supports modifying the display name of the system default LDAP account to adapt to actual scenarios where different users have unified login across internal systems.
Added parameter (max_delay), supporting custom service topology calculation time.

New Integrations¶

Added GCP Storage integration;
Added GCP Cloud SQL (MySQL) integration;
Added Alibaba Cloud VPC Peering Connection integration;
Added AWS Lambda Trace integration;
Added Alibaba Cloud WAF Application Firewall integration;
Added Tencent Cloud Tencent CVM / KeewiDB views;
Fixed case sensitivity issues in Ingress-nginx-prom integration documentation;
Fixed integration documentation issues (including Chinese/English character and formatting issues);
Fixed TencentCloud public CLB collector to support non-public IPs;
Fixed linearBuckets metric bug in GCP Cloud Monitoring;
Added CSPM rule: S3 bucket policies should restrict access from other AWS accounts;
Added cloud integration templates: Aliyun CPFS, Aliyun NLB, HuaweiCloud EVS, Aliyun CNAPIGateway, HuaweiCloud ROMA;
Added cloud script: GCP APIs collector;
Added cloud script: GCP RUN collector.

Bug Fixes¶

Fixed the issue where alert events could not recover;
Fixed the issue of excessive connection count when connecting to external Kafka clusters;
Fixed the issue where email addresses being added to a blacklist prevented normal email receipt;
Fixed the issue where the first load of the host list did not display the total number of online hosts, requiring waiting for lazy loading;
Fixed the issue where calling the log query task interface returned an error;
Fixed the issue where clicking Mute in event details on the Hangzhou site did not take effect;
Fixed the issue where the snapshot share button sometimes did not respond;
Fixed the issue of poor sampling results for APM on overseas sites;
Fixed the issue where alert events could not be associated to view related content;
Fixed the issue where searching log sources triggered large queries, causing platform queries to return no results;
Fixed the issue of not receiving high consumption warning emails;
Fixed the issue where monitor events did not recover as expected;
Fixed the issue of abnormal data display in the RUM error analysis view;
Fixed the issue of errors with trace data (7 days) and log queries (7 days);
Fixed the issue of abnormal Sourcemap reporting for the same version;
Fixed the issue where selecting all indices with wildcards when generating metrics from logs would cause generation failure;
Fixed the issue where read-only users could not view public dashboards;
Fixed the issue where the quick search function in dashboards could not be concatenated with log stream graphs, and the issue of abnormal display of multi-select view variables in the log analysis function;
Fixed the issue of encountering errors when obtaining samples during time series governance using pipelines on overseas sites;
Fixed the issue where the "Past 1 month" query range in scheduled reports on overseas sites returned an incorrect time range (217 days);
Fixed the issue where dashboard template errors caused testing to be blocked on overseas sites;
Fixed the issue of abnormal expression calculation results in monitors;
Fixed the issue where clicking the "Go to Workspace" link often resulted in a white screen with no event details displayed;
Fixed the issue of incorrect paths in the guide for installing data collectors;
Fixed the issue where user access geographic location was displayed as Unknown;
Fixed the issue of abnormal CPU load value display for Windows hosts in Infrastructure;
Fixed the issue of abnormal results when using DQL for trace queries;
Fixed the issue where Session Replay data could not be displayed;
Fixed the issue where adjusting the time window on overseas sites resulted in incorrect APM data results;
Fixed the issue where the Inner Mongolia region in the China map was displayed in English with incorrect data;
Fixed the issue of no query results after binding logs to external indices;
Fixed the issue of being unable to open trace data details;
Fixed the issue where pipelines processing logs could not judge or filter text with empty content;
Fixed the issue of IP address city resolution failure;
Fixed the issue of Chinese characters appearing in pipeline script functions on overseas sites, and the issue of user IDs not being displayed in the Resource Explorer, and dashboard errors in the resource analysis section of the User Analysis dashboard;
Fixed the issue of lag when selecting wildcards for variables.

December 10, 2025¶

Feature Updates¶

Billing¶

Based on the newly added Notification Targets, added a new billing item "Phone": Counts the number of voice notifications sent daily (each time/day).

In China Region Sites, the billing details are as follows:

Billing Item	Settlement Currency	Price Details
Phone	RMB	¥0.6
	USD	$0.09

Monitoring¶

Added support for Voice Phone as a notification target;
Monitors support cross-workspace data detection

Management¶

Data Forwarding: After performing the Delete Rule action, the system sets the status of that rule to "Deleting". After processing is complete, the rule will be automatically removed.

December 3, 2025¶

Feature Updates¶

APM¶

Service Map:
- Clicking a node now adjusts to slide out the corresponding service details on the right side. In addition to basic information like service name, corresponding team, and contact details, new charts for service request response time, error request distribution, and error log count analysis are added;
- Added operation buttons: Zoom out, Zoom in, and Show Full Map;
- Added Service Map configuration:
  - Users can manually configure whether to calculate node size based on "Request Count";
  - Users can choose the hover highlight range.
Performance Metrics:
- Added Filter Field Configuration. In addition to official default filter fields, users can customize up to 5 fields as filter fields;
- Added support for exporting the current performance metrics list as a CSV file.
Service Details > Resource Invocation:
- Added sampling prompt: When queries for the resource list and distribution chart trigger sampling, a "Sampling Rate icon" is displayed;
- Upstream/Downstream Topology: Added "View Upstream/Downstream Calls" buttons, supporting analysis of full-link paths starting from the current resource by continuing to view the calling relationships at the upper/lower levels based on the current topology.
Trace > Service Call Relationships:
- Interaction Optimization: Only draws call paths between different services, making dependency relationships clearer;
- Node Information Enhancement: Displays full-path service call relationships through a left-right structure. Simultaneously, on each service node, execution time, average response time, call count, and error information are directly displayed; clicking allows viewing the service's parent Span for tracing upstream call sources; if the service has errors, error details are directly displayed.

RUM¶

To adapt to the development of the HarmonyOS ecosystem, added support for Application Type HarmonyOS. Users can select the HarmonyOS client type when creating an application and obtain corresponding SDK integration guidance and configuration support to achieve complete observability integration for HarmonyOS applications.
The View Explorer page supports TOBY AI AI error analysis.

Events¶

Added new Event Level: Fatal (df_status:fatal), defined as the highest level.

DQL¶

Added new function histogram_auto(): Automatic histogram range aggregation, no need to manually provide bucket basis, automatically selects appropriate bucket ranges to return statistical information about data distribution.
Optimized eval expression null value handling logic, added OR operator null value determination rule: When the left-side query result is null, the right-side result is automatically used for calculation, flexibly adapting to null value completion scenarios. Example analysis:
- (a or 0) / b: When query a result is null, it is automatically treated as 0, finally calculating 0 / b;
- (a or b) / b: When query a result is null, the result of query b is automatically used, finally calculating b / b.

MCP Server¶

Added support for querying Metrics, Trace, and RUM data in a standardized way.

Management¶

Data Forwarding: When deleting a rule, the rule name must be entered to confirm the operation;
Member Management: Supports assigning roles to teams. Team roles are automatically applied as additional roles to team members. A member's final permissions include both personal roles and team roles.

Scenarios¶

Dashboard:
- Added a "Filter" button for quickly adding global filter conditions;
- Original functions like "History Versions", "Large Screen Mode", "Report Records" have been moved to the "Settings" dropdown menu.
Charts:
- Advanced Configuration: Added "Repeat Chart" option. When enabled, the system generates multiple charts with the same structure based on each value of the selected view variable;
- Clicking a data point now supports Apply to Filter and Copy Group Label;
- Table Chart: Manually entered return count limit increased to 2000.

Monitoring¶

Alert Aggregation Notification Template Optimization: In rule aggregation and intelligent aggregation notifications, displays the count of different events triggered within the current aggregation period, helping users quickly identify the scale and impact scope of alerts associated with the alert.

New Integrations¶

Openresty added OpenTelemetry trace access method;
Added Zabbix integration, based on api\stream;
Added Alibaba Cloud Native API Gateway integration, Alibaba Cloud Function Compute integration;
Added Huawei Cloud EVS Cloud Disk integration;
Added Tencent Cloud WAF monitor;
Optimized Alibaba Cloud NLB view & integration documentation;
Optimized Alibaba Cloud SLB view;
Fixed iis integration view monitor;
Optimized Huawei Cloud ECS, CSS, Functiongraph views and monitors;
Optimized Tencent Cloud clb monitor/view;
Added Huawei Cloud DC/ Alibaba Cloud SLB monitors;
Discontinued Huawei Cloud GuassDB related integrations (Huawei Cloud discontinued related products);
Fixed Huawei Cloud ROMA script;
Added CSPM templates:
- S3 buckets should have "MFA Delete" enabled;
- S3 bucket ACLs should restrict public internet access;
- S3 bucket content access should be limited to authorized principals;
- IAM users should not have the "AdministratorAccess" policy attached;
- IAM policies should be attached and managed at the group level.
Added Resource Catalog templates:
- Huawei Cloud: dds, functiongraph, kafka, obs, rds(mysql), rds_mariadb, rds_sqlserver
- Volcengine: postgresql
- Alibaba Cloud: nat
- Tencent Cloud: tdsql_c_mysql, mongodb, eip, cos
- AWS: iam_user
- Cloud Integration templates:
- Added Tencent Cloud ckafka, es, redis, waf, etc.;
- Optimized Huawei Cloud: rds, postgresl, apig;
- Optimized AWS: WAF.

Bug Fixes¶

Fixed the issue where an email was registered but could not log into the corresponding workspace normally;
Fixed the issue where log data could not be written to newly created workspaces;
Fixed the issue of no data after pagination in the unrecovered events list;
Fixed the issue where monitoring indicators showed self-built testing nodes successfully sending data, but no data appeared in the Explorer;
Fixed the issue where file paths were not correctly displayed in error details after successful SourceMap upload and parsing;
Fixed the issue where global configuration saves were invalid in the Performance Profiling Explorer;
Fixed the issue with abnormal auto-refresh functionality in single dashboard view mode within Scenarios;
Fixed the issue where workspace administrator accounts could not create new workspaces;
Fixed the issue where clicking the view button in a dashboard to open view details had a time interval inconsistent with the dashboard configuration;
Fixed the issue with abnormal billing timeline charging functionality;
Fixed the occasional issue where filter conditions in the log explorer sidebar could not return correct results;
Fixed the issue of being unable to generate scheduled reports;
Fixed the issue of incorrect text on the testing function studio page;
Fixed the issue of "No metric data query permission" in external API reports;
Fixed the issue of "Internal Server Error" when accounts restricted by data access permissions tried to access the log explorer;
Fixed the interface error when viewing network topology in the Infrastructure network menu;
Fixed the issue where iOS symbol table uploads failed to successfully parse stack information;
Fixed the issue of frequent false alerts (corresponding machines online without issues) in Infrastructure Liveness Detection V2;
Fixed the issue where the log explorer within a workspace could not search for specific logs using Chinese;
Fixed the intermittent issue of incomplete or missing trace query results, requiring repeated page refreshes;
Fixed the issue where the upper limit value supported for setting continuous trigger judgment conditions in monitors was incorrect (should be 10);
Fixed the issue where log data forwarding volume abnormally decreased by 90% starting from a specific date;
Fixed the issue where the error_stack field could not be selected in monitor grouping settings, while it could be used normally in DQL;
Fixed the issue where DQL queries executed by monitors returned incorrect data, leading to event alerts;
Fixed the issue of accessing Infrastructure functionality failure on the Ningxia site;
Fixed the issue where drilling down into CPU metrics showed "No Data" in all related charts;
Fixed the issue where members in a workspace could display logs via traceid, but searching for keywords in logs returned no results;
Fixed the issue where log monitors could be saved without a data source configuration, but monitoring would fail;
Fixed the issue of errors when opening a specific view within a scenario on mobile applications;
Fixed the issue where the "Cross-region Private Network Traffic Fee" billing item in a workspace abnormally increased on specific dates;
Fixed the issue where high consumption warnings set within a workspace on the Hangzhou site did not send warning emails normally;
Fixed the issue where AWS-related Resource Catalog was displayed in Chinese;
Fixed the issue with abnormal data auto-scaling functionality when setting dashboard data units;
Fixed the issue of data display errors in workspace resource topology on the Hangzhou site and the Performance Profiling page failing to load;
Fixed the issue of abnormal log queries on the Oregon site;
Fixed the issue where service nodes in the resource topology graph had no upstream/downstream, and metrics like request count and p99 were 0;
Fixed the issue where dashboard scheduled reports did not display data normally;
Fixed the issue of abnormal jumps when clicking in the APM analysis dashboard;
Fixed the issue of abnormally high error logs (nearly ten thousand per minute) for specific services in the Deployment Plan.

November 20, 2025¶

Feature Updates¶

Query Tool¶

PromQL > Range Query Mode now supports setting the step (step).

Scenarios¶

Text Chart supports the introduction of view variables and time variables, automatically parsing user-manually entered view variables #{fieldname} and time variables.
Funnel Chart: The number of nodes that can be added has been increased to 15.
In dashboards, explorers, and query tools, when chart sampling is enabled, a sampling rate icon will be displayed in the upper right corner.
- In the query tool, clicking this icon allows temporarily disabling sampling.

Management¶

In blacklist configuration, "Filter" now supports optional entry.
SSO Management:
- The "Edit" button must be clicked before enabling/disabling operations can be performed;
- The "Edit Identity Provider > Role Authorization" page supports selecting custom roles.

November 12, 2025¶

Feature Updates¶

Billing¶

The billing unit price for "APM/LLM Trace" has been adjusted as follows:

Monitoring¶

Added new Programmable Detection monitors, allowing detection rules to be written via scripts, covering detection needs for various system data types.

TOBY AI AI¶

Added support for anomaly analysis. Based on input text, TOBY AI AI can intelligently integrate complex and chaotic information, generating clear and concise root cause analysis results for you.

MCP Server¶

Added support for accessing MCP Server (Model Context Protocol). As an open protocol, it provides a unified multi-model callable interface service for TrueWatch TOBY AI AI, supports multi-client access, and accesses Guance's monitor, log, dashboard, and DQL query capabilities via API Key authentication.

Management¶

Role Management: Scenario configuration management/monitor permission split.
- Scenario Configuration Management: Permissions subdivided into
  - Dashboard, View View
  - Dashboard Management
  - View Management
  - Note, Explorer Management
- Monitor: Split into Monitor View and Management permissions.
Field Management: Added new "Attribute Classification" configuration item, including: System Field, Business Field, Other.
Workspace Settings:
- Added new "Data Reporting IP Whitelist" configuration. When enabled, only egress IPs within the whitelist can report data normally; data from other sources will be blocked.
- The original "IP Whitelist" configuration has been renamed to "Login IP Whitelist". When the login (host) IP whitelist is enabled, only requests from sources in the whitelist can log in normally; requests from other sources will be denied access.

LLM Monitoring¶

Added support for collecting scores (model quality evaluation scores, descriptions, etc.) and displaying them.

Events¶

Change Event: New hosts being accessed will generate new change events.

Scenarios¶

Time Series Chart > Analysis Mode added style switching and period-over-period comparison;
Charts added "Open in Metric Analysis" functionality. Seamlessly transition from any chart to the metric analysis interface, with the system automatically bringing in the set query conditions.

Explorer¶

Log Explorer: Display fields now also support filtering values;
All Explorers: Added field type icon display.

Log Index¶

Log Index: Added Description and Associated Service Configuration. When querying traces, the system will automatically associate matching service indices.
External Index: Added index description configuration;
Explorer application of index supports single/multi-select mode switching.

APM¶

Service Map: Added display of maximum service response time.

RUM¶

Explorer > Fetch/XHR tab page: The original "Request" column renamed to "Resource URL", and supports displaying the full URL, with a button to toggle display on/off.

Cloud Account Management¶

Added search control, supporting fuzzy matching by keyword search.

New Integrations¶

Added Volcengine PostgreSQL integration;
Added Alibaba Cloud CPFS integration;
Added Alibaba Cloud ALB integration;
Optimized Alibaba Cloud NAT view;
Optimized Tencent Cloud Cloud Monitoring;
Optimized Alibaba Cloud Oceanbase dashboard;
Added Pipeline templates:
- AWS ELB
- Squid
- Kong
- CloudFront
- CloudTrail
Added cloud collector templates:
- Alibaba Cloud cfw/cen/apigateway/mqtt/nas/OceanBase/ga;
- AWS step function/ssm run command/waf2;
- Huawei Cloud apic/apig/auto_scaling/cbr/cdm/css_es/dcaas, etc.;
Added CSPM templates.

Bug Fixes¶

Fixed the issue where clicking on a log in the log stream graph to expand the details page could not display the context;
Fixed the issue where the index in the log side-slide page was not automatically matched;
Fixed the issue where view variables could not be selected when there were too many in a dashboard;
Fixed the issue where the latest DK version could not be obtained via Helm in the AWS Oregon region;
Fixed the issue of DQL parsing failure when configuring detection metrics in APM metric detection;
Fixed the issue of workspace invitation member failure reports and language display issues on the APM interface;
Fixed the display abnormality when clicking the "Data Access" menu;
Fixed the issue of not receiving emails after selecting a one-time "Immediate" report in scheduled reports on the Singapore site;
Fixed chart jump issues in the RUM performance analysis dashboard;
Fixed page errors when viewing basic machine information on the Oregon site;
Fixed the issue where log sources under selected indices could not display normally in log detection monitors;
Fixed the issue of no response when clicking on log sources in monitors;
Fixed the issue of excessive connection count when forwarding data to Kafka;
Fixed the "Internal Server Error" when querying recent day data in the APM analysis dashboard;
Fixed the issue of duplicate display of extended field values in the console;
Fixed display abnormalities after selecting "All Sources" for the data source in blacklist configuration;
Fixed abnormal display of trace information in log details;
Fixed the issue of charts displaying "service unavailable" in scheduled reports;
Fixed abnormal display in APM > Resource Call > Response Time Distribution;
Fixed the issue where bar charts using PromQL queries for a specific metric without aggregation or grouping could not set aliases;
Fixed page errors after clicking host details in the Infrastructure page of the Deployment Plan;
Fixed the issue of erroneous single group deletion in dashboards;
Fixed abnormal return results after changing the top value in Top List chart settings;
Fixed the issue of blank Profile data upon opening and inability to download;
Fixed the issue of user alerts caused by slow Redis hgetall query logs;
Fixed the issue where the label_values function became unavailable after upgrading the base version to 1.119.212, and view variable settings could not be saved;
Fixed incorrect jump links in the Security Monitoring Rule Writing Guide;
Fixed errors when querying external index logs;
Fixed the issue of excessively large fluctuations in data points in log query time series charts;
Fixed the issue where composite detection monitor configurations were empty after exporting from Space A and importing into Space B;
Fixed abnormal display and drill-down issues in Heat maps.

October 22, 2025¶

Feature Updates¶

Open API¶

Supports modifying the duration of data retention policies;
Supports log field global configuration > Key Field Configuration;
Supports creating log indices via interface.

External API¶

DQL¶

Added function rate_over_sum(), which first sums the field within the aggregation window, then divides by the window length (seconds), used to calculate the average rate, with the result being a floating-point type.
Added function rate_over_count(), which counts the number of non-null values of a field within the aggregation window and divides by the window length (seconds), used to calculate event frequency, with the result being a floating-point type.
Added support for count(*) / 1i syntax.
Example: L::*:( count(*) / 1i ) [::1m]. Represents dividing by the number of seconds in the time window size (1m) to calculate the QPS of log writes.

Billing¶

Data Forwarding > External Storage Forwarding Traffic Statistics: Based on the current workspace, aggregates compressed forwarding traffic by external storage type, counts daily increments, and distinguishes between public and private network traffic for billing invoicing. Click to view specific price details.
Usage Analysis: Supports manual switching to the billing time zone (UTC+8), resolving issues where user time zones differ from the billing time zone.

Monitoring¶

Alert Strategies: Added support for not sending notifications for recovery events: When this option is enabled, all recovery conditions only generate events and do not send external notifications.
Monitor:
Added Large Volume Alert Protection button: When the number of alerts generated by a single detection exceeds a preset threshold, the system automatically switches to a status summary strategy: instead of processing alert objects individually, it generates a small number of summary alerts based on event status and pushes them.
Log Detection > Detection Metrics: Supports configuring multiple indices.
Range Detection, Outlier Detection: Supports cross-workspace query for detection metrics.

Scenarios¶

Histogram:
- Added support for querying metric class data sources.
- Controls statistical dimensions based on the BY field in the query conditions, divided into "Global Statistics" and "Group Statistics":
- Without BY conditions, performs global total statistics, calculating the total distribution of all data.
- With BY conditions, groups data by the BY field and then calculates the distribution for each group.
- Added X-axis and Y-axis configuration, allowing customization of data display boundaries by setting maximum and minimum values.
Time Series Chart: At the target time point on the time series chart, clicking allows selecting a Fixed Time Marker. Once set, the marker does not change due to mouse movement, page scrolling, or switching time series charts.
Composite Chart: Added export button, supporting one-click export of all chart information.
Chart > Link: When creating a new chart in a dashboard (existing charts remain unchanged), if the BY field in the query conditions meets specific criteria, the system will automatically enable the display of the corresponding link list.
Report: Original real-time reports and archived reports are unified into "Report". All reports will be archived and saved, simplifying management and viewing experience.
- Simultaneously supports directly creating new reports on the dashboard page, automatically bringing in the current view and time range.
- The Report Records page allows viewing historical archived data and directly sharing or deleting it.

Infrastructure¶

Host: Added Real-time Performance toggle. When enabled, the system refreshes every 10 seconds and automatically fetches the latest three metric fields: CPU usage, memory usage, and CPU load.

Explorer¶

Global Configuration > Quick Filter Configuration: For RUM and Synthetic Tests explorers:
- The left side displays the source list, allowing modification of multiple options simultaneously in a pop-up.
- When opened from different explorers, the corresponding source will be automatically selected.
RUM > Long Task Explorer > Details Page: Added Script details, displaying restored code.
Time Widget: Added Playback button. After selecting a time range and executing a query operation, clicking the ▶️ button quickly returns to the most recent specified time range.

Snapshots¶

Supports re-editing already saved snapshots.

Management¶

Blacklist: Supports one-click enable/disable.
Pipelines: Optimized template export format and updated official template library samples.
Role Management: Supports one-click export of roles.
Data Forwarding: In addition to JSON text format storage types, added support for Parquet data storage type.

LLM Monitoring¶

Added access guide configuration steps.

New Integrations¶

Added AWS CloudTrail integration;
Added AWS CloudFront integration;
Added AWS Athena integration;
Added Alibaba Cloud NAS integration;
Added Alibaba Cloud MQTT integration;
Added Alibaba Cloud OceanBase integration;
Optimized Kong integration documentation, added Tracing integration method;
Optimized CSPM templates.

Bug Fixes¶

Fixed the issue where members could not view and timestamp variable settings were incorrect after log field advanced configuration linkage;
Fixed the issue where calling OpenAPI to invite members still sent invitation emails to already joined members;
Fixed the issue where data in dashboard views was not expanded normally;
Fixed incorrect format after exporting table charts to CSV;
Fixed defects in the Multi-step test creation flow;
Fixed the issue where the return upper limit for area charts, line charts, and bar charts in metric analysis did not match the documentation description;
Fixed the issue where Profile could not open normally;
Fixed the issue where field aliases were visible when adding quick filters in the explorer but disappeared after addition;
Fixed the issue of scheduled report sending failures;
Fixed the issue where no testing task data appeared on the platform after creating a new testing task, and self-observability queries found related error logs in kodo;
Fixed errors when querying JSON format data with DQL;
Fixed the issue of no data in RUM Action and View details;
Fixed the issue where actual role permissions existed but were not displayed on the right side in API Keys management;
Fixed the issue where scheduled reports could not be sent in production workspaces but could be sent in test workspaces;
Fixed the issue where custom roles could not be deleted;
Fixed issues with the log explorer: including abnormal bar chart and data count display, and inconsistent entry counts between searched items and items displayed below;
Fixed the issue of no data when clicking to view after sharing a snapshot;
Fixed the APM data empty result issue;
Fixed the issue of data backlog when forwarding to Kafka, with the backuplog service continuously consuming memory until OOM;
Fixed the issue where provinces with data were not displayed in the China map on dashboards;
Fixed the issue where text charts in panels would move to the top after repositioning and refreshing;
Fixed slow loading when querying 5-minute logs;
Fixed incorrect escaping of filter conditions when jumping to associated views from the event details page;
Fixed the issue where time window parameters affected calculation results when using DQL to query data;
Fixed the issue where data stored by guancedb-storage was for 1 year, not meeting expectations;
Fixed the issue where filtering user-customized fields in Actions did not take effect;
Fixed the issue where Webhook object addresses were not properly effective in alert events after modification;
Fixed log query issues: including lag when scrolling down the list for more details and query errors, and significant differences between status distribution chart display results and actual data;
Fixed the issue where cross-workspace trace queries only displayed current workspace data.

October 15, 2025¶

Feature Updates¶

Chart Query¶

Expression Query:

Added an independent "Expression Query" input box for directly writing expression formulas;
All queries are automatically assigned a query identifier (e.g., a, b, c) beforehand;
Compatibility Notes
- Historical chart subquery identifiers (e.g., A, B) cannot be reused by new expressions;
- Existing expressions can still be queried normally, not affecting current chart functionality;
- It is recommended to reconfigure expressions using new query identifiers when editing charts.

Data Forwarding¶

Added support for forwarding data to Volcengine TOS, providing five storage type options: Standard Storage, Infrequent Access Storage, Archive Flashback Storage, Archive Storage, Cold Archive Storage, to adapt to storage needs in different business scenarios.
When the storage type of forwarded data is "Archive", supports restoration tasks to thaw data for access and analysis.

September 24, 2025¶

Feature Updates¶

Open API¶

Added specified API Key creation permissions for newly created workspaces;
Added support for binding a specified billing center;
Added support for cross-workspace authorization.

Security Monitoring¶

Added CSPM detection type, supporting custom selection of detection types based on actual business scenarios (e.g., cloud resource protection, compliance audits, etc.), enriching detection coverage scenarios. Detection type descriptions are as follows:
CSPM (Cloud Security Posture Management): Identifies misconfigurations (e.g., open high-risk ports, excessive permission assignments) and compliance risks in cloud infrastructure, continuously assesses cloud resource security, and reduces vulnerability exploitation risks.
SIEM (Security Information and Event Management): Collects and analyzes security data from across the infrastructure, detecting threats and anomalous activities (e.g., abnormal login + bulk data export) through event correlation and log analysis.
Official Detection Library Experience Upgrade: Detection rules added "Belongs to Detection Library" identifier, facilitating quick identification of rule sources; simultaneously supports switching views in the template library, allowing browsing of all detection rules including monitors at once, improving rule search efficiency.
Security Detection Rule Editing Experience Optimization: Added "Trigger Detection Immediately" function, eliminating the need to wait for scheduled detection cycles, enabling real-time triggering of detection tasks. This allows users to quickly verify script effectiveness and immediately view generated security signals after writing/adjusting detection scripts.

Management¶

Added Preferences, allowing unified configuration of workspace language, theme mode, detail page opening methods, etc.;
Member Management: Added support for exporting members;
Invite Member: Added configuration for member team affiliation and remarks information.

Monitoring¶

Monitor: Supports "Trigger Detection Immediately" when editing monitor rules;
Mutation Detection, Range Detection V2 support cross-workspace queries
Mute Rules support cloning.

APM¶

Service List page added "Add Service" button.

Synthetic Tests¶

When creating new testing tasks, supports configuring task execution frequency by inputting custom crontab.

Incident¶

When an Issue is automatically discovered for the first time or manually created, the system supports AI intelligent analysis, automatically summarizing the current Issue content.

Metrics¶

Generate Metrics: Supports Infrastructure and Resource Catalog data sources.

View Variables¶

Removed the original all values option, unified use of * to achieve multi-scenario filtering needs. Supports selective use based on different business scenarios, with specific effects as follows:

Ignore this field filter: When * is selected, ignore this field filter; chart queries will not include filtering conditions for this variable.
Full value filter (equivalent to original all values): When * is selected, all variable values will be used as filter conditions (supports up to 100 values). Note: Excessive data may impact performance; it is recommended to use selectively based on actual needs, avoiding indiscriminate full-value filtering.

Explorer¶

Log Explorer: Index style adjustment, simultaneously supports one-click selection of all indices, pinning indices, searching and locating by index name, and other operations;
All Explorers: Supports Advanced Linkage Configuration.
Added query acceleration configuration, allowing configuration of indices for commonly used filter fields in the explorer "Global Configuration" to improve query speed for those fields.

Added support for Quick Zoom function: One-click expands the current query time range to 3 times the original, reducing manual time range adjustment steps and improving data exploration efficiency.

External Data Source¶

Added support for SQL Server data source.

New Integrations¶

Added AWS AOSS integration;
Added AWS PCS integration;
Added Alibaba Cloud CEN integration;
Added Continuous Profiler JVM dashboard template (analyzing Profile data);
Added AWS WAF integration;
Added FastDFS integration;
Added Alibaba Cloud API Gateway integration;
Added Alibaba Cloud Cloud Firewall integration;
Translated AWS AOSS/AWS PCS views.

Bug Fixes¶

Fixed the issue of adding tags to df_label in event content via central Pipeline;
Fixed the issue of unsuccessful deletion of workspace authorizations;
Fixed Resource Catalog database resource display issues;
Fixed the issue where host data on the Infrastructure > Host page decreased after clicking the sort button;
Fixed incorrect billing center username values during new account registration;
Fixed system internal errors when binding external indices (TLS/ES);
Fixed errors when creating workspaces;
Fixed errors when drilling down into Redis metric data, resulting in page errors about failed Func query task creation;
Fixed the issue where dashboards sometimes could query data and sometimes reported Internal Server Error;
Fixed the "Specified view not found" issue after jumping from container_crash related events in K8s within Infrastructure;
Fixed the issue where prometheus exporter metric collection displayed the same interface across different versions during integration;
Fixed missing display of some fields in log stream graph unit settings;
Fixed discrepancies between Open API call results and documentation;
Fixed the issue of missing charts in the system view "APM P90 Resource Analysis View";
Fixed the issue where alert strategies failed to successfully send emails to customers;
Fixed the issue where JSON key:value format output in event templates did not follow the format viewed in the explorer;
Fixed false alerts generated by host data reporting monitors;
Fixed 502 errors during SourceMap uploads;
Fixed omissions in the Webhook alert process;
Fixed abnormal fields appearing when using DQL to query logs during panel drawing;
Fixed unknown Scalar function errors in dashboard queries;
Fixed mismatches after switching DQL to simple queries in dashboards;
Fixed the issue where Pie Chart in the Data Display module of Studio dashboard did not work properly;
Fixed 400 errors on the Metric Management interface > Time Series page on the Hangzhou site;
Fixed erroneous text in Integration > Cloud Account Management;
Fixed errors in RUM ERROR pattern analysis;
Fixed the inability to query RUM Session and View data;
Fixed Warroom issues;
Fixed the issue where no results appeared in the list when filtering for entry-type spans, even though both entry and exit span types existed for the specified resource;
Fixed incomplete display of service lists.

September 3, 2025¶

Feature Updates¶

Security Check¶

The Security Check function has been officially discontinued. Its related functionalities can be achieved through the Security Monitoring > Security Information and Event Management (SIEM) module.

LLM Monitoring¶

TrueWatch introduces LLM Monitoring, providing "monitoring + tracing" capabilities for large model applications, eliminating the "black box" of model operation. It fully records input/output, tool calls, retries, latency, cost, and tokens for each call. Visualizable Trace and Session aggregated by conversation facilitate replay and troubleshooting, enabling full-link transparent management. It now prioritizes support for Langfuse integration. If you are already a Langfuse user, you can quickly enable LLM monitoring capabilities.

Free Plan¶

Targeting independent developers and small teams, TrueWatch adds a Free Zone (Beijing) node. Under this node, you can register for the Free Plan (other sites no longer support creating Free Plan workspaces), covering key core functionalities.

Open API¶

Incident > Schedule: Supports adding parameters for retrieving calendars and filtering schedules.

Explorer¶

Log Explorer:
Added Advanced Linkage Configuration: Supports configuring jump links for individual fields, enabling direct opening of target pages from the current field, completing parameter transfer through variables for linkage analysis.
Log Explorer Display Items optimization:
- Added "Delete All Fields", "Reset Fields" buttons;
- Added "Time Column" display toggle.
All Explorers
Supports DQL Query mode.
Supports searching for all IP addresses under a single IP field via the CIDR function.

Events¶

Events generated by SIEM rules (security) support TOBY AI AI intelligent analysis on the details page.
No restriction on dimension tags, default support for jumping to log/trace explorers.

Monitoring¶

Alert Strategies Management: Under Rule Aggregation Mode, supports selecting only "Send First Alert", thereby avoiding missing important abnormal events while waiting for aggregation.
Monitor > Event Content supports defining domain variables:
df_studio_env_name: Current environment name
df_studio_console_base_url: Current environment console address
df_studio_monitor_base_link: Current environment monitor address

Management¶

Workspace administrators support disabling AI Intelligent Analysis at the workspace level.

Metrics > Metric Analysis¶

Table Chart mode added Prom mode, displaying results returned by PromQL queries.
In independent chart mode, chart titles are added based on query conditions.

Infrastructure¶

Host and Container explorers support directly creating mute rules.

Synthetic Tests¶

Testing Task: Request body content now supports multipart/form-data.

Sensitive Data Scanning¶

Supports covering all data types, no longer limited to scanning only log data.

Mobile RUM¶

Analysis dashboard added "Crash Analysis" and "Stutter Analysis" tab pages.

New Integrations¶

Added Squid integration;
Added Openresty integration;
Added Kafka 4.0 integration;
Added AWS MWAA integration;
Added AWS Step Function State Machine integration;
Added Alibaba Cloud GA integration;
Updated Nginx tracing integration;
Updated AWS OpenSearch monitor/view.

Bug Fixes¶

Fixed the issue where aliases in dashboard grouped table charts did not take effect;
Fixed incorrect display results in overview charts;
Fixed Chinese characters appearing when importing dashboards (multiple dashboards - zip file);
Fixed the issue where funnel charts jumping to session lists displayed errors in session replay;
Fixed the issue of still sending alert events after setting mute;
Fixed the issue of host tags not displaying in Infrastructure;
Fixed the issue where data existed in the Android explorer but corresponding analysis dashboard charts did not display data for the same time period;
Fixed the issue of no connections between services in the service topology graph;
Fixed incorrect alert mute configurations causing all alerts to fail;
Fixed the issue where chart DQL statements returned no results;
Fixed testing task errors on the Guangzhou site;
Fixed unexpected results when importing templates in the Deployment Plan management console.

August 13, 2025¶

Feature Updates¶

Open API¶

Supports custom roles for Tokens.

RUM¶

To cover query scenarios for application data of different scales, the system has optimized RUM data writing. Accordingly, the following updates have been made:

RUM data query drill-down to application level:
Explorer/Analysis Dashboard: Added application filter at the top of the page, defaulting to "All Applications", supporting custom single or multiple selection; queries are triggered only after selecting applications.
DQL query statements support single or multiple application queries; more usage instructions can be found at RUM Data.

R(app name1)::view:(count_distinct(username))   # Specify querying UV for a specific application name
R(app id1)::view:(count_distinct(username))     # Specify querying UV for a specific application ID
R(*)::view:(count_distinct(username))   # Specify querying UV for all applications within the workspace

Existing users experiencing application data query performance bottlenecks can contact their account manager to enable the "User Access Data Table Splitting" function in the management console. For new users, after creating a workspace, the system will automatically split data writes based on different applications.

Scenarios¶

Scheduled Reports: Added "Archived Reports": Supports performing full data calculations on dashboards according to set cycles (daily/weekly) and generating static snapshots. Archived results are retained long-term, unaffected by dashboard configuration changes, and can be viewed within the platform or notifications sent as configured.
Dashboard > Log Analysis: Added support for automatically including the dashboard's view variables as filter conditions for display.
Log Stream Graph: Supports querying all data sources within the platform.

Explorer¶

The search bar supports querystring(md5(xxx)) tokenized query method. If data is MD5 encrypted and needs to be located in the explorer after scanning, this method can be used for querying.

DataFlux Func¶

To enhance security protection for DataFlux Func (Automata), the following updates have been made:

The "Reset Password" operation has been removed from the Automata page in the console, and initial account passwords are no longer sent to email;
For newly created Automata instances, using the Func page for login is disabled by default, only supporting authorized login via console user authorization.
Already installed Automata Func: After upgrading to version 7.2.0 or above, two login methods are supported:
Authorized Studio users can log in directly via the console > DataFlux Func (Automata) interface;
Users previously created in Func (including the initialized admin user) can also log in via the Func page.

APM¶

Trace > Waterfall Detail Page/Code Hotspot tab page: Resources support one-click expand or collapse;
Topology Graph: Added support for displaying "P95 Response Time".

Synthetic Tests¶

Testing Task > Request Body: Supports configuring four types of dynamic variables:

{{ timestamp "ns" }} //1754379375400790109
{{ date "rfc3339" }} // 2006-01-02T15:04:05Z07:00
{{ date "iso8601" }} // 2006-01-02T15:04:05Z
{{ urlencode "hello world" }} // hello+world

Added support for one-click cloning of testing tasks.

Monitoring¶

Threshold Detection > Detection Metrics: Supports selecting metric data across workspaces. Subsequently, after monitor rules are successfully created, cross-workspace alert configurations can be implemented.
Monitor List: After quick filtering monitors, supports cross-page select all and one-click export.

Events¶

For recovery events, added definition of df_fault_end_time extension field as fault recovery time.

DCA¶

List supports selecting all data;
Supports configuring filter conditions based on DataKit version (datakit_ver), operating system (os), environment (env), etc.;
List added environment display.

Management¶

Role Permissions: Added "Client Token View" permission.
Cross-workspace Authorization: When editing or deleting authorization rules, if data scope or log indices are reduced, a confirmation pop-up is added, displaying the names of affected monitors and data access configurations, while supporting exporting this list as a CSV file.
System Notifications: Added subscription type – "Monitor": Once a monitor becomes invalid, the system will send email notifications.

New Integrations¶

Added AWS SSM RunCommand integration;
Added AWS EBS integration;
Added AWS ECR integration;
Added AWS EFS integration;
Added TDengine monitor;
Added Milvus K8s view;
Updated Azure cloud billing: EA architecture support;
Rewrote OTEL jvm dashboard: different metrics for 1._ and 2._ (java agent);
Huawei Cloud billing script update: Fixed billing anomalies caused by missing instance IDs;
SIEM templates launched (10 AWS templates);
Optimized AWS MemoryDB;
Optimized Tomcat monitor;
Optimized Tencent Cloud MySQL, supporting cloud disk edition (cloud disk) node dimension metrics, slow log collection;
Optimized Alibaba Cloud Oceanbase collector, supporting supplementary tenant data.

Bug Fixes¶

Fixed recent slow log query issues;
Fixed inconsistent data performance for resource objects;
Fixed the issue where associated logs in traces displayed as 0;
Fixed errors when clicking code hotspots after successful deployment;
Fixed abnormal data display after scrolling to the bottom of dashboard log stream graphs;
Fixed import errors when importing dashboard JSON with identifier set;
Fixed incorrect jump locations in Resource Catalog official template library;
Fixed sensitive data scan configurations not taking effect;
Fixed the issue where count_distinct query results were greater than count query results;
Fixed the issue of no data display on trace detail pages;
Fixed PromQL statement errors that didn't occur with different query time intervals;
Fixed abnormal display of trace service names;
Fixed the issue where Picture charts could not be modified;
Fixed the inability to write cloud billing data in production environments;
Fixed abnormal display of service topology charts in dashboards;
Fixed site registration and activation failures;
Fixed abnormal display of RUM funnel functionality;
Fixed the occasional issue of missing dashboard lists after importing dashboards, requiring re-entering the page for complete display;
Fixed misleading interface access guidance;
Fixed interface operation errors reporting 406 - kodo API exceptions;
Fixed the issue where SourceMap file paths, environments, and versions were correct but source code could not be parsed;
Fixed abnormal data display in log indices;
Fixed the issue of adding APM guide pages on the interface;
Fixed variable display in chart titles after sharing charts;
Fixed service context not updating when clicking different services in trace flame graphs;
Fixed abnormal fuzzy query search data for dashboard view variables;
Fixed Pipeline script save failures;
Fixed the issue where SIEM templates did not take effect after addition, but tags did;
Fixed topic 404 errors in nsqd logs of the Deployment Plan;
Fixed the inability to normally display load times in popular page performance overviews;
Fixed the lack of view details buttons for .net profile data on trace detail pages;
Fixed occasional non-display of data for the same DQL expression queries;
Fixed unstable display of infrastructure dependencies in APM;
Fixed DQL subqueries not taking effect;
Fixed platform page errors after performing mute operations on events in the Events center.

July 23, 2025¶

Feature Updates¶

Monitoring¶

SLO
SLO deduction is executed at "second" level frequency;
SLI events added display of event information generated under corresponding monitors.
Details Page added Overview page, with related key metric charts dynamically linked to the time widget in the upper right corner.
Added "SLO Correction" configuration. When SLO is about to be violated due to uncontrollable factors (e.g., infrastructure failure, third-party service interruption), temporary correction mechanisms avoid false alarms while ensuring SLO data audit compliance.
Alert Strategies
Supports cloning alert strategies;
When configuring notification rules based on members, added support for one-click copying member notification configurations.

Events¶

The default refresh time for the time widget on the default explorer page is set to refresh every 30 seconds;
Alert notifications on the details page no longer display sending status.

Billing¶

Usage Statistics: Added "Backup Log Count Increment" display, used to count the number of new backup logs added daily;
Usage Analysis: Default entry query time adjusted to "Today".

Basic Components¶

For the Shortcut > Snapshot display page:
Supports filtering by type;
Supports batch delete operations.
Explorer
Search Bar:
- Recent query display count adjusted to 10, saved count adjusted to 50;
- Supports pinning query conditions;
Quick Filter > Workspace Filter Items: After configuring fields, the system automatically adds indices. Simultaneously, in the explorer search bar and chart query dropdown components, an icon identifier is added for these fields.
Details Page: Extension fields added icon identifiers for fields already added to the display column for differentiation.

Infrastructure¶

Database: Added SQL Server data collection type; details page allows viewing all Table related information, including columns, indices, foreign keys.
Resource Catalog: Custom object explorer details page added "Complete Information" tab page.

Metrics¶

Metric Management: Added "Unique Value Count" display for tags, counting distinct tag values globally or under a single metric dimension.

Pipelines¶

One-click Get Sample: Supports specifying data sources to obtain test data.

Scenarios > Top List¶

External data source queries support sorting.

Management¶

Data Forwarding: Supports multiple filter conditions as OR;
Token: When replacing a Token, added configuration to adjust permission scope, supporting use only for reporting.
Sensitive Data Scanning: Custom rules support lookaround regex test matching.
Support Center > Ticket: Added character limit for ticket descriptions.

New Integrations¶

Added Huawei Cloud APIG integration;
Added Huawei Cloud SFS Turbo integration;
Optimized Alibaba Cloud ECS integration view;
Updated AWS SQS integration;
Tencent Cloud cloud product collection optimization, supporting multi-dimensional metric collection (Cloud Monitoring V2);
EIP
COS
MySQL
PostgreSQL
MariaDB
TDSQL-C MySQL
TDSQL-C PostgreSQL
Redis
KeeWiDB
MongoDB
Memcached
Huawei Cloud integration related documentation content format adjustments.
Fixed Chinese characters appearing in the console's Scene > Dashboards section;
Fixed Chinese display of some country names in the console's Scene > Dashboards > Create > World Map;
Fixed the issue where if an Issue created by automatic discovery was manually changed to closed or resolved, subsequent Issue generation would restart the old Issue instead of creating a new one;
Fixed abnormal display of log explorer status distribution charts;
Fixed expired session replay display;
Fixed no data when switching event center display items to list mode;
Fixed abnormal frontend display of event data;
Fixed abnormal Resource data display in the RUM explorer;
Fixed query errors for forwarded data;
Fixed interface exceptions for /api/v1/inner/alert_opt/get, /api/v1/account/list in the Deployment Plan;
Fixed unupdated Pod monitoring view templates associated with traces;
Fixed abnormal display of data access input data scope filters;
Fixed time range issues when slicing PromQL by 1d in time series charts > bar charts;
Fixed the issue where PromQL query statements had data within hourly intervals but no data within daily intervals;
Fixed the issue where webpack plugins showed SourceMap file upload success but files couldn't be viewed in the SourceMap list;
Fixed duplicate Issues generated by Incident > Issue automatic discovery;
Fixed Prometheus function idelta not meeting expectations;
Fixed significant discrepancies between log explorer query results and DQL query results under the same query conditions;
Fixed the issue where monitors set df_label but generated events had no df_label value, causing user mute strategies not to take effect;
Fixed IP fields not taking effect in Pipelines for user access;
Fixed errors after upgrading kodo-x in private environments;
Fixed "Top Span Missing" display in trace details when top spans actually existed;
Fixed the inability to query application data in RUM > Application List;
Fixed the issue where workspaces couldn't see consumption details in Billing;
Fixed the issue where pressing Enter while entering a snapshot name in Save Snapshot would directly save;
Fixed billing for log monthly usage with 0 usage;
Fixed display judgment issues for src_ip and dst_ip;
Fixed occasional erroneous display of log explorer bar charts for the same time interval;
Fixed search functionality usage issues in Incident;
Fixed the issue where follow direction configuration in Synthetic Tests tasks didn't take effect and was cleared upon re-editing;
Fixed inconsistent entry counts between log index queries over multiple days and TLS.

July 9, 2025¶

Feature Updates¶

Billing¶

Introduced a new billing model: Enterprise Plan. This model adopts combined billing based on data traffic + total storage volume, more accurately aligning with actual resource consumption in scenarios with extremely high log write volumes, making users' cost structure more transparent and predictable. This model provides optimized cost-effectiveness for handling massive observability data and is one of the foundational capabilities for building an "enterprise-grade observability hub with full-domain control."
Within Enterprise Plan workspaces, data retention policies support custom configuration;
To upgrade from the Free Plan to the Enterprise Plan, please contact your account manager.
Commercial Plan:
Billing item names in Usage Statistics and Usage Analysis adjusted;
Commercial Plan Time Series 180-day, 360-day price adjustments.

Monitoring¶

Monitor > Threshold Detection: Detection metrics support querying external data sources;
Monitor List: Supports searching and locating based on monitor ID.

Events¶

Added Display Items: Supports switching between standard and list mode display.
Change Event > Details Page: Basic Attributes adjusted as follows:
Change Content: Displays df_message content, recording detailed descriptions of resource changes;
Diff Comparison: Displays diff content, recording difference text of resource changes.

Scenarios > Charts¶

SLO Chart: Locked time added "This Year" dynamic time option;
Heat Map:
Added "Metrics" data source type query;
Added Y-axis configuration, supporting Y-axis calculation based on data.

Infrastructure¶

Network > Overview
Supports custom analysis dimensions: By selecting source and target query fields, displays aggregated query data;
Supports cross-workspace network data queries.
Database:
Added Oracle database integration;
For PostgreSQL databases, allows viewing all Table related information, including columns, indices, foreign keys.

Metrics¶

Generate Metrics: Supports different generation rules specifying the same metric name and tags;
Metric Management: Added multi-dimensional time series analysis at the measurement level.

Deployment Plan Updates¶

Workspace List > Index Configuration: Supports configuring data retention policies.

New Integrations¶

Added OpenLLMetry integration;
Added Undertow integration;
Added Cloudflare integration;
Added Huawei Cloud CDM integration;
Added Huawei Cloud DWS integration;
Added Huawei Cloud NAT integration;
Added AWS Transit Gateway integration;
Updated Volcengine ECS monitor, view;
Updated MinIO view, monitor;
Optimized Huawei Cloud ASM / CCE integration;
Optimized Alibaba Cloud SAE integration;
Optimized JMX / MQTT integration.

Bug Fixes¶

Fixed 404 errors when accessing session replay data in SaaS environments via login-free Tokens.
Fixed unrecognized Issue automatic discovery configuration content in RUM.
Fixed missing specific association information display in events generated by monitoring testing alerts.
Fixed duplicate label name prompts when modifying label names after adding labels in global tags.
Fixed abnormal DQL query return results.
Fixed PromQL query metric failures while DQL queries worked normally.
Fixed Deployment > Pod information confusion in multi-cluster scenarios.
Fixed abnormal log status distribution chart display.
Fixed inconsistent time ranges between RUM filters and time selectors, preventing application data viewing.
Fixed Issue automatic discovery template variables not taking effect in the RUM Error explorer.
Fixed "Invalid address" errors when adding Webhook notification targets.
Fixed data backlog issues in base data forwarding.
Fixed abnormal log status distribution chart display.
Fixed frequent false alerts caused by DQL query results of 0.
Fixed inability to sort, slimit invalidity, and pagination issues when querying logs via the base query tool.
Fixed time series queries returning time lines without any tags and not constrained by filter conditions.

June 25, 2025¶

Breaking Changes¶

Extracted df_check_targets, df_check_condition, df_check_rules from the df_meta field in events to the same level. Subsequently, in webhook notifications, when df_source = monitor, information such as detection time, detection metrics, detection count, and detection rules from the monitor configuration will be displayed.

Feature Updates¶

External API¶

Added interface index_list_info to query workspace index information list;
Added interface update_index_setting to modify workspace index configuration.

External Data Source¶

Added integration of PG, Oracle, Clickhouse three external data source types to meet broader data scenario requirements.

Logs¶

Added Native Direct Write Index type, allowing direct specification of the write index during data collection for precise classification and storage.

Monitoring¶

Range Detection V2 supports detecting APM, RUM data types;
Mutation Detection > Event Content: Added df_check_detail extension field, supporting output of mutation comparison original values to event details.

Events¶

Alert events triggered based on monitor configuration rules support TOBY AI AI Intelligent Analysis.

Infrastructure > Database¶

Added PostgreSQL database integration;
For MySQL databases, allows viewing all Table related information, including columns, indices, foreign keys.

Explorer¶

Search bar added Query History record display, click to directly reuse and flexibly modify.

Cloud Account Management¶

Added support for Tencent Cloud, Azure account types.

Scenarios¶

Adjusted Import Dashboard entry, integrating original custom template import functionality, while supporting batch dashboard import.
Dashboard page added "Log Analysis" functionality, allowing one-click viewing and analysis of related log data directly in a side-slide new page without jumping.

Incident¶

The "Incident" menu on the console left side added "Incident Management" entry, allowing direct jump to the management page.

New Integrations¶

Added Volcengine NAT integration;
Added Ceph integration;
Updated Clickhouse integration;
Huawei Cloud billing script optimization;
Added Tencent Cloud billing;
Added Tencent Cloud WAF integration;
Added Tencent Cloud ES integration;
Added Tencent Cloud cos/cdb/mariadb/postgresql English version views, monitors;
Added AWS Firehose;
Added AWS VPC NAT Gateway integration documentation;
AWS cloud billing script update: T+1 calculation method caused billing errors for some components (e.g., EC2), adjusted to T-2;
Added Azure cloud billing.

Bug Fixes¶

Fixed abnormal data display after generating metrics;
Fixed inability to load log content after clicking "Load More" on the log details page;
Fixed invalid RUM activation links and missing pricing content;
Fixed inability to query data after clicking associated event jumps in Issues;
Fixed 406 errors when creating Infrastructure Liveness Detection v2 type monitors;
Fixed slow session replay page loading;
Fixed missing automatic rule name generation when creating mute rules via Open API;
Fixed errors when inputting PromQL to query metrics;
Fixed abnormal page error rate display;
Fixed frequent disappearance of host tags;
Fixed ineffectiveness of descending order after adding search conditions in resource invocation top lists;
Fixed no prompt to rebind MFA after unbinding MFA and logging out/back in when 7-day MFA-free login was selected;
Fixed CSV file rendering issues due to empty aliases in exported dashboard data;
Fixed monitors not generating alerts normally, with self-observability logs showing query timeout errors;
Fixed automatic deletion of imported fields in backend management;
Fixed user experience data loss.

June 11, 2025¶

Feature Updates¶

Billing¶

Added new statistical items: Trace Write Traffic, RUM Write Traffic, SIEM Scan Volume; Usage Analysis simultaneously displays data for newly added statistical items.

Scenarios¶

Dashboard > AI Intelligent Analysis: Added support for automatic error discovery and error analysis, further enhancing TOBY AI AI data processing capabilities.

Monitor¶

Detection frequency supports shortest custom input of 20s, system newly supports selecting 30s;
APM Metric Detection, RUM Metric Detection respectively support multi-selection of service, application;

SIEM¶

Official Detection Library launched: The system provides out-of-the-box security information detection template library.

Infrastructure > Database¶

Supports cross-workspace data viewing;
Added fields: QPS, TPS, Average Query Duration, Slow Query Log Status, Slow Query Count.

Metrics > Metric Analysis¶

Added Independent Chart mode, suitable for scenarios where multiple queries are added simultaneously and query result units are inconsistent;
Added support for displaying grouped total statistics, while default slimit changed to 50.

Logs > Explorer¶

Stack Mode added line break toggle;
Context logs support clicking the time column for ascending/descending sorting.

Cloud Account Management¶

Cloud Account type added support for Huawei Cloud.

Management > Environment Variables¶

RUM Android/iOS SDK supports dynamic updates via Environment Variables.

Query Tool¶

Table charts and simple queries in metric analysis both support selecting multiple columns;
DQL quick queries default to simple mode, supporting multi-column configuration queries.

APM¶

ddtrace added package level instrumentation configuration. If instrumentation is needed for all methods under packages com.zy and javax.servlet, configure as follows: -Ddd.trace.method.packages=com.zy,javax.servlet.

Deployment Plan Updates¶

Mapping Rules added "Append Mapping" toggle. When enabled, accounts using single sign-on will be assigned workspaces and roles according to mapping rules, while original workspaces and roles remain unchanged.
For workspaces using the ScopeDB engine, supports configuring tenant-level queries.

New Integrations¶

Optimized Tencent Cloud billing script, supporting sub-account method to obtain billing information;
Added Tencent Cloud billing integration;
Added Tencent Cloud EIP integration documentation;
Added Tencent Cloud CDB monitor (English);
Added Huawei Cloud billing integration;
AWS ELB integration content update;
AWS LAMBDA integration content update;
AWS S3 integration content update;
Added AWS Aurora MySQL integration;
Added AWS Aurora PostgreSQL integration;
Added Hikaricp integration;
TiDB Cloud view optimization;
Added vpc integration;
Added AWS rds postgresql integration.

Bug Fixes¶

Fixed the issue where userid was not displayed in the resource explorer for Singapore site user workspaces;
Fixed the inability to query custom reported userid via the action explorer;
Fixed inaccurate AI analysis results in dashboards;
Fixed Open API time series trend chart retrieval issues;
Fixed delayed display of data gap content on monitor edit pages;
Fixed skipping existing files when uploading SourceMap using webpack plugin;
Fixed errors in quick filters under network functionality;
Fixed non-functional variable filters;
Fixed high-risk penetration testing vulnerabilities;
Fixed dashboard errors in the resource analysis section of the User Analysis dashboard on the Singapore site;
Fixed undefined variable values in panel link jumps;
Fixed missing time selector box in the upper right corner of the log explorer;
Fixed discrepancy between preview chart display data and actual data in monitors (APM);
Fixed display issues regarding DingTalk and WeChat in emails during cross-workspace authorization;
Fixed inconsistencies between SSO user lists and user details in backend management;
Fixed display issues for external database data source queries;
Fixed trend chart display issues when creating new threshold monitors;
Fixed search failures when viewing services in APM;
Fixed DQL query errors;
Fixed daily repeat mute rules not sending mute生效 notifications as expected daily;
Fixed missing AI analysis button when entering traces from RUM session replay.

May 28, 2025¶

Open API Updates¶

Incident supports returning associated event count information when listing and retrieving.

Feature Updates¶

SIEM¶

Detection Rules: Added test, full-screen script editing functionality;
Added new Signals explorer;
Added new Execution Logs explorer.

Monitoring¶

Alert Strategies > Association: Added selection of SIEM detection rules, simultaneously supporting direct creation.
Edit Monitor Rules > Detection Metrics added support for PromQL query preview.
Monitor Rules list:
Import added support for "Delete and import monitors with the same name" on the operation page;
Supports one-click export of all monitor rule configurations for the current workspace.
Intelligent Inspection function entry discontinued.

Infrastructure¶

Containers: Added Persistent Volume Claims Explorer.
Added Database Explorer, providing a centralized explorer tool for real-time monitoring of MySQL database performance metrics, resource usage, and log records.
Resource Catalog: Resource Class added Database, displaying total count of all databases.

Incident¶

Channel > Issue Details Page: Added "Associated Events", allowing direct click to jump to the event list for viewing; Issue emails and other sent notification events simultaneously added associated event display;
Notification Strategies > Issue Escalation: Added event storm option. Can set the system to send "repeat" or "once" notification reminders when the cumulative count of events associated with an Issue exceeds a specific number.

Events¶

Unrecovered Events:

Added "Mute" button. Clicking allows direct "Mute" configuration of rules on the current page.
Added "Recover All with One Click" button. Clicking recovers all abnormal events in the current list, with option to associate Issues.

APM¶

Flame Graph: Added "Locate to Current Span" function button.

RUM¶

WEB SDK added client timezone recording.
Session Replay view page added client timezone display.
All time widgets uniformly added timezone display.

Scenarios¶

Dashboard > TOBY AI AI Intelligent Analysis:
Optimized page display效果;
Optimized problem output.
Charts
Time Series Chart: Added prompt: Query has exceeded the maximum number of data points for time series charts, only displaying 1,000 data points;
Bar chart mouse hover color adjustment;
Table chart order adjustment optimization: Compatible with PromQL queries.

Metrics¶

Metric Analysis: Added query history and unit configuration.

Management¶

Sensitive Data Masking: Supports one rule configuring masking for multiple fields.
Data Access: Edit page added access site selection.

Explorer > Quick Filter¶

All Explorers:
In edit mode, supports modifying "Filter Fields", "Optional Fields";
Added hide field alias functionality;
When searching for fields, if query results have no precise matching values, can directly create and add to "Filter Fields".
Log Explorer:
Two view modes display adjustment, added "Global Configuration" in "Stack Mode";
Display Items Configuration adjustment.

Registration¶

Login/Registration page display optimization.

Deployment Plan Updates¶

Configuration Management > Issue Discovery: Rule check frequency added support for 1 minute.

New Integrations¶

Added TiDB Cloud integration documentation;
Added Traefik integration documentation;
Added AWS cognito integration;
Added AWS certificatemanager integration;
Added AWS RDS PostgreSQL integration documentation;
Added aliyun rabbitmq integration;
Updated haproxy view and monitor;
Added Huawei Cloud DIS English monitor, view;
Updated AWS ELB application integration documentation, view, added AWS ELB application monitor;
Updated AWS lambda integration documentation, added Lambda fetching S3 log data operation steps.

Bug Fixes¶

Fixed abnormal metric generation data reporting.
Fixed tag import failures when calling Open API import monitor interface.
Fixed unstopped testing tasks.
Fixed 406 errors when clicking "Context Logs" in log details.
Fixed cache issue where alertPolicyMemberInfos displayed existing members in code when monitors only configured notification targets without configuring members.
Fixed un生效 saves after selecting to treat results as 0 in monitor data gap settings.
Fixed failures and errors during batch alert recovery.
Fixed inconsistent log explorer query result counts.
Fixed overwriting original data when batch modifying monitors via API without configuring extend, rule fields.
Fixed incorrect replacement of built-in view templates after import in backend management.
Fixed lack of linkage between log index configuration one-click key field获取 and log explorer stack mode key field display, which instead displayed based on display items.
Fixed critical level errors in monitor execution logs.
Fixed DQL subqueries not taking effect.
Fixed incorrect condition filling due to unescaped commas in variable values when clicking Top List views and selecting apply to view variables.

May 14, 2025¶

Brand LOGO Change¶

TrueWatch unveils a new innovative visual identity, showcasing its iterative信念 and technological strength amidst the AI wave.

From this moment, TOBY AI will accompany you in洞察 the data world,驾驭 system complexity, and走在 the forefront of the AI era.

External API¶

Dashboard: Supports globally importing platform-level dashboards via identifier ID. This operation only updates dashboard configurations and does not affect the binding relationships of this view within each workspace.

Feature Updates¶

Security Monitoring¶

Added SIEM function module: Real-time analysis of logs and event data from various enterprise systems (e.g., servers, applications, network devices), automatically discovering potential threats, helping teams quickly locate anomalies, and fully发挥 the role of a security monitoring hub.

Monitoring¶

Alert Strategies:
Association: Supports selecting SIEM detection rules;
Notification Configuration: Added "Security Monitoring" type level.
Monitor: Due to adjustments in "Infrastructure Change Detection Monitor" data writing, old monitors need to be re-saved to avoid affecting generated event display.

Events¶

The "Events" function module renamed to "Events", interaction page optimized.
Added Events explorer, supporting centralized viewing of all event data.
Event recovery added secondary confirmation operation to avoid accidental触 scenarios.

Incident¶

After adding schedules in Incident > Calendar, when creating a new Issue or associating a responsible person, "On-duty Personnel" or "Notification Targets" can be selected. The system automatically assigns Issue responsible persons and notifies based on当日 on-duty personnel.

Scenarios¶

Dashboard: Added TOBY AI AI Intelligent Analysis functionality.
Time widget logic optimization: When "Relative Time" is selected, even if users set refresh frequency to "off", modifying query conditions (e.g., adding/removing conditions using quick filters in explorers, adjusting filter conditions in search boxes, or switching view variables in dashboards/notes) will still trigger重新 queries.

Management¶

Data Forwarding: For the three archive types AWS S3, Huawei Cloud OBS, Alibaba Cloud OSS, added Encrypted Storage selection toggle. When enabled, the system encrypts outgoing forwarded data.
Audit Events: Added workspace field marking.

Infrastructure¶

Host, Container, Pod, etc. detail page built-in pages:
Time Widget: Added Pin functionality;
Integration Operation Status: "View Monitoring View" page optimized;
Associated views added current event occurrence timeline display.
Host Explorer: Default query time adjusted to "Last 2 hours".

Logs¶

Optimized log multi-index matching hit logic, avoiding computational waste caused by逐条 matching index rules.

Deployment Plan Updates¶

Supports creating, deleting, and modifying groups via External API, as well as adding or removing users within groups;
Workspace Management > Data Retention Policy: Added network storage policy configuration, supporting selection of fixed 2-day storage duration or custom保存 duration.
Added Profile data reporting dynamic parameter toggle. Users can dynamically enable or disable Profile data reporting based on platform performance.
Added API Key configuration and AI function access link configuration toggles, including the following scenarios:
Monitor > Alert Strategies > AI Alert Aggregation
AI Write Pipeline entry
Scenarios > Chart Components > AI Chart Title and Description Generation
Log Explorer > Log details with error status, Logs > Error Tracking > AI Error Analysis entry
RUM > Error Explorer > AI Error Analysis entry
APM > Trace Explorer > Trace details with error status, APM > Error Tracking > Trace Details > AI Error Analysis entry
When editing alert strategies, supports custom repeat alert time. Custom input silence time format examples: 20m (20 minutes), 2h (2 hours), 1d (1 day).

New Integrations¶

Added host class monitors;
Added MySQL monitors;
Updated CouchDB view and monitor;
Added ActiveMQ integration;
Added AWS SNS integration;
Added Volcengine ESCloud integration;
Added English version Huawei Cloud API, Huawei Cloud CCE monitors and dashboards;
Added Volcengine RabbitMQ integration;
Modified AWS MSK integration metrics.

Bug Fixes¶

Fixed 413 errors during SourceMap upload via Vite packaging, SourceMap download errors, and TrueWatch inability to display source code error locations.
Fixed abnormal display of multiple workspace RUM data during cross-workspace queries.
Fixed inaccurate namespace and service data display after selecting self-built log indices in the log explorer.
Fixed page style混乱 when creating multi-step tests.
Fixed inability to normally display namespace tag data in quick filter sections under multi-index conditions in the log explorer.
Fixed false alert误报 on the Guangzhou site.
Fixed anomalies when viewing host detail information using hosted Doris in version 0409.
Fixed abnormal external data source query data.
Fixed重影 display when expanding single logs in log pattern mode.
Fixed recovered events still displayed on event statistics pages.
Fixed errors triggered by clicking "Batch" button in unrecovered events list display mode.
Fixed inability to query historical logs on S3 via "Data Forwarding" function.
Fixed FUNC alert message sending logs in version 1.109.196 Volcengine base being reported to business workspaces.

April 23, 2025¶

Breaking Change¶

Testing Data Storage Adjustment: Testing data has been separated from the original log index, independently stored in tables, and added dedicated query Namespace D. This adjustment does not affect historical testing data. If testing data was previously queried via custom charts, please update query configurations promptly. Official testing templates (e.g., HTTP, ICMP, TCP, WebSocket, Multi-step Test) and related monitors, metric rules have been adapted to this change.

External API¶

Supports adding, modifying, listing specified workspace role lists, member list interfaces;
Optimized interface names and descriptions in OpenAP, External API.

Feature Updates¶

RUM¶

SDK supports environment variable hot updates: By predefining variable parameters, introducing variables via environment variables within applications enables dynamic configuration updates.
Application > New Application: Users' custom parameter configurations实时 update left-side code examples; the system caches latest parameter configurations, eliminating need for re-entry each time.
Error Explorer: Added support for TOBY AI AI Error Analysis. Intelligent parsing of single RUM error logs, automatically extracting key information, and obtaining preliminary resolution ideas and suggestions through integrated online search.

Infrastructure¶

Cross-workspace Authorization: If authorized workspaces exist and authorized data type is "Basic Objects", directly switch workspaces on Infrastructure object type explorer pages to achieve cross-workspace object data viewing.
Added "Change Event" tab page, supporting display of change details based on Deployments, Daemonsets, Services, Cron Jobs, Statefulsets five object type data, facilitating user回溯 change records.

Monitoring¶

Monitor > Detection Rules: Added "Infrastructure Change Detection". Through continuous monitoring of Kubernetes resource configuration changes (e.g., YAML file modifications), combined with version tracking and intelligent analysis, achieves compliance checks, fault root cause定位, and resource usage optimization, ultimately ensuring cluster security, stability, and resource efficiency.
Detection Rules > Event Content > Custom Event Notification Template: Added time automatic conversion template function {{ df_fault_duration | to_date_range_human }}.

Events¶

Added Change Events:
View all event data records triggered based on Infrastructure Change Detection rules.
All Event Details > History Trend: When detection objects have change events, time series charts display change event time nodes, supporting click to jump to change details page.
Event Explorer:
Added "Only Show Unassociated Issue Button", clicking quickly filters out associated events;
Added "Display Items": Supports display preference switching (including list, standard, extended三种方式);

Management¶

Data Forwarding > Data View: Search Component Optimization.

Chart Export¶

Charts support exporting to synchronously created new dashboards or new notes, applicable scope includes:

Metric Analysis
Explorer > List/Dimension Analysis

Explorer¶

Adjusted interactions for basic "List" view and "Dimension Analysis" chart modes;
Dimension Analysis: Added grouped table chart.

Integration¶

In the console left menu, "Cloud Account Management" function access path adjusted from original Management interface to Integration directory.

Deployment Plan Updates¶

Supports adjusting Login Method (local account, LDAP account, OIDC) order.

New Integrations¶

Added apollo;
Updated Argocd integration documentation, adjusted to kubernetesprometheus collecting metric information;
Updated ingress nginx documentation view monitor;
Neo4j updated dashboard & added monitor;
Added kubelet integration;
Added Azure Virtual Network Gateway integration;
Updated TIDB integration documentation, view and monitor;
Alibaba Cloud 30 components added Automata management.

Bug Fixes¶

Fixed incorrect member count display on member management page.
Fixed untranslated log view time fields after switching to English interface.
Fixed abnormal label synchronization display after switching clusters.
Fixed abnormal user count display due to stutter count appearing on RUM > Analysis Dashboard > Mobile > Error Analysis page when mobile SDK not接入.
Fixed timing judgment issues for log explorer > details page appearance.

April 9, 2025¶

Open API Updates¶

Supports creating, editing, deleting multi-step testing tasks;
Supports configuring workspace count upper limit restrictions.

Feature Updates¶

Scenarios¶

Chart Optimization
Bar Chart:
- Adjusted Alias position, supports listing all metrics and groups;
- Added X-axis configuration item.
Grouped Table Chart:
- Supports sorting based on group selection;
- Return count dropdown added 200 option, manual input maximum count adjusted to 1,000.
Time Series Chart > Line Chart: Added line "Style" settings, including linear, smooth, step-before, step-after.
Snapshot: Added permission prompts for dashboard snapshot sharing with configured permissions.
Explorer, Dashboard > Time Widget: Added "Last 1 minute", "Last 5 minutes", default selects后者.

Management¶

Cross-workspace Authorization: Supports cross-site data authorization, enabling extended data sharing.
Data Forwarding:
Data type added "Audit Events".
Adjusted explorer query time logic:
- Changed to daily queries,不支持 cross-day queries;
- When viewing forwarded data, system automatically queries and continuously loads until complete display,无需 user manual clicks;
- Management > Workspace Settings > Advanced Settings: Added "Data Forwarding Query Duration" configuration.
Data Access, Pipeline, Blacklist permission split, adjusted "Management" permission to: "Create, Edit" and "Delete".

Monitoring¶

System Notifications: Added associated log jump links, allowing jumps to log explorer and filtering out logs of failed notifications for this notification target.
Monitor:
Create from Template > Official Template Library: Added search functionality;
Configuration Page > Event Content: Updated注意提示. Only when关联异常追踪 enabled, @ member configuration生效 and sends此处 event content to specified members.
Threshold Detection: Added Recovery Conditions toggle, configuring recovery conditions and severity. When query results have multiple values, any value meeting trigger conditions generates recovery event.

Incident¶

Issue email notification "Source" modified to hyperlink, users click to directly access.

RUM¶

SourceMap:

Page interaction adjusted, from original pop-up to separate page;
List page added search, export functionality.

TOBY AI AI¶

Optimized Generate Chart functionality: Caching metric management data via local Func, generated DQL更贴近 semantic descriptions.

TOBY AI AI Error Analysis ¶

Added context support for root cause analysis, helping users更快,更全面 understand error context, improving诊断 efficiency.

Integration > Extensions¶

DataFlux Func (Automata)/ RUM Headless: Application billing added email reminders and system notifications.

Infrastructure¶

Host > Details Page: Disk capacity statistics distinguish between local disks and remote disks display.

Deployment Plan Updates¶

Template Management:

Page interaction optimization, including added display column "Template Type", etc.;
Top filter items added "Template Type";
Supports batch exporting templates;
When importing templates, supports previewing template details;
Built-in view, Pipeline, monitor template upload supports同名覆盖 logic.

New Integrations¶

Added GCP Compute Engine;
Added Azure Storage;
Added Azure redis cache;
Added Azure kubernetes;
Added Azure Postgresql;
Added Alibaba Cloud Rds MYSQL Automata integration;
Added Druid integration
Updated Trino;
Adjusted AWS/Alibaba Cloud regarding Automata integration documentation: Added Automata开通脚本 steps.

Bug Fixes¶

Fixed discrepancies between Open API获取 unrecovered events and actual data.
Fixed errors when searching in event explorer.
Fixed abnormal external data source data queries.
Fixed Incident email notification related issues.
Fixed slow Incident > Analysis Dashboard loading.
Fixed incorrect bar chart color display.
Fixed no AK prompts for external events.
Fixed incorrect status distribution chart, log volume display.

March 26, 2025¶

Feature Updates¶

Events¶

Unrecovered Events: Time widget defaults to auto-refresh, manual event recovery adds frontend page prompts after success.
Event Details: Alert notification page display optimization.
Events, Intelligent Monitoring explorer export appended "Notified" display.

Management¶

Data Forwarding: Added permission configuration. By setting view permissions for forwarded data, effectively improves data security.

Monitoring¶

Infrastructure Liveness Detection V2: Added configurable detection interval.
Alert Strategies: Notification matching logic adjustment, improving execution efficiency for events hitting multiple策略 and complex alert strategy scenarios.
Notification Targets Management: Added Slack and Teams two notification targets to meet needs of更多 global users.

Scenarios¶

View Variables: Supports external data source queries.
Charts:
Added new "Monitor Summary" chart, integrating monitor list, displaying latest status, achieving即时 monitoring and异常态势感知.
Command Palette: Display optimization;
Chart Query: In DQL queries, using "wildcard" or "regex", added query suggestion prompts.
Explorer, Dashboard > Time Widget: Added "Last 1 minute" and "Last 5 minutes" options.

Billing¶

Added Monthly Bill module,直观 displaying monthly consumption total.
Added export bill functionality.

RUM¶

Application List > New Application: Added "Compressed Upload" and "Custom Hosted Address" parameter configurations.

Synthetic Tests¶

Added "South Africa" and "Hong Kong, China" as testing nodes, further expanding global coverage.

Logs¶

Log Explorer
Quick filter operation items adjustment;
List tokenization logic optimization;
JSON format data added "JSON Search";
Index > Key Fields: Added "One-click Get".

New Integrations¶

Added Azure Network Interfaces;
Added Azure Kubernetes;
Added Azure virtual network gateway;
Improved English integration translations.

Bug Fixes¶

Fixed low utilization display on log pages.
Fixed Service Map metric unit display issues.
Fixed inability to select units for multiple columns in table charts.
Fixed errors when exporting CSV from Dashboard > Log Stream Graph with export counts other than 1,000.
Fixed inconsistencies between most popular page P75 and DQL query results.
Fixed time selector boxes still displaying today after clicking << button.
Fixed menu management not meeting expectations.
Fixed abnormal workspace ID filter searches in backend management.
Fixed test sample loss in Pipeline interface.
Fixed excessively long configuration migration export times.
Fixed大量空项 in quick filter tags on event details interface after upgrade.
Fixed duplicate detection库 lists in monitor official template库, and inability to search other monitors once a detection库 selected.

March 12, 2025¶

Breaking Changes¶

Event df_alert_info field definition adjusted, added alert strategy未匹配原因说明, still requires filtering via isIgnored to obtain actual对外 sent notification targets.

Feature Updates¶

Incident¶

Added Incident Management entry, through which currently logged-in users can view and manage Incident statuses for all joined workspaces.
Optimized Incident page channel list display, improving query efficiency when channels过多.

Management¶

Cloud Account Management: Added Alibaba Cloud cloud account authorization type.
API Key Management: Added permission control functionality for API Keys, supporting role authorization addition. Through role authorization, API Keys only possess operation permissions within role scope, effectively reducing security risks.
Data Forwarding: Default interaction changed to not selecting rules.

TOBY AI AI Error Analysis¶

The following details pages added TOBY AI AI Error Analysis capability:

error logs
APM > Trace/Error Tracking

Scenarios¶

Scheduled Reports:
Added Webhook sending as notification method;
Supports sharing dashboard images to WeCom/DingTalk.
Time Series Chart: After selecting area chart as chart type, added Stack Mode style, facilitating observation of cumulative整体 data效果.

APM¶

Trace: Supports list batch export in JSONL format.

RUM¶

User Analysis > Funnel Analysis: For queried Session lists, supports session replay functionality.

Logs¶

Explorer:
Log Explorer > Index quick filter search bar listing display效果 optimization;
Log Details > Extension Fields: Added "Perform Dimension Analysis" mode;
Index: Under index dimension, supports setting专属 Key Fields.

Left-side time range selection and right-side refresh frequency are independent. Only two situations affect refresh frequency:

Selected time range exceeds 1h
Selected time is absolute time

Infrastructure¶

Host: Explorer supports adjusting time range.

Pipeline¶

Configuration page display optimization;
Pipeline processing type added "Events";
Test samples support obtaining JSON format.
Filter Conditions > Synthetic Tests: Supports selecting multi-step tests.

Deployment Plan Updates¶

Template Management: Supports uploading all explorer templates.

New Integrations¶

Added azure_load_balancer;
Rewrote K8S server api;
Updated Gitlab CI;
Translated Volcengine related views;
Translated AWS related views.

Bug Fixes¶

Fixed no response when exporting log stream graphs to CSV.
Fixed no data in time series charts after adding related filters when ddtrace collected JVM metric view variables were runtime-id fields.
Fixed custom gradient range color scale interface display issues.
Fixed empty display upon re-editing after saving time series chart DQL queries with filter conditions selecting >0.
Fixed abnormal APM > Infrastructure table chart display.
Fixed frontend forwarding rule不支持 after setting data forwarding storage duration to 1,800 days in backend management.
Fixed "kodo service API request error: Service Unavailable" when executing show_object_field(HOST) in quick queries.
Fixed bug issues in Shortcut.
Fixed no data for RUM session and view while other resource and action, etc. had data.
Fixed immediate validation of required fields when creating multi-step test request steps.
Fixed filter conditions not生效 when setting role authorization in data access.

February 27, 2025¶

Open API Updates¶

Metrics: Added Measurement and Tag Information Retrieval.

Feature Updates¶

Synthetic Tests¶

HTTP Testing: Supports Script Mode. By writing Pipeline scripts, flexibly customize testing task judgment conditions and data processing logic.
Added Multi-step Testing: Allows creating tests using multiple API connection response data, passing values via local variables, linking multiple task requests.

Scenarios¶

Dashboard > Visibility Scope: Added "Custom" configuration, allowing configuration of this dashboard's "Operation", "View" permissions. Simultaneously, this configuration added "All Members" option.
Charts:
Added AI-based automatic chart title and description generation capability;
Log Stream Graph added "Rule Mapping" functionality;
Table chart display column optimization;
Grouped Table Chart: Expression results support sorting;
Time series charts, pie charts, multiple tables support data export as CSV files.

Metrics¶

Metric Analysis > Table Chart: When query result return count exceeds 2,000 entries, three modes added "Query Result Count" display.
Metric Management: Supports one-click jump to metric analysis.
Generate Metrics: Supports import creation method, supports batch export.

Infrastructure¶

Container/ Pod Explorer: Object data added cpu_usage_by_limit, cpu_usage_by_request, mem_used_percent_base_limit, mem_used_percent_base_request 4 new fields.

APM¶

Profiling > Flame Graph interaction optimization: Selecting single search method name directly focuses定位.
ServiceMap interaction optimization: In upstream/downstream pages, supports searching nodes within current canvas.

New Integrations¶

Added AWS Cloud Billing;
Added Kube Scheduler;
Added MQTT;
Rewrote APISIX;
Updated tidb English documentation and views;
Updated Zookeeper view, supplemented integration icons;
Fixed部分组件 mainfest.yaml English translations.

Bug Fixes¶

Fixed errors when clicking APM > Trace Details tab pages;
Fixed incorrect @member in Incident > Issue replies;
Fixed incorrect temperature units in charts.

February 19, 2025¶

Breaking Changes¶

Event df_meta will no longer retain alert_info related information records. Users previously relying on this information for notification target acquisition should switch to using the newly added df_alert_info (event alert notification), df_is_silent (whether muted), df_sent_target_types (event notification target types) 3 fields to complete corresponding functionality.

Potentially affected functional scenarios:

Custom usage scenarios integrating external systems via Open API获取 events
Custom usage scenarios forwarding events to external systems via Webhook notification targets

Feature Updates¶

PromQL Query¶

Added query type: Instant Query, i.e., querying for a single time point.

Monitoring¶

Monitor configuration page:

Trigger condition logic matching added not between option;
Supports directly modifying monitor status ("Enabled" or "Disabled").

APM¶

Trace: Details page added Service Context tab page.

Events¶

Event Details Page: Added support for binding Built-in Views;

Incident¶

Issue added working, closed statuses;
For open status timeout停留 and未指定 responsible person and processing timeout situations, Issue escalation added repeat notification configuration;
Adjusted Issue system comments, channel notification UI display;
Analysis Dashboard: Added time widget.

Scenarios¶

Chart Link: Added "View Host Monitoring View", default关闭.
Explorer: Supports deleting fixed name column, users can customize list display.
Cloud Billing Analysis View: Supports viewing billing details.

Management¶

Role Management: Session Replay View, Audit Events added custom add view permission capability.

Metrics¶

Generate Metrics: Metric name input no longer supports using - hyphen.

Integration¶

Integration cards added description information.

Deployment Plan Updates¶

Template Management: Supports uploading Infrastructure explorer templates;
Index Configuration: Deprecated "Backup Logs" item; can configure corresponding storage policy at "Edit Workspace > Data Retention Policy > Data Forwarding-Default Storage".

New Integrations¶

Added Milvus;
Added Volcengine Public IP;
Added opentelemetry-python;
Added openLIT Integration;
Updated k8s\es\mongodb\rabbitmq\oracle\coredns\sqlserver Chinese/English monitors & views.

Bug Fixes¶

Fixed abnormal results caused by special characters in AI aggregation notification messages;
Fixed Servicemap Deployment Plan adaptation issues;
Fixed inability to configure already hidden view variables in composite charts;
Fixed混乱 display of "Unrecovered Issue List" in Incident > Analysis Dashboard;
Fixed inconsistencies between most popular page P75 results and DQL query results in RUM Analysis Dashboard;
Fixed abnormal RUM > Explorer search boxes;
Fixed partial生效 for same field in dashboards when using Resource Catalog for field mapping in Scenarios > Object Mapping;
Fixed UI display issues for Monitor > Event Content;
Fixed unmet expectations for quick filter results in Event Explorer unrecovered events.

January 16, 2025¶

Feature Updates¶

RUM¶

Added Funnel Analysis functionality: Users can create funnels by defining conversion steps, view data conversion and perform深入 analysis;
User Analysis Module Integration: Added User Analysis module, integrating heatmaps and funnel analysis within this module, providing更全面的 user behavior analysis tools;
Added Mobile SourceMap还原: Android and iOS applications support uploading SourceMap files on pages and viewing还原后 data in error explorer.

APM¶

APM Add Service: Added Host Auto-injection installation guide method, simplifying installation process.

Integration¶

DataKit (Data Collection Tool): DataKit installation page added Docker method installation guide, providing更多样化 installation options;
External Data Source Optimization: When querying SLS data sources, added query specification prompts, helping users更准确 perform data queries.

Scenarios¶

Composite Chart Optimization: Composite chart added view variable configuration, supports selecting current dashboard view variables作用于 this composite chart, helping更灵活 filter and analyze data.

Monitoring¶

Mutation Detection Monitor: Added week-over-week, month-over-week support for query周期.

TOBY AI AI¶

Added DataFlux Func related knowledge base.

Pipeline¶

Auto-generate Pipeline Optimization: Supports simultaneously obtaining Pipeline parsing via structured plus natural language interaction.

Bug Fixes¶

Fixed display issues in log stack mode;
Fixed misaligned function input boxes in log detection monitors;
Fixed metric calculation errors;
Fixed having statement不 support in Volcengine;
Fixed errors when selecting "Request Error Rate" and "Average Requests Per Second" two metrics in APM metric detection;
Fixed not in statement不生效 in Volcengine base;
Fixed large event list return data affecting page loading speed;
Fixed unmet expectations for one-click event recovery on Hangzhou site.

January 8, 2025¶

Open API Updates¶

Field Management: Supports获取 field management list, supports Add/Modify/Delete field management.
Synthetic Tests: Supports Modify testing tasks.
Incident > Schedule: Supports获取 schedule list, supports Create/Modify/Delete schedules.
Incident > Configuration Management: Supports获取 notification strategy list, supports Add/Modify/Delete notification strategies; supports获取 Issue discovery list, supports Create/Modify/Enable/Disable/Delete Issue discovery configurations.

Feature Updates¶

Logs¶

Log Index Optimization:
When accessing log built-in views, log context tab pages, respectively defaults to selecting current log's index, default index. Both tab pages support index multi-selection. Simultaneously, when cross-workspace query enabled and authorized workspaces selected in所属 menu, supports directly querying corresponding workspace index data here. Ultimately helps users completely view associated log data on one page, optimizing log query interaction.
When listing log indices, besides default pinned display,其余 log indices listed alphabetically A-Z.
Log Explorer added stack View Mode: In stack mode, fields整合 within same column, and these fields presented as rows inside cells. Log information display更紧凑 and清晰,方便 users quickly browse and analyze.
Log Pipeline Optimization: Log Pipeline test samples adjusted to获取 all log fields, and require line protocol format entry. Simultaneously user manually entered logs must follow format requirements.

Scenarios¶

Table Chart Optimization:
Multi-metric Query Sorting Support: When using one DQL for multi-metric queries, table chart now supports sorting.
Table Pagination Selection: Added table pagination selection functionality, users can select appropriate pagination size based on data volume and viewing needs.
Composite Chart: Supports adjusting chart order.
Chart Optimization: Adjusted DQL query component function order,同时特别 emphasized Rollup function usage scenarios, helping users更好地 utilize Rollup function for data aggregation and analysis.

Management¶

Events support configuring Data Forwarding: Supports configuring event type data forwarding rules, saving event data meeting filter conditions to TrueWatch object storage and forwarding to external storage, providing灵活 management event data capability.
Workspace added DataKit Environment Variables: Workspace supports managing DataKit environment variables, users can轻松 configure and update environment variables, achieving remote同步更新 DataKit collection configuration.
Query Audit Events Optimization: Added multiple fields for recording query information,同时 event content supplemented query time range,便于 tracking and analyzing query behavior.

Pipeline¶

Auto-generate Pipeline Optimization: Changed prompt appearance method, optimizing product experience.

TOBY AI AI¶

TOBY AI AI added Generate Chart: Generate chart functionality based on large model自动分析 user input text data, intelligently generating appropriate charts, solving manual chart creation繁琐, chart selection困难等问题.

Monitoring¶

Alert Strategies: Configuring notification rules by member supports appending names for usage description.

Deployment Plan Updates¶

Management Console > Workspace Menu Optimization:
Workspace list added main storage engine, business two filter items, supporting便捷 filtering workspaces;
Optimized workspace list page number return logic. When modifying/deleting a workspace, or modifying workspace data reporting limits, stays on current page to optimize query experience.
Deployment Plan added parameter: alertPolicyFixedNotifyTypes, supports configuring whether "Email" notification method displays in alert strategies Configuration Reference.

New Integrations¶

Added AWS Gateway Classic ELB;
Added Volcengine TOS Object Storage;
Modified AWS Classic collector name;
Added MinIO V3 integration;
Updated elasticsearch, solr, nacos, influxdb_v2, mongodb integrations (views, documentation, monitors);
Updated kubernetes monitoring views.

Bug Fixes¶

Resolved event data cross-workspace authorization not生效 issues;
Resolved log associated trace jumps to trace explorer carrying trace_id unable to query data issues;
Resolved view expression query inability to perform numerical filling issues;
Resolved external event detection monitors not generating operation audit records when changing alert strategies;
Resolved column width adjustment inability for event display lists.