Changelog (2025)¶

December 24, 2025¶

Feature Updates¶

Role Permissions¶

Dashboard permissions refined: Added independent "Dashboard Create" permission. The original "Dashboard Management" permission still includes all operations. Assigning the "Create" permission will automatically enable basic view permissions for dashboards and views.
The navigation bar dynamically displays based on user permissions. If a role does not have any permissions in a specified module, that module will not appear in its left navigation bar. This rule applies to the following modules: Cloud Billing, Billing, Scenarios, Event Center, Infrastructure, Logs, Metrics, APM, RUM, LLM Monitoring, Synthetic Tests, Monitoring, Incident, Security Monitoring.

Monitoring¶

Alert Strategies:
- Simultaneously supports search and filtering to filter alert strategies; newly added support for precise filtering by monitor name (checker_title) and member (member);
- Repeat Alerts: Added support for setting separate repeat alert suppression intervals for different alert levels (e.g., Critical, Severe, Warning, etc.);
- Added notification aggregation rule: "Custom". Supports freely specifying field combinations for alert aggregation based on business needs. Input field names (multiple fields separated by English commas), and the system will strictly aggregate based on this combination: aggregation alerts will only be triggered when event data contains all specified fields and their values are valid.
DQL functions built into Arbiter support querying data from a specified workspace by passing a workspace parameter. Applicable to scenarios for creating and modifying Programmable Monitors and SIEM detection rules.

APM¶

Performance Metrics:
- Added Apdex statistics to quantify user satisfaction with application performance;
- Time series visualization of statistical metrics: Upgraded core statistical metrics in the service list, such as average request count, response time, and error count, from numerical display to time series chart format, intuitively presenting change trends.
Service Details:
- Supports displaying OpenTelemetry service language;
- Added Tab pages: Service Map, Profile, Dashboard.

Scenarios¶

Added new chart type "Change Comparison Chart": Quantitatively compares the value of a specified metric in the current period with its value in the same historical period (e.g., same time yesterday, same day last week) or with other metrics, and visually displays the change magnitude, enabling quick identification of abnormal fluctuations;
When creating a Pie Chart (Donut Chart), when the legend is not hidden, you can choose whether to display the Value and Value percentage.
Chart Y-axis: Optimized raw value display.

Snapshots¶

Overall optimization of snapshot list style;
Save Snapshot: Added "Save as static time" setting.

Metrics¶

Metric Analysis: Numerical values in query results now support flexible display format settings, allowing configuration of decimal places and full-precision result display.

Management¶

Cross-workspace Authorization: When the data scope selects "Metrics", detailed configuration can be performed on the metric authorization scope;
Share Management: Added quick filtering by type and search box.

Pipelines¶

Each data type now supports setting two default Pipelines (including local and central Pipeline).

Open API¶

Dashboard cross-workspace queries support specifying the default selected workspace.

Deployment Plan¶

Management Console:
- Workspace List > Tenant Configuration Management:
  - Added "Maximum Time Partition" setting, defining the maximum time search range for a single query. Once sufficient data is obtained within this range, the search stops immediately;
  - Extended "Sampling Threshold" configuration, allowing free definition.
- Supports batch import of members by uploading a member list file;
- Security Settings > Login Method Management: Supports modifying the display name of the system default LDAP account to adapt to actual scenarios where different users have unified login across internal systems.
Added parameter (max_delay), supporting custom service topology calculation time.

New Integrations¶

Added GCP Storage integration;
Added GCP Cloud SQL (MySQL) integration;
Added Alibaba Cloud VPC Peering Connection integration;
Added AWS Lambda Trace integration;
Added Alibaba Cloud WAF Application Firewall integration;
Added Tencent Cloud Tencent CVM / KeewiDB views;
Fixed case sensitivity issue in Ingress-nginx-prom integration documentation;
Fixed integration documentation issues (including Chinese/English character and format issues);
Fixed TencentCloud public CLB collector to support non-public IPs;
Fixed linearBuckets metric bug in GCP Cloud Monitoring;
Added CSPM rule: S3 bucket policies should restrict access from other AWS accounts;
Added cloud integration templates: Aliyun CPFS, Aliyun NLB, HuaweiCloud EVS, Aliyun CNAPIGateway, HuaweiCloud ROMA;
Added cloud script: GCP APIs collector;
Added cloud script: GCP RUN collector.

Bug Fixes¶

Fixed the issue where alert events could not recover;
Fixed the issue of excessive connection count when connecting to external Kafka clusters;
Fixed the issue where email addresses being added to a blacklist prevented normal email reception;
Fixed the issue where the first load of the host list did not display the total number of online hosts, requiring waiting for lazy loading;
Fixed the issue where calling the log query task interface returned an error;
Fixed the issue where clicking Mute in event details on the Hangzhou site did not take effect;
Fixed the issue where the snapshot share button sometimes did not respond;
Fixed the issue of poor sampling results for APM on overseas sites;
Fixed the issue where alert events could not be associated to view related content;
Fixed the issue where searching log sources triggered large queries, causing platform queries to return no results;
Fixed the issue of not receiving high consumption warning emails;
Fixed the issue where monitor events did not recover as expected;
Fixed the issue of abnormal data display in the RUM error analysis view;
Fixed the issue of errors reported for trace data (7 days) and log queries (7 days);
Fixed the issue of abnormal Sourcemap reporting for the same version;
Fixed the issue where selecting all indices with wildcards when generating metrics from logs would cause generation failure;
Fixed the issue where read-only users could not view public dashboards;
Fixed the issue where the quick search function in dashboards could not be concatenated with log stream graphs, and the issue of abnormal display of multi-select view variables in log analysis;
Fixed the issue where obtaining samples encountered errors during time series governance using pipelines on overseas sites;
Fixed the issue where the "Past 1 month" query range in scheduled reports on overseas sites returned an incorrect time range (217 days);
Fixed the issue where dashboard template errors on overseas sites hindered testing;
Fixed the issue of abnormal expression calculation results in monitors;
Fixed the issue where clicking the "Go to Workspace" link often resulted in a white screen with no event details displayed;
Fixed the issue of incorrect paths in the guide for installing data collectors;
Fixed the issue where user access geographic location was displayed as Unknown;
Fixed the issue of abnormal CPU load value display for Windows hosts in Infrastructure;
Fixed the issue of abnormal results when using DQL for trace queries;
Fixed the issue where Session Replay data could not be displayed;
Fixed the issue where adjusting the time window on overseas sites resulted in incorrect APM data results;
Fixed the issue where the Inner Mongolia region in the China map was displayed in English with incorrect data;
Fixed the issue where data queries returned no results after logs were bound to external indices;
Fixed the issue where trace data details could not be opened;
Fixed the issue where pipelines processing logs could not judge or filter text with empty content;
Fixed the issue of IP address city resolution failure;
Fixed the issue of Chinese characters appearing in pipeline script functions on overseas sites, and the issue of user ID not being displayed in the resource explorer, and dashboard errors in the resource analysis section of the user access analysis dashboard;
Fixed the issue of lag when selecting wildcards for variables.

December 10, 2025¶

Feature Updates¶

Billing¶

Based on the newly added Notification Targets, added a new billing item "Phone Call": Counts the number of voice notification calls sent daily (each call/day).

In China Region sites, the billing details are as follows:

Billing Item	Settlement Currency	Price Details
Phone Call	RMB	¥0.6
	USD	$0.09

Monitoring¶

Added support for Voice Phone Call as a notification target;
Monitors support cross-workspace data detection

Management¶

Data Forwarding: After performing the Delete Rule action, the system sets the status of that rule to "Deleting". After processing is complete, the rule will be automatically removed.

December 3, 2025¶

Feature Updates¶

APM¶

Service Map:
- Clicking a node now adjusts to slide out the corresponding service details on the right side. In addition to basic information like service name, corresponding team, and contact details, new charts for service request response time, error request distribution, and error log count analysis are added;
- Added operation buttons: Can zoom out, zoom in, and fully display the entire topology map;
- Added topology map configuration:
  - Users can manually configure whether to calculate node size based on "Request Count";
  - Users can choose the hover highlight range.
Performance Metrics:
- Added Filter Field Configuration. In addition to official default filter fields, users can customize up to 5 fields as filter fields;
- Added support for exporting the current performance metrics list as a CSV file.
Service Details > Resource Invocation:
- Added sampling hint: When queries for the resource list and distribution chart trigger sampling, a "Sampling Rate icon" is displayed;
- Upstream/Downstream Topology: Added "View Upstream/Downstream Calls" buttons, supporting analysis of the full call path starting from the current resource by continuing to view the calling relationships at the upper/lower levels based on the current topology.
Trace > Service Call Relationships:
- Interaction optimization: Only draws call paths between different services, making dependency relationships clearer;
- Node information enhancement: Displays full-path service call relationships through a left-right structure. Simultaneously, on each service node, directly displays execution time, average response time, call count, and error information; clicking allows viewing the service's parent Span for tracing upstream call sources; if the service has errors, error details are directly displayed.

RUM¶

To adapt to the development of the HarmonyOS ecosystem, added support for Application Type HarmonyOS. Users can select the HarmonyOS client type when creating an application and obtain corresponding SDK integration guidance and configuration support to achieve complete observability integration for HarmonyOS applications.
View Explorer page supports TOBY AI error analysis.

Event Center¶

Added Event Level: Fatal (df_status:fatal), defined as the highest level.

DQL¶

Added Function histogram_auto(): Automatic histogram range aggregation, no need to manually provide bucket basis, automatically selects appropriate bucket ranges to return statistical information of data distribution.
Optimized eval expression null value handling logic, added OR operator null value determination rule: When the left query result is null, automatically uses the right result for calculation, flexibly adapting to null value completion scenarios. Example analysis:
- (a or 0) / b: When query a result is null, automatically treats it as 0, finally calculating 0 / b;
- (a or b) / b: When query a result is null, automatically uses query b's result, finally calculating b / b.

MCP Server¶

Added support for querying metrics, traces, and RUM data in a standardized way.

Management¶

Data Forwarding: When deleting a rule, the rule name must be entered to confirm the operation;
Member Management: Supports assigning roles to teams. Team roles are automatically applied as additional roles to team members. A member's final permissions include both personal roles and team roles.

Scenarios¶

Dashboard:
- Added "Filter" button for quickly adding global filter conditions;
- Original functions like "History Versions", "Large Screen Mode", "Report Records" have been moved to the "Settings" dropdown menu.
Charts:
- Advanced Configuration: Added "Repeat Chart" option. When enabled, the system generates multiple charts with the same structure based on the various values of the selected view variable;
- Clicking a data point now supports Apply to Filter and Copy Group Label;
- Table Chart: Manually entered return count upper limit increased to 2000.

Monitoring¶

Alert Aggregation Notification Template Optimization: In rule aggregation and intelligent aggregation notifications, displays the count of different events triggered within the current aggregation period, helping users quickly identify the scale and impact scope of alerts associated with the alert.

New Integrations¶

Openresty added OpenTelemetry trace access method;
Added Zabbix integration, based on api\stream;
Added Alibaba Cloud Native API Gateway integration, Alibaba Cloud Function Compute integration;
Added Huawei Cloud EVS cloud disk integration;
Added Tencent Cloud WAF monitor;
Optimized Alibaba Cloud NLB view & integration documentation;
Optimized Alibaba Cloud SLB view;
Fixed iis integration view monitor;
Optimized Huawei Cloud ECS, CSS, Functiongraph views and monitors;
Optimized Tencent Cloud clb monitor/view;
Added Huawei Cloud DC/ Alibaba Cloud SLB monitors;
Discontinued Huawei Cloud GaussDB related integrations (Huawei Cloud discontinued the related products);
Fixed Huawei Cloud ROMA script;
Added CSPM templates:
- S3 buckets should have "MFA Delete" enabled;
- S3 bucket ACLs should restrict public internet access;
- S3 bucket content access should be limited to authorized principals;
- IAM users should not have the "AdministratorAccess" policy attached;
- IAM policies should be attached and managed at the group level.
Added Resource Catalog templates:
- Huawei Cloud: dds, functiongraph, kafka, obs, rds(mysql), rds_mariadb, rds_sqlserver
- Volcengine: postgresql
- Alibaba Cloud: nat
- Tencent Cloud: tdsql_c_mysql, mongodb, eip, cos
- AWS: iam_user
- Cloud Integration templates:
- Added Tencent Cloud ckafka, es, redis, waf, etc.;
- Optimized Huawei Cloud: rds, postgresl, apig;
- Optimized AWS: WAF.

Bug Fixes¶

Fixed the issue where an email was registered but could not log in to the corresponding workspace normally;
Fixed the issue where log data could not be written to newly created workspaces;
Fixed the issue where the unrecovered event list showed no data after pagination;
Fixed the issue where monitoring indicators showed self-built testing nodes successfully sending data, but there was no data in the explorer;
Fixed the issue where file paths were not correctly displayed in error details after SourceMap was successfully uploaded and parsed;
Fixed the issue where global configuration saving was invalid in the performance profiling explorer;
Fixed the issue with abnormal auto-refresh functionality in single dashboard view mode within Scenarios;
Fixed the issue where workspace administrator accounts could not create new workspaces;
Fixed the issue where clicking the view button in a dashboard to open view details had a time interval inconsistent with the dashboard configuration;
Fixed the issue with abnormal billing timeline charging functionality;
Fixed the issue where the sidebar filter conditions in the log explorer occasionally failed to return correct results;
Fixed the issue where scheduled reports could not be generated;
Fixed the issue with incorrect text on the dial testing function studio page;
Fixed the issue where external API reports showed "No metric data query permission";
Fixed the issue where accounts restricted by data access permissions encountered "Internal Server Error" when trying to access the log explorer;
Fixed the interface error when viewing network topology in the Infrastructure network menu;
Fixed the issue where iOS symbol table uploads failed to successfully parse stack information;
Fixed the issue of frequent false alerts (corresponding machines online without issues) in Infrastructure liveness detection V2 version;
Fixed the issue where the log explorer within a workspace could not search for specific logs using Chinese;
Fixed the issue of intermittent missing or incomplete trace query results, requiring repeated page refreshes;
Fixed the issue where the upper limit value supported for setting consecutive trigger conditions in monitors was incorrect (should be 10);
Fixed the issue where log data forwarding volume abnormally decreased by 90% starting from a specific date;
Fixed the issue where the error_stack field could not be selected in monitor grouping settings, while it could be used normally in DQL;
Fixed the issue where DQL queries executed by monitors returned incorrect data, leading to event alerts;
Fixed the issue of accessing Infrastructure functionality failure on the Ningxia site;
Fixed the issue where drilling down into CPU metrics showed "No data" in all related charts;
Fixed the issue where members in a workspace could display logs via traceid, but searching for keywords in logs returned no results;
Fixed the issue where log monitors could be saved without a data source configuration, but monitoring would fail;
Fixed the error when opening a specific view within a scenario on mobile applications;
Fixed the issue where the "Cross-region Private Network Traffic Fee" billing item in a workspace abnormally increased on a specific date;
Fixed the issue where high consumption warnings set within a workspace on the Hangzhou site failed to send warning emails normally;
Fixed the issue where AWS-related resource catalogs were displayed in Chinese;
Fixed the issue with abnormal data auto-scaling functionality when setting dashboard data units;
Fixed the issue of resource topology data display errors and performance profiling page loading failures on the Hangzhou site workspace;
Fixed the issue of abnormal log queries on the Oregon site;
Fixed the issue where service nodes in the resource topology graph had no upstream/downstream, and metrics like request count and p99 were 0;
Fixed the issue where dashboard scheduled reports failed to display data normally;
Fixed the issue of abnormal trace jumps when clicking in the APM analysis dashboard;
Fixed the issue of abnormally high error counts (nearly ten thousand per minute) in specific service logs in the Deployment Plan.

November 20, 2025¶

Feature Updates¶

Query Tool¶

PromQL > Range Query Mode now supports setting the step size (step).

Scenarios¶

Text Chart supports introducing view variables and time variables, automatically parsing user-manually entered view variables #{fieldname} and time variables.
Funnel Chart: The number of nodes that can be added has been increased to 15.
In dashboards, explorers, and query tools, when chart sampling is enabled, a sampling rate icon will be displayed in the upper right corner.
- In the query tool, clicking this icon allows temporarily turning off sampling.

Management¶

In blacklist configuration, "Filter" now supports optional filling.
SSO Management:
- The "Edit" button must be clicked before enabling/disabling operations can be performed;
- The "Edit Identity Provider > Role Authorization" page supports selecting custom roles.

November 12, 2025¶

Feature Updates¶

Billing¶

The billing unit price for "APM/LLM Trace" has been adjusted as follows:

Monitoring¶

Added Programmable Detection monitors, enabling detection rule writing through scripts to cover detection needs for various system data types.

TOBY AI Agent¶

Added support for anomaly analysis. Based on input text, the TOBY AI Agent intelligently integrates complex and chaotic information to generate clear, concise root cause analysis results for you.

MCP Server¶

Added support for accessing MCP Server (Model Context Protocol). As an open protocol, it provides a unified multi-model callable interface service for the TrueWatch TOBY AI Agent, supports multi-client access, and accesses Guance's monitor, log, dashboard, and DQL query capabilities via API Key authentication.

Management¶

Role Management: Scenario configuration management/monitor permission split.
- Scenario Configuration Management: Permissions subdivided into
  - Dashboard, View View
  - Dashboard Management
  - View Management
  - Note, Explorer Management
- Monitor: Split into Monitor View and Management permissions.
Field Management: Added "Attribute Classification" configuration item, including: System Field, Business Field, Other.
Workspace Settings:
- Added "Data Reporting IP Whitelist" configuration. When enabled, only egress IPs within the whitelist can report data normally; data from other sources will be blocked.
- The original "IP Whitelist" configuration has been renamed to "Login IP Whitelist". Enabling the login (host) IP whitelist allows only sources within the whitelist to log in normally; requests from other sources will be denied access.

LLM Monitoring¶

Added support for collecting scores (model quality evaluation scores, descriptions, etc.) and displaying them.

Event Center¶

Change Event: After a new host is accessed, a new change event will be generated.

Scenarios¶

Time Series Chart > Analysis Mode added style switching and period-over-period comparison;
Charts added "Open in Metric Analysis" functionality. Seamlessly transition from any chart to the metric analysis interface, with the system automatically bringing in the set query conditions.

Explorer¶

Log Explorer: Display fields now also support filtering values;
All Explorers: Added field type icon display.

Log Index¶

Log Index: Added description and associated service configuration. When querying traces, the system will automatically associate matching service indices.
External Index: Added index description configuration;
Applying indices in the explorer supports switching between single/multi-select modes.

APM¶

Service Map: Added service maximum response time display.

RUM¶

Explorer > Fetch/XHR tab page: The original "Request" column renamed to "Resource URL", and supports displaying the full URL, with a button to toggle display on/off.

Cloud Account Management¶

Added search control, supporting fuzzy matching by keyword search.

New Integrations¶

Added Volcengine PostgreSQL integration;
Added Alibaba Cloud CPFS integration;
Added Alibaba Cloud ALB integration;
Optimized Alibaba Cloud NAT view;
Optimized Tencent Cloud Cloud Monitoring;
Optimized Alibaba Cloud Oceanbase dashboard;
Added Pipeline templates:
- AWS ELB
- Squid
- Kong
- CloudFront
- CloudTrail
Added cloud collector templates:
- Alibaba Cloud cfw/cen/apigateway/mqtt/nas/OceanBase/ga;
- AWS step function/ssm run command/waf2;
- Huawei Cloud apic/apig/auto_scaling/cbr/cdm/css_es/dcaas, etc.;
Added CSPM templates.

Bug Fixes¶

Fixed the issue where clicking on a log in the log stream graph to expand the details page could not display the context;
Fixed the issue where the index in the log slide-out page was not automatically matched;
Fixed the issue where too many view variables in a dashboard prevented selection;
Fixed the issue where the latest DK version could not be obtained via Helm in the AWS Oregon region;
Fixed the issue of DQL parsing failure when configuring detection metrics in APM metric detection;
Fixed the issue of workspace invitation member failure reports and language display issues on the APM interface;
Fixed the display abnormality when clicking the "Data Access" menu;
Fixed the issue where selecting a one-time "Immediate" report in scheduled reports on the Singapore site did not receive an email;
Fixed chart jump issues in the RUM performance analysis dashboard;
Fixed the page error when viewing basic machine information on the Oregon site;
Fixed the issue where log sources under selected indices could not display normally in log detection monitors;
Fixed the issue where clicking log sources in monitors was unresponsive;
Fixed the issue of excessive connection count when forwarding data to Kafka;
Fixed the "Internal Server Error" when querying recent day data in the APM analysis dashboard;
Fixed the issue of duplicate values displayed for extended fields in the console;
Fixed the display abnormality after selecting "All Sources" for the data source in blacklist configuration;
Fixed the abnormal display of trace information in log details;
Fixed the issue where charts in scheduled reports displayed "service unavailable";
Fixed the abnormal display in APM > Resource Call > Response Time Distribution;
Fixed the issue where bar charts using PromQL queries for a specific metric without aggregation or grouping could not set aliases;
Fixed the error when clicking host details on the Infrastructure page in the Deployment Plan;
Fixed the issue with erroneous single group deletion in dashboards;
Fixed the issue of abnormal return results after changing the top value in Top List chart settings;
Fixed the issue where Profile data opened blank and could not be downloaded;
Fixed the issue of user alerts caused by slow Redis hgetall query logs;
Fixed the issue where the label_values function became unavailable after upgrading the base version to 1.119.212, and view variable settings could not be saved;
Fixed the incorrect jump link opening in the security monitoring rule writing guide;
Fixed the error when querying external index logs;
Fixed the issue of excessive data point fluctuations in log query time series charts;
Fixed the issue where composite detection monitor configurations were empty after exporting from Workspace A and importing into Workspace B;
Fixed the abnormal display and drill-down of Heat maps.

October 22, 2025¶

Feature Updates¶

Open API¶

Supports modifying the duration of data retention policies;
Supports log field global configuration > Key Field Configuration;
Supports creating log indices via interface.

External API¶

DQL¶

Added function rate_over_sum(), which first sums the field within the aggregation window, then divides by the window length (seconds), used to calculate the average rate, with the result being a floating-point type.
Added function rate_over_count(), which counts the number of non-null values of a field within the aggregation window and divides by the window length (seconds), used to calculate event frequency, with the result being a floating-point type.
Added support for count(*) / 1i syntax.
Example: L::*:( count(*) / 1i ) [::1m]. Means dividing by the number of seconds in the time window size (1m) to calculate the QPS of log writes.

Billing¶

Data Forwarding > External Storage Forwarding Traffic Statistics: Based on the current workspace, aggregates compressed forwarding traffic by external storage type, counts daily increments, and distinguishes between public and private network traffic for billing invoicing. Click to view specific price details.
Usage Analysis: Supports manually switching to the billing time zone (UTC+8), solving the issue of user time zone inconsistency with the billing time zone.

Monitoring¶

Alert Strategies: Added support for Recovery Events Not Sending Notifications: Enabling this option means all recovery conditions only generate events and do not send external notifications.
Monitors:
Added Mass Alert Protection button: When the number of alerts generated by a single detection exceeds a preset threshold, the system automatically switches to a status summary strategy: instead of processing alert objects individually, it generates a small number of summary alerts based on event status and pushes them.
Log Detection > Detection Metrics: Supports configuring multiple indices.
Range Detection, Outlier Detection: Supports cross-workspace query for detection metrics.

Scenarios¶

Histogram:
- Added support for metric data source queries.
- Controls statistical dimensions based on the BY field in the query conditions, divided into "Global Statistics" and "Group Statistics":
- Without BY conditions, performs global total statistics, calculating the total distribution of all data.
- With BY conditions, groups by the BY field and then calculates the distribution of each group's data.
- Added X-axis and Y-axis configuration, allowing customization of data display boundaries by setting maximum and minimum values.
Time Series Chart: At the target time point on the time series chart, clicking allows selecting a Fixed Time Marker. Once marked, the marker setting will not change due to mouse movement, page scrolling, or switching time series charts.
Composite Chart: Added export button, supporting one-click export of all chart information.
Chart > Link: When creating a new chart in a dashboard (existing charts remain unchanged), if the BY field in the query conditions meets specific criteria, the system will automatically enable the display of the corresponding link list.
Report: Original real-time reports and archived reports unified into "Report". All reports will be archived and saved, simplifying management and viewing experience.
- Synchronously supports directly creating new reports on the dashboard page, automatically bringing in the current view and time range.
- The Report Records page allows viewing historical archived data and directly sharing or deleting them.

Infrastructure¶

Hosts: Added Real-time Performance toggle. When enabled, the system refreshes every 10 seconds and automatically fetches the latest three metric fields: CPU usage, memory usage, and CPU load.

Explorer¶

Global Configuration > Quick Filter Configuration: For RUM and Synthetic Tests explorers:
- The left side displays the source list, allowing modification of multiple options simultaneously in a pop-up.
- When opened from different explorers, the corresponding source will be automatically selected.
RUM > Long Task Explorer > Details Page: Added Script details, displaying restored code.
Time Widget: Added Playback button. After selecting a time range and executing a query operation, clicking the ▶️ button quickly returns to the most recent specified time range.

Snapshots¶

Supports re-editing already saved snapshots.

Management¶

Blacklist: Supports one-click enable/disable.
Pipelines: Optimized template export format and updated official template library samples.
Role Management: Supports one-click export of roles.
Data Forwarding: In addition to JSON text format storage types, added support for Parquet data storage type.

LLM Monitoring¶

Added access guide configuration steps.

New Integrations¶

Added AWS CloudTrail integration;
Added AWS CloudFront integration;
Added AWS Athena integration;
Added Alibaba Cloud NAS integration;
Added Alibaba Cloud MQTT integration;
Added Alibaba Cloud OceanBase integration;
Optimized Kong integration documentation, added Tracing integration method;
Optimized CSPM templates.

Bug Fixes¶

Fixed the issue where members could not view and timestamp variable settings were incorrect after log field advanced configuration linkage;
Fixed the issue where calling OpenAPI to invite members still sent invitation emails to already joined members;
Fixed the issue where data in dashboard views was not expanded normally;
Fixed the issue with incorrect format after exporting table charts to CSV;
Fixed defects in the Multi-step test creation flow;
Fixed the issue where the return upper limit for area, line, and bar chart query results in metric analysis did not match the documentation description;
Fixed the issue where Profile could not open normally;
Fixed the issue where field aliases were visible when adding quick filters in the explorer but disappeared after addition;
Fixed the issue of scheduled report sending failures;
Fixed the issue where no dial test task data appeared on the platform after creating a new dial test task, and self-observation queries found related error logs in kodo;
Fixed the error when querying JSON format data with DQL;
Fixed the issue of no data in RUM detection Action and View details;
Fixed the issue where actual role permissions existed in API Keys management but were not displayed on the right side;
Fixed the issue where scheduled reports in production workspaces could not be sent, but test workspaces could;
Fixed the issue where custom roles could not be deleted;
Fixed issues with the log explorer: including abnormal bar chart and data count display, and inconsistency between the number of items found in search and the number of items queried below;
Fixed the issue of no data when clicking to view after sharing a snapshot;
Fixed the APM data empty result issue;
Fixed the issue of data backlog when forwarding to Kafka, with the backuplog service consuming memory until OOM;
Fixed the issue where the China map in the dashboard did not display provinces with data;
Fixed the issue where text charts in panels moved to the top after refreshing when their position was moved;
Fixed the slow loading of 5-minute log queries;
Fixed the issue of incorrect filter condition escaping when jumping to associated views from the event details page;
Fixed the issue where time window parameters affected calculation results when using DQL to query data;
Fixed the issue where data stored by guancedb-storage was 1 year old, not meeting expectations;
Fixed the issue where filtering user-customized fields in Actions did not take effect;
Fixed the issue where Webhook object address modifications did not take effect normally in alert events;
Fixed log query issues: including lag when loading more details from the list dropdown and query errors, and significant differences between status distribution chart display results and actual data;
Fixed the issue where cross-workspace trace queries only displayed current workspace data.

October 15, 2025¶

Feature Updates¶

Chart Query¶

Expression Query:

Added an independent "Expression Query" input box for directly writing expression formulas;
All queries are automatically assigned a query identifier (e.g., a, b, c) beforehand;
Compatibility Notes
- Historical subquery identifiers (e.g., A, B) existing in charts cannot be reused by new expressions;
- Original expressions can still be queried normally, not affecting existing chart functionality;
- It is recommended to reconfigure expressions using new query identifiers when editing charts.

Data Forwarding¶

Added support for forwarding data to Volcengine TOS, providing five storage type options: Standard Storage, Infrequent Access Storage, Archive Flashback Storage, Archive Storage, Cold Archive Storage, to adapt to storage needs in different business scenarios.
When the storage type of forwarded data is "Archive", supports restoration tasks to thaw data for access and analysis.

September 24, 2025¶

Feature Updates¶

Open API¶

Added specified API Key creation permissions for newly created workspaces;
Added support for binding a specified billing center;
Added support for cross-workspace authorization.

Security Monitoring¶

Added CSPM detection type, supporting custom selection of detection types based on actual business scenarios (such as cloud resource protection, compliance audits, etc.), enriching detection coverage scenarios. Detection type descriptions are as follows:
CSPM (Cloud Security Posture Management): Identifies misconfigurations (e.g., open high-risk ports, excessive permission assignments) and compliance risks in cloud infrastructure, continuously assesses cloud resource security, and reduces the risk of vulnerability exploitation.
SIEM (Security Information and Event Management): Collects and analyzes security data from across the infrastructure, detecting threats and anomalous activities (e.g., abnormal login + bulk data export) through event correlation and log analysis.
Official Detection Library Experience Upgrade: Detection rules added "Belongs to Detection Library" identifier, facilitating quick identification of rule sources; simultaneously supports switching views in the template library, allowing browsing of all detection rules including monitors at once, improving rule search efficiency.
Security Detection Rule Editing Experience Optimization: Added "Trigger Detection Immediately" function, eliminating the need to wait for scheduled detection cycles, enabling real-time triggering of detection tasks. This allows users to quickly verify script effectiveness and immediately view generated security signals after writing/adjusting detection scripts.

Management¶

Added Preferences, allowing unified configuration of workspace language, theme mode, details page opening method, etc.;
Member Management: Added support for exporting members;
Invite Member: Added configuration for member's team and remarks information.

Monitoring¶

Monitors: Supports "Trigger Detection Immediately" when editing monitor rules;
Anomaly Detection, Range Detection V2 support cross-workspace queries
Mute Rules support cloning.

APM¶

Service List page added "Add Service" button.

Synthetic Tests¶

When creating new dial test tasks, supports configuring task execution frequency by inputting custom crontab.

Incident¶

During the first automatic discovery or manual creation of an Issue, the system supports AI intelligent analysis, automatically summarizing the current Issue content.

Metrics¶

Generate Metrics: Supports infrastructure and resource catalog data sources.

View Variables¶

Removed the original all values option, unified using * to achieve multi-scenario filtering needs. Supports selective use based on different business scenarios, with specific effects as follows:

Ignore this field filter: When * is selected, ignore this field filter; chart queries will not include filtering conditions for this variable.
Full value filter (equivalent to original all values): When * is selected, all variable values will be used as filter conditions (up to 100 values supported). Note: Excessive data may affect performance; it is recommended to use selectively based on actual needs, avoiding indiscriminate full filtering.

Explorer¶

Log Explorer: Index style adjusted, simultaneously supporting one-click selection of all indices, pinning indices, searching and locating by index name, etc.;
All Explorers: Supports Advanced Linkage Configuration.
Added query acceleration configuration, allowing configuration of indices for commonly used filter fields in the explorer's "Global Configuration" to improve query speed for those fields.

Added support for Quick Zoom function: One-click expands the current query time range to 3 times the original, reducing manual time range adjustment steps and improving data exploration efficiency.

External Data Source¶

Added support for SQL Server data source.

New Integrations¶

Added AWS AOSS integration;
Added AWS PCS integration;
Added Alibaba Cloud CEN integration;
Added Continuous Profiler JVM dashboard template (analyzing Profile data);
Added AWS WAF integration;
Added FastDFS integration;
Added Alibaba Cloud API Gateway integration;
Added Alibaba Cloud Cloud Firewall integration;
Translated AWS AOSS/AWS PCS views.

Bug Fixes¶

Fixed the issue of adding tags to df_label in event content via central Pipeline;
Fixed the issue of unsuccessful workspace authorization deletion;
Fixed resource catalog database resource display issues;
Fixed the issue where host data on the Infrastructure > Hosts page decreased after clicking the sort button;
Fixed the issue of incorrect billing center username value when registering a new account;
Fixed the system internal error when binding external indices (TLS/ES);
Fixed the error when creating a workspace;
Fixed the error "Failed to create Func query task" when drilling down into Redis metric data;
Fixed the issue where data could sometimes be queried in the Dashboard, but sometimes reported an Internal Server Error;
Fixed the "Specified view not found" issue after jumping from container_crash related to events in K8s within Infrastructure;
Fixed the issue where the same interface displayed for different versions during prometheus exporter metric collection in Integrations;
Fixed the issue where some fields were not displayed in the log stream graph unit settings;
Fixed the discrepancy between Open API call results and documentation;
Fixed the issue where the system view "APM P90 Resource Analysis View" did not contain charts;
Fixed the issue where alert strategies failed to successfully send emails to customers;
Fixed the issue where the key:value format of JSON output in event templates did not follow the format viewed in the explorer;
Fixed the issue of false alerts generated by host data reporting monitors;
Fixed the 502 error when uploading SourceMap;
Fixed the omission in the Webhook alert process;
Fixed the issue of abnormal fields appearing when using DQL to query logs during panel drawing;
Fixed the "unknown Scalar function" error in dashboard queries;
Fixed the mismatch issue after switching DQL to simple query in dashboards;
Fixed the issue where the Pie Chart Data Display module in Studio dashboard did not work properly;
Fixed the 400 error on the Time Series page in the metric management interface on the Hangzhou site;
Fixed the erroneous text in Integrations > Cloud Account Management;
Fixed the issue with incorrect RUM ERROR pattern analysis;
Fixed the issue where RUM could not query Session and View data;
Fixed Warroom issues;
Fixed the issue where no results appeared in the list when filtering span types to entry for specified resources that had both entry and exit span types;
Fixed the issue of incomplete service list display.

September 3, 2025¶

Feature Updates¶

Security Check¶

The Security Check function has been officially discontinued. Its related functionalities can be achieved through the Security Monitoring > Security Information and Event Management (SIEM) module.

LLM Monitoring¶

TrueWatch launched LLM Monitoring, providing "monitoring + tracing" capabilities for large model applications, ending the "black box" of model operation. It completely records input/output, tool calls, retries, latency, cost, and tokens for each call, with visual Trace and Session aggregated by conversation for easy replay and troubleshooting, achieving full-link transparent management. It now prioritizes support for Langfuse integration. If you are already a Langfuse user, you can quickly enable LLM monitoring capabilities.

Free Plan¶

For independent developers and small teams, TrueWatch added a Free Zone (Beijing) node. Under this node, you can register for the Free Plan (other sites no longer support creating Free Plan workspaces), covering key core functionalities.

Open API¶

Incident > Schedule: Supports adding parameters to get calendars and filter schedules.

Explorer¶

Log Explorer:
Added Advanced Linkage Configuration: Supports configuring jump links for individual fields, allowing direct opening of target pages from the current field, completing parameter transfer through variables for linkage analysis.
Log Explorer Display Items optimization:
- Added "Delete All Fields", "Reset Fields" buttons;
- Added "Time Column" display toggle.
All Explorers
Supports DQL Query mode.
Supports searching for event content under all IP addresses in a single IP field via the CIDR function.

Event Center¶

Events generated by SIEM rules (security) support TOBY AI intelligent analysis on the details page.
No restriction on dimension tags, default supports jumping to log/trace explorer.

Monitoring¶

Alert Strategies Management: Under Rule Aggregation Mode, supports selecting only "Send First Alert", thereby avoiding missing important abnormal events while waiting for aggregation.
Monitor > Event Content supports defining domain variables:
df_studio_env_name: Current environment name
df_studio_console_base_url: Current environment console address
df_studio_monitor_base_link: Current environment monitor address

Management¶

Workspace administrators support disabling AI Intelligent Analysis at the workspace level.

Metrics > Metric Analysis¶

Table Chart mode added Prom mode, displaying PromQL query return results.
In independent chart mode, chart titles are added based on query conditions.

Infrastructure¶

Host and container explorers support directly creating mute rules.

Synthetic Tests¶

Dial Test Tasks: Request body content added support for multipart/form-data.

Sensitive Data Scanning¶

Supports covering all data types, no longer limited to scanning only log data.

Mobile RUM¶

Analysis dashboard added "Crash Analysis", "Stuck Analysis" tab pages.

New Integrations¶

Added Squid integration;
Added Openresty integration;
Added Kafka 4.0 integration;
Added AWS MWAA integration;
Added AWS Step Function State Machine integration;
Added Alibaba Cloud GA integration;
Updated Nginx tracing integration;
Updated AWS OpenSearch monitor/view.

Bug Fixes¶

Fixed the issue where aliases in dashboard grouped table charts did not take effect;
Fixed the issue of incorrect summary chart display results;
Fixed the appearance of Chinese characters when importing Dashboards (multiple dashboards - zip file);
Fixed the issue where funnel chart jumps to session list, but Session Replay displayed errors;
Fixed the issue where alerts were still sent even though mute was set;
Fixed the issue where host tags were not displayed in Infrastructure;
Fixed the issue where data existed in the Android client explorer but corresponding analysis dashboard charts did not display data for the time period;
Fixed the issue of no connections between services in the service topology map;
Fixed the issue of incorrect alert mute configuration causing all alerts to fail;
Fixed the issue where chart DQL statements returned no results;
Fixed the error reported by dial test tasks on the Guangzhou site;
Fixed the issue where imported template results in the Deployment Plan management console did not meet expectations.

August 13, 2025¶

Feature Updates¶

Open API¶

Supports custom roles for Tokens.

RUM¶

To cover query scenarios for application data of different volumes, the system optimized RUM data writing. Accordingly, the following updates were made synchronously:

RUM data query drills down to the application level:
Explorer/Analysis Dashboard: Added application filter at the top of the page, default selected as "All Applications", supports custom single or multiple selection; queries are triggered only after selecting applications.
DQL query statements support single or multiple application queries; more usage instructions can be found at RUM Data.

R(app name1)::view:(count_distinct(username))   # Specify querying UV for a specific application name
R(app id1)::view:(count_distinct(username))     # Specify querying UV for a specific application ID
R(*)::view:(count_distinct(username))   # Specify querying UV for all applications within the workspace

Existing users experiencing application data query performance bottlenecks can contact their account manager to enable the "User Access Data Table Splitting" function in the management console. For new users after workspace creation, the system will automatically split data writes based on different applications.

Scenarios¶

Scheduled Reports: Added "Archived Reports": Supports performing full data calculations on dashboards according to set cycles (daily/weekly) and generating static snapshots. Archived results are retained long-term, unaffected by dashboard configuration changes, and can be viewed within the platform or notifications sent as configured.
Dashboard > Log Analysis: Added support for automatically bringing in the dashboard's view variables as filter conditions for display.
Log Stream Graph: Supports querying all data sources within the platform.

Explorer¶

The search bar supports querystring(md5(xxx)) tokenized query method. If data is MD5 encrypted and needs to be searched and located in the explorer after scanning, this method can be used for querying.

DataFlux Func¶

To enhance security protection for DataFlux Func (Automata), the following updates were made:

The "Reset Password" operation was removed from the Automata page in the console, and initial account passwords are no longer sent to email;
For newly created Automata instances, using the Func page for login is disabled by default, only supporting authorized login via console user authorization.
Already installed Automata Func: After upgrading to version 7.2.0 or above, two login methods are supported:
Authorized Studio users can log in directly via the console > DataFlux Func (Automata) interface;
Previously created users in Func (including the initialized admin user) can also log in via the Func page.

APM¶

Trace > Waterfall Details Page/Code Hotspot tab page: Resources support one-click expand or collapse;
Topology Map: Added support for displaying "P95 Response Time".

Synthetic Tests¶

Dial Test Tasks > Request Body: Supports configuring four types of dynamic variables:

{{ timestamp "ns" }} //1754379375400790109
{{ date "rfc3339" }} // 2006-01-02T15:04:05Z07:00
{{ date "iso8601" }} // 2006-01-02T15:04:05Z
{{ urlencode "hello world" }} // hello+world

Added support for one-click cloning of dial test tasks.

Monitoring¶

Threshold Detection > Detection Metrics: Supports selecting metric data across workspaces. Subsequently, after the monitor rule is successfully created, cross-workspace alert configuration can be achieved.
Monitor List: After quick filtering monitors, supports selecting across pages and one-click export.

Events¶

For recovery events, added definition of df_fault_end_time extension field as fault recovery time.

DCA¶

List supports selecting all data;
Supports configuring filter conditions based on DataKit version (datakit_ver), operating system (os), environment (env), etc.;
List added environment display.

Management¶

Role Permissions: Added "Client Token View" permission.
Cross-Workspace Authorization: When editing or deleting authorization rules, if data scope or log indices are reduced, a confirmation pop-up appears showing the names of affected monitors and data access configurations, while supporting exporting this list as a CSV file.
System Notifications: Added subscription type – "Monitor": Once a monitor becomes invalid, the system will send email notifications.

New Integrations¶

Added AWS SSM RunCommand integration;
Added AWS EBS integration;
Added AWS ECR integration;
Added AWS EFS integration;
Added TDengine monitor;
Added Milvus K8s view;
Updated Azure cloud billing: EA architecture support;
Rewrote OTEL jvm dashboard: 1._ and 2._ metrics differ (java agent);
Huawei Cloud billing script update: Fixed billing anomalies caused by missing instance IDs;
SIEM templates launched (10 AWS templates);
Optimized AWS MemoryDB;
Optimized Tomcat monitor;
Optimized Tencent Cloud MySQL, supporting cloud disk edition (cloud disk) node dimension metrics, slow log collection;
Optimized Alibaba Cloud Oceanbase collector, supporting supplementary tenant data.

Bug Fixes¶

Fixed the issue of slow log queries recently;
Fixed the issue of inconsistent data performance for resource objects;
Fixed the issue where associated logs for traces displayed as 0;
Fixed the error when clicking code hotspots after successful deployment;
Fixed the abnormal data display after scrolling to the bottom of the dashboard log stream graph;
Fixed the import error when importing dashboard JSON due to setting identifier;
Fixed the incorrect jump location in the resource catalog official template library;
Fixed the issue where sensitive data scanning configuration did not take effect;
Fixed the issue where count_distinct query results were more than count query results;
Fixed the issue where trace details page did not display data;
Fixed the issue where PromQL statements reported errors, but changing the query time interval did not cause errors;
Fixed the issue where the trace service name was not displayed normally;
Fixed the issue where Picture charts could not be modified;
Fixed the issue where cloud billing could not be written in production environments;
Fixed the abnormal display of service topology charts in dashboards;
Fixed the issue of site registration and activation failure;
Fixed the abnormal display of RUM funnel functionality;
Fixed the issue where after importing dashboards, there was a probability of missing dashboard lists, requiring re-entering the page to display completely;
Fixed the misleading guidance on the interface access guide;
Fixed the 406 - kodo API exception on interface operations;
Fixed the issue where SourceMap file path, environment, and version were all correct, but source code could not be parsed;
Fixed the abnormal data display in log indices;
Fixed the issue of adding APM guide pages on the interface;
Fixed the issue where chart titles displayed variables after sharing charts;
Fixed the issue where service context did not follow updates when clicking different services in the trace flame graph;
Fixed the abnormal search data for fuzzy queries of dashboard view variables;
Fixed the issue of Pipeline script save failure;
Fixed the issue where templates did not take effect after adding SIEM templates, but tags took effect;
Fixed the topic 404 issue in nsqd logs of the Deployment Plan;
Fixed the issue where popular page performance overview could not display load time normally;
Fixed the issue where .net profile data on the trace details page had no view details button;
Fixed the intermittent issue of no data display for the same DQL expression query;
Fixed the unstable display of infrastructure dependencies in APM;
Fixed the issue where DQL subqueries did not take effect;
Fixed the platform page error after muting events in the Event Center.

July 23, 2025¶

Feature Updates¶

Monitoring¶

SLO
SLO deduction is executed at "second" level frequency;
SLI events added display of event information generated under the corresponding monitor
Details Page added overview page, with related key metric charts dynamically linked to the time widget in the upper right corner.
Added "SLO Correction" configuration. When SLO is about to be violated due to uncontrollable factors (e.g., infrastructure failure, third-party service interruption), temporary correction mechanisms avoid false alarms while ensuring SLO data audit compliance.
Alert Strategies
Supports cloning alert strategies;
When configuring notification rules based on members, added support for one-click copying member notification configurations.

Event Center¶

The default refresh time for the time widget on the default explorer page is set to refresh every 30 seconds by default;
Alert notifications on the details page no longer display sending status.

Billing¶

Usage Statistics: Added "Backup Log Count Increment" display, used to count the daily increment of backup logs;
Usage Analysis: Default entry query time adjusted to "Today".

Basic Components¶

For the Shortcut > Snapshot display page:
Supports filtering based on type;
Supports batch delete operations.
Explorer
Search Bar:
- Recent query display count adjusted to 10, saved count adjusted to 50;
- Supports pinning query conditions;
Quick Filter > Workspace Filter Items: After configuring fields, the system automatically adds indices. Simultaneously, in the explorer search bar and chart query dropdown components, an icon identifier is added for these fields.
Details Page: Extension fields added icon identifiers for fields already added to the display column for differentiation.

Infrastructure¶

Database: Added SQL Server data collection type. Details page allows viewing all Table related information, including columns, indices, foreign keys.
Resource Catalog: Custom object explorer details page added "Complete Information" tab page.

Metrics¶

Metric Management: Added "Unique Value Count" display for tags, counting the distinct count of tag values globally or under a single metric dimension.

Pipelines¶

One-click Get Sample: Supports specifying data sources to obtain test data.

Scenarios > Top List¶

External data source queries support sorting.

Management¶

Data Forwarding: Supports OR logic for multiple filter conditions;
Token: When replacing a Token, added configuration to adjust permission scope, supporting use only for reporting.
Sensitive Data Scanning: Custom rules support lookaround regex test matching.
Support Center > Ticket: Added character limit for ticket descriptions.

New Integrations¶

Added Huawei Cloud APIG integration;
Added Huawei Cloud SFS Turbo integration;
Optimized Alibaba Cloud ECS integration view;
Updated AWS SQS integration;
Tencent Cloud cloud product collection optimization, supporting multi-dimensional metric collection (Cloud Monitoring V2);
EIP
COS
MySQL
PostgreSQL
MariaDB
TDSQL-C MySQL
TDSQL-C PostgreSQL
Redis
KeeWiDB
MongoDB
Memcached
Huawei Cloud integration related documentation content format adjusted.
Fixed the appearance of Chinese characters in the console's Scene > Dashboards section;
Fixed the display of Chinese names for some countries in the console's Scene > Dashboards > Create > World Map;
Fixed the issue where if an Issue created by Issue auto-discovery was manually changed to closed or resolved, generating a new Issue would restart the old Issue instead of creating a new one;
Fixed the abnormal display of the log explorer status distribution chart;
Fixed the issue where Session Replay displayed as expired;
Fixed the issue of no data after changing the display items to list mode in the Event Center;
Fixed the abnormal frontend display of event data;
Fixed the abnormal display of RUM explorer Resource data;
Fixed the error when querying forwarded data;
Fixed the abnormal /api/v1/inner/alert_opt/get, /api/v1/account/list interfaces in the Deployment Plan;
Fixed the issue where the Pod monitoring view template associated with traces was not updated;
Fixed the abnormal display when inputting data scope filters in Data Access;
Fixed the issue with the time range returned when slicing PromQL by 1d in time series chart > bar chart;
Fixed the issue where PromQL query statements had data within hourly intervals but no data within daily intervals;
Fixed the issue where the webpack plugin showed SourceMap file upload success, but files could not be viewed in the SourceMap list;
Fixed the issue where Issue auto-discovery in Incident generated duplicate Issues;
Fixed the issue where the Prometheus function idelta did not meet expectations;
Fixed the significant gap between log explorer query results and DQL query results under the same query conditions;
Fixed the issue where monitors set df_label but events generated had no value for df_label, causing user mute strategies not to take effect;
Fixed the issue where the IP field in RUM Pipelines did not take effect;
Fixed the error after upgrading kodo-x in private environments;
Fixed the issue where trace details displayed "Top Span Missing", but the top span actually existed;
Fixed the issue where application data could not be queried in RUM > Application List;
Fixed the issue where the billing details could not be seen in the workspace's Billing;
Fixed the issue where pressing Enter while entering a snapshot name in Save Snapshot would directly save it;
Fixed the issue of being charged for log monthly billing usage of 0;
Fixed the display judgment issue for src_ip and dst_ip;
Fixed the intermittent erroneous display of the log explorer bar chart for the same time interval;
Fixed the usage issue of the search function in Incident;
Fixed the issue where the follow direction configuration in Synthetic Tests tasks was checked but did not take effect and was cleared when editing again;
Fixed the inconsistency between log index query count over multiple days and TLS.

July 9, 2025¶

Feature Updates¶

Billing¶

Introduced a new billing model: Enterprise Plan. This model adopts combined billing of data traffic + total storage volume, more accurately aligning with actual resource consumption in scenarios with extremely high log write volumes, making users' cost structure more transparent and predictable. This mode provides optimized cost-effectiveness for handling massive observability data and is one of the foundational capabilities for building a "globally controllable enterprise-level observability hub."
Within Enterprise Plan workspaces, data retention policies support custom configuration;
To upgrade from the Free Plan to the Enterprise Plan, please contact your account manager.
Commercial Plan:
Billing item names in Usage Statistics and Usage Analysis adjusted;
Commercial Plan Time Series 180-day, 360-day price adjusted.

Monitoring¶

Monitor > Threshold Detection: Detection metrics support querying external data sources;
Monitor List: Supports searching and locating based on monitor ID.

Event Center¶

Added Display Items: Supports switching between standard and list mode display.
Change Event > Details Page: Basic Attributes adjusted as follows:
Change Content: Displays df_message content, recording detailed descriptions of resource changes;
Diff Comparison: Displays diff content, recording difference text of resource changes.

Scenarios > Charts¶

SLO Chart: Locked time added "This Year" dynamic time option;
Heat Map:
Added "Metrics" data source type query;
Added Y-axis configuration, supporting Y-axis calculation based on data.

Infrastructure¶

Network > Summary
Supports custom analysis dimensions: By selecting source and target query fields, displays aggregated query data;
Supports cross-workspace network data queries.
Database:
Added Oracle database integration;
For PostgreSQL databases, allows viewing all Table related information, including columns, indices, foreign keys.

Metrics¶

Generate Metrics: Supports different generation rules specifying the same metric name and tags;
Metric Management: Added multi-dimensional time series analysis at the measurement level.

Deployment Plan Updates¶

Workspace List > Index Configuration: Supports configuring data retention policies.

New Integrations¶

Added OpenLLMetry integration;
Added Undertow integration;
Added Cloudflare integration;
Added Huawei Cloud CDM integration;
Added Huawei Cloud DWS integration;
Added Huawei Cloud NAT integration;
Added AWS Transit Gateway integration;
Updated Volcengine ECS monitor, view;
Updated MinIO view, monitor;
Optimized integration Huawei Cloud ASM / CCE;
Optimized integration Alibaba Cloud SAE;
Optimized integration JMX / MQTT.

Bug Fixes¶

Fixed the 404 error when accessing Session Replay data via login-free Token in SaaS environments.
Fixed the issue where Issue auto-discovery configuration content in RUM detection was not recognized.
Fixed the issue where events generated by monitoring dial test alerts did not display specific association information in event details.
Fixed the issue where modifying tag names after adding tags in global tags prompted duplicate tag names already existing.
Fixed the issue of abnormal DQL query return results.
Fixed the issue where PromQL queries for metrics failed, but DQL queries worked normally.
Fixed the chaotic Deployment > Pod information display in multi-cluster scenarios.
Fixed the abnormal display of log status distribution charts.
Fixed the inconsistency between RUM filter time range and time selector, preventing application data viewing.
Fixed the issue where Issue auto-discovery template variables did not take effect in the RUM Error explorer.
Fixed the "Invalid address" error when adding Webhook notification targets.
Fixed the backlog issue in base forwarded data.
Fixed the abnormal display of log status distribution charts.
Fixed the issue of frequent false alerts caused by DQL query data being 0.
Fixed the issues in the base query tool when querying logs: inability to sort, slimit invalid, and inability to paginate.
Fixed the issue in time series queries where time series appeared that were not constrained by filter conditions and had no tags.

June 25, 2025¶

Breaking Changes¶

Extracted df_check_targets, df_check_condition, df_check_rules from the Event df_meta field to the same level. Subsequently, in webhook notifications, when df_source = monitor, information such as detection time, detection metrics, detection count, and detection rules from the monitor configuration will be displayed.

Feature Updates¶

External API¶

Added interface index_list_info to query workspace index information list;
Added interface update_index_setting to modify workspace index configuration.

External Data Source¶

Added integration of PG, Oracle, Clickhouse three external data source types to meet broader data scenario needs.

Logs¶

Added Native Direct Write Index type, allowing direct specification of the write index during data collection for precise classification and storage.

Monitoring¶

Range Detection V2 supports detecting APM, RUM data types;
Anomaly Detection > Event Content: Added df_check_detail extension field, supporting outputting the anomaly comparison original value to event details.

Events¶

Alert events triggered based on monitor configuration rules support TOBY AI Intelligent Analysis.

Infrastructure > Database¶

Added PostgreSQL database integration;
For MySQL databases, allows viewing all Table related information, including columns, indices, foreign keys.

Explorer¶

Search bar added Query History record display, click to directly reuse and flexibly modify.

Cloud Account Management¶

Added support for Tencent Cloud, Azure account types.

Scenarios¶

Adjusted Import Dashboard entry, integrating the original custom template import function, while supporting batch import of dashboards.
Dashboard page added "Log Analysis" function, allowing one-click viewing and analysis of related log data directly in a side-slide new page without jumping.

Incident¶

The "Incident" menu on the console left side added "Incident Management" entry, allowing direct jump to the management page.

New Integrations¶

Added Volcengine NAT integration;
Added Ceph integration;
Updated Clickhouse integration;
Huawei Cloud billing script optimization;
Added Tencent Cloud billing;
Added Tencent Cloud WAF integration;
Added Tencent Cloud ES integration;
Added Tencent Cloud cos/cdb/mariadb/postgresql English version views, monitors;
Added AWS Firehose;
Added AWS VPC NAT Gateway integration documentation;
AWS billing script update: T+1 calculation method caused billing errors for some components (e.g., EC2), adjusted to T-2;
Added Azure billing.

Bug Fixes¶

Fixed the abnormal data display after generating metrics;
Fixed the issue where log content could not load after clicking "Load More" on the log details page;
Fixed the issue of invalid RUM activation links and missing pricing content;
Fixed the issue where clicking associated events in Issues to jump could not query data;
Fixed the 406 error when creating Infrastructure Liveness Detection v2 type monitors;
Fixed the slow loading of Session Replay pages;
Fixed the issue where Open API creating mute rules did not automatically generate rule names;
Fixed the error when inputting PromQL to query metrics;
Fixed the abnormal display of page error rates;
Fixed the frequent disappearance of host tags;
Fixed the ineffectiveness of descending order after adding search conditions to resource invocation Top List;
Fixed the issue where after unchecking 7-day MFA-free login, if MFA was unbound and logged out and logged back in, the system did not prompt for re-binding;
Fixed the issue where empty aliases in exported CSV files from dashboards caused incorrect rendering;
Fixed the issue where monitors did not generate alerts normally, and self-observation logs had query timeout errors;
Fixed the issue where imported fields in the management console were automatically deleted;
Fixed the issue of user experience data loss.

June 11, 2025¶

Feature Updates¶

Billing¶

Added statistical items: Trace Write Traffic, RUM Write Traffic, SIEM Scan Volume; Usage Analysis synchronously displays data for the newly added statistical items.

Scenarios¶

Dashboard > AI Intelligent Analysis: Added support for automatic error discovery and error analysis, further enhancing TOBY AI data processing capabilities.

Monitors¶

Detection frequency supports shortest custom input of 20s, system newly supports selecting 30s;
APM Metric Detection, RUM Metric Detection respectively support multiple selection of service, application;

SIEM¶

Official Detection Library launched: The system provides out-of-the-box security information detection template libraries.

Infrastructure > Database¶

Supports cross-workspace data viewing;
Added fields: QPS, TPS, Average Query Duration, Slow Query Log Status, Slow Query Count.

Metrics > Metric Analysis¶

Added Independent Chart mode, suitable for scenarios where multiple queries are added simultaneously and query result units are inconsistent;
Added support for displaying total group statistics, while default slimit changed to 50.

Logs > Explorer¶

Stacked Mode added line break toggle;
Context logs support clicking the time column for ascending/descending sorting.

Cloud Account Management¶

Cloud Account type added support for Huawei Cloud.

Management > Environment Variables¶

RUM Android/iOS SDK supports dynamic updates via Environment Variables.

Query Tool¶

Table charts and simple queries in metric analysis both support selecting multiple columns;
DQL quick query defaults to simple mode, supporting multi-column configuration queries.

APM¶

ddtrace added package level instrumentation configuration. If instrumentation is needed for all methods under packages com.zy and javax.servlet, it can be configured as follows: -Ddd.trace.method.packages=com.zy,javax.servlet.

Deployment Plan Updates¶

Mapping Rules added "Append Mapping" toggle. When enabled, accounts using single sign-on will be assigned workspaces and roles according to mapping rules, while original workspaces and roles remain unchanged.
For workspaces using the ScopeDB engine, supports configuring tenant-level queries.

New Integrations¶

Optimized Tencent Cloud billing script, supporting obtaining billing information via sub-account method;
Added Tencent Cloud billing integration;
Added Tencent Cloud EIP integration documentation;
Added Tencent Cloud CDB monitor (English);
Added Huawei Cloud billing integration;
AWS ELB integration content updated;
AWS LAMBDA integration content updated;
AWS S3 integration content updated;
Added AWS Aurora MySQL integration;
Added AWS Aurora PostgreSQL integration;
Added Hikaricp integration;
TiDB Cloud view optimization;
Added vpc integration;
Added AWS rds postgresql integration.

Bug Fixes¶

Fixed the issue where userid was not displayed in the resource explorer for Singapore site user workspaces;
Fixed the issue where custom reported userid could not be queried via the action explorer;
Fixed the issue of inaccurate AI analysis results in dashboards;
Fixed the issue with Open API obtaining time series trend charts;
Fixed the delayed display of data gap content on the monitor modification page;
Fixed the issue of skipping existing files when uploading SourceMap using webpack plugin;
Fixed the error in quick filters under network functionality;
Fixed the issue where filters via variables did not run normally;
Fixed high-risk vulnerabilities from penetration testing;
Fixed dashboard errors in the resource analysis section of the user access analysis dashboard on the Singapore site;
Fixed the issue of undefined variable values in panel link jumps;
Fixed the issue of no time selector box in the upper right corner of the log explorer;
Fixed the discrepancy between preview chart display data and actual data in monitors (APM);
Fixed the display issue regarding DingTalk and WeChat in emails during cross-workspace authorization;
Fixed the inconsistency between SSO user list and user details in the management console;
Fixed the display issue of external database data source queries;
Fixed the display issue of trend charts when creating new threshold monitors;
Fixed the search failure when viewing services in APM;
Fixed DQL query errors;
Fixed the issue where daily repeating mute rules did not send mute生效 notifications daily as expected;
Fixed the issue where the AI analysis button was not visible after entering traces from RUM Session Replay.

May 28, 2025¶

Open API Updates¶

Incident supports returning associated event count information when listing and retrieving.

Feature Updates¶

SIEM¶

Detection Rules: Added test, full-screen script editing functions;
Added Signals explorer;
Added Execution Logs explorer.

Monitoring¶

Alert Strategies > Association: Added selection of SIEM detection rules, synchronously supporting direct creation.
Edit Monitor Rules > Detection Metrics added support for PromQL query preview.
Monitor Rules list:
When importing, added support for "Delete and import monitors with the same name" on the operation page;
Supports one-click export of all monitor rule configurations for the current workspace.
Intelligent Inspection function entry discontinued.

Infrastructure¶

Containers: Added Persistent Volume Claims Explorer.
Added Database Explorer, providing a centralized explorer tool for real-time monitoring of MySQL database performance metrics, resource usage, and log records.
Resource Catalog: Resource Class added database, displaying total count of all databases.

Incident¶

Channel > Issue Details Page: Added "Associated Events", allowing direct click to jump to the event list for viewing; Issue emails and other sent notification events synchronously added associated event display;
Notification Strategies > Issue Escalation: Added event storm option. Can set that when the cumulative count of events associated with an Issue exceeds a specific number, the system sends "repeat" or "once" notification reminders.

Events¶

Unrecovered Events:

Added "Mute" button. Clicking allows direct "Mute" configuration of the rule on the current page.
Added "Recover All with One Click" button. Clicking recovers all abnormal events in the current list, with the option to associate with Issues.

APM¶

Flame Graph: Added "Locate to Current Span" function button.

RUM¶

WEB SDK added client timezone recording.
Session Replay viewing page added client timezone display.
All time widgets uniformly added timezone display.

Scenarios¶

Dashboard > TOBY AI Intelligent Analysis:
Optimized page display effect;
Optimized problem output.
Charts
Time Series Chart: Added hint: Query has exceeded the maximum number of time series chart data points, only displaying 1,000 data points;
Bar chart mouse hover color adjusted;
Table chart order adjustment optimization: Compatible with PromQL queries.

Metrics¶

Metric Analysis: Added query history and unit configuration.

Management¶

Sensitive Data Masking: Supports one rule configuring masking for multiple fields.
Data Access: Edit page added access site selection.

Explorer > Quick Filter¶

All Explorers:
In edit mode, supports modifying "Filter Fields", "Optional Fields";
Added hide field alias function;
When searching for fields, if query results have no exact matching value, can directly create and add to "Filter Fields".
Log Explorer:
Two viewing modes display adjusted, added "Global Configuration" in "Stacked Mode";
Display Items Configuration adjusted.

Registration¶

Login registration page display optimized.

Deployment Plan Updates¶

Configuration Management > Issue Discovery: Rule detection frequency added support for 1 minute.

New Integrations¶

Added TiDB Cloud integration documentation;
Added Traefik integration documentation;
Added AWS cognito integration;
Added AWS certificatemanager integration;
Added AWS RDS PostgreSQL integration documentation;
Added aliyun rabbitmq integration;
Updated haproxy view and monitor;
Added Huawei Cloud DIS English monitor, view;
Updated AWS ELB application integration documentation, view, added AWS ELB application monitor;
Updated AWS lambda integration documentation, added Lambda fetching S3 log data operation steps.

Bug Fixes¶

Fixed the issue where generated metric data was not reported normally.
Fixed the issue of tag import failure when calling the Open API import monitor interface.
Fixed the issue of dial test tasks not stopping.
Fixed the 406 error when clicking "Context Logs" in log details.
Fixed the cache issue where alertPolicyMemberInfos in the code showed members existed when monitors only configured notification targets without configuring members.
Fixed the issue where saving did not take effect after selecting to treat results as 0 in monitor data gaps.
Fixed the failure and error when batch recovering alerts.
Fixed the inconsistency in log explorer query result counts.
Fixed the issue where original data was overwritten when batch modifying monitors via API without configuring extend, rule fields.
Fixed the issue where built-in view templates were not correctly replaced after importing in the management console.
Fixed the issue where after one-click obtaining key fields in log index configuration, key fields were not linked to log explorer stacked mode display based on display items.
Fixed the critical level error in monitor execution logs.
Fixed the issue where DQL subqueries did not take effect.
Fixed the issue where commas in variable values were not escaped causing incorrect condition filling when clicking Top List view and selecting to apply to view variables.

May 14, 2025¶

Brand LOGO Change¶

TrueWatch presents an innovative visual image, showcasing its iterative belief and technological power in the AI wave.

From this moment on, Obsy will accompany you to gain insights into the data world, navigate system complexity, and walk at the forefront of the AI era.

External API¶

Dashboard: Supports globally importing platform-level dashboards via identifier ID. This operation only updates dashboard configurations and does not affect the binding relationships of this view within each workspace.

Feature Updates¶

Security Monitoring¶

Added SIEM function module: Real-time analysis of logs and event data from various enterprise systems (such as servers, applications, network devices), automatically discovering potential threats, helping teams quickly locate anomalies, and fully leveraging the role of a security monitoring hub.

Monitoring¶

Alert Strategies:
Association: Supports selecting SIEM detection rules;
Notification Configuration: Added "Security Monitoring" type level.
Monitors: Due to adjustments in data writing for "Infrastructure Change Detection Monitors", old monitors need to be re-saved to avoid affecting generated event displays.

Event Center¶

The "Events" function module renamed to "Event Center", interaction page optimized.
Added Event Center explorer, supporting centralized viewing of all event data.
Event recovery added secondary confirmation operation to avoid accidental triggering scenarios.

Incident¶

After adding schedules in Incident > Calendar, when creating a new Issue or associating a responsible person, "On-duty Personnel" or "Notification Targets" can be selected. The system automatically assigns Issue responsible persons and notifies based on the day's on-duty personnel.

Scenarios¶

Dashboard: Added TOBY AI Intelligent Analysis function.
Time widget logic optimized: When selecting "Relative Time", even if users set the refresh frequency to "off", as long as query conditions are modified (such as adding/removing conditions using quick filters in the explorer, adjusting filter conditions in the search box, or switching view variables in dashboards/notes), the system will still re-trigger queries.

Management¶

Data Forwarding: For the three archive types AWS S3, Huawei Cloud OBS, Alibaba Cloud OSS, added Encrypted Storage selection toggle. When enabled, the system encrypts data forwarded outward.
Audit Events: Added workspace field marking.

Infrastructure¶

Host, Container, Pod, etc. details page built-in pages:
Time Widget: Added Pin function;
Integration Running Status: "View Monitoring View" page optimized;
Associated views added current event occurrence timeline display.
Host Explorer: Default query time adjusted to "Last 2 hours".

Logs¶

Optimized log multi-index matching hit logic, avoiding computational waste caused by matching index rules line by line.

Deployment Plan Updates¶

Supports creating, deleting, and modifying groups via External API, and adding or removing users in groups;
Workspace Management > Data Retention Policy: Added network storage policy configuration, supporting selection of fixed 2-day storage duration or custom save duration.
Added Profile data reporting dynamic parameter toggle. Users can dynamically enable or disable Profile data reporting based on platform performance.
Added API Key configuration and AI function access link configuration toggles, including the following scenarios:
Monitor > Alert Strategies > AI Alert Aggregation
AI Write Pipeline entry
Scenarios > Chart Components > AI Chart Title and Description Generation
Log Explorer > Log details with error status, Logs > Error Tracking > AI Error Analysis entry
RUM > Error Explorer > AI Error Analysis entry
APM > Trace Explorer > Trace details with error status, APM > Error Tracking > Trace Details > AI Error Analysis entry
When editing alert strategies, supports custom repeat alert time. Example formats for custom input silence time: 20m (20 minutes), 2h (2 hours), 1d (1 day).

New Integrations¶

Added host-class monitors;
Added MySQL monitor;
Updated CouchDB view and monitor;
Added ActiveMQ integration;
Added AWS SNS integration;
Added Volcengine ESCloud integration;
Added English version Huawei Cloud API, Huawei Cloud CCE monitors and dashboards;
Added Volcengine RabbitMQ integration;
Modified AWS MSK integration metrics.

Bug Fixes¶

Fixed the 413 error when uploading SourceMap via Vite packaging, SourceMap download errors, and TrueWatch inability to display source code error locations.
Fixed the issue where multiple workspace RUM data could not display normally during cross-workspace queries.
Fixed the inaccurate display of namespace and service data after selecting self-built log indices in the log explorer.
Fixed the messy page style when creating multi-step dial tests.
Fixed the issue where the quick filter section in the log explorer could not normally display namespace tag data under multi-index conditions.
Fixed the issue of false alerts on the Guangzhou site.
Fixed the abnormality when viewing host details using hosted Doris in version 0409.
Fixed the issue of abnormal external data source query data.
Fixed the ghosting display when expanding single logs in clustered mode.
Fixed the issue where the event statistics page still displayed recovered events.
Fixed the error triggered when clicking the "Batch" button in unrecovered events list display mode.
Fixed the issue where historical logs on S3 could not be queried via the "Data Forwarding" function.
Fixed the issue where FUNC alert message sending logs in version 1.109.196 Volcengine base were reported to business workspaces.

April 23, 2025¶

Breaking Change¶

Dial test data storage adjustment: Separated dial test data from the original log index, independently built table storage, and added dedicated query Namespace D. This adjustment does not affect historical dial test data. If previously querying dial test data via custom charts, please update query configurations promptly. Official dial test templates (such as HTTP, ICMP, TCP, WebSocket, Multistep Test) and related monitors, metric rules have been adapted to this change.

External API¶

Supports adding, modifying, listing specified workspace role lists, member list interfaces;
Optimized interface names and description information in OpenAPI, External API.

Feature Updates¶

RUM¶

SDK supports environment variable hot updates: By predefining variable parameters, introducing variables via environment variables within the application achieves dynamic configuration updates.
Application > Create Application: Users configure via custom parameters, left-side code examples update in real-time, system caches latest parameter configurations, no need to re-enter each time.
Error Explorer: Added support for TOBY AI Error Analysis. Intelligently parses single RUM error logs, automatically extracts key information, and obtains preliminary solutions and suggestions through integrated online search.

Infrastructure¶

Cross-Workspace Authorization: If authorized workspaces exist and the authorized data type is "Basic Objects", on Infrastructure various object type explorer pages can directly switch workspaces, achieving cross-workspace object data viewing.
Added "Change Event" tab page, supporting display of change details based on five object type data: Deployments, Daemonsets, Services, Cron Jobs, Statefulsets, facilitating user change record回溯.

Monitoring¶

Monitor > Detection Rules: Added "Infrastructure Change Detection". Through continuous monitoring of Kubernetes resource configuration changes (e.g., YAML file modifications), combined with version tracking and intelligent analysis, achieves effects like compliance checks, fault root cause定位, and resource usage optimization, ultimately ensuring cluster security, stability, and resource efficiency.
Detection Rules > Event Content > Custom Event Notification Template: Added time automatic conversion template function {{ df_fault_duration | to_date_range_human }}.

Events¶

Added Change Events:
View all event data records triggered based on Infrastructure Change Detection rules.
All Event Details > History Trend: When detection objects have change events, the time series chart displays change event time nodes and supports clicking to jump to change details page.
Event Explorer:
Added "Only Show Unassociated Issue Button", clicking quickly filters out associated events;
Added "Display Items": Supports display preference switching (including list, standard, extended三种方式);

Management¶

Data Forwarding > Data View: Search Component Optimization.

Chart Export¶

Charts support exporting to synchronously created new dashboards or new notes, applicable scope includes:

Metric Analysis
Explorer > List/Dimensional Analysis

Explorer¶

Adjusted interaction for basic "List" viewing and "Dimensional Analysis" chart modes;
Dimensional Analysis: Added grouped table chart.

Integrations¶

In the console left menu, the "Cloud Account Management" function access path adjusted from the original Management interface to the Integrations directory.

Deployment Plan Updates¶

Supports adjusting Login Method (local account, LDAP account, OIDC) order.

New Integrations¶

Added apollo;
Updated Argocd integration documentation, adjusted to kubernetesprometheus collecting metric information;
Updated ingress nginx documentation view monitor;
Neo4j updated dashboard & added monitor;
Added kubelet integration;
Added Azure Virtual Network Gateway integration;
Updated TIDB integration documentation, views and monitors;
Alibaba Cloud 30 components added Automata management.

Bug Fixes¶

Fixed the incorrect member count display on the member management page.
Fixed the untranslated time field in log views after switching to English interface.
Fixed the abnormal synchronized label display after switching clusters.
Fixed the issue where without mobile SDK接入, in RUM > Analysis Dashboard > Mobile > Error Analysis page, stuck count appeared, affecting abnormal user count display.
Fixed the timing judgment issue in the log explorer > details page.

April 9, 2025¶

Open API Updates¶

Supports creating, editing, deleting multistep dial test tasks;
Supports configuring workspace count upper limit restrictions.

Feature Updates¶

Scenarios¶

Chart Optimization
Bar Chart:
- Adjusted Alias position, supports listing all metrics and groups;
- Added X-axis configuration item.
Grouped Table Chart:
- Supports sorting based on group selection;
- Added 200 option in return count dropdown, manual input maximum count adjusted to 1,000.
Time Series Chart > Line Chart: Added line "Style" setting, including linear, smooth, front step, back step.
Snapshot: Added permission hint for dashboard snapshot sharing with configured permissions.
Explorer, Dashboard > Time Widget: Added "Last 1 minute", "Last 5 minutes", default selects the latter.

Management¶

Cross-Workspace Authorization: Supports cross-site data authorization, enabling extended data sharing.
Data Forwarding:
Data type added "Audit Events".
Adjusted explorer query time logic:
- Changed to daily queries, cross-day queries not supported;
- When viewing forwarded data, system automatically queries and continuously loads until complete display, no need for manual clicking;
- Management > Workspace Settings > Advanced Settings: Added "Data Forwarding Query Duration" configuration.
Data Access, Pipeline, Blacklist permission split, adjusted "Management" permission to: "Create, Edit" and "Delete".

Monitoring¶

System Notifications: Added associated log jump links, allowing jumps to log explorer and filtering out logs of failed notifications for this notification target.
Monitors:
Create from Template > Official Template Library: Added search function;
Configuration Page > Event Content: Updated attention hint. Only when associating Incident is enabled, @ member configuration takes effect and sends event content here to specified members.
Threshold Detection: Added Recovery Conditions toggle, configuring recovery conditions and severity. When query results have multiple values, any value meeting trigger conditions generates recovery events.

Incident¶

Issue email notification "Source" modified to hyperlink, users can directly access by clicking.

RUM¶

SourceMap:

Page interaction adjusted, from original pop-up to separate page;
List page added search, export functions.

TOBY AI Agent¶

Optimized Generate Chart function: Caching metric management data via local Func, generated DQL更贴近 semantic descriptions.

TOBY AI Error Analysis ¶

Added context support for root cause analysis, helping users understand error context faster and more comprehensively, improving diagnosis efficiency.

Integrations > Extensions¶

DataFlux Func (Automata)/ RUM Headless: Application billing added email reminders and system notifications.

Infrastructure¶

Host > Details Page: Disk capacity statistics distinguish between local disks and remote disks display.

Deployment Plan Updates¶

Template Management:

Page interaction optimization, including added display column "Template Type", etc.;
Top filter items added "Template Type";
Supports batch exporting templates;
When importing templates, supports previewing template details;
Built-in view, Pipeline, monitor template upload supports same-name overwrite logic.

New Integrations¶

Added GCP Compute Engine;
Added Azure Storage;
Added Azure redis cache;
Added Azure kubernetes;
Added Azure Postgresql;
Added Alibaba Cloud Rds MYSQL Automata integration;
Added Druid integration
Updated Trino;
Adjusted AWS/Alibaba Cloud Automata integration documentation: Added Automata开通脚本 steps.

Bug Fixes¶

Fixed the discrepancy between calling Open API to get unrecovered events and actual situation.
Fixed the error when searching in the event explorer.
Fixed the abnormal external data source data query.
Fixed Incident email notification related issues.
Fixed the slow loading of Incident > analysis dashboard.
Fixed incorrect bar chart display colors.
Fixed the issue of no AK提示 for external events.
Fixed the incorrect display of status distribution charts and log volume.

March 26, 2025¶

Feature Updates¶

Events¶

Unrecovered Events: Time widget defaults to auto-refresh, manual event recovery成功后 added frontend page hint.
Event Details: Alert notification page display optimized.
Event, intelligent monitoring explorer export appended "Notified or not" display.

Management¶

Data Forwarding: Added permission configuration. By setting view permissions for forwarded data, effectively improves data security.

Monitoring¶

Infrastructure Liveness Detection V2: Added configurable detection interval.
Alert Strategies: Notification matching logic adjusted, improving execution efficiency for events hitting multiple策略 and complex alert strategy scenarios.
Notification Targets Management: Added Slack and Teams two notification targets to meet the needs of more global users.

Scenarios¶

View Variables: Supports external data source queries.
Charts:
Added "Monitor Summary" chart, integrating monitor list, displaying latest status, achieving instant monitoring and abnormal态势感知.
Command Palette: Display optimized;
Chart Query: In DQL queries, when using "wildcard" or "regex", added query suggestion hints.
Explorer, Dashboard > Time Widget: Added "Last 1 minute" and "Last 5 minutes" options.

Billing¶

Added Monthly Bill module, intuitively displaying monthly total consumption.
Added export bill function.

RUM¶

Application List > Create Application: Added "Compressed Upload" and "Custom Hosting Address" parameter configurations.

Synthetic Tests¶

Added "South Africa" and "Hong Kong, China" as dial test nodes, further expanding global coverage.

Logs¶

Log Explorer
Quick filter operation items adjusted;
List tokenization logic optimized;
JSON format data added "JSON Search";
Index > Key Fields: Added "One-click Get".

New Integrations¶

Added Azure Network Interfaces;
Added Azure Kubernetes;
Added Azure virtual network gateway;
Improved English integration translations.

Bug Fixes¶

Fixed the low utilization display on the log page.
Fixed the metric unit display issue in Service Map.
Fixed the issue where multiple columns in table charts could not select units.
Fixed the error when exporting CSV from Dashboard > log stream graph, selecting export counts other than 1,000.
Fixed the inconsistency between the most popular page's P75 and DQL query results.
Fixed the issue where the time box still displayed today after clicking the << button in the time filter.
Fixed the issue where menu management did not meet expectations.
Fixed the abnormal workspace ID filter search in the management console.
Fixed the loss of test samples in the Pipeline interface.
Fixed the excessively long time for configuration migration export function.
Fixed the issue of大量空项 in quick filter tags on the event details interface after upgrade.
Fixed the duplicate detection library list in the monitor official template library, and once a detection library was selected, other monitors could not be searched.

March 12, 2025¶

Breaking Changes¶

Event df_alert_info field definition adjusted, added alert strategy未匹配原因说明, still needs filtering via isIgnored to obtain actual对外发送 notification targets.

Feature Updates¶

Incident¶

Added Incident Management entry. Through this entry, the currently logged-in user can view and manage the incident status of all joined workspaces.
Optimized incident page channel list display, improving query efficiency when channels are过多.

Management¶

Cloud Account Management: Added Alibaba Cloud cloud account authorization type.
API Key Management: Added permission control function for API Keys, supporting adding role authorization. Through role authorization, API Keys only have operation permissions within the role scope, effectively reducing security risks.
Data Forwarding: Default interaction changed to not selecting rules.

TOBY AI Error Analysis¶

The following details pages added TOBY AI Error Analysis capability:

error logs
APM > Trace/Error Tracking

Scenarios¶

Scheduled Reports:
Added Webhook sending as a notification method;
Supports sharing dashboard images to WeCom/DingTalk.
Time Series Chart: After selecting area chart as the chart type, added Stacked Mode style, facilitating observation of cumulative effects of overall data.

APM¶

Trace: Supports list batch export in JSONL format.

RUM¶

User Analysis > Funnel Analysis: For queried Session lists, supports Session Replay functionality.

Logs¶

Explorer:
Log Explorer > Index quick filter search bar listing display effect optimized;
Log Details > Extension Fields: Added "Perform Dimensional Analysis" mode;
Index: Under the index dimension, supports setting dedicated Key Fields.

Left side time range selection and right side refresh frequency are independent. Only two situations affect refresh frequency:

Selected time range exceeds 1h
Selected time is absolute time

Infrastructure¶

Hosts: Explorer supports adjusting time range.

Pipeline¶

Configuration page display optimized;
Pipeline processing type added "Events";
Test samples support obtaining JSON format.
Filter Conditions > Synthetic Tests: Supports selecting multistep dial tests.

Deployment Plan Updates¶

Template Management: Supports uploading all explorer templates.

New Integrations¶

Added azure_load_balancer;
Rewrote K8S server api;
Updated Gitlab CI;
Translated Volcengine related views;
Translated AWS related views.

Bug Fixes¶

Fixed the issue of no response when exporting log stream graphs to CSV.
Fixed the issue of no data when adding related filters to time series charts when the view variable for JVM metric views collected by ddtrace was the runtime-id field.
Fixed the interface display issue for custom gradient range color scales.
Fixed the issue where after editing DQL queries in time series charts, selecting filter conditions >0 and saving, it showed empty when editing again.
Fixed the abnormal display of APM > infrastructure table charts.
Fixed the issue where after setting data forwarding storage duration to 1,800 days in the management console, foreground forwarding rules did not support it.
Fixed the error "kodo service API request error: Service Unavailable" when executing show_object_field(HOST) in quick queries.
Fixed bug issues in Shortcuts.
Fixed the issue where session and view had no data in RUM, while other resource and action, etc. had data.
Fixed the issue where multistep dial test creation request steps immediately validated required fields.
Fixed the issue where filter conditions did not take effect when setting role authorization in Data Access.

February 27, 2025¶

Open API Updates¶

Metrics: Added measurement and tag information获取.

Feature Updates¶

Synthetic Tests¶

HTTP Dial Test: Supports Script Mode. By writing Pipeline scripts, flexibly customize judgment conditions and data processing logic for dial test tasks.
Added Multistep Dial Test: Allows creating tests using response data from multiple API connections, and linking multiple task requests through local variable value passing.

Scenarios¶

Dashboard > Visibility Scope: Added "Custom" configuration, allowing configuration of this dashboard's "Operation", "View" permissions. Simultaneously, under this configuration, added "All Members" option.
Charts:
Added capability for AI automatic generation of chart titles and descriptions;
Log stream graph added "Rule Mapping" function;
Table chart display columns optimized;
Grouped table chart: Expression results support sorting;
Time series chart, pie chart, and multiple tables support data export as CSV files.

Metrics¶

Metric Analysis > Table Chart: When query result return count exceeds 2,000条, three modes added "Query Result Count" display.
Metric Management: Supports one-click jump to metric analysis.
Generate Metrics: Supports import creation method, supports batch export.

Infrastructure¶

Container/ Pod Explorer: Object data added cpu_usage_by_limit, cpu_usage_by_request, mem_used_percent_base_limit, mem_used_percent_base_request 4 new fields.

APM¶

Profiling > Flame Graph interaction optimized: Selecting a single search method name directly focuses定位.
ServiceMap interaction optimized: In upstream/downstream pages, supports searching for nodes in the current canvas.

New Integrations¶

Added AWS Billing;
Added Kube Scheduler;
Added MQTT;
Rewrote APISIX;
Updated tidb English documentation and views;
Updated Zookeeper views, supplemented integration icons;
Fixed partial component mainfest.yaml English translations.

Bug Fixes¶

Fixed the error display when clicking APM > trace details tab page;
Fixed the issue with incorrect @member in Incident > Issue replies;
Fixed incorrect temperature units in charts.

February 19, 2025¶

Breaking Changes¶

Event df_meta will no longer retain alert_info related information records. Users previously relying on this information to obtain notification targets should switch to using the newly added df_alert_info (event alert notification), df_is_silent (whether muted), df_sent_target_types (event notification target types) 3 fields to complete corresponding functionalities.

Potentially affected functional scenarios:

Custom usage scenarios for integrating with external systems via Open API to obtain events
Custom usage scenarios for forwarding events to external systems via Webhook notification targets

Feature Updates¶

PromQL Query¶

Added query type: Instant Query, i.e., querying for a single time point.

Monitoring¶

Monitor configuration page:

Logical matching of trigger conditions added not between option;
Supports directly modifying monitor status ("Enabled" or "Disabled").

APM¶

Trace: Details page added Service Context tab page.

Events¶

Event Details Page: Added support for binding Built-in Views;

Incident¶

Issue added working, closed statuses;
For situations where open status停留超时 and no responsible person assigned and processing超时, Issue escalation added repeat notification configuration;
Adjusted UI display for Issue system comments, channel notifications;
Analysis Dashboard: Added time widget.

Scenarios¶

Chart Link: Added "View Host Monitoring View", default off.
Explorer: Supports deleting fixed name column, users can customize list display.
Cloud Billing Analysis View: Supports viewing billing details.

Management¶

Role Management: Session Replay View, Audit Events added custom add view permission capability.

Metrics¶

Generate Metrics: Metric name input no longer supports using - hyphen.

Integrations¶

Integration cards added description information.

Deployment Plan Updates¶

Template Management: Supports uploading infrastructure explorer templates;
Index Configuration: Discontinued "Backup Logs" item; can configure corresponding storage policy at "Edit Workspace > Data Retention Policy > Data Forwarding-Default Storage".

New Integrations¶

Added Milvus;
Added Volcengine Public IP;
Added opentelemetry-python;
Added openLIT Integration;
Updated k8s\es\mongodb\rabbitmq\oracle\coredns\sqlserver Chinese/English monitors & views.

Bug Fixes¶

Fixed the issue where special characters in AI aggregation notification messages caused abnormal results;
Fixed the Servicemap Deployment Plan adaptation issue;
Fixed the issue where composite charts could not configure already hidden view variables;
Fixed the chaotic display of "Unrecovered Issue List" in Incident > analysis dashboard;
Fixed the inconsistency between the most popular page's P75 results in RUM analysis dashboard and DQL query results;
Fixed the abnormal RUM > explorer search box issue;
Fixed the issue where using resource catalog for field mapping in Scenarios > object mapping, only部分生效 for the same field in the dashboard;
Fixed the UI display issue for Monitor > event content;
Fixed the unmet expectation issue for unrecovered event quick filter results in the event explorer.

January 16, 2025¶

Feature Updates¶

RUM¶

Added Funnel Analysis function: Users can create funnels by defining conversion steps, view data conversion and perform in-depth analysis;
User Analysis Module Integration: Added User Analysis module, integrating heatmaps and funnel analysis within this module, providing more comprehensive user behavior analysis tools;
Added Mobile SourceMap还原: Android and iOS applications support uploading SourceMap files on the page and viewing还原后 data in the error explorer.

APM¶

When adding services in APM, added installation guide for Host Auto-injection, simplifying the installation process.

Integrations¶

DataKit (Data Collection Tool): DataKit installation page added Docker method installation guide, providing more diverse installation options;
External Data Source Optimization: When querying SLS data sources, added query specification hints, helping users perform data queries more accurately.

Scenarios¶

Composite Chart Optimization: Composite chart added view variable configuration, supports selecting view variables from the current dashboard to apply to this composite chart, helping more flexibly filter and analyze data.

Monitoring¶

Anomaly Detection Monitor: Added support for week-over-week, month-over-week comparisons of query periods.

TOBY AI Agent¶

Added DataFlux Func related knowledge base.

Pipeline¶

Auto-generate Pipeline Optimization: Supports simultaneously obtaining Pipeline parsing through structured plus natural language interaction.

Bug Fixes¶

Fixed display issues in log stacked mode;
Fixed the misalignment of function input boxes in log detection monitors;
Fixed incorrect metric calculations;
Fixed the issue where Volcengine did not support having statements;
Fixed the error when selecting "Request Error Rate" and "Average Requests Per Second" two metrics in APM metric detection;
Fixed the issue where not in statements did not take effect in the Volcengine base;
Fixed the issue where excessively large data returned by the event list affected page loading speed;
Fixed the unmet expectation issue for one-click event recovery on the Hangzhou site.

January 8, 2025¶

Open API Updates¶

Field Management: Supports obtaining field management list, supports adding/modifying/deleting field management.
Synthetic Tests: Supports modifying dial test tasks.
Incident > Schedule: Supports obtaining schedule list, supports creating/modifying/deleting schedules.
Incident > Configuration Management: Supports obtaining notification strategy list, supports adding/modifying/deleting notification strategies; supports obtaining Issue discovery list, supports creating/modifying/enabling/disabling/deleting Issue discovery configurations.

Feature Updates¶

Logs¶

Log Index Optimization:
When accessing log built-in views, log context tab pages, will respectively default select the index where the current log resides, default index. Both tab pages support multi-selection of indices. Simultaneously, when cross-workspace query is enabled and authorized workspaces are selected in the所属 menu, supports directly querying corresponding workspace index data here. Ultimately helps users completely view associated log data on one page, optimizing log query interaction.
When listing log indices, besides default pinned display, other log indices are listed in A-Z order.
Log Explorer added stacked Viewing Mode: In stacked mode, fields will be integrated into the same column, and these fields are presented as rows within the cell. Log information display is more compact and clear,方便 users quickly browse and analyze.
Log Pipeline Optimization: Log Pipeline test samples adjusted to obtain all fields of the log and need to be filled in line protocol format. Simultaneously, user manually entered logs must also follow format requirements.

Scenarios¶

Table Chart Optimization:
Multi-metric Query Sorting Support: When using one DQL for multi-metric queries, table charts now support sorting.
Table Pagination Selection: Added table pagination selection function, users can choose appropriate pagination size based on data volume and viewing needs.
Composite Chart: Supports adjusting chart order.
Chart Optimization: Adjusted DQL query component function order, while特别 emphasizing Rollup function usage scenarios, helping users better utilize Rollup function for data aggregation and analysis.

Management¶

Events Support Configuring Data Forwarding: Supports configuring data forwarding rules for event type, saving event data meeting filter conditions to TrueWatch object storage and forwarding to external storage, providing flexible event data management capability.
Workspace Added DataKit Environment Variables: Workspace supports managing DataKit environment variables, users can easily configure and update environment variables, achieving remote synchronous updates of DataKit collection configuration.
Query Audit Events Optimization: Added multiple fields for recording query information, while event content supplemented query time range, facilitating tracking and analysis of query behavior.

Pipeline¶

Auto-generate Pipeline Optimization: Changed hint appearance method, optimizing product experience.

TOBY AI Agent¶

TOBY AI Agent added Generate Chart: Generate chart function automatically analyzes user-input text data based on large models, intelligently generates suitable charts, solving problems like繁琐 manual chart creation, chart selection困难.

Monitoring¶

Alert Strategies: Configuring notification rules by member supports appending names for usage description.

Deployment Plan Updates¶

Management Console > Workspace Menu Optimization:
Workspace list added primary storage engine, business two filter items, supporting convenient workspace filtering;
Optimized workspace list page number return logic. When modifying/deleting a workspace, or modifying workspace data reporting limits, will stay on the current page to optimize query experience.
Deployment Plan Added Parameter: alertPolicyFixedNotifyTypes, supports configuring whether the "Email" notification method is displayed in alert strategies Configuration Reference.

New Integrations¶

Added AWS Gateway Classic ELB;
Added Volcengine TOS Object Storage;
Modified AWS Classic collector name;
Added MinIO V3 integration;
Updated elasticsearch, solr, nacos, influxdb_v2, mongodb integrations (views, documentation, monitors);
Updated kubernetes monitoring views.

Bug Fixes¶

Resolved the issue where cross-workspace authorization for event data did not take effect;
Resolved the issue where log-associated trace jumps to trace explorer carrying trace_id could not query data;
Resolved the issue where view expression queries could not perform numerical filling;
Resolved the issue where external event detection monitors did not generate operation audit records when changing alert strategies;
Resolved the issue where column widths in the event display list could not be adjusted.