Changelog (2025)¶

December 24, 2025¶

Feature Updates¶

Role Permissions¶

Dashboard permissions refinement: Added independent "Dashboard Create" permission. The original "Dashboard Management" permission still includes all operations. When assigning the "Create" permission, basic dashboard and view viewing permissions are automatically enabled.
The navigation bar dynamically displays based on user permissions. If a role does not have any permissions in a specific module, that module will not be displayed in its left navigation bar. This rule applies to the following modules: Cloud Billing, Billing, Scenarios, Event Center, Infrastructure, Logs, Metrics, APM, RUM, LLM Monitoring, Synthetic Tests, Monitoring, Incident, Security Monitoring.

Monitoring¶

Alert Strategies:
- Simultaneously supports searching and filtering to filter alert strategies; Newly supports precise filtering by monitor name (checker_title) and member (member);
- Repeat Alerts: Added support for setting separate non-sending time intervals for repeat alerts based on different alert levels (e.g., critical, severe, warning, etc.);
- Added notification aggregation rule: "Custom". Supports freely specifying field combinations for alert aggregation based on business needs. Input field names (multiple fields separated by English commas), the system will strictly aggregate based on this combination: alerts will only be aggregated when the event data contains all specified fields and their values are valid.
Arbiter's built-in DQL functions support querying data from a specified workspace by passing a workspace parameter. Applicable to the creation and modification of Programmable Monitors and SIEM detection rules.

APM¶

Performance Metrics:
- Added Apdex statistics to quantify user satisfaction with application performance;
- Statistical metric time series visualization: Upgraded core statistical metrics in the service list (like average requests, response time, error count) from numerical display to time series charts, intuitively showing change trends.
Service Details:
- Supports displaying OpenTelemetry service language;
- Added Tab pages: Service Map, Profile, Dashboard.

Scenarios¶

Added new chart type "Change Comparison Chart": Quantitatively compares a specified metric's value in the current period with the same period in history (e.g., same time yesterday, same day last week) or other metrics, and intuitively displays the change magnitude for quick anomaly detection;
When creating a Pie Chart (Doughnut Chart), when the legend is not hidden, you can choose whether to display the Value and Value percentage.
Chart Y-axis: Optimized raw value display.

Snapshots¶

Overall optimization of the snapshot list style;
Save Snapshot: Added "Save as static time" setting.

Metrics¶

Metric Analysis: Numeric values in query results now support flexible display format settings, allowing setting decimal places and full precision result display.

Management¶

Cross-workspace Authorization: When the data scope is "Metrics", refined configuration of the metric authorization scope is possible;
Share Management: Added quick filtering by type and search box.

Pipelines¶

Each data type now supports setting two default Pipelines (including local and central Pipeline).

Open API¶

Cross-workspace dashboard queries support specifying the default selected workspace.

Deployment Plan¶

Management Console:
- Workspace List > Tenant Configuration Management:
  - Added "Max Subvolume Time" setting, which defines the maximum time search range for a single query. Once sufficient data is retrieved within this range, the search stops immediately;
  - Extended "Sampling Threshold" configuration, allowing free definition.
- Supports batch importing members by uploading a member list file;
- Security Settings > Login Method Management: Supports modifying the display name of the system default LDAP account to adapt to different users' internal system unified login scenarios.
Added parameter (max_delay), supporting custom service topology calculation time.

New Integrations¶

Added GCP Storage integration;
Added GCP Cloud SQL (MySQL) integration;
Added Alibaba Cloud VPC Peering Connection integration;
Added AWS Lambda Trace integration;
Added Alibaba Cloud WAF Application Firewall integration;
Added Tencent CVM / KeewiDB views for Tencent Cloud;
Fixed case sensitivity issue in Ingress-nginx-prom integration documentation;
Fixed integration documentation issues (including Chinese/English character and format issues);
Fixed TencentCloud public CLB collector to support non-public IPs;
Fixed Bug with linearBuckets metric in GCP Cloud Monitoring;
Added CSPM rule: S3 bucket policies should restrict access from other AWS accounts;
Added cloud integration templates: Aliyun CPFS, Aliyun NLB, HuaweiCloud EVS, Aliyun CNAPIGateway, HuaweiCloud ROMA;
Added cloud script: GCP APIs collector;
Added cloud script: GCP RUN collector.

Bug Fixes¶

Fixed the issue where alert events could not recover;
Fixed the issue of excessive connections when connecting to external Kafka clusters;
Fixed the issue where email addresses added to the blacklist could not receive emails normally;
Fixed the issue where the number of all online hosts was not displayed upon first loading the host list, requiring waiting for lazy loading;
Fixed the issue where calling the log query task interface returned an error;
Fixed the issue where clicking Mute in the event details on the Hangzhou site did not take effect;
Fixed the issue where the snapshot share button was sometimes unresponsive;
Fixed the issue of poor sampling results for APM on overseas sites;
Fixed the issue where alert events could not associate and view related content;
Fixed the issue where searching log sources triggered large queries, causing platform queries to return no results;
Fixed the issue of not receiving high consumption warning emails;
Fixed the issue where monitor events did not recover as expected;
Fixed the issue with abnormal data display in the RUM Error Analysis view;
Fixed the issue with errors in trace data (7 days) and log queries (7 days);
Fixed the issue with abnormal Sourcemap reporting for the same version;
Fixed the issue where using wildcards for all indices when generating metrics from logs caused generation failure;
Fixed the issue where read-only users could not view public dashboards;
Fixed the issue where the quick search function in dashboards could not be spliced with log stream graphs, and the issue with abnormal multi-select view variable display in log analysis;
Fixed the issue where obtaining samples encountered errors during timeline governance using pipelines on overseas sites;
Fixed the issue where the "Past 1 month" query range in scheduled reports on overseas sites returned an incorrect time range (217 days);
Fixed the issue where dashboard templates on overseas sites caused test failures;
Fixed the issue with abnormal expression calculation results in monitors;
Fixed the issue where clicking the "Go to Workspace" link often resulted in a white screen with no event details displayed;
Fixed the incorrect path for guiding the installation of data collectors;
Fixed the issue where user access geographical location was displayed as Unknown;
Fixed the issue with abnormal CPU load value display for Windows hosts in Infrastructure;
Fixed the issue with abnormal results when using DQL for trace queries;
Fixed the issue where SESSION REPLAY data could not be displayed;
Fixed the issue where adjusting the time window on overseas sites resulted in incorrect APM data;
Fixed the issue where Inner Mongolia was displayed in English and data was incorrect in the China map;
Fixed the issue where no results were returned after binding logs to external indices;
Fixed the issue where trace data details could not be opened;
Fixed the issue where pipeline processing logs could not judge and filter text with empty content;
Fixed the issue where IP address city resolution failed;
Fixed the issue with Chinese text in pipeline script functions on overseas sites, and the issue where user IDs were not displayed in the resource explorer, and dashboard errors in the resource analysis section of the user analysis board;
Fixed the stuttering issue when variables selected wildcards.

December 10, 2025¶

Feature Updates¶

Billing¶

Based on the newly added Notification Targets, added a new billing item "Phone Call": Counts the number of voice notifications sent daily (each time/day).

For China region sites, the billing details are as follows:

Billing Item	Settlement Currency	Price Details
Phone Call	RMB	¥0.6
	USD	$0.09

Monitoring¶

Added support for Voice Call (IVR) as a notification target;
Monitors support cross-workspace data detection.

Management¶

Data Forwarding: After performing the Delete Rule action, the system sets the status of that rule to "Deleting". After processing is complete, the rule is automatically removed.

December 3, 2025¶

Feature Updates¶

APM¶

Service Map:
- Clicking a node now slides out the corresponding service details on the right. Besides basic information like service name, corresponding team, and contact details, it adds charts for service request response time, error request distribution, and error log count analysis;
- Added action buttons: Zoom out, Zoom in, Show complete topology map;
- Added topology map configuration:
  - Users can manually configure whether to calculate node size based on "Request Count";
  - Users can choose the hover highlight range.
Performance Metrics:
- Added Filter Field Configuration. Besides official default filter fields, users can customize up to 5 fields as filter fields;
- Added support for exporting the current performance metrics list as a CSV file.
Service Details > Resource Invocation:
- Added sampling hint: When queries for the resource list and distribution chart trigger sampling, a "Sampling Rate icon" is displayed;
- Upstream/Downstream Topology: Added "View Upstream/Downstream Calls" buttons, supporting viewing the calling relationships at the upper/lower levels based on the current topology, enabling full-link path analysis starting from the current resource.
Traces > Service Call Relationships:
- Interaction optimization: Only draws call paths between different services, making dependencies clearer;
- Node information enhancement: Displays full-path service call relationships through a left-right structure, and directly shows execution time, average response time, call count, and error information on each service node; Clicking allows viewing the service's parent Span to trace upstream call sources; If the service has errors, error details are directly displayed.

RUM¶

To adapt to the HarmonyOS ecosystem development, added support for Application Type HarmonyOS. Users can choose the HarmonyOS type when creating an application and get corresponding SDK integration guidance and configuration support for complete observability接入 (access) for HarmonyOS applications.
The View explorer page supports TOBY AI error analysis.

Event Center¶

Added Event Level: Fatal (df_status:fatal), defined as the highest level.

DQL¶

Added function histogram_auto(): Automatic histogram range aggregation, no need to manually provide bucket boundaries, automatically selects appropriate bucket ranges to return statistical information about data distribution.
Optimized eval expression null value handling logic, added OR operator null value determination rule: When the left query result is null, automatically uses the right result for calculation, flexibly adapting to null value completion scenarios. Example analysis:
- (a or 0) / b: When query a result is null, automatically treats it as 0, finally calculating 0 / b;
- (a or b) / b: When query a result is null, automatically uses query b result, finally calculating b / b.

MCP Server¶

Added support for querying metrics, traces, and RUM data in a standardized way.

Management¶

Data Forwarding: When deleting a rule, the rule name must be entered to confirm the operation;
Member Management: Supports assigning roles to teams. Team roles are automatically applied as additional roles to team members. The member's final permissions include both personal roles and team roles.

Scenarios¶

Dashboard:
- Added a "Filter" button for quickly adding global filter conditions;
- Original functions like "History Version", "Large Screen Mode", "Report Record" have been moved to the "Settings" dropdown menu.
Charts:
- Advanced Configuration: Added "Repeat Chart" option. When enabled, the system generates multiple charts with the same structure based on the various values of the selected view variables;
- Clicking a data point now supports Apply to Filter and Copy Grouping Label;
- Table Chart: Manually entered return count上限 (upper limit) increased to 2000.

Monitoring¶

Alert aggregation notification template optimization: In rule aggregation and intelligent aggregation notifications, displays the number of different events triggered within the current aggregation周期 (period), helping users quickly identify the scale and impact range of alerts associated with events.

New Integrations¶

Openresty added OpenTelemetry trace接入 (access) method;
Added Zabbix integration, based on api\stream;
Added Alibaba Cloud Native API Gateway integration, Alibaba Cloud Function Compute integration;
Added Huawei Cloud EVS Cloud Disk integration;
Added Tencent Cloud WAF monitor;
Optimized Alibaba Cloud NLB view & integration documentation;
Optimized Alibaba Cloud SLB view;
Fixed iis integration view monitor;
Optimized Huawei Cloud ECS, CSS, Functiongraph views and monitors;
Optimized Tencent Cloud clb monitor/view;
Added Huawei Cloud DC/ Alibaba Cloud SLB monitors;
Removed Huawei Cloud GuassDB related integrations (Huawei Cloud has removed related products);
Fixed Huawei Cloud ROMA script;
Added CSPM templates:
- S3 buckets should enable "MFA Delete" function;
- S3 bucket ACLs should restrict public access;
- S3 bucket content access should be limited to authorized principals;
- IAM users should not have the "AdministratorAccess" policy attached;
- IAM policies should be attached and managed at the group level.
Added Resource Catalog templates:
- Huawei Cloud: dds, functiongraph, kafka, obs, rds(mysql), rds_mariadb, rds_sqlserver
- Volcengine: postgresql
- Alibaba Cloud: nat
- Tencent Cloud: tdsql_c_mysql, mongodb, eip, cos
- AWS: iam_user
Cloud integration templates:
- Added Tencent Cloud ckafka, es, redis, waf, etc.;
- Optimized Huawei Cloud: rds, postgresl, apig;
- Optimized AWS: WAF.

Bug Fixes¶

Fixed the issue where an email was registered but could not log in to the corresponding workspace normally;
Fixed the issue where log data could not be written to newly created workspaces;
Fixed the issue where the unrecovered events list showed no data after pagination;
Fixed the issue where monitor metrics showed self-built拨测 (synthetic test) nodes sent data successfully, but no data was visible in the explorer;
Fixed the issue where file paths were not correctly displayed in error details after SourceMap was successfully uploaded and parsed;
Fixed the issue where global configuration saving was无效 (invalid) in the performance profile explorer;
Fixed the issue with abnormal auto-refresh functionality for single dashboard viewing mode in Scenarios;
Fixed the issue where workspace administrator accounts could not create new workspaces;
Fixed the issue where the time interval for opening view details by clicking the view button in the dashboard was inconsistent with the dashboard configuration;
Fixed the issue with abnormal billing functionality for billing timelines;
Fixed the issue where filter conditions in the log explorer sidebar occasionally failed to return correct results;
Fixed the issue where scheduled reports could not be generated;
Fixed the incorrect wording on the拨测 (synthetic test) function studio page;
Fixed the "No metric data query permission" error for external API reports;
Fixed the "Internal Server Error" encountered by accounts restricted by data access permissions when trying to access the log explorer;
Fixed the interface error when viewing network topology in the Infrastructure network menu;
Fixed the issue where iOS symbol table uploads failed to successfully parse stack information;
Fixed the issue with frequent false alerts for Infrastructure存活 (liveness) detection V2 version (corresponding machines were online without anomalies);
Fixed the issue where specific logs could not be searched using Chinese in the workspace log explorer;
Fixed the issue with intermittent missing or incomplete trace query results, requiring repeated page refresh;
Fixed the issue where the upper limit value supported for continuous trigger judgment conditions in monitors was incorrect (should be 10);
Fixed the issue where log data forwarding volume abnormally decreased by 90% since a specific date;
Fixed the issue where the error_stack field could not be selected in monitor grouping settings, while it worked normally in DQL;
Fixed the issue where DQL queries executed by monitors returned incorrect data, leading to event alerts;
Fixed the failure to access the Infrastructure function on the Ningxia site;
Fixed the issue where drilling down into CPU metrics showed "No data" in various related charts;
Fixed the issue where members in the workspace could display logs via traceid, but searching for keywords in logs returned no results;
Fixed the issue where log monitors could be saved without a data source configuration, but monitoring would be无效 (invalid);
Fixed the error when opening a certain view in the Scenarios module on mobile;
Fixed the issue where the "Cross-region private network traffic fee" billing item in the workspace abnormally increased on specific dates;
Fixed the issue where high consumption预警 (warning) emails set in the Hangzhou site workspace were not sent normally;
Fixed the issue where AWS-related resource catalogs were displayed in Chinese;
Fixed the issue with abnormal data auto-scaling functionality when setting dashboard data units;
Fixed the dashboard data display error on the Hangzhou site workspace resource topology and the issue where the performance profile page failed to load;
Fixed the abnormal log query issue on the Oregon site;
Fixed the issue where service nodes in the resource topology graph had no upstream/downstream, and metrics like request count and p99 were 0;
Fixed the issue where dashboard scheduled reports failed to display data normally;
Fixed the abnormal jump to traces in the APM analysis dashboard;
Fixed the issue where specific service log error counts abnormally increased (nearly ten thousand per minute) in the Deployment Plan.

November 20, 2025¶

Feature Updates¶

Query Tools¶

PromQL > Range Query Mode now supports setting the step size (step).

Scenarios¶

Text Chart supports introducing view variables and time variables, automatically parsing view variables #{fieldname} and time variables manually filled by users.
Funnel Chart: The number of nodes that can be added has been increased to 15.
In dashboards, explorers, and query tools, when chart sampling is enabled, a sampling rate icon will be displayed in the upper right corner.
- In query tools, you can click this icon to temporarily disable sampling.

Management¶

In blacklist configuration, "Filter" now supports on-demand filling.
SSO Management:
- The "Edit" button must be clicked before enabling/disabling operations can be performed;
- The "Edit Identity Provider > Role Authorization" page supports selecting custom roles.

November 12, 2025¶

Feature Updates¶

Billing¶

The billing unit price for "APM/LLM Trace" has been adjusted as follows:

Monitoring¶

Added Programmable Detection monitors. Detection rules are written through scripts, covering detection needs for various system data types.

TOBY AI Agent¶

Added support for anomaly analysis. Based on the input text, the TOBY AI agent intelligently integrates complex and chaotic information to generate clear and concise root cause analysis results for you.

MCP Server¶

Added support for accessing MCP Server (Model Context Protocol). As an open protocol, it provides a unified multi-model callable interface service for the TrueWatch TOBY AI agent, supports multi-client access, and accesses TrueWatch's monitor, log, dashboard, and DQL query capabilities through API Key authentication.

Management¶

Role Management: Scenario configuration management / monitor permission split.
- Scenario configuration management: Permissions are subdivided into
  - Dashboard, view viewing
  - Dashboard management
  - View management
  - Note, explorer management
- Monitor: Split into monitor viewing and management permissions.
Field Management: Added "Attribute Classification" configuration item, including: system fields, business fields, other.
Workspace Settings:
- Added "Data Reporting IP Whitelist" configuration. When enabled, only egress IPs within the whitelist can report data normally; data from other sources will be intercepted.
- The original "IP Whitelist" configuration has been renamed "Login IP Whitelist". After enabling the login (host) IP whitelist, only sources in the whitelist can log in normally; other source requests will be denied access.

LLM Monitoring¶

Added support for collecting scores (model quality evaluation scores, descriptions, etc.) and displaying them.

Event Center¶

Change Event: After a new host is accessed, a new change event will be generated.

Scenarios¶

Time Series Chart > Analysis Mode added style switching and同期 (period-over-period) comparison;
Charts added the "Open in Metric Analysis" function. Seamlessly transition from any chart to the metric analysis interface, with the system automatically bringing in the set query conditions.

Explorers¶

Log Explorer: Display fields also support filtering values;
All Explorers: Added field type icon display.

Log Index¶

Log Index: Added description and associated service configuration. When querying traces, the system will automatically associate matching service indices.
External Index: Added index description configuration;
Explorer application index supports single/multiple selection mode switching.

APM¶

Service Map: Added display of maximum service response time.

RUM¶

Explorer > Fetch/XHR tab page: The original "Request" column was renamed "Resource URL" and supports displaying the full URL, which can be toggled on/off via a button.

Cloud Account Management¶

Added a search control, allowing fuzzy matching by searching for keywords.

New Integrations¶

Added Volcengine PostgreSQL integration;
Added Alibaba Cloud CPFS integration;
Added Alibaba Cloud ALB integration;
Optimized Alibaba Cloud NAT view;
Optimized Tencent Cloud Cloud Monitoring;
Optimized Alibaba Cloud Oceanbase dashboard;
Added Pipeline templates:
- AWS ELB
- Squid
- Kong
- CloudFront
- CloudTrail
Added cloud collector templates:
- Alibaba Cloud cfw/cen/apigateway/mqtt/nas/OceanBase/ga;
- AWS step function/ssm run command/waf2;
- Huawei Cloud apic/apig/auto_scaling/cbr/cdm/css_es/dcaas, etc.;
Added CSPM templates.

Bug Fixes¶

Fixed the issue where clicking to expand log details in the log stream graph could not display context;
Fixed the issue where the index in the log slide-out page was not automatically matched;
Fixed the issue where too many dashboard view variables could not be selected;
Fixed the issue where the latest DK version could not be obtained via Helm in the AWS Oregon region;
Fixed the DQL parsing failure issue when configuring detection metrics in APM metric detection;
Fixed the issue with workspace invitation member failure reports and language display on the APM interface;
Fixed the display exception when clicking the "Data Access" menu;
Fixed the issue where one-time "Immediate" reports selected in scheduled reports on the Singapore site did not result in received emails;
Fixed the chart jump issue in the RUM performance analysis dashboard;
Fixed the page error when viewing basic machine information on the Oregon site;
Fixed the issue where log sources under the selected index in the log detection monitor could not be displayed normally;
Fixed the unresponsive issue when clicking log sources in monitors;
Fixed the issue of excessive connections when forwarding data to Kafka;
Fixed the Internal Server Error when querying the last day's data in the APM analysis dashboard;
Fixed the issue of duplicate display of extended field values in the console;
Fixed the display anomaly after selecting "All Sources" for the data source in blacklist configuration;
Fixed the abnormal display of trace information in log details;
Fixed the issue where charts displayed "service unavailable" in scheduled reports;
Fixed the abnormal display in APM > Resource Call > Response Time Distribution;
Fixed the issue where aliases could not be set for bar charts using PromQL queries for a certain metric without aggregation or grouping;
Fixed the error when clicking host details on the Deployment Plan infrastructure page;
Fixed the error in deleting dashboard groups;
Fixed the abnormal return results after changing the top value in the leaderboard chart settings;
Fixed the issue where Profile data opened blank and could not be downloaded;
Fixed the user alert issue caused by slow Redis hgetall queries;
Fixed the issue where the label_values function became unavailable after upgrading the base version to 1.119.212 and view variables could not be saved after being set;
Fixed the incorrect jump link opening in the security monitoring rule writing guide;
Fixed the error when querying external index logs;
Fixed the issue with excessively large起伏 (fluctuations) in data points in the log query time series graph;
Fixed the issue where the configuration was empty when exporting a composite detection monitor from space A and importing it into space B;
Fixed the display and drill-down异常 (abnormality) of the Heat map.

October 22, 2025¶

Feature Updates¶

Open API¶

Supports modifying data retention policy duration;
Supports log field global configuration > Key Field Configuration;
Supports creating log indices via interface.

External API¶

DQL¶

Added function rate_over_sum(), which first sums the field within the aggregation window, then divides by the window length (seconds), used to calculate the average rate, resulting in a floating-point type.
Added function rate_over_count(), which counts the number of non-null values of the field within the aggregation window and divides by the window length (seconds), used to calculate event frequency, resulting in a floating-point type.
Added support for count(*) / 1i syntax.
- Example: L::*:( count(*) / 1i ) [::1m]. Represents dividing by the number of seconds in the time window (1m) to calculate the QPS of log writing.

Billing¶

Data Forwarding > External Storage Forwarding Traffic Statistics: Based on the current workspace, summarizes compressed forwarding traffic by external storage type, counts daily increments, and distinguishes between public and internal network traffic for billing purposes. View specific price details.
Usage Analysis: Supports manually switching to the billing time zone (UTC+8), resolving issues where the user time zone and billing time zone were inconsistent.

Monitoring¶

Alert Strategies: Added support for not sending notifications for recovery events: Enabling this option means all recovery conditions only generate events and do not send external notifications.
Monitors:
- Added Large Volume Alert Protection button: When the number of alerts generated by a single detection exceeds a preset threshold, the system automatically switches to a summary-by-status strategy: instead of processing each alert object individually, it generates a small number of summary alerts based on event status and pushes them.
- Log Detection > Detection Metrics: Supports configuring multiple indices.
- Range Detection, Outlier Detection: Supports cross-workspace query of detection metrics.

Scenarios¶

Histogram:
- Added support for metric data source queries.
- Controls statistical dimensions based on the BY field in the query conditions, divided into "Global Statistics" and "Grouped Statistics":
  - Without BY conditions, performs global total statistics, calculating the total distribution of all data.
  - With BY conditions, groups by the BY field and then统计 (calculates) the distribution of each group's data.
- Added X-axis and Y-axis configuration, allowing customization of data display boundaries by setting maximum and minimum values.
Time Series Chart: On the target time point of the time series chart, clicking allows selecting a Fixed Time Marker. Once set, the marker does not change due to mouse movement, page scrolling, or switching time series charts.
Composite Chart: Added an export button, supporting one-click export of all chart information.
Chart > Link: When creating a new chart in a dashboard (existing charts remain unchanged), if the by field in the query condition meets specific conditions, the system will automatically enable the display of the corresponding link list.
Reports: Original real-time reports and archived reports are unified into "Reports". All reports are archived and saved, simplifying management and viewing experience.
- Synchronously supports directly creating reports on the dashboard page, automatically带入 (bringing in) the current view and time range.
- The Report Record page allows viewing historical archived data and directly sharing or deleting it.

Infrastructure¶

Hosts: Added Real-time Performance switch. When enabled, the system refreshes every 10 seconds and automatically获取 (obtains) the latest three metric fields: CPU usage, memory usage, and CPU load.

Explorers¶

Global Configuration > Quick Filter Configuration: For RUM and Synthetic Tests explorers:
- The left side displays a source list, allowing modification of multiple options simultaneously in a pop-up.
- When opened from different explorers, the corresponding source is automatically selected.
RUM > Long Task Explorer > Details Page: Added Script details, displaying还原 (restored) code.
Time Widget: Added a Play button. After selecting a time range and executing a query, clicking the ▶️ button quickly returns to the most recent specified time range.

Snapshots¶

Supports re-editing already saved snapshots.

Management¶

Blacklist: Supports one-click enable/disable.
Pipelines: Optimized template export format and updated official template library samples.
Role Management: Supports one-click export of roles.
Data Forwarding: In addition to JSON text format storage types,新增 (added) support for Parquet data storage type.

LLM Monitoring¶

Added接入 (access) guide configuration steps.

New Integrations¶

Added AWS CloudTrail integration;
Added AWS CloudFront integration;
Added AWS Athena integration;
Added Alibaba Cloud NAS integration;
Added Alibaba Cloud MQTT integration;
Added Alibaba Cloud OceanBase integration;
Optimized Kong integration documentation, added Tracing integration method;
Optimized CSPM templates.

Bug Fixes¶

Fixed the issue where members could not view after log field advanced configuration linkage, and the incorrect timestamp variable setting;
Fixed the issue where calling the OpenAPI to invite members still sent invitation emails to already joined members;
Fixed the issue where data in dashboard views was not expanded normally;
Fixed the incorrect format after exporting table charts to CSV;
Fixed the defects in the Multi-step test creation flow;
Fixed the issue where the return upper limit restriction for area charts, line charts, and bar charts in metric analysis did not match the documentation description;
Fixed the issue where Profile could not open normally;
Fixed the issue where field aliases were visible when adding quick filters in the explorer but disappeared after adding;
Fixed the issue of scheduled report sending failures;
Fixed the issue where no拨测 (synthetic test) task data was available on the platform after creating a new拨测 task, and self-observation queries found relevant error logs in kodo;
Fixed the error when querying JSON format data with DQL;
Fixed the issue of no data in RUM Action and View details;
Fixed the issue where actual role permissions existed in API Keys management but were not displayed on the right端 (end);
Fixed the issue where scheduled reports in the production workspace could not be sent, but those in the test workspace could;
Fixed the issue where custom roles could not be deleted;
Fixed issues with the log explorer: including abnormal display of bar charts and data bar counts, and inconsistency between the number of items searched and the number of items found below;
Fixed the issue of no data when viewing shared snapshots;
Fixed the APM data empty result issue;
Fixed the issue of data堆积 (piling up) when forwarding data to Kafka, where the backuplog service kept consuming memory until OOM;
Fixed the issue where provinces with data were not displayed in the Dashboard > China Map;
Fixed the issue where text charts in panels would move to the top after refreshing after being moved;
Fixed the slow loading of 5-minute log queries;
Fixed the incorrect转义 (escaping) of filter conditions when jumping to associated views from the event details page;
Fixed the issue where time window parameters affected calculation results when using DQL to query data;
Fixed the issue where data stored by guancedb-storage was for 1 year, which did not meet expectations;
Fixed the issue where filtering custom fields defined by users in Actions did not take effect;
Fixed the issue where Webhook object addresses were modified but did not take effect normally in alert events;
Fixed log query related issues: including stuttering when loading more details from the list dropdown and query errors, and significant differences between the status distribution graph display results and actual data;
Fixed the issue where cross-workspace trace queries only displayed data from the current workspace.

October 15, 2025¶

Feature Updates¶

Chart Query¶

Expression Query: 1. Added an independent "Expression Query" input box for directly writing expression formulas; 2. Automatically assigns a query identifier (e.g., a, b, c) before all queries; 3. Compatibility Notes - Historical chart subquery identifiers (e.g., A, B) cannot be reused by new expressions; - Original expressions can still be queried normally,不影响 (not affecting) existing chart functionality; - It is recommended to use new query identifiers to reconfigure expressions when editing charts.

Data Forwarding¶

Added support for forwarding data to Volcengine TOS, providing five storage type options: Standard Storage, Infrequent Access Storage, Archive Flashback Storage, Archive Storage, Cold Archive Storage, to适应 (adapt to) different storage needs in various business scenarios.
When the storage type of forwarded data is "Archive", supports restoring tasks to thaw the data for access and analysis.

September 24, 2025¶

Feature Updates¶

Open API¶

Added specified API Key creation permissions for newly created workspaces;
Added support for binding specified billing centers;
Added support for cross-workspace authorization.

Security Monitoring¶

Added CSPM detection type, supporting custom selection of detection types based on actual business scenarios (such as cloud resource protection, compliance auditing, etc.), enriching detection coverage scenarios. Detection type descriptions are as follows:
- CSPM (Cloud Security Posture Management): Identifies misconfigurations (e.g., open high-risk ports, excessive permission allocation) and compliance risks in cloud infrastructure, continuously assesses cloud resource security, and reduces the risk of vulnerability exploitation.
- SIEM (Security Information and Event Management): Collects and analyzes security data from the entire infrastructure, detecting threats and anomalous activities (e.g., abnormal login + bulk data export) through event correlation and log analysis.
Official Detection Library Experience Upgrade: Detection rules新增 (added) "Belonging Detection Library"标识 (identifier), facilitating users to quickly identify rule sources; simultaneously supports switching views in the template library, allowing browsing of all detection rules including monitors at once, improving rule查找 (search) efficiency.
Security Detection Rule Editing Experience Optimization: Added "Trigger Detection Immediately" function,无需 (no need to) wait for scheduled detection cycles, can trigger detection tasks in real-time,便于 (facilitating) users to quickly verify script effectiveness after writing/adjusting detection scripts, and immediately view generated security signals.

Management¶

Added Preferences, allowing unified configuration of workspace language, theme mode, detail page opening method, etc.;
Member Management: Added support for exporting members;
Invite Member: Added configuration for member's team and remarks information.

Monitoring¶

Monitors: Editing monitor rules supports "Trigger Detection Immediately";
- Sudden Change Detection, Range Detection V2 support cross-workspace queries.
Mute Rules support cloning.

APM¶

Service list page added "Add Service" button.

Synthetic Tests¶

When creating new拨测 (synthetic test) tasks, supports configuring task execution frequency by inputting custom crontab.

Incident¶

When Issues are automatically discovered for the first time or created manually, the system supports AI intelligent analysis, automatically summarizing the current Issue content.

Metrics¶

Generate Metrics: Supports Infrastructure and Resource Catalog data sources.

View Variables¶

Removed the original all values option, unified use of * to achieve multi-scenario filtering needs, supports selective use based on different business scenarios. The specific effects are as follows:

Ignore this field filter: When * is selected, ignore this field filter, chart queries will not include过滤 (filtering) conditions for this variable.
Full value filter (equivalent to original all values): When * is selected, all variable values will be used as filter conditions (supports up to 100 values). Note: Too much data may affect performance. It is recommended to use selectively based on actual needs, avoiding indiscriminate full filtering.

Explorers¶

Log Explorer: Index style adjustment, simultaneously supports one-click selection of all indices, pinning indices, searching and positioning based on index name, etc.;
All Explorers: Supports Advanced Linkage Configuration.
Added query acceleration configuration. In the explorer "Global Configuration", index can be configured for commonly used filter fields to improve the query speed of that field.

Added support for Quick Zoom function: One-click expands the current query time range to 3 times the original, reducing manual adjustment of time ranges and improving data exploration efficiency.

External Data Sources¶

Added support for SQL Server data source.

New Integrations¶

Added AWS AOSS integration;
Added AWS PCS integration;
Added Alibaba Cloud CEN integration;
Added Continuous Profiler JVM dashboard template (analyzing Profile data);
Added AWS WAF integration;
Added FastDFS integration;
Added Alibaba Cloud API Gateway integration;
Added Alibaba Cloud Cloud Firewall integration;
Translated AWS AOSS/AWS PCS views.

Bug Fixes¶

Fixed the issue of adding labels to the df_label in event content through the central Pipeline;
Fixed the issue of unsuccessful workspace authorization deletion;
Fixed the display issue of database resources in the Resource Catalog;
Fixed the issue where host data on the Infrastructure > Hosts page decreased after clicking the sort button;
Fixed the issue of incorrect billing center username取值 (value retrieval) during new account registration;
Fixed the internal system error when binding external indices (TLS/ES);
Fixed the error when creating workspaces;
Fixed the error "Failed to create Func query task" when drilling down into Redis metric data;
Fixed the issue where Dashboard queries sometimes returned data and sometimes reported Internal Server Error;
Fixed the "View not found" issue when jumping from container_crash related to K8s events in Infrastructure;
Fixed the issue where the interface display was the same for different versions of指标 (metrics) collected by集成 (integration) > prometheus exporter;
Fixed the issue where some fields were not displayed in the log stream graph unit settings;
Fixed the discrepancy between Open API call results and documentation;
Fixed the issue where the system view "APM P90 Resource Analysis View" did not contain charts;
Fixed the issue where alert strategies failed to successfully send emails to customers;
Fixed the issue where the key:value format of JSON output in event templates did not follow the format viewed in the explorer;
Fixed the issue of false alerts generated by host data reporting monitors;
Fixed the 502 error when uploading SourceMap;
Fixed the omission in the Webhook alert process;
Fixed the issue of abnormal fields appearing when using DQL to query logs during panel drawing;
Fixed the "unknown Scalar function" error in dashboard queries;
Fixed the mismatch issue when switching DQL to simple queries in dashboards;
Fixed the issue where Studio dashboard > Pie Chart could not work normally in the Data Display module;
Fixed the 400 error on the Metrics Management interface > Time Series page on the Hangzhou site;
Fixed the wording error in Integration > Cloud Account Management;
Fixed the error in RUM ERROR pattern analysis;
Fixed the issue where RUM could not query Session and View data;
Fixed Warroom issues;
Fixed the issue where指定 (specified) resources had both entry and exit span types, but filtering for entry type spans yielded no results in the list;
Fixed the issue of incomplete service list display.

September 3, 2025¶

Feature Updates¶

Security Inspection¶

The Security Inspection function is officially discontinued. Its related functionalities can be achieved through the Security Monitoring > Security Information and Event Management (SIEM) module.

LLM Monitoring¶

TrueWatch launched LLM Monitoring, providing "monitoring + tracing" capabilities for large model applications,告别 (saying goodbye to) the "black box" of model operation, completely recording input/output, tool calls, retries, latency, cost, and tokens for each call. Visualized Trace and Session aggregated by session facilitate playback and troubleshooting, achieving full-link transparent management. It now优先 (prioritizes)支持 (supporting) Langfuse integration. If you are already a Langfuse user, you can quickly enable LLM monitoring capabilities.

Free Plan¶

面向 (Aimed at) independent developers and small teams, TrueWatch added a Free Zone (Beijing) node. Under this node, you can register for the Free Plan (other sites no longer support creating Free Plan workspaces), covering key core functionalities.

Open API¶

Incident > Schedule: Supports adding parameters for获取 (obtaining) calendars and filtering schedules.

Explorers¶

Log Explorer:
- Added Advanced Linkage Configuration: Supports configuring jump links for individual fields, allowing direct opening of target pages from the current field and passing parameters through variables for linkage analysis.
- Log Explorer Display Items optimization:
  - Added "Delete All Fields", "Reset Fields" buttons;
  - Added "Time Column" display switch.
All Explorers
- Supports DQL Query mode.
- Supports searching for all IP addresses under a single IP field through the CIDR function.

Event Center¶

Events generated by SIEM rules (security) support TOBY AI intelligent analysis on the details page.
No restriction on dimension tags,默认 (by default) supports jumping to log/trace explorers.

Monitoring¶

Alert Strategy Management: In Rule Aggregation Mode, supports selecting only "Send First Alert", thereby avoiding missing important异常 (anomalous) events while waiting for aggregation.
Monitor > Event Content supports defining domain variables:
- df_studio_env_name: Current environment name
- df_studio_console_base_url: Current environment console address
- df_studio_monitor_base_link: Current environment monitor address

Management¶

Workspace administrators support disabling AI Intelligent Analysis at the workspace level.

Metrics > Metric Analysis¶

Table Chart mode added Prom mode, displaying PromQL query return results.
In independent chart mode, added chart titles based on query conditions.

Infrastructure¶

Host and container explorers support directly creating mute rules.

Synthetic Tests¶

拨测 (Synthetic Test) Tasks: Request body content新增 (added) support for multipart/form-data.

Sensitive Data Scanning¶

Supports covering all data types, no longer limited to scanning only log data.

Mobile RUM¶

Analysis dashboard added "Crash Analysis", "Stutter Analysis" tab pages.

New Integrations¶

Added Squid integration;
Added Openresty integration;
Added Kafka 4.0 integration;
Added AWS MWAA integration;
Added AWS Step Function State Machine integration;
Added Alibaba Cloud GA integration;
Updated Nginx tracing integration;
Updated AWS OpenSearch monitor/view.

Bug Fixes¶

Fixed the issue where aliases in grouped table charts in dashboards did not take effect;
Fixed the issue of incorrect overview chart display results;
Fixed the appearance of Chinese text when Importing Dashboard (multiple dashboards - zip file);
Fixed the issue where funnel charts跳转 (jumped) to the session list, but SESSION REPLAY displayed errors;
Fixed the issue where alerts were still sent even though mute was set;
Fixed the issue where host tags were not displayed in Infrastructure;
Fixed the issue where charts in the analysis dashboard did not display data for the corresponding time period even though data existed in the Android端 (end) explorer;
Fixed the issue of no connections between services in the service topology graph;
Fixed the incorrect alert mute configuration causing all alerts to fail;
Fixed the issue where DQL statements in charts could not query results;
Fixed the error reported by拨测 (synthetic test) tasks on the Guangzhou site;
Fixed the issue where importing templates in the Deployment Plan management console did not meet expectations.

August 13, 2025¶

Feature Updates¶

Open API¶

Supports custom roles for Tokens.

RUM¶

To cover query scenarios for application data of different scales, the system optimized RUM data writing. This同步 (synchronously) led to the following updates:

RUM data query drills down to the application level:
- Explorer/Analysis Dashboard: Added application filter at the top of the page, defaulting to "All Applications", supporting custom single or multiple selection; queries are triggered only after selecting applications.
- DQL query statements support single or multiple application queries; more usage instructions can be found at RUM Data.
```
R(app name1)::view:(count_distinct(username))   # Specify querying UV for a certain application name
R(app id1)::view:(count_distinct(username))     # Specify querying UV for a certain application ID
R(*)::view:(count_distinct(username))   # Specify querying UV for all applications in the workspace
```
Existing users experiencing application data query performance bottlenecks can contact their account manager to enable the "User Access Data Table Splitting" function in the management console. For new users, after creating a workspace, the system will automatically split table data writes based on different applications.

Scenarios¶

Scheduled Reports: Added "Archived Reports": Supports full-data calculation for dashboards according to set periods (daily/weekly) and generates static snapshots. Archived results are retained long-term, unaffected by dashboard configuration changes, and can be viewed within the platform or notifications sent as configured.
Dashboard > Log Analysis: Added support for automatically带入 (bringing in) the dashboard's view variables as filter conditions for display.
Log Stream Graph: Supports querying all data sources within the platform.

Explorers¶

The search bar supports the querystring(md5(xxx)) tokenized query method. If data is encrypted with MD5 and needs to be located in the explorer after scanning, this method can be used for searching.

DataFlux Func¶

To enhance security protection for DataFlux Func Hosted Edition, the following updates were made:

Removed the "Reset Password" operation from the Hosted Edition page in the console, and stopped sending initial account passwords to email;
For newly created Hosted Editions, logging in via the Func page is disabled by default, only supporting免登 (password-free login) through console user authorization.
Already installed hosted Func: After upgrading to version 7.2.0 or above, two login methods are supported:
- Authorized Studio users can log in directly through the Console > DataFlux Func Hosted Edition interface;
- Alternatively, use users previously created in Func (including the initialized admin user) to log in via the Func page.

APM¶

Trace > Waterfall Detail Page/Code Hotspot tab page: Resources support one-click expand or collapse;
Topology Map: Added support for displaying "P95 Response Time".

Synthetic Tests¶

拨测 (Synthetic Test) Task > Request Body: Supports configuring four types of dynamic variables:

{{ timestamp "ns" }} //1754379375400790109
{{ date "rfc3339" }} // 2006-01-02T15:04:05Z07:00
{{ date "iso8601" }} // 2006-01-02T15:04:05Z
{{ urlencode "hello world" }} // hello+world

Added support for one-click cloning of拨测 tasks.

Monitoring¶

Threshold Detection > Detection Metrics: Supports selecting metric data across workspaces. Subsequently, after the monitor rule is successfully created, cross-workspace alert configuration can be achieved.
Monitor List: After quick filtering of monitors, supports cross-page全选 (select all) and one-click export.

Events¶

For recovery events, added definition of df_fault_end_time extension field as fault recovery time.

DCA¶

List supports selecting all data;
Supports configuring filter conditions based on DataKit version (datakit_ver), operating system (os), environment (env), etc.;
List added environment display.

Management¶

Role Permissions: Added "Client Token View" permission.
Cross-Workspace Authorization: When editing or deleting authorization rules, if the data scope or log index is reduced, a confirmation pop-up新增 (added) after confirmation, displaying the names of affected monitors and data access configurations, and simultaneously supports exporting this list as a CSV file.
System Notification: Added subscription type – "Monitor": Once a monitor becomes无效 (invalid), the system will send an email notification.

New Integrations¶

Added AWS SSM RunCommand integration;
Added AWS EBS integration;
Added AWS ECR integration;
Added AWS EFS integration;
Added TDengine monitor;
Added Milvus K8s view;
Updated Azure cloud billing: EA architecture support;
Rewrote OTEL jvm dashboard: Different metrics for 1._ and 2._ (java agent);
Huawei Cloud billing script update: Fixed billing anomalies caused by missing instance IDs;
SIEM templates launched (10 AWS templates);
Optimized AWS MemoryDB;
Optimized Tomcat monitor;
Optimized Tencent Cloud MySQL, supporting cloud disk edition (cloud disk) node dimension metrics, slow log collection;
Optimized Alibaba Cloud Oceanbase collector, supporting supplementary tenant data.

Bug Fixes¶

Fixed the issue of slow log queries recently;
Fixed the issue of inconsistent data performance for resource objects;
Fixed the issue where associated logs displayed as 0 in traces;
Fixed the error when clicking code hotspots after successful deployment;
Fixed the abnormal data display when scrolling to the bottom of the dashboard log stream graph;
Fixed the import error caused by setting identifier when importing dashboard JSON;
Fixed the incorrect jump location in the Resource Catalog official template library;
Fixed the issue where sensitive data scanning configuration did not take effect;
Fixed the issue where count_distinct query results were more than count query results;
Fixed the issue where trace details pages did not display data;
Fixed the issue where PromQL statements reported errors, but changing the query time interval did not cause errors;
Fixed the issue where the trace's service name was not displayed normally;
Fixed the issue where Picture charts could not be modified;
Fixed the issue where cloud billing could not be written in the production environment;
Fixed the abnormal display of service topology charts in dashboards;
Fixed the issue of site registration and activation failure;
Fixed the abnormal display of RUM funnel functionality;
Fixed the issue where imported dashboards might be missing from the dashboard list upon occurrence, requiring re-entering the page to display completely;
Fixed the misleading guidance on the interface access guide;
Fixed the 406 - kodo API exception reported during interface operations;
Fixed the issue where SourceMap file path, environment, and version were all correct, but source code could not be parsed;
Fixed the abnormal display of log index data;
Fixed the issue of adding APM guide pages on the page;
Fixed the issue where variable titles were displayed after sharing charts;
Fixed the issue where service context did not follow updates when clicking different services in the trace flame graph;
Fixed the abnormal data搜索 (search) for view variable fuzzy queries in dashboards;
Fixed the issue of Pipeline script save failures;
Fixed the issue where SEIM templates did not take effect after adding, but labels did;
Fixed the issue of topic 404 appearing in the Deployment Plan's nsqd logs;
Fixed the issue where the loading time could not be displayed normally in the popular page performance overview;
Fixed the issue where there was no view details button for .net profile data on the trace details page;
Fixed the occasional issue of the same DQL expression query not displaying data;
Fixed the unstable display of infrastructure dependencies in APM;
Fixed the issue where DQL subqueries did not take effect;
Fixed the platform page error after performing mute operations on events in the Event Center.

July 23, 2025¶

Feature Updates¶

Monitoring¶

SLO
- SLO deductions are executed at a "second" level frequency;
- Added display of event information corresponding to the monitor in SLI events;
- Details Page added an overview page, with related key metric charts dynamically统计 (counting) in conjunction with the time widget in the upper right corner.
- Added "SLO Correction" configuration. When SLO is about to be violated due to uncontrollable factors (e.g., infrastructure failure, third-party service interruption), avoid false alarms through temporary correction mechanisms while ensuring audit compliance of SLO data.
Alert Strategies
- Supports cloning alert strategies;
- When configuring notification rules based on members, added support for one-click copying of member notification configurations.

Event Center¶

The default refresh time for the explorer page's time widget is set to refresh every 30 seconds;
Alert notifications on the details page no longer display sending status.

Billing¶

Usage Statistics: Added "Backup Log Increment" display, used for counting the daily number of new backup logs;
Usage Analysis: The default entry query time adjusted to "Today".

Basic Components¶

For the Shortcut > Snapshot display page:
- Supports filtering based on type;
- Supports batch delete operations.
Explorer
- Search Bar:
  - Recent query display count adjusted to 10, save count adjusted to 50;
  - Supports pinning query conditions;
- Quick Filter > Space Filter Item: After configuring fields, the system automatically adds an index. Simultaneously, in the explorer search bar and chart query dropdown components, an icon identifier is added for these fields.
- Details Page: Extended fields added an icon identifier for fields already added to the display column, for differentiation.

Infrastructure¶

Database: Added SQL Server data collection type. The details page can view all Table related information, including columns, indexes, foreign keys.
Resource Catalog: Custom object explorer details page added "Complete Information" tab page.

Metrics¶

Metric Management: Added "Unique Value Count" display for labels,统计 (counting) the distinct count of label values globally or under a single metric dimension.

Pipelines¶

One-click Get Sample: Supports specifying data sources to obtain test data.

Scenarios > Leaderboard¶

External data source queries support sorting.

Management¶

Data Forwarding: Supports OR for multiple filter conditions;
Token: When changing Token, added configuration to adjust permission scope, supporting use only for reporting.
Sensitive Data Scanning: Custom rules support lookaround regex test matching.
Support Center > Ticket: Added upper limit for ticket description word count.

New Integrations¶

Added Huawei Cloud APIG integration;
Added Huawei Cloud SFS Turbo integration;
Optimized Alibaba Cloud ECS integration view;
Updated AWS SQS integration;
Tencent Cloud cloud product collection optimization, supporting multi-dimensional metric collection (Cloud Monitoring V2);
- EIP
- COS
- MySQL
- PostgreSQL
- MariaDB
- TDSQL-C MySQL
- TDSQL-C PostgreSQL
- Redis
- KeeWiDB
- MongoDB
- Memcached
Adjusted the content format of Huawei Cloud integration related documents.
Fixed the issue of Chinese text appearing in the console's Scene > Dashboards section;
Fixed the issue where some country names were displayed in Chinese in the console's Scene > Dashboards > Create > World Map;
Fixed the issue where if an Issue created by Issue auto-discovery was manually changed to closed or resolved status, generating a new Issue would restart the old Issue instead of creating a new one;
Fixed the abnormal display of the log explorer status distribution graph;
Fixed the issue where SESSION REPLAY displayed as expired;
Fixed the issue of no data after changing the display item to list mode in the Event Center;
Fixed the abnormal front-end display of event data;
Fixed the abnormal display of RUM explorer Resource data;
Fixed the error when querying forwarded data;
Fixed the abnormality in the Deployment Plan /api/v1/inner/alert_opt/get, /api/v1/account/list interfaces;
Fixed the issue where the trace-associated Pod monitoring view template was not updated;
Fixed the abnormal display of data access input data scope filtering;
Fixed the issue with the time range returned when slicing PromQL by 1d in time series chart > bar chart;
Fixed the issue where data existed for hourly intervals in PromQL queries but not for daily intervals;
Fixed the issue where the webpack plugin showed SourceMap file upload success, but it could not be viewed in the SourceMap list;
Fixed the issue where Incident > Issue auto-discovery generated duplicate Issues;
Fixed the issue where the Prometheus function idelta did not meet expectations;
Fixed the significant gap between log explorer query results and DQL query results under the same query conditions;
Fixed the issue where df_label was set in the monitor but had no value in generated events, causing user mute policies not to take effect;
Fixed the issue where the IP field in the Pipeline for user access did not take effect;
Fixed the error reported after upgrading the private environment kodo-x;
Fixed the issue where the trace details displayed "Top Span Missing", but the top span actually existed;
Fixed the issue where RUM > Application List could not query application data;
Fixed the issue where the paid plan and billing for the workspace could not see consumption details;
Fixed the issue where pressing enter while entering a snapshot name in Save Snapshot would save directly;
Fixed the issue of being charged for log monthly billing usage of 0;
Fixed the display judgment issue for src_ip and dst_ip;
Fixed the occasional incorrect display of the log explorer bar chart for the same time interval;
Fixed the usage issue of the Incident > search function;
Fixed the issue where the follow direction configuration was checked in Synthetic Tests tasks but did not take effect and was cleared upon re-editing;
Fixed the inconsistency between the log index query count over multiple days and TLS.

July 9, 2025¶

Feature Updates¶

Billing¶

Launched a new billing model: Enterprise Plan. This model uses a combination of data traffic + total storage volume for billing, more accurately aligning with actual resource consumption in scenarios with extremely high log write volumes, making users' cost structure more transparent and predictable. This mode provides optimized cost-effectiveness for handling massive observability data and is one of the foundational capabilities for building an "enterprise-level observability hub with full control".
- In Enterprise Plan workspaces, data storage policies support custom configuration; -如需 (If needed) to upgrade from the Free Plan to the Enterprise Plan, please contact your account manager.
Commercial Plan:
- Usage Statistics, Usage Analysis billing item names adjusted;
- Commercial Plan Time Series 180-day, 360-day prices adjusted.

Monitoring¶

Monitor > Threshold Detection: Detection metrics support querying external data sources;
Monitor List: Supports searching and locating based on monitor ID.

Event Center¶

Added Display Item: Supports switching between standard and list mode display.
Change Event > Details Page: Basic Attributes adjusted as follows:
- Change Content: Displays df_message content, recording detailed descriptions of resource changes;
- Difference Comparison: Displays diff content, recording the difference text of resource changes.

Scenarios > Charts¶

SLO Chart: Lock time added "This Year" dynamic time option;
Heatmap:
- Added "Metric" data source type query;
- Added Y-axis configuration, supporting Y-axis calculation based on data.

Infrastructure¶

Network > Overview
- Supports custom analysis dimensions: Displays aggregated query data by selecting source and target query fields;
- Supports cross-workspace network data queries.
Database:
- Added Oracle database integration;
- For PostgreSQL databases, all Table related information can be viewed, including columns, indexes, foreign keys.

Metrics¶

Generate Metrics: Supports different generation rules specifying the same metric name and tags;
Metric Management: Added multi-dimensional time series analysis at the measurement level.

Deployment Plan Updates¶

Workspace List > Index Configuration: Supports configuring data storage policies.

New Integrations¶

Added OpenLLMetry integration;
Added Undertow integration;
Added Cloudflare integration;
Added Huawei Cloud CDM integration;
Added Huawei Cloud DWS integration;
Added Huawei Cloud NAT integration;
Added AWS Transit Gateway integration;
Updated Volcengine ECS monitor, view;
Updated MinIO view, monitor;
Optimized integration Huawei Cloud ASM / CCE;
Optimized integration Alibaba Cloud SAE;
Optimized integration JMX / MQTT.

Bug Fixes¶

Fixed the 404 error when accessing SESSION REPLAY data in the SaaS environment via password-free login Token.
Fixed the issue where the Issue auto-discovery configuration content in RUM was not recognized.
Fixed the issue where event details in monitor拨测 (synthetic test) alerts did not display specific associated information.
Fixed the issue of提示 (prompting) for existing duplicate label names when modifying label names after adding labels in global tags.
Fixed the issue of abnormal DQL query return results.
Fixed the issue where PromQL queries for metrics failed, but DQL queries worked normally.
Fixed the混乱 (chaotic) display of Deployment > Pod information in multi-cluster scenarios.
Fixed the abnormal display of the log status distribution graph.
Fixed the issue where the RUM filter time range was inconsistent with the time selector, preventing application data from being viewed.
Fixed the issue where Issue auto-discovery template variables did not take effect in the RUM Error explorer.
Fixed the "Invalid address" error when adding Webhook notification objects.
Fixed the issue of data堆积 (piling up) in base forwarding.
Fixed the abnormal display of the log status distribution graph.
Fixed the issue of frequent false alerts caused by DQL query data being 0.
Fixed the issue where the base query tool could not sort, slimit was无效 (invalid), and could not paginate when querying logs.
Fixed the issue of time series queries returning time series不受 (unconstrained) by filter conditions and without any tags.

June 25, 2025¶

Breaking Changes¶

Extracted df_check_targets, df_check_condition, df_check_rules from the df_meta field of events to the same level. Subsequently, in webhook notifications, when df_source = monitor, information such as detection time, detection metrics, detection count, and detection rules from the monitor configuration will be displayed.

Feature Updates¶

External API¶

Added interface index_list_info to query workspace index information list;
Added interface update_index_setting to modify workspace index configuration.

External Data Sources¶

Added integration of PG, Oracle, Clickhouse三种 (three) external data source types to meet broader data scenario needs.

Logs¶

Added Native Direct Write Index type, allowing direct specification of the write index during data collection for precise classification and storage.

Monitoring¶

Range Detection V2 supports detecting APM, RUM data types;
Sudden Change Detection > Event Content: Added df_check_detail extension field, supporting outputting the original value compared for the sudden change into the event details.

Events¶

Alert events triggered based on monitor configuration rules support TOBY AI Intelligent Analysis.

Infrastructure > Database¶

Added PostgreSQL database integration;
For MySQL databases, all Table related information can be viewed, including columns, indexes, foreign keys.

Explorers¶

Search bar added Query History record display. Clicking allows direct reuse and flexible modification.

Cloud Account Management¶

Added support for Tencent Cloud, Azure account types.

Scenarios¶

Adjusted the Import Dashboard entry point,整合 (integrated) the original custom template import function, and simultaneously supports batch import of dashboards.
Dashboard page added "Log Analysis" function. No need to jump pages, directly view and analyze related log data with one click in the side-sliding new page.

Incident¶

The "Incident" menu item on the left side of the console added an "Incident Management" entry, allowing direct jump to the management page.

New Integrations¶

Added Volcengine NAT integration;
Added Ceph integration;
Updated Clickhouse integration;
Huawei Cloud cloud billing script optimization;
Added Tencent Cloud billing;
Added Tencent Cloud WAF integration;
Added Tencent Cloud ES integration;
Added Tencent Cloud cos/cdb/mariadb/postgresql English version views, monitors;
Added AWS Firehose;
Added AWS VPC NAT Gateway integration documentation;
AWS cloud billing script update: T+1 calculation method caused billing errors for some components (like EC2), adjusted to T-2;
Added Azure cloud billing.

Bug Fixes¶

Fixed the abnormal data display after generating metrics;
Fixed the issue where log content could not be loaded after clicking "Load More" on the log details page;
Fixed the issue where the RUM开通 (activation) link was invalid and had no pricing content;
Fixed the issue where clicking associated events in Issues跳转 (jumped) but no data could be queried;
Fixed the 406 error when creating Infrastructure Liveness Detection v2 type monitors;
Fixed the slow loading of the SESSION REPLAY page;
Fixed the issue where Open API creating mute rules did not automatically generate rule names;
Fixed the error when inputting PromQL to query metrics;
Fixed the abnormal display of page error rates;
Fixed the issue of host tags frequently disappearing;
Fixed the issue where descending order had no effect after adding search conditions to the resource invocation leaderboard;
Fixed the issue where after checking "7-day免 (free) MFA login", if MFA was unbound and logged out and logged back in, the system did not prompt for re-binding;
Fixed the issue where aliases being empty in exported CSV files from dashboards caused incorrect rendering;
Fixed the issue where monitors did not generate alerts normally, and self-observation logs reported query timeout errors;
Fixed the issue where imported fields were automatically deleted in the background management;
Fixed the issue of user experience data loss.

June 11, 2025¶

Feature Updates¶

Billing¶

Added statistical items: Trace Write Traffic, RUM Write Traffic, SIEM Scan Volume; Usage Analysis synchronously displays the newly added statistical item data.

Scenarios¶

Dashboard > AI Intelligent Analysis: Added support for automatic error discovery and error analysis, further enhancing TOBY AI data processing capabilities.

Monitors¶

Detection frequency supports shortest custom input of 20s, system newly supports selecting 30s;
APM Metric Detection, RUM Metric Detection respectively support multiple selection of services, applications;

SIEM¶

Official Detection Library launched: The system provides out-of-the-box security information detection template libraries.

Infrastructure > Database¶

Supports cross-workspace data viewing;
Added fields: QPS, TPS, Average Query Time, Slow Query Log Status, Slow Query Count.

Metrics > Metric Analysis¶

Added Independent Chart mode, suitable for scenarios where multiple queries are added simultaneously and the query result units are inconsistent;
Added support for displaying grouped total statistics, and the default slimit was changed to 50.

Logs > Explorer¶

Added line break switch under Stack Mode;
Context logs support clicking the time column for ascending/descending sorting.

Cloud Account Management¶

Cloud Account types added support for Huawei Cloud.

Management > Environment Variables¶

RUM Android/iOS SDK supports dynamic updates through Environment Variables.

Query Tools¶

Table charts and metric analysis simple queries both support selecting multiple columns;
DQL quick query defaults to simple mode, supporting multi-column configuration queries.

APM¶

ddtrace added package level埋点 (instrumentation) configuration. If需要对 (need to instrument) all methods under packages com.zy and javax.servlet, configure as follows: -Ddd.trace.method.packages=com.zy,javax.servlet.

Deployment Plan Updates¶

Mapping Rules added an "Append Mapping" switch. When enabled, accounts using single sign-on will be assigned workspaces and roles according to mapping rules, while the original workspaces and roles remain unchanged.
For workspaces using the ScopeDB engine, supports configuring tenant-level queries.

New Integrations¶

Optimized Tencent Cloud billing script, supporting获取 (obtaining) billing information through sub-account methods;
Added Tencent Cloud billing integration;
Added Tencent Cloud EIP integration documentation;
Added Tencent Cloud CDB monitor (English);
Added Huawei Cloud cloud billing integration;
AWS ELB integration content updated;
AWS LAMBDA integration content updated;
AWS S3 integration content updated;
Added AWS Aurora MySQL integration;
Added AWS Aurora PostgreSQL integration;
Added Hikaricp integration;
TiDB Cloud view optimization;
Added vpc integration;
Added AWS rds postgresql integration.

Bug Fixes¶

Fixed the issue where userid was not displayed in the Singapore site user space resource explorer;
Fixed the issue where custom reported userid could not be queried through the action explorer;
Fixed the inaccuracy of dashboard AI analysis results;
Fixed the issue with Open API获取 (obtaining) time series trend charts;
Fixed the delayed display of data gap content on the monitor modification page;
Fixed the issue of skipping existing files when uploading SourceMap using webpack plugin;
Fixed the error in quick filters under the network function;
Fixed the issue where filters through variables could not run normally;
Fixed the high-risk vulnerability in penetration testing;
Fixed the dashboard error in the resource analysis section of the Singapore site user analysis dashboard;
Fixed the issue where panel link jump value variables were undefined;
Fixed the issue of no time selection box in the upper right corner of the log explorer;
Fixed the discrepancy between the preview chart data display and the actual data in the monitor (APM);
Fixed the internal display issue regarding DingTalk and WeChat in cross-workspace authorization emails;
Fixed the inconsistency between the SSO user list and user details in the management console;
Fixed the display issue of external database data source queries;
Fixed the display issue of trend charts when creating new threshold monitors;
Fixed the search failure when viewing services in APM;
Fixed the DQL query error;
Fixed the issue where daily repeating mute rules did not send mute生效 (effective) notifications daily as expected;
Fixed the issue where the AI analysis button was not visible after entering traces from RUM SESSION REPLAY.

May 28, 2025¶

Open API Updates¶

Incident supports returning associated event count information when listing and getting.

Feature Updates¶

SIEM¶

Detection Rules: Added test, full-screen edit script functions;
Added Signals explorer;
Added Execution Logs explorer.

Monitoring¶

Alert Strategies > Association: Added selection of SIEM detection rules,同步 (simultaneously) supports direct creation.
Editing monitor rules > Detection metrics newly supports PromQL query preview.
Monitor Rules list:
- Importing newly supports "Delete and import monitors with the same name" on the operation page;
- Supports one-click export of all monitor rule configurations in the current workspace.
Intelligent Inspection function entry discontinued.

Infrastructure¶

Containers: Added Persistent Volume Claims Explorer.
Added Database Explorer, providing a centralized explorer tool for real-time monitoring of MySQL database performance metrics, resource usage, and log records.
Resource Catalog: Resource classification added database, and displays the total number of all databases.

Incident¶

Channel > Issue Details Page: Added "Associated Events", allowing direct click to jump to the event list for viewing; Issue emails and other sent notification events同步 (simultaneously) added associated event display;
Notification Policy > Issue Escalation: Added event storm option. Can set to send "repeat" or "once" notification reminders after the number of events associated with an Issue accumulates超过 (exceeds) a specific number.

Events¶

Unrecovered Events: - Added "Mute" button. Clicking allows direct "Mute" configuration of the rule on the current page. - Added "Recover All" button. Clicking recovers all abnormal events in the current list, with an option to associate Issues.

APM¶

Flame Graph: Added "Locate to Current Span" function button.

RUM¶

WEB SDK added client timezone recording.
SESSION REPLAY viewing page added client timezone display.
All time widgets uniformly added timezone display.

Scenarios¶

Dashboard > TOBY AI Intelligent Analysis:
- Optimized page display effect;
- Optimized problem output.
Charts
- Time Series Chart: Added hint: Query has exceeded the maximum number of time series chart data points, only displaying 1,000 data points;
- Bar chart mouse hover color adjustment;
- Table chart order adjustment optimization: Compatible with PromQL queries.

Metrics¶

Metric Analysis: Added query history and unit configuration.

Management¶

Sensitive Data Masking: Supports configuring masking for multiple fields with one rule.
Data Access: Edit page added access site selection.

Explorers > Quick Filter¶

All Explorers:
- In Edit Mode, supports modifying "Filter Fields" and "Optional Fields";
- Added hide field alias function;
- When searching fields, if the query results have no精确 (precise) matching values, can directly create and add to "Filter Fields".
Log Explorer:
- Two Viewing Modes display adjustment, added "Global Configuration" under "Stack Mode";
- Display Item Configuration adjustment.

Registration¶

Login registration page display optimization.

Deployment Plan Updates¶

Configuration Management > Issue Discovery: Rule check frequency newly supports 1 minute.

New Integrations¶

Added TiDB Cloud integration documentation;
Added Traefik integration documentation;
Added AWS cognito integration;
Added AWS certificatemanager integration;
Added AWS RDS PostgreSQL integration documentation;
Added aliyun rabbitmq integration;
Updated haproxy views and monitors;
Added Huawei Cloud DIS English monitors, views;
Updated AWS ELB application integration documentation, views, added AWS ELB application monitor;
Updated AWS lambda integration documentation, added Lambda fetching S3 log data operation steps.

Bug Fixes¶

Fixed the issue where generated metric data was not reported normally.
Fixed the issue of tag import failure when calling the Open API import monitor interface.
Fixed the issue of拨测 (synthetic test) tasks not stopping.
Fixed the 406 error when clicking to view "Context Logs" in log details.
Fixed the cache issue where alertPolicyMemberInfos displayed existing members in the code when only notification objects were configured in the monitor without configuring members.
Fixed the issue where saving was not生效 (effective) after selecting to treat results as 0 for data gaps in monitors.
Fixed the failure and error when批量 (batch) recovering alerts.
Fixed the inconsistency in log explorer query result counts.
Fixed the issue where原有 (original) data was overwritten because extend, rule fields were not configured when modifying monitors in bulk via API.
Fixed the issue where built-in view templates were not correctly replaced after importing in the background management.
Fixed the issue where after one-click获取 (obtaining) key fields in log index configuration, the log explorer stack mode display was not linked to the key fields, but displayed according to the display items.
Fixed the critical level error in monitor execution logs.
Fixed the issue where DQL subqueries did not take effect.
Fixed the issue where commas in variable values were not escaped when clicking leaderboard views and selecting to apply to view variables, leading to incorrect condition filling.

May 14, 2025¶

Brand LOGO Change¶

TrueWatch innovates its visual image, demonstrating its iterative belief and technological strength in the AI wave.

From this moment on, Obsy will accompany you to洞察 (observe) the data world,驾驭 (navigate) system complexity, and stay at the forefront of the AI era.

External API¶

Dashboards: Supports globally importing platform-level dashboards via identifier ID. This operation only updates the dashboard configuration and does not affect the binding relationship of this view in each workspace.

Feature Updates¶

Security Monitoring¶

Added SIEM function module: Real-time analysis of logs and event data from various enterprise systems (such as servers, applications, network devices), automatically discovering potential threats, helping teams quickly locate anomalies, and fully leveraging the role of a security monitoring hub.

Monitoring¶

Alert Strategies:
- Association: Supports selecting SIEM detection rules;
- Notification Configuration: Added "Security Monitoring" type level.
Monitors: Due to adjustments in the data writing of the "Infrastructure Change Detection Monitor", old monitors need to be re-saved to avoid affecting the display of generated events.

Event Center¶

The "Events" function module was renamed "Event Center", and the interaction page was optimized.
Added Event Center explorer, supporting centralized viewing of all event data.
Event recovery added secondary confirmation operation to avoid accidental triggering scenarios.

Incident¶

After adding schedules in Incident > Calendar, when creating new Issues or associating responsible persons, you can choose "On-duty Personnel" or "Notification Objects". The system will automatically assign Issue responsible persons and notify based on the on-duty personnel of the day.

Scenarios¶

Dashboard: Added TOBY AI Intelligent Analysis function.
Time widget logic optimization: When selecting "Relative Time", even if the user sets the refresh frequency to "off", as long as the query conditions are modified (such as adding or decreasing conditions using quick filters in the explorer, adjusting filter conditions in the search box, or switching view variables in the dashboard/notes), the system will still re-trigger the query.

Management¶

Data Forwarding: For the three archive types AWS S3, Huawei Cloud OBS, Alibaba Cloud OSS, added Encrypted Storage choice switch. When enabled, the system encrypts data forwarded outward.
Audit Events: Added workspace field marking.

Infrastructure¶

Built-in pages for Host, Container, Pod, etc. details:
- Time Widget: Added Pin function;
- Integration Operation Status: "View Monitoring View" page optimization;
- Associated views added display of the timeline when the current event occurred.
Host Explorer: Default query time adjusted to "Last 2 hours".

Logs¶

Optimized log multi-index matching hit logic, avoiding computational waste caused by逐条 (piece-by-piece) matching of index rules.

Deployment Plan Updates¶

Supports creating, deleting, and modifying groups via External API, and adding or removing users in groups;
Workspace Management > Data Storage Policy: Added network storage policy configuration, supporting selection of fixed 2-day storage duration or custom保存 (save) duration.
Added Profile data reporting dynamic parameter switch. Users can dynamically enable or disable Profile data reporting based on platform performance.
Added API Key configuration and AI function access link configuration switches, including the following scenarios:
- Monitor > Alert Strategies > AI Alert Aggregation
- AI Write Pipeline entry
- Scenarios > Chart Components > AI Chart Title and Description Generation
- Log Explorer > Log details with error status, Logs > Error Tracking > AI Error Analysis entry
- RUM > Error Explorer > AI Error Analysis entry
- APM > Trace Explorer > Trace details with error status, APM > Error Tracking > Trace Details > AI Error Analysis entry
When editing alert strategies, supports custom repeat alert time. Custom input mute time format example: 20m (20 minutes), 2h (2 hours), 1d (1 day).

New Integrations¶

Added host-class monitors;
Added MySQL monitors;
Updated CouchDB views and monitors;
Added ActiveMQ integration;
Added AWS SNS integration;
Added Volcengine ESCloud integration;
Added English version Huawei Cloud API, Huawei Cloud CCE monitors and dashboards;
Added Volcengine RabbitMQ integration;
Modified AWS MSK integration metrics.

Bug Fixes¶

Fixed the 413 error when uploading SourceMap via Vite packaging, and the SourceMap download error and TrueWatch inability to display source code error locations.
Fixed the issue where RUM data from multiple workspaces could not be displayed normally during cross-workspace queries.
Fixed the inaccurate display of namespace and service data after selecting self-built log indices in the log explorer.
Fixed the messy page style when creating multi-step拨测 (synthetic tests).
Fixed the issue where the quick filter column could not normally display namespace label data under multi-index conditions in the log explorer.
Fixed the issue of false alerts on the Guangzhou site.
Fixed the exception when viewing host details using hosted Doris in version 0409.
Fixed the abnormal query of external data source data.
Fixed the ghosting display when expanding single logs in clustering mode.
Fixed the issue where recovered events were still displayed on the event statistics page.
Fixed the error triggered by clicking the "Batch" button in the list display mode of unrecovered events.
Fixed the issue where historical logs on S3 could not be queried using the "Data Forwarding" function.
Fixed the issue where FUNC alert message logs in version 1.109.196 Volcengine base were reported to the business workspace.

April 23, 2025¶

Breaking Change¶

拨测 (Synthetic Test) Data Storage Adjustment: Separated拨测 data from the original log index, independently built table storage, and added专属 (dedicated) query Namespace D. This adjustment does not affect historical拨测 data. If you previously queried拨测 data through custom charts, please update the query configuration promptly. Official拨测 templates (such as HTTP, ICMP, TCP, WebSocket, Multi-step拨测) and related monitors and metric rules have been adapted to this change.

External API¶

Supports新增 (adding), modifying, listing specified workspace role lists, member lists interfaces;
Optimized interface names and description information in OpenAP, External API.

Feature Updates¶

RUM¶

SDK supports hot updates through Environment Variables: Achieve dynamic configuration updates by predefining variable parameters and introducing variables through environment variables within the application.
Application > New Application: User-defined parameter configuration, the left-side code example updates in real-time, the system caches the latest parameter configuration, no need to re-enter each time.
Error Explorer: Added support for TOBY AI Error Analysis. Intelligently parses single RUM error logs, automatically extracts key information, and obtains preliminary solutions and suggestions through integrated online search.

Infrastructure¶

Cross-Workspace Authorization: If authorized workspaces exist and the authorized data type is "Basic Object", you can directly switch workspaces on the explorer pages of various object types in Infrastructure to achieve cross-workspace viewing of object data.
Added "Change Event" tab page, supporting display of change details based on five object type data: Deployments, Daemonsets, Services, Cron Jobs, Statefulsets, facilitating users to review change records.

Monitoring¶

Monitor > Detection Rules: Added "Infrastructure Change Detection". By continuously monitoring Kubernetes resource configuration changes (such as YAML file modifications), combined with version tracking and intelligent analysis, achieves compliance checks, fault root cause location, and resource usage optimization effects, ultimately ensuring cluster security, stability, and resource efficiency.
Detection Rules > Event Content > Custom Event Notification Template: Added time automatic conversion Template Function {{ df_fault_duration | to_date_range_human }}.

Events¶

Added Change Events:
- View all event data records triggered based on Infrastructure Change Detection rules.
- All Event Details > History Trend: When the detection object has change events, the time series chart displays the time nodes of the change events and supports clicking to jump to the change details page.
Event Explorer:
- Added "Only Show Unassociated Issue Button", clicking quickly filters out associated events;
- Added "Display Item": Supports display preference switching (including list, standard, extended三种 (three) ways);

Management¶

Data Forwarding > Data Viewing: Search Component Optimization.

Chart Export¶

Charts support exporting to newly created dashboards or newly created notes synchronously. The application scope includes: 1. Metric Analysis 2. Explorer > List/Dimension Analysis

Explorers¶

Adjusted the interaction for basic "List" viewing and "Dimension Analysis" chart modes;
Dimension Analysis: Added grouped table charts.

Integration¶

In the left menu of the console, the access path for the "Cloud Account Management" function has been adjusted from the original Management interface to the Integration directory.

Deployment Plan Updates¶

Supports adjusting the order of Login Methods (local account, LDAP account, OIDC).

New Integrations¶

Added apollo;
Updated Argocd integration documentation, adjusted to kubernetesprometheus for collecting metric information;
Updated ingress nginx documentation views monitors;
Neo4j updated dashboard&added monitors;
Added kubelet integration;
Added Azure Virtual Network Gateway integration;
Updated TIDB integration documentation, views and monitors;
Added Automata management for 30 Alibaba Cloud components.

Bug Fixes¶

Fixed the issue of incorrect member count display on the member management page.
Fixed the issue where the log view time field was not translated after switching to the English interface.
Fixed the abnormal synchronized display of labels after switching clusters.
Fixed the issue where卡顿 (stutter) counts appeared on the RUM > Analysis Dashboard > Mobile > Error Analysis page when the mobile SDK was not integrated, affecting user count display.
Fixed the timing judgment issue in the Log Explorer > Details page.

April 9, 2025¶

Open API Updates¶

Supports creating, editing, deleting multi-step拨测 (synthetic test) tasks;
Supports configuring the upper limit on the number of workspaces.

Feature Updates¶

Scenarios¶

Chart Optimization
- Bar Chart:
  - Adjusted Alias position, supports listing all metrics and groups;
  - Added X-axis configuration item.
- Grouped Table Chart:
  - Supports sorting based on group selection;
  - Added 200 option in the return count dropdown, and the maximum number supported for manual input adjusted to 1,000.
- Time Series Chart > Line Chart: Added line "Style" settings, including linear, smooth, step-before, step-after.
Snapshots: Added permission prompts for Dashboard Snapshot sharing with configured permissions.
Explorer, Dashboard > Time Widget: Added "Last 1 minute", "Last 5 minutes", defaulting to selecting the latter.

Management¶

Cross-Workspace Authorization: Supports cross-site data authorization, enabling extended data sharing.
Data Forwarding:
- Data types added "Audit Events".
- Adjusted the query time logic of the explorer:
  - Changed to query by day, does not support cross-day queries;
  - When viewing forwarded data, the system automatically queries and continuously loads until fully displayed, no need for user manual clicks;
  - Management > Workspace Settings > Advanced Settings: Added "Data Forwarding Query Duration" configuration.
Data Access, Pipeline, Blacklist permissions split, adjusted "Management" permission to: "Create, Edit" and "Delete".

Monitoring¶

System Notification: Added jump link for associated logs, allowing跳转 (jump) to the log explorer and filtering out logs where notification objects failed to send.
Monitors:
- Create from Template > Official Template Library: Added search function;
- Configuration Page > Event Content: Updated attention prompt. The @ member configuration only takes effect and sends the event content here to specified members when关联 (associated) incident tracking is enabled.
- Threshold Detection: Added Recovery Condition switch, configuring recovery conditions and severity. When the query result has multiple values, any value meeting the trigger condition generates a recovery event.

Incident¶

The "Source" in Issue email notifications was changed to a hyperlink. Users can click to access directly.

RUM¶

SourceMap: - Page interaction adjusted, changed from pop-up to separate page; - List page added search, export functions.

TOBY AI Agent¶

Optimized Generate Chart function: Caches metric management data locally through Func, making the generated DQL closer to the semantic description.

TOBY AI Error Analysis ¶

Added context support for root cause analysis, helping users understand the context of errors faster and more comprehensively, improving diagnostic efficiency.

Integration > Extensions¶

DataFlux Func Hosted Edition/ RUM Headless: Application billing added email reminders and system notifications.

Infrastructure¶

Host > Details Page: Disk capacity statistics distinguish between local disks and remote disks for display.

Deployment Plan Updates¶

Template Management: - Page interaction optimization, including added display column "Template Type", etc.; - Added "Template Type" to the top filter options; - Supports batch exporting templates; - When importing templates, supports previewing template details; - Built-in views, Pipeline, monitor template uploads support同名 (same name) overwrite logic.

New Integrations¶

Added GCP Compute Engine;
Added Azure Storage;
Added Azure redis cache;
Added Azure kubernetes;
Added Azure Postgresql;
Added Alibaba Cloud Rds MYSQL Automata integration;
Added Druid integration;
Updated Trino;
Adjusted AWS/Alibaba Cloud integration documentation regarding Automata: Added Hosted Edition Activation Script steps.

Bug Fixes¶

Fixed the discrepancy between unrecovered events obtained via Open API and the actual situation.
Fixed the error when searching in the event explorer.
Fixed the abnormal query of external data source data.
Fixed the related issues with incident email notifications.
Fixed the slow loading of Incident > Analysis Dashboard.
Fixed the incorrect bar chart color display.
Fixed the issue of no AK prompt for external events.
Fixed the issue where status distribution graphs and log volume were not displayed correctly.

March 26, 2025¶

Feature Updates¶

Events¶

Unrecovered Events: Time widget defaults to auto-refresh. Manual event recovery adds front-end page prompts after successful recovery.
Event Details: Alert notification page display optimization.
Event and intelligent monitoring explorer exports appended "Notified or not" display.

Management¶

Data Forwarding: Added permission configuration. By setting viewing permissions for forwarded data, data security is effectively improved.

Monitoring¶

Infrastructure Liveness Detection V2: Added configurable detection interval.
Alert Strategies: Notification matching logic adjusted to improve execution efficiency in scenarios where events hit multiple policies and complex alert policies.
Notification Object Management: Added Slack and Teams two notification objects to meet the needs of more global users.

Scenarios¶

View Variables: Supports external data source queries.
Charts:
- Added "Monitor Overview" chart, integrating the monitor list, displaying the latest status, achieving instant monitoring and anomaly situation awareness.
- Command Palette: Display optimization;
- Chart Query: In DQL queries, when using "wildcard" or "regex", added query suggestion prompts.
Explorer, Dashboard > Time Widget: Added "Last 1 minute" and "Last 5 minutes" options.

Billing¶

Added Monthly Bill module, intuitively displaying monthly total consumption.
Added export bill function.

RUM¶

Application List > New Application: Added parameter configurations for "Compressed Upload" and "Custom Hosted Address".

Synthetic Tests¶

Added "South Africa" and "Hong Kong, China" as拨测 (synthetic test) nodes, further expanding global coverage.

Logs¶

Log Explorer
- Quick filter operation items adjusted;
- List tokenization logic optimized;
- JSON format data added "JSON Search";
Index > Key Fields: Added "One-Click Get".

New Integrations¶

Added Azure Network Interfaces;
Added Azure Kubernetes;
Added Azure virtual network gateway;
Improved English integration translations.

Bug Fixes¶

Fixed the low utilization rate of the log page display.
Fixed the metric unit display issue in Service Map.
Fixed the issue where multiple columns in table charts could not select units.
Fixed the error when exporting more than 1,000 items from Dashboard > Log Stream Graph to CSV.
Fixed the inconsistency between the P75 of the most popular pages and DQL query results.
Fixed the issue where the time box still showed today after clicking the << button in the time filter.
Fixed the issue where menu management did not meet expectations.
Fixed the abnormal workspace ID search filtering in the management console.
Fixed the loss of test samples in the Pipeline interface.
Fixed the excessive time consumption of the configuration migration export function.
Fixed the issue of大量 (a large number of) empty items in the quick filter labels on the event details interface after upgrade.
Fixed the issue where the detection library list was duplicated in the monitor official template library, and once a detection library was selected, other monitors could not be searched.

March 12, 2025¶

Breaking Changes¶

Event df_alert_info field definition adjusted. Added explanation for unmatched alert policy reasons. Filtering based on isIgnored is still required to obtain the actual notification objects sent externally.

Feature Updates¶

Incident¶

Added an Incident Management entry. Through this entry, the currently logged-in user can view and manage the incident status of all joined workspaces.
Optimized the display of the channel list on the incident page, improving query efficiency when there are too many channels.

Management¶

Cloud Account Management: Added Alibaba Cloud cloud account authorization type.
API Key Management: Added permission control for API Keys, supporting role authorization. Through role authorization, API Keys only have operation permissions within the role scope, effectively reducing security risks.
Data Forwarding: Default interaction changed to not select rules.

TOBY AI Error Analysis¶

The following details pages added TOBY AI Error Analysis capability: - error logs - APM > Trace/Error Tracking

Scenarios¶

Scheduled Reports:
- Added Webhook sending as a notification method;
- Supports sharing dashboard images to WeCom/DingTalk.
Time Series Chart: After selecting area chart as the chart type, added Stack Mode style,便于 (facilitating) observing the cumulative effect of overall data.

APM¶

Trace: Supports batch exporting JSONL format from the list.

RUM¶

User Insight > Funnel Analysis: Supports SESSION REPLAY functionality for the queried Session list.

Logs¶

Explorer:
- Log Explorer > Index quick filter display effect optimization in the search bar;
- Log Details > Extended Fields: Added "Perform Dimension Analysis" mode;
Index: Supports setting dedicated Key Fields under the index dimension.

The left side selects the time range and the right side refresh frequency are independent of each other. Only two situations affect the refresh frequency: - The selected time range exceeds 1h - The selected time is absolute time

Infrastructure¶

Hosts: Explorer supports adjusting the time range.

Pipeline¶

Configuration page display optimization;
Pipeline processing types added "Event";
Test samples support obtaining JSON format.
Filter Conditions > Synthetic Tests: Supports selecting multi-step拨测.

Deployment Plan Updates¶

Template Management: Supports uploading all explorer templates.

New Integrations¶

Added azure_load_balancer;
Rewrote K8S server api;
Updated Gitlab CI;
Translated Volcengine related views;
Translated AWS related views.

Bug Fixes¶

Fixed the unresponsiveness when exporting log stream graphs to CSV.
Fixed the issue where when the view variable was the runtime-id field for JVM metrics collected by ddtrace, the time series chart had no data after adding relevant filters.
Fixed the display issue of the custom gradient interval color scale interface.
Fixed the issue where after saving with filter condition >0 in DQL query editing in time series charts, it showed empty upon re-editing.
Fixed the abnormal display of APM > Infrastructure table charts.
Fixed the issue where the前台 (front-end) forwarding rule did not support it after setting the data forwarding storage duration to 1,800 days in the management console.
Fixed the error "kodo service API request error: Service Unavailable" when executing show_object_field(HOST) in quick queries.
Fixed the bugs existing in the shortcuts.
Fixed the issue where there was no data for session and view in RUM, while other resource and action等 (etc.) had data.
Fixed the issue where required fields were immediately validated when creating request steps in multi-step拨测.
Fixed the issue where filter conditions did not take effect when setting role authorization in data access.

February 27, 2025¶

Open API Updates¶

Metrics: Added Measurement and Tag Information Acquisition.

Feature Updates¶

Synthetic Tests¶

HTTP拨测 (Synthetic Test): Supports Script Mode. By writing Pipeline scripts, flexibly customize the judgment conditions and data processing logic of拨测 tasks.
Added Multi-step拨测: Allows creating tests using response data from multiple API connections, passing values through local variables, and linking multiple task requests.

Scenarios¶

Dashboard > Visibility: Added "Custom" configuration, allowing configuration of "Operation" and "View" permissions for this dashboard. Simultaneously, added "All Members" option under this configuration.
Charts:
- Added ability to automatically generate chart titles and descriptions based on AI;
- Log Stream Graph added "Rule Mapping" function;
- Table chart display column optimization;
- Grouped Table Chart: Expression results support sorting;
- Time series charts, pie charts, and multiple other tables support exporting data as CSV files.

Metrics¶

Metric Analysis > Table Chart: When query results exceed 2,000条 (items), the three modes added "Query Result Count" display.
Metric Management: Supports one-click jump to metric analysis.
Generate Metrics: Supports import creation method, supports batch export.

Infrastructure¶

Container/ Pod Explorer: Object data added 4 new fields: cpu_usage_by_limit, cpu_usage_by_request, mem_used_percent_base_limit, mem_used_percent_base_request.

APM¶

Profiling > Flame Graph interaction optimization: Selecting a single search method name allows direct focus and positioning.
ServiceMap interaction optimization: In the upstream/downstream pages, supports searching for nodes in the current canvas.

New Integrations¶

Added AWS Cloud Billing;
Added Kube Scheduler;
Added MQTT;
Rewrote APISIX;
Updated tidb English documentation and views;
Updated Zookeeper views, supplemented integration icons;
Fixed English translations for some component mainfest.yaml.

Bug Fixes¶

Fixed the error displayed when clicking APM > Trace Details tab pages;
Fixed the error in @member in Incident > Issue replies;
Fixed the incorrect temperature unit in charts.

February 19, 2025¶

Breaking Changes¶

The df_meta within events will no longer retain alert_info related information records. Users who previously relied on this information to obtain notification objects should switch to using the newly added df_alert_info (event alert notification), df_is_silent (whether muted), df_sent_target_types (event notification object types) 3 fields to complete the corresponding functionality.

Functionality scenarios that may be affected:

Custom usage scenarios where events are obtained via Open API to connect to external systems
Custom usage scenarios where events are forwarded to external systems via Webhook notification objects

Feature Updates¶

PromQL Query¶

Added query type: Instant Query, which queries for a single point in time.

Monitoring¶

Monitor configuration page: 1. Added not between option in the logical matching of trigger conditions; 2. Supports directly modifying the monitor status ("Enable" or "Disable").

APM¶

Trace: Details page added Service Context tab page.

Events¶

Event Details Page: Added support for binding Built-in Views;

Incident¶

Issue added working, closed statuses;
For open status停留 (stay) timeout and situations where no responsible person is assigned and processing timeout, Issue escalation added repeat notification configuration;
Adjusted the UI display of Issue system comments and channel notifications;
Analysis Dashboard: Added time widget.

Scenarios¶

Chart Link: Added "View Host Monitoring View", default off.
Explorer: Supports deleting fixed name column, users can customize list display.
Cloud Billing Analysis View: Supports viewing billing details.

Management¶

Role Management: SESSION REPLAY Viewing, Audit Events added custom add view permission capability.

Metrics¶

Generate Metrics: Metric name input no longer supports using - hyphen.

Integration¶

Integration cards added description information.

Deployment Plan Updates¶

Template Management: Supports uploading infrastructure explorer templates;
Index Configuration: Deprecated "Backup Logs" item; Can configure corresponding storage policies at "Edit Workspace > Data Storage Policy > Data Forwarding-Default Storage".

New Integrations¶

Added Milvus;
Added Volcengine Public IP;
Added opentelemetry-python;
Added openLIT Integration;
Updated k8s\es\mongodb\rabbitmq\oracle\coredns\sqlserver Chinese/English monitors&views.

Bug Fixes¶

Fixed the issue where special characters in AI aggregation notification messages caused abnormal results;
Fixed the Deployment Plan adaptation issue for Servicemap;
Fixed the issue where combined charts could not configure already hidden view variables;
Fixed the disordered display of the "Unrecovered Issue List" in Incident > Analysis Dashboard;
Fixed the issue where the P75 results of the most popular pages in RUM analysis dashboard were inconsistent with DQL query results;
Fixed the abnormal search box in RUM > Explorer;
Fixed the issue where in Scenarios > Object Mapping, using the resource catalog for field mapping, only部分 (part) of the same field in the dashboard took effect;
Fixed the UI display issue in Monitor > Event Content;
Fixed the issue where quick filter results for unrecovered events in the event explorer did not meet expectations.

January 16, 2025¶

Feature Updates¶

RUM¶

Added Funnel Analysis function: Users can create funnels by defining conversion steps, view data transformation and conduct in-depth analysis;
User Insight module integration: Added User Insight module, integrating heatmaps and funnel analysis within this module, providing more comprehensive user behavior analysis tools;
Added mobile SourceMap restoration: Android and iOS applications support uploading SourceMap files on the page and viewing restored data in the error explorer.

APM¶

When adding services in APM, added installation guidance for Host Auto-injection, simplifying the installation process.

Integration¶

DataKit (Data Collection Tool): DataKit installation page added Docker method installation guidance, providing more diverse installation options;
External Data Source Optimization: When querying SLS data sources, added query specification prompts to help users perform data queries more accurately.

Scenarios¶

Combined Chart optimization: Combined charts added view variable configuration, supporting selecting view variables from the current dashboard to apply to this combined chart, helping with more flexible filtering and data analysis.

Monitoring¶

Sudden Change Detection Monitor: Added support for week-over-week and month-over-week comparisons of query cycles.

TOBY AI Agent¶

Added DataFlux Func related knowledge base.

Pipeline¶

Auto-generate Pipeline optimization: Supports交互 (interacting) to obtain Pipeline parsing simultaneously in structured plus natural language ways.

Bug Fixes¶

Fixed the display issue in log stack mode;
Fixed the misalignment of the function input box in the log detection monitor;
Fixed the error in metric operations;
Fixed the issue where Volcengine did not support having statements;
Fixed the error when selecting "Request Error Rate" and "Average Requests Per Second" two metrics in APM metric detection;
Fixed the issue where the not in statement did not take effect in the Volcengine base;
Fixed the issue where excessively large data returned by the event list affected page loading speed;
Fixed the issue where one-click recovery of events on the Hangzhou site did not meet expectations.

January 8, 2025¶

Open API Updates¶

Field Management: Supports obtaining field management list, supports adding/modifying/deleting field management.
Synthetic Tests: Supports modifying拨测 tasks.
Incident > Schedule: Supports obtaining schedule list, supports creating new/modifying/deleting schedules.
Incident > Configuration Management: Supports obtaining notification policy list, supports adding/modifying/deleting notification policies; supports obtaining Issue discovery list, supports creating new/modifying/enabling/disabling/deleting Issue discovery configuration.

Feature Updates¶

Logs¶

Log Index Optimization:
- When accessing built-in log views and log context tab pages, the current log's index and the default index are selected by default respectively. Both tab pages support multiple selection of indices. Additionally, when cross-workspace query is enabled and authorized workspaces are selected in the所属 (belonging) menu, supports directly querying the index data of the corresponding workspaces here. Ultimately helps users completely view associated log data on one page, optimizing log query interaction.
- When listing log indices, besides default being displayed at the top, the remaining log indices are listed in A-Z order.
Log Explorer added stack viewing mode: In stack mode, fields will be integrated into the same column, and these fields are presented in rows within the cell. The display of log information is more compact and clear,方便 (facilitating) users to quickly browse and analyze.
Log Pipeline Optimization: Log Pipeline test samples are adjusted to obtain all fields of the log, and need to be filled in line protocol format. Simultaneously, logs manually entered by users must also follow the format requirements.

Scenarios¶

Table Chart optimization:
- Multi-metric query sorting support: When using one DQL for multi-metric queries, table charts now support sorting.
- Table pagination selection: Added table pagination selection function. Users can choose the appropriate pagination size based on data volume and viewing needs.
Combined Charts: Supports adjusting the order of charts.
Chart Optimization: Adjusted the function order of the DQL query component, and specially emphasized the usage scenarios of the Rollup function, helping users better utilize the Rollup function for data aggregation and analysis.

Management¶

Events support configuring Data Forwarding: Supports configuring data forwarding rules for event types, saving event data that meets filter conditions to TrueWatch's object storage and forwarding to external storage, providing flexible management of event data capabilities.
Workspace added DataKit Environment Variables: Workspace supports managing DataKit environment variables. Users can easily configure and update environment variables, achieving remote synchronous updates of DataKit collection configuration.
Query Audit Events optimization: Added multiple fields to record query information. Simultaneously, the event content supplemented the query time range, facilitating tracking and analysis of query behavior.

Pipeline¶

Auto-generate Pipeline optimization: Changed the way prompts appear, optimizing product experience.

TOBY AI Agent¶

TOBY AI Agent added Generate Chart: The generate chart function automatically analyzes user-input text data based on large models, intelligently generates suitable charts, solving the problems of繁琐 (tedious) manual chart creation and difficulty in chart selection.

Monitoring¶

Alert Strategies: Configuring notification rules based on members supports appending names for usage description.

Deployment Plan Updates¶

Management Console > Workspace Menu Optimization:
- Workspace list added main storage engine and business two filter options, supporting convenient workspace filtering;
- Optimized workspace list page number return logic. When modifying/deleting a workspace, or modifying the workspace's data reporting limit, will stay on the current page to optimize query experience.
Deployment Plan added parameter: alertPolicyFixedNotifyTypes, supports configuring whether to display the configuration reference for the "Email" notification method in alert strategies.

New Integrations¶

Added AWS Gateway Classic ELB;
Added Volcengine TOS Object Storage;
Modified AWS Classic collector name;
Added MinIO V3 integration;
Updated elasticsearch, solr, nacos, influxdb_v2, mongodb integrations (views, documentation, monitors);
Updated kubernetes monitoring views.

Bug Fixes¶

Resolved the issue where cross-workspace authorization for event data was not effective;
Resolved the issue where jumping to the trace explorer with trace_id from associated logs could not query data;
Resolved the issue where numerical filling could not be performed for view expression queries;
Resolved the issue where external event detection monitors did not generate operation audit records when changing alert strategies;
Resolved the issue where the column width of the event display list could not be adjusted.### Bug Fixes {#bug0108}
Resolved the issue where cross-workspace authorization for event data was not effective;
Resolved the issue where jumping to the trace explorer with trace_id from associated logs could not query data;
Resolved the issue where numerical filling could not be performed for view expression queries;
Resolved the issue where external event detection monitors did not generate operation audit records when changing alert strategies;
Resolved the issue where the column width of the event display list could not be adjusted.

(Note: The translation continues from the provided starting point, adhering to all specified rules and the provided dictionary. The original structure and numbering are preserved.)