Changelog (2025)¶

This document records the update content of each release of TrueWatch.

DataKit

SDK

Web Mini Program Android iOS React Native

July 23, 2025¶

Feature Updates¶

Monitoring¶

SLO
- SLO deductions are executed at a "second" level frequency;
- Added event information generated under the corresponding monitor in SLI events;
- Added a Summary page in the details page, with key metric charts dynamically linked to the time widget in the upper right corner.
- Added "SLO Correction" configuration. When SLO is about to be violated due to uncontrollable factors (such as infrastructure failures or third-party service interruptions), a temporary correction mechanism is used to avoid false alarms while ensuring SLO data audit compliance.
Alert Policies
- Support cloning alert policies;
- When configuring notification rules based on members, added support for one-click copying of member notification configurations.

Event Center¶

The default refresh time for the time widget on the Explorer page is set to refresh every 30 seconds;
Alert notifications on the details page no longer display the sending status.

Billing¶

Usage Statistics: Added "Backup Log Increment" display to count the daily increment of backup logs;
Usage Analysis: Default query time adjusted to "Today".

Basic Components¶

For the Shortcut > Snapshot display page:
- Support filtering based on type;
- Support batch deletion operations.
Explorer
- Search Bar:
  - Recent queries display adjusted to 10, saved queries adjusted to 50;
  - Support pinning query conditions;
- Quick Filter > Workspace Filter: After configuring fields, the system automatically adds indexes. At the same time, an icon identifier will be added for these fields in the Explorer search bar and chart query dropdown components.
- Details Page: Added an icon identifier for fields that have been added to the display column to distinguish them.

Infrastructure¶

Database: Added SQL Server data collection type. The details page can view all Table related information, including columns, indexes, and foreign keys.
Resource Catalog: Added a "Complete Information" tab page in the custom object Explorer details page.

Metrics¶

Metric Management: Added "Unique Value Count" display for tags, counting the deduplicated count of tag values globally or under a single metric dimension.

Pipelines¶

One-click sample acquisition: Support specifying the data source to obtain test data.

Scenarios > Top List¶

External data source queries support sorting.

Management¶

Data Forwarding: Support multiple filter conditions as OR;
Token: When changing Token, added configuration to adjust permission scope, supporting only reporting use.
Sensitive Data Scanning: Custom rules support look-around regex test matching;
Support Center > Tickets: Added a limit on the number of words in the ticket description.

New Integrations¶

Added Huawei Cloud APIG integration;
Added Huawei Cloud SFS Turbo integration;
Optimized Alibaba Cloud ECS integration view;
Updated AWS SQS integration;
Optimized Tencent Cloud product collection, supporting multi-dimensional metric collection (Cloud Monitor V2);
- EIP
- COS
- MySQL
- PostgreSQL
- MariaDB
- TDSQL-C MySQL
- TDSQL-C PostgreSQL
- Redis
- KeeWiDB
- MongoDB
- Memcached
Adjusted Huawei Cloud integration related document content format.
Fixed the issue where Chinese appeared in the Scene > Dashboards section of the console;
Fixed the issue where some country names in the Scene > Dashboards > Create > World Map section of the console were displayed in Chinese;
Fixed the issue where if an Issue created by Issue auto-discovery was manually changed to closed or resolved, a new Issue would restart the old Issue instead of creating a new one;
Fixed the issue where the status distribution chart in the Log Explorer displayed abnormally;
Fixed the issue where Session Replay displayed as expired;
Fixed the issue where no data was displayed after switching the Event Center display items to list mode;
Fixed the issue where event data displayed abnormally on the frontend;
Fixed the issue where Resource data in the RUM Explorer displayed abnormally;
Fixed the issue where forwarding data reported errors during queries;
Fixed the issue where the /api/v1/inner/alert_opt/get and /api/v1/account/list interfaces in the Deployment Plan reported errors;
Fixed the issue where the Pod monitoring view template linked to the trace was not updated;
Fixed the issue where the data access input data range filter displayed abnormally;
Fixed the issue where PromQL in the Time Series Chart > Bar Chart returned an incorrect time range when sliced by 1d;
Fixed the issue where PromQL queries returned data within an hour but not within a day;
Fixed the issue where the webpack plugin showed SourceMap file upload success but the SourceMap list could not be viewed;
Fixed the issue where Issue auto-discovery in Incident created duplicate Issues;
Fixed the issue where the Prometheus function idelta did not meet expectations;
Fixed the issue where the Log Explorer query results and DQL query results differed significantly under the same query conditions;
Fixed the issue where the monitor's df_label was set but the df_label in the generated events had no value, causing user mute policies to not take effect;
Fixed the issue where the IP field in the RUM Pipeline did not take effect;
Fixed the issue where the private environment kodo-x reported errors after upgrading;
Fixed the issue where the trace details displayed "Top Span Missing" but the top span actually existed;
Fixed the issue where application data could not be queried in the RUM > Application List;
Fixed the issue where the Billing details could not be viewed in the workspace's Billing Plan;
Fixed the issue where pressing Enter while entering a snapshot name would directly save the snapshot;
Fixed the issue where the monthly log bill showed 0 usage but was still charged;
Fixed the issue where the display judgment of src_ip and dst_ip was incorrect;
Fixed the issue where the Log Explorer bar chart occasionally displayed errors within the same time range;
Fixed the issue with the search function in Incident;
Fixed the issue where the Synthetic Tests task's follow direction configuration did not take effect and was cleared when edited again;
Fixed the issue where the number of logs and TLS were inconsistent when querying log indexes across multiple days.

July 9, 2025¶

Feature Updates¶

Billing¶

Introduced a new billing model: Enterprise Plan. This model uses a combination of data traffic + storage volume billing, more accurately reflecting the actual resource consumption in scenarios with extremely high log write volumes, making the cost structure more transparent and predictable. This model provides optimized cost efficiency for handling massive observation data, serving as one of the foundational capabilities for building a "globally controllable enterprise-level observation hub."
- In the Enterprise Plan workspace, data storage policies support custom configurations;
- To upgrade from the Free Plan to the Enterprise Plan, please contact your account manager.
Commercial Plan:
- Adjusted the billing item names in Usage Statistics and Usage Analysis;
- Adjusted the prices for Commercial Plan Time Series 180-day and 360-day storage.

Monitoring¶

Monitor > Threshold Detection: Detection metrics support querying external data sources;
Monitor List: Support searching and locating based on monitor ID.

Event Center¶

Added Display Items: Support switching between standard and list mode displays.
Change Events > Details Page: Made the following adjustments to Basic Attributes:
- Change Content: Display df_message content, recording detailed descriptions of resource changes;
- Difference Comparison: Display diff content, recording the difference text of resource changes.

Scenarios > Charts¶

SLO Charts: Added "This Year" dynamic time option for locked time;
Heatmap:
- Added "Metrics" data source type query;
- Added Y-axis configuration, supporting Y-axis calculations based on data.

Infrastructure¶

Network > Summary
- Support custom analysis dimensions: Display aggregated query data by selecting source and target query fields;
- Support cross-workspace network data queries.
Database:
- Added Oracle database integration;
- For PostgreSQL databases, view all Table related information, including columns, indexes, and foreign keys.

Metrics¶

Generate Metrics: Support specifying the same metric name and tag for different generation rules;
Metric Management: Added multi-dimensional analysis for time series at the measurement level.

Deployment Plan Updates¶

Workspace List > Index Configuration: Support configuring data storage policies.

New Integrations¶

Added OpenLLMetry integration;
Added Undertow integration;
Added Cloudflare integration;
Added Huawei Cloud CDM integration;
Added Huawei Cloud DWS integration;
Added Huawei Cloud NAT integration;
Added AWS Transit Gateway integration;
Updated Volcengine ECS monitors and views;
Updated MinIO views and monitors;
Optimized Huawei Cloud ASM / CCE integration;
Optimized Alibaba Cloud SAE integration;
Optimized JMX / MQTT integration.

Bug Fixes¶

Fixed the issue where accessing SaaS environments via login-free Tokens resulted in a 404 error when viewing Session Replay data.
Fixed the issue where Issue auto-discovery configurations in RUM were not recognized.
Fixed the issue where the event details in Synthetic Testing alerts did not display specific associated information.
Fixed the issue where modifying tag names in global tags prompted the existence of duplicate tag names.
Fixed the issue where DQL queries returned abnormal results.
Fixed the issue where PromQL queries failed but DQL queries worked normally.
Fixed the issue where Deployment > Pod information displayed incorrectly in multi-cluster scenarios.
Fixed the issue where the log status distribution chart displayed abnormally.
Fixed the issue where the RUM filter time range did not match the time selector, preventing the viewing of application data.
Fixed the issue where Issue auto-discovery template variables did not take effect in the RUM Error Explorer.
Fixed the issue where adding Webhook notification targets reported "Invalid Address" errors.
Fixed the issue where data forwarding in the base layer accumulated.
Fixed the issue where the log status distribution chart displayed abnormally.
Fixed the issue where DQL queries returning 0 caused frequent false alarms.
Fixed the issue where the base layer query tool could not sort logs, slimit was invalid, and pagination was not supported.
Fixed the issue where time series queries returned time series not constrained by filter conditions and without any tags.

June 25, 2025¶

Breaking Changes¶

Extracted df_check_targets, df_check_condition, and df_check_rules from the df_meta field of Events to the same level. In subsequent webhook notifications, when df_source = monitor, the detection time, detection metrics, detection count, and detection rules in the monitor configuration will be displayed.

Feature Updates¶

External API¶

Added the index_list_info interface to query workspace index information lists;
Added the update_index_setting interface to modify workspace index configurations.

External Data Sources¶

Added PG, Oracle, and Clickhouse external data source types to meet broader data scenario needs.

Logs¶

Added Native Direct Write Index type, allowing direct specification of write indexes during data collection for precise classification and storage.

Monitoring¶

Range Detection V2 supports detecting APM and RUM data types;
Mutation Detection > Event Content: Added the df_check_detail extension field, supporting the output of mutation comparison original values to event details.

Events¶

Alert events triggered based on monitor configuration rules support Obsy AI Intelligent Analysis.

Infrastructure > Database¶

Added PostgreSQL database integration;
For MySQL databases, view all Table related information, including columns, indexes, and foreign keys.

Explorer¶

Added Query History display in the search bar, allowing direct reuse and flexible modification.

Cloud Account Management¶

Added support for Tencent Cloud and Azure account types.

Scenarios¶

Adjusted the Import Dashboard entry, integrating the original custom template import function, and supporting batch dashboard imports.
Added "Log Analysis" to the dashboard page, allowing one-click viewing and analysis of related log data in a new side-slide page without leaving the page.

Incident¶

Added an "Incident Management" entry in the "Incident" menu on the left side of the console, allowing direct access to the management page.

New Integrations¶

Added Volcengine NAT integration;
Added Ceph integration;
Updated Clickhouse integration;
Optimized Huawei Cloud billing scripts;
Added Tencent Cloud billing;
Added Tencent Cloud WAF integration;
Added Tencent Cloud ES integration;
Added Tencent Cloud cos/cdb/mariadb/postgresql English views and monitors;
Added AWS Firehose;
Added AWS VPC NAT Gateway integration documentation;
Updated AWS cloud billing scripts: Adjusted T+1 calculation method to T-2 due to billing inaccuracies for some components (e.g., EC2);
Added Azure cloud billing.

Bug Fixes¶

Fixed the issue where generated metrics displayed abnormally;
Fixed the issue where clicking "Load More" on the log details page did not load log content;
Fixed the issue where the RUM activation link was invalid and had no pricing content;
Fixed the issue where clicking associated events in Issues did not query data after jumping;
Fixed the issue where creating a new Infrastructure V2 monitor reported a 406 error;
Fixed the issue where the Session Replay page loaded slowly;
Fixed the issue where OpenAPI did not automatically generate rule names when creating mute rules;
Fixed the issue where PromQL queries reported errors;
Fixed the issue where page error rates displayed abnormally;
Fixed the issue where host tags frequently disappeared;
Fixed the issue where resource call rankings did not sort correctly after adding search conditions;
Fixed the issue where if MFA was unbound after selecting 7-day MFA-free login, the system did not prompt to rebind MFA upon re-login;
Fixed the issue where CSV files exported from dashboards could not render correctly due to empty aliases;
Fixed the issue where monitors did not generate alerts normally and self-observation logs reported query timeout errors;
Fixed the issue where imported fields were automatically deleted in the backend;
Fixed the issue where user experience data was lost.

June 11, 2025¶

Feature Updates¶

Billing¶

Added Statistics Items: Trace write traffic, RUM write traffic, SIEM Scan Volume; Usage Analysis synchronously displays the newly added statistics.

Scenarios¶

Dashboard > AI Intelligent Analysis: Added support for automatic error discovery and error analysis, further enhancing Obsy AI data processing capabilities.

Monitors¶

Detection frequency supports custom input as short as 20s, with system support for 30s;
Application Performance Metrics Detection and RUM Metrics Detection support multi-selection of services and applications respectively;

SIEM¶

Official Detection Library launched: The system provides out-of-the-box security information detection templates.

Infrastructure > Database¶

Support cross-workspace data viewing;
Added fields: QPS, TPS, Average Query Time, Slow Query Log Status, Slow Query Count.

Metrics > Metric Analysis¶

Added Independent Chart mode, suitable for adding multiple queries simultaneously with inconsistent units;
Added support for displaying grouped statistics totals, with default slimit changed to 50.

Logs > Explorer¶

Added line break switch in Stack Mode;
Context logs support clicking the time column for ascending/descending sorting.

Cloud Account Management¶

Cloud Account types added support for Huawei Cloud.

Management > Environment Variables¶

RUM Android/iOS SDK supports dynamic updates via Environment Variables.

Query Tools¶

Table charts and simple queries in metric analysis support selecting multiple columns;
DQL quick queries default to simple mode, supporting multi-column configuration queries.

APM¶

ddtrace added package level instrumentation configuration. To instrument all methods under the com.zy and javax.servlet packages, configure as follows: -Ddd.trace.method.packages=com.zy,javax.servlet.

Deployment Plan Updates¶

Mapping Rules added "Append Mapping" switch. When enabled, accounts using single sign-on will be assigned workspaces and roles according to mapping rules, with original workspaces and roles retained.
For workspaces using the ScopeDB engine, support tenant-level query configuration.

New Integrations¶

Optimized Tencent Cloud billing scripts, supporting sub-account billing information retrieval;
Added Tencent Cloud billing integration;
Added Tencent Cloud EIP integration documentation;
Added Tencent Cloud CDB monitors (English);
Added Huawei Cloud billing integration;
Updated AWS ELB integration content;
Updated AWS LAMBDA integration content;
Updated AWS S3 integration content;
Added AWS Aurora MySQL integration;
Added AWS Aurora PostgreSQL integration;
Added Hikaricp integration;
Optimized TiDB Cloud views;
Added vpc integration;
Added AWS rds postgresql integration.

Bug Fixes¶

Fixed the issue where userid was not displayed in the resource Explorer for Singapore site user spaces;
Fixed the issue where custom reported userid could not be queried in the action Explorer;
Fixed the issue where dashboard AI analysis results were inaccurate;
Fixed the issue with OpenAPI fetching time series trend charts;
Fixed the issue where monitor modification page data displayed delays;
Fixed the issue where webpack plugin skipped existing files when uploading SourceMap;
Fixed the issue where quick filters in the network function displayed errors;
Fixed the issue where variable filters did not run correctly;
Fixed the issue with high-risk vulnerabilities in penetration testing;
Fixed the issue where the RUM Analysis Dashboard > Resource Analysis section reported errors for Singapore site users;
Fixed the issue where panel link jump value variables were undefined;
Fixed the issue where the Log Explorer had no time selector in the upper right corner;
Fixed the issue where monitor (APM) preview charts displayed data inconsistent with actual data;
Fixed the issue where internal emails about DingTalk and WeChat were displayed incorrectly during cross-space authorization;
Fixed the issue where SSO user lists and user details were inconsistent in the management backend;
Fixed the issue with external database data source query displays;
Fixed the issue where new threshold monitor trend charts displayed incorrectly;
Fixed the issue where APM Explorer failed to search services;
Fixed the issue where DQL queries reported errors;
Fixed the issue where daily recurring mute rules did not send mute activation notifications as expected;
Fixed the issue where the AI analysis button was not visible after entering traces from RUM Session Replay.

May 28, 2025¶

OpenAPI Updates¶

Incident supports returning associated event count information when listing and fetching.

Feature Updates¶

SIEM¶

Detection Rules: Added testing and full-screen script editing;
Added Signals Explorer;
Added Execution Logs Explorer.

Monitoring¶

Alert Policy > Association: Added selection of SIEM detection rules, supporting direct creation.
Edit Monitor Rules > Detection Metrics added support for PromQL query preview.
Monitor Rules List:
- Importing supports deleting and importing monitors with the same name on the operation page;
- Supports one-click exporting all monitor rule configurations in the current workspace.
- Intelligent Inspection feature entry removed.

Infrastructure¶

Containers: Added Persistent Volume Claims Explorer.
Added Database Explorer, providing a centralized tool for real-time monitoring of MySQL database performance metrics, resource usage, and logs.
Resource Catalog: Added database to resource classifications, displaying the total number of all databases.

Incident¶

Channel > Issue Details Page: Added "Associated Events," allowing direct jumps to the event list for viewing; Issue emails and other notifications also display associated events;
Notification Policy > Issue Escalation: Added event storm options. Set to send "repeated" or "one-time" notifications when Issue associated events exceed a specific count.

Events¶

Unrecovered Events:

Added "Mute" button. Clicking allows direct mute configuration for rules on the current page.
Added "Recover All" button. Clicking recovers all abnormal events in the current list, with an option to associate Issues.

APM¶

Flame Graph: Added "Locate Current Span" button.

RUM¶

WEB SDK added client time zone recording.
Session Replay Explorer page added client time zone display.
All time widgets unified with time zone display.

Scenarios¶

Dashboard > Obsy Obsy AI Intelligent Analysis:
- Optimized page display;
- Optimized issue output.
Charts
- Time Series Chart: Added a prompt: Query exceeds the maximum number of data points for time series charts, only displaying 1,000 data points;
- Bar Chart mouse hover color adjustment;
- Table Chart order optimization: Compatible with PromQL queries.

Metrics¶

Metric Analysis: Added query history and unit configuration.

Management¶

Sensitive Data Masking: Support configuring multiple fields for one rule.
Data Access: Edit page added access site selection.

Explorer > Quick Filter¶

All Explorers:
- In Edit Mode, support modifying "Filter Fields" and "Optional Fields";
- Added hiding field aliases;
- When searching fields, if no exact match is found, directly create and add to "Filter Fields."
Log Explorer:
- Adjusted two View Modes, adding "Global Configuration" in "Stack Mode";
- Adjusted Display Item Configuration.

Registration¶

Login and registration page display optimization.

Deployment Plan Updates¶

Configuration Management > Issue Discovery: Rule detection frequency added support for 1 minute.

New Integrations¶

Added TiDB Cloud integration documentation;
Added Traefik integration documentation;
Added AWS cognito integration;
Added AWS certificatemanager integration;
Added AWS RDS PostgreSQL integration documentation;
Added aliyun rabbitmq integration;
Updated haproxy views and monitors;
Added Huawei Cloud DIS English monitors and views;
Updated AWS ELB application integration documentation and views, added AWS ELB application monitors;
Updated AWS lambda integration documentation, added Lambda fetching S3 log data steps.

Bug Fixes¶

Fixed the issue where generated metric data was not reported normally.
Fixed the issue where OpenAPI importing monitor interfaces failed to import tags.
Fixed the issue where Synthetic Testing tasks did not stop.
Fixed the issue where clicking "Context Logs" in log details reported a 406 error.
Fixed the issue where monitors configured only with notification targets but no members displayed cached members in alertPolicyMemberInfos.
Fixed the issue where monitors treating data gaps as 0 did not take effect after saving.
Fixed the issue where batch recovering alerts failed and reported errors.
Fixed the issue where Log Explorer query results were inconsistent.
Fixed the issue where batch modifying monitors via API without configuring extend and rule fields overwrote original data.
Fixed the issue where importing built-in view templates in the backend was not correctly replaced.
Fixed the issue where log index configuration key fields did not link to Log Explorer stack mode display but displayed according to display items.
Fixed the issue where monitor execution logs reported critical level errors.
Fixed the issue where DQL subqueries did not take effect.
Fixed the issue where clicking Top List views and applying to view variables did not escape commas in variable values, causing incorrect condition filling.

May 14, 2025¶

Brand LOGO Change¶

TrueWatch innovates its visual identity, showcasing its iterative belief and technological strength in the AI wave.

From now on, Obsy will accompany you to gain insights into the data world, navigate system complexity, and stay at the forefront of the AI era.

External API¶

Dashboard: Supports global import of platform-level dashboards via identifier ID. This operation only updates dashboard configurations without affecting the binding relationships of views in each workspace.

Feature Updates¶

Security Monitoring¶

Added SIEM feature module: Real-time analysis of enterprise system logs and event data (e.g., servers, applications, network devices), automatically discovering potential threats, helping teams quickly locate anomalies, and fully leveraging the security monitoring hub role.

Monitoring¶

Alert Policy:
- Association: Supports selecting SIEM detection rules;
- Notification Configuration: Added "Security Monitoring" type levels.
Monitors: Adjusted "Infrastructure Change Detection Monitor" data writing, requiring re-saving old monitors to avoid affecting generated event displays.

Event Center¶

The "Events" feature module is renamed "Event Center," with optimized interaction pages.
Added Event Center Explorer, supporting centralized viewing of all event data.
Event recovery added a secondary confirmation operation to avoid accidental triggers.

Incident¶

In Incident > Calendar, after adding schedules, when creating Issues or associating responsible persons, "On-Duty Personnel" or "Notification Targets" can be selected. The system automatically assigns Issue responsible persons and notifies based on the day's on-duty personnel.

Scenarios¶

Dashboard: Added Obsy AI Intelligent Analysis function.
Time Widget Logic Optimization: When selecting "Relative Time," even if the refresh frequency is set to "off," modifying query conditions (e.g., adding/removing conditions in Explorer quick filters, adjusting filter conditions in the search box, or switching view variables in dashboards/notes) will still trigger queries.

Management¶

Data Forwarding: For AWS S3, Huawei Cloud OBS, and Alibaba Cloud OSS archive types, added Encrypted Storage switch. When enabled, the system encrypts forwarded data.
Audit Events: Added workspace field tagging.

Infrastructure¶

Host, Container, Pod, etc. built-in pages:
- Time Widget: Added Pin function;
- Integration Running Status: Optimized "View Monitoring Views" page;
- Associated Views added current event timeline display.
Host Explorer: Default query time adjusted to "Last 2 Hours."

Logs¶

Optimized log multi-index matching hit logic, avoiding calculation waste caused by matching index rules one by one.

Deployment Plan Updates¶

Supports creating, deleting, and modifying groups via External API, and adding or removing users in groups;
Workspace Management > Data Storage Policy: Added network storage policy configuration, supporting fixed 2-day storage duration or custom save duration.
Added Profile data reporting dynamic parameter switch. Users can dynamically enable or disable Profile data reporting based on platform performance.
Added API Key configuration and AI function access link configuration switches, including the following scenarios:
- Monitor > Alert Policy > AI Alert Aggregation
- AI Pipeline Writing Entry
- Scenarios > Chart Components > AI Chart Title and Description Generation
- Log Explorer > Error Log Details, Logs > Error Tracking > AI Error Analysis Entry
- RUM > Error Explorer > AI Error Analysis Entry
- APM > Trace Explorer > Error Trace Details, APM > Error Tracking > Trace Details > AI Error Analysis Entry
When editing alert policies, supports custom repeat alert time. Custom mute time format examples: 20m (20 minutes), 2h (2 hours), 1d (1 day).

New Integrations¶

Added host monitors;
Added MySQL monitors;
Updated CouchDB views and monitors;
Added ActiveMQ integration;
Added AWS SNS integration;
AddedVolcengine ESCloud integration;
Added English Huawei Cloud API, Huawei Cloud CCE monitors and dashboards;
AddedVolcengine RabbitMQ integration;
Modified AWS MSK integration metrics.

Bug Fixes¶

Fixed the issue where 413 errors occurred when uploading SourceMap via Vite packaging, and SourceMap download errors and TrueWatch could not display source code error locations.
Fixed the issue where RUM data could not be displayed normally in cross-workspace queries.
Fixed the issue where the Log Explorer displayed inaccurate namespace and service data after selecting self-built log indexes.
Fixed the issue where page styles were disordered when creating Multistep Tests.
Fixed the issue where the Log Explorer could not display namespace tag data normally in multi-index scenarios.
Fixed the issue where false alarms were reported in Guangzhou site.
Fixed the issue where Host details displayed abnormally when using hosted Doris in version 0409.
Fixed the issue where external data source query data displayed abnormally.
Fixed the issue where logs displayed shadows when expanding single logs in clustering mode.
Fixed the issue where recovered events were still displayed in event statistics pages.
Fixed the issue where clicking "Batch" in unrecovered event list mode triggered errors.
Fixed the issue where "Data Forwarding" function could not query historical logs on S3.
Fixed the issue where FUNC alert messages in version 1.109.196 reported to business spaces.

April 23, 2025¶

Breaking Change¶

Synthetic Testing data storage adjustment: Separated Synthetic Testing data from the original log index, independently stored, and added a dedicated query Namespace D. This adjustment does not affect historical Synthetic Testing data. If custom charts previously queried Synthetic Testing data, please update query configurations promptly. Official Synthetic Testing templates (e.g., HTTP, ICMP, TCP, WebSocket, Multistep Tests) and related monitors and metric rules have been adapted to this change.

External API¶

Supports adding, modifying, and listing specified workspace role lists and member lists interfaces;
Optimized OpenAPI and External API interface names and descriptions.

Feature Updates¶

RUM¶

SDK supports dynamic updates via Environment Variables: Dynamically update configurations by introducing variables predefined in Environment Variable Parameters within the application.
Application > New Application: Users can configure custom parameters, with left-side code examples updated in real-time, and the system caches the latest parameter configurations, eliminating the need to re-enter each time.
Error Explorer: Added support for Obsy AI Error Analysis. Intelligently parses single RUM error logs, automatically extracts key information, and integrates online search for initial solutions and suggestions.

Infrastructure¶

Cross-Workspace Authorization: If authorized workspaces exist and the authorized data type is "Basic Objects," directly switch workspaces in Infrastructure object type Explorer pages to view object data across workspaces.
Added "Change Events" tab page, supporting Deployments, Daemonsets, Services, Cron Jobs, Statefulsets object type data display for change details, facilitating user change record backtracking.

Monitoring¶

Monitor > Detection Rules: Added "Infrastructure Change Detection". Continuously monitors Kubernetes resource configuration changes (e.g., YAML file modifications), combines version tracking and intelligent analysis, implements compliance checks, fault root cause location, and resource usage optimization, ensuring cluster security, stability, and resource efficiency.
Detection Rules > Event Content > Custom Event Notification Templates: Added time auto-conversion Template Function {{ df_fault_duration | to_date_range_human }}.

Events¶

Added Change Events:
- View all event data records triggered based on Infrastructure Change Detection rules.
- All Event Details > Historical Trends: When detection objects have change events, time series charts display change event time nodes, supporting jumps to change details.
Event Explorer:
- Added "Only Unassociated Issues" button, quickly filtering associated events;
- Added "Display Items": Supports display preference switching (including list, standard, extended modes);

Management¶

Data Forwarding > Data View: Search Component Optimization.

Chart Export¶

Charts support exporting to newly created dashboards or notes, applicable to:

Metric Analysis
Explorer > List/Dimension Analysis

Explorer¶

Adjusted basic "List" view and "Dimension Analysis" chart mode interactions;
Dimension Analysis: Added grouped table charts.

Integration¶

In the left console menu, "Cloud Account Management" access path moved from Management to Integration directory.

Deployment Plan Updates¶

Supports adjusting Login Method (local accounts, LDAP accounts, OIDC) order.

New Integrations¶

Added apollo;
Updated Argocd integration documentation, adjusted to kubernetesprometheus metric collection;
Updated ingress nginx document views and monitors;
Neo4j updated dashboards & added monitors;
Added kubelet integration;
Added Azure Virtual Network Gateway integration;
Updated TIDB integration documentation, views, and monitors;
Alibaba Cloud 30 components added Automata management.

Bug Fixes¶

Fixed the issue where member management page member counts displayed incorrectly.
Fixed the issue where log view time fields were not translated after switching to the English interface.
Fixed the issue where label synchronization displayed abnormally after switching clusters.
Fixed the issue where mobile SDK was not accessed, and RUM > Analysis Dashboard > Mobile > Error Analysis page displayed incorrect user counts due to stuck times.
Fixed the issue where Log Explorer > Details page timing judgment was incorrect.

April 9, 2025¶

OpenAPI Updates¶

Supports creating, editing, and deleting Multistep Tests tasks;
Supports configuring workspace count upper limits.

Feature Updates¶

Scenarios¶

Chart Optimization
- Bar Chart:
  - Adjusted Alias position, supporting listing all metrics and groups;
  - Added X-axis configuration items.
- Grouped Table Charts:
  - Supports sorting based on groups;
  - Added 200 options in return count dropdown, supporting manual input with a maximum of 1,000.
- Time Series Chart > Line Chart: Added line "Style" settings, including linear, smooth, front step, back step.
Snapshot: Added permission prompts for Dashboard Snapshot sharing with configured permissions.
Explorer, Dashboard > Time Widget: Added "Last 1 Minute," "Last 5 Minutes," defaulting to the latter.

Management¶

Cross-Workspace Authorization: Supports cross-site data authorization, extending data sharing.
Data Forwarding:
- Added "Audit Events" data type.
- Adjusted Explorer query time logic:
  - Changed to daily queries, no cross-day queries;
  - When viewing forwarded data, the system automatically queries and continuously loads until fully displayed, no manual clicking required;
  - Management > Workspace Settings > Advanced Settings: Added "Data Forwarding Query Duration" configuration.
Data Access, Pipeline, Blacklist permission splits, changing "Management" permissions to: "Create, Edit" and "Delete."

Monitoring¶

System Notifications: Added associated log jump links, allowing jumps to the Log Explorer and filtering logs where this notification target failed to send.
Monitors:
- From Template New > Official Template Library: Added search function;
- Configuration Page > Event Content: Updated attention prompts. Only when associated with Incident, @ member configurations take effect and send event content to specified members.
- Threshold Detection: Added Recovery Conditions switch, configuring recovery conditions and severity. When query results are multiple values, any value meeting trigger conditions generates recovery events.

Incident¶

Issue email notifications' "Source" modified to hyperlinks, allowing direct access.

RUM¶

SourceMap:

Page interaction adjustment, changed from pop-ups to separate pages;
List page added search and export functions.

Obsy Obsy AI Intelligent Agent¶

Optimized Generate Charts function: Locally cached Func metric management data, generated DQL closer to semantic descriptions.

Obsy AI Error Analysis ¶

Added context support for root cause analysis, helping users understand error contexts faster and more comprehensively, improving diagnostic efficiency.

Integration > Extensions¶

DataFlux Func Automata / RUM Headless: Application billing added email reminders and system notifications.

Infrastructure¶

Host > Details Page: Disk capacity statistics distinguish local and remote disks.

Deployment Plan Updates¶

Template Management:

Page interaction optimization, including added "Template Type" in display columns;
Top filters added "Template Type";
Supports batch exporting templates;
When importing templates, supports previewing template details;
Built-in views, Pipeline, monitor template uploads support same-name overwrite logic.

New Integrations¶

Added GCP Compute Engine;
Added Azure Storage;
Added Azure redis cache;
Added Azure kubernetes;
Added Azure Postgresql;
Added Alibaba Cloud Rds MYSQL Automata integration;
Added Druid integration
Updated Trino;
Adjusted AWS/Alibaba Cloud Automata integration documentation: Added Automata Activation Script steps.

Bug Fixes¶

Fixed the issue where OpenAPI fetching unrecovered events did not match actual data.
Fixed the issue where Event Explorer reported errors during searches.
Fixed the issue where external data source data queries were abnormal.
Fixed the issue with Incident email notifications.
Fixed the issue where Incident > Analysis Dashboard loaded slowly.
Fixed the issue where bar chart colors displayed incorrectly.
Fixed the issue where external event prompts lacked AK.
Fixed the issue where status distribution charts and log volumes did not display correctly.

March 26, 2025¶

Feature Updates¶

Events¶

Unrecovered Events: Time widget defaults to auto-refresh, manual event recovery success adds frontend page prompts.
Event Details: Alert notification page display optimization.
Events, Intelligent Monitoring Explorer export appended "Whether Notified" display.

Management¶

Data Forwarding: Added permission configuration. By setting view permissions for forwarded data, effectively improves data security.

Monitoring¶

Infrastructure Detection V2: Added configurable detection intervals.
Alert Policy: Notification matching logic adjustment, improving execution efficiency in scenarios where events hit multiple policies and complex alert policies.
Notification Targets Management: Added Slack and Teams notification targets, meeting more global user needs.

Scenarios¶

View Variables: Supports external data source queries.
Charts:
- Added "Monitor Summary" chart, integrating monitor lists, displaying latest status, achieving instant monitoring and anomaly awareness.
- Command Panel: Display optimization;
- Chart Query: In DQL queries, using "wildcard" or "regex" added query suggestion prompts.
- Explorer, Dashboard > Time Widget: Added "Last 1 Minute" and "Last 5 Minutes" options.

Billing¶

Added Monthly Bill module, intuitively displaying monthly consumption totals.
Added export bill function.

RUM¶

Application List > New Application: Added "Compress Upload" and "Custom Hosted Address" parameter configurations.

Synthetic Tests¶

Added "South Africa" and "Hong Kong, China" as testing nodes, further expanding global coverage.

Logs¶

Log Explorer
- Quick Filter operation items adjustment;
- List word segmentation logic optimization;
- JSON format data added "JSON Search";
Index > Key Fields: Added "One-Click Extraction".

New Integrations¶

Added Azure Network Interfaces;
Added Azure Kubernetes;
Added Azure virtual network gateway;
Improved English integration translations.

Bug Fixes¶

Fixed the issue where log page display utilization was low.
Fixed the issue where Service Map metric units displayed incorrectly.
Fixed the issue where table charts could not select units for multiple columns.
Fixed the issue where Dashboard > Log Flow Chart exporting CSV reported errors when selecting export counts other than 1,000.
Fixed the issue where the most popular page's P75 and DQL query results were inconsistent.
Fixed the issue where time filters still displayed today after clicking << button.
Fixed the issue where menu management did not meet expectations.
Fixed the issue where searching space IDs in the management backend filtered abnormally.
Fixed the issue where Pipeline interface test samples were lost.
Fixed the issue where configuration migration export took too long.
Fixed the issue where event details interface quick filter tags had many empty items after upgrading.
Fixed the issue where monitor official template library detection library lists were duplicated, and once a detection library was selected, other monitors could not be searched.

March 12, 2025¶

Breaking Changes¶

Events df_alert_info field definition adjustment, added alert policy unmatched reason descriptions, still requiring isIgnored filtering to obtain actual notification targets sent.

Feature Updates¶

Incident¶

Added Incident Management entry, allowing current logged-in users to view and manage all Incident statuses in joined workspaces.
Optimized Incident page Channel List display, improving query efficiency when there are many channels.

Management¶

Cloud Account Management: Added Alibaba Cloud cloud account authorization types.
API Key Management: Added API Key permission control, supporting role authorization. Through role authorization, API Keys only have operation permissions within role scopes, effectively reducing security risks.
Data Forwarding: Default interaction changed to not selecting rules.

Obsy AI Error Analysis¶

Added Obsy AI Error Analysis capabilities to the following details pages:

error logs
APM > Trace/Error Tracking

Scenarios¶

Scheduled Reports:
- Added Webhook sending as a notification method;
- Supports sharing dashboard images to WeCom/DingTalk.
Time Series Chart: After selecting area chart as the chart type, added Stack Mode style, facilitating overall data cumulative effect observation.

APM¶

Trace: Supports batch exporting JSONL format.

RUM¶

User Analysis > Funnel Analysis: Supports Session Replay for queried Session lists.

Logs¶

Explorer:
- Log Explorer > Index Quick Filter search bar listing display optimization;
- Log Details > Extended Fields: Added "Dimension Analysis" mode;
Index: Supports setting dedicated Key Fields under index dimensions.

Left-side time range selection and right-side refresh frequency are independent. Only two situations affect refresh frequency:

Selected time range exceeds 1h
Selected time is absolute time

Infrastructure¶

Host: Explorer supports adjusting time ranges.

Pipeline¶

Configuration page display optimization;
Pipeline processing types added "Events";
Test samples support obtaining JSON format.
Filter Conditions > Synthetic Tests: Supports selecting Multistep Tests.

Deployment Plan Updates¶

Template Management: Supports uploading all Explorer templates.

New Integrations¶

Added azure_load_balancer;
Rewrote K8S server api;
Updated Gitlab CI;
Translated Volcengine related views;
Translated AWS related views.

Bug Fixes¶

Fixed the issue where log flow chart exporting to CSV did not respond.
Fixed the issue where ddtrace collected JVM metric view variables were runtime-id fields, and time series charts added related filters had no data.
Fixed the issue where custom gradient range color scale interface display was incorrect.
Fixed the issue where time series chart editing DQL queries, filter conditions selecting >0 saved, and re-editing displayed empty.
Fixed the issue where APM > Infrastructure table chart displayed abnormally.
Fixed the issue where management backend setting data forwarding storage duration to 1,800 days was not supported in the frontend.
Fixed the issue where quick queries executing show_object_field(HOST) reported "kodo service API request error: Service Unavailable."
Fixed the issue with bugs in Shortcuts.
Fixed the issue where RUM session and view had no data, while other resource and action had data.
Fixed the issue where Multistep Tests creation request steps immediately validated required fields.
Fixed the issue where role authorization filter conditions did not take effect in data access settings.

February 27, 2025¶

OpenAPI Updates¶

Metrics: Added Measurement and Tag Information Acquisition.

Feature Updates¶

Synthetic Tests¶

HTTP Tests: Supports Script Mode. By writing Pipeline scripts, flexibly customize test task judgment conditions and data processing logic.
Added Multistep Tests: Allows creating tests using multiple API connection response data, passing values through local variables, linking multiple task requests.

Scenarios¶

Dashboard > Visibility: Added "Custom" configuration, configuring this dashboard's "Operation," "View" permissions. This configuration also added "All Members" option.
Charts:
- Added AI auto-generating chart titles and descriptions capabilities;
- Log Flow Chart added "Rule Mapping" function;
- Table Chart display column optimization;
- Grouped Table Chart: Expression results support sorting;
- Time Series Chart, Pie Chart, etc. support data export to CSV files.

Metrics¶

Metric Analysis > Table Chart: When query results exceed 2,000, three modes added "Query Result Count" display.
Metric Management: Supports one-click jump to metric analysis.
Generate Metrics: Supports import creation, batch export.

Infrastructure¶

Container/ Pod Explorer: Object data added cpu_usage_by_limit, cpu_usage_by_request, mem_used_percent_base_limit, mem_used_percent_base_request 4 new fields.

APM¶

Profiling > Flame Graph interaction optimization: Selecting a single search method name directly focuses and locates.
ServiceMap interaction optimization: In upstream and downstream pages, supports searching nodes in the current canvas.

New Integrations¶

Added AWS Cloud Billing;
Added Kube Scheduler;
Added MQTT;
Rewrote APISIX;
Updated tidb English documentation and views;
Updated Zookeeper views, supplemented integration icons;
Fixed some components mainfest.yaml English translations.

Bug Fixes¶

Fixed the issue where clicking APM > Trace Details tab pages displayed errors;
Fixed the issue where Incident > Issue replies @members were incorrect;
Fixed the issue where chart temperature units were incorrect.

February 19, 2025¶

Breaking Changes¶

Events df_meta will no longer retain alert_info related information records. Users previously relying on this information for notification target acquisition, please switch to using the newly added df_alert_info (event alert notifications), df_is_silent (whether muted), df_sent_target_types (event notification target types) 3 fields to complete corresponding functions.

Potential affected functional scenarios:

Custom usage scenarios where external systems are integrated via OpenAPI event acquisition
Custom usage scenarios where events are forwarded to external systems via Webhook notification targets

Feature Updates¶

PromQL Query¶

Added query type: Instant Query, i.e., querying for a single time point.

Monitoring¶

Monitor configuration page:

Added not between option in trigger condition logic matching;
Supports directly modifying monitor status ("Enable" or "Disable").

APM¶

Trace: Details page added Service Context tab page.

Events¶

Event Details Page: Added support for binding Built-in Views;

Incident¶

Issue added working, closed statuses;
For open status timeouts and unspecified responsible persons and processing timeouts, Issue Escalation added repeated notification configurations;
Adjusted Issue system comments, channel notification UI display;
Analysis Dashboard: Added time widget.

Scenarios¶

Chart Links: Added "View Host Monitoring Views," default off.
Explorer: Supports deleting fixed name column, users can customize list display.
Cloud Billing Analysis Views: Supports viewing billing details.

Management¶

Role Management: Session Replay viewing, audit events added custom viewing permission capabilities.

Metrics¶

Generate Metrics: Metric name input no longer supports using - hyphen.

Integration¶

Integration cards added description information.

Deployment Plan Updates¶

Template Management: Supports uploading infrastructure Explorer templates;
Index Configuration: Deprecated "Backup Logs" item; can configure corresponding storage policies in "Edit Workspace > Data Storage Policy > Data Forwarding-Default Storage."

New Integrations¶

Added Milvus;
Added Volcengine Public IP;
Added opentelemetry-python;
Added openLIT Integration;
Updated k8s\es\mongodb\rabbitmq\oracle\coredns\sqlserver Chinese & English monitors & views.

Bug Fixes¶

Fixed the issue where AI aggregation notification messages' special characters caused result abnormalities;
Fixed the issue with Servicemap Deployment Plan adaptation;
Fixed the issue where combined charts could not configure hidden view variables;
Fixed the issue where Incident > Analysis Dashboard's "Unresolved Issue List" displayed disorderly;
Fixed the issue where RUM Analysis Dashboard's most popular page's P75 results and DQL query results were inconsistent;
Fixed the issue where RUM > Explorer search box was abnormal;
Fixed the issue where Scenarios > Object Mapping, using Resource Catalog for field mapping, dashboards' same fields only partially took effect;
Fixed the issue where Monitor > Event Content UI display was incorrect;
Fixed the issue where Event Explorer unrecovered event quick filter results did not meet expectations.

January 16, 2025¶

Feature Updates¶

RUM¶

Added Funnel Analysis: Users can define conversion steps to create funnels, view data conversion, and perform in-depth analysis;
User Analysis module integration: Added User Analysis module, integrating Heatmap and Funnel Analysis, providing comprehensive user behavior analysis tools;
Added mobile SourceMap restoration: Android and iOS applications support uploading SourceMap files on the page and viewing restored data in the Error Explorer.

APM¶

APM added service, added Host Auto Injection installation guidance, simplifying installation processes.

Integration¶

DataKit (data collection tool): DataKit installation page added Docker installation guidance, providing more diverse installation options;
External Data Source optimization: Added query specification prompts in SLS data source queries, helping users query data more accurately.

Scenarios¶

Combined Charts optimization: Combined charts added view variable configuration, supporting selecting current dashboard view variables for the combined chart, helping more flexibly filter and analyze data.

Monitoring¶

Mutation Detection Monitor: Added weekly and monthly year-on-year support for query cycles.

Obsy AI Intelligent Agent¶

Added DataFlux Func knowledge base.

Pipeline¶

Auto-generated Pipeline optimization: Supports simultaneously interacting with structured and natural language to obtain Pipeline parsing.

Bug Fixes¶

Fixed the issue where log stack mode display was incorrect;
Fixed the issue where log detection monitor function input boxes were misaligned;
Fixed the issue where metric calculations were incorrect;
Fixed the issue where Volcengine did not support having statements;
Fixed the issue where selecting "Request Error Rate" and "Average Requests Per Second" in APM metrics detection reported errors;
Fixed the issue where Volcengine base not in statements did not take effect;
Fixed the issue where event list returned data was too large, affecting page loading speed;
Fixed the issue where Hangzhou site event one-click recovery did not meet expectations.

January 8, 2025¶

OpenAPI Updates¶

Field Management: Supports obtaining field management lists, supports adding/modifying/deleting field management.
Synthetic Tests: Supports modifying testing tasks.
Incident > Schedule: Supports obtaining schedule lists, supports creating/modifying/deleting schedules.
Incident > Configuration Management: Supports obtaining notification policy lists, supports adding/modifying/deleting notification policies; supports obtaining Issue discovery lists, supports creating/modifying/enabling/disabling/deleting Issue discovery configurations.

Feature Updates¶

Logs¶

Log Index Optimization:
- When accessing built-in views and log context tab pages, the current log's index and default index are selected by default respectively. Both tab pages support multi-index selection. Additionally, when cross-workspace queries are enabled and authorized workspaces are selected in the menu, corresponding workspace index data can be directly queried here. Ultimately helping users view associated log data completely on one page, optimizing log query interactions.
- When listing log indexes, except for default being displayed at the top, other log indexes are listed in A-Z order.
Log Explorer added stack View Mode: In stack mode, fields will be integrated in the same column, and these fields will be presented in rows within cells. Log information display is more compact and clear, facilitating quick browsing and analysis.
Log Pipeline Optimization: Log Pipeline test samples are adjusted to obtain all log fields, and need to be filled in line protocol format. At the same time, manually input logs also need to follow format requirements.

Scenarios¶

Table Chart Optimization:
- Multi-metric query sorting support: When using one DQL for multi-metric queries, table charts now support sorting.
- Table Pagination Selection: Added table pagination selection function, users can select appropriate pagination sizes based on data volume and viewing needs.
Combined Charts: Supports adjusting chart order.
Chart Optimization: Adjusted DQL query component function order, especially emphasizing Rollup function usage scenarios, helping users better utilize Rollup functions for data aggregation and analysis.

Management¶

Events support configuring Data Forwarding: Supports configuring event type data forwarding rules, saving event data meeting filter conditions to TrueWatch object storage and forwarding to external storage, providing flexible event data management capabilities.
Workspace added DataKit Environment Variables: Workspace supports managing DataKit environment variables, users can easily configure and update environment variables, achieving remote synchronous updates of DataKit collection configurations.
Query Audit Events Optimization: Added multiple fields for recording query information, at the same time event content supplemented query time ranges, facilitating tracking and analyzing query behaviors.

Pipeline¶

Auto-generated Pipeline Optimization: Changed prompt appearance method, optimizing product experience.

Obsy AI Intelligent Agent¶

Obsy AI Intelligent Agent added Generate Charts: Generate charts function automatically analyzes user input text data based on large models, intelligently generating suitable charts, solving manual chart creation tediousness and chart selection difficulties.

Monitoring¶

Alert Policy: According to member configuration notification rules, supports appending names for usage descriptions.

Deployment Plan Updates¶

Management Backend > Workspace Menu Optimization:
- Workspace list added main storage engine, business two filter options, supporting convenient workspace filtering;
- Optimized workspace list page number return logic, when modifying/deleting a workspace, or modifying workspace data reporting limits, will stay on the current page, optimizing query experience.
Deployment Plan added parameter: alertPolicyFixedNotifyTypes, supports configuring in alert policies, whether selecting "Email" notification method displays Configuration Reference.

New Integrations¶

Added AWS Gateway Classic ELB;
AddedVolcengine TOS Object Storage;
Modified AWS Classic collector name;
Added MinIO V3 integration;
Updated elasticsearch, solr, nacos, influxdb_v2, mongodb integrations (views, documentation, monitors);
Updated kubernetes monitoring views.

Bug Fixes¶

Solved the issue where event data cross-space authorization did not take effect;
Solved the issue where log associated trace jumps to trace Explorer carrying trace_id could not query data;
Solved the issue where view expression queries could not perform numerical filling;
Solved the issue where external event detection monitors did not generate operation audit records when changing alert policies;
Solved the issue where event display list column widths could not be adjusted.