Log Storage¶
Log storage in TrueWatch consists of standard storage, long-term storage, and LogBamboo cold storage, supporting real-time analysis, historical investigation, and private backups. You can combine these storage options based on how often you query your logs and how long you need to retain them.
Storage Components¶
Total log storage = Standard storage + Long-term storage + LogBamboo cold storage.
Standard storage and long-term storage retain logs for queries within the TrueWatch platform. LogBamboo cold storage runs in your own environment and provides independent backup and search capabilities. Together, these three components form the overall log storage system.
| Storage Type | Primary Use | Retention Policy | Query Method |
|---|---|---|---|
| Standard storage | Real-time analysis and queries, routine troubleshooting | 3 / 7 / 14 / 30 / 60 / 90 days | Use Standard Query in the Log Explorer to search and analyze any time range within the retention period |
| Long-term storage | Historical log investigation and infrequent queries | 90 / 120 / 180 / 360 days; must exceed the standard storage duration and includes the standard storage period | Use Long-term Query in the Log Explorer; each query can cover a time range of up to 24 hours |
| LogBamboo cold storage | Private log backups and long-term retention | User-configured in your own environment; can exceed total platform retention. Actual coverage depends on policies and available capacity | Search in your self-hosted LogBamboo service, or go to Manage > Data Forwarding > Data Explorer in the platform |
Standard Storage¶
Standard storage supports real-time log analysis and queries. It is suitable for frequent access, such as routine troubleshooting and dashboards.
Choose a retention period from 3 to 90 days based on your business needs. Within the configured retention period, logs support queries over any time range, real-time responses, and fast chart interactions.
For configuration details, see Data Storage Policy. To configure different retention policies for different workloads, use Multi-index Management.
Long-term Storage¶
Long-term storage retains historical logs beyond the standard storage period for infrequent queries and historical investigations, with a total retention period of up to 360 days. Each query of long-term data can cover a time range of up to 24 hours. To review multiple days, query separate time ranges of no more than 24 hours each.
Retention Example¶
With the standard storage duration set to 30 days and the long-term storage duration set to 180 days, counting backward from today:
- Days 1–30 fall within the standard storage period.
- Days 31–180 fall within the long-term storage data range.
- Total platform retention covers the most recent 180 days.
The long-term storage duration is the total retention period, including the standard storage period. In this example, 30 days of standard storage plus the next 150 days of long-term data provide 180 days of retention in total.
For storage usage and billing, long-term storage only counts data beyond the standard storage period. Data from days 1–30 is counted under standard storage and is not counted again under long-term storage.
For query details, see Standard Query and Long-term Query. For pricing details, see Long-term Storage Billing.
LogBamboo Cold Storage¶
LogBamboo provides private log backups. For logs that need long-term retention, deploy LogBamboo on-premises or in your own cloud environment to build your own backup and search service. Use it to investigate historical incidents, review event records, and run infrequent log queries.
Independent Backup and Retention¶
Select LogBamboo as the destination in Data Forwarding (Chinese), complete the connection settings, and save and enable the rule. Matching logs are then automatically written to LogBamboo without waiting for platform storage retention to expire. Logs become searchable after LogBamboo finishes processing them.
You configure LogBamboo retention in your own environment. It can exceed the total period covered by standard and long-term storage in the platform, allowing you to retain older historical logs. LogBamboo and platform retention policies are configured separately, and logs from the same period can be retained in both locations. Actual coverage also depends on when forwarding starts and the available capacity.
In the diagram, "total storage" refers to these three storage components. The historical period actually retained depends on platform storage policies, when forwarding rules take effect, and LogBamboo retention policies and capacity.
Query Access¶
- Self-hosted LogBamboo: Use its query interface to search logs by index, time range, and keywords.
- TrueWatch platform: After configuring a forwarding rule and query token, go to Manage > Data Forwarding > Data Explorer and select the corresponding rule. For time range and permission settings in the platform, see Data Explorer.
For deployment and connection instructions, see Deploy LogBamboo (Chinese) and Forward Data to LogBamboo (Chinese).