Log Data Insights

Observo AI enhances log data processing by summarizing data based on keys, tracking tag trends, and analyzing pattern trends to detect anomalies and operational shifts.

Purpose

It optimizes data processing by filtering noise, improving storage efficiency, and enabling real-time analytics for better decision-making. Additionally, its transformation optimization applies AI-driven structuring and enrichment, ensuring seamless integration with security and observability platforms.

Navigate to the Data Insights tab and review the Log Data by Keys panel. Review the Keys and Values to determine whether any outliers are present.

Log Data Summary by Keys

• Organizes log data based on specific keys for structured analysis.

• Enables efficient filtering and quick insights into key metrics.

• Helps detect anomalies by comparing values across log entries.

The Bar Chart breaks the key value pair by Percentage of Average Bytes (Avg Bytes %). Selecting any key within the bar chart reveals the cardinality, “P50%” and “P99%” values for each key.

Below the Bar Chart, the Plot table header consists of:

• Key: Defaults to All keys. Type in the Key name to focus on a specific key.

• No of unique Values: Toggle up/down to reveal higher/lower values.

• %age of log size(Average): Toggle up/down to reveal higher/lower values.

You can select/deselect values under the Plot column. You can also click on any field name directly to get updates on the Key Stats and Top 10 Values panels right adjacent to the Plot table.

Example: Select Key message. It reveals the following (this example):

• Key Stats panel:

  • 9 Unique Values (Donut)

  • P-50 Percentage Size: 13.81%

  • P-99 Percentage Size: 22.02%

  • P-50 Size: 46.21

  • P-99 Size: 84.23

• Top 10 values panel:

  • Show the %age of total key data defined by content

  • Toggle up/down to reveal higher/lower values.

Log Data Summary by Keys Panel

Tags Trends for Patterns

• Tracks trends in tagged log data to identify recurring behaviors.

• Provides deeper insights by categorizing logs with meaningful labels.

• Enhances monitoring by highlighting deviations from expected trends.

Users can filter and break down trends based on:

• Select Duration (Defaults: Last Hour)

• Select By:

  • Select Appname

  • Select Sentiment

  • Select Src Id

**Note: In this example, the appname and sentiment parameters were configured in the Pattern Extractor Configs subsection, which is part of the Pattern Extractor Enricher definition within this specific Syslog example Source definition. For reference, see the Example subsection in the Pattern Extractor section.

You can select single, multiple or deselect for all Appnames. You can search on Appname(s) by type into the text box adjacent to Appname: field name. The pattern trends are reflected in the adjacent graph panel.

Duration	Tagging

Tags Trends for Patterns Panel

Patterns Trend

• Analyzes recurring log patterns over time to detect operational shifts.

• Helps identify abnormal activity through trend-based comparisons.

• Supports predictive analytics for system performance and security monitoring.

Users can filter and break down trends based on (this example):

• Select Duration (Defaults: Last Hour)

• Select Appname (Defaults: All)

• Select Sentiment (Defaults: All)

• Select Src Id (Defaults: All - can be set to any Src Id)

**Note: In this example, the appname and sentiment parameters were configured in the Pattern Extractor Configs subsection, which is part of the Pattern Extractor Enricher definition within this specific Syslog example Source definition. For reference, see the Example subsection in the Pattern Extractor section.

You can select single, multiple or deselect for all Log Patterns. You can search on Log Pattern(s) by type into the text box adjacent to Log Pattern: field name. The pattern trends are reflected in the adjacent graph panel.

Select Total Occurrences: Toggle up/down to reveal higher/lower values.

Duration	Appname	Sentiment	Src Id

Patterns Trend Panel

Key Benefits

Observo AI Data Insights empowers organizations to optimize and derive actionable insights from vast operational data. It transforms raw telemetry and log data into enriched, highly relevant information through multiple specialized capabilities. Among these are:

• Data Insights: Offering a comprehensive view of operational data.

• Log Data Summary by Keys: Quickly summarizing log data based on specific keys.

• Tags Trends for Patterns: Identifying and tracking trends in tagged patterns.

• Patterns Trend: Analyzing recurring patterns over time.

This integrated approach is particularly valuable for security, DevOps, and IT operations teams, providing the real-time insights needed for effective incident response and system optimization.