The Monitoring Dashboard provides a comprehensive overview of integration logs, enabling users to monitor, analyze, and troubleshoot data processing activities in real-time. It aggregates log data from various integration bridges, offering visual summaries, charts, and a detailed log explorer for efficient debugging and performance insights.
Accessing the Monitoring Dashboard
Access the Monitoring Dashboard from the Dashboard page by clicking on the Monitor tile. Logs are ingested and reflected in the dashboard based on the configured Log Rotation Size (as set in the Advanced Settings section of the Summary page of your Integration Bridge). If no custom size is specified, logs will default to reflecting after reaching 500 MB. The minimum allowable value for Log Rotation Size is 20 MB.
Monitoring Dashboard Features
Search Bar:
The Search Bar, located at the top of the dashboard, enables quick keyword-based searching across key log attributes for retrieving relevant entries.
Search Bar Features:
- Supports keyword searches, exact phrases.
- Searches are limited to specific columns: IntegrationBridgeName, MESSAGE, level, and Operation Name.
- Does not support searching on other columns to maintain focus on key attributes.
Dropdown Filters:
Dropdown Filters allow users to refine the dashboard view by selecting specific values for key attributes, applied across all sections.
Dropdown Filters Features:
- Filter by Operation Name: Select from a list of available operation names.
- Filter by IntegrationBridgeName: Choose specific integration bridges.
- Filter by level: Options include INFO, ERROR, WARNING, and SYSTEM.
- Filter by Date Range: Use the timestamp field to select a custom start and end date/time.
- Filters can be combined for precise analysis and are reset via a clear button.
Visual Summary Cards:
The top row of the dashboard features summary cards displaying key metrics for the current day (based on timestamp), providing an immediate snapshot of system health.
Visual Summary Cards Features:
- Error Count: Total logs with level = ERROR, highlighted in red for alerts.
- Total Operations: Count of distinct Operation Names executed today.
- Active Users: Number of unique users active in the last 24 hours.
- Active Bridges: Count of distinct integration bridges in use.
- Logs Ingested Today: Total number of logs ingested based on timestamp.
- Cards update in real-time with live tailing and are filterable via search or dropdowns.
Example:
If the Error Count card shows a significant number of errors, this indicates a high volume of errors requiring attention.
Charts:
The dashboard includes several interactive charts to visualize log patterns, distributions, and trends over time.
Pie Chart (Log Level Distribution):
This pie chart shows the proportional breakdown of logs by severity level.
- Filterable by time range via dropdowns.
- Tooltips display count and percentage share for each segment.
- Supports real-time updates with live tailing.
Donut Chart (Operation Breakdown):
This donut chart illustrates the share of logs by top Operation Names.
- Displays dominant operations (e.g., Single_Line_to_Multiline_1) with colored segments.
- Tooltips show count and percentage.
- Filterable by time and other dropdowns.
- Updates in real-time to reflect new log ingestions.
Line Chart (Logs Over Time):
This line chart tracks log volume over time.
- X-axis: Timestamp (e.g., dates like Sep 28, Sep 29).
- Y-axis: Log count.
- Supports zooming, hovering for details, and real-time live tailing.
Calendar Heatmap (Logs by Hours):
This heatmap displays hourly log activity with color intensity representing volume.
- Grid layout showing hours (e.g., 12AM, 1AM) with counts (e.g., 166654 at 12AM).
- Darker shades indicate higher log volumes.
- Filterable by date range and levels.
- Real-time updates ensure visibility into recent activity spikes.
Log Explorer:
The Log Explorer is a bottom-panel data table for in-depth log review, with pagination and scrolling for large datasets.
Log Explorer Features:
- Columns: timestamp, level, IntegrationBridgeName, Operation Name, UserName, MESSAGE (preview).
- MESSAGE column is expandable to view full log details.
- Supports export to CSV or Excel for offline analysis.
- Toggle between inline dashboard view and a full-page explorer mode.
- Real-time live tailing appends new logs automatically.
