Yavio

Metrics

How KPIs are computed from raw events at query time

All metrics in Yavio are derived at query time from the raw events stored in ClickHouse. Nothing in this page represents a separately stored value — each metric is a query over the events table.

Overview KPIs

The dashboard overview shows these high-level metrics:

MetricHow It's Computed
Total invocationsCount of all tool_call events
Unique sessionsCount of distinct session_id values
Error rateRatio of failed tool_call events to total tool_call events
Avg latencyAverage latency_ms across all tool_call events
Invocations over timetool_call events grouped by time bucket (line chart)
Platform breakdowntool_call events grouped by platform (pie chart)
Top toolstool_call events grouped by event_name, ordered by count
Total conversionsCount of all conversion events
Total revenueSum of conversion_value across all conversion events

Business KPIs

MetricHow It's Computed
Session-to-conversion rateSessions with at least one conversion / total sessions
Widget engagement rateSessions with any widget_click or widget_form_field / sessions with widget_render

Tool Explorer Metrics

Per-tool deep-dive analytics:

MetricDescription
Per-tool invocation countHow often each tool is called
Latency distributionHistogram of execution times for a selected tool
Error rate over timeError ratio per time bucket for a selected tool
Error category breakdownDistribution of error types (auth, validation, timeout, etc.)
Parameter fill ratesHow often each parameter key appears in tool calls
Top parameter valuesMost frequent values per input key
Common parameter combinationsFrequent patterns in input_keys
Zero-result ratePercentage of tool calls that returned empty results
Tool discovery-to-invocation ratioHow often a discovered tool is actually called

Funnel Metrics (Coming Soon)

Funnels stitch step and conversion events within a trace to visualize user journeys:

MetricDescription
Step progressionOrdered sequence of steps and conversions within a trace
Drop-off ratesPercentage of traces that don't progress from step N to step N+1
Example tracesFull event timeline for individual traces

Timing Metrics

MetricDescription
Time-to-first-interaction (TTFI)Time from widget_render to first widget_click
Time-to-first-tool-callTime from session start to first tool invocation
Latency percentilesp50, p95, and p99 latency across tool calls

Session Aggregates

Sessions are continuously materialized by ClickHouse as events arrive. There is no explicit "session close" event — sessions are implicit aggregates over events sharing the same session_id.

FieldDescription
tool_countDistinct tools used in the session
invocation_countTotal tool calls in the session
event_countTotal events in the session
conversion_countConversions in the session
total_revenueSum of conversion values
duration_msTime from first to last event
has_widgetWhether any widget was rendered
ttfi_msTime to first interaction in widget

On this page