Solved Aware Consumption Metric
Solved-aware consumption metric for dataset iterations.
Tracks total LLM consumption split by solved/not-solved, plus per-substage and per-solved aggregations (min, max, avg). Also computes averageSolvedCost: total consumption divided by the number of solved items.
Important: tracks the consumption of all substages (including optimizer substages), not just agent runs. Consider AgentRunStatsMetric if you need agent-specific stats.
Only meaningful on stages created by iterateDataset, where each direct substage represents a dataset item whose solved/not-solved status is known.
The canonical fields above carry the final-attempt view (research signal). When any leaf below has performed retries, a withRetries sub-object is also emitted carrying the *WithRetries / *InRetries totals — auxiliary metrics that quantify the cluster-cost overhead of retries.
Constructors
Types
Key holder for SolvedAwareConsumptionMetric.
Properties
Total consumption across all finished items divided by the number of solved items, or null if none solved.
Mean per-item total cost across solved items, or null if none.
The key that identifies this metric in a ai.koog.agents.optimization.training.metrics.MetricsMap.
Largest per-item total cost across solved items, or null if none.
Smallest per-item total cost across solved items, or null if none.
Total LLM consumption across solved (and not failed) finished items, or NA if none.
Retries-aware totals. null when no retries fired anywhere under this dataset iteration — the serializer omits the sub-object in that case.
Functions
Recompute this metric from the full list of substages records.