FailureFeedback

data class FailureFeedback(val input: String, val expectedLabel: String, val actualOutput: String, val score: Double, val trajectory: Prompt)

Feedback collected from a single failed execution, fed to the reflection LM.

Constructors

constructor(input: String, expectedLabel: String, actualOutput: String, score: Double, trajectory: Prompt)

the output the agent actually produced.

the expected (ground-truth) output, as a string.

the agent input for the failed item.

the metric score for this item (0.0 = complete failure, 1.0 = perfect).

val trajectory: Prompt

the full conversation trace of the failed run.