Failure Kind
High-level categorization of failures occurred during experiments:
AGENT_EXECUTION: likely related to agent logic / prompting / model capability (could potentially be improved).
EXTERNAL_ENVIRONMENT: infrastructure issues (network / provider / API / MCP server), usually worth re-checking environment and rerunning.
EXECUTION_ABORTED: the runner deliberately stopped the execution in response to a triggering condition such as a spend-limit breach. The specific cause lives in AnalyzedFailure.resolvedId.
UNKNOWN: not recognized by our heuristics yet.
Entries
Likely related to agent logic / prompting / model capability (could potentially be improved).
Infrastructure issues (network / provider / API / MCP server); usually worth re-checking environment and rerunning.
The runner deliberately stopped the execution in response to a triggering condition such as a spend-limit breach. The specific cause lives in AnalyzedFailure.resolvedId.
Properties
Functions
Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)
Returns an array containing the constants of this enum type, in the order they're declared.