FailureKind

High-level categorization of failures occurred during experiments:

  • AGENT_EXECUTION: likely related to agent logic / prompting / model capability (could potentially be improved).

  • EXTERNAL_ENVIRONMENT: infrastructure issues (network / provider / API / MCP server), usually worth re-checking environment and rerunning.

  • EXECUTION_ABORTED: the runner deliberately stopped the execution in response to a triggering condition such as a spend-limit breach. The specific cause lives in AnalyzedFailure.resolvedId.

  • UNKNOWN: not recognized by our heuristics yet.

Entries

Link copied to clipboard

Likely related to agent logic / prompting / model capability (could potentially be improved).

Link copied to clipboard

Infrastructure issues (network / provider / API / MCP server); usually worth re-checking environment and rerunning.

Link copied to clipboard

The runner deliberately stopped the execution in response to a triggering condition such as a spend-limit breach. The specific cause lives in AnalyzedFailure.resolvedId.

Link copied to clipboard

Not recognized by our heuristics yet.

Properties

Link copied to clipboard

Returns a representation of an immutable list of all enum entries, in the order they're declared.

Link copied to clipboard
Link copied to clipboard

Functions

Link copied to clipboard

Returns the enum constant of this type with the specified name. The string must match exactly an identifier used to declare an enum constant in this type. (Extraneous whitespace characters are not permitted.)

Link copied to clipboard

Returns an array containing the constants of this enum type, in the order they're declared.