TrainSetItem

data class TrainSetItem<AgentInput, ItemLabel>(val userQuery: AgentInput, val itemLabel: ItemLabel)

An optimizer requires dataset items to run an agent on them and collect execution trajectories. DatasetItems consist of a userQuery, which is being passed to the Agent, and a label, which is the golden answer. The one using an optimizer is in charge of providing an optimizer with a relevant metric that can evaluate the produced result over the golden label.

Constructors

Link copied to clipboard
constructor(userQuery: AgentInput, itemLabel: ItemLabel)

Properties

Link copied to clipboard

the golden answer this item is evaluated against.

Link copied to clipboard

the input passed to the agent for this dataset item.