koog-agents-optimization/ai.koog.agents.optimization.training/ConsumptionCapturingPromptExecutor

ConsumptionCapturingPromptExecutor

abstract class ConsumptionCapturingPromptExecutor(delegate: PromptExecutor) : CapturingPromptExecutor

A CapturingPromptExecutor that wraps a delegate executor, runs each call through it, and accumulates the LLMConsumption extracted from the returned Message.Response metadata.

The training infrastructure creates one per leaf prompt call (via the session's capturingExecutorFactory) and reads accumulated consumption between retry attempts via collectAndClear. Subclasses supply the provider-specific extractConsumption.

Inheritors

LiteLLMConsumptionCapturingPromptExecutor

Constructors

ConsumptionCapturingPromptExecutor

constructor(delegate: PromptExecutor)

Functions

open override fun close()

Closes the underlying delegate executor.

collectAndClear

open override fun collectAndClear(): LLMConsumption?

Returns the consumption accumulated since the previous call (or since construction), then resets the accumulator. Returns null when nothing was captured.

execute

open suspend override fun execute(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): List<Message.Response>

Runs the call through delegate and accumulates any LLMConsumption reported by extractConsumption for the returned responses. Accumulation is thread-safe.

fun execute(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>, executorService: ExecutorService?): List<Message.Response>

executeMultipleChoices

fun executeMultipleChoices(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>, executorService: ExecutorService?): List<LLMChoice>

open suspend fun executeMultipleChoices(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): List<LLMChoice>

executeStreaming

open override fun executeStreaming(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): Flow<StreamFrame>

Delegates streaming to delegate; no consumption is captured from streamed frames.

executeStreamingWithPublisher

fun executeStreamingWithPublisher(prompt: Prompt, model: LLModel, tools: List<ToolDescriptor>): Flow.Publisher<StreamFrame>

executeStructuredOrThrow

inline suspend fun <OutputStructT> PromptExecutor.executeStructuredOrThrow(prompt: Prompt, model: LLModel): OutputStructT

Executes prompt against model, requesting a structured response of type OutputStructT, and returns the parsed data.

getBasicJsonSchemaGenerator

open fun getBasicJsonSchemaGenerator(model: LLModel): BasicJsonSchemaGenerator

getStandardJsonSchemaGenerator

open fun getStandardJsonSchemaGenerator(model: LLModel): StandardJsonSchemaGenerator

models

fun models(executorService: ExecutorService?): List<LLModel>

open suspend fun models(): List<LLModel>

moderate

open suspend override fun moderate(prompt: Prompt, model: LLModel): ModerationResult

Delegates moderation to delegate; no consumption is captured.

fun moderate(prompt: Prompt, model: LLModel, executorService: ExecutorService?): ModerationResult