ModelPreferences

@Serializable

class ModelPreferences(val hints: List<ModelHint>?, val costPriority: Double?, val speedPriority: Double?, val intelligencePriority: Double?)(source)

The server's preferences for model selection, requested by the client during sampling.

Constructors

constructor(hints: List<ModelHint>?, costPriority: Double?, speedPriority: Double?, intelligencePriority: Double?)

How much to prioritize cost when selecting a model.

Optional hints to use for model selection.

How much to prioritize intelligence and capabilities when selecting a model.

How much to prioritize sampling speed (latency) when selecting a model.