Skip to content

LLMOptions

dbally.data_models.llm_options.LLMOptions dataclass

LLMOptions(frequency_penalty: Optional[float], max_tokens: Optional[int], n: Optional[int], presence_penalty: Optional[float], seed: Optional[int], stop: Optional[Union[str, List[str]]], temperature: Optional[float], top_p: Optional[float], dict=asdict)

Dataclass that represents all available LLM call options for the OpenAI API. Each of them is described in the OpenAI API documentation

frequency_penalty instance-attribute

frequency_penalty: Optional[float]

max_tokens instance-attribute

max_tokens: Optional[int]

n instance-attribute

n: Optional[int]

presence_penalty instance-attribute

presence_penalty: Optional[float]

seed instance-attribute

seed: Optional[int]

stop instance-attribute

stop: Optional[Union[str, List[str]]]

temperature instance-attribute

temperature: Optional[float]

top_p instance-attribute

top_p: Optional[float]

dict class-attribute instance-attribute

dict = asdict