tinker.types.SamplingParams

class tinker.types.SamplingParams( BaseModel)

Fields:

• max_tokens ( Optional[int]) – Maximum number of tokens to generate
• seed ( Optional[int]) – Random seed for reproducible generation
• stop ( Union[str, Sequence[str], Sequence[int], None]) – Stop sequences for generation
• temperature ( float) – Sampling temperature
• top_k ( int) – Top-k sampling parameter (-1 for no limit)
• top_p ( float) – Nucleus sampling probability

Referenced by

• SamplingClient.sample