TokenCompleter - Tinker Documentation
tinker_cookbook.completers.TokenCompleter
class tinker_cookbook.completers.TokenCompleter()
Abstract interface for generating tokens from a prompt.
call( model_input, stop, max_tokens)
Generate a token sequence from the given model input.
Parameters:
- model_input ( tinker. ModelInput) – The tokenized prompt to complete from.
- stop ( StopCondition) – Stop sequences (strings) or stop token IDs that terminate generation.
- max_tokens ( int | None) – Optional per-call cap on the number of generated tokens. When set, implementations should generate at most this many tokens (combined with any implementation-level limit by taking the minimum).
None(default) means no per-call override. Rollout runners use this to enforce per-turn token budgets.
Returns: TokensWithLogprobs – The generated tokens with their log-probabilities and stop reason.