TopkPromptLogprobs - Tinker Documentation
tinker.types.TopkPromptLogprobs
class tinker.types.TopkPromptLogprobs()
Top-k most likely tokens at each prompt position, as dense numpy matrices.
Both matrices have shape (prompt_length, k) where k is the number of top tokens requested. Empty positions are filled with sentinel values (token_id=0, logprob=-99999.0).
Fields:
- token_ids ( np.ndarray) – int32 matrix of token IDs, shape
(prompt_length, k). - logprobs ( np.ndarray) – float32 matrix of log probabilities, shape
(prompt_length, k).