tinker_cookbook.preference.ComparisonRendererFromChatRenderer

class tinker_cookbook.preference.ComparisonRendererFromChatRenderer( ComparisonRenderer)

Wraps a chat Renderer to render Comparisons for preference training.

Formats comparisons by concatenating the prompt conversation with labeled sections for Completion A and Completion B, separated by system markers.

build_generation_prompt( comparison)

Build a model input prompt for generating a preference label.

Parameters:

• comparison ( Comparison ) – The comparison to render.

Returns: types. ModelInput – Token-level model input ending at the "==== Preference =====" marker, ready for sampling.

property tokenizer

The tokenizer from the underlying chat renderer.

Returns: Tokenizer – The tokenizer instance.