get_registered_tokenizer_names - Tinker Documentation

tinker_cookbook.tokenizer_utils.get_registered_tokenizer_names

tinker_cookbook.tokenizer_utils.get_registered_tokenizer_names()

Return a list of all registered custom tokenizer names.

Returns: list[str] – Names of all tokenizers registered via register_tokenizer.