unregister_tokenizer - Tinker Documentation

tinker_cookbook.tokenizer_utils.unregister_tokenizer

tinker_cookbook.tokenizer_utils.unregister_tokenizer( name)

Unregister a custom tokenizer factory.

Parameters:

Returns: True if the tokenizer was unregistered, False if it wasn't registered.