get_full_finetune_lr_multiplier - Tinker Documentation
tinker_cookbook.hyperparam_utils.get_full_finetune_lr_multiplier
tinker_cookbook.hyperparam_utils.get_full_finetune_lr_multiplier( model_name)
Get a model-specific LR multiplier for full fine-tuning, proportional to 1/sqrt(param_count).
Parameters:
- model_name ( str) – HuggingFace model identifier.
Returns: The LR multiplier for full fine-tuning.