# tinker_cookbook.hyperparam_utils.get_lora_lr_multiplier

### [**tinker_cookbook.hyperparam_utils.get_lora_lr_multiplier**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/hyperparam_utils.py#L332)( _model_name_)

Get a model-specific multiplier for the LR, when training with LoRA.

Given two models A and B, and learning rate LR_A that's known to be optimal for A,
we can guess an optimal learning rate for B as
LR_B = LR_A * get_lora_lr_multiplier(B) / get_lora_lr_multiplier(A)

**Parameters:**

- [**model_name**](https://github.com/thinking-machines-lab/tinker-cookbook/blob/main/tinker_cookbook/hyperparam_utils.py#L332) ( _str_) – HuggingFace model identifier.

**Returns:** The LoRA LR multiplier combining full-finetune scaling and LoRA factor.
