xbe.at

Topics / NLP and transformers

Fine tuning and adaptation

1 notes.

  1. Efficient Fine-Tuning of Language Models with LoRA and MoRA using Python6 min

    LoRA (Low-Rank Adaptation) and MoRA (Monolithic Residual Adaptation) are two techniques used for efficient fine-tuning of large language models. They aim to...