Intermediate
Artificial Intelligence & Machine Learning
Q62 / 100
What is LoRA (Low-Rank Adaptation)?
Correct! Well done.
Incorrect.
The correct answer is B) A parameter-efficient fine-tuning method adding low-rank matrices to transformer layers, adapting LLMs with far fewer trainable parameters
B
Correct Answer
A parameter-efficient fine-tuning method adding low-rank matrices to transformer layers, adapting LLMs with far fewer trainable parameters
Explanation
LoRA (Hu et al., 2021): instead of fine-tuning all weights W, add ΔW = BA where B (d×r), A (r×d), r<<d. Train only A,B (0.1% of parameters). Enables LLM fine-tuning on consumer GPUs.
Progress
62/100