Advanced
Artificial Intelligence & Machine Learning
Q82 / 100
What is the scaling law in large language models?
Correct! Well done.
Incorrect.
The correct answer is B) Empirical power-law relationships showing that model performance improves predictably with compute, parameters, and data — enabling principled decisions about training runs
B
Correct Answer
Empirical power-law relationships showing that model performance improves predictably with compute, parameters, and data — enabling principled decisions about training runs
Explanation
Kaplan et al. (2020): loss ∝ N^-0.076 * D^-0.095 (N=params, D=tokens). Chinchilla (Hoffmann 2022): optimal: N and D should scale equally. These laws guide billion-dollar training run decisions.
Progress
82/100