Intermediate
Artificial Intelligence & Machine Learning
Q56 / 100
What is knowledge distillation?
Correct! Well done.
Incorrect.
The correct answer is B) Training a smaller "student" model to mimic a larger "teacher" model's soft probability outputs, transferring knowledge into a compact model
B
Correct Answer
Training a smaller "student" model to mimic a larger "teacher" model's soft probability outputs, transferring knowledge into a compact model
Explanation
Distillation (Hinton 2015): student learns from teacher's soft labels (temperature-scaled softmax) carrying inter-class similarity info. The student can approach teacher performance with far fewer parameters.
Progress
56/100