Beginner
Artificial Intelligence & Machine Learning
Q34 / 100
What is the attention mechanism in deep learning?
Correct! Well done.
Incorrect.
The correct answer is B) A mechanism allowing models to dynamically weight the importance of different parts of the input when producing each output
B
Correct Answer
A mechanism allowing models to dynamically weight the importance of different parts of the input when producing each output
Explanation
Attention (Bahdanau, 2014) allows models to focus on relevant input parts per output token. Self-attention (Transformers) computes relationships within the same sequence, enabling long-range dependency modeling.
Progress
34/100