Explain the concept of attention mechanism in NLP.
Instruction: Describe how attention mechanism improves model performance and provide examples of its application.
Context: This question tests the candidate's knowledge on one of the key innovations in NLP model architecture that enables models to focus on relevant parts of the input data.
Updated
Official answer available
Read the opening below, then unlock the full answer and practical guidance.
Attention is a mechanism that lets a model weigh which parts of the input matter most when producing an output...