Attention Mechanism

A mechanism that lets a model focus dynamically on the most relevant parts of its input.