Attention Mechanism
A method in neural networks that helps a model focus on the relevant parts of the input when producing an output. In a transformer model, attention determines which words in a document influence the generation of each subsequent word. This is what allows a model to connect a revenue figure on page 12 of a filing to a question about margin trends.