Attention mechanism

The core component of a transformer that lets the model weigh how much every part of the input matters to every other part. It builds an attention filter from the inputs and uses it to give some words more weight than others when forming a representation.

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.