HelloAILearn
Sign in →
HelloAI glossary

Self-attention

Attention where the query, key, and value all come from the same input, so a sequence attends to itself. It is how a transformer works out the contextual relationships among the words within one sequence.

Go beyond the definition

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.

Sign in →
See all terms →