HelloAI glossary
Self-attention
Attention where the query, key, and value all come from the same input, so a sequence attends to itself. It is how a transformer works out the contextual relationships among the words within one sequence.
Go beyond the definition
Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.
Sign in →