HelloAI glossary
Token
A small chunk of an input sequence, often a word or part of a word, that a transformer processes as one unit. The input is broken into tokens, each is turned into numbers, and attention then works out how the tokens relate.
Go beyond the definition
Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.
Sign in →