HelloAILearn
Sign in →
HelloAI glossary

Token

A small chunk of an input sequence, often a word or part of a word, that a transformer processes as one unit. The input is broken into tokens, each is turned into numbers, and attention then works out how the tokens relate.

Go beyond the definition

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.

Sign in →
See all terms →