Encoder-only model

A transformer that uses only the encoder, also called an autoencoding model. Built for understanding context, such as classification and sentiment analysis. BERT is the classic example, pre-trained with masked language modeling and fine-tuned by adding classifier layers.

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.