BERT

A well-known encoder-only (autoencoding) transformer, pre-trained with masked language modeling so it reads context bidirectionally. Used for understanding tasks like classification. In healthcare, the BEHRT adaptation was trained on sequential diagnosis codes to predict future diagnoses.

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.