Masked language modeling

A self-supervised pre-training task where part of the input tokens are hidden and the model is trained to predict them from the surrounding unmasked tokens. Because it can use context on both sides, it produces bidirectional encoders. It is the task BERT is pre-trained with.

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.