Self-supervised learning

Training a model on large amounts of unlabelled data by having it predict parts of its own input, so no expensive expert annotations are needed. It is the usual first stage for transformers, producing general representations that a later fine-tuning step adapts to a specific task.

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.