Pre-training

The first training stage, where a model learns general representations from a large dataset (often unlabelled, via self-supervision) before being adapted to a specific task. Pre-training ideally uses data from the same domain as the eventual task.

Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.