HelloAI glossary
Feed-forward network
A fully connected network inside each transformer layer that applies further transformations to the attention output, letting the model capture more complex relationships between tokens. It sits alongside the attention sublayer in both encoder and decoder.
Go beyond the definition
Terms like this come up in real clinical scenarios across the HelloAI courses: bite-sized modules with verifiable certificates. An account takes one minute, no password needed.
Sign in →