Language & LLMs

What Are Adapter Layers?

Adapter layers are small neural network modules inserted between the layers of a pretrained model. During fine-tuning, only these adapters are trained while the original weights stay fixed. This enables efficient task adaptation and lets multiple tasks share the same base model.