Language & LLMs

What Is Prompt Tuning?

Prompt tuning is a parameter-efficient technique that learns a small set of continuous vectors, called a soft prompt, added to the input. The main model weights remain frozen, and only these vectors are optimized for a task. It requires far fewer trainable parameters than full fine-tuning.