Language & LLMs

What Is Instruction Tuning?

Instruction tuning is a fine-tuning process that trains a language model on datasets of tasks phrased as instructions paired with desired responses. This teaches the model to follow natural-language directions across a wide range of tasks. It improves usefulness and generalization to new instructions.