Instruction tuning

Instruction tuning is the process of fine tuning a language model on datasets of instruction output pairs. The purpose is to make the model more likely to follow intructions given by the user, as opposed to attempting to finish the instruction.

Image credits: S. Zhang et al,

Related Articles

No items found.