Fine-tuning

See also

• Pretraining

  The first stage of training, in which a model learns general patterns from a large, broad dataset before it is adapted to particular tasks.

• Reinforcement learning from human feedback

  A training method in which people rank a model's answers, a separate reward model learns to predict their preferences, and the main model is then tuned with reinforcement learning toward the answers people prefer.

• Distillation

  Training a smaller model to reproduce a larger model's outputs, aiming to keep much of the larger one's ability at a fraction of the cost to run.

• Parameters

  The numbers inside a model, its weights and biases, that are set during training and together hold what it learned.