Reinforcement learning

See also

• Reinforcement learning from human feedback

  A training method in which people rank a model's answers, a separate reward model learns to predict their preferences, and the main model is then tuned with reinforcement learning toward the answers people prefer.

• Reward hacking

  When a model trained with rewards finds a way to score well that its designers did not intend, such as gaming a test instead of solving the task.

• Reasoning model

  A model trained to work through a problem in steps before it answers, spending more test-time compute on problems such as math, coding and analysis.