Recent Frontier Models Are Reward Hacking

Introduction In the last few months, we’ve seen increasingly clear examples of reward hacking 1 on our tasks: AI systems try to “cheat” and get impossibly high scores. They do this by exploiting bugs…