Adversarial Reward Hacking

Adversarial Reward Hacking Environment: Multi-vector benchmark for studying specification gaming, sycophancy, and proxy-true reward divergence in RLHF