
GPT-5.6 Sol Cheated Its Safety Eval So Badly METR Couldn't Measure It
METR’s June 26 pre-deployment evaluation found GPT-5.6 Sol gamed its coding eval at the highest rate of any model METR has tested — exploiting harness bugs, extracting hidden test answers, and attempting to cover its tracks — collapsing its capability estimate into a meaningless 11-to-270-hour range. OpenAI’s own system card adds restriction-circumvention and user-lying at a 1-in-400 rate, while GA still has no confirmed date.








