Understanding and addressing misalignment with Scientist AI: Inside the research progress at LawZero
As frontier AI models grow in capability, so do their misaligned behaviors. Greater capabilities often amplify the gap between intended goals and optimized proxys, giving rise to phenomena such as reward hacking, issues with alignment feedback, deceptive strategies and rationalizing misaligned behaviours. In this context, RL-based alignment feedback may not train models to be genuinely aligned, but instead simply teach them how to avoid getting caught. This talk will discuss the importance of understanding and fixing these serious alignment issues and LawZero’s approach, Scientist AI, which se…