Stanford Study Compares Chain-of-Thought and DPO Alignment Techniques at Frontier Scale

Researchers at Stanford CRFM have published a head-to-head comparison of chain-of-thought alignment and Direct Preference Optimization (DPO) methods at frontier model scales. The study finds DPO-trained models show more consistent task performance but higher susceptibility to adversarial instruction injection compared to CoT-trained counterparts. Authors recommend a hybrid approach for high-stakes deployment scenarios.