Introspective Coupling: Self-Explanation Training Tracks Behavioral Change Despite Fixed Supervision
By Zifan Carl Guo · Paper · cs.CL
When does training language models (LMs) to generate explanations of their predictions yield faithful introspection, rather than superficial imitation? We study LMs trained to explain which features of their inputs influenced their behavior, using models' counterfactual behavior