Resist and Update: Counterfactual Report Coordinates for Incentive-Compatible LLMs
By Sen Yang · Paper · cs.AI
Aligned language models routinely misreport under non-evidential incentive pressure: they agree with a confident user or overstate certainty even when their internal belief is unchanged. We cast this as a failure of internal incentive-compatibility (IC) and present a method for l