Surprisal Theory is Tautological (without Rational Grounding)
By Ryan Cotterell · Paper · cs.CL
Surprisal theory holds that the human processing difficulty of a linguistic unit in context is an affine function of its surprisal under some language model. I argue this claim is a tautology without further constraint: for any non-negative difficulty measure over units in contex