Democratic ICAI: Debating Our Way to Steering Principles from Preferences
By Kevin Kingslin · Paper · cs.LG
Preference-based alignment often struggles to capture the reasoning that underlies human judgments. Many evaluations rely on multiple interacting criteria, yet pairwise labels reveal only the final choice rather than the considerations that shape preferences. Inverse Constitution