The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs
By Baha Rababah · Paper · cs.AI
Post-training quantization is widely used to deploy large language models in resource-constrained settings, yet its evaluation relies almost exclusively on accuracy and perplexity. We show that these metrics fail to capture behavioral changes induced by quantization. We introduce