Rethinking Expressivity and Efficiency in Test-Time Training
By Zeyun Zhong · Paper · cs.LG
Test-Time Training (TTT) enables long-context processing via continuous weight updates during inference, but current methods struggle to balance the expressivity of per-token update dynamics with the hardware efficiency of chunk-wise approximations. We propose E$^2$-TTT (Expressi