LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure
By Fanfei Li · Paper · cs.CL
Modern language models are trained on heterogeneous web-scale text corpora. Consequently, studying knowledge and skill acquisition is difficult, as prior exposure to related content is hard to characterize. To address this challenge, we introduce LITTLECURRICULUM, a curated 88B-t