‹ back to 2026-08-15

LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure

Research LLMs & Foundation Models

Ranking

Overall 85

Content 95

Popularity 60

Observed public metrics from 1 member.

Merged summary

TL;DR - LittleLearner is a 5B-parameter language model trained from scratch on an 88B-token corpus restricted to U.S. elementary-school material. It provides a controlled sandbox for studying knowledge acquisition with interpretable exposure and capability boundaries.

LITTLECURRICULUM excludes concepts, facts, and vocabulary taught above Grade 5.
The resulting model retains enough language competence for open-ended evaluation while exhibiting curriculum-aligned knowledge limits.
Post-training and in-context learning improved the use of existing knowledge but did not increase out-of-scope capabilities.
The authors release both the corpus and model for research on how models acquire, represent, and apply knowledge.

Sources (1)

LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure

arXiv cs.CL Fanfei Li, Jana Zeller, Manuel Prada-Corral, Thaddäus Wiedemer, Prasanna Mayilvahanan, Ryan Cotterell, Wieland Brendel 2026-08-13 arXiv:2608.13545

Public signals Hugging Face upvotes 8

Providers: Hugging Face · Upvotes 8 OpenAlex · N/A Publisher · N/A Semantic Scholar · N/A X · N/A Fetched 2026-09-14 14:23:33.068166 UTC

LITTLECURRICULUM excludes concepts, facts, and vocabulary taught above Grade 5.
The resulting model retains enough language competence for open-ended evaluation while exhibiting curriculum-aligned knowledge limits.
Post-training and in-context learning improved the use of existing knowledge but did not increase out-of-scope capabilities.
The authors release both the corpus and model for research on how models acquire, represent, and apply knowledge.

item →