OmniEdu: Open Foundation Models for Learning and Teaching

Hugging Face Daily Papers Papers
education foundation-models language-models fine-tuning curriculum pedagogy open-source

Summary

OmniEdu introduces an open family of foundation models for K-12 education, trained on a curated corpus to improve problem-solving, curriculum grounding, and pedagogical tutoring capabilities.

Educational foundation models must solve problems, understand curriculum structure, diagnose learner difficulties, and provide appropriate instructional support. Existing educational language models often focus on either problem solving or tutoring, with training mixtures organized by source or task rather than capability. We present OmniEdu, an open family of foundation models for K-12 learning and teaching. Its instruction-tuning corpus combines over 100 educational resources and general instruction sources, organized around four capabilities: subject competence, curriculum grounding, diagnostic reasoning, and pedagogical action and scaffolding. Our pipeline integrates deterministic cleaning, semantic auditing and rewriting, task-specific quality scoring, token-budgeted diversity selection, and pedagogical instruction assignment. It yields 69,999 examples and 15.96M supervised response tokens, including 60,951 education-specific examples. We fine-tune 4B, 9B, and 27B models and evaluate curriculum grounding, K-12 problem solving, and pedagogical tutoring, alongside general capability. Education-oriented tuning consistently improves all three educational benchmark groups across model scales. OmniEdu-27B achieves 63.12% EM and 76.69% F1 on K12-Bench, 85.89% on MathFish, 86.95% on EDUMATH, and 78.74% in MathTutorBench's Scaffold setting. It also achieves the highest Teaching average on LongTutor among the evaluated models, at 3.02. These results demonstrate the value of curated, capability-balanced supervision for adapting general language models to educational tasks spanning problem solving, curriculum understanding, and instructional support.
Original Article
View Cached Full Text

Cached at: 09/22/26, 07:26 AM

Paper page - OmniEdu: Open Foundation Models for Learning and Teaching

Source: https://huggingface.co/papers/2609.23088

Abstract

Educationalfoundationmodelsmustsolveproblems,understandcurriculumstructure,diagnoselearnerdifficulties,andprovideappropriateinstructionalsupport.Existingeducationallanguagemodelsoftenfocusoneitherproblemsolvingortutoring,withtrainingmixturesorganizedbysourceortaskratherthancapability.WepresentOmniEdu,anopenfamilyoffoundationmodelsforK-12learningandteaching.Itsinstruction-tuningcorpuscombinesover100educationalresourcesandgeneralinstructionsources,organizedaroundfourcapabilities:subjectcompetence,curriculumgrounding,diagnosticreasoning,andpedagogicalactionandscaffolding.Ourpipelineintegratesdeterministiccleaning,semanticauditingandrewriting,task-specificqualityscoring,token-budgeteddiversityselection,andpedagogicalinstructionassignment.Ityields69,999examplesand15.96Msupervisedresponsetokens,including60,951education-specificexamples.Wefine-tune4B,9B,and27Bmodelsandevaluatecurriculumgrounding,K-12problemsolving,andpedagogicaltutoring,alongsidegeneralcapability.Education-orientedtuningconsistentlyimprovesallthreeeducationalbenchmarkgroupsacrossmodelscales.OmniEdu-27Bachieves63.12%EMand76.69%F1onK12-Bench,85.89%onMathFish,86.95%onEDUMATH,and78.74%inMathTutorBench’sScaffoldsetting.ItalsoachievesthehighestTeachingaverageonLongTutoramongtheevaluatedmodels,at3.02.Theseresultsdemonstratethevalueofcurated,capability-balancedsupervisionforadaptinggenerallanguagemodelstoeducationaltasksspanningproblemsolving,curriculumunderstanding,andinstructionalsupport.

View arXiv pageView PDFProject pageGitHub1Add to collection

Get this paper in your agent:

hf papers read 2609\.23088

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.23088 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.23088 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.23088 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

Discovery Foundation Models: Toward Open-Ended Discovery Intelligence

Hugging Face Daily Papers

Discovery Foundation Models are proposed as general-purpose systems for enabling open-ended scientific discovery through iterative problem formulation, hypothesis testing, and evidence-based revision across dry and wet lab settings. The paper introduces a framework with capabilities like problem discovery and continual improvement, instantiated with systems like Zetema and GALILEO.

OmniOPD: Logit-Free On-Policy Distillation via Speculative Verification

Hugging Face Daily Papers

OmniOPD introduces a logit-free on-policy distillation method that uses chunk-level semantic similarity and speculative verification to train student models with black-box teachers, achieving up to +28.64% improvement on math benchmarks over standard OPD.