StudentSim: Training LLM-based Student Simulators
Summary
StudentSim trains personalized LLM-based student simulators from sparse data to mirror learner responses and adapt to tutor guidance, outperforming GPT-5.4 across chess, writing, and math domains.
View Cached Full Text
Cached at: 09/02/26, 03:45 AM
Paper page - StudentSim: Training LLM-based Student Simulators
Source: https://huggingface.co/papers/2609.01591
Abstract
StudentSim trains personalized student simulators from sparse data to mirror learner responses and adapt to tutor guidance, outperforming existing models across chess, writing, and math.
AI tutors are most useful when they adapt to each student’s strengths, weaknesses, and preferred guidance, but evidence about which guidance works for which student is sparse, slow, and costly to collect from real learners.Student simulatorscan provide this signal as a proxy, yet existing approaches are limited: state-tracking models fit student behavior but struggle to process explanations or corrections, while LLM role-play follows guidance fluently but does not reliably match the competence of the student being imitated. We present StudentSim, a training framework that turns sparse per-student data into individualized simulators throughpooled trainingfollowed byper-student specialization. The resulting simulators both mirror a student’s own responses and update them under tutor guidance. We also introduce StudentSimEval, a standardized protocol covering 60 students across chess, second-language English writing, and mathematics, using public learner datasets with de-identified records shared for research. StudentSimEval measuresbehavioral fidelity(F), or how well a simulator matches a student’s responses, andguidance responsiveness(R), or how readily it updates under tutor guidance, with all methods fit and evaluated on the same records. Across all three domains, StudentSim outperforms GPT-5.4 on both metrics. In chess, StudentSim reaches F=0.51 and R=0.91, compared with 0.23 and 0.72 for GPT-5.4 and 0.45 and 0.27 for Maia2. As a proof of concept, using StudentSim as areward modelfor tutorreinforcement learningproduces a chess tutor that expert humans rate as more accurate, better-guided, and more personalized than a no-RL baseline and a tutor trained against a GPT-5.4 simulator reward. Code is available at https://github.com/microsoft/StudentSim.
View arXiv pageView PDFProject pageGitHub10Add to collection
Get this paper in your agent:
hf papers read 2609\.01591
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2609.01591 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2609.01591 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2609.01591 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
From Mastery Profile to Simulated Response: Stochastic Student Knowledge Graphs (SSKG) for Faithful LLM Student Simulation
The paper proposes Stochastic Student Knowledge Graphs (SSKG) to enable faithful simulation of student knowledge by LLMs, overcoming the limitation where LLMs tend to perform at their own capability level instead of simulating varying mastery profiles.
INSIDE the Student's Mind: Jointly Modeling Latent Reasoning and Action in LLM Student Simulators
This paper presents INSIDE, a framework that fine-tunes LLMs to generate internal dialogue grounded in Bloom's Taxonomy, enabling student simulators to model both latent reasoning and observable actions. Evaluations show improved action fidelity and reasoning alignment compared to prompting baselines.
KnowSim: Evaluating Information Calibration in LLM Assistants with User Simulators that Learn
This paper presents KnowSim, an evaluation framework that models user knowledge states to assess information calibration in LLM assistants, validated against human judgments and outperforming baseline simulators.
LLM-as-a-Tutor: Policy-Aware Prompt Adaptation for Non-Verifiable RL
LLM-as-a-Tutor introduces a framework that extends LLM's role from judge to tutor by dynamically adjusting prompt difficulty through pairwise comparison and constraint addition, improving instruction-following performance in reinforcement learning.
SimSkill: A Lifelong Learning AI Agent for Autonomous Mastery of Traffic Simulation
SimSkill is a lifelong learning AI agent that autonomously masters traffic simulation by identifying capability gaps, generating tasks, and using memory systems to improve performance, showing up to 25% improvement in task completion on benchmarks.