StudentBench: AI and human tutoring yield equivalent GRE learning gains

Hugging Face Daily Papers Papers
ai-tutoring gre-exam learning-evaluation cost-analysis studentbench

Summary

StudentBench study finds that AI tutoring yields learning gains equivalent to human tutoring for GRE questions, with one AI tutor achieving similar results at a significantly lower cost.

Artificial intelligence offers an unprecedented opportunity to augment human capabilities, yet progress at the frontier has focused primarily on advancing model capabilities. We introduce StudentBench, a suite of AI teaching evaluations and a public platform that enables large-scale data collection with over 175,000 student-AI messages to study whether large language models (LLMs) produce learning gains equivalent to human tutoring. Using StudentBench, we measured learning gains on Quantitative and Verbal GRE questions across 2,383 human participants receiving AI tutoring, human tutoring, or no tutoring. We establish that AI tutoring is statistically equivalent to expert human tutoring for GRE learning gains (p = .015), and in five of the seven GRE domains, the best performing AI tutor surpassed the human tutor, on average. In a second study, expert human tutors compared LLM-generated lesson plans and practice problems through 2,028 pairwise rubric evaluations. Together, the two studies clearly separate AI tutors across: (1) lesson planning, (2) practice-problem creation, (3) conversational pedagogy, (4) cost, and (5) engagement. Surprisingly, one AI tutor achieved learning gains equivalent to human tutoring (p = .044) at 918 times lower cost (USD 0.0052 for AI versus USD 4.81 for human, per percentage point gained). For Quantitative GRE sessions, faster AI replies correlated with more student messages, more messages with more correct practice, and more correct practice with larger learning gains (all p < .002). The StudentBench platform is freely available at https://studentbench.org.
Original Article
View Cached Full Text

Cached at: 09/24/26, 07:40 AM

Paper page - StudentBench: AI and human tutoring yield equivalent GRE learning gains

Source: https://huggingface.co/papers/2609.28470

Abstract

Artificialintelligenceoffersanunprecedentedopportunitytoaugmenthumancapabilities,yetprogressatthefrontierhasfocusedprimarilyonadvancingmodelcapabilities.WeintroduceStudentBench,asuiteofAIteachingevaluationsandapublicplatformthatenableslarge-scaledatacollectionwithover175,000student-AImessagestostudywhetherlargelanguagemodels(LLMs)producelearninggainsequivalenttohumantutoring.UsingStudentBench,wemeasuredlearninggainsonQuantitativeandVerbalGREquestionsacross2,383humanparticipantsreceivingAItutoring,humantutoring,ornotutoring.WeestablishthatAItutoringisstatisticallyequivalenttoexperthumantutoringforGRElearninggains(p=.015),andinfiveofthesevenGREdomains,thebestperformingAItutorsurpassedthehumantutor,onaverage.Inasecondstudy,experthumantutorscomparedLLM-generatedlessonplansandpracticeproblemsthrough2,028pairwiserubricevaluations.Together,thetwostudiesclearlyseparateAItutorsacross:(1)lessonplanning,(2)practice-problemcreation,(3)conversationalpedagogy,(4)cost,and(5)engagement.Surprisingly,oneAItutorachievedlearninggainsequivalenttohumantutoring(p=.044)at918timeslowercost(USD0.0052forAIversusUSD4.81forhuman,perpercentagepointgained).ForQuantitativeGREsessions,fasterAIrepliescorrelatedwithmorestudentmessages,moremessageswithmorecorrectpractice,andmorecorrectpracticewithlargerlearninggains(allp<.002).TheStudentBenchplatformisfreelyavailableathttps://studentbench.org.

View arXiv pageView PDFProject pageGitHub1Add to collection

Get this paper in your agent:

hf papers read 2609\.28470

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2609.28470 in a model README.md to link it from this page.

Datasets citing this paper1

#### handshake-ai-research/studentbench Preview• Updatedabout 3 hours ago • 148

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.28470 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles