StudentBench: AI and human tutoring yield equivalent GRE learning gains
Ranking
Observed public metrics from 1 member.
Merged summary
TL;DR - StudentBench finds that LLM tutors can deliver GRE learning gains statistically equivalent to expert human tutoring, with the strongest AI tutor achieving this at 918 times lower cost. The benchmark and public platform provide large-scale evaluations of lesson planning, practice generation, conversational pedagogy, cost, and engagement.
- The study evaluated 2,383 participants receiving AI tutoring, human tutoring, or no tutoring across Quantitative and Verbal GRE questions.
- AI tutoring was statistically equivalent to expert human tutoring overall; the best AI tutor also outperformed the human tutor on average in five of seven GRE domains.
- Expert tutors conducted 2,028 pairwise rubric evaluations of LLM-generated lesson plans and practice problems.
- In Quantitative GRE sessions, faster responses correlated with more student messages, which correlated with more correct practice and larger learning gains.
Sources (1)
StudentBench: AI and human tutoring yield equivalent GRE learning gains
TL;DR - StudentBench finds that LLM tutors can deliver GRE learning gains statistically equivalent to expert human tutoring, with the strongest AI tutor achieving this at 918 times lower cost. The benchmark and public platform provide large-scale evaluations of lesson planning, practice generation, conversational pedagogy, cost, and engagement.
- The study evaluated 2,383 participants receiving AI tutoring, human tutoring, or no tutoring across Quantitative and Verbal GRE questions.
- AI tutoring was statistically equivalent to expert human tutoring overall; the best AI tutor also outperformed the human tutor on average in five of seven GRE domains.
- Expert tutors conducted 2,028 pairwise rubric evaluations of LLM-generated lesson plans and practice problems.
- In Quantitative GRE sessions, faster responses correlated with more student messages, which correlated with more correct practice and larger learning gains.