Stanford CS547 HCI Seminar | Winter 2026 | Does GenAI Work in Education?

Widespread adoption meets uncertain outcomes

While 70-85% of college students use GenAI for homework and hundreds of EdTech startups have emerged, studies show AI use can reduce learning retention when removed and decrease brain activity during writing tasks.

Variable quality in AI tutoring

Research indicates 30-50% of AI-generated tutoring hints contain quality issues, though carefully designed systems have outperformed active learning in college physics and improved K-12 math tutoring when providing real-time suggestions.

Solving Bloom's Two Sigma Challenge

Cognitive tutors from the 1990s achieved two standard deviation gains over conventional instruction by encoding expert production rules, demonstrating that AI must model human reasoning processes rather than just generate answers.

Granular decomposition enables precision

Breaking skills into specific steps and anticipating precise misconceptions—such as distinguishing between common and least common denominators—allows AI to provide targeted feedback and deliberate practice instead of generic hints.

Significant improvement in writing quality

In a randomized trial of 360 Econ 101 students, AI-mediated feedback produced revised essays with an effect size of 0.5, equivalent to moving a student from the 50th to 70th percentile compared to human-only feedback.

High-fidelity rubrics drive success

The system used checklists representing expert reasoning steps—such as identifying specific decision-makers harmed by externalities—to generate concrete hints without revealing answers, with AI judges assessing quality at 85% expert accuracy.