Their preliminary results were “sobering,” according to a June report by the University of Chicago Education Lab and MDRC, a research organization.
The researchers found that tutoring during the 2023-24 school year produced only one or two months’ worth of extra learning in reading or math — a tiny fraction of what the pre-pandemic research had produced. Each minute of tutoring that students received appeared to be as effective as in the pre-pandemic research, but students weren’t getting enough minutes of tutoring altogether. “Overall we still see that the dosage students are getting falls far short of what would be needed to fully realize the promise of high-dosage tutoring,” the report said.
Monica Bhatt, a researcher at the University of Chicago Education Lab and one of the report’s authors, said schools struggled to set up large tutoring programs. “The problem is the logistics of getting it delivered,” said Bhatt. Effective high-dosage tutoring involves big changes to bell schedules and classroom space, along with the challenge of hiring and training tutors. Educators need to make it a priority for it to happen, Bhatt said.
Some of the earlier, pre-pandemic tutoring studies involved large numbers of students, too, but those tutoring programs were carefully designed and implemented, often with researchers involved. In most cases, they were ideal setups. There was much greater variability in the quality of post-pandemic programs.
“For those of us that run experiments, one of the deep sources of frustration is that what you end up with is not what you tested and wanted to see,” said Philip Oreopolous, an economist at the University of Toronto, whose 2020 review of tutoring evidence influenced policymakers. Oreopolous was also an author of the June report.
“After you spend lots of people’s money and lots of time and effort, things don’t always go the way you hope. There’s a lot of fires to put out at the beginning or throughout because teachers or tutors aren’t doing what you want, or the hiring isn’t going well,” Oreopolous said.
Another reason for the lackluster results could be that schools offered a lot of extra help to everyone after the pandemic, even to students who didn’t receive tutoring. In the pre-pandemic research, students in the “business as usual” control group often received no extra help at all, making the difference between tutoring and no tutoring far more stark. After the pandemic, students — tutored and non-tutored alike — had extra math and reading periods, sometimes called “labs” for review and practice work. More than three-quarters of the 20,000 students in this June analysis had access to computer-assisted instruction in math or reading, possibly muting the effects of tutoring.
The report did find that cheaper tutoring programs appeared to be just as effective (or ineffective) as the more expensive ones, an indication that the cheaper models are worth further testing. The cheaper models averaged $1,200 per student and had tutors working with eight students at a time, similar to small group instruction, often combining online practice work with human attention. The more expensive models averaged $2,000 per student and had tutors working with three to four students at once. By contrast, many of the pre-pandemic tutoring programs involved smaller 1-to-1 or 2-to-1 student-to-tutor ratios.
Despite the disappointing results, researchers said that educators shouldn’t give up. “High-dosage tutoring is still a district or state’s best bet to improve student learning, given that the learning impact per minute of tutoring is largely robust,” the report concludes. The task now is to figure out how to improve implementation and increase the hours that students are receiving. “Our recommendation for the field is to focus on increasing dosage — and, thereby learning gains,” Bhatt said.
That doesn’t mean that schools need to invest more in tutoring and saturate schools with effective tutors. That’s not realistic with the end of federal pandemic recovery funds.
Instead of tutoring for the masses, Bhatt said researchers are turning their attention to targeting a limited amount of tutoring to the right students. “We are focused on understanding which tutoring models work for which kinds of students.”
