Colleges that ditched test scores for admissions still struggle with bias

Before the pandemic, the move to test-optional admissions was already gathering steam as concerns mounted over the fact that wealthier students could hire tutors, take the tests multiple times and post higher scores. Other critics said that the paperwork to waive testing fees was a barrier for many low-income students. Then, during the pandemic, it became nearly impossible for students to sit for exams and the vast majority of colleges eliminated testing requirements. Some have since restored them, but many haven’t.

Slay’s research is still ongoing, and she presented her preliminary findings at the 2022 annual conference of the Association For Education Finance & Policy. When I interviewed her in October 2022, she and her research team had interviewed 22 admissions officers from 16 colleges and universities. All were four-year institutions, but they ranged from public to private, large to small, and religious to nonreligious. Four of the colleges had dropped testing requirements in the years before the pandemic with the remaining 12 doing so during the pandemic.

It’s not surprising that colleges that went test-optional during the pandemic were suddenly scrambling to decide how to review applications without standardized tests. But the researchers learned that even colleges who had years of experience with test-optional admissions were still working out the details of how to implement it.

Admissions officers worried that their colleges were replacing standardized tests with metrics that were even more biased toward wealthier and white students, such as letters of recommendation and expensive extra-curricular activities. One college purchased a data service that ranked high schools and factored those high school rankings into each application. Students from underserved high schools received a lower ranking, an admissions officer explained. It wasn’t a fair process.

Many admissions officers said that they were struggling with how to select candidates fairly and didn’t know how to weigh an application with test scores against one without. “I think the students that do have the strong test scores still do have that advantage, especially when you have a student that has strong test scores versus a student who doesn’t have test scores and everything else on the academics is more or less the same,” an admissions officer told Slay.

“It’s really hard to ignore test scores if that’s the way you were trained to review applications and think about merit,” said Slay. “If the standardized test is there in the file, it might still bias you in ways that you’re not aware of. It’s an anchoring bias.”

Admissions officers also described how they struggled to answer a frequent, but basic question: are you really test optional? Students wanted to know if they would have an advantage if they did submit a test score. Slay said admissions officers wished they had better guidance on how to answer this question. Since college entrance exam scores could also be used for certain scholarships and determining course placements once admitted, it was difficult for admissions officers to say that the test wasn’t still important.

Larger workloads were a common complaint. College admissions officers said they were spending more time on each application in an effort to be diligent. Plus, the volume of applications had increased “a lot” at selective schools, Slay said. Meanwhile, many offices lost staff during COVID. Some employees resigned amid the strong job market. Budget cuts at some schools led to layoffs and furloughs. Slay said that some admissions offices were operating with a “skeletal” staff.

The stress and pressure of being short-staffed and confused could affect anyone’s decision making. The conditions were ripe for amplifying implicit biases – exactly the opposite of the intent of the test-optional policy.

Slay is hearing from colleges that test-optional policies have increased the diversity of the applicant pool, but it’s not translating into a more diverse student body.

“One of the things we concluded is that test optional does not mean an increase in diversity – racial diversity or socio-economic diversity,” said Slay. “If we haven’t figured out how to review students who come from diverse backgrounds who come from schools where they may not have the same access to AP or IB courses, then that could mean that these students still aren’t going to be admitted.”