Imagine a world where school districts鈥� hiring departments can predict the longevity and effectiveness of a teacher before she steps foot into a classroom.
It鈥檚 a scenario that鈥檚 proved difficult to make reality, but a body of emerging research is making inroads. There are a handful of research-practitioner partnerships across the country working to improve teacher hiring through a strategic approach to job interviews, recommendations, and resume screenings.
鈥淭he basic question [behind the research] is, 鈥楬ow can schools do a better job of choosing among applications who to hire?鈥� 鈥� said Aaron Sojourner, a labor economist at the University of Minnesota. 鈥淭he current state of practice is pretty idiosyncratic, pretty uneven.鈥�
Sojourner and other researchers partnered with the Minneapolis school district to determine whether teachers鈥� resumes can predict how effective they鈥檒l be in the classroom and how long they鈥檒l stay. The researchers studied seven years of teachers鈥� resumes, as well as subsequent teacher-evaluation and retention data on hires.
鈥淚n many ways, it鈥檚 very sensible,鈥� Sojourner said. Researchers found that teacher applicants with relevant work experience were more likely to be effective and long-serving. And applicants who have a history of short tenure in past jobs were more likely to be poor performers.
Still, Sojourner said, the main value of the research, which is expected to be published this month, has been to come up with a way to take a resume and turn it into an objective measure of relevant work experience. The researchers developed an algorithm to match job descriptions and titles on applicants鈥� resumes to the U.S. Department of Labor鈥檚 occupation data set.
The data set is able to match occupations to the knowledge, skills, and abilities typically acquired in those positions. Instead of hiring managers trying to determine whether candidates鈥� past experiences will make them a good fit for teaching positions, the screening tool will generate that information.
鈥淚 think this has been the big obstacle for the profession: [Applicants] give you words to describe their past jobs, but how do you interpret those words?鈥� Sojourner said. Hiring teams don鈥檛 always remember how past hires turned out or what their resumes looked like when they applied, he said.
"[Now], you can process the resumes and get a ranking鈥� based on the district鈥檚 history of hiring and teaching, Sojourner said. 鈥淲e鈥檙e not recommending this as a replacement for human judgment, for expert judgment, but as an aid.鈥�
Officials from the 36,700-student school district in Minneapolis declined to comment, as the research has not yet led to changes to their hiring systems.
Another strand of research is developing in Spokane, Wash. The 31,000-student district there created a two-phase screening system for teacher applicants. The central human resources office scores applicants based on recommendations and the experience and skills on their resumes. Then, principals look at the candidates who have met a particular cutoff score and do another round of evaluations before bringing prospective teachers in for interviews.
A team of researchers found in 2014 that each of these screening processes had some predictive power in terms of teacher effectiveness. For instance, the effect on student achievement is roughly equivalent to being assigned to a second- or third-year teacher rather than a novice teacher.
Now, Dan Goldhaber, the director of the Center for 91制片厂视频 Data and Research at the University of Washington, who was one of the researchers, is expanding on that research by studying the impact of professional recommendations and references.
He has asked supervisors who write letters of recommendation to privately rate the teacher applicants on their strengths and weaknesses in six areas, including cultural competency, classroom management, and student engagement. While the results are expected to be released sometime in the next few months, Goldhaber said the findings are 鈥渆ncouraging.鈥�
Putting Data at the Center
The research-practitioner partnership in Spokane has helped the district鈥檚 hiring department make more strategic choices, said Kim Harmon, the director of recruitment and retention for the district.
鈥淚t鈥檚 helped us to put data more toward the center of several of our conversations,鈥� she said. 鈥淲e鈥檙e trying to take the guesswork out of hiring.鈥�
Even so, Harmon said, they haven鈥檛 found a silver bullet in determining who will make for an effective, long-serving teacher.
鈥淚 think that this data is helping us to get a little more pinpointed and narrow鈥� in hiring decisions, she said. 鈥淏ut I think there鈥檚 still a lot more research to be done.鈥�
The small but growing body of research includes work being done in Los Angeles. In the 2014-15 school year, the district there adopted a standardized screening process for prospective teachers with eight components, including a writing sample and the delivery of a sample lesson. Applicants are scored based on rubrics, many of which are aligned to the district鈥檚 teacher-evaluation system.
Researchers found the screening process is predictive of performance, as measured by contributions to student test-score growth, evaluation scores, and teacher attendance. But it鈥檚 a trade-off for the district, since different components are predictive of different outcomes, said Katharine Strunk, a professor of education policy at Michigan State University and one of the researchers involved.
For example, scores on a sample lesson assessment are meaningfully predictive of teachers鈥� contributions to student achievement, while professional references are predictive of teacher attendance.
The Scope of Strategic Hiring
It鈥檚 hard to say exactly how prevalent these screening processes are in school districts across the country.
鈥淢ost school districts in the country are really, really small,鈥� Goldhaber said. 鈥淭hey might not have the capacity or the need to have a formalized system.鈥�
One indication might be a 2018 survey from the Frontline Research and Learning Institute, which asked nearly 600 school and district hiring managers from around the country about their hiring preferences. Just about 5 percent said they had a quality protocol in place to assess applicants.
鈥淭here鈥檚 not a significant deep dive into candidate quality or instructional practices,鈥� said Elizabeth Combs, the managing director of the institute, which is a division of Frontline 91制片厂视频, a K-12 software company. She noted only 30 percent of respondents said they asked applicants to provide a sample lesson plan.
Still, many school districts struggle with shortages of qualified applicants in certain subjects, like special education or high school math and science. For those districts, strategic hiring might not be possible, said Elizabeth Arons, the chief executive officer of Urban Schools Human Capital Academy, which focuses on human resources reform in school systems.
鈥淚f I鈥檓 hiring a math teacher and HR says to me, 鈥業 have one person in the pool,鈥� you鈥檙e going to say, 鈥極K, send them over,鈥� 鈥� she said. 鈥淐learly, the more choices you have, the more strategic your hiring will be.鈥�
Establishing a screening mechanism can also be costly for districts, Strunk acknowledged, but she pointed to research that shows that urban districts can, on average, spend more than $20,000 on each new hire, which includes expenses related to recruitment, hiring, and training.
It makes financial sense for districts to invest in selection mechanisms that help them predict which teacher applicants will be successful, she said.
After all, trying to improve in-service teachers through evaluations and professional development is tricky and often controversial, Goldhaber said: 鈥淔ocusing on how do you improve the quality of teachers who enter the teaching workforce is a lot less politically contentious.鈥�
