91制片厂视频

Special Report
School & District Management

Proof Lacking on Success of Staff Development

By Stephen Sawchuk 鈥 November 10, 2010 6 min read
  • Save to favorites
  • Print
Email Copy URL

Anecdotes about districts鈥 success stories with particular professional-development brands, services, and approaches are common in today鈥檚 marketplace. But is there proof that any of them actually work?

For the most part, the answer is no, according to scholars who have studied the link between postlicensure teacher training and student academic achievement. Reasons for that dearth of evidence include a general lack of rigor in education research, as well as specific obstacles that make studying professional development鈥檚 impact on student achievement a challenge.

Few studies of professional development employ scientifically rigorous methodologies. The research literature on the training, scholars say, is largely qualitative or descriptive, and therefore not capable of answering nuanced cause-and-effect questions.

At the same time, there are many problems with those programs and studies that do purport to tackle the student-achievement question.

Professional Development:
Sorting Through the Jumble to Achieve Success
Professional Development for Teachers at Crossroads
Proof Lacking on Success of Staff Development
Mass. District Strives for Teacher 鈥楲earning System鈥
Mich. District Adds Accountability to Staff Training
Staff-Development Providers Eye New Opportunities
Full Cost of Professional Development Hidden
Questions Arise Over Teacher-Credential Expenses
Experts Search for Best Content to Train Teachers
Texas District Targets Teachers for ELL Training
Web Extras
Interactive: Teacher Voices View video profiles of teachers discussing professional development.
Digital Edition View the interactive PDF version of this report.
Resources

鈥淔irst, the intervention itself should be workable, and some are not supported by theory or scientific action. Second, the program needs to be fully implemented if you want to see any effects, and in many cases, fidelity is a real challenge,鈥 said Kwang S. Yoon, an analyst at the Washington-based American Institutes of Research who studies in-service training. 鈥淎nd the third piece is the intervention research itself. It may be weak in design.鈥

For a commissioned by the U.S. Department of 91制片厂视频, Mr. Yoon and colleagues pulled more than 1,300 potentially relevant research studies of professional development conducted between 1986 and 2006.

Only 132 specifically focused on K-12 in-service training in reading, mathematics, or science. And of those, only nine studies met evidence standards set by the What Works Clearinghouse, the arm of the federal Institute of 91制片厂视频 Sciences that reviews experimental research on program impact.

Time on Task

The review found that, across the nine studies, only the teachers who received a substantial amount of development boosted students鈥 scores. Three of the nine studies, those that examined summer institutes or workshops between five and 14 hours in length, showed no effect on student achievement. The studies that looked at teachers trained between 30 and 100 hours were correlated with positive student-achievement gains.

Advocates have seized on those findings as evidence that the amount of time currently spent on professional development is insufficient. But given the small sample sizes of most of those studies, Mr. Yoon said, they don鈥檛 provide conclusive answers to the question of how much time spent in training matters.

Rather, he said, the effects of professional development are likely functions of both the time and the quality of the specific training. 鈥淵ou can have many, many hours without much engagement,鈥 he noted. 鈥淎ny serious teacher change or teacher learning requires intensive treatment of some topic of significance.鈥

An added problem is that professional development is mediated through teachers鈥 own practices. A successful in-service-training program, therefore, must inculcate in teachers behaviors that improve outcomes for students.

鈥淓ven if professional development is effective and a teacher learned something, what makes them really improve their practice in the classroom when they are so busy and so tired?鈥 Mr. Yoon said. 鈥淚 don鈥檛 think there is a huge external incentive for the teachers to practice their new learning. ... I think that鈥檚 a huge [research] gap that we do not think to pay much attention to.鈥

Multimedia: Teacher Voices

BRIC ARCHIVE

These mini-profiles鈥攊ncluding video interviews鈥攁re meant to provide insight, but not to serve as representative examples of the districts in which they teach or programs in question. Their diverse experiences highlight the challenges districts face in providing high-quality training matched to each teacher鈥檚 needs.

View Teacher Profiles >>>

Some of the largest-scale studies have found that even when teachers have indeed changed practices in response to a professional-development intervention, those changes haven鈥檛 led to greater student learning.

A used a randomized experiment to look at the impact of two early-reading intervention programs. It found that the intervention caused significant increases in teachers鈥 knowledge and changes in their teaching practices, but did not significantly enhance students鈥 reading achievement.

Many professional-development advocates say one way to ensure that teachers both have enough time for professional development and work to improve their own practice is through site-based professional learning communities. Such communities are formed of teams of teachers who meet frequently to review student-achievement information and tailor instruction accordingly.

High-quality studies specifically focused on the effect of the PLC format of professional development remain sparse, despite the model鈥檚 common-sense appeal. The studies that do exist suggest that the success of such endeavors might hinge on having a formal, systematic approach and possibly experts to help guide teachers.

A published in 2009 in the Elementary School Journal found an achievement edge for schools whose learning teams relied on a set of formal protocols, a leadership structure that guided meetings, and a process for setting forth and solving problems. The study used a quasi-experimental methodology to compare students in nine Title I schools that used that specific framework with students in six other schools using a variety of other school improvement models.

Too Site-Based?

Some scholars worry that the pendulum has already swung too far toward site-based development without proper attention to how the training is structured and led.

鈥淔or a long time, most professional development was guided or directed by a central office or a regional office, and those efforts lacked the contextual relevance that was really necessary,鈥 said Thomas R. Guskey, a professor of educational psychology at the University of Kentucky. 鈥淣ow, we鈥檝e swung the other way and said we have to be completely site-based. ... Solutions can鈥檛 always come from inside, and oftentimes the findings from research can be particularly instructive, but teachers need guidance and direction on what can be done to bring it to bear in their classrooms.鈥

Russell M. Gersten, a professor emeritus of education at the University of Oregon, seconds the idea that researchers need to do more to investigate features that seem to yield the most effective site-based training. He and colleagues crafted and tested their own approach for building 1st grade teachers鈥 capacity to teach reading comprehension and vocabulary, through facilitated study groups that met to discuss empirical reading research and create aligned lesson plans and instruction.

A randomized study of the approach conducted by Mr. Gersten and his team found that teachers aligned their practices with the research, producing modest but statistically significant progress on measures of oral-vocabulary development. Released this year, the compared teachers in 19 schools receiving federal Reading First funding in three states.

Gains didn鈥檛 show up in other areas, but Mr. Gersten said his team is working on a larger-scale study with more statistical 鈥減ower鈥 to see if the results can be replicated.

A version of this article appeared in the November 10, 2010 edition of 91制片厂视频 Week as No Proof-Positive for Training Approaches

Events

Recruitment & Retention Webinar Keep Talented Teachers and Improve Student Outcomes
Keep talented teachers and unlock student success with strategic planning based on insights from Apple 91制片厂视频 and educational leaders.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement: The Foundation for a Strong School Year
Learn how family engagement promotes student success with insights from National PTA, AASA鈥痑nd leading districts and schools.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Special 91制片厂视频 Webinar
How Early Adopters of Remote Therapy are Improving IEPs
Learn how schools are using remote therapy to improve IEP compliance & scalability while delivering outcomes comparable to onsite providers.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

School & District Management Opinion From One Superintendent to Another: Get Political
Strong relationships with political leaders help create a supportive network for your schools, even amid partisan turbulence.
George Philhower
5 min read
Vector of an education leader hand holding a book bridging the gap in education for a group of political people walking on
Feodora Chiosea/iStock
School & District Management Q&A What Should School Administrators Wear to Work? A Superintendent鈥檚 Style Tips
Melanie Kay-Wyatt describes her wardrobe as professional, comfortable, and colorful.
3 min read
Melanie Kay-Wyatt stands for a portrait inside Alexandria City High School on Sept. 9, 2024 in Alexandria, Va. Kay-Wyatt serves as superintendent for Alexandria City Public Schools.
Melanie Kay-Wyatt, the superintendent for the Alexandria, Va., school district, stands for a portrait inside Alexandria City High School on Sept. 9, 2024. She considers her professional style to be an important part of how she presents herself in her role.
Maansi Srivastava for 91制片厂视频 Week
School & District Management Video How School Leaders Can Learn to 'Disagree Better'
Leaders can鈥檛 avoid conflict. But they can learn to manage it more effectively.
3 min read
School & District Management Opinion 3 Ways School Leaders Can Build Collective Understanding
Initiatives will fail without school staff being included in these key conversations.
5 min read
Screenshot 2024 09 07 at 11.41.23鈥疉M
Canva