91制片厂视频

Special Report
Classroom Technology

Educators Evaluate Array of Formative Testing Products

By Michele Molnar 鈥 October 17, 2014 7 min read
  • Save to favorites
  • Print
Email Copy URL

When he was teaching kindergarten, Shawn C. Rubin used a clipboard and green, yellow, and red crayons to track students鈥 progress on paper. Adjusting his teaching for each student鈥檚 ability level had the greatest possibility for advancing learning, he said, but it was also the most difficult assessment approach to do.

Now working to advance blended learning鈥攁 mix of face-to-face and online education鈥攊n all Rhode Island school districts and charter schools, he sees the magnitude of the formative-assessment challenge multiplied exponentially. Elementary teachers need to evaluate 鈥30 students a day in six subject areas with two competencies in each subject, and high school teachers might be tracking 200 students in one subject,鈥 said Mr. Rubin, the director of blended learning for the nonprofit Highlander Institute, a Providence, R.I.-based community of educators and professionals, and the CEO and co-founder of Metryx, a Providence-based company that has designed an ed-tech tool that allows teachers to track and analyze student mastery without crayons.

Metryx is just one of dozens of ed-tech products on the market today competing to help teachers and students with some aspect of the formative-assessment process, in which educators gauge learners鈥 understanding to pinpoint precisely what each has mastered, and adjusts teaching accordingly. The competition is heating up, in large part because formative assessments鈥 on-the-spot feedback about student mastery lies at the heart of scaling personalized learning.

But truly effective formative assessments need to go beyond simply evaluating students鈥 knowledge against standards and creating bar charts and graphs to show degrees of mastery, say some observers.

The most important question is: 鈥淗ow does this support the learning process?鈥 said Margaret Heritage, the assistant director for professional development for the National Center for Research on Evaluation, Standards, & Student Testing, or CRESST, at the University of California, Los Angeles. She describes formative assessment as an embedded process in which teachers are collecting evidence while students are learning.

In evaluating the growing collection of formative-assessment products on the market, Ms. Heritage said educators should be asking whether those products give them the items or tools that are linked to their immediate lesson goals and that provide actionable information. 鈥淢ost things I see out there don鈥檛 do that,鈥 she said.

Market Demand Rising

Analyzing growth trends in the testing- and assessment-market segments, 鈥渨e found a lot of excitement鈥攁nd therefore, demand鈥攁round formative, adaptive assessments that support personalized learning,鈥 said John Richards, the president of Consulting Services for 91制片厂视频 and the author of 鈥淏ehind the Data: PreK-12 Testing and Assessment Market,鈥 a report that the Washington-based Software & Information Industry Association was finalizing at press time. Formative-assessment products are now capturing some of the most sophisticated and nuanced learning measurements, including assessing skills such as collaboration, problem-solving, and conceptual understanding, according to Mr. Richards.

91制片厂视频al technology products that help conduct formative assessments are being packaged in three distinct ways, said Julia F. Freeland, a research fellow for the Clayton Christensen Institute, a San Mateo, Calif.-based think tank that studies trends in personalized learning. It is embedded in online curricula, such as ST Math, Lexia Learning, and DreamBox Learning; it is offered as a stand-alone assessment tool like MasteryConnect and its recent acquisition Socrative; and it is provided as part of adaptive-learning platforms such as Knewton, that aggregate data from numerous assessments and use those results to generate recommendations for individualized learning pathways.

The Market for Formative Testing Tools

Educators who want immediate feedback about their student comprehension have a growing list of ed-tech products to choose from to help them evaluate student mastery more quickly, and adjust their teaching accordingly. Some of the products that have made their way into schools include:

Acuity

Formative assessments used by more than 1,000 districts.

ForAllRubrics

A portable tool where assessments can be uploaded, created, or borrowed via mobile devices.

InfuseLearning

A student-response assessment tool for 鈥渂ring your own device鈥 environments.

MasteryConnect

A cloud-based software platform for educators to share and find assessments and resources, track mastery of standards, and use built-in grading tools.

Metryx

A tool to import standards, track mastery, and analyze results to differentiate teaching via mobile devices.

Naiku

Standards-based mobile formativeassessment tool.

Nutmeg 91制片厂视频

Assessment-building based on a question bank submitted by teachers, or teachers can create their own, via mobile devices.

Schoolnet

Pearson鈥檚 instructional management system, which includes formativeassessment tools.

Socrative

A tool to track student performance, aggregate results, and provide visuals to show students鈥 strengths and areas in need of improvement.

SparkWorks

Competency- and cloud-based software for online and mobile adaptive learning.

Taskstream

Portfolio- and data-management system that aims to support outcomes-based assessment.

SOURCES: Excerpted from 鈥淎ssessing Deeper Learning: A Survey of Performance Assessment and Mastery-Tracking Tools,鈥 a report produced by Getting Smart; 91制片厂视频 Week

For products that embed questions in online curricula, Ms. Freeland observes varying levels of trust among educators about the quality of those assessments.

In response to that concern, some ed-tech providers鈥攕uch as MasteryConnect and Renaissance Learning with its STAR Custom鈥攔ely in whole or in part on teacher-submitted assessments that can give educators the more-customized feedback they want.

Increasingly, ed-tech companies are matching their content and questions to specific standards, including the Common Core State Standards, which can be problematic. 鈥淎 single question could be tagged against one or multiple standards,鈥 she said. If a student answers a multiple-standard question incorrectly, it can cause confusion for teachers. 鈥淗ow are they expected to unbundle that,鈥 she asked.

Common Core Fuels Interest

The expected rollout this school year of the more complex common-core tests from the Partnership for Assessment of Readiness for College and Careers, or PARCC, and the Smarter Balanced Assessment Consortium brings with it an increasing interest in formative testing that goes beyond multiple choice and true/false responses. Some questions will require test takers to demonstrate the transfer of learning by asking them to show their work, or write a passage, for instance. To measure true transfer of learning, tasks must be 鈥渄esigned to provide students with opportunities to adapt or apply their knowledge in new or unique ways,鈥 said Eric M. Carbaugh, an associate professor in the department of middle, secondary, and math education at James Madison University in Harrisonburg, Va. 鈥淵ou can鈥檛 assess true transfer at all with multiple-choice questions,鈥 he said.

Mr. Carbaugh, who consults with schools and districts under the auspices of Alexandria, Va.-based ASCD Professional Learning Services, said many experts recommend a simple 鈥3-2-1" exit-card approach to helping teachers use formative assessments to gauge student understanding: 鈥淕ive me three big ideas you took away, two questions you have, and one way you think you can use it,鈥 he said he tells teachers. That information can go on a blog, in a journal, or on an index card. 鈥淚t鈥檚 a little messier, from a teacher鈥檚 standpoint, but we need to measure more than whether kids can get a right or wrong answer,鈥 he said.

Smarter Balanced recently released its digital library, which features mathematics and English/language arts literacy resources to help teachers with the formative-assessment process that can take the form of assignments, classroom discussions, and other approaches. The consortium contracted with Amplify, based in New York City, to build the interactive online modules, which are 鈥渕eant to demonstrate how the formative-assessment process is used to implement the intent of the Common Core State Standards,鈥 said Chrys Mursky, Smarter Balanced鈥檚 director of professional learning.

Integrating Response Data

The Northwest Evaluation Association, which is based in Portland, Ore. and produces the Measures of Academic Progress interim assessments that are adapted to students鈥 instructional levels, also owns the Formative Assessment Item Bank it acquired from the Princeton, N.J.-based 91制片厂视频al Testing Service. The 81,000-item bank, which is operated independently of the evaluation association, is usually licensed to platforms that can store and build tests and scan and report on data. It is also licensed directly to some districts.

Some companies are also creating products and services to help educators use polling software and 鈥渃licker鈥 technology to have students register responses to formative-assessment questions. Turning Technologies, a Youngstown, Ohio-based company, is one provider that integrates the data from its response systems with interactive whiteboards and on mobile devices. Poll Everywhere is an app that does the same.

Acuity, the McGraw-Hill 91制片厂视频 CTB Web-based assessment platform, offers 10- to 20-minute tutorials for students with embedded assessments to check students鈥 understanding of the material they are trying to learn, and it incorporates an online community where teachers can share resources and tests they have created.

Other formative-testing developments are also worth noting.

For instance, CRESST鈥檚 Ms. Heritage said a new K-3 formative-assessment platform in North Carolina that is under development with a state university, using Race to the Top and state funding, looks very promising. At the click of a button, teachers can view a progression and learn about strategies for collecting evidence. Plus, teachers can capture audio and video evidence, and add notes, to document student learning, then review information that would help teachers interpret the evidence, she said.

For the Christensen Institute鈥檚 Ms. Freeland, the fast growth of blended learning and an emerging competency-based education system鈥攕imilar to what is in place in New Hampshire鈥攁re harbingers of future formative-assessment opportunities for schools, and companies, if it is done well.

鈥淎s content becomes more widespread and commoditized,鈥 she said, 鈥渋t鈥檚 going to be all about online assessments to verify what students know.鈥

Coverage of personalized learning and systems leadership in 91制片厂视频 Week and its special reports is supported in part by the Eli and Edythe Broad Foundation. 91制片厂视频 Week retains sole editorial control over the content of this coverage.
A version of this article appeared in the October 22, 2014 edition of 91制片厂视频 Week as Formative-Assessment Tools Shape Personalized Lessons

Events

Recruitment & Retention Webinar Keep Talented Teachers and Improve Student Outcomes
Keep talented teachers and unlock student success with strategic planning based on insights from Apple 91制片厂视频 and educational leaders.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement: The Foundation for a Strong School Year
Learn how family engagement promotes student success with insights from National PTA, AASA鈥痑nd leading districts and schools.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Special 91制片厂视频 Webinar
How Early Adopters of Remote Therapy are Improving IEPs
Learn how schools are using remote therapy to improve IEP compliance & scalability while delivering outcomes comparable to onsite providers.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

Classroom Technology Black Students Are More Likely to Be Falsely Accused of Using AI to Cheat
Report notes why this is a problem that educators need to pay closer attention to.
2 min read
Student working on a computer.
E+
Classroom Technology What Schools Can Do to Make Teens Smarter Users of AI
Teens who have talked about AI in school are more likely to use it responsibly.
2 min read
Illustration of three educators in hard hats lifting up a very large letter "I" next to a large letter A.
DigitalVision Vectors
Classroom Technology Spotlight Spotlight on Media Literacy
This Spotlight will provide you with strategies to spot AI manipulation, review how media literacy has evolved in schools, and more.


This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Classroom Technology Whitepaper
The District Leader鈥檚 Guide to AI
This comprehensive guide explores how AI can support educators, enhance tutor training, personalize learning experiences, and drive stude...
Content provided by Saga 91制片厂视频