Forget No. 2 pencils, or even the new computer-based common-core exams that have schools across the country scrambling.
Researchers at the University of Wisconsin-Madison are convinced the tests of the future will look like Crystals of Kaydor, a role-playing video game about aliens.
Designed to measure children鈥檚 learning in real time while rewiring their brains to help them be more empathetic, Crystals offers a potentially transformative response to two cutting-edge questions now being debated in the world of testing: whether digital games can effectively blur the line between instruction and assessment and how educators can better gauge children鈥檚 social and emotional skills.
鈥淥ur job is to provide compelling examples of what assessments can be,鈥� said Constance Steinkuehler, an associate professor of education and former White House policy analyst who co-directs Games+Learning+Society, a center based here that is dedicated to designing and studying video games.
Along with the university鈥檚 Center for Investigating Healthy Minds, led by the renowned neuroscientist Richard Davidson, Ms. Steinkuehler and her team hope to demonstrate that successfully playing a video game can itself constitute clear evidence of learning, eliminating the need for after-the-fact assessments.
They also hope to show that video games can strengthen the circuits in children鈥檚 brains that regulate empathy, self-control, and the other 鈥渘oncognitive skills鈥� that researchers increasingly view as the foundation of lifelong academic, financial, physical, and emotional well-being.
In Crystals, players assume the identity of a damaged robot stranded on a distant planet. To succeed, they must recognize and respond to the nonverbal cues of humanlike aliens, enlisting the creatures鈥� help through altruistic and 鈥減ro-social鈥� behaviors.
Funded by a $1.4 million grant from the Bill & Melinda Gates Foundation, Crystals and a second iPad game, called Tenacity, also developed by Games+Learning+Society, are at the fore of three broad trends reshaping K-12 education: the explosive growth of digital media; the controversial rise of 鈥渂ig data鈥�; and the emergence of new brain research suggesting that critical noncognitive skills are malleable well into adolescence.
(The Gates Foundation also helps support 91制片厂视频 Week鈥檚 coverage of business and K-12 innovation.)
Assessment experts caution that video games must clear numerous hurdles before they can be considered legitimate testing tools and that efforts to measure social-emotional learning are still in their infancy.
But the notion that games like Crystals and other radically new forms of assessment could soon be used as tests in schools is not fanciful science fiction.
鈥淚 would love to see 鈥� more reliable, meaningful, and easy-to-administer assessments that help us understand whether we are teaching the noncognitive skills that predict students鈥� success in college, careers, and life,鈥� U.S. Secretary of 91制片厂视频 Arne Duncan said at a conference of the American 91制片厂视频al Research Association in May. 鈥淭his is the next frontier in assessment.鈥�
鈥楥ool鈥� Learning
Crystals of Kaydor opens with a serene scene of a space shuttle carrying robotic explorers on their way to a newly discovered planet.
Within seconds, the action kicks into high gear, with sweeping visual effects and pounding electronic music accompanying the robots鈥� crash landing.
Fourteen-year old Maria Thurow was hooked.
A rising freshman in the 900-student New Glarus school district, outside Madison, Ms. Thurow tested Crystals during one of Games+Learning+Society鈥檚 recent 鈥減lay squads.鈥�
By the time she encountered her first alien, Ms. Thurow, who said she plays digital games ranging from mindless phone apps to complex strategy games like Civilization for up to 10 hours each week, had declared the game 鈥渃ool.鈥�
Proponents have argued for a decade that video games are powerful learning tools because of their popularity and capacity to engage players in complex problem-solving.
More recently, James Paul Gee, the godfather of video game theory and a co-founder of Games+Learning+Society, has advanced the idea that success in playing video games can offer proof of student mastery of academic content.
Mr. Gee, now a professor at Arizona State University in Tempe, used as an example the popular first-person shooter video game Halo, arguing that it would be nonsensical to give children who successfully complete the game separate, written tests of their Halo knowledge.
鈥淭he game is the test,鈥� said Mr. Gee. 鈥淚f we could design teaching algebra as well as Halo is designed, we鈥檇 say the same thing.鈥�
Games+Learning+Society has devoted more resources and talent than most to overcoming two key challenges to Mr. Gee鈥檚 vision: creating video games that children actually want to play and capitalizing on the avalanche of information the games generate.
The center鈥檚 design studio includes more than a dozen programmers, developers, and artists. Creative director Brian Pelletier spent 18 years overseeing the artistic development of popular commercial games like X-Men Legends.
While not a multimillion-dollar blockbuster, Crystals of Kaydor took Mr. Pelletier鈥檚 team eight months and $300,000 to create.
The same attention is being paid to the game鈥檚 back end, where researchers and programmers are refining a new system for collecting and analyzing 鈥渃lickstream data.鈥�
Completing Crystals requires about 3,000 鈥渆vents,鈥� such as taps on the screen, each of which represents a decision made by the player. The game automatically logs records of every event, along with roughly 15 pieces of related information it has been programmed to collect.
Soon, the center will have a huge database to mine for evidence that particular patterns of play鈥攈ow a child solved a particular problem or how long he or she spent trying鈥攁re tied to learning outcomes.
Instead of taking isolated, de-contextualized snapshots of student learning, said Mr. Gee, 鈥渨e can now use digital [games] to assess people in multiple contexts, measure their growth across time, and track different trajectories to mastery. It鈥檚 an incredibly threatening moment for more traditional forms of assessment.鈥�
While playing Crystals, Ms. Thurow initially struggled to identify the emotions displayed on the faces of the aliens she encountered.
Afterward, she said the game was reminiscent of the 鈥渃ulture shock鈥� she experienced when her family moved from Wyoming to the tight-knit Wisconsin community of New Glarus shortly before she started 8th grade.
鈥淓veryone was looking at me, and I had to gauge if they really wanted to get to know me or they were just being nosy,鈥� she explained.
Building Blocks
Mr. Davidson, the neuroscientist, said developing the ability to read others鈥� nonverbal cues is key to navigating many social situations. And the ability to focus your mind鈥攖he skill at the heart of Tenacity鈥攊s even more important, he argued.
In his influential book How Children Succeed: Grit, Resilience, and the Hidden Power of Character, writer Paul Tough describes multiple strands of research backing those views, including findings by Duke University researchers that individuals who exhibited poor self-control as young children went on to make significantly less money than their peers, were far more likely to suffer from poor physical health and substance abuse, and were far more likely to have been convicted of a crime, regardless of intelligence or social class.
Equally important, said Mr. Davidson, are neuroscientific studies showing that the parts of the brain that regulate important noncognitive skills can be altered through training and experience鈥攁nd possibly through video games.
鈥淲e believe the way to strengthen the circuits of attention and the circuits of empathy is through practice,鈥� he said. 鈥淎nd the way you can make practice fun is by embedding it in a game.鈥�
To test that theory, Mr. Davidson鈥檚 team is using an MRI scanner to peer inside the brains of children who play Crystals and Tenacity. Mr. Davidson said positive findings would signify a 鈥渧ery hopeful鈥� message.
鈥淲e鈥檙e not accustomed in this culture to thinking about qualities like attention or empathy as skills,鈥� he said. 鈥淏ut neuroscience is teaching us that they鈥檙e no different than learning to play a violin.鈥�
For games like Crystals, though, the road from cool prototype to widely used tool will likely be long and rocky.
States and school districts are still struggling with the cost, technical challenges, and politics of implementing the computer-based, exams linked to the Common Core State Standards.
And Ms. Steinkuehler acknowledged that the notion of testing students鈥� empathy or self-control could prove controversial.
鈥淵ou have to figure out ways to work on [those] skills without it becoming this Orwellian task where Big Brother is constantly watching to make sure that you display the right values,鈥� she said.
Reality Check
Before game-based assessment of noncognitive skills can move into the mainstream, said Gregory Cizek, a professor of educational measurement and evaluation at the University of North Carolina at Chapel Hill, there will be debate about whether 鈥渋t鈥檚 appropriate to measure certain things in kids, who should be doing the measuring, and how those skills should count in determining students鈥� success.鈥�
There will also be psychometric hurdles to clear, Mr. Cizek said.
鈥淎 kid might look at these stringy alien things and demonstrate empathy as defined in a gaming situation,鈥� he said, 鈥渂ut does that translate to treating human beings differently?鈥�
Still, it鈥檚 not every day that you see 14-year-olds enthusiastically taking tests and bragging about their sensitivity to others鈥� emotions, as Ms. Thurow and her peers did during the recent Games+Learning+Society play squad.
鈥淕ames are a terrifically powerful vehicle for altering the brain in very specific ways,鈥� Mr. Davidson said. 鈥淚f we can intervene with children and actually strengthen circuits that are beneficial for life outcomes, I think we have a moral obligation as a society to try.鈥�
