91制片厂视频

Special Report
School & District Management

Mobile Learning Seen to Lack Rigorous Research

By Kathleen Kennedy Manzo 鈥 March 16, 2010 7 min read
  • Save to favorites
  • Print
Email Copy URL

For their fans and promoters, mobile devices鈥攚hether smartphones, gaming gadgets, MP3 players, or netbooks鈥攈ave the potential to transform teaching and learning by engaging students more deeply in lessons and promoting anytime, anywhere learning.

Only problem is, they can鈥檛 quite prove it yet. At least not with the kind of large-scale, empirical data that might persuade skeptics or decisionmakers that the investment needed to equip classrooms and train teachers would pay off in higher student achievement.

But researchers and educators who are already convinced of the benefits of mobile learning say that a growing number of studies here and abroad, as well as increasing anecdotal evidence from the K-12 field, are helping to strengthen the case for embedding portable tech tools into the school day.

鈥淭he problem that we鈥檝e got on this is that all the research is promising, but it鈥檚 also based on very small samples,鈥 says Thomas Greaves, the president of the Greaves Group, an Encinitas, Calif.-based education technology consulting firm. 鈥淚t鈥檚 really too early to tell definitively yet. ... It鈥檚 real hard until we get large-scale results to know what difference they are making.鈥

Early Results Promising

Early results from two notable mobile-learning projects that involve thousands of students in North Carolina and the United Kingdom may help as well. Preliminary results show that cellphones equipped with Internet and a range of learning applications can help increase students鈥 collaboration and motivation, and improve their reading and math skills. (鈥淪olving Algebra on Smartphones,鈥 this issue.)

Smaller studies have looked at the effectiveness of specific applications for hand-held devices, and surveys have gauged the role that portable devices play in the lives of students and adults.

But those projects that introduce a specific activity or intervention for a short period of time鈥攇enerally with small numbers of students鈥攁nd then test any gain in the targeted knowledge or skills do not produce the kind of data the field needs to demonstrate how technology can transform teaching and learning, according to Elliot Soloway, a professor of education and computer science at the University of Michigan, and one of the foremost researchers of mobile learning. In fact, those focused inquiries may be counterproductive to efforts to position technology as a means of education reform.

鈥淚n general, there鈥檚 a lack of research on the sustained impact of technology on learning,鈥 Soloway says. 鈥淭he transition we鈥檙e trying to achieve is from technology being an add-on in the curriculum to technology being essential to the curriculum. So when you make that distinction, you realize the folly of this one-off research.鈥

Soloway is working in districts in New York, Ohio, Texas, and elsewhere to integrate cellphones throughout the school day using curriculum and data-management software he developed with University of North Texas researcher Cathleen A. Norris.

While mobile learning has a longer track record in other countries, particularly in Australia and several European nations, the literature as a whole is fairly thin, experts say.

An international review of the research published last year in the Australasian Journal of 91制片厂视频al Technology, for example, found that of just 44 studies on mobile learning in K-12 or higher education, only a handful used experimental methods. About half the studies were based on self-reported data, and more than half were short-term.

Cellphone Trends

Percentage of adults and teenagers who own cellphones, 2004-2008.

BRIC ARCHIVE

SOURCE: Pew Internet & American Life Project

The analysis concluded that, based on the limited research, there is evidence that mobile technologies are efficient for assessment of student skills and that they help motivate students to spend more time on academic tasks. But the research tended to focus more on the features of the mobile devices rather than on the 鈥渢heoretical rationale or justification for using them鈥 that could inform teaching, wrote researchers Wing Sum Cheung and Khe Foon Hew of the National Institute of 91制片厂视频 in Singapore.

Assessing the Impact

Despite the lack of empirical data, however, Greaves argues that some of the research on other technologies, such as desktop or laptop computers, can be generalized to mobile devices, particularly their tendency to increase students鈥 time on task, communication, and motivation.

鈥淭he more technology [students] have, the better they do,鈥 says Greaves, who has begun analyzing data from more than 1,000 schools for a special research project. The information gathered will be used to create a database of the practices and policies related to technology that have shown positive results and proved cost-effective. 鈥淚f you have a computer for every kid, or every two kids, or four kids, there is a stair-step effect in test scores, dropout rates, course completion, disciplinary actions, so that the more technology, the more those schools are reporting better outcomes,鈥 Greaves says.

But quantifying the impact is a bit trickier given that the influx of mobile technology into schools is recent and piecemeal, and is not spread consistently or widely geographically or throughout the curriculum. Beyond those issues, conducting experiments of classrooms equipped with mobile technologies and those using more traditional tools and methods may lead to unfair comparisons, according to Soloway.

In a classroom that utilizes mobile learning, 鈥渆verything is different as a function of the technology,鈥 he says. 鈥淒oing experimentation like that leads to ugly research because you鈥檙e not holding one thing constant.鈥

Ed-Tech 91制片厂视频

Percentage of public school districts that employ a person responsible for educational technology leadership.

BRIC ARCHIVE

SOURCE: Pew Internet & American Life Project

That leaves little solid evidence for school leaders to go on, some observers say. Those looking to move toward mobile platforms for learning might have to take something of a leap of faith.

The 60,000-student Katy district near Houston did just that when it signed on to participate in a pilot project using Soloway鈥檚 Go Know software, and provided specially equipped cellphones to 130 5th graders this school year. The district had already been using interactive whiteboards, desktop computing, and Web 2.0 applications, but in its effort to shift more teachers toward innovative strategies and tools, cellphones seemed a natural addition to the suite of tools, according to Lenny J. Schad, the district鈥檚 chief information officer. Educators in the district were persuaded primarily by observations about students鈥 preference for portable devices for completing a variety of tasks.

鈥淭here really weren鈥檛 a lot of people to talk to who鈥檝e done this,鈥 says Schad.

In the short term, the students have outperformed previous cohorts of 5th graders on standardized reading and math tests. While those results are hardly scientific, combined with reports of greater teacher collaboration, improved attendance, and reduced discipline problems, Schad says the experiment is successful so far.

By the Numbers

77% of teens own a game console, such as an Xbox or a PlayStation.

74% of teens own an iPod or mp3 player.

60% of teens own a desktop or laptop computer.

55% of teens own a portable gaming device.

SOURCE: Pew Internet & American Life Project

鈥淢ath scores at the school are up by 20 points, reading scores by 18 points,鈥 he says. 鈥淚 don鈥檛 want to say that鈥檚 simply because of the [mobile] devices, but I think that they facilitated the increase in scores.鈥

鈥業t Motivates Kids鈥

The research that is available tends to confirm the effects in the Katy district, according to Mark van鈥檛 Hooft, a researcher at the Research Center for 91制片厂视频al Technology at Kent State University in Ohio.

Tracking Trends
Ed Tech Stats PDF

鈥淚t motivates kids to learn, and they tend to do more of whatever is being measured, maybe write more, read more, more review of content,鈥 says van鈥檛 Hooft, the editor of the center鈥檚 refereed, multimedia journal.

But isolating the cause of those positive outcomes in schools that infuse tech tools in meaningful ways, he adds, is often difficult. Based on the literature in general, however, inferences can be made about the role technology might play in those improvements.

鈥淯sing digital tools tends to be a catalyst for improving teaching, improving learning,鈥 he says, 鈥渨ith appropriate administrative support and tech support.鈥

Advocates are optimistic that the evidence will come. Meanwhile, they say, one of the most compelling reasons for using mobile technology to enhance instruction is the prevalence of the tools in students鈥 lives and their proficiency in using them to find and share information outside of school.

The research is clear on the ever-present nature of cellphones in the lives of today鈥檚 teenagers. The proportion of teens who have their own cellphones, for example, is catching up to the 77 percent of adults who do, according to the Pew Internet and American Life Project.

鈥淲e鈥檙e struggling with engaging the digital learners of today,鈥 Schad says. 鈥淪o we鈥檙e using a tool that these kids use every single day.鈥

Events

Recruitment & Retention Webinar Keep Talented Teachers and Improve Student Outcomes
Keep talented teachers and unlock student success with strategic planning based on insights from Apple 91制片厂视频 and educational leaders.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Families & the Community Webinar
Family Engagement: The Foundation for a Strong School Year
Learn how family engagement promotes student success with insights from National PTA, AASA鈥痑nd leading districts and schools.鈥
This content is provided by our sponsor. It is not written by and does not necessarily reflect the views of 91制片厂视频 Week's editorial staff.
Sponsor
Special 91制片厂视频 Webinar
How Early Adopters of Remote Therapy are Improving IEPs
Learn how schools are using remote therapy to improve IEP compliance & scalability while delivering outcomes comparable to onsite providers.
Content provided by 

EdWeek Top School Jobs

Teacher Jobs
Search over ten thousand teaching jobs nationwide 鈥 elementary, middle, high school and more.
Principal Jobs
Find hundreds of jobs for principals, assistant principals, and other school leadership roles.
Administrator Jobs
Over a thousand district-level jobs: superintendents, directors, more.
Support Staff Jobs
Search thousands of jobs, from paraprofessionals to counselors and more.

Read Next

School & District Management Opinion From One Superintendent to Another: Get Political
Strong relationships with political leaders help create a supportive network for your schools, even amid partisan turbulence.
George Philhower
5 min read
Vector of an education leader hand holding a book bridging the gap in education for a group of political people walking on
Feodora Chiosea/iStock
School & District Management Q&A What Should School Administrators Wear to Work? A Superintendent鈥檚 Style Tips
Melanie Kay-Wyatt describes her wardrobe as professional, comfortable, and colorful.
3 min read
Melanie Kay-Wyatt stands for a portrait inside Alexandria City High School on Sept. 9, 2024 in Alexandria, Va. Kay-Wyatt serves as superintendent for Alexandria City Public Schools.
Melanie Kay-Wyatt, the superintendent for the Alexandria, Va., school district, stands for a portrait inside Alexandria City High School on Sept. 9, 2024. She considers her professional style to be an important part of how she presents herself in her role.
Maansi Srivastava for 91制片厂视频 Week
School & District Management Video How School Leaders Can Learn to 'Disagree Better'
Leaders can鈥檛 avoid conflict. But they can learn to manage it more effectively.
3 min read
School & District Management Opinion 3 Ways School Leaders Can Build Collective Understanding
Initiatives will fail without school staff being included in these key conversations.
5 min read
Screenshot 2024 09 07 at 11.41.23鈥疉M
Canva