Category: Video Game Research

Meta-Study: Virtual Reality Based Instruction is Effective

An interesting meta-study from researchers at Texas A&M looked at instruction delivered through videogames, simulations, and virtual worlds. While all were found to be effective, educational videogames were found to be the most effective.

Here is the abstract:

The purpose of this meta-analysis is to examine overall effect as well as the impact of selected instructional design principles in the context of virtual reality technology-based instruction (i.e. games, simulation, virtual worlds) in K-12 or higher education settings. A total of 13 studies (N = 3081) in the category of games, 29 studies (N = 2553) in the category of games, and 27 studies (N = 2798) in the category of virtual worlds were meta-analyzed. The key inclusion criteria were that the study came from K-12 or higher education settings, used experimental or quasi-experimental research designs, and used a learning outcome measure to evaluate the effects of the virtual reality-based instruction.

Results suggest games (FEM = 0.77; REM = 0.51), simulations (FEM = 0.38; REM = 0.41), and virtual worlds (FEM = 0.36; REM = 0.41) were effective in improving learning outcome gains. The homogeneity analysis of the effect sizes was statistically significant, indicating that the studies were different from each other. Therefore, we conducted moderator analysis using 13 variables used to code the studies. Key findings included that: games show higher learning gains than simulations and virtual worlds. For simulation studies, elaborate explanation type feedback is more suitable for declarative tasks whereas knowledge of correct response is more appropriate for procedural tasks. Students performance is enhanced when they conduct the game play individually than in a group. In addition, we found an inverse relationship between number of treatment sessions learning gains for games.

With regards to the virtual world, we found that if students were repeatedly measured it deteriorates their learning outcome gains. We discuss results to highlight the importance of considering instructional design principles when designing virtual reality-based instruction.

Reference:

Merchant, Z., Goetz, E. T., Cifuentes, L., Keeney-Kennicutt, W., & Davis, T. J. (2014). Effectiveness of virtual reality-based instruction on students’ learning outcomes in K-12 and higher education: A meta-analysis. Computers & Education, 70, 29-40.

-

-

Call for Papers – Religion in Digital Games

I received the following in a recent e-mail from Simone Heidbrink and Tobias Knoll at University of Heidelberg. Please pass this information along to interested colleagues:

The editors of “Online – Heidelberg Journal of Religions on the Internet” (http://www.online.uni-hd.de/) are pleased to announce the relaunch of the journal. It will come up with a new design as well as improved navigation and search functions. By establishing a peer-review system, we will renew our mission of publishing articles of a high academic standard from a multitude of disciplines.

We herewith invite researchers of all disciplines to hand in articles on their research dealing with religions on the internet. We are currently planning to publish 2 issues a year, one of which will be a special issue addressing a certain topic. The next issue to be published in December 2013 will broach the issues of “Religion in Digital Games” (for further information see Call for Papers below).

The journal is always keen to collect high quality scholarship on issues relating to religions on the Internet and welcomes submissions pertaining to all aspects of theses matters anytime to be published in a future issue!

Submissions and queries should be send to the following address:
online.religion@zegk.uni-heidelberg.de.

***Call for Papers***

“Religion in Digital Games – Multiperspective and Interdisciplinary Approaches”

Special issue of Online – Heidelberg Journal of Religions on the Internet (http://www.online.uni-hd.de/), due for publication in December 2013!

Over the past few years, the scientific analysis of digital games and their cultural and social impact has become a growing field of research in various scientific disciplines. Sadly, the issue of religion as an (explicit or implicit) factor in the construction and reception of game worlds, rules and mechanics has been vastly underrepresented in most studies on the field. This negligence seems rather unjustified given the vast presence of e.g. religious symbols, narratives and player actions in popular games like The Elder Scrolls: Skyrim , Bioshock: Infinite and many others.

The special issue on “Religion in Digital Games” seeks to contribute to filling this gap in games research through a multi-perspective and interdisciplinary approach. We herewith invite scholars from Religious Studies, Cultural Studies, Social Studies, Media Studies, Game Studies, Educational Studies, Economics, Theology and other related disciplines to hand in proposals for possible articles which deal with all kind of religious aspects in the context of digital games, i.e. computer games, console games, mobile games.

The articles could (among others) broach the issue of
- game aesthetics
- gaming culture
- reception and recipient research
- ludology
- narratology
- content analysis

In order to present a broad insight into the aspects of religion in digital games, we invite theoretical, methodical and empirical studies referring to these or related topics. We are looking forward to receive the title and a short abstract (max. 250 words) of the planned article until June 30th  2013. The language of the Journal is English, for proposals in other languages please contact the editors beforehand.

Further important dates and deadlines are:

July 15th – Notification on the acceptance of your proposal by the editors.
September 30th – Submission deadline for full article.
October 15th – Deadline for comments, requests of revisions by the editors (if necessary).
November 15th – Submission deadline for revised articles.
December 1st – Publication of the Online Journal.

Please send your abstract and / or further inquiries to the following e-mail address: online.religion@zegk.uni-heidelberg.de.

-

#Gamestudy Roundup for April 2013

Here’s a roundup of some of the research on videogames I’ve been posting on Twitter. Follow me @EduGamRes, or search for the hashtag #Gamestudy to see more.

Diet techniques learned in Second Life transferred to weight loss in real life

Researchers at University of Kansas Medical School followed 20 subjects in a weight loss program, either visiting a clinic in real life or nutritionists in a virtual clinic in Second Life. Then all the subjects followed an additional six months of training in the game environment. The completely virtual program was found to be more effective.

http://www.jneb.org/article/S1499-4046%2812%2900667-7/abstract

-==-

Kids diagnosed with autism may be subject to greater likelihood of videogame overuse

Micah Mazurek at University of Missouri followed 202 children diagnosed as falling in the autism spectrum disorder, and 179 typically developing children. Those with ASD were found to engage in videogames more, and in social media less.

According to the MU News Bureau:

The study, “Television, Video Game and Social Media Use among Children with ASD and Typically Developing Siblings,” will be published in an upcoming issue of the Journal of Autism and Developmental Disorders. “Video Game Use and Problem Behaviors in Boys with Autism Spectrum Disorders,” was published in Research in Autism Spectrum Disorders.

-==-

Concept paper at SigBovik 2013 shows computer programs playing videogames

LearnFun and PlayFun are two computer programs. The first watches a human player engage in a videogame. The second one then plays and wins the game in a more efficient manner. The video shows author Tom Murphy play the first level of Super Mario Bros., then the computer program plays the level.

-==-

Study shows videogames don’t affect behavior

University of Glasgow researchers followed 13,587 children in the UK, finding that television screen time showed a minor effect on children, while videogame screen time showed none. The study contrasts with previous studies suggesting a link to violent behavior with increased screen time.

http://adc.bmj.com/content/98/5/341.full.pdf+html

-==-

Action videogames may help students with dyslexia

Researchers at University of Padua in Italy found that regularly playing action videogames increased the reading abilities of children diagnosed with dyslexia. Non action videogame did not produce the same results. The increase was observed without additional direct phonological training.

http://www.sciencedirect.com/science/article/pii/S0960982213000791

-

Twitter Roundup for #GameStudy

As things cross the transom these days, they often get tweeted before they get blogged. Here’s a roundup for headlines and papers that made my #GameStudy hashtag.

World of Warcraft Improves Spatial Abilities in the Elderly
Anne McLaughlin and Jason Allaire, over at the Gains Through Gaming Lab at North Carolina State University, tested the effect on cognitive proficiencies for senior adults after playing World of Warcraft. The paper was published in Computers in Human Behavior. Here is the abstract:

The effectiveness of a game-based cognitive training intervention on multiple abilities was assessed in a sample of 39 older adults aged 60–77. The intervention task was chosen based on a cognitive task analysis designed to determine the attentional and multi-modal demands of the game. Improvements on a measure of attention were found for the intervention group compared to controls. Furthermore, for the intervention group only, initial ability scores predicted improvements on both tests of attention and spatial orientation. These results suggest cognitive training may be more effective for those initially lower in ability.

Nintendo Wii Balance Board Improves Balance for the Elderly
Cathy Craig over at Queen’s University Belfast in Ireland, presented a paper and demonstration of research professors from QUB and Trinity University Dublin have been working on that was funded by the Centre for Ageing Research and Development in Ireland (CARDI). Participants in the study showed 15% improvement in balance, and the professors are in discussions with a software development company to produce specialized gaming software. The efforts were publicized here.

Simulation Training is Critical for Modern Surgical Procedures
We’ve discussed game-based training for surgeons here and here. In a new paper in Archives of Otolaryngology-Head & Neck Surgery, Marvin P. Fried over at Montefiore Medical Center and colleagues found surgeons practicing endoscopic sinus surgery on a simulator that only allows “leveling up” once proficiencies are met, to outperform the control group.

The news release is here, the Science Daily article is here.

-

Research on Benefits of Children Playing Videogames

Some interesting new studies and projects have come out recently showing beneficial links to videogame playing for children. Linda A. Jackson, professor of psychology over at Michigan State University, led a study finding that videogame play was a strong predictor of creativity in children. Here is the abstract:

This research examined relationships between children’s information technology (IT) use and their creativity. Four types of information technology were considered: computer use, Internet use, videogame playing and cell phone use. A multidimensional measure of creativity was developed based on Torrance’s (1987, 1995) test of creative thinking. Participants were 491 12-year olds; 53% were female, 34% were African American and 66% were Caucasian American. Results indicated that videogame playing predicted of all measures of creativity. Regardless of gender or race, greater videogame playing was associated with greater creativity. Type of videogame (e.g., violent, interpersonal) was unrelated to videogame effects on creativity. Gender but not race differences were obtained in the amount and type of videogame playing, but not in creativity. Implications of the findings for future research to test the causal relationship between videogame playing and creativity and to identify mediator and moderator variables are discussed.

The paper can be downloaded here. The MSU press release is here. The paper is in press, and will be published in an upcoming issue of Computers in Human Behavior.

-+-

Meanwhile, A. Scott Cunningham, an assistant professor of economics over at Baylor, along with Benjamin Engelstätter at the Zentrum für Europäische Wirtschaftsforschung (Center for European Economic Research) and Michael R. Ward at University of Texas Arlington, released a working paper on the Social Science Research Network entitled “Understanding the Effects of Violent Video Games on Violent Crime.”

Researchers have long been able to measure physiological arousal in participants engaging in violent media. This physiological measurement is seen regardless of the media. Violent TV shows, movies, music, and videogames will elicit the measured arousal as study after study has shown. But, more tenuous are assertions this arousal leads to violence elsewhere once participants are away from the media. This study seeks to empirically link violent videogame sales with decreases in reports of violence. Here is the abstract:

Psychological studies invariably find a positive relationship between violent video game play and aggression. However, these studies cannot account for either aggressive effects of alternative activities video game playing substitutes for or the possible selection of relatively violent people into playing violent video games. That is, they lack external validity. We investigate the relationship between the prevalence of violent video games and violent crimes. Our results are consistent with two opposing effects. First, they support the behavioral effects as in the psychological studies. Second, they suggest a larger voluntary incapacitation effect in which playing either violent or non-violent games decrease crimes. Overall, violent video games lead to decreases in violent crime.

The paper can be accessed here. Some good articles discussing it in the media are here and here.

-+-

Finally, work on videogames to assist children in coping with medical problems continues in earnest. A recent example involves the University of Utah’s Engineering Arts and Entertainment (EAE) program, which brings in students from the school’s Dept. of Film and Media Arts and School of Computing to design interactive entertainment. Together with physical therapists and councilors, EAE students created a series of videogames designed to help children stricken with cancer. The unnamed minigames written for the PlayStation3 are currently being beta tested by patients in the pediatric ward at the Primary Children’s Medical Center in Salt Lake City, with possible retail release in the near future. Articles on the games can be found here and here.


What Can Angry Birds Teach us About … ? At the Forefront of Angry Birds Research

With over a billion downloads, Angry Birds is the most popular casual gaming app of all time, so it’s only natural for social scientists to investigate it. Here’s the results of some recent items I found while searching for what educators and others have been researching about the game.

David Kelly, blogging at Misadventures in Learning, notes design elements in Angry Birds spark positive influences for skill acquisition. Players can jump right in with little to no learning curve, follow multiple paths to success, and are offered incentives toward productivity. Its initial platform design assists in simple productivity as well:

One of the reasons Angry Birds is as successful as it is is its accessibility.  Unlike console video games, Angry Birds was designed for mobile devices. It has no tether restricting where it can be played and was in fact designed for mobile phones, a device many people have with them throughout the day.

In addition, the level structure of Angry Birds is packaged in small chunks.  An attempt at a level can be completed in less than 30 seconds.  It’s the perfect design for mobility.

Pertti Saariluoma, Editor-in-Chief of Human Technology, noted the games’ designers professed they have no idea why the game is successful. Indeed, Saariluoma notes, good game and software design often is intuitive rather than proscribed.

Market research firm AYTM.com offered up a handy infographic showing demographics and other data from the game. Interesting nuggets include: a total of 53% of players use the free version with the majority occasionally feeling “addicted” while playing. The firm noted Michael Chorost’s article in Psychology Today listing the “addictive” elements of the game. These include simplicity, reward, and realistically simulated physics. Dr. Chorost speculates a dopamine burst may be released, making the gaming experience a pleasurable one for players. As far as using Angry Birds in the classroom, Dan MacIsaac over at SUNY-Buffalo State notes that Google returns over a million hits for “physics teaching Angry Birds.”

Mobile apps in general are receiving scrutiny from researchers, and Angry Birds is often mentioned since it’s the most popular game. Matthias Böhmer over at the German Research Center for Artificial Intelligence, Brent Hecht, a PhD. student at Northwestern, and their colleagues released a large scale study of mobile app use at Mobile HCI 2011 in Stockholm. They found users spend about an hour a day on their phones, but only about a minute at a time with mobile apps. News apps were found to be more popular in the morning, while gaming apps are more popular in the evening:

Weather checking is, not surprisingly, largely a morning activity, as is the checking of one’s calendar. On the other hand, users’ desire to fling Angry Birds at pigs is absent in the morning, and only picks up in the early afternoon and into the evening. Kindle usage behavior is even more focused in the late evening.

Angry Birds and other popular mobile games will probably continue receiving attention from researchers, with efforts likely to include discerning design details that can be adapted to more educational endeavors, as well as a continued commitment to incorporating the game itself into academics. Research always lags pop culture. By the time several thorough studies of Angry Birds are published, if any ever are, the game will likely have faded in popularity and been replaced by the next new thing.


Using Video Games to Solve Complex Problems

The blogosphere and the Twitterverse were buzzing today with news about the latest crowdsourcing coup, where a video game was used to unravel the molecular structure of viral enzymes that cause AIDS in monkeys.

Such tedious work often requires human cognitive abilities, and combined efforts seem to flourish within a gaming environment. The online game used is called Foldit, and Firas Khatib and Frank DiMaio over at University of Washington’s Dept. of Biochemistry along with several others published a paper in Nature detailing the effort, entitled Crystal structure of a monomeric retroviral protease solved by protein folding game players. Here is their abstract:

Following the failure of a wide range of attempts to solve the crystal structure of M-PMV retroviral protease by molecular replacement, we challenged players of the protein folding game Foldit to produce accurate models of the protein. Remarkably, Foldit players were able to generate models of sufficient quality for successful molecular replacement and subsequent structure determination. The refined structure provides new insights for the design of antiretroviral drugs.

The game looks quite interesting, and by playing you might help make a significant contribution to science.

-

Study: Predicting Player Behavior and How Zynga Profits from Data Analysis

An interesting front page story in The Wall Street Journal today by journalist Nick Wingfield discusses how casual gaming giant Zynga cashes in on their millions of players. After developing Fishville, following in the footsteps of highly successful titles like Farmville, managers noted players spending in-game currency on one type of fish more so than others. The “translucent angler fish” was being purchased more than 6 times the rate of other virtual fish. So the company quickly developed a whole line of translucent sea creatures, charging as much as $4 (this time, in real world money) for more exotic varieties.

This formula has been very successful for the company. Although only about five percent of Zynga’s player base spends serious money in their games, so many millions of people play that the company rakes in millions. They rake in even more by figuring out what the players want through data analysis.

Zynga is transforming the game industry. Traditional videogame companies create games they think players will like, then sell them. Zynga offers free games through Facebook Inc.’s social network, then studies data on how its audience plays them. It uses its findings to fiddle with the games to get people to play longer, tell more Facebook friends about them and buy more “virtual goods.” At the heart of the whole process is Zynga’s ability to analyze reams of data on how players are reacting to its games.

“We’re an analytics company masquerading as a games company,” said Ken Rudin, a Zynga vice president in charge of its data-analysis team, in one of a series of interviews with Zynga executives prior to the company’s July filing for an initial public offering.

This formula for financial success has other companies following Zynga’s lead. Rather than spending millions developing a title with a short shelf life, companies are turning to free games with extras that cost money. The primitive graphics Zynga uses are generally derided by serious gamers, but Zynga aims for the mass market, much the way American beer brewers produce bland beverages that appeal to the most palates.

All of Zynga’s games go through what amounts to a giant ongoing lab experiment involving players. Zynga conducts hundreds of “A-B tests” within its games, in which two sets of players see virtual goods on sale with, say, subtle color differences to see which color sells better…

Sizhao Yang, a former Zynga executive who helped create its virtual farming hit “FarmVille,” says his development team figured out by analyzing virtual-goods-sales data that “people buy animals a lot more than tractors and other inanimate objects.” The findings led the “FarmVille” team to more prominently feature animals in its online store, he says.

Interestingly, Wingfield reports there is considerable tension in the company between the data jockeys and the game designers. The game designers have a certain idea of how a game should look and function. The analysts drive the direction of game development based on the data, leading to tension. Some designers have quit the company in protest. Still, data remains the keystone in Zynga’s game plan for the foreseeable future.

The Zynga story on data analysis comes on the heels of the recent International Conference on the Foundations of Digital Games in Bordeaux this summer (fdg2011.org). There, Brent Harrison and David L. Roberts over at North Carolina State delivered an interesting paper, Using sequential observations to model and predict player behavior. Here’s their abstract:

In this paper, we present a data-driven technique for designing models of user behavior. Previously, player models were designed using user surveys, small-scale observation experiments, or knowledge engineering. These methods generally produced semantically meaningful models that were limited in their applicability. To address this, we have developed a purely data-driven methodology for generating player models based on past observations of other players. Our underlying assumption is that we can accurately predict what a player will do in a given situation if we examine enough data from former players that were in similar situations. We have chosen to test our method on achievement data from the MMORPG World of Warcraft. Experiments show that our method greatly outperforms a baseline algorithm in both precision and recall, proving that this method can create accurate player models based solely on observation data.

While not fixating on the profit motives that Zynga has in mind, Harrison and Roberts offer clues to game designers in guiding player behavior in-game. Educational games could become more engaging:

The ability to accurately predict a player’s behavior in a game has a number of applications. While these applications are beyond the scope of this paper, we discuss two of them briefly here to better situate and motivate our approach. With a model of player behavior, we can create an experience that is unique to a user’s tendencies or preferences. For example, if we predict that the user will choose to fight a certain non-player character (NPC) rather than talk to it, that NPC can be made more willing to fight. Another application involves guiding players to parts of games that they may enjoy. Modern games often take place in large, sandbox worlds where the player is given total freedom. It’s quite possible that players may never see content that they would like because the sandbox is just so big. Predictions about a player’s behavior can be used to guide her to the parts of the game that she would enjoy.

Eschewing surveys, the authors recommend a purely data-driven approach (as does Zynga):

We feel that a purely data-driven approach has significant promise for creating accurate predictive models of player behavior in games without the difficulties associated with earlier modeling techniques. Very little research has been done in this area to date.

Read the entire paper for further discussion of the algorithm they developed. Very interesting.

References:

Harrison, B & Roberts, D. L. (2011). Using sequential observations to model and predict player behavior. In Proceedings of the 2011 Foundations of Digital Games Conference. (FDG 2011), Bordeaux, France.

Wingfield, N. (2011, September 9). Virtual products, real profits. The Wall Street Journal, p.A1.
-

Center for Children and Technology Reports on DS Games at AERA

I’m honored to be invited to participate in a discussion group this fall put together by the Education Development Center’s Center for Children and Technology (EDC/CCT). The research this group is involved with in the field of classroom gaming is impressive.

The list of projects EDC/CCT is working on is extensive. Among many, one project with the U.S. Dept. of Education involves the design of educational game modules for the Nintendo DSi handheld, aimed at middle school science and literacy.

A paper by Marion Goldstein, Marian Pasquale, and Katie McMillan Culp, members of the Possible Worlds team at CCT, was presented recently at AERA 2011. Here is the abstract for the paper, entitled Using Students’ Naïve Theories to Design Games for Middle-Grades Science:

This paper reports on one phase of a long-term research and development project that is creating video game modules for middle-school science classrooms. The games are intended to help teachers address common scientific misconceptions by providing students with opportunities to interact with visualizations of otherwise abstract or inaccessible concepts or phenomena that are the source of those misconceptions. The visualizations serve as metaphors for natural phenomena, and linking activities help teachers build connections between the visualizations and the targeted concepts. Findings presented here are derived from formative research conducted to inform the development of a game and associated classroom materials that address genetics and heredity. The paper discusses how teachers in our sample typically teach this material in seventh grade, student expressions of common misconceptions about genetics and heredity, and how an initial design for the game responds to and addresses those misconceptions. Students’ misconceptions were associated with the concepts of randomness of inheritance, gene expression, and natural selection.

Perhaps the most impressive aspect of the team’s approach to instructional handheld gaming design is the commitment to research-based efforts. Through direct research with middle school students, the team uncovered several misconceptions held by the students through a series of experiments. When showed a mixed race couple, students’ assumptions regarding the physical makeup of the couple’s children were based on misconceptions. Other experiments uncovered faulty assumptions based on genetic adaptations of beetles and the random characteristics of lotteries. With this research in hand, the team set out to tackle common misconceptions among students at this age and grade level. The remainder of the paper discusses results with prototypes of the resulting game modules.

It’s an excellent report of a work in progress. Research and design such as this will ultimately result in stronger and more effective educational video games.


Dartmouth’s Tiltfactor Researches and Designs Social Games

I’ve been conversing via e-mail with Dr. Mary Flanagan, the founder of Tiltfactor at Dartmouth, where she is the Sherman Fairchild Distinguished Professor in Digital Humanities. Dr. Flanagan and Tiltfactor are doing exciting work in educational gaming. One of the key areas many researchers think it’s strongest is the social arena. This is where “fuzzy” concepts that are so difficult to teach through reading and lecturing can be more effectively transmitted via gaming. Consequently, Tiltfactor focuses on social games, including health and educational initiatives. Here’s a paragraph from their website explaining the organization’s purpose:

Tiltfactor is the first academic center to focus on critical play–a method of using games and play to investigate issues and ideas. Our mission is to research and develop software and playful art that creates rewarding, compelling, and socially responsible interactions, with a focus on innovative game design for social change. We are interested in the processes through which designers imbue their games with moral, social, and political values, whether intentionally or inadvertently, and the corollary processes through which these values are interpreted by players. Our approach involves extensive cross-disciplinary work among the Humanities, Social Sciences, the Arts, and the Sciences.

The academic gaming lab is funded in part by the NEH, NSF, and Microsoft. The center has researched and developed a remarkable list of educational titles. These include, among many others:

It’s exciting to see strong academic centers involved in educational gaming efforts like Tiltfactor is, and I encourage other educators and researchers to examine their work. As with most government funded initiatives, such as Josie True, the end product is freely available to schools and teachers. The research potential from their many efforts is considerable, and a list of selected books and articles Dr. Flanagan has written is here. Last but not least, Tiltfactor blog posts can be found at grandtextauto.