We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

A View from Henry Jenkins

When Lab Rats Talk Back...

Many of my gamer friends are abuzz about this blog entry written by a young college student about his experiences participating in some lab-based experiments into the effects of violent video games. Not sure what the news value is but…

  • October 21, 2003

Many of my gamer friends are abuzz about this blog entry written by a young college student about his experiences participating in some lab-based experiments into the effects of violent video games. Not sure what the news value is but it certainly vividly illustrates some of the concerns many of us have about this kind of research.

As an MIT faculty member, I have tremendous respect for the authority which real science commands, but the “media effects” researchers misuse that authority in applying lab techniques to address what are essentially cultural questions. This research reduces complex cultural processes to simple variables which can be tested in the laboratory and in the process strips away most of what it would need to research if it actually wanted to address the questions it poses. Ultimately, what these reseaerchers put forward is not the data – which often shows minor effects at best – but the interpretation of that data – which makes much larger claims – and those conclusions, qualified in the original research documents, get expanded further at each subsequent step in the reporting process – by journalists, activists, politicians, and finally your Aunt Agatha talking over the back fence to her neighbors.

What’s wrong with this picture? First, let’s start with the fact that unlike real lab research, this lab rat CAN talk back and in fact, seems to know more about the phenomenon being researched than the researchers. There is no effort here to tap what he knows or to ask him what the experience means. He is assumed to be inarticulate and his interpretations are measured only indirectly. His own insights about the experience here are richer than the binary codes they will be given as the researchers mulch down their aggregate data.

Second, the researchers seem to care very little about the most basic distinctions between different types of games or different kinds of representations of violence which would be part of the way gamers think about and respond to the media. “Violence” is assumed to be one simple thing which produces specific and predictable results and not a theme which gets dealt with in many different ways.

Third, the researchers have removed him from any context where he would ever actually be playing games, creating an arbitrary situation which strongly colors his response. Ask yourself whether playing in a laboratory booth is more like playing at home alone or in an arcade and you can see how inadequate it is as a substitute for either experience.

Fourth, to give the researcher the benefit of the doubt, they introduce other variables into the experiment – such as the potential frustration caused by asking someone to play with a badly tuned controller – which taint the results they get. In the end, the measures being applied aren’t fine tuned enough to distinguish between aggression stirred up by violence and frustration created by being thrust into a situation over which you have so little control.

Fifth, the research from the very beginning has an agenda – in this case, perhaps, it is already linked with a law suit. There is enormous pressure to find negative effects. If they don’t find those effects, the experiment will be regarded as a failure and its results will not be reported. But an experiment which produces no results in this case isn’t really a failed experiment. It may demonstrate that such media does not have the kinds of effects hypothesized.

Sixth, most often, such methods expose people to kinds of media they would not otherwise consume. Often they have little of the kinds of preparation – in terms of knowledge, skill, or emotional readiness – which actual consumers in real life situations would have before they experienced such content, in most cases. So, what are we measuring – the impact of such media on casual consumers or its impact on people who spend a great deal of their lives interacting with games. Is there a difference between what is actually measured here and the way those results will be interpreted once they are released to the public?

Food for thought next time you read a newspaper story reporting on this kind of research finding.

Uh oh–you've read all of your free articles for this month.

Insider Premium
$179.95/yr US PRICE

Want more award-winning journalism? Subscribe to Insider Plus.
  • Insider Plus {! insider.prices.plus !}*

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus ad-free web experience, select discounts to partner offerings and MIT Technology Review events

    See details+

    What's Included

    Bimonthly magazine delivery and unlimited 24/7 access to MIT Technology Review’s website

    The Download: our daily newsletter of what's important in technology and innovation

    Access to the magazine PDF archive—thousands of articles going back to 1899 at your fingertips

    Special discounts to select partner offerings

    Discount to MIT Technology Review events

    Ad-free web experience

You've read all of your free articles this month. This is your last free article this month. You've read of free articles this month. or  for unlimited online access.