Skip to Content
Artificial intelligence

AI Can Re-create Video Games Just by Watching Them

September 11, 2017

Machines just took aim at video-game development—from the '80s. AIs have been able to learn to play games like Space Invaders  by watching them for a while. But now, Georgia Tech researchers have written a paper describing how AI can actually build the underlying game engine of Super Mario Bros. just by spectating.

The approach, first reported by the Verge, works by analyzing thousands of frames of game play to see what happens as everyone’s favorite mustachioed plumber moves through the game. The AI looks at what changes between one frame and the next, and tries to link cause to effect—what happens when Mario, say, touches a coin, or lands on an evil sentient mushroom (oh, okay, then: a Goomba).

Over time, the researchers say, the AI can build up rules into a rudimentary version of the game engine. The Verge’s James Vincent calls the results “glitchy, but passable” and notes that the tool is limited to simple 2-D platform games like Super Mario Bros. and Mega Man at the moment.

Speaking to the Verge, one of the researchers says that “a future version of this could [analyze] limited domains of reality.” That’s a nice idea, but as we’ve explained before, making sense of the world is one of the biggest challenges facing AI right now—and re-creating Super Mario Bros. is only a very small jump toward cracking it.

 

Deep Dive

Artificial intelligence

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

Google DeepMind’s new generative model makes Super Mario–like games from scratch

Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.

What’s next for generative video

OpenAI's Sora has raised the bar for AI moviemaking. Here are four things to bear in mind as we wrap our heads around what's coming.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.