Skip to Content
Artificial intelligence

A new AI creates original video clips from text cues

February 26, 2018

A short, typed description of a scene is enough to get this software making footage.

How it works: Science reports that the AI uses two neural networks—one to create video, another to assess if it’s realistic in order to improve the first's output. We named these kinds of AIs one of our 10 Breakthrough Technologies of 2018.

What it does: First, the system is trained on footage of activities labelled with descriptions like "playing golf on grass." It can then recreate similar scenes given a snippet of text. Plus, it can make clips combining disparate concepts from training data, such as "sailing on snow."

Why it matters: Automatic generation of video from text could be incredibly useful—for creating huge sets of synthetic training data for autonomous cars, say. It could also lead to some worrying fake content too.

But: The clips are just 32 frames long and 64x64 pixels in size. They're still not wholly convincing, and if they're made larger, accuracy plummets. All that needs fixing to build a useful text-to-video converter.

Deep Dive

Artificial intelligence

DeepMind’s cofounder: Generative AI is just a phase. What’s next is interactive AI.

“This is a profound moment in the history of technology,” says Mustafa Suleyman.

AI hype is built on high test scores. Those tests are flawed.

With hopes and fears about the technology running wild, it's time to agree on what it can and can't do.

You need to talk to your kid about AI. Here are 6 things you should say.

As children start back at school this week, it’s not just ChatGPT you need to be thinking about.

AI language models are rife with different political biases

New research explains you’ll get more right- or left-wing answers, depending on which AI model you ask.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.