Skip to Content
Artificial intelligence

This AI-generated musak shows us the limit of artificial creativity

A powerful AI algorithm can dream up music that echoes Bach or the Beatles, but it isn’t real creativity.
April 26, 2019
Sheet music.
Sheet music.
Sheet music.Unsplash/Radek Grzybowski.

If Mozart were alive today (and if he was feeling a bit uninspired) he might well sit down and produce a piece of music like this:

A piece of music, in the style of Mozart, generated by MuseNet.

The tune is actually (you guessed it) the work of a machine-learning algorithm that was fed thousands of pieces of MIDI music as training data.

The algorithm, called MuseNet, was developed by researchers at OpenAI, a research company in San Francisco that's focused on researching intelligence and studying its potential impact.

The researchers trained a very large neural network known as a transformer. This type of network learns to predict the next few notes in a piece of music. You can then give the network a few notes, and have it conjure up something new. It makes it possible to mix different genres and styles, and even to add and remove specific instruments.

The work shows how effectively such a model can capture and reproduce statistical patterns that reflect the character of something like a piece of music.

The same researchers previous used similar technology to auto-generate text from a starting sentence. These results were sometimes remarkably realistic—prompting the researchers to fret (a little dramatically) about the risk that such a tool could be used to mass-produce fake news.

The MuseNet project is interesting from a music-history perspective, as it points to some interesting connections (statistically speaking) between different artists across genres and centuries. Who’d have thought that Richard Wagner and Britney Spears shared so much musical taste?

The tool is also quite fun to play with. If you’ve ever wondered what it might sound like if the Beatles jammed with Lady Gaga, the algorithm offers an answer of sorts:

How the Beatles might improvise around Lady Gaga's Poker Face, according to MuseNet.

Some people see great potential for this sort of technology to inspire new music. Sageev Oere, a machine learning researcher at the University of Toronto who's interested in AI-generated music, was wowed by the tool's ability to riff on a famous piece of Mozart's.

It's true that tools like MuseNet may inspire new ways of making music. But how does it compare to human musical creativity? I asked Zach Lipton, an assistant professor at CMU and an accomplished jazz musician, what he thought of MuseNet’s jazz improvisations. 

(An LSTM is a type of neural network, originally developed by Jürgen Schmidhuber, that can capture the characteristics of a piece of music quite effectively.)

Lipton’s skepticism isn’t just musical snobbery. MuseNet, like any AI system that generates music, or art, or text, isn’t being creative or inventive in the same way as a human musician. It’s learning the patterns in existing pieces of work and then regurgitating some statistical variation. 

As we’ve noted before, it’s unclear how artistically creative AI can be at all. Unlike MuseNet’s creations, human music is rooted in culture, history, and language. It has remarkable capacity to surprise, shock, and inspire. The algorithms have some ways to go yet.

Updated April 27 with additional comment. 

Deep Dive

Artificial intelligence

conceptual illustration showing various women's faces being scanned
conceptual illustration showing various women's faces being scanned

A horrifying new AI app swaps women into porn videos with a click

Deepfake researchers have long feared the day this would arrive.

storm front
storm front

DeepMind’s AI predicts almost exactly when and where it’s going to rain

The firm worked with UK weather forecasters to create a model that was better at making short term predictions than existing systems.

computation concept
computation concept

How AI is reinventing what computers are

Three key ways artificial intelligence is changing what it means to compute.

digital twins concept
digital twins concept

How AI digital twins help weather the world’s supply chain nightmare

Just-in-time shipping is dead. Long live supply chains stress-tested with AI digital twins.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.