The Google Magenta team, which makes machine-learning tools for the creative process, has made models that help you compose melodies, and tools that help you sketch cats. Mostly because it’s fun, but also to explore how AI can make creation more accessible. Its latest project now gives anyone a chance to make quarantine tunes to vibe to—no music training necessary.
Lo-Fi Player, designed by Vibert Thio, a technologist and artist who interned with the team this summer, lets users interact with objects in a virtual room to mix their own lo-fi hip-hop soundtracks. The goal is to make the music-mixing experience as simple and friendly as possible. The room is a two-dimensional, pixelated drawing displayed in a web browser. Clicking on different objects, like the clock and the piano, prompts the user to adjust different tracks, like the drum line and melody.
There are two machine-learning models at work in the background. One, tucked away in the radio, generates new melodies when clicked on; the other, hidden in the TV, interpolates between two melodies to create something that sounds a little bit like both.
Most of the sounds in the room, however, are not generated by machine learning—and that’s kind of the point. Throughout the process, Thio worked with lo-fi producers to curate bass lines, drum lines, and background ambience that exemplify the genre and sound good. He also wrote four melody options that users can choose from. The machine learning adds just enough of a wild card on top of the scripted tracks to give each user a unique mix.
The initial launch of Lo-Fi Player also includes an interactive YouTube livestream, where users can type commands into the chat window to change the music. The idea is to make music creation a more collective experience, with quarantine in mind. “What a tiny, small thing to bring us together during covid,” says Doug Eck, a research scientist who supervised the project.
Right now the project is in its first version, but Thio already sees more possibilities. His dream project is to make a kind of TikTok for music creation—an interface that makes it really easy for non-musicians to play with music editing, share their creations, and express themselves.
A Roomba recorded a woman on the toilet. How did screenshots end up on Facebook?
Robot vacuum companies say your images are safe, but a sprawling global supply chain for data from our devices creates risk.
The viral AI avatar app Lensa undressed me—without my consent
My avatars were cartoonishly pornified, while my male colleagues got to be astronauts, explorers, and inventors.
Roomba testers feel misled after intimate images ended up on Facebook
An MIT Technology Review investigation recently revealed how images of a minor and a tester on the toilet ended up on social media. iRobot said it had consent to collect this kind of data from inside homes—but participants say otherwise.
How to spot AI-generated text
The internet is increasingly awash with text written by AI software. We need new tools to detect it.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.