The other day, I was reading The Very Hungry Caterpillar to my daughter. When I got to the part where the caterpillar ate through one apple, I paused, surprised by an unmistakable munching sound coming from my coffee table.
The sound was actually emitted by an app called Novel Effect that uses voice-recognition technology to insert sound effects and music to books as you read them aloud—ideally, to make the experience of reading aloud more engaging for kids at home or in the classroom.
“You still get engagement, you still get interactivity,” says Matt Hammersley, Novel Effect’s CEO and one of its four cofounders. “But they’re not staring at a screen and you’re actually encouraging face-to-face personal communication.”
A free beta version of the app is currently available for the iPhone and iPad (an Android app is coming). It’s stocked with sound effects for a handful of books like The Very Hungry Caterpillar and Where the Wild Things Are.
For now, Novel Effect makes money when users buy books from Amazon via the app. In the early fall, the Seattle-based company plans to roll out a more polished version of its app with sound effects for over 100 different books; then it will start charging a $5 monthly fee to use it. The company already has a partnership with publisher Hachette Book Group, and several others are in the works, Hammersley says.
Novel Effect’s effort to bridge the real world of books with the digital world makes a lot of sense right now: we’ve quickly gotten comfortable with voice recognition in our daily lives, from Siri on Apple’s iPhones to Alexa on Amazon’s Echo speakers. A little under a fifth of the population will use a digital assistant at least once a month this year, according to research firm eMarketer. And the people using these things the most are between the ages of 25 and 34. Chances are many of them have kids to read with.
To use Novel Effect, you open up the specific book in the app that accompanies the real-world book; this prompts the app to start listening for the book text so it can analyze your speech to figure out where you are in the story and synchronize all kinds of noises, from stomach-ache groans to neighs. It doesn’t require you to read the book straight from start to finish; you can start on page 10 and jump around if you want. And it doesn’t matter how much time you spend on one page, or whether you interrupt the reading experience to talk about things other than what’s on the page (Hammersley stresses that the app doesn’t record what users say, and is only looking for the book text).
By late this year or early next, the company also plans to offer a tool that lets anyone create new sound-enhanced stories or add sounds to existing ones.
My experiences with the current version of the app were mixed. I was charmed by the munching and a variety of other sounds in The Very Hungry Caterpillar; the timing was decent and the noises were appropriate. Yet when I tried reading Brown Bear, Brown Bear, What Do You See? it didn’t work nearly as well—tweeting and croaking interrupted my speech, spoiling the surprise of which animal would be revealed next.
Anti-aging drugs are being tested as a way to treat covid
A quick guide to the most important AI law you’ve never heard of
It will soon be easy for self-driving cars to hide in plain sight. We shouldn’t let them.
If they ever hit our roads for real, other drivers need to know exactly what they are.
Crypto is weathering a bitter storm. Some still hold on for dear life.
When a cryptocurrency’s value is theoretical, what happens if people quit believing?
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.