Skip to Content
Uncategorized

App Tells Your Friends What You’re Watching

iPhone app analyzes sound to determine what’s on your TV.
February 10, 2011

Sitting at home in front of the TV could soon become an altogether more sociable experience. A new iPhone app can identify the show you’re watching just by analyzing a few seconds of audio, making it possible to automatically share your TV viewing choices with friends through Facebook and Twitter. It only does this when the user presses a button to activate it.

What’s on: IntoNow recognizes TV shows by analyzing a few seconds of audio, and lets you share comments with friends.

People often talk about what they watched the night before, so TV viewing already has a social element to it, says Adam Cahan, founder and CEO of IntoNow, the startup company that makes the app. “What we’re focused on is how to connect people through the shows that they love,” he says.  

Using a technology called SoundPrinting, developed and patented by IntoNow, the app allows people to instantly see what their friends are watching, and discuss them through social networking functionality, all while the shows are still on the air, says Cahan.

IntoNow uses software that carries out a spectral analysis of audio to create unique identifiers of TV content that can then be indexed and searched quickly. “Our catalog covers anything that’s been on TV within the last five years,” says Cahan. That equates to 140 million minutes or 266 years of content, he says.

Other smart-phone apps use audio tagging to identify music. London-based Shazam, for instance, can identify 10 million songs based on a few seconds of music per song.

IntoNow, however, can also identify shows that’s haven’t aired before, says Cahan. “You can identify a new episode of Dexter or breaking news, even,” he says. “We did it with the Super Bowl this weekend.”

This is possible because IntoNow continuously monitors the broadcasts from 130 TV channels, carrying out a spectral analysis of the audio 20 times a second, says Rob Johnson, the company’s technology architect. So when someone uses the app, even new shows should already be in the system.

“When [the app] searches the index, it doesn’t tell you what program it was,” he says. Instead, it delivers the channel and time at which that segment was aired, and from this, the system can work out the precise program and episode that was being watched.

Others are also looking at identifying TV content in this way, says Marie-José Montpetit, a pioneer of social TV at MIT. Recognizing live broadcasts is an advance, she says: “It’s a nice gadget that could take off.” But she doubts it will fundamentally change the way we watch TV.

Even so, it could change the way advertisers operate. Cahan says the information collected by IntoNow could be used to determine what part of a show people are watching. He adds that “it gives you the ability to say ‘I’m into that commercial.’ ”

An app that records audio from the living room may raise privacy worries, says Montpetit. But, according to Johnson, there is no risk of anyone being able to eavesdrop on users. “We are not recording the audio, we are analyzing it,” he says. “So there’s no way to reconstruct that audio.”

Keep Reading

Most Popular

Large language models can do jaw-dropping things. But nobody knows exactly why.

And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

OpenAI teases an amazing new generative video model called Sora

The firm is sharing Sora with a small group of safety testers but the rest of us will have to wait to learn more.

Google’s Gemini is now in everything. Here’s how you can try it out.

Gmail, Docs, and more will now come with Gemini baked in. But Europeans will have to wait before they can download the app.

This baby with a head camera helped teach an AI how kids learn language

A neural network trained on the experiences of a single young child managed to learn one of the core components of language: how to match words to the objects they represent.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.