Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not an Insider? Subscribe now for unlimited access to online articles.

Connectivity

Snapping a Picture to Connect to a Printer or Other Device

Researchers are exploring how the camera on your smartphone could make it quick and simple to connect to smart gadgets like printers and projectors.

What if you could connect your smartphone to all kinds of “smart” appliances around you just by taking photos of them?

Snap-To-It, a project from researchers at Carnegie Mellon University, lets users connect to smart appliances by taking a picture of them.

That’s the plan behind a research project called Snap-To-It, created by researchers at Carnegie Mellon University and two other schools. A Snap-To-It Android smartphone app is used to take a picture of a device like a printer or digital projector, and the system figures out which appliance you’re trying to connect to and sends your phone the right interface to use it—to, say, print out a document or upload and control a slide presentation, as the researchers demonstrate in a video.

The aim is to make the growing numbers of Internet-connected devices, many of which use different standards to communicate and may each require their own smartphone app to use, easier to interact with, especially when you’re in a new place. A paper on the project will be presented in May at the ACM CHI 2016 computer-human interaction conference in San Jose, California.

“The ability to walk into a space that I haven’t been into before and just start using equipment that I’m authorized to is really nice,” says Anind Dey, an associate professor at Carnegie Mellon and a coauthor of the paper.

Adrian de Freitas, a graduate student and the paper’s lead author, says that Snap-To-It works behind the scenes by broadcasting the photo you take to all the devices on the network in the area; a computer-vision algorithm runs for each device, comparing your photo to existing ones to figure out what you’re trying to connect to. Information about your location and the direction your phone is pointed is considered, too, in figuring out which device is the one you want. If Snap-To-It isn’t quite sure what device you’re trying to use, it will send you an ordered list of its top five guesses. The system needs to be set up with the Internet-connected appliances in advance, which requires taking pictures of a gadget and setting up which of its functions a Snap-To-It user can use.

Researchers determined that without filtering out blurry images or images snapped from odd angles, the app connected the user to the right device 82 percent of the time when using just one reference image. Now the researchers are toying with how to use smartphone sensors—a barometer, for instance—to better determine your position within a building, which would make it easier for Snap-To-It to figure out what device you’re trying to connect to.

They’re also considering other ways the system could be useful beyond enabling you to control devices—perhaps you could take a photo of a device and get more information about what it can do, or snap an image to control several devices simultaneously.

Keep up with the latest in IOT at EmTech Digital.
Don't be left behind.

March 25-26, 2019
San Francisco, CA

Register now
More from Connectivity

What it means to be constantly connected with each other and vast sources of information.

Want more award-winning journalism? Subscribe and become an Insider.
  • Insider Plus {! insider.prices.plus !}* Best Value

    {! insider.display.menuOptionsLabel !}

    Everything included in Insider Basic, plus the digital magazine, extensive archive, ad-free web experience, and discounts to partner offerings and MIT Technology Review events.

    See details+

    Print + Digital Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

    Technology Review PDF magazine archive, including articles, images, and covers dating back to 1899

    10% Discount to MIT Technology Review events and MIT Press

    Ad-free website experience

  • Insider Basic {! insider.prices.basic !}*

    {! insider.display.menuOptionsLabel !}

    Six issues of our award winning print magazine, unlimited online access plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    Print Magazine (6 bi-monthly issues)

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

  • Insider Online Only {! insider.prices.online !}*

    {! insider.display.menuOptionsLabel !}

    Unlimited online access including articles and video, plus The Download with the top tech stories delivered daily to your inbox.

    See details+

    Unlimited online access including all articles, multimedia, and more

    The Download newsletter with top tech stories delivered daily to your inbox

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.