A View from Emerging Technology from the arXiv
The Killer App For Crowdsourced Photographs
Searching through other people’s photographs as soon as they’ve taken them is now possible thanks to a new search service
Imagine the following scenarios. A small boy becomes separated from his parents at a holiday parade. In a packed soccer stadium, in full view of thousands of fans with cameraphones, the TV cameras somehow miss the angle that would give the perfect picture of a goal. And during a family photoshoot, a thief burgles the house next door.
In all these situations, photographs taken by one or more people would be useful to other people. In the first case, any photographs of the parade taken in the moments after the boy was lost would be crucial for the police. They would be equally interested in the picture of the thief in action, which could prove to be valuable evidence. And in the final case, a sports editor would pay good money for a photograph taken at just the right angle and time, which may well exist on on camera among the thousands of fans at the event.
The question is how to search for these pictures when they are storied on mobile devices of limited power.
Today, Ardalan Amiri Sani and buddies at Rice University in Texas unveil a service called Theia that can do the trick.
Theia is a distributed search service that scans through all the photographs on a registered smartphone looking for ones that match a certain search query.
That sounds potentially expensive. Imagine calling 50 or a hundred friends in the space of a few minutes: how much would that cost?
And how pleased would you be to find that at the very moment you need it most, your smartphone is running at a snail’s pace because somebody else is searching the pictures it contains?
But Sani and co have developed a distributed search algorithm that minimises the cost to the searcher and also the disruption to the phones being searched.
It uses a two stage search system which first identifies promising candidate photos and then uploads these to the cloud where a far more powerful search algorithm can do its job without using up smartphone juice.
This, they say, is “the first working system that allows content-based search of photos inside smartphones.”
This kind of opportunistic search could certainly be useful in an albeit limited number of circumstances.
We’ve seen this kind of idea used to great effect in amateur astronomy, where many photographs of a comet together give a good indication of the comet’s trajectory around the Sun.
Perhaps there are similar applications in social situations here on Earth. The question is whether anybody can think up a killer app.
Ref: arxiv.org/abs/1106.5568: Opportunistic Content Search of Smartphone Photos
AI is here.
Own what happens next at EmTech Digital 2019.