Finding Images
Searching for images on the Internet can be hit or miss. That’s because most image searches rely on metadata (text associated with the images, such as file names or dates), and metadata can be incomplete–if it’s there at all. Software that analyzes the images themselves has been notoriously unreliable. But it could get a boost from a technology developed at the University of California, San Diego.
The technology is based on existing systems that learn to describe pictured objects in terms of features like color, texture, and lines by practicing on pictures in a database of known objects. The UCSD system adds a new twist: it assigns each image a likelihood of belonging to categories such as “sky,” “mountain,” or “people.” Then it uses those words to label parts of the pictures. The technique is 40 percent more accurate than typical content-based image-search methods, says Nuno Vasconcelos, a UCSD professor.
Keep Reading
Most Popular
Large language models can do jaw-dropping things. But nobody knows exactly why.
And that's a problem. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.
The problem with plug-in hybrids? Their drivers.
Plug-in hybrids are often sold as a transition to EVs, but new data from Europe shows we’re still underestimating the emissions they produce.
Google DeepMind’s new generative model makes Super Mario–like games from scratch
Genie learns how to control games by watching hours and hours of video. It could help train next-gen robots too.
How scientists traced a mysterious covid case back to six toilets
When wastewater surveillance turns into a hunt for a single infected individual, the ethics get tricky.
Stay connected
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.