Facebook has built stunning virtual spaces for its AI programs to explore
Researchers at Facebook have created a number of extremely realistic virtual homes and offices so that their AI algorithms can learn how the real world works.
Real deal: A team at Facebook Reality Labs created 18 “sample spaces” through a program known as Replica. The idea is for AI agents to learn about real-world objects through exploration and practice. In theory, this could make chatbots and robots smarter, and it could make it possible to manipulate VR in powerful ways. But the virtual spaces need to be extremely lifelike for this to be transferable to the real world.
Mirror world: The environments were created by mapping real offices and homes using a high-definition 3D camera rig. The researchers also developed new software to deal with reflections, which can easily confuse such scanning systems. Whereas other simulation engines run at around 50 to 100 frames per second, Facebook says AI Habitat runs at over 10,000 frames per second, which makes it possible to test AI agents rapidly.
Home alone: These virtual spaces can be loaded into a new environment called AI Habitat, inside which AI programs can explore and learn. The algorithms will first be trained to recognize objects in different settings. But over time they should build some common-sense understanding about the conventions of the physical world—like the fact that tables typically support other objects.
Uncommon sense: A lack of common sense is a glaring problem for today’s AI systems. Unlike a person, a chatbot or robot cannot rely on an understanding of the world—things like physics, logic, and social norms—to figure out the intent of an ambiguous command. The complexity and ambiguity of language makes this situation all too common.
Deep Dive
Artificial intelligence
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
AI is dreaming up drugs that no one has ever seen. Now we’ve got to see if they work.
AI automation throughout the drug development pipeline is opening up the possibility of faster, cheaper pharmaceuticals.
GPT-4 is bigger and better than ChatGPT—but OpenAI won’t say why
We got a first look at the much-anticipated big new language model from OpenAI. But this time how it works is even more deeply under wraps.
The original startup behind Stable Diffusion has launched a generative AI for video
Runway’s new model, called Gen-1, can change the visual style of existing videos and movies.
Stay connected
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.