A chatbot trained to engage its partner on personal topics can learn to predict information about the other participant.
Background: Even with AI, chatbots are brittle systems that typically can’t talk about anything outside of what they’ve been trained on. They also tend not to have a personality or long-term memory, so most development for chat agents is around task-specific goals, like airline bookings.
Once more, with feeling: A new paper by Facebook AI Research demonstrates a way to create a bot that is good at general conversation, a.k.a. chit chat. Trained on a new data set consisting of 164,356 utterances between crowdsourced workers who were asked to chat, the system can store a persona in a memory-augmented neural network and produce “more personal, specific, consistent and engaging responses.”
Getting to know you: Using the same setup, the chatbot asks its dialogue partner questions about personal topics, which it can then use to build a model of the partner. Human evaluators still ranked human partners much higher across board for things like persona and consistency, but this model outscored one trained on movie dialogue—one of the largest dialogue data sets out there.
The inside story of how ChatGPT was built from the people who made it
Exclusive conversations that take us behind the scenes of a cultural phenomenon.
AI is dreaming up drugs that no one has ever seen. Now we’ve got to see if they work.
AI automation throughout the drug development pipeline is opening up the possibility of faster, cheaper pharmaceuticals.
GPT-4 is bigger and better than ChatGPT—but OpenAI won’t say why
We got a first look at the much-anticipated big new language model from OpenAI. But this time how it works is even more deeply under wraps.
The original startup behind Stable Diffusion has launched a generative AI for video
Runway’s new model, called Gen-1, can change the visual style of existing videos and movies.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.