Computing

Marvin Minsky on Common Sense and Computers That Emote

(Page 2 of 3)

  • Thursday, July 13, 2006
  • By Wade Roush

TR: Why do people shy away from the common-sense problem?

MM: I think people look around to see what field is currently popular, and then waste their lives on that. If it's popular, then to my mind you don't want to work on it. Now, physics is different. There, people say "This popular theory works pretty well, but it doesn't explain this or that -- so I should look at that." But when people write AI papers, they only tell what their program did, and not how it failed or what kinds of problems it couldn't solve. People don't consider the important problem to be the one their system hasn't solved. People have gotten neural networks to recognize that if you are looking for a taxi, for example, you should look for a yellow moving object. But they don't ask how come these networks can't answer other kinds of questions.

TR: But understanding common sense is a much harder problem, isn't it? Couldn't that explain why so many AI researchers go into other areas?

MM: That's true. Back when I was writing The Society of Mind, we worked for a couple of years on making a computer understand a simple children's story: "Mary was invited to Jack's party. She wondered if he would like a kite." If you ask the question "Why did Mary wonder about a kite?" everybody knows the answer -- it's probably a birthday party, and if she's going that means she has been invited, and everybody who is invited has to bring a present, and it has to be a present for a young boy, so it has to be something boys like, and boys like certain kinds of toys like bats and balls and kites. You have to know all of that to answer the question. We managed to make a little database and got the program to understand some simple questions. But we tried it on another story and it didn't know what to do. Some of us concluded that you'd have to know a couple million things before you could make a machine do some common-sense thinking.

TR: As people have realized how difficult it is to get a computer to understand even simple common-sense situations, would you say that some of the optimism around the possibilities for AI in the 1950s and 1960s has dissipated?

MM: I don't think optimism is the right word. I think we were asking good questions, but somehow most of the people working on what they called AI started looking for one of these universal solutions. In physics, that worked; there were Newton's equations and then Maxwell's and then relativity and quantum theory. Most AI people are trying to imitate that and find a general theory. But humans have 100 different brain centers that all work in slightly different ways. You shouldn't be working on a single solution; you should be working on a host of gadgets.

TR: A lot of the funding for AI has come from the Defense Advanced Research Projects Agency (DARPA), where there's a pretty clear demand for practical results. In fact, they're one of the sponsors of the Dartmouth AI conference. How has DARPA shaped the direction of AI research?

MM: In the early days, DARPA supported people rather than proposals. There was a lot of progress from starting in 1963; for about ten years the kinds of things I am talking about did flourish. And then in the early 1970s there was a kind of funny accident. Senator Mike Mansfield, quite a liberal, decided that the Department of Defense shouldn't be supporting civilian research. So he was responsible for ARPA becoming DARPA, and straining not to compete with industrial and civilian research. So it became much harder for them to support visionary researchers.

At the same time, the American corporate research community started to disappear in the early 1970s. Bell Labs and RCA and the others essentially disappeared from this sort of activity. And another thing happened: the entrepreneur bug hit. By the 1980s, many people were starting to try to patent things and start startups and make products, and that coincided with the general disappearance of young scientists. People who could have become productive scientists are now going into law and business.

So there's no way to support this research. If you have a good idea, it's hard to get it published because people say "Where's your experiment?" But the trouble with common-sense thinking is that you can't experiment until you have a big common-sense database. There is one called Cyc, started by Doug Lenat in 1985. And we have the Open Mind database, which is publicly available but not very well structured yet. But it's a whole research project just to figure out how to open up the Open Mind database.

Print

Related Articles

Software That Learns from Users

A massive AI project called CALO could revolutionize machine learning.

An Emotional Cat Robot

Robots might behave more efficiently if they had emotions.

Close Comments

To comment, please sign in or register

Forgot my password

Guest (mwhitlock)

  • 2043 Days Ago
  • 07/13/2006

Wouldn't it take 3-4 years to start...

Has anybody noticed that it takes 3-4 years of learning and experience for a 3-4 year old child to think like a 3-4 year old. And you act surprised that this process can't be replicated in a shorter time span....hhhmmm.

Reply

cassiuszedaker

1 Comment

  • 1949 Days Ago
  • 10/15/2006

Re: Wouldn't it take 3-4 years to start...

AI research itself lacks common sense. Have AI researchers even defined AI? The Turing Test is not a definition, merely a scientific toy.

Reply

santi.ontanon

2 Comments

  • 862 Days Ago
  • 10/06/2009

Re: Wouldn't it take 3-4 years to start...

You could say the same about biology. There is no good definition of "life", and that doesn't stop them. The lack of a definition for AI, is simply the lack of a definition for "intelligence", which is not just a problem of the AI community, but of many others. But anyway, that is not a problem for advancing the research. As long as there are open problems and questions (such as what is intelligence), there can be sound research

Reply

nkryten

2 Comments

  • 1789 Days Ago
  • 03/24/2007

Re: Wouldn't it take 3-4 years to start...

This was my first thought at reading the article, why start at a 3 year olds level? Surely if we want to replicate the development process of a human we must begin by looking at what abilities a new born has and trying to replicate that in machine form.

Reply

santi.ontanon

2 Comments

  • 862 Days Ago
  • 10/06/2009

Re: Wouldn't it take 3-4 years to start...

That's like trying to fly like a bird. Imitating the human process of learning is one way. But it does not have to be necessarily the only way...

Reply

Guest (Steve Rose (Maui))

  • 2042 Days Ago
  • 07/14/2006

Congratulations to Dr. Minsky

Congratulations to Dr. Minsky on 50 years of successful promotion of himself and his work. 

It's too bad that his book "Perceptrons", a term coined by Frank Rosenblatt, put an end for twenty years to the neural modeling approach to understanding intellgence, and may have contributed to Rosenblatt's solo boating accident on Cayuga Lake, especially since the book was a smear designed to divert funding to Minsky's "black box" approach to AI (and was fabulously successful in doing so). 

The book basically discredited Rosenblatt's work by proving that a two layer Perceptron couldn't separate figure from ground, so Perceptrons weren't worthy of further investigation.  Rosenblatt was aware of the simplicity of the two layer approach he was using, and did so so that we could begin to understand neural nets without the complexity of hidden layers (which could be explored later, along with other learning algorithms).

(continued)

Reply

minsky

1 Comment

  • 1942 Days Ago
  • 10/22/2006

Re: Congratulations to Dr. Minsky

Steve said:

[The book Perceptrons by Minsky and Papert]  basically discredited Rosenblatt's work by proving that a two layer Perceptron couldn't separate figure from ground, so Perceptrons weren't worthy of further investigation.  Rosenblatt was aware of the simplicity of the two layer approach he was using, and did so so that we could begin to understand neural nets without the complexity of hidden layers (which could be explored later, along with other learning algorithms).

I presume that you are repeating a rumor, and did not actually read the book.  So far as I know, no addition of  "hidden" layers will help to enable a loop-free (non-recursive) neural network to recognize or separate connected images on a retina.  And because of this limitation of the networks themselves, no improvement in learning procedures will help.

Indeed, loopfree neural networks can do many useful things indeed, but no matter how many layers they have, there is no reason (or evidence) that they can surmount the topological limitations discussed in the book. 

I should add that while there have been many statement that try to discredit the book, it is very strange that there has been virtually no further research  to show that the same limitations do not apply to networks with multiple layers -- unless one allows unlimited numbers of inputs to each neuron.  (Of course, in that case, a 2-layer network can compute any Boolean function by expressing it in disjunctive normal form.

Perhaps we did make a mistake by emphasizing the problem of computing parity, because this particular function can be computed in logarithmically few layers.  However, if one cask about the "majority" function instead, I suspect that the problem remains quite difficult, and I'd like to see some of those critics demonstrate how large a network would be required to recognize whether an input contains more zeros than ones. 

No such problems have been solve the kinds of invective that we see in this letter. 

Reply

Advertisement

Guest (Steve Rose (Maui))

  • 2042 Days Ago
  • 07/14/2006

Congratulations continued...

However, Roseblatt had naively allowed the popular press to play up his work, which grated on Minsky.  From Wikipedia (article: Frank Rosenblatt): "For years Minsky crusaded against Rosenblatt on a very nasty and personal level, including contacting every group who funded Rosenblatt's research to denounce him as a charlatan....".  It is a shame that Minsky's work turned up so many dead ends, and ironic that one of the primary researchers who have begun to really understand how the brain works is Jeff Hawkins ("On Intelligence"), for whom brain function was a hobby until recently.  Also ironic is Minsky's complaint of an absence of people working on higher level theories.  It would have been interesting to see the progress of Rosenblatt's work over the last 40 years had Minsky not hounded him.

Reply

Guest (Joe Reuter)

  • 2036 Days Ago
  • 07/20/2006

Delayed recognition is often the reward for Genius


http://www.ieee.org/portal/pages/about/awards/sums/rosensum.html

Reply

Guest (Steve Rose)

  • 2035 Days Ago
  • 07/21/2006

Frank Rosenblatt

Thanks, Joe!  Very cool, and deserved.

Aloha,
Steve

Reply

Guest (John LaMuth)

  • 2042 Days Ago
  • 07/14/2006

Emotions and AI

Announcing the recently issued U.S. patent

Reply

Guest (Len Bullard)

  • 2042 Days Ago
  • 07/14/2006

Why Do Children Learn So Fast?

A question that I don't see answered is how can children learn that much that fast?  The scaling problem of AI is centered in how situation semantics (for lack of a better term) are related so quickly with the number of observations made.

Reply

Guest (Paul)

  • 2042 Days Ago
  • 07/14/2006

Its biological. Stimulus causes new neurons to develop in the brain, creating new memory pathways and learning.  Computers don't develop biologically, so it is harder for them to "learn" from experience and  data input.

Reply

nkryten

2 Comments

  • 1789 Days Ago
  • 03/24/2007

Re:

Could this physical development not be replicated logically?

Reply

Advertisement

stan@adnamis.org

6 Comments

  • 1665 Days Ago
  • 07/26/2007

common knowledge memories as a data base design issue.

Yes, but as a statistical association matrix.
all data is a pathway / index to other data. Ideas are built up as a result of the path you follow.  Each branch in the path builds up parts of the data 'solution'.  Think of the most general concepts as being closer to the root of the decision tree, a very specific idea / object a leaf.  See the following:

The memory code.
By Joe Z. Tsien
Scientific American, July 2007 (vol 297-1, pg 52)

Researchers are closing in on the rules that the brain uses to lay down memories.  Discovery of this memory code could lead to the design of smarter computers and Robots and even to new ways to peer into the mind.

Dr. Tsien is noteworthy for creating a new strain of lab mice ‘Doogie’(s) that have enhanced memory abilities.

Reply

Guest (sholliman)

  • 2042 Days Ago
  • 07/14/2006

"Common" sense

I think that it's more like there's nothing very "common" about common sense.  I expected to see expert systems and applications coming from AI expermentation.  Something more practical like the space race or the human genome project. What I see are the fear factor driving us away from serious advances in this field, that could have some real help for humans, towards a machine with emotions that people are afraid of.  I want a tool that I can use to build me a solar generator and help me plan the future.  If you think in terms of modularized units that can work together or separately on smaller units of work, then, hey, it's that alot like us?

Reply

Guest (Glen)

  • 2038 Days Ago
  • 07/18/2006

Whatever happened to OpenMind

I noticed that Mr. Minsky referrs to the OpenMind project as if it is ongoing, but the last several times I've checked www.openmind.org, it was obviously unmaintained and broken.  Anyone know whatever became of OpenMind?

Reply

Guest (me)

  • 2036 Days Ago
  • 07/20/2006

I think the driving force behind the project (push singh) has died. I hope this doesnt mean the end of the whole thing.

Reply

Guest (G Roper)

  • 2029 Days Ago
  • 07/27/2006

"Common sense" like "intelligence"...

Neither are well-defined. It's always best to  define a topic clearly in operational terms before doing research. Good Old-Fashioned AI (GOFAI)never did that. The reason was that, GOFAI was the wrong approach. So-called Nouvelle AI is now finding the answer.

Unfortunately Minsky _built_ the GOFAI road. His legacy will be "A bright guy, with lots of ideas, who led us astray for 20 years."

Reply

Guest (G Roper)

  • 2029 Days Ago
  • 07/27/2006

GOFAI yields to Nouvelle AI

Nouvelle AI research, initiated by Hans Moravec and Rodney Brooks, is yielding AI systems that work in the real world.

And the astonishing experimental work of Luc Steels at the Paris Sony Labs demonstrating  how languages are created by communicating robots deserves a Nobel prize.

Reply

Guest (Melchor batista)

  • 2029 Days Ago
  • 07/27/2006

de Bono

Most of what is being discussed here was discussed in great depth in one book: "Workings of Mind" (neural pathways) and popularized in two other: "Lateral Thinking" (different perspectives)and "Six Thinking Hats" (different modes of thinking, including emotions) by Dr. Edward de Bono back in the late 60's and early 70's.

Reply

Advertisement

MAGAZINE

Can We Build Tomorrow's Breakthroughs?

Manufacturing in the United States is in trouble. That's bad news not just for the country's economy but for the future of innovation.

Sponsored Content

Technologies from National Instruments

Adding Data Logging
Log measured data to a file and open it in Microsoft Excel

> Click here for more National Instruments Videos <
Whitepaper

Temperature Measurements with Thermocouples: How-To Guide

This document is part of the “How-To Guide for Most Common Measurements” centralized resource portal. This tutorial provides a detailed guide for measurement and device considerations to take temperature measurements using thermocouples. Get an introduction to thermocouples, which are inexpensive sensing devices widely used with PC-based data acquisition systems. Also review some specific thermocouple examples and learn how thermocouples work and ways to integrate them into a data acquisition measurement system.

View full PDF > Listen to story >
Find us on Youtube

Videos

A Robot Recruit that Can Do It All

More

Advertisement

Technology Review Lists

TR50

Our list of the 50 most innovative companies, including the following:

Joule Unlimited

eSolar

Google

PrimeSense

More

Advertisement

Facebook

Advertisement