Technology Review - Published By MIT
Advertisement

Marvin Minsky on Common Sense and Computers That Emote

Continued from page 2

By Wade Roush

Thursday, July 13, 2006

smaller text tool iconmedium text tool iconlarger text tool icon

TR: You mentioned that a computer needs to know a couple million things in order to make common-sense connections. But Lenat and his colleagues have been working on exactly that, spending years feeding common-sense knowledge into Cyc. Why is another database needed?

MM: When Lenat started Cyc in 1985, it was pretty ambitious, and there was no other such project. My colleagues and I said let's wait and see how this works. And then nothing happened for a while.

Lenat has done some very good things. The trouble is that Cyc is very hard to use and it's proprietary, so it isn't used by researchers much. And there are a lot of problems with his system that didn't show up earlier because there wasn't any competition.

They've made it consistent, so it actually doesn't know much. Should a whale be considered a mammal or a fish? Whales have many fish-like characteristics, so most people are surprised when they hear it's a mammal. But the real answer is, it should be both. A common-sense database shouldn't necessarily be logically consistent. Lenat finally realized that they should restructure Cyc by providing for the different contexts in which a question may come up. But the database was originally structured to make things very logical, and its language is predicate calculus. Our hope is to make the Open Mind system use natural language -- which is of course full of ambiguities, but ambiguities are both good and bad.

TR: What are some of the main arguments or research recommendations in your upcoming book, The Emotion Machine?

MM: The main idea in the book is what I call resourcefulness. Unless you understand something in several different ways, you are likely to get stuck. So the first thing in the book is that you have got to have different ways of describing things. I made up a word for it: "panalogy." When you represent something, you should represent it in several different ways, so that you can switch from one to another without thinking.

The second thing is that you should have several ways to think. The trouble with AI is that each person says they're going to make a system based on statistical inference or genetic algorithms, or whatever, and each system is good for some problems but not for most others. The reason for the title The Emotion Machine is that we have these things called emotions, and people think of them as mysterious additions to rational thinking. My view is that an emotional state is a different way of thinking.

When you're angry, you give up your long-range planning and you think more quickly. You are changing the set of resources you activate. A machine is going to need a hundred ways to think. And we happen to have a hundred names for emotions, but not for ways to think. So the book discusses about 20 different directions people can go in their thinking. But they need to have extra meta-knowledge about which way of thinking is appropriate in each situation.

TR: Are you saying that computers should get angry?

MM: If somebody is in your way, and they won't get out of your way, you have to intimidate them or scare them or make them be afraid. That's a perfectly reasonable way to solve the problem if you're in a hurry and if something bad will happen if you can't get around them. I propose that we need about 20 different words for these ways of thinking. Then you can throw "rational" away.

Minsky's The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind is scheduled to be published in hardcover by Simon & Schuster in November 2006. Minsky has published a draft of the book online.

Comments

  • Wouldn't it take 3-4 years to start...
    Has anybody noticed that it takes 3-4 years of learning and experience for a 3-4 year old child to think like a 3-4 year old. And you act surprised that this process can't be replicated in a shorter time span....hhhmmm.
    Rate this comment: 12345
    Guest (mwhitlock)
    07/13/2006
    Posts:1
    • Re: Wouldn't it take 3-4 years to start...
      AI research itself lacks common sense. Have AI researchers even defined AI? The Turing Test is not a definition, merely a scientific toy.
      Rate this comment: 12345

      cassiuszedak...
      10/15/2006
      Posts:1
      • Re: Wouldn't it take 3-4 years to start...
        You could say the same about biology. There is no good definition of "life", and that doesn't stop them. The lack of a definition for AI, is simply the lack of a definition for "intelligence", which is not just a problem of the AI community, but of many others. But anyway, that is not a problem for advancing the research. As long as there are open problems and questions (such as what is intelligence), there can be sound research
        Rate this comment: 12345

        santi.ontano...
        10/06/2009
        Posts:2
    • Re: Wouldn't it take 3-4 years to start...
      This was my first thought at reading the article, why start at a 3 year olds level? Surely if we want to replicate the development process of a human we must begin by looking at what abilities a new born has and trying to replicate that in machine form.
      Rate this comment: 12345

      nkryten
      03/24/2007
      Posts:2
  • Congratulations to Dr. Minsky
    Congratulations to Dr. Minsky on 50 years of successful promotion of himself and his work. 

    It's too bad that his book "Perceptrons", a term coined by Frank Rosenblatt, put an end for twenty years to the neural modeling approach to understanding intellgence, and may have contributed to Rosenblatt's solo boating accident on Cayuga Lake, especially since the book was a smear designed to divert funding to Minsky's "black box" approach to AI (and was fabulously successful in doing so). 

    The book basically discredited Rosenblatt's work by proving that a two layer Perceptron couldn't separate figure from ground, so Perceptrons weren't worthy of further investigation.  Rosenblatt was aware of the simplicity of the two layer approach he was using, and did so so that we could begin to understand neural nets without the complexity of hidden layers (which could be explored later, along with other learning algorithms).

    (continued)
    Rate this comment: 12345
    Guest (Steve Rose (Maui))
    07/14/2006
    Posts:1
    • Re: Congratulations to Dr. Minsky
      Steve said:

      [The book Perceptrons by Minsky and Papert]  basically discredited Rosenblatt's work by proving that a two layer Perceptron couldn't separate figure from ground, so Perceptrons weren't worthy of further investigation.  Rosenblatt was aware of the simplicity of the two layer approach he was using, and did so so that we could begin to understand neural nets without the complexity of hidden layers (which could be explored later, along with other learning algorithms).

      I presume that you are repeating a rumor, and did not actually read the book.  So far as I know, no addition of  "hidden" layers will help to enable a loop-free (non-recursive) neural network to recognize or separate connected images on a retina.  And because of this limitation of the networks themselves, no improvement in learning procedures will help.

      Indeed, loopfree neural networks can do many useful things indeed, but no matter how many layers they have, there is no reason (or evidence) that they can surmount the topological limitations discussed in the book. 

      I should add that while there have been many statement that try to discredit the book, it is very strange that there has been virtually no further research  to show that the same limitations do not apply to networks with multiple layers -- unless one allows unlimited numbers of inputs to each neuron.  (Of course, in that case, a 2-layer network can compute any Boolean function by expressing it in disjunctive normal form.

      Perhaps we did make a mistake by emphasizing the problem of computing parity, because this particular function can be computed in logarithmically few layers.  However, if one cask about the "majority" function instead, I suspect that the problem remains quite difficult, and I'd like to see some of those critics demonstrate how large a network would be required to recognize whether an input contains more zeros than ones. 

      No such problems have been solve the kinds of invective that we see in this letter. 
      Rate this comment: 12345

      minsky
      10/22/2006
      Posts:1
      Avg Rating:
      5/5
  • Congratulations continued...
    However, Roseblatt had naively allowed the popular press to play up his work, which grated on Minsky.  From Wikipedia (article: Frank Rosenblatt): "For years Minsky crusaded against Rosenblatt on a very nasty and personal level, including contacting every group who funded Rosenblatt's research to denounce him as a charlatan....".  It is a shame that Minsky's work turned up so many dead ends, and ironic that one of the primary researchers who have begun to really understand how the brain works is Jeff Hawkins ("On Intelligence"), for whom brain function was a hobby until recently.  Also ironic is Minsky's complaint of an absence of people working on higher level theories.  It would have been interesting to see the progress of Rosenblatt's work over the last 40 years had Minsky not hounded him.
    Rate this comment: 12345
    Guest (Steve Rose (Maui))
    07/14/2006
    Posts:1
  • Emotions and AI
    Announcing the recently issued U.S. patent
    Rate this comment: 12345
    Guest (John LaMuth)
    07/14/2006
    Posts:1
  • Why Do Children Learn So Fast?
    A question that I don't see answered is how can children learn that much that fast?  The scaling problem of AI is centered in how situation semantics (for lack of a better term) are related so quickly with the number of observations made.
    Rate this comment: 12345
    Guest (Len Bullard)
    07/14/2006
    Posts:1
    • [no subject]
      Its biological. Stimulus causes new neurons to develop in the brain, creating new memory pathways and learning.  Computers don't develop biologically, so it is harder for them to "learn" from experience and  data input.
      Rate this comment: 12345
      Guest (Paul)
      07/14/2006
      Posts:1
      • Re:
        Could this physical development not be replicated logically?
        Rate this comment: 12345

        nkryten
        03/24/2007
        Posts:2
        • common knowledge memories as a data base design issue.
          Yes, but as a statistical association matrix.
          all data is a pathway / index to other data. Ideas are built up as a result of the path you follow.  Each branch in the path builds up parts of the data 'solution'.  Think of the most general concepts as being closer to the root of the decision tree, a very specific idea / object a leaf.  See the following:

          The memory code.
          By Joe Z. Tsien
          Scientific American, July 2007 (vol 297-1, pg 52)

          Researchers are closing in on the rules that the brain uses to lay down memories.  Discovery of this memory code could lead to the design of smarter computers and Robots and even to new ways to peer into the mind.

          Dr. Tsien is noteworthy for creating a new strain of lab mice ‘Doogie’(s) that have enhanced memory abilities.
          Rate this comment: 12345

          stan@adnamis...
          07/26/2007
          Posts:4
          Avg Rating:
          3/5
  • "Common" sense
    I think that it's more like there's nothing very "common" about common sense.  I expected to see expert systems and applications coming from AI expermentation.  Something more practical like the space race or the human genome project. What I see are the fear factor driving us away from serious advances in this field, that could have some real help for humans, towards a machine with emotions that people are afraid of.  I want a tool that I can use to build me a solar generator and help me plan the future.  If you think in terms of modularized units that can work together or separately on smaller units of work, then, hey, it's that alot like us?
    Rate this comment: 12345
    Guest (sholliman)
    07/14/2006
    Posts:1
  • Whatever happened to OpenMind
    I noticed that Mr. Minsky referrs to the OpenMind project as if it is ongoing, but the last several times I've checked www.openmind.org, it was obviously unmaintained and broken.  Anyone know whatever became of OpenMind?
    Rate this comment: 12345
    Guest (Glen)
    07/18/2006
    Posts:1
    • [no subject]
      I think the driving force behind the project (push singh) has died. I hope this doesnt mean the end of the whole thing.
      Rate this comment: 12345
      Guest (me)
      07/20/2006
      Posts:1
  • "Common sense" like "intelligence"...
    Neither are well-defined. It's always best to  define a topic clearly in operational terms before doing research. Good Old-Fashioned AI (GOFAI)never did that. The reason was that, GOFAI was the wrong approach. So-called Nouvelle AI is now finding the answer.

    Unfortunately Minsky _built_ the GOFAI road. His legacy will be "A bright guy, with lots of ideas, who led us astray for 20 years."
    Rate this comment: 12345
    Guest (G Roper)
    07/27/2006
    Posts:1
  • GOFAI yields to Nouvelle AI
    Nouvelle AI research, initiated by Hans Moravec and Rodney Brooks, is yielding AI systems that work in the real world.

    And the astonishing experimental work of Luc Steels at the Paris Sony Labs demonstrating  how languages are created by communicating robots deserves a Nobel prize.
    Rate this comment: 12345
    Guest (G Roper)
    07/27/2006
    Posts:1
  • de Bono
    Most of what is being discussed here was discussed in great depth in one book: "Workings of Mind" (neural pathways) and popularized in two other: "Lateral Thinking" (different perspectives)and "Six Thinking Hats" (different modes of thinking, including emotions) by Dr. Edward de Bono back in the late 60's and early 70's.
    Rate this comment: 12345
    Guest (Melchor batista)
    07/27/2006
    Posts:1

Log In

Forgot your password?     Register »
Advertisement

Videos

Laser-Triggered Chemical Reactions
Featured Content
Sponsored by:
White Papers

Twelve ways to reduce costs with SQL Server 2008
Find out how to reduce costs and get more efficient

Download

Total Economic Impact of SQL Server 2008 Upgrade
Forrester reports on increasing productivity and management capabilities

Download 

Achieving Cost and Resource Savings with UC
How Office Communications Server R2 and Exchange Server can make your business smarter and more efficient

Download 

The Compelling Case for Conferencing
Read how you can improve workload support and find IT efficiencies

Download

How Windows Server 2008 R2 Helps Optimize IT and Save you Money
Read how you can improve workload support and find IT efficiencies

Download

Windows Server 2008 R2 Hyper-V Live Migration
See how Windows Server 2008 R2 and Hyper-V enable virtualization and Live Migration

Download
Advertisement
Subscribe to Technology Review's daily e-mail update. Enter your e-mail address

TECHNOLOGY RESOURCES
Advertisement
MIT Massachusetts Institute of Technology © 2009 Technology Review. All Rights Reserved.