Jen-Hsun Huang, CEO of the chipmaker Nvidia, is either very prescient or very lucky. His company was built around graphics processing units (GPUs) for video games. But those same chips are now widely used in artificial-intelligence projects such as efforts to build self-driving cars.
I think robotics is going to be huge. The reason we chose [to make a chip for] self-driving cars is that it’s the easiest robotics challenge. Deep learning has given us an algorithm that can finally allow robots to learn for themselves, from high-level goals, and through iteration discover for itself. I don’t think it’s possible to teach a robot that by writing programs.
Deep learning has certainly been successful, but it’s only a very approximate simulation of what goes on in the brain. Are you interested in developing hardware that works more like the underpinnings of biological intelligence?
We’re trying to build a better plane rather than figure out how a bird works. Some people describe it as neurons, but the analogy to the brain is very loose. To us it’s a whole bunch of mathematics that extracts the important features out of images or voice or sensor action. Any analogy to a brain is not necessarily that important.
We work very closely with the DeepMind guys, and there is no question AlphaGo was a milestone in human endeavor. It’s amazing that a machine could learn the deep intuition needed to play. I’d love to see us advance these new ideas, whether its memory, reinforcement learning, or transfer learning, unsupervised learning. All of these areas of research will expand the capabilities of this tool called deep learning dramatically. As soon as I learn the challenges of today’s architectures, I can put those ideas into the next architecture.
