Skip to Content

Origin of the Patents

Now reinventing recent patents, genetic programming heads toward automated “invention machines.”
August 3, 2001

The adjective “Darwinian” is often applied to the dog-eat-dog software industry. But get ready for software that orchestrates natural selection among computer programs so that researchers can harvest the surviving code.

That striking notion underlies genetic programming, a branch of artificial intelligence in which a computer solves problems in biomedicine, electronics and even robotic soccer playing by evolving its own software. Researchers have been working with the concept for many years and have implemented it in a few high-end engineering design applications.

At Stanford, genetic programming research seeks to produce results that are competitive with human problem solving, and to test that by evaluating success in duplicating or infringing upon existing U.S. patents. The research effort now has accomplished just that for patents generated as recently as last year. The work may eventually deliver automated “invention machines,” says John Koza, genetic computing guru and consulting professor of biomedical informatics at Stanford.

Environment for Evolution

Koza says the recipe for perfection of a species goes like this:

  • Create a rules-based environment defined by a problem you want to solve-such as designing an analog audio filter, finding a metabolic pathway or creating an antenna design.
  • Add a “primordial ooze” of half-a-million or so randomly generated programs, each designed to take a stab at the problem.
  • Step back and let the population evolve generation after generation. The programs electronically die off, mutate, crossbreed and adapt to the environment, “until the fittest individual in a late generation solves, or approximately solves, the problem,” Koza says.

Not surprisingly, such forced evolution could bring almost any computing system to its knees. Fortunately, Koza’s resources include a 1,000-node parallel computing cluster at Genetic Programming Inc. in Los Altos, CA, where Koza is president.

Patent Progress

Koza, who began his work in genetic programming in the 1980s, has long been fascinated by the question, how do you get a computer to do what needs to be done without telling it how to do it?

Until recently, his organic software-breeding method was able to dream up only inventions that duplicated or infringed on patents filed as early as 1917 and as late as 1974. But Koza has set his sights forward, focusing on patents filed in the year 2000 or later, which demonstrate the state-of-the art for humans assisted with conventional engineering software.

“Five months ago, we didn’t have any results where we duplicated or infringed on very recent patents,” he says. “Now, we’ve got two in our sack and four others that are in various stages of programming.”

Concentrating on what he calls “the black arts”-areas where there’s no known mathematical method to solve the problem quickly-Koza’s recent focuses include controllers, analog circuits and cellular automata.

Competing with Humans

But if genetic programming has advanced to the point where it can duplicate recent patents, how soon will it be before Koza’s genetic programming experiments cook up inventions no one has thought of before?

“I imagine we have done that but we don’t know it,” laughs Koza. To identify valuable, original results rather than simply matching patents, he explains, a human expert in the given field would need to evaluate tens of thousands of survivors.

Koza cautiously acknowledges that companies may eventually be interested in licensing his technology, but he must hit a higher number of contemporary patents first. “Clearly, the next step is to come up with patents that haven’t been invented,” he says.

“When we get a group of six together, we’re going to stop that project and try to take the next step,” he says. “But we haven’t yet. There’s so much bogus stuff in the AI field where people babbled about what they thought they were going to do before they did it. We’re still waiting 30 years later for five percent of it.”

With a little luck, Koza and company will add to that bottom line soon.

Keep Reading

Most Popular

transplant surgery
transplant surgery

The gene-edited pig heart given to a dying patient was infected with a pig virus

The first transplant of a genetically-modified pig heart into a human may have ended prematurely because of a well-known—and avoidable—risk.

open sourcing language models concept
open sourcing language models concept

Meta has built a massive new language AI—and it’s giving it away for free

Facebook’s parent company is inviting researchers to pore over and pick apart the flaws in its version of GPT-3

Muhammad bin Salman funds anti-aging research
Muhammad bin Salman funds anti-aging research

Saudi Arabia plans to spend $1 billion a year discovering treatments to slow aging

The oil kingdom fears that its population is aging at an accelerated rate and hopes to test drugs to reverse the problem. First up might be the diabetes drug metformin.

images created by Google Imagen
images created by Google Imagen

The dark secret behind those cute AI-generated animal images

Google Brain has revealed its own image-making AI, called Imagen. But don't expect to see anything that isn't wholesome.

Stay connected

Illustration by Rose WongIllustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at customer-service@technologyreview.com with a list of newsletters you’d like to receive.