Google has created an artificial-intelligence code of ethics that prohibits the development of autonomous weapons. But the principles leave sufficient wiggle room for Google to benefit from lucrative defense deals down the line.
The announcement comes in the wake of significant internal protest over the use of Google’s AI technology by a Department of Defense initiative called the Algorithmic Warfare Cross-Functional Team. The goal of this venture, known internally as Project Maven, is to improve the accuracy of drone strikes, among other things.
Last month a dozen Google workers quit over the scandal, and many more signed an open letter of protest.
The uproar captures the fears many have about how technology might help automate warfare in the future. The situation is not simple, however.
Artificial intelligence could help make some weapons systems safer and less error prone. There are also many mundane applications of AI across the defense industry. Google doesn’t want to disavow this huge potential market for its cloud AI technology.
Google’s CEO, Sundar Pichai, announced the new code in a blog post today. It suggests seven principles for guiding Google’s use of AI, stating that it should benefit society; avoid algorithmic bias; respect privacy; be tested for safety; be accountable to the public; maintain scientific rigor; and be made available to others in accordance with the same principles.
But Pichai also took pains to state that Google would not allow its AI technology to be used to develop anything that could cause harm, including “weapons or other technologies whose principal purpose or implementation is to cause or directly facilitate injury to people.”
Pichai said Google would also avoid developing surveillance technology that violates internationally accepted norms on human rights, or any technology that contravenes international laws.
Artificial intelligence is developing quickly, and Google has run into other problems involving AI projects. One of its computer vision systems, for example, repeatedly misidentified people of African heritage as gorillas. The company abandoned its “Don’t be evil” motto this April, but it retains an idealistic culture.
Military uses of artificial intelligence could be increasingly contentious as the technology is adopted in new ways and companies seek to sell their cloud AI technology as widely as possible.
Machine learning and artificial intelligence will inevitably become more important for intelligence and defense work. Other US tech companies, including Amazon and Microsoft, have bid on a multibillion-dollar cloud computing project with the Pentagon.
The US Navy wants swarms of thousands of small drones
Budget documents reveal plans for the Super Swarm project, a way to overwhelm defenses with vast numbers of drones attacking simultaneously.
Here’s how the Nord Stream gas pipelines could be fixed
The first step will be figuring out the extent of the damage. Then the difficulties really begin.
A wrongfully terminated Chinese-American scientist was just awarded nearly $2 million in damages
"The settlement makes clear that when the government discriminates, it’s going to be held accountable," said Sherry Chen's lawyer.
Inside effective altruism, where the far future counts a lot more than the present
The giving philosophy, which has adopted a focus on the long term, is a conservative project, consolidating decision-making among a small set of technocrats.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.