Google has created an artificial-intelligence code of ethics that prohibits the development of autonomous weapons. But the principles leave sufficient wiggle room for Google to benefit from lucrative defense deals down the line.
The announcement comes in the wake of significant internal protest over the use of Google’s AI technology by a Department of Defense initiative called the Algorithmic Warfare Cross-Functional Team. The goal of this venture, known internally as Project Maven, is to improve the accuracy of drone strikes, among other things.
Last month a dozen Google workers quit over the scandal, and many more signed an open letter of protest.
The uproar captures the fears many have about how technology might help automate warfare in the future. The situation is not simple, however.
Artificial intelligence could help make some weapons systems safer and less error prone. There are also many mundane applications of AI across the defense industry. Google doesn’t want to disavow this huge potential market for its cloud AI technology.
Google’s CEO, Sundar Pichai, announced the new code in a blog post today. It suggests seven principles for guiding Google’s use of AI, stating that it should benefit society; avoid algorithmic bias; respect privacy; be tested for safety; be accountable to the public; maintain scientific rigor; and be made available to others in accordance with the same principles.
But Pichai also took pains to state that Google would not allow its AI technology to be used to develop anything that could cause harm, including “weapons or other technologies whose principal purpose or implementation is to cause or directly facilitate injury to people.”
Pichai said Google would also avoid developing surveillance technology that violates internationally accepted norms on human rights, or any technology that contravenes international laws.
Artificial intelligence is developing quickly, and Google has run into other problems involving AI projects. One of its computer vision systems, for example, repeatedly misidentified people of African heritage as gorillas. The company abandoned its “Don’t be evil” motto this April, but it retains an idealistic culture.
Military uses of artificial intelligence could be increasingly contentious as the technology is adopted in new ways and companies seek to sell their cloud AI technology as widely as possible.
Machine learning and artificial intelligence will inevitably become more important for intelligence and defense work. Other US tech companies, including Amazon and Microsoft, have bid on a multibillion-dollar cloud computing project with the Pentagon.
This scientist now believes covid started in Wuhan’s wet market. Here’s why.
How a veteran virologist found fresh evidence to back up the theory that covid jumped from animals to humans in a notorious Chinese market—rather than emerged from a lab leak.
The US crackdown on Chinese economic espionage is a mess. We have the data to show it.
The US government’s China Initiative sought to protect national security. In the most comprehensive analysis of cases to date, MIT Technology Review reveals how far it has strayed from its goals.
All charges against China Initiative defendant Gang Chen have been dismissed
MIT professor Gang Chen was one of the most prominent scientists charged under the China Initiative, a Justice Department effort meant to counter economic espionage and national security threats.
The China Initiative’s first academic guilty verdict raises more questions than it answers
Observers hoped that the trial of the prominent Harvard professor Charles Lieber would provide some clues into the future of the Department of Justice’s campaign against Chinese economic espionage.
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.