Skip to Content
Artificial intelligence

Tech companies must anticipate the looming risks as AI gets creative

Governments will need to enact stricter regulations as well, says one Microsoft AI expert.
March 25, 2019
Jeremy Portje

The technology industry must take preemptive steps to avoid emerging dangers as artificial intelligence becomes increasingly capable of being creative and otherwise acting more like human beings, Microsoft’s Harry Shum warned at MIT Technology Review’s EmTech Digital conference on Monday.

“This is the point in the cycle …  where we need to engineer responsibility into the very fabric of the technology,” said Shum, executive vice president of the software giant’s artificial intelligence and research group, onstage at the San Francisco event.

Shum noted that the industry has already failed to anticipate flaws in the technology, as well as some of the troublesome ways that it’s been used in the real world.

Face recognition software, for example, has proved to be bad at accurately identifying faces with dark skin tones. China has been pairing these tools with surveillance cameras to monitor members of its Uighur Muslim minority and to shame alleged debtors and jaywalkers by posting their faces on billboards. An Uber self-driving car struck and killed a pedestrian last year. And IBM’s Watson has reportedly prescribed “unsafe and incorrect” cancer treatments.

These challenges will only become more complicated as AI gets better at discerning human emotions, conducting sophisticated conversations, and producing stories, poetry, songs, and paintings that seem increasingly indistinguishable from those created by humans, Shum said. These emerging capabilities could make it easier to produce and spread fake audio, images, and video, adding to the challenges of dealing with propaganda and misinformation online.

Microsoft is addressing these rising risks in a handful of ways. Shum said the company has improved its face recognition tools by adding altered versions of photos with a wider variety of skin colors, eyebrows, and lighting conditions to its databases.

The company has also established an AI ethics committee and joined collaborative industry groups like the Partnership on AI. Microsoft will “one day very soon” add an AI ethics review step to its standard checklist of privacy, security, and accessibility audits that must occur before new products are released, Shum said.

But he acknowledged that self-regulation won’t be enough.

Indeed, a growing chorus of voices in and out of the technology industry are calling for tighter regulations surrounding artificial intelligence. In December, the AI Now Institute at New York University, a group that includes Microsoft and Google employees, argued that government agencies need greater power to “oversee, audit, and monitor” these technologies, and called for “stringent regulation” of face recognition tools in particular.

“We are working hard to get ahead of the challenges posed by AI creation,” Shum said. “But these are hard problems that can’t be solved with technology alone, so we really need the cooperation across academia and industry. We also need to educate consumers about where the content comes from that they are seeing and using.”

Deep Dive

Artificial intelligence

This new data poisoning tool lets artists fight back against generative AI

The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models. 

Rogue superintelligence and merging with machines: Inside the mind of OpenAI’s chief scientist

An exclusive conversation with Ilya Sutskever on his fears for the future of AI and why they’ve made him change the focus of his life’s work.

Unpacking the hype around OpenAI’s rumored new Q* model

If OpenAI's new model can solve grade-school math, it could pave the way for more powerful systems.

Generative AI deployment: Strategies for smooth scaling

Our global poll examines key decision points for putting AI to use in the enterprise.

Stay connected

Illustration by Rose Wong

Get the latest updates from
MIT Technology Review

Discover special offers, top stories, upcoming events, and more.

Thank you for submitting your email!

Explore more newsletters

It looks like something went wrong.

We’re having trouble saving your preferences. Try refreshing this page and updating them one more time. If you continue to get this message, reach out to us at with a list of newsletters you’d like to receive.