Menu
Google bans use of AI in weapons

Google bans use of AI in weapons

Restriction could help tech giant defuse months of employee protests

Sundar Pichai - CEO, Google

Sundar Pichai - CEO, Google

Google will not allow its artificial intelligence (AI) software to be used in weapons or unreasonable surveillance efforts under new standards for its business decisions in the nascent field, the Alphabet unit said on Thursday.

The restriction could help Google management defuse months of protest by thousands of employees against the company's work with the U.S. military to identify objects in drone video.

Google instead will seek government contracts in areas such as cybersecurity, military recruitment and search and rescue, CEO Sundar Pichai said in a blog post.

"We want to be clear that while we are not developing AI for use in weapons, we will continue our work with governments and the military in many other areas," he said.

Breakthroughs in the cost and performance of advanced computers have carried AI from research labs into industries such as defence and health in the last couple of years.

Google and its big technology rivals have become leading sellers of AI tools, which enable computers to review large datasets to make predictions and identify patterns and anomalies faster than humans could.

But the potential of AI systems to pinpoint drone strikes better than military specialists or identify dissidents from mass collection of online communications has sparked concerns among academic ethicists and Google employees.

A Google official, requesting anonymity to discuss the sensitive issue, said the company would not have joined the drone project last year had the principles already been in place. The work comes too close to weaponry, even though the focus is on non-offensive tasks, the official said on Thursday.

Google plans to honour its commitment to the project through next March, a person familiar with the matter said last week.

More than 4,600 employees petitioned Google to cancel the deal sooner, with at least 13 employees resigning in recent weeks in an expression of concern.

A nine-employee committee drafted the AI principles, according to an internal email seen by Reuters.

The Google official described the principles as a template that any software developer could put into immediate use.

Though Microsoft and others released AI guidelines earlier, the AI community has followed Google's efforts closely because of the internal pushback against the drone deal.

Google's principles say it will not pursue AI applications intended to cause physical injury, that tie into surveillance "violating internationally accepted norms of human rights," or that present greater "material risk of harm" than countervailing benefits.

"The clear statement that they won't facilitate violence or totalitarian surveillance is meaningful," University of Washington technology law professor Ryan Calo tweeted on Thursday.

Google also called on employees and customers developing AI "to avoid unjust impacts on people," particularly around race, gender, sexual orientation and political or religious belief.

The company recommended that developers avoid launching AI programs likely to cause significant damage if attacked by hackers because existing security mechanisms are unreliable.

Pichai said Google reserved the right to block applications that violated its principles. The Google official acknowledged that enforcement would be difficult because the company cannot track each use of its tools, some of which can be downloaded free of charge and used privately.

Google's decision to restrict military work has inspired criticism from members of Congress. Representative Pete King, a New York Republican, tweeted on Thursday that Google not seeking to extend the drone deal "is a defeat for U.S. national security."

(Reporting by Paresh Dave; additional reporting by Kristina Cooke, Salvador Rodriguez and Heather Somerville; Editing by Cynthia Osterman and Richard Chang)


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags GoogleAI

Featured

Slideshows

Reseller News Innovation Awards 2018: meet the top performing partners

Reseller News Innovation Awards 2018: meet the top performing partners

Reseller News honoured the industry’s finest on a standout evening for the New Zealand channel, recognising the achievements of established partners, emerging players and innovative start-ups, in front of over 460 technology leaders in Auckland.

Reseller News Innovation Awards 2018: meet the top performing partners
Champagne Reception kicks off Reseller News Innovation Awards 2018

Champagne Reception kicks off Reseller News Innovation Awards 2018

More than 460 channel leaders came together to toast the top performers of the New Zealand industry, during the opening Champagne Reception at the Reseller News Innovation Awards 2018 - in association with Techbuyer.

Champagne Reception kicks off Reseller News Innovation Awards 2018
Chasing innovation: how Kiwi partners can create a new customer agenda

Chasing innovation: how Kiwi partners can create a new customer agenda

This exclusive Reseller News Roundtable - in association with Rhipe and Microsoft - detailed a blueprint for customer success, outlining the new role of the modern-day partner and wider network in New Zealand.

Chasing innovation: how Kiwi partners can create a new customer agenda
Show Comments