Menu
Google bans use of AI in weapons

Google bans use of AI in weapons

Restriction could help tech giant defuse months of employee protests

Sundar Pichai - CEO, Google

Sundar Pichai - CEO, Google

Google will not allow its artificial intelligence (AI) software to be used in weapons or unreasonable surveillance efforts under new standards for its business decisions in the nascent field, the Alphabet unit said on Thursday.

The restriction could help Google management defuse months of protest by thousands of employees against the company's work with the U.S. military to identify objects in drone video.

Google instead will seek government contracts in areas such as cybersecurity, military recruitment and search and rescue, CEO Sundar Pichai said in a blog post.

"We want to be clear that while we are not developing AI for use in weapons, we will continue our work with governments and the military in many other areas," he said.

Breakthroughs in the cost and performance of advanced computers have carried AI from research labs into industries such as defence and health in the last couple of years.

Google and its big technology rivals have become leading sellers of AI tools, which enable computers to review large datasets to make predictions and identify patterns and anomalies faster than humans could.

But the potential of AI systems to pinpoint drone strikes better than military specialists or identify dissidents from mass collection of online communications has sparked concerns among academic ethicists and Google employees.

A Google official, requesting anonymity to discuss the sensitive issue, said the company would not have joined the drone project last year had the principles already been in place. The work comes too close to weaponry, even though the focus is on non-offensive tasks, the official said on Thursday.

Google plans to honour its commitment to the project through next March, a person familiar with the matter said last week.

More than 4,600 employees petitioned Google to cancel the deal sooner, with at least 13 employees resigning in recent weeks in an expression of concern.

A nine-employee committee drafted the AI principles, according to an internal email seen by Reuters.

The Google official described the principles as a template that any software developer could put into immediate use.

Though Microsoft and others released AI guidelines earlier, the AI community has followed Google's efforts closely because of the internal pushback against the drone deal.

Google's principles say it will not pursue AI applications intended to cause physical injury, that tie into surveillance "violating internationally accepted norms of human rights," or that present greater "material risk of harm" than countervailing benefits.

"The clear statement that they won't facilitate violence or totalitarian surveillance is meaningful," University of Washington technology law professor Ryan Calo tweeted on Thursday.

Google also called on employees and customers developing AI "to avoid unjust impacts on people," particularly around race, gender, sexual orientation and political or religious belief.

The company recommended that developers avoid launching AI programs likely to cause significant damage if attacked by hackers because existing security mechanisms are unreliable.

Pichai said Google reserved the right to block applications that violated its principles. The Google official acknowledged that enforcement would be difficult because the company cannot track each use of its tools, some of which can be downloaded free of charge and used privately.

Google's decision to restrict military work has inspired criticism from members of Congress. Representative Pete King, a New York Republican, tweeted on Thursday that Google not seeking to extend the drone deal "is a defeat for U.S. national security."

(Reporting by Paresh Dave; additional reporting by Kristina Cooke, Salvador Rodriguez and Heather Somerville; Editing by Cynthia Osterman and Richard Chang)


Follow Us

Join the newsletter!

Or

Sign up to gain exclusive access to email subscriptions, event invitations, competitions, giveaways, and much more.

Membership is free, and your security and privacy remain protected. View our privacy policy before signing up.

Error: Please check your email address.

Tags GoogleAI

Featured

Slideshows

The making of an MSSP: a blueprint for growth in NZ

The making of an MSSP: a blueprint for growth in NZ

Partners are actively building out security practices and services to match, yet remain challenged by a lack of guidance in the market. This exclusive Reseller News Roundtable - in association with Sophos - assessed the making of an MSSP, outlining the blueprint for growth and how partners can differentiate in New Zealand.

The making of an MSSP: a blueprint for growth in NZ
Reseller News Platinum Club celebrates leading partners in 2018

Reseller News Platinum Club celebrates leading partners in 2018

The leading players of the New Zealand channel came together to celebrate a year of achievement at the inaugural Reseller News Platinum Club lunch in Auckland. Following the Reseller News Innovation Awards, Platinum Club provides a platform to showcase the top performing partners and start-ups of the past 12 months, with more than ​​50 organisations in the spotlight.​​​

Reseller News Platinum Club celebrates leading partners in 2018
Meet the top performing HP partners in NZ

Meet the top performing HP partners in NZ

HP has honoured its leading partners in New Zealand during 2018, following 12 months of growth through the local channel. Unveiled during the fourth running of the ceremony in Auckland, the awards recognise and celebrate excellence, growth, consistency and engagement of standout Kiwi partners.

Meet the top performing HP partners in NZ
Show Comments