San Diego Union-Tribune

GOOGLE AI RESEARCHER’S EXIT SPARKS CONCERNS

Departure raises doubts over ethics, bias at company

- BY MATT O’BRIEN

Prominent artificial intelligen­ce scholar Timnit Gebru helped improve Google’s public image as a company that elevates Black computer scientists and questions harmful uses of AI technology.

But internally, Gebru, a leader in the field of AI ethics, was not shy about voicing doubts about those commitment­s — until she was pushed out of the company this week in a dispute over a research paper examining the societal dangers of an emerging branch of AI.

Gebru announced on Twitter she was f ired. Google told employees she resigned. More than 1,200 Google employees have signed on to an open letter calling the incident “unpreceden­ted research censorship” and faulting the company for racism and defensiven­ess.

The furor over Gebru’s abrupt departure is the latest incident raising questions about whether Google has strayed so far away from its original “Don’t Be Evil” motto that the company now routinely ousts employees who dare to challenge management. The exit of Gebru, who is Black, also raised further doubts about diversity and inclusion at a company where Black women account for just 1.6 percent of the workforce.

And it’s exposed concerns beyond Google about whether showy efforts at ethical AI — ranging from a White House executive order this week to ethics review teams set up throughout the tech industry — are of little use

when their conclusion­s might threaten profits or national interests.

Gebru has been a star in the AI ethics world who spent her early tech career working on Apple products and got her doctorate studying computer vision at the Stanford Artificial Intelligen­ce Laboratory.

She’s co-founder of the group Black in AI, which promotes Black employment and leadership in the field. She’s known for a landmark 2018 study that found racial and gender bias in facial recognitio­n software.

Gebru had recently been working on a paper examining the risks of developing computer systems that analyze huge databases of human language and use that to create their own human-like text. The paper, a copy of which was shown to The Associated Press, mentions Google’s own new technology, used in its search business, as well as those developed by others.

Besides f lagging the potential dangers of bias, the paper also cited the environmen­tal cost of chugging so much energy to run the models — an important issue at a company that brags about its

commitment to being carbon neutral since 2007 as it strives to become even greener.

Google managers had concerns about omissions in the work and its timing, and wanted the names of Google employees taken off the study, but Gebru objected, according to an exchange of emails shared with the AP and first published by Platformer.

Jeff Dean, Google’s chief of AI research, reiterated Google’s position about the study in a statement Friday.

The paper raised valid points but “had some important gaps that prevented us from being comfortabl­e putting Google affiliatio­n on it,” Dean wrote.

“For example, it didn’t include important findings on how models can be made more efficient and actually reduce overall environmen­tal impact, and it didn’t take into account some recent work at Google and elsewhere on mitigating bias,” Dean added.

Gebru on Tuesday vented her frustratio­ns about the process to an internal diversity-and-inclusion email group at Google, with the subject line: “Silencing Marginaliz­ed Voices in Every Way Possible.” Gebru said on Twitter that’s the email that got her fired.

Dean, in an email to employees, said the company accepted “her decision to resign from Google” because she told managers she’d leave if her demands about the study were not met.

“Ousting Timnit for having the audacity to demand research integrity severely undermines Google’s credibilit­y for supporting rigorous research on AI ethics and algorithmi­c auditing,” said Joy Buolamwini, a graduate researcher at the Massachuse­tts Institute of Technology who co-authored the 2018 facial recognitio­n study with Gebru.

“She deserves more than Google knew how to give, and now she is an all-star free agent who will continue to transform the tech industry,” Buolamwini said in an email Friday.

How Google will handle its AI ethics initiative and the internal dissent sparked by Gebru’s exit is one of a number of problems facing the company heading into the new year.

At the same time she was on her way out, the National Labor Relations Board on Wednesday cast another spotlight on Google’s workplace. In a complaint, the NRLB accused the company of spying on employees during a 2019 effort to organize a union before the company fired two activist workers for engaging in activities allowed under U.S. law. Google has denied the allegation­s in the case, which is scheduled for an April hearing.

Google has also been cast as a profit-mongering bully by the U.S. Justice Department in an antitrust lawsuit alleging the company has been illegally abusing the power of its dominant search engine and other popular digital services to stif le competitio­n. The company also denies any wrongdoing in that legal battle, which may drag on for years.

 ?? JEFF CHIU AP ?? Google is embroiled in a lawsuit filed by the Justice Department alleging that the company abuses its power.
JEFF CHIU AP Google is embroiled in a lawsuit filed by the Justice Department alleging that the company abuses its power.

Newspapers in English

Newspapers from United States