The Guardian (USA)

We need to rethink social media before it's too late. We've accepted a Faustian bargain

- Jeff Orlowski

When people envision technology overtaking society, many think of The Terminator and bulletproo­f robots. Or Big Brother in George Orwell’s Nineteen EightyFour,a symbol of external, omnipotent oppression.

But in all likelihood, dystopian technology will not strong-arm us. Instead, we’ll unwittingl­y submit ourselves to a devil’s bargain: freely trade our subconscio­us preference­s for memes, our social cohesion for instant connection, and the truth for what we want to hear.

Indeed, as former insiders at Google, Twitter, Facebook, Instagram and YouTube attest in our new documentar­y, The Social Dilemma,this is already happening. We already live in a version of Aldous Huxley’s Brave New World. As Neil Postman puts it in his 1985 book Amusing Ourselves to Death:

Public Discourse in the Age of Show Business:

The technology that threatens our society, democracy, and mental health is lurking in our bedrooms, sometimes lying on our pillows, as we fall asleep. We awake to its call, bring its chiming notificati­ons to dinner, and blindly trust where it guides us. We scroll insatiably, unsuspecti­ng that the technology that connects us, especially now in a distanced world, is also controllin­g us.

Our social media platforms are powered by a surveillan­ce-based business model designed to mine, manipulate, and extract our human experience­s at any cost, causing a breakdown of our informatio­n ecosystem and shared sense of truth worldwide. This extractive business model is not built forus but built to exploit us.

A third of American adults, and nearly half of those aged 18-29, say they are online “almost constantly”. But, unlike the citizens of Brave New World, we’re miserable. As our time online has gone up, so have anxiety, depression and suicide rates, particular­ly among youth.

Social media is also derailing productive public discourse. A largely ignored internal memo to senior executives at Facebook in 2018 explained: “Our algorithms exploit the human brain’s attraction to divisivene­ss.” Left unchecked, the algorithms will feed

users “more and more divisive content in an effort to gain user attention and increase time on the platform”.

In 2014, Pew Research Center found that partisan antipathy and division in America is “deeper and more extensive than at any point in the last two decades”. Over the past six years, social media has only exacerbate­d these sentiments. In 2019, 77% of Republican­s and 72% of Democrats said voters in both parties “not only disagree over plans and policies, but also cannot agree on the basic facts”.

In The Social Dilemma, Tristan Harris, a former Google design ethicist and the co-founder of the Center for Humane Technology, points out that far before technology overpowers human strengths, it will overwhelm human weaknesses. Sophistica­ted algorithms learn our emotional vulnerabil­ities and exploit them for profit in insidious ways.

By surveillin­g nearly all of our online activity, social media platforms can now predict our emotions and behaviors. They leverage these insights and auction us to the highest advertisin­g bidder, and they have consequent­ly become some of the richest companies in the history of the world.

But users aren’t just being sold a pair of shoes. The targeting capabiliti­es of these platforms give anyone with a motive the power and precision to influence us cheaply and with phenomenal ease. Disinforma­tion campaigns have been cited in more than 70 countries, and doubled from 2017 to 2019.

The whistleblo­wer Sophie Zhang has revealed how pervasive the problem is on Facebook’s platform, and how little the company acts on it. Facebook recently rolled out a series of updates to mitigate political misinforma­tion in the upcoming US presidenti­al election, including a bar on political ads one week before election day, but these measures are too little, too late, and they do not address the fundamenta­l problem of their exploitati­ve business model.

After nearly three years of working on this film, I now see “the social dilemma” as a foundation­al problem of our time, underlying many of the other societal conflicts that require compromise and a shared understand­ing to fix. If two sides are constantly fed reflection­s of their pre-existing ideologies and outrageous straw men of opposing views, we will never be able to build bridges and heal the challenges that plague humanity.

But there is hope. In The Terminator sequels, Arnold Schwarzene­gger comes back as a good guy. “Who sent you?” John Connor asks. The Terminator answers, “You did. Thirty-five years from now, you reprogramm­ed me to be your protector.”

In the absence of time travel, the solution needs to incorporat­e the work and voices of devoted activists, organizati­ons, scholars, and those who have experience­d the harms of exploitati­ve technology, which amplifies systemic oppression and inequality. We can’t rely on the people who created the problem to be the ones to solve it. And I won’t trust these social media companies until they change their business model to serve us, the public. Humans created this technology, and we can – and have a responsibi­lity to – change it.

It is a foundation­al problem of our time, underlying many of the other societal conflicts that require compromise and a shared understand­ing to fix

 ??  ?? ‘We scroll insatiably, unsuspecti­ng that the technology that connects us, especially now in a distanced world, is also controllin­g us.’ Photograph: Sam Thomas/Getty Images
‘We scroll insatiably, unsuspecti­ng that the technology that connects us, especially now in a distanced world, is also controllin­g us.’ Photograph: Sam Thomas/Getty Images
 ?? Photograph: Marcio Jose Sanchez/AP ?? ‘Facebook’s recent measures do not address the fundamenta­l problem of their exploitati­ve business model.’
Photograph: Marcio Jose Sanchez/AP ‘Facebook’s recent measures do not address the fundamenta­l problem of their exploitati­ve business model.’

Newspapers in English

Newspapers from United States