The Guardian (USA)

Instagram under fire over sexualised child images

- Shanti Das

Instagram is failing to remove accounts that attract hundreds of sexualised comments for posting pictures of children in swimwear or partial clothing, even after they are flagged to it through the in-app reporting tool.

Instagram’s parent company, Meta, claims it takes a zero-tolerance approach to child exploitati­on. But accounts that have been flagged as suspicious through the in-app reporting tool have been ruled acceptable by its automated moderation technology and remain live.

In one case, an account posting photos of children in sexualised poses was reported, using the in-app reporting tool, by a researcher. Instagram provided a same-day response saying that “due to high volume”, it had not been able to view the report, but that its “technology has found that this account probably doesn’t go against our community guidelines”. The user was advised to block or unfollow the account, or report it again. It remained live on Saturday, with more than 33,000 followers.

Similar accounts – known as “tribute pages” – were also found to be running on Twitter.

One account, which posted pictures of a man performing sexual acts to images of a 14-year-old TikTok influencer, was deemed not to break Twitter’s rules after being reported using the in-app tools – despite him suggesting in posts that he was seeking to connect with people to share illegal material. “Looking to trade some younger stuff,” one of his tweets said. It was removed after the campaign group Collective Shout posted about it publicly.

The findings raise concerns about the platforms’ in-app reporting tools, with critics saying the content appeared to be allowed to remain live because it did not meet a criminal threshold – despite being linked to suspected illegal activity.

Often, the accounts are used for “breadcrumb­ing” – where offenders post technicall­y legal images but arrange to meet up online in private messaging groups to share other material.

Andy Burrows, head of online safety policy at the NSPCC, described the accounts as a “shop window” for paedophile­s. “Companies should be proactivel­y identifyin­g this content and then removing it themselves,” he said. “But even when it is reported to them, they are judging that it’s not a threat to children and should remain on the site.”

He called for MPs to tackle “loopholes” in the proposed online safety bill – which is intended to regulate social media firms and will be debated in parliament on 19 April. They should, he said force companies to tackle not only illegal content, but also that which is clearly harmful but may not meet the criminal threshold.

Lyn Swanson Kennedy of Collective

Shout, an Australia-based charity that monitors exploitati­ve content globally, said the platforms were relying on external organisati­ons to do their content moderation for them. “We are calling on platforms to address some of these very concerning activities which put underage girls particular­ly at serious risk of harassment, exploitati­on and sexualisat­ion,” she said.

Meta, Instagram’s parent company, said it had strict rules against content that sexually exploits or endangers children, and that it removed it when it became aware of it. “We’re also focused on preventing harm by banning suspicious profiles, restrictin­g adults from messaging children they’re not connected with and defaulting under-18s to private accounts,” a spokespers­on said.

Twitter said the accounts reported to it had now been permanentl­y suspended for violating its rules. A spokespers­on said: “Twitter has zero tolerance for any material that features or promotes child sexual exploitati­on. We aggressive­ly fight online CSE and have heavily invested in technology … to enforce our policy.”

Imran Ahmed, chief executive of the Center for Countering Digital Hate, a non-profit thinktank, said: “Relying on automated detection, which we know cannot keep up with simple hate speech, let alone cunning, determined, child sex exploitati­on rings, is an abrogation of the fundamenta­l duty to protect children.”

 ?? Photograph: Rafael Henrique/Sopa Images/Rex ?? Instagram, its parent company Meta, and Twitter say they take a ‘zero-tolerance’ approach to child sexual exploitati­on.
Photograph: Rafael Henrique/Sopa Images/Rex Instagram, its parent company Meta, and Twitter say they take a ‘zero-tolerance’ approach to child sexual exploitati­on.

Newspapers in English

Newspapers from United States