Las Vegas Review-Journal

FIRMS BACK OFF ORIGINAL CLAIMS

-

out as planned. There is little evidence the companies have helped ferret out brewing threats of violence, bullying or self-harm, according to a review of contracts, marketing materials and emails obtained through public records requests.

But in hiring them, schools expand the traditiona­l boundaries of their responsibi­lity, and perhaps, experts say, their liability. And, the documents show, they vacuum up hundreds of harmless posts, raising questions about student privacy.

One of the posts by Yousefi, now 22, said he was going to “chop” a teacher “in the throat,” which he said was an inside joke among the class, the teacher included. He believes his posts were brought to the school’s attention by a social media monitoring company seeking clients.

“It takes authority and extends it to an inappropri­ate extent in a way that’s truly terrifying,” he said. Shortly afterward, the district hired a firm to monitor posts, and more than a dozen students were expelled.

The monitoring programs have often been initiated without notifying students, parents or local school boards. Because of their relatively low cost — contracts typically range from a few thousand dollars to $40,000 per year — the deals can get buried in school board agendas.

In their advertisin­g, the companies promise much, but when contacted, they declined to give details on specific incidents, citing nondisclos­ure agreements and student privacy laws. Many schools also declined to give details of instances in which they used the companies’ informatio­n.

Interviews and marketing materials help paint a picture of the companies’ basic approach. Some apply and pay for access to social media companies’ public data, such as Twitter’s so-called data fire hose, which gives users the ability to access and analyze public tweets in bulk.

Rather than asking schools for a list of students and social media handles, the companies typically employ a method called “geofencing” to sweep up posts within a given geographic area and use keywords to narrow the pool. Because only a small fraction of social media users share their locations, the companies use additional clues, like a user’s hometown, to determine whose content is worth flagging.

School officials are alerted to flagged posts in real time or in batches at the end of each day. Burlington High School in Massachuse­tts typically receives two to six alerts per day from Social Sentinel, the company based in Vermont, according to a list of alerts from 2017. Many consisted of normal teenage banter.

“Ok so all day I’ve wanted my bio grade up online and now that it’s up I’ve decided I want to die,” one Twitter post said.

“Hangnails make me want to die,” said another.

By its count, Social Sentinel has contracts in more than 30 states.

“We’re a carbon monoxide detector,” said Gary Margolis, the company’s chief executive and a former campus police chief. “If a student is posting about not liking their teacher, that’s not what we pay attention to. If a student is posting about shooting their teacher, we would hope we’d be able to find something like that.”

An unsatisfie­d customer

Mark Pompano, the security director for the school district that includes Sandy Hook Elementary in Connecticu­t, has vetted hundreds of school safety products since the mass shooting there. In 2015, impressed by Social Sentinel’s pitch, he gave the company a try for a few months, but it never caught anything serious, he said.

Social Sentinel struggled to weed out posts from the Twitter account of a nearby liquor store, records show.

“I cannot recall a single incident that we used Social Sentinel to pursue some type of security threat or anything like that,” Pompano said. “If something doesn’t work, we’re not going to stick with it.”

Today, Pompano said, the district relies mostly on tips from students, a system that works well if there is an atmosphere of trust. “It goes back to human intelligen­ce, where kids have at least one trusted adult,” he said, “knowing what they’re telling them is confidenti­al.”

In a few cases, school administra­tors said, monitoring services have helped them identify students who appeared to be at risk of harming themselves. More rare were instances in which an imminent threat to others was thwarted. In 2015, as the first anniversar­y of a shooting at Florida State approached, a post expressing sympathy for the gunman and an intent to visit the campus was intercepte­d by Social Sentinel, the campus police chief said. The man was stopped on campus and warned to stay away. When he returned, he was arrested.

Patrick Larkin, an assistant superinten­dent in Burlington, Mass., said he received alerts on his phone in real time from Social Sentinel. “Nineteen out of 20” come from people who are not even his students, he said earlier this year.

Real threats, administra­tors said, are more often flagged by vigilant users, as was the case with the Parkland gunman, whose troubling comments on Youtube were reported to the FBI.

Larkin said Social Sentinel helped him sleep easier at night. And because it can track only public posts — nothing that requires a “friend” request — he doesn’t see it as an intrusion.

“My concern was, what if it’s some odd hour and some kid tweets something I don’t see?” he said.

Margolis said it was hard to demonstrat­e that harm had been averted. “How do you measure the absence of something?” he said, adding that Social Sentinel’s algorithms had improved in recent months.

One client, Michael Sander, the superinten­dent of Franklin City Schools in Ohio, said he had planned to contact the police about a Twitter message that read, “There’s three seasons: summer, constructi­on season and school shooting season.” But the poster appeared to attend school in Franklin, Wis. — not Ohio.

Backtracki­ng on claims

Some companies have backed off from early promises, including creating watch lists that tracked specific people. Liferaft, based in Nova Scotia, told the Salem-keizer Public Schools in Oregon that it could help the district find “behavioral informatio­n” on “individual­s of concern.” The company also vowed to monitor the conversati­ons of “groups and networks” connected with those individual­s.

Mary Jane Leslie, the vice president of Liferaft, acknowledg­ed that the language was “creepy,” saying, “To be frank, I don’t think the software ever really did that.”

She added that the company no longer markets its services to schools.

To use social media data, monitoring companies must agree to specific rules, which were tightened after multiple companies were condemned by the American Civil Liberties Union in 2016 for helping police clients surveil activists in the Black Lives Matter movement. Twitter, Facebook and Instagram cut off the firms’ data access. Some, like Social Sentinel, dropped their police contracts to concentrat­e on serving schools.

The ACLU called out Media Sonar, an Ontario firm that recommende­d that its police clients monitor hashtags like #Blacklives­matter, #Dontshoot and #Imunarmed. In late 2015, around the one-year anniversar­y of the death of Michael Brown in an encounter with the police in Ferguson, Missouri, Media Sonar briefly contracted with the Ferguson-florissant School District, which asked for alerts on the terms “protest” and “walkout.”

Kevin Hampton, a spokesman for the district, said the service was used strictly for safety purposes. Media Sonar did not respond to interview requests.

But privacy advocates questioned whether safety was the companies’ only motive. “The companies seem to dance back and forth” between marketing themselves for public health and student discipline, said Kade Crockford, director of the ACLU of Massachuse­tts’ Technology for Liberty program. “Those two goals seem fairly at odds and somewhat contradict­ory.”

In 2013, the Huntsville City Schools in Alabama enlisted a consulting firm for a surveillan­ce program that led to the expulsion of 14 students, 12 of them African-american.

Casey Wardynski, the district’s former superinten­dent, told local news organizati­ons that the program had helped break up a local gang, and some students were expelled for wielding guns on Facebook.

One student had been accused of “holding too much money” in photograph­s, an investigat­ion by the Southern Poverty Law Center found, and one was suspended for an Instagram post in which she wore a sweatshirt with an airbrushed image of her father, a murder victim. School officials said the sweatshirt’s colors and the student’s hand symbol were evidence of gang ties, according to the investigat­ion.

Off campus, still watched

Monitoring students’ lives off campus is untested terrain. School lawyers are advising administra­tors to be “very cautious,” said Sonja Trainor, the managing director of legal advocacy for the National School Boards Associatio­n. Districts “tend to find that they’re inundated with informatio­n, and it becomes very difficult to establish parameters for issuing warnings to the community,” she said.

In 2013, the Glendale Unified School District in California hired the company Geo Listening in response to student suicides in which online bullying had been cited as a factor.

Lilly Leif, a 2017 graduate of Glendale’s Crescenta Valley High School, said she was summoned to the assistant principal’s office after using an expletive in a post about her biology class. The assistant principal showed her a printed copy and asked her to change her account settings to private, she said.

“She said it reflected poorly on my high school and my teacher,” said Leif, 19, now a college sophomore.

In another instance, Leif said, an administra­tor asked students to delete a message promoting a school fundraiser at “Blaze Pizza” and “Baked Bear” — actual pizza and ice cream establishm­ents — because of the apparent allusions to marijuana.

Rene Valdes, the district’s former director of student support services, said the program included teaching students online etiquette. “The conversati­on with the kid would be, ‘Realize that companies are now monitoring social media before they hire people,’” Valdes said.

After an outcry in Glendale, the state Legislatur­e passed a 2014 law requiring California schools to notify students and parents if they are even considerin­g a monitoring program. The law also lets students see any informatio­n collected about them and tells schools to destroy all data on students once they turn 18 or leave the district.

That’s no longer a concern for Glendale, which dropped its contract with Geo Listening last year.

“We discovered more and more kids were using Instagram and Snapchat, and those were not being monitored by Geo Listening,” Valdes said. “It seems like the kids are always two steps ahead of the adults.”

 ?? PHOTOS BY HILARY SWIFT / THE NEW YORK TIMES ?? Gary Margolis is CEO of Social Sentinel, a Burlington, Vt.-based company that contracts with school districts to monitor students’ social media accounts. With the continuing rash of school shootings, schools are hiring services to keep a constant watch on students. Amid questions about their value, the companies say their success can’t be measured.
PHOTOS BY HILARY SWIFT / THE NEW YORK TIMES Gary Margolis is CEO of Social Sentinel, a Burlington, Vt.-based company that contracts with school districts to monitor students’ social media accounts. With the continuing rash of school shootings, schools are hiring services to keep a constant watch on students. Amid questions about their value, the companies say their success can’t be measured.
 ??  ?? Polly Managan works at her desk at Social Sentinel. Rather than asking schools for a list of students and social media handles, the monitoring companies typically employ a method called “geofencing” to sweep up posts within a given geographic area and use keywords to narrow the pool.
Polly Managan works at her desk at Social Sentinel. Rather than asking schools for a list of students and social media handles, the monitoring companies typically employ a method called “geofencing” to sweep up posts within a given geographic area and use keywords to narrow the pool.

Newspapers in English

Newspapers from United States