CRITICAL THINKING
J-school students and industry vets tackle the tough questions
With the 2016 election polls missing the mark, should newsrooms rely less on polls this year? .................
A:I’m not sure newsrooms should be using polling information less in the future, but they should instead present the results as they actually are—mere estimates.
Only after the polls were deemed to be obviously flawed—i.e. after President Trump took his surprising win in 2016—did we start hearing about why those polling results may have been flawed.
However, we should have known all along those poll results could certainly misrepresent the truth of the public’s opinion.
In my statistics classes following the election, the 2016 polls were a popular topic of discussion, especially because it was easy for senior high school stats students to pick out where things may have gone wrong. Over the course of maybe a week, we learned how polls may have only targeted those on the extremes of the political spectrum, how leading questions may have confused participants and how the media’s omission or lack of attention to confidence intervals may have misrepresented the actual results. Whatever the cause, the point is I believe news media should be upfront and very clear with their audience about the level of exactness the polling results actually have.
I think this can be as simple as an extra paragraph or an editor’s note in a story that references poll results, or a onesentence disclaimer before or after a presentation of the results on television or over the radio. One of the primary jobs of the news media is to promote democracy, to inform the public of what they need to know so they can make informed decisions about their government and the world around them. In order to do this, we need to be transparent that a lead in the polls is not an exact percentage by any means but an estimate of a huge number of voters that is prone to both statistical and human bias.
A:Just one day after voters selected Donald J. Trump as president, the Pew Research Center published an article aiming to answer this question: “How could the polls have been so wrong about the state of the election?”
The authors acknowledged it was too soon to tell exactly why election polls showed Democrat Hillary Clinton with a commanding lead headed into November. But their article shared the thoughts of many pundits at the time—that pollsters asked the wrong voters, or that people who responded were afraid to say they’d vote for Trump, or that analysts made faulty predictions about which candidate would generate more enthusiasm on Election Day.
In the nearly four years since that election, the narrative about disastrous polling has evolved. Nate Silver of Fivethirtyeight observed in 2018 that in retrospect, the 2016 polls were only slightly farther off the mark than for the four previous presidential elections and actually average in accuracy in a longer-term historical comparison.
All of which is to say that newsrooms should rely less on polls— survey responses are not the same as completed ballots—but the results still provide information to help identify shifts in mood, attention and attitudes about elections, candidates and issues. As one source in a broader strategy for covering elections, polls are not inherently bad.
Our experience in local politics reporting in Wisconsin, including during the 2016 election, demonstrates where we should shift any time and attention we take away from poll-obsessing: Journalists covering major elections should speak to and observe voters themselves, a lot of voters over a broad geography and period of time.
We’re doing more of that in our news organization, and we are positioning ourselves to catch trends we might have missed if we were overly focused on survey results. Those subtle changes in tone and rhetoric, the more prominent and prolific campaign signs in our communities, the political donations pouring in from individuals, even—gasp!—facebook comments are all indicators that should feed into news coverage of the election.
Then, maybe, the question in November will be: “How did news organizations get this election so right?”