When to freak out about shocking new polls

Ordinarily, this is the point at which I’d urge a little patience. There’s been a lot of news over the past two weeks — the conclusion to the FBI’s investigation into Clinton’s emails and the Dallas shootings of police officers, in particular — and it would be nice to see how the polls settled in after a couple of slow weeks on the campaign trail. However, we’re entering a period of rapidly moving political news. Bernie Sanders endorsed Clinton only Tuesday. Trump is expected to name his VP later this week. And then we’ll have the party conventions. The prospects definitely look better for Trump than they did a week or two ago, but the landscape also looks blurrier, and it may not be until mid-August that we have a chance to catch our breath.

So for the rest of this article, I’m going to focus mostly on the Quinnipiac polls — both to explain why our model reacted relatively strongly to them, when some of the other data wasn’t so bad for Clinton, and as an example of how you might think about “unexpected” polling results as they arise over the next few weeks. If you’re a poll junkie, this situation will seem familiar. You think you have a pretty good idea of where the race stands, but then a couple of splashy polls come out that contradict that impression. You have to figure out how much to incorporate the new polls with the data you had previously.

The FiveThirtyEight models make that calculation automatically; we just input the new data and press “go.” That’s helpful because when people (us included) rely on their intuition about how to evaluate new polls, they tend to make one of two mistakes. The more common error is to treat every new poll as a “game changer,” inventing an elaborate story about how the whole race has been upended. Often, it turns out, these interpretations don’t hold up to scrutiny, and a highly touted new poll won’t move the forecast much at all, or a poll that comes out the next day contradicts it.