Green Room

Does the GOP nominee’s ideology matter?

posted at 11:35 am on November 17, 2011 by

Having critiqued Nate Silver’s model for calculating the odds of various GOP candidates winning the 2012 presidential election — particularly his inclusion and assessment of candidate ideology — I was curious as to what political scientists would make of his model.

Brendan Nyhan and Jacob Montgomery do the most extensive deconstruction of Silver’s model, pointing out that it performs worse than Douglas Hibbs’ “Bread and Peace” model (which Silver criticized) on out-of-sample data, and has a larger mean average error than all of the most well-known election forecasting models.

Regarding candidate ideology, Nyhan and Montgomery add:

First, when the economy is growing and presidential approval is high, strong moderate candidates may be scared off from entering the race, leaving only ideologues. A similar effect has been shown when one party has held the presidency for a long period of time. When this happens, the opposition tends to perform better due to the perception that is “time for a change”, and opposition parties are likely to nominate more moderate candidates in the hopes of regaining control of the White House at the expense of ideological purity.

Second, the estimates of challenger ideology that Silver uses are primarily drawn from voter perceptions of the candidates. However, these perceptions are driven by the content of the campaign, which is itself shaped by the economic context. Candidates who appear extreme in one era may seem less so in the next (consider the changing perceptions of Ronald Reagan between 1976 and 1980, for instance). For all of these reasons, Silver’s estimates of the effects of challenger ideology and election outcomes are likely to be significantly exaggerated.

Similarly, Seth Masket notes:

[P]erceptions of the Republican nominee’s ideological stances may well change by next year. It’s very hard to make realistic projections of Cain’s governing ideology since he’s never governed before. Perry would be facing a more liberal electorate than he’s ever faced, and Romney would be facing a more conservative one. Plus, given Romney’s history, there should be substantially large error bars on either side of his line.

Indeed, while I cannot find a good link at the moment, some political scientists argue that voters’ perception of ideology would be a better variable for forecasting.

Alan Abramowitz also has several problems with Silver’s model. Of course, Abramowitz has his own “Time For a Change” model, which gives Obama a good chance of winning a second term even with fairly modest economic growth next year and an approval rating in the low- to mid-forties. It’s worth noting the “Time For a Change” model has over-predicted the vote of the incumbent candidate by at least 1.85% in each of the last four presidential elections.

For more criticism of Abramowitz’s model — and of election forecasting models generally — see Sean Trende. Although I’m a fan of Trende’s work, his criticism of these models has its own weaknesses. In particular, Trende does not really acknowledge political scientists admit the limitations of such models. Nyhan among others stresses the problem inherent in a small data set, and the risk of overfitting models to conform to past results. Hibbs will admit his model only accounts for approximately 77% of election results (iirc). James E. Campbell, creator of the “Trial Heat and Economy” forecasting model would be the first to admit that model blew up (.pdf) in 2008 due to the intervention of the financial crisis. That a model does not forecast unknown unknowns is not a strong criticism (even though some foresaw the financial panic, few would have pinpointed its eruption to the month).

But I digress. The takeaway here is that election forecasting models are admittedly limited attempts to quantify the basic factors on which elections usually turn — peace and prosperity. Other factors may matter, but the challenger’s ideology likely does not matter more than a point or two — which is within the margin of error for even the best models. Silver’s model was probably a nice traffic driver for the New York Times, but it likely overestimates the effect of challenger ideology. Nyhan and Montgomery did not directly test whether adding estimates of challenger ideology to existing forecasting models would improve their performance, but the Silver model’s large mean average error compared to others suggests an answer.

Recently in the Green Room:



Trackback URL


Of course it does, the GOP would never nominate a liberal.

Oh wait, nevermind.

uknowmorethanme on November 17, 2011 at 11:50 AM

Of course it does, the GOP would never nominate a liberal.

Oh wait, nevermind.

uknowmorethanme on November 17, 2011 at 11:50 AM

Don’t talk about Mitt Romney like that. He’s a conservative standard bearer!


gryphon202 on November 17, 2011 at 1:54 PM

According to Sean Trende’s logic, then, McCain lost only because he was seeking a third term for his party. That’s encouraging, because the voters came back to the GOP in historically large numbers for a mid-term in 2010. Combined, the President’s poor performance, the crazy corruptocracy Reid/Pelosi have built for themselves in Congress, the rotten economic situation and–most of all- the absence of the “third term” problem means that the GOP candidate is going to swamp the President.

But you already knew that.

MTF on November 17, 2011 at 2:48 PM

HotAir — Politics, Culture, Media, 2017, Breaking News from a conservative viewpoint
Top Pick

Will they stay or will they go?

Top Pick

I can’t imagine what I was thinking when I said that

Rocking the boat majorly

Big government never contracts. It only grows more powerful

It’s only a “ban” until it becomes inconvenient

The decline and fall of Obamacare and the AHCA

Jazz Shaw Jun 24, 2017 8:31 AM

This was all over before it began

Fixing crime in America is a complicated issue

Taylor Millard Jun 23, 2017 8:31 PM

Cops alone won’t solve it.

Victim’s father was President Maduro’s supervisor back when he was a bus driver.

Democrats forgot all about the “era of good feelings”

“Bernie and Jane Sanders have lawyered up.”

“the Judiciary Committee is examining the circumstances surrounding the removal of James Comey.”

Winning isn’t everything. It is the only thing

Trump signs VA reform bill into law

John Sexton Jun 23, 2017 2:41 PM

“What happened was a national disgrace, and yet some of the employees involved in these scandals remained on the payrolls.”

A new era of something.

“…died suddenly in less than a week just after his return to the U.S.”

The shortsightedness of “Denounce and Preserve”

Taylor Millard Jun 23, 2017 12:11 PM

Pragmatism for the sake of pragmatism doesn’t always work.

Perhaps if you threw in a new car?

Gay marriages still growing, but not as fast

Andrew Malcolm Jun 23, 2017 10:31 AM

More, but not as quickly.

Should’ve stuck with the pirate gig. It was working for him

The battle for the rubble of Raqqa is underway

Andrew Malcolm Jun 23, 2017 8:51 AM

Won’t be much left.

Your list of demands is a publicity stunt

“what happened that day was emblematic of a deeply troubling trend among progressives…”

“The jobs are still leaving. Nothing has stopped.”

Bad vendor. Bad! No cookie!

“The Corps is just starting to grapple with the issues the court has identified.”

“So you want me to sing my praises, is that what you’re saying?”

Why would we possibly want that?

“I mean he sold our country to The Russians.”

I could think of someone else you might want to ask about…

“You can ask a hundred people what hate speech is and you get a thousand different answers”

Trump: I never made any recordings of Comey

Allahpundit Jun 22, 2017 2:01 PM


Hackers stole private data from election databases

John Sexton Jun 22, 2017 1:21 PM

“90,000 records stolen by Russian state actors contained drivers license numbers”

Failure to protect the city

Big man on the Middle Eastern campus