Monday, October 29, 2012

#Poll 2008 Pollster Report Card #Rasmussen A- #Ipsos B+ #CNN B+ #Battleground C+


2008 Pollster Report Card

The table below is an assessment of pollster performance in the 2008 Presidential election.  The pollsters were graded on both the accuracy of their final poll (popular vote) and the consistency of their polling during the month of October.
The overall score is a weighted average of their Accuracy and Consistency numbers.  The weighting is 75% accuracy and 25% consistency.  Formula details are at the bottom of this page.
 Overall    
PollScoreGrade AccuracyConsistency
Rasmussen Reports91%A- 92%86%
Ipsos/McClatchy89%B+ 92%79%
CNN/Opinion Research88%B+ 92%77%
Fox News84%B 92%61%
Pew83%B- 92%56%
GWU/Battleground79%C+ 92%41%
Diageo/Hotline77%C+ 77%79%
NBC News / Wall St. Journal76%C 77%75%
Gallup Traditional73%C- 77%63%
Marist67%D+ 62%82%
ABC News / Wash Post67%D+ 62%82%
IBD/TIPP66%D 77%34%
Gallup Expanded66%D 62%78%
CBS News / NYT60%D- 62%56%
Reuters/C-SPAN/Zogby35%F 31%48%
Data
The data for this chart come from the  Real Clear Politics summary on 12 November 2008.   Here is a local mirror of that data, with the final polls summarized at the top.  Here is a quick summary of the final spread predicted by the pollsters, ranked from most accurate to least:
PollObamaMcCain Spread (actual=6.5) Off by
Rasmussen Reports5246 6 0.5
Pew5246 6 0.5
GWU/Battleground5044 6 0.5
Ipsos/McClatchy5346 7 0.5
CNN/Opinion Research5346 7 0.5
Fox News5043 7 0.5
Diageo/Hotline5045 5 1.5
NBC News / Wall St. Journal5143 8 1.5
Gallup Traditional5143 8 1.5
IBD/TIPP5244 8 1.5
Marist5243 9 2.5
ABC News / Wash Post5344 9 2.5
Gallup Expanded5243 9 2.5
CBS News / NYT5142 9 2.5
Reuters/C-SPAN/Zogby5443 11 4.5

Formulas
Every final poll showed Obama with a lead, so assessing their accuracy is just a matter of comparing their forecasted spread with the actual spread of the election which was Obama +6.5.  
Final poll accuracy score =  100 -  (  |(POLL SPREAD - 6.5)| / 6.5  )
All the pollsters graded had more than one poll during the month of October.  If a poll reported a wide spread and then suddenly narrowed down right before the election, this formula produces a lower score.  Likewise a pollster gets a lower score if they predicted a very tight race until the end and then widened up.
October Consistency = 100 - ( POLL STDEV / POLL AVERAGE )