This article needs additional citations for verification. (July 2014) (Learn how and when to remove this template message)
Individual Poll Aggregation
A poll aggregator is an entity that tracks and aggregates, often but not exclusively by averaging, individual polls conducted by different organizations in order to gauge public sentiment on key civic issues such as the approval rating of a major political figure (e.g., president, prime minister, monarch, governor, lawmaker, etc.), or legislative body; or to measure likely public support for an individual candidate or political party in an upcoming election. A poll aggregator may also forecast the likely outcome of upcoming elections by gathering and analysing pre-election polls published by others, and/or utilizing other available politics-related information which, according to its methodology, may affect the outcome of an election. For example, an aggregator may attempt to predict the winner of a presidential election or the composition of a legislature, or it may focus on attempting to determine current opinion by smoothing out poll-to-poll variation. Editorial commentary by the site's owners and others complements the data. Interest and web traffic peak during the last few weeks before the election.
How individual polls are aggregated varies from site to site. Some aggregators take a long- or short-term running/rolling average or average the polls at certain points in time, while other aggregators might take a weighted poll average (e.g., giving less weight to older polls), or use some other proprietary method of aggregation, based on such factors as past pollster accuracy, age of the poll, or other more subjective factors. The averaging method has been criticized by at least one statistician because it doesn't weight them by sample size. In this way the resulting average support percentages do not reflect the actual support percentage for any candidate of the pooled polls. According to the American Association for Public Opinion Research, "[o]ther aggregators use regression-based analyses — a method for adjusting data to account for unusual results (“outliers”). Other aggregators combine additional data like historical election results or economic data with current polling data through statistical methods – these are often called modelers."
Aggregators are not capable of accounting for systematic errors in the polls themselves. For instance, if pollsters are misjudging the turnout demographics, aggregators cannot undo these errors. Likewise, when there is a tendency to herd (i.e. for different pollsters to converge on a particular result to avoid being an outlier), aggregators will reflect this.
Aggregators are useful in U.S. presidential elections because the presidency is determined by the winner of state by state elections (see Electoral College), and not by simple popular vote of the entire nation. Consequently to predict a winner, polls of individual states becomes more significant. An equivalent issue may arise in parliamentary systems if the legislature is sufficiently malapportioned as in Canada.
Real Clear Politics was the first such web site. It began aggregating polls in 2002 for the congressional elections that year. Several sites existed by 2004, including Andrew S. Tanenbaum's Electoral-vote.com, and Sam Wang's Princeton Election Consortium. Relative newcomer FiveThirtyEight began in 2008 by baseball statistician Nate Silver and has been lauded for the quality of its analysis. Pollster.com by Mark Blumenthal, now affiliated with the Huffington Post as Huffpost Pollster, has likewise been given a top ranking for the depth and breadth of its chartable polling data. Since 2010 the political blog Talking Points Memo has also sponsored a "PollTracker" feature which aggregates opinion polls. Other noteworthy examples include Drew Linzer's Votamatic, Josh Putnam's Frontloading HQ as well as Politics by the Numbers by Jay DeSart and Tom Holbrook. For an aggregator of poll aggregators see the PollyVote, which combines different polling averages as one component of a combined forecast of the US presidential election result.For another example of aggregating other poll aggregators, discussed in more detail below, see Politicrunch.
Aggregating Poll Aggregators
Given the proliferation of poll aggregators such as those mentioned above, a notable approach to poll aggregation is not to aggregate individual polls as has been done for years, but rather to aggregate the poll aggregators so as to (arguably) provide an even more stable overview of polling data. PollyVote, noted above, is a prominent example of an aggregator of poll aggregators. Additionally, Politicrunch, averages well-known poll aggregators (and election forecasters) to produce its own proprietary poll trackers and forecast models focusing for the time being on U.S. political issues and elections. Politicrunch tracks and processes public polling data from major poll aggregators (e.g., FiveThirtyEight and RealClearPolitics) to show where the polls stand at given points in time and from a long-term standpoint. For example, Politicrunch tracks U.S. Presidential Job Approval and also tracked the 2018 U.S. Congress Generic Ballot by aggregating poll aggregators. Politicrunch also developed its own 2018 U.S. House Forecast by aggregating other election forecasters, and presents results of the 2018 U.S. Midterm Elections.
- "Poll Aggregators". Am. Ass'n for Pub. Opinion Research (AAPOR). Retrieved 13 February 2019.
- "Election Handicappers Are Using Risky Tool: Mixed Poll Averages", the Numbers Guy, Wall Street Journal, February 15, 2008
- "Margins of Error. Poll Reading Tips", Bill Moyers Journal, October 24, 2008
- Homepage ElectoralVote
- Homepage Princeton Election Consortium
- Huffpost Pollster
- "Your Guide to Political Polling Sites", MediaShift, National Public Radio, October 16, 2008
- TPM PollTracker
- Homepage votamatic.org
- Homepage Frontloading HQ
- Politics by the Numbers Blog
- Graefe, Andreas; Armstrong, J. Scott; Jones, Randall J. Jr; and Alfred G. Cuzán (2014). "Accuracy of combined forecasts for the 2012 Presidential Elections: The PollyVote" (PDF). PS: Political Science & Politics. Cambridge Journals. 47 (2): 427–431.