Public Opinion Research and Polling Resource Centre
What is Public Opinion Polling?
A public opinion poll is considered scientific because the results are drawn from research that is conducted on a representative sample in order to make generalizations about a population being studied. The statistical theory of generalization only applies to sample surveys that are based on probability sampling. Probability samples are statistical theory of generalization only applies to sample surveys that are based on probability sampling. Probability samples are based on the principle of randomness. Random means that each unit in the population has an equal or at least measurable chance of being included in the sample. The principle of randomness provides a sound theoretical basis for projecting the results to the general population, which is called statistical inference.
On the other hand, you cannot draw generalizations about the population from which non-probability samples are drawn. However, the predictive ability of polls from non-probability samples has been just as accurate in recent years, opening up new debates as technology, mixed-methods and new sampling strategies offer arguably improved responses and better quality data. Non-probability sampling does not involve random selection. With non-probability samples, we may or may not represent the population well, and it will often be hard for us to know how well we have done so. All online samples are non-probability samples. However, the results from a sample drawn from good access panels (as judged by polling results) could resemble those obtained from a probability sample, i.e., it might be a representative sample while not having been randomly selected.
The results of a public opinion poll often help measure, understand and report on the attitudes, perceptions, and behaviours of the population being studied. Public opinion polls are just a measurement tool. However, as accuracy remains one of the ten core principles of marketing research, when reporting on public opinion polls, it is important to report the margin of sampling error and confidence level on probability samples. When reporting on non-probability samples, it is important to report the researcher’s use of other indicators to indicate the level of and possible sources of error in the sample.
How to report on polls responsibly - Poynter institute
Elections 2020 - Field guide to Polling- Pew Research Centre
Surveys and Polling- American Statistical Association and SciLine
Guides on polling for media and news outlets- American Association of Public Opinion Research (AAPOR)
Guidance for media and journalists looking to report on data from public opinion polls- Market Research Society (MRS), UK
The polling report- Polling Report.comAmerican Historical Association - Public Opinion Polls
A podcast on polling - CBC
IMPORTANT ISSUES TO CONSIDER IN POLLING
There are many reasons polling paints an incomplete picture often. According to market research, polls can be inaccurate if there are flawed “weights” in the sample, shoddily constructed questionnaire design, or minimal contact rates.
· Sampling issues in polling - Pew Research Centre
· Election polling data - Stanford University
Organizations like the Pew research centre and the American Association of Public Opinion Research reveal that polls in the US mainly concentrated on 3 groups of people, the Adults, the Registered voters(RV), and the likely voters(LV).
How to define likely voters - Gallup
Likely and unlikely voters - AAPOR 2004
IMPORTANCE OF PUBLIC OPINION POLLING IN ELECTIONS
One of the most remarkable applications of survey research is in election polling. Election polls attract great attention for their perceived ability to provide a strong indication of the outcome of elections based on scientific polling. However, as polls should only be seen as a measurement tool, the most important function of election polls is to serve a better understanding of the public’s perceptions of a campaign and election for journalists as well as citizens. Some resources below expand on the role of polling in elections.
A sampling method is biased if every member of the population does not have equal likelihood of being in the sample. How can one choose an appropriate sample?
MARGIN OF ERROR IN ELECTION POLLS
The margin of error is a statistic, expressing the amount of random sampling error in the results of a survey. Usually, a poll includes a sample of respondents rather than the total population, which leads to the random sampling error. So, the margin of sampling error describes how closely we can expect a survey's result to match the outcome relative to the true population's value.
Exit polls and their uses
The name “Exit poll” refers to the poll of voters taken just after they exit from the poling stations. The results from exit polls can be very useful to the media and can have several advantages. Exit polls can act as a valuable safeguard against counting fraud. Since the voters cast their actual votes anonymously, we can get additional details from exit polls, like how different groups of people voted, and why they voted.
For many years, a survey's response rate was viewed as an important indicator of survey quality. Many observers believed that the higher the response rates in the sample, the more accurate the survey result. Non-response is widely recognized as a potential source of error that can reduce the accuracy of all types of polls. Non-response becomes a critical issue when non-response falls to below 70 percent. National Elections Studies and the General Social Survey reveal that in-person interviewing has non-response rates of 25 to 35 percent, whereas in telephone surveys receive a nonresponse rate of at least 10 percentage points higher.
· Possible consequences of non-response for pre-election surveys - Pew Research Centre
· The causes and consequences of response rates in surveys
OTHER RELATED RESOURCES
Please refrain from sharing sales pitches posting on unrelated matters and keep comments cordial and to the point. Those participating must abide by the Terms and Conditions.
*Before creating new topics, you must sign up for MRIA communications here