A Survey about Surveys

I usually take the results of polls and surveys with grain of salt, and now there's good reason that you should too.

A study published by the Pew Research Center indicates that only 9% of households sampled respond to surveys. This is down from 36% in 1997. However, the study concludes that even with this abysmal response rate surveys still adequately represent the population at large.

I am doubtful. The population that responds to surveys is completely self-selected, and certainly has behavioral and preferential differences from the overwhelming majority of the population that doesn't respond to surveys.

The question is, does it matter? The study found that people who respond to surveys are more engaged in civic activity. Which probably means that people who actually go out and vote are more likely to respond to polls, which could mean that polls may still be somewhat accurate gauges of electoral outcomes, even if they don't represent the general sentiment of the population.

But that isn't a given, and it's basically impossible to determine the accuracy of that hypothesis because the tool you need to measure it with doesn't work.

So, exactly why are more people refusing to respond to surveys?

1. They don't want to waste the time.
2. They figure it's a gimmick or someone is just trying to collect demographic data in order to sell them something.
3. They don't think their opinion is anyone's business.
4. They really don't have an opinion or don't vote or buy a product so they would just be wasting everyone's time.
5. They don't want to burn cellphone minutes (polling now tries to balance cellphone and land-line respondents).
6. They are tired of being constantly interrupted.
7. They believe that poll and survey questions are intentionally slanted to achieve a desired result and are therefore not accurate gauges of their opinion in the first place.

I've declined to respond to surveys for most of these reasons at one time or another, but I'm particularly bothered by "push polls," which have become de rigueur. The the integrity of many polling firms has come into question because of the obvious political slant of their questions and outcomes that tilt consistently in one direction year in and year out.

It's interesting that in the age of Facebook, where everyone is constantly baring their innermost secrets for all the world to see, the number of people who are willing to respond to questions from someone who actually wants their opinion has shrunk dramatically.

I'd ask everyone to respond to the question above, but I know only 9% of you would do it, and the results would be worthless.