Back to blog
A blank sheet of white paper on a wooden desk, a pen lying to its left and the corner of a laptop to its right
Survey designSeptember 22, 202612 min read

Asking sensitive questions without pushing people to lie

On sensitive topics, respondents answer to look good rather than to be accurate, and your clean export hides it. Here is how mode, wording and placement change whether people tell you the truth.

By SurveyLane · The team building SurveyLane

Some questions get an honest answer. Some get the answer the respondent wants you to have. The gap between the two is not noise you can average away. It runs in one direction, it is widest exactly where the topic matters most, and nothing in your tidy export marks which rows are inflated. This is social desirability bias, and you design against it before you send, not after.

What social desirability bias actually is

People want to look good, even to a stranger they will never meet, even in a survey they were told is anonymous. So on any question with a socially approved answer, respondents drift toward it. They over-report the things a good citizen does, like voting, exercising, giving to charity, reading to their kids. And they under-report the things that carry stigma, from drinking and drug use to prejudice, debt and skipping the dentist.

The tell is that the error has a direction. Ordinary measurement noise scatters both ways and shrinks as your sample grows. Social desirability bias does not shrink, because every respondent is leaning the same way. A bigger sample just buys you a more precise estimate of the wrong number. That is what makes it nastier than random error and worth spending real design effort on. More data does not save you.

The interviewer is the single biggest lever

Before you touch a word of the question, decide who the respondent is answering to. The presence of another human is the strongest driver of social desirability bias there is, and switching it off is the most reliable fix you have.

The Pew Research Center has measured this directly by asking the same questions by phone and on the web. Asked about their personal finances, 20 percent of people answering online admitted they were in poor shape financially, against just 14 percent of those on the phone with a live interviewer. Same question, same period. The only difference was whether a human was listening. Pew also found that refusals to sensitive questions run higher when an interviewer is present. People would rather say nothing than say an unflattering thing out loud to another person.

The practical reading is simple. If a topic is sensitive, keep it self-administered. A web form or an app answered in private pulls more candour and fewer refusals than any interview, however well trained the interviewer. SurveyLane is self-administered by default, so you start from the better mode. The work left is the wording and the placement.

Not all sensitivity is the same

"Sensitive" bundles three different problems together, and they do not all have the same fix. It helps to pull them apart. A question can be intrusive: it feels like none of your business whatever the answer, like income or religion. It can carry a threat of disclosure, where the respondent fears the answer could get back to someone and be used against them, like drug use, or an employee survey about a manager. Or it can be socially desirable, meaning there is a right-looking answer and a wrong-looking one, and admitting the wrong one feels shameful.

Only the third is social desirability bias in the strict sense, but the three travel together and feed each other. Disclosure fear makes the desirable answer even more tempting, because now the lie protects the respondent as well as saving their face. When you review a draft, name which kind of sensitivity each hard question carries. Intrusiveness is answered by making the item optional and saying why you ask. Disclosure fear is answered by a confidentiality promise you can keep. Social desirability is answered by wording and mode. Reach for the wrong lever and you waste it.

Word the question so the undesirable answer feels normal

Once the topic is fixed and the mode is private, the wording does the rest. The core move is to lower the cost of admitting the unflattering thing, and there are a few reliable ways to do it.

Load the question toward the sensitive answer, not the flattering one. A neutral "Did you vote in the last election?" invites the good-citizen reply. A version that gives non-voting an out, like "In the last election, did something come up that kept you from voting, or did you make it to the polls?", turns not voting into a normal outcome with an ordinary excuse, and more non-voters own up. This is one of the few places where a deliberately non-neutral question is the more accurate one.

Normalise the behaviour before you ask about it. A short preamble that says many people do the thing takes the shame out: "Many people find it hard to stick to a budget every month. How often in the last month did you go over yours?" You are signalling that the honest answer is common and expected, not a confession. Keep the preamble true, because inventing a norm to manufacture an answer is its own bias. But where the behaviour genuinely is widespread, saying so buys you candour.

Give the unflattering answer an easy exit

People lie by omission when the honest answer has no comfortable box to sit in. So build the box. Ask how many alcoholic drinks someone had last week on a scale that starts at "0 to 2", and the heavy drinker at the top of the range has nowhere honest to land, so they round down. Extend the top of the scale past what you expect, so the true answer is never the most extreme option on offer. Respondents shy away from the most extreme option on instinct.

Offer a real way out, too. An explicit "prefer not to say" on a sensitive item earns its place. A respondent who picks it is choosing silence over a lie, which keeps their other answers honest and tells you the item is one people guard. That beats a forced answer you cannot trust. It is the same reasoning behind writing better survey questions in general. The option set is part of the question, and a missing option is a quiet instruction to fudge.

Be specific about the reference period

Over-reporting of good behaviour thrives on vague timeframes. "Do you exercise regularly?" measures self-image, because "regularly" means whatever the respondent wants it to mean, and everyone rounds up to the version of themselves they intend to be. "How many days in the last seven did you exercise for at least twenty minutes?" measures behaviour, because it pins a countable thing to a window short enough to actually remember.

Tight, recent reference periods cut social desirability two ways. They give the flattering self-image less room to work, and they lean on memory instead of identity. The trade is recall accuracy. Ask about too long a window and people telescope events in or out, so match the window to how memorable the behaviour is. Rare, vivid events tolerate a longer period. Frequent, forgettable ones need a short one.

Put the sensitive questions late

Where a question sits changes how it is answered. Open with the sensitive item and you spend trust you have not earned yet, so people quit or stonewall. The funnel structure, broad and easy at the top and narrow and sensitive at the bottom, exists partly for this. By the time a respondent reaches the hard question, they have put in a few minutes and built a little momentum, and they answer more honestly than they would have at the door.

Demographics that feel intrusive, like income, belong at the end for the same reason. The exception is a demographic you need to route the survey, which has to come early. The full case for sequence is in question order effects. The piece to carry here is that sensitivity is one of the main things a good order is protecting.

Make the confidentiality promise real, then keep it

A respondent weighs how honest to be against how exposed the answer might leave them. A credible confidentiality promise tips that calculation toward candour, but only if it is credible. Vague reassurance does little. A specific statement of who sees the raw answers, what is stripped before analysis, and what will never be linked back to them does much more.

The fastest way to break your own promise is to undercut it elsewhere in the survey. Ask for name, employee ID or email on the same page as a question about whether people trust their manager, and every assurance on the intro screen is worthless. If you promised anonymity, collect nothing that re-identifies. The difference between anonymity and confidentiality matters here. It changes what you can honestly claim, and what you can promise a respondent is worth getting exactly right before you lean on it to pull sensitive answers.

When it really matters: indirect techniques

Sometimes the topic is sensitive enough that no wording gets you a straight self-report, and you accept that you cannot ask directly at all. Two established techniques trade precision for candour by taking the respondent's fingerprint off the answer.

The list experiment, or item-count technique, hands one random half of your sample a list of harmless statements and asks only how many are true, not which. The other half gets the same list plus the sensitive item. Nobody ever admits to the sensitive statement on its own. You recover how common it is from the difference in average counts between the two groups. The randomized response technique, a method going back to the 1960s, does something similar with a coin flip. The respondent answers truthfully or gives a fixed answer depending on a private random outcome you never see, so any single "yes" is deniable while the group rate is still recoverable.

Both cost you a lot of sample and give you a group-level estimate, not individual data you can cross-tabulate. They are overkill for most surveys. But when you are measuring something people have a strong reason to hide and you only need the rate, they beat a direct question that everyone quietly lies to.

You cannot fully clean it afterwards

Design is most of the job, because the back end can do so little. Once a socially desirable answer is in the file, it looks exactly like an honest one. There is no flag, no outlier, no residual you can subtract. Where an external benchmark exists, like turnout records, sales figures or known population rates, you can at least see the direction and rough size of the inflation by holding your self-reports against it. Most of the time you have no such anchor, and the bias is simply baked in.

What you can catch afterwards are the coarser problems that ride alongside it, the straightlining and speeding and copy-paste answers that monitoring response quality is built to find. Social desirability bias is quieter than those and rarely trips the same checks, which is why the money is spent up front. Pick the private mode. Word the item so the honest answer is the easy one. Place it late. Make a promise you actually keep. Those four moves do more than any amount of cleaning ever will.

Frequently asked questions

Does telling people the survey is anonymous fix social desirability bias?

It helps, but it does not fix it, and only if the claim is true and believable. People shade their answers even when genuinely unobserved, because part of the pull is toward their own self-image and not only toward a watching interviewer. A specific, credible promise about who sees the data and what gets stripped moves more people than a bare "this is anonymous" banner, and undercutting it by collecting identifiers on the same page erases the benefit completely.

Which survey mode gives the most honest answers on sensitive topics?

Self-administered modes, like a web form or app answered in private, consistently beat any interview. Pew's own phone-versus-web comparisons show people are more candid and refuse sensitive questions less often when no interviewer is listening. If a topic is sensitive, the single most effective decision you can make is to take the human out of the exchange, before you even start tuning the wording.

Should I make sensitive questions optional?

Usually yes. An explicit "prefer not to say" lets a respondent decline without lying, which protects the honesty of their other answers and tells you the item is one people guard. A forced response on a threatening question tends to produce a flattering fabrication instead of a real answer, so you gain a filled cell and lose the truth. The exception is a screening question the rest of the survey depends on, which has to be answered to route people correctly.

When are list experiments or randomized response worth the effort?

Only when the topic is sensitive enough that direct questions clearly fail and you need the group rate rather than individual records. Both techniques cost a large amount of sample and give you an aggregate estimate you cannot cross-tabulate against other answers. For most surveys, careful mode, wording and placement get you honest enough data at a fraction of the cost. The indirect methods are reserved for the genuinely stigmatised behaviours people will not admit to under any direct phrasing.

Further reading