Are you buying survey data the wrong way?

Published date December 3, 2025

What started as a curated craft has become a $119B mass-market machine. Today, survey quality is hard to see — and even harder to trust. This episode of our Data Quality Simplified series explains why consultants, investors, and anyone else relying on the industry should rethink how they buy data.

Share this piece

Executive summary.

For consulting and private equity teams, the risk in buying survey data is treating it like a commodity instead of a high-stakes research input. This article explains how the survey industry evolved from curated, traceable respondent recruitment into a $119B scaled market where buyers often receive a packaged dataset without enough visibility into the quality risks behind it. As fraud adapts and providers compete on volume, speed, and certainty, survey data can look credible even when the underlying quality is uncertain. The takeaway is that consultants and investors should resist the commodity mindset: in high-stakes strategy, diligence, and investment decisions, survey results are only trustworthy when buyers scrutinize how the data was produced rather than accepting fast, polished answers at face value. 

The problem with the survey industry

Industries evolve. Clothing, once stitched by hand, is now made by the millions. Houses, once built with hand-carved detailing, are now assembled from standardized parts.

Surveys are no exception. What was once personal and deliberate is now available at a massive scale.

It's progress ... but not without its sacrifices.

Quote from Vignesh Krishnan, CTO of RepData, on fraud, AI, and the coming shift in how survey data is bought.

From craft to commodity: How we got here

Once upon a time, you knew who answered your survey. A signature on a clipboard. A registered phone number on the other end. Even early online panels were limited to curated mailing lists.

But as technologies evolved, so did fraud.

Quote from Vignesh Krishnan, CTO of RepData, on layered fraud defenses and using AI to fight AI.

“ And the thing is, fraud does not sit still. There are hundreds of thousands of fraudsters who try to break into our surveys every day. Every check meets a new workaround. And of course, fraud prevention alone does not guarantee quality,” says Krishnan.

But in a $119B industry competing on volume, most providers skip nuance and sell certainty: tell us how many answers you need, and when, and out comes your data.

Somewhere along the way, surveys went from a bespoke service to a packaged commodity.

The cost of scale without scrutiny

Quote from Potloc CEO Rodolphe Barrere on normalized industry practices like hidden middlemen and hyperactive respondents.

Our recent study shows the real cost of these shortcuts. For example, providers set their own thresholds for how many surveys someone can attempt in a day — and they rarely tell you where that line is, let alone the data quality trade-offs.

Quote from Potloc CEO Rodolphe Barrere on providers using the high-quality label without having to prove it.
That’s how you end up with data that’s not always good… just good-looking.
Quote from Vignesh Krishnan, CTO of RepData, on the lack of transparency that makes good and bad suppliers hard to tell apart.
It’s time to change that.

What buyers can do: Resist the commodity mindset

“You wouldn’t accept a candidate without checking their references. And you wouldn’t expect to buy a home at half the market price in a prime neighbourhood,” says Barrere.

Surveys are no different. They are an amazing way to gather human insights, but they need to be done right.

Quote from Potloc CEO Rodolphe Barrere on why insights can't be bought like a product on a shelf.
Progress only starts when buyers resist the commodity mindset. Because in high-stakes decisions, if you can’t see the risks… how can you trust the results?

You might also like

See all resources