Recruiting Respondents for Concept and Ad Testing¶

A concept test - a packaging redesign, an ad creative round, a set of logo directions run through a Pairwise Comparison knockout - is only as informative as the people answering it. Internal team feedback and a quick share with your existing customer list both have an obvious blind spot: they're not your actual target audience, and every reaction they give you is filtered through already knowing the brand, the project, or the person who sent the link.

Panel Recruitment and Opionate's concept-testing tools - the Stimulus Section and Pairwise Comparison - are built to work together directly: the same Advanced Survey that holds your concept test can be filled with real, matched respondents instead of whoever happens to be on your own list.

Why Concept Testing Specifically Benefits From This¶

Concept and ad testing usually needs a genuinely fresh reaction - someone seeing a design for the first time, without the context an internal reviewer or an existing customer already carries. It also often needs a specific audience match (the target demographic for a specific product, not just "anyone available") that your existing list may not cover well, or at the volume a real test needs to produce a reliable result.

Setting It Up¶

Build your concept test as you normally would - a Stimulus Section with highlight areas and targeted questions for detailed feedback on a specific design, or a Pairwise Comparison knockout for a forced-choice ranking across several concepts - inside an Advanced Survey. Then define your audience's screening criteria to match the specific group you actually need reacting to it (an age range, a product-usage history, whatever's relevant to the concept being tested), and fund a wave sized to what your analysis needs. Our guides on the Stimulus Section and Pairwise Comparison cover building the test itself in depth; our guide on launching and funding a wave covers the recruitment side.

A Practical Pattern¶

For a design decision with a genuine shortlist, running a Stimulus Section first (to understand why people react the way they do to each individual concept) and a Pairwise Comparison section second, in the same test, against the same recruited audience, produces both qualitative depth and a decisive forced-choice ranking - from the same fielding, against the same real target audience, rather than two separate studies that might not even agree with each other.

FAQ¶

Do I need a huge sample for a concept test, or is a small panel-recruited group enough?
It depends on how decisive you need the result to be and how many concepts you're comparing - see our guide on how many panel respondents you need for the general reasoning, though a Pairwise Comparison ranking across several concepts generally benefits from a reasonably sized panel to produce a stable, reliable ranking.

Can I target a very specific niche audience through Panel Recruitment for a concept test?
You can screen on age, country, employment status, and 300+ other criteria - how narrow you can go before recruitment slows down or screen-outs climb depends on how rare your specific criteria are within the general population.

Should I use my own list, a panel, or both for a concept test?
Both is often the strongest option when it's available - your own list for people with real context on the brand, a panel for an unfiltered outside reaction - run as two segments you can compare against each other rather than picking only one.

See Introduction to Panel Recruitment and our guides on the Stimulus Section and Pairwise Comparison for the pieces this combines.