Ideas & analysis

Creative Contribution: Test the Idea Before Media

Tom Weiss
Tom WeissChief Product & Technology Officer
· Updated

Creative is a decision worth investigating before committing the media budget. An agency can ask respondents whether they understand an idea, find the claim credible, and see it as relevant, then use those reasons to improve the execution.

Why the biggest lever stays a guess

Internal review and live A/B testing answer different questions. Internal review can check whether the execution fits the brief. A live experiment observes behavior under its audience, delivery, and landing-page conditions. Neither automatically explains what people misunderstood in a concept that never entered the live test.

A prelaunch survey can supply that diagnosis. It is useful when the team still has room to change the proposition or execution, and when the planned measures actually inform the client decision.

Test the creative before you pay to run it

Use comparable stimuli, a defined audience, controlled exposure, and consistent questions. Plan the relevant segments and bases before choosing a winner. Review the open-ended reasons alongside the ratings; a small score gap may not justify eliminating an option.

The creative-testing workflow covers those inputs. The practical checklist and worked example shows how to report a result without turning survey preference into guaranteed conversion lift. Turnaround depends on questionnaire readiness, audience feasibility, usable sample, and review requirements.

The math is almost embarrassing

Cost relative to media can be calculated, but the inputs must be stated. In a purely illustrative budget with $500,000 media spend at $10 CPM, media impressions would be $500,000 ÷ $10 × 1,000 = 50 million. If research were separately quoted at an assumed $20,000, its allocation across those impressions would be $20,000 ÷ 50 million × 1,000 = $0.40 CPM, or 4% of that media budget.

Those are hypothetical inputs and reproducible arithmetic, not a standard research price. A research allocation CPM is not the platform's pricing unit. Nor does spending $500,000 establish revenue or profit from which a 5% performance change can be valued. There is no investment-return forecast in this example.

For a real program, quotes depend on survey length and respondent count; no separate seat or feature fees apply, and data ingestion can cost extra. The pricing explanation provides the current factors. Decide whether the research is worthwhile using the actual quote and the decision it can inform.

Stop guessing the one that matters

Document what was tested, which respondents evaluated it, what the findings support, and what remains uncertain. Carry a justified shortlist into a live experiment, and evaluate behavior under those delivery conditions.

The agency testing page connects that sequence to briefs and client recommendations. Your team owns study design and interpretation while the MX8 Labs Research Platform supports production.

Correction, October 2, 2026: An earlier Nielsen attribution was unsupported and has been removed.