Why creative tests come first

Phase one: creative#

Fixed audience, variant creative, 5 to 7 day read. Reddit SMB framework sets this window; Gupta Media extends creative tests to one to two weeks. Resolve the tension by budget: fast spenders read in days, slow spenders need weeks for equivalent confidence. Source: how Reddit ads work.

Phase two: audiences#

Winning creative duplicated into new community clusters, keyword groups and interest tests. Same angles, new rooms: now audience variance gets its clean read. Fund each audience to learning thresholds; starved audiences produce anecdotes. Structure: the separation law.

Phase three: scale#

Winners expand into adjacent pods with gradual budget increases while testing continues in the reserved pool. Core spend compounds on proof; test spend hunts the next proof. Never spend the test pool defending a core loser. Method: scaling winners.

Significance honestly#

Reddit experimentation guidance warns early stopping kills statistical significance, without publishing universal minimums per campaign. Use direction plus magnitude plus consistency: winners should win across days, placements and reasonable windows before scaling. Guidance: Reddit testing guidance.

Document everything#

Hypothesis, variant, audience, window, result, decision: six fields per test, logged centrally. Institutional memory compounds; repeated tests of settled questions burn the tuition twice. The log is the asset the algorithm cannot copy. Naming helps: naming convention.

Putting test order into practice#

Map the current quarter into three phases on one page: creative tests running now, audience tests queued on winners, scale slots reserved for graduates. Unsequenced testing wastes budget on parallel variables; sequenced testing compounds learning. One page, whole quarter.

Enforce the sequence in planning reviews: no audience test without a creative winner, no scale without an audience winner. Governance: first campaign setup and scaling winners.

Frequently asked questions#