How incrementality testing proves Meta works

Attribution claims, incrementality proves#

Platform reporting answers who touched the buyer; incrementality answers what the spend caused. The gap between the two is the budget currently wasted on demand that would have converted anyway. Every scaled account eventually faces this question, and experiments answer it.

Think of it plainly: an illustrative brand spending six figures monthly might find only part of reported conversions truly caused. The rest is credit, not cause. The hub frames the family, and attribution windows explain the claiming machinery.

Haus-style method means disciplined geo and holdout testing run continuously, not as a one-off audit. Cadence beats grandeur: small honest reads quarterly beat one heroic study yearly.

Holdouts: the control group#

A holdout keeps a matched audience unexposed while the test group sees ads; the conversion gap between them is lift. Design starts with the question: which budget decision will this answer, and what result changes the plan. Tests without decisions attached waste everybody.

Size holdouts for statistical reading: too small and noise rules, too large and opportunity cost bites. Run to a pre-committed read date so impatience never moves the goalposts. Our A/B rules set the clean-read discipline.

Document everything: hypothesis, cells, dates, budgets, outcome, decision. Meta own guidance on experiment reading reinforces why stable learning matters during tests.

Geo tests for national budgets#

Geo testing splits matched regions into exposed and control markets, ideal for always-on spend that cannot simply switch off. Match geos on history, seasonality and size before launch; sloppy matching corrupts every later conclusion. Read the gap in business outcomes, not platform metrics.

Expect noise from weather, local events and retail calendars, and pre-commit to how anomalies get handled. One honest inconclusive beats three confident fictions.

Rotate control geos across studies so no region permanently subsidises learning. Fair rotation keeps regional stakeholders allies rather than sceptics.

Calibration: from claimed to caused#

Calibration turns experiment results into everyday multipliers on reported numbers: if tests show each reported pound contains a set share of true lift, budgets and targets adjust to caused reality. Revisit multipliers as creative, audiences and seasons shift; calibration decays.

Apply calibration per funnel stage, never as one account-wide factor: prospecting and retargeting lift differently, and blended factors misjudge both. Prospecting splits keep the stages honest.

Feed calibrated values back through CAPI discipline and modelled conversions so the auction trains on truth rather than applause. Clean signal compounds every later test.

What to test first#

Start with the biggest budget question: usually prospecting incrementality or retargeting necessity. Retargeting holdouts routinely surprise: some warm pools convert anyway, and freeing that budget for prospecting grows the base. Test where the money sits.

Sequence studies across quarters: prospecting lift, then retargeting necessity, then creative incrementality, then channel overlap. Each answer funds the next question.

Share results beyond media: finance, trading and leadership need the caused-revenue story for planning. An experiment nobody acts on is theatre. Browse Meta own business success stories for directional examples of tested growth.

Run the cadence in-house#

Quarterly holdouts plus continuous calibration checks fit most scaled accounts: one live question always, one read per quarter minimum. Smaller accounts can start with Conversion Lift studies before graduating to geo designs. Our Conversion Lift guide stages the entry path.

Keep a testing ledger with dates, cells, outcomes and decisions; institutional memory beats heroic recollection when planners rotate. Scaling decisions should cite the ledger, not vibes.

Ask our team for an incrementality plan when reported ROAS and banked revenue first disagree. That disagreement is the method knocking.

Frequently asked questions#