The difference between correlation and causation in growth reporting

A common reading of a revenue increase during a period of active marketing is that the marketing worked. A common reading of a decrease is that something in the marketing failed. Both readings rely on the same assumption: that the data available is sufficient to draw causal inferences. It is not.

Standard growth reporting is almost entirely correlational. It shows what happened at the same time as revenue moved. Channel X was active during a period of growth. Spend increased in quarter three, and so did revenue. The report records the co-occurrence and implies the cause. The implication is rarely examined.

The causal inference problem

Correlation describes what happened together. Causation describes what produced what. Growth reporting conflates the two because of a structural limitation of the data available.

The structural limitation is this: standard analytics captures what happened inside the funnel. It does not capture what was happening in the market at the same time. A business might increase paid search spend and observe a revenue increase. But if category-level search demand also increased during that period, driven by a seasonal trend, a regulatory change, or a competitive event, the revenue increase was partially or wholly caused by external demand.

Attribution models attempt to resolve this, but they operate on the same closed population: visitors who arrived. They assign credit for conversion across touchpoints within the funnel. They cannot assign credit, or absence of credit, to the demand that never entered the funnel at all.

The practical consequence is that growth decisions are made on incomplete evidence. If marketing spend is credited for a revenue increase that was primarily caused by a market tailwind, the organisation will increase that spend expecting to replicate the result. When the tailwind subsides, the result will not replicate, and the spend will appear to have failed.

Causal measurement requires a counterfactual. What would have happened without the intervention? Standard analytics cannot answer this. But demand-level data can establish a baseline: how much visibility did the business hold in category searches, how much of it leaked to competitors before the intervention, and what changed after it?

That is the minimum necessary condition for a causal analysis, and it is not a complete one. Without knowing what demand existed and what proportion was captured, any attribution of revenue to marketing activity is a correlation presented as a cause.

The decisions that follow from that error are significant. They determine where capital is allocated, which channels are expanded, and which are cut. Getting the causal inference wrong at this level is a structural source of capital misallocation.

Brand Demand Scan

The gap has a revenue figure.

Brand Demand Scan identifies whether your business has a meaningful demand gap and quantifies it in revenue terms.

Request a scan →

Brand Demand Scan puts a revenue figure on the gap this note describes, from your own Search Console data. Leadership decides where the next euro in marketing goes against that figure, and the RoI² Framework verifies the profit each decision adds.