The Goal Statement and the Result Aren't Always the Same Claim

The Goal Statement and the Result Aren’t Always the Same Claim

You have a case study open. Near the top it says the client wanted more online sales. Near the bottom it reports a follower count. Nothing in between explains how the second number produced the first, because the document never wrote that sentence.

The opening paragraph and the closing paragraph are two separate claims

Case studies follow a consistent shape: a stated objective near the front, a headline metric near the back. Reader habit welds them into one argument: here is the task, here is the proof. They are two independent statements that share a page.

The objectives that recur fall into roughly three categories: revenue or sales, brand awareness, and audience or community growth. The headline metrics fall into three as well: a sales or conversion figure, an engagement or reach figure, and a follower or audience-size figure. No metric proves any goal by proximity alone. The document has to make that connection explicit in a sentence, or you have no basis for assuming it.

A hypothetical case study where the two paragraphs stop agreeing

Here is a HYPOTHETICAL excerpt, invented for this article. No real agency, client or campaign is described, and the numbers are made up.

HYPOTHETICAL, invented example. Objective: the brief was to increase online sales over the campaign period. Approach: a three month organic content programme across two platforms. Results: the account gained a hypothetical 41,000 new followers over the same period, a hypothetical increase of 180 percent on the starting audience.

Read it again looking only for a sales number. There is none. The objective is about money and every reported number is about audience size. The excerpt never claims a sales result and never says the follower growth caused one. It leaves that to you.

Why the mismatch survives being written down and published

The reason is boring rather than sinister. The goal paragraph tends to be lifted from the original client brief or pitch deck, written before the campaign ran. The results paragraph is written afterwards, from reporting, and features whichever number moved most. That is not necessarily the number the brief promised to move, and the dashboard offers a menu, which is why the best metric on a dashboard is rarely the real story.

Then nobody reconciles them. The client approves the study for accuracy about their brand, the agency checks the numbers against what it reported, an editor checks it reads well. Nobody holds the objective sentence and the results sentence side by side.

Questions that catch the substitution

  • Does the document contain a sentence that connects the metric to the goal, something like “this audience growth drove the sales increase”? Or does the metric simply appear near the goal, linked by page order?
  • If the stated goal was sales or revenue, is a sales or revenue number reported anywhere, even a modest one? Or is every number a different kind of metric?
  • Would the reported metric still read as success under the opposite goal? Follower growth reported under a goal of driving in-store visits should feel wrong. If it does not, you are reading it as generic good news rather than evidence for a claim.
  • Is there a plausible undisclosed reason the two connect? Sometimes a real link between the metric type and the goal type was understood in the room and never written down. That is a reporting failure rather than a substitution, and you cannot tell the two apart from outside.

A disclosed substitution is a different document from a silent one

Some case studies handle this properly. The disclosed version reads like this: the goal was an increase in online sales, sales data was not available inside the reporting window, so the study reports the closest proxy, referral traffic to the product pages. The substitution is named and the reason given.

That still does not prove the goal was met. A proxy is not the thing it stands in for. But the limitation sits on the page where you can weigh it. A silent substitution reads as if the goal was met, because it names a goal, closes with a large number, and never marks the swap. The deficit is identical. Your knowledge of it is not.

This is not the same reading error as a vanity metric

These get conflated constantly. A vanity metric critique evaluates one number on its own terms, asking what it measures and hides. That question stands whether or not the document claimed the number proved anything else, and it is the subject of our piece on when the headline number is a vanity metric. A goal-metric mismatch is a comparison instead. It sets two claims from one document side by side, the stated objective and the reported result, and asks whether they answer one question.

So a case study can have this problem while its headline number is entirely legitimate. Picture a document that opens with an email list growth objective and closes with a genuine, properly attributed revenue figure. That is no vanity metric. It answers a different question than the one the document said it was asked.

Read a few side by side

The check gets faster with volume. Browse the case study library and run the four questions against the first three you open, or submit your own published work. The wider method: how to read a marketing case study without being misled.

FAQ

If a case study states a sales goal but only reports engagement numbers, does that mean the campaign failed?

No. It means the document does not give you enough to judge the sales goal in either direction. You have found a gap in the report, not evidence about the result.

Is it ever legitimate for a case study to report a different metric than the one in its stated goal?

Yes, when the substitution is disclosed as a proxy and the reason is given. It becomes a reading problem only when the swap is silent and you are left to assume a link the document never states.

How is this different from a case study just using a vanity metric?

A vanity metric critique questions one number in isolation, asking what it hides. A goal-metric mismatch compares two claims in the same document, the opening objective and the closing result, and asks whether they are about the same thing.

Sources

Similar Posts

Leave a Reply

Your email address will not be published. Required fields are marked *