When a Case Study Names One Platform and Says Nothing About the Rest
A case study names one platform, gives it a strong number, and never mentions whether the campaign ran anywhere else. Nothing on the page is false. The platform named really did produce that result. But a reader who takes the page at face value will walk away crediting one channel with a result that might have depended on, or been offset by, work happening somewhere the page never describes.
A number that is true and a story that is incomplete are not the same failure
This post is about a specific and narrow failure: a channel that is never mentioned at all, not a channel that is mentioned but whose contribution can’t be isolated. That second problem, several named channels and no way to tell which one drove the result, is a real and separate question worth its own treatment. This one is different. Here, the case study describes a single platform in detail and simply does not say whether the campaign existed anywhere else.
Fabrication is the easier failure to catch, because it leaves something on the page that is wrong: a number that doesn’t match the underlying data, a claim that contradicts the summary. Omission leaves nothing wrong on the page. Every sentence can be accurate and the page can still describe a fraction of what happened as though it were the whole thing.
What tips you off that a platform might be missing from the story
- The headline names one platform, but the body describes budget, creative production, or team resourcing in plural or company-wide terms, implying a larger operation than the single channel being reported on.
- There is no sentence anywhere describing the overall channel mix, the media plan, or how spend was split across platforms. A case study can disclose plenty of detail about one channel and never address whether there were others.
- The platform named is also the agency’s known specialty. That’s not proof of anything by itself, but it’s a reasonable place to look first: an agency has an obvious incentive to lead with the channel it’s best known for.
- The write-up describes a single deliverable, a launch video, a content series, an ad set, without situating it inside a broader campaign structure the reader is left to assume doesn’t exist.
A hypothetical worked example
The following campaign, numbers and all, is entirely hypothetical. No real agency, client, or campaign is being described. The figures are round and illustrative, not measured results, and are labelled that way throughout.
Picture a hypothetical campaign that ran on three platforms over the same eight-week window. On Platform A, hypothetical engagement rose by a hypothetical 40 percent. On Platform B, hypothetical follower growth was hypothetically flat, roughly zero net change. On Platform C, hypothetical click-through was hypothetically unremarkable, in line with what the account normally saw before the campaign started.
The agency’s write-up covers only Platform A: the 40 percent figure, the creative strategy behind it, a call to action. Platform B and Platform C are never named. A reader who saw only this write-up would reasonably conclude the campaign as a whole delivered a strong result, when in this hypothetical the honest summary is that one of three channels performed well and two did not move.
Why the omission is easy to miss
A case study is a marketing document, and a marketing document is under no obligation to volunteer its own scope. Nobody writing one has to open with “this covers only the channel that worked.” The reader’s attention goes to what is stated, the platform, the number, the creative rationale, rather than to what is structurally absent from the page.
That asymmetry is the whole difficulty. Catching a wrong number is a matter of noticing an error: something on the page conflicts with something else. Catching an omission requires actively asking a question the page never prompts. There is no red flag built into “we ran this on Instagram and saw a 40 percent lift.” The flag only appears once you stop and ask what else the account was doing at the time, and the page gives you no reason to stop.
The questions that surface the other platforms
- What else did this campaign run on, and what happened there? Ask this even when the write-up gives no indication anything else existed.
- What was the total budget or spend across all channels, and how was it split? A case study that states one platform’s spend without a total is itself worth noticing.
- Is this write-up describing the entire campaign, or one workstream inside a larger one? The answer changes what the headline number is actually a claim about.
What a complete version of this case study would look like
A complete version states its own scope: which channels were part of the campaign, not just the featured one, with a sentence on what happened on the others, even when the honest answer is flat or unremarkable. That disclosure costs very little. A line noting a second channel ran in parallel with no notable movement doesn’t undercut the featured result.
What it buys is credibility a silent write-up can’t earn. A case study that names its underperforming channels is telling the reader it isn’t curating the page down to only the flattering number. That’s stronger evidence than a page that never raises the subject. The same habit of checking what a page never says applies to what a case study leaves out when it names the winning variant and to why the best metric on a dashboard is rarely the real story.
Read the next case study with this in mind
The library at Social Case Studies credits every number to the agency that reported it, and the point of reading them this way is to notice what a write-up scopes itself to before crediting it with more. If you have a case study that holds up to this kind of read, you can submit your own.
FAQ
Is a case study lying if it only reports the platform that worked?
Not necessarily. The named platform’s number can be entirely accurate. The failure isn’t a false statement, it’s that the reader is left to assume, without being told, that the named platform is the whole story rather than one part of it.
How is this different from not being able to tell which channel caused a result?
That’s a separate problem: several channels are named and it’s unclear which one drove the outcome. This post is about channels that are never named at all, so the reader doesn’t know they existed, let alone get to weigh their contribution.