If you have ever walked into a meeting with a dashboard so colourful it could qualify as modern art, I get it. Marketing is one of the only jobs where you can do a ton of work, make a real impact, and still have someone ask, “Okay, but how many likes did it get?”
Here’s the thing. Most of us are not short on metrics. We are drowning in them. The actual skill is knowing which numbers are telling you the truth, which ones are just being polite, and which ones are actively trying to get you promoted based on vibes.
Don’t just measure, measure what matters.
In this post, I’m going to give you a cheat sheet for separating vanity metrics (the ones that look impressive) from vital metrics (the ones that change decisions and predict revenue). I’ll keep it practical, email-first, and mildly cheeky, because if I have to watch one more team celebrate open rate like it is 2016, I will gently scream into a pillow.
Define the Problem or Context
Vanity metrics are metrics that make you look good without helping you make better choices. Tableau puts it plainly: they are exciting to point to, but they are not actionable and do not reliably inform future strategy.
They are tempting because they hit three very human psychological buttons.
First, they give instant feedback. A spike in followers or pageviews feels like evidence that your brain is doing a good job. It is the same dopamine loop as refreshing a tracking page for your online order.
Second, they are easy to compare. It is simple to say “up 20%” even when you cannot explain what changed or why it matters.
Third, platforms love them. Most platforms are designed to surface numbers that keep you posting, boosting, and refreshing. If a metric is easy to inflate, it tends to be easy to sell.
Email has its own special flavour of vanity metrics, because some “classic” email metrics have become less reliable due to privacy shifts. Apple’s Mail Privacy Protection is a big example. Apple says Mail Privacy Protection hides the IP address and prevents senders from seeing if you opened an email. Litmus also notes that as of March 2024, MPP accounted for 55% of all opens, which makes open rate a pretty lousy way to judge whether you are doing a good job.
So the problem is not that metrics are bad. The problem is that a lot of the ones we default to are either not connected to customer behaviour, not connected to business outcomes, or not trustworthy enough to steer decisions.
Teach the Reader Something Valuable
The Vital Metric Test
Whenever someone suggests a KPI, I run it through five questions. If it fails more than one, it is probably a vanity metric wearing a blazer.
First, does it represent customer behaviour, not platform behaviour? Clicks, purchases, upgrades, renewals, replies, and time spent using a product are behaviours. “Impressions served” is mostly a platform bragging about how big it is.
Second, can I take a clear action if it moves? If your metric goes down, can you name the three most likely causes and what you would do next? If the answer is “uhhh,” you are tracking trivia.
Third, is it comparable over time, or is it easily distorted? If the measurement method keeps changing, your trend line becomes interpretive dance. Open rate is the classic example in email because of privacy protection and background content loading.
Fourth, does it connect to value? Value can be revenue, retention, referrals, reduced support costs, or lower churn. The point is that it should connect to something your business actually survives on.
Fifth, is it hard to “win” without actually improving the customer experience? If you can juice the number with clickbait subject lines, dark patterns, or spammy targeting, it is not a vital metric. It is a temptation.
The ladder that keeps you sane
I like to think of metrics as a ladder.
Attention is what you get. Intent is what you earn. Value is what you keep.
Vanity metrics often live at the attention level. Vital metrics tend to show up at intent and value, even if they are less dramatic in a screenshot.
In lifecycle and email, this matters because email is not just a channel. It is a relationship. And relationships do not thrive on applause. They thrive on consistency and trust. If you optimize for applause, your list will eventually respond by quietly leaving. Sometimes literally, via unsubscribe.
Deepen the Insight or Expand the Value
The Ultimate Cheat Sheet (no chart, just the truth)
Let’s walk through the most common “looks good on a slide” metrics, what they are missing, and what to track instead if you want to make better decisions.
In email, open rate is the classic vanity metric. It feels like proof that your subject line worked, but opens are increasingly unreliable because of privacy changes. Apple says Mail Privacy Protection prevents senders from learning whether an email was opened, and it also hides IP addresses. Litmus reports that Apple MPP can account for a majority share of opens, which means open-based reporting can be deeply misleading. If you want a vital view of whether email is working, look at click rate, unique clickers, and the conversion rate that happens after the click. Those are behavioural signals. They also tell you what to do next. If clicks are down, your value proposition or relevance may be off. If clicks are steady but conversions drop, your landing page or offer is the issue.
Click-to-open rate is another one that sounds sophisticated, but it inherits the same problem. If your denominator is unreliable, your ratio becomes fancy math built on sand. If you like the “efficiency” concept behind CTOR, shift the question to something sturdier: of the people who clicked, how many completed the action that mattered? That is the click-to-conversion rate, and it forces you to care about outcomes instead of micro-engagement.
List size is the metric everyone loves to post on LinkedIn. “We hit 100k subscribers!” Okay. How many of them would recognize your brand in a lineup? A big list can hide low intent, poor deliverability, and a lot of people who have mentally unsubscribed but did not bother to click the button. The vital alternative is an engaged subscriber rate, measured by meaningful actions like recent clicks, conversions, replies, or other first-party engagement signals over a defined window. That helps you answer the real question: Is your audience healthy and reachable?
Total clicks can also turn into a vanity metric when it is used without context. One highly engaged segment, or even a handful of click-happy subscribers, can create a spike that looks like broad success. A better lens is unique clickers and segment-level response. It moves the conversation from “look at this big number” to “who actually responded, and what do they have in common?” That is where personalization becomes strategic instead of creepy.
On the website side, pageviews are the poster child of vanity metrics. They tell you someone loaded a page, not that they found value. If you want a better proxy for meaningful visits, Google Analytics 4 uses engagement rate based on “engaged sessions,” which can include sessions that last more than 10 seconds, include a key event, or have multiple page views. It is not perfect, but it is closer to the truth than raw traffic. Pair that with funnel completion rates for the journeys you actually care about, like signup, checkout, demo request, or trial start.
Paid marketing has its own vanity trapdoor, and it is called impressions. Impressions are not persuasion. They are exposed. Helpful sometimes, but not a strategy by themselves. Click-through rate can also become vanity if it is treated as success rather than a clue. The vital shift is to focus on the cost per qualified action and, where you can, payback periods or customer acquisition cost relative to lifetime value. Those metrics force you to confront whether you are buying attention that converts into value, not just attention that exists.
Social metrics are designed to make you feel something. Follower count, likes, and comments can be useful directional indicators, but they often reflect what the algorithm decided to show, not what your audience truly values. The vital connection for most businesses is owned audience growth. If social is part of your engine, track email signups or product actions that originate from social. That is the difference between “people clapped” and “people joined.”
And then there is the lifecycle metric that causes the most confusion: “engagement” as one big blob. Engagement can mean anything from “opened an email” to “used a product feature” to “laughed at a meme.” When it is undefined, it becomes a vanity metric because it cannot drive a specific decision. The vital approach is to define behavioural milestones, then measure activation and retention by cohort. Cohorts are your reality check. They show whether changes you make are improving outcomes for new users over time, instead of letting totals mask what is really happening.
The reporting framework that makes you look like you have your life together
If you want a simple way to build vital marketing metrics into your reporting, stop organizing your dashboard by channel and start organizing it by decision.
Decision one is your reach: are we reaching the right people? In email, that means deliverability and engaged audience health, not list size. If your engaged audience is shrinking, that is not a “content problem.” It is a relevance and trust problem.
Decision two is the message: is what I’m saying working? Here, you want metrics that reflect intent, like clicks, replies, and downstream behaviour, not opens. Opens can still be directional in controlled comparisons, but they are not a reliable success metric when privacy protections interfere with tracking.
Decision three is experience: is the path converting? This is where you connect email to onsite engagement and conversion. If you fix the email but ignore the landing page, you are basically polishing a doorknob on a door that is locked.
Decision four is value: is this creating long-term benefit? This is where retention, repeat purchase, cohort revenue, and revenue per recipient come in. These are harder to “win” with gimmicks, which is exactly why they are so useful.
The secret is that vital metrics often look less exciting week to week. They do not spike dramatically unless something is broken or you ran a truly great campaign. They are steady, and they compound, and they tell you what to do next. Which is also how I would describe a good savings account, a good skincare routine, and a good lifecycle program.
Vanity metrics make you feel successful without reliably changing your decisions. Vital marketing metrics connect to customer behaviour, are actionable, hold up over time, and link to business value. Tableau describes vanity metrics as exciting but non-actionable and not reliably useful for strategy.
For email, open-based metrics have become less trustworthy because privacy protections can prevent senders from knowing whether an email was opened and can distort measurement. If you want metrics that steer strategy, anchor on clicks and conversions, segment-level behaviour, engaged audience health, and downstream value signals like retention and revenue per recipient.
If you want more practical frameworks for email and lifecycle that do not rely on wishful thinking and pretty dashboards, subscribe to The Click Brief. I send one issue a week with decision-first marketing thinking, psychology you can actually use, and metrics that predict revenue. You can also find me on LinkedIn or Instagram if you want to swap stories about the weird things people celebrate in marketing meetings.