Vanity Metrics

What Counts as a Vanity Metric

A vanity metric is any number that goes up and to the right without telling you whether your business is getting healthier. Page views, total downloads, social media followers, app installs, registered users (as opposed to active users), and press mentions are the classic offenders. They are easy to measure, easy to screenshot, and easy to feel good about, which is exactly why founders gravitate toward them.

The problem is not that these numbers are fake. Ten thousand app downloads is a real event. The problem is that the number does not connect to anything that keeps a company alive: paying customers, repeat usage, or sustainable acquisition costs. You can have 50,000 signups and zero revenue. You can have 100,000 Twitter followers and no product to sell them.

Why This Matters for Early-Stage Founders

Early-stage founders are especially vulnerable to vanity metrics for three reasons:

• Investor decks reward big numbers. "10x growth in users" sounds better than "12% week-4 retention," even if the second number is the one that predicts survival.
• Vanity metrics are available sooner. You can count signups on day one. You often need weeks or months of cohort data before retention or LTV numbers mean anything.
• They create false confidence. A founder watching downloads climb may delay fixing a broken activation flow, because the top-line chart still looks good.

The real danger is that vanity metrics can mask a business that is quietly dying. A viral launch can produce 20,000 signups in 48 hours and then lose 95% of those users within a week, leaving the founder with a huge top-of-funnel number and almost nothing underneath it.

How to Tell a Vanity Metric from a Real One

Ask two questions of any metric before you put it in a report:

1. Does it change my next decision? If the number goes up or down, would you actually do something differently? If not, it is likely vanity.
2. Does it correlate with money in the business? Revenue, retention, and referral behavior are the closest proxies for business health. If a metric does not feed into one of those, treat it with suspicion.

Example: Downloads vs. Activated Users

Say your app gets 8,000 downloads in its first month.

• Vanity framing: "We had 8,000 downloads!"
• Actionable framing: Of those 8,000, how many completed onboarding (activated) and how many were still using the app in week 4?

If only 400 activated (5% activation rate) and 40 remained by week 4 (10% week-4 retention among activated users), the real story is a leaky funnel, not a growth win. The download number hides that story completely.

Metrics to Track Instead

Replace vanity numbers with metrics tied to behavior and money:

• Activation rate: percentage of new users who reach a defined "aha moment" (e.g., created their first project, sent their first message).
• Retention rate: percentage of users still active at a fixed interval (day 7, week 4, month 3).
• Revenue per user or customer (ARPU/ARPC): total revenue divided by active users or paying customers.
• Referral or organic share: percentage of new users who arrive without paid acquisition, a sign of real product-market pull.
• North Star Metric: a single number that reflects the core value your product delivers (e.g., "weekly active teams" for a collaboration tool), tracked over time against cohorts.

A Quick Formula for Sanity-Checking Growth Claims

When someone reports a growth number, ask them to also report retention alongside it:

Net Effective Growth = New Users Acquired - Users Lost (Churned) in Same Period

If New Users Acquired is large but Users Lost nearly cancels it out, the headline growth number is vanity. A team growing from 1,000 to 1,200 users by adding 500 new users while losing 300 existing ones is in a much weaker position than the raw "+200" suggests.

Common Mistakes

• Reporting cumulative totals instead of active numbers. "100,000 total signups" hides how many are still around.
• Optimizing marketing for the metric that's easiest to move. Follower counts and impressions are cheap to inflate with ad spend and mean little without conversion data.
• Skipping cohort analysis. Without breaking users into signup cohorts, it's impossible to see whether retention is improving or decaying over time.
• Using vanity metrics to raise funding, then facing them again in diligence. Sophisticated investors will ask for retention curves and unit economics regardless of what's on the pitch deck.

The Takeaway

Vanity metrics aren't useless for storytelling, a big download number can help with press or morale, but they should never be the metric a founder uses to decide whether the business is working. Before a launch, tools like welaunch.sh can help founders plan which real metrics (activation, retention, referral) to instrument from day one, so the first numbers that come in are the ones that actually matter.