Customers & Markets

Lean Analytics

Use Data to Build a Better Startup Faster

Alistair Croll & Benjamin Yoskovitz · 2013 · O'Reilly Media

How to choose the one number that matters at your stage, measure it honestly, and turn it into evidence of traction.

The big idea

What the book argues

Croll and Yoskovitz argue that startups should focus on one metric that matters most at a given time, chosen according to their stage and business model. They lay out five stages, empathy, stickiness, virality, revenue and scale, and argue that companies should move through them in order. Good metrics are comparative, understandable, ratios or rates, and capable of changing behavior. Vanity metrics that only go up feel good but hide problems, while cohort analysis and pre-set targets keep founders honest.

5
stages: empathy, stickiness, virality, revenue, scale

Key takeaways

7 ideas worth keeping

1

Focus on one metric that matters right now

At any stage, one number matters more than the rest for deciding what to do next. Tracking a dozen indicators equally means none drives decisions. The metric changes as the company evolves; it is a spotlight on the current problem, not a permanent scoreboard. When the current metric reaches its target, choose the next one.

Illustration: A product people don't return to has a retention problem, so early revenue is the wrong focus until users come back.
2

Good metrics pass four simple tests

A useful metric is comparative, across time periods or user groups; understandable, so people remember and discuss it; a ratio or rate rather than a raw count; and behavior-changing, meaning you would act differently if it moved. Run every number you report through those filters.

Illustration: 'Forty thousand total signups' fails all four. 'Signup-to-activation fell from 29% to 22% last month' passes, and tells you where to work.
3

Vanity metrics only ever go up

Cumulative totals such as all-time users, downloads or page views can never deliver bad news, which is why they are tempting under pressure. Experienced investors discount them, and relying on them lets you avoid the real diagnosis. Replace them with rates and trends, such as active users as a share of total, tracked over time.

Illustration: Two companies each report 100,000 total signups. One has monthly actives rising, the other falling. Only the rate metric shows the difference.
4

Move through the five stages in order

Empathy: confirm a real problem people will pay to solve. Stickiness: build something they return to. Virality: grow through users. Revenue: prove the economics work. Scale: grow a proven engine. Skipping stickiness and paying for growth into a product people abandon wastes money, because new users leave as fast as they arrive.

5

Your business model decides your metrics

The book covers several business models, including software as a service, e-commerce, marketplaces, media, user-generated content and mobile apps, each with different key numbers. Subscription businesses watch churn and retention; marketplaces watch how often listings actually transact; e-commerce watches repeat purchases. Borrowing another model's metrics leads you to optimize the wrong thing.

6

Draw the line before the experiment

Decide in advance what result counts as success, and write it down. People are skilled at rationalizing whatever number comes back, and an experiment with no threshold always seems to have kind of worked. A pre-set target turns a debate into a decision and saves weeks of defending a weak result.

Illustration: Commit to a 5% conversion threshold before testing a pricing page; a 3.1% result then means change it, not 'promising'.
7

Segment and cohort every metric you track

Split each metric by when customers joined, who they are and where they came from. A flat average can hide steady improvement in newer cohorts, or one strong segment carrying several weak ones. A cohort chart showing improvement is persuasive evidence for investors, and the habit protects you from misleading yourself.

The framework

The five stages of Lean Analytics

01

Empathy

Find a real problem people will pay to solve.

02

Stickiness

Build something people come back to; retention before growth.

03

Virality

Grow through users bringing in other users.

04

Revenue

Show customer value exceeds acquisition cost, repeatably.

05

Scale

Invest to grow a proven engine and expand into new markets.

Apply it this week

Three moves to make now

  1. Name the single metric that matters for your current stage, record its current value and set the threshold that means you are ready to move on.
  2. Rebuild your retention or conversion figures by monthly cohort to see whether newer customers behave better than older ones.
  3. Check every number in your pitch deck against the four tests and convert or remove any cumulative total.

Read next

Pairs well with

This page is an original summary and commentary prepared by XRAYCLOUD.AI with AI assistance. It is not affiliated with or endorsed by the author or publisher, and it is no substitute for the book — read it for the full argument.