What the measurement said
The baseline confirmed onboarding as loud (2.2 behaviour, 2.4 perception) and, because the fix was already scheduled, spent no research budget confirming it further. The real finding sat next door: activation read 2.1 behaviour against 3.8 perception. New subscribers believed they were “using” the product, but cohort data showed 60% never configured a single topic or newsletter, landed on a generic homepage each visit, and stalled out of the habit loop within three weeks. Silently.
The loud surface came pre-diagnosed and pre-funded. The silent one next to it carried more modelled churn than all the onboarding complaints combined.
The four surfaces at baseline
| Surface | Behaviour | Perception | Quadrant |
|---|---|---|---|
| Task | 2.2 | 2.4 | Loud |
| Commitment | 2.1 | 3.8 | Silent |
| Access | 3.0 | 3.1 | Watch |
| Belief | 3.3 | 3.4 | Watch |
The treatment
The scheduled onboarding fix shipped as planned: fewer steps, payment friction removed. Separately, first-session value was pulled forward: the first visit now builds a reader profile from three taps, and the homepage leads with it from visit two. Depth-of-use instrumentation shipped in week one, before any treatment, so the effect would be measurable, which is also what lifted confidence from 0.68 to 0.83.
What did not work
The email sequence
A re-engagement sequence aimed at stalled subscribers, the marketing-side fix for the same leak, was tested against the product-side fix and did nothing durable. Opens were fine, return visits spiked for a day, week-three retention was unchanged. The stall was a product state, not an attention problem, and no email fixes a homepage that shows every reader the same thing. The sequence was retired.
- 40% → 61%
- New cohorts reaching the activation event
- +4pts
- Week-three retention
- 0.68 → 0.83
- Confidence, from instrumenting depth of use
Composite, ten weeks apart
Onboarding, post-rebuild, moved to watch: behaviour improved, perception still lagging, as expected for a surface users complained about for a year. The memory of friction outlives the friction.
Still open
Onboarding perception remains below its behaviour and is scheduled for a rescore next quarter, on the record rather than in a footnote.