The Metrics Trap: Are You Measuring the Wrong Things?

The Metrics Trap: Are You Measuring the Wrong Things?

49:34 Feb 27, 2025
About this episode
This week, we’re tackling a biggie—how to avoid the pitfalls of metrics. We’ll explore why tracking the wrong numbers can send your entire organization in the wrong direction and what you should be focusing on instead.We also have a fantastic Figma plugin to make your mockups more realistic, a thought-provoking read on AI’s impact on UX, and a listener question on handling the ever-growing number of software subscriptions. Oh, and of course, Marcus has a joke. But don’t get your hopes up.App of the Week: Quick FillThis week, I came across Quick Fill, a Figma plugin that helps you populate your designs with realistic-looking data. We’ve all been there—presenting a mockup to stakeholders, only to have them fixate on the fact that every name and profile picture is identical. Quick Fill solves that by auto-generating realistic text, names, addresses, and other useful content to make your designs feel more natural.Not only does this improve stakeholder buy-in, but it also helps you spot design issues early on. Ever built a UI that looks perfect until you enter a name like “Marcus Brian John Lillington” and suddenly everything breaks? This plugin helps catch those issues before they reach development. Highly recommend giving it a go.Topic of the Week: The Metrics TrapMetrics can be an incredibly powerful tool—but only if you track the right things. Too often, businesses latch onto the easiest numbers to measure rather than the ones that truly reflect success. And that’s where things start to go wrong.The Dangers of Poor MetricsA classic mistake is tracking surface-level engagement over meaningful outcomes. For example, an insurance company might focus on the number of quotes they generate rather than the number of actual policies sold. I’ve worked with companies who obsess over lead generation, but when you dig deeper, half of those “leads” never convert into paying customers. If you optimize for the wrong metric, you optimize for the wrong behavior.Then there’s the McNamara Fallacy, which essentially states that we measure what’s easy rather than what’s important. It’s easy to track the number of form submissions. It’s harder to track customer satisfaction, lifetime value, or the real impact of UX improvements. But those harder-to-measure metrics are the ones that truly matter.Short-Term Thinking vs. Long-Term SuccessAnother issue is the obsession with short-term metrics. Quarterly targets and monthly reports drive short-term decision-making, often at the expense of long-term strategy. A UX redesign might cause a temporary dip in conversions as users adjust, but if you panic and roll everything back immediately, you’ll never see the long-term benefits.
Select an episode
0:00 0:00