27 days until #mtpcon London, the world’s best product conference
Book now
SUNDAY REWIND: Data-driven blunders and how to avoid them "Product people - Product managers, product designers, UX designers, UX researchers, Business analysts, developers, makers & entrepreneurs 27 July 2023 False Data driven products, Product Management, Sunday Rewind, Mind the Product Mind the Product Ltd 236 Product Management 0.944
· 1 minute read

SUNDAY REWIND: Data-driven blunders and how to avoid them

In this week’s Sunday Rewind, Jorge Rodriguez-Ramos examines the consequences when we expect data to be the “secret sauce” that will immediately improve all aspects of our product

Jorge Rodriguez-Ramos looks at those categories most likely to lead to data-driven blunders, and how to avoid them.

Broadly, these categories are: improper testing, too much data too often, and picking the wrong North Star metric.

Improper testing

With testing, says Jorge, keep it simple and test one variable at a time. You will have to run multiple tests or create more than two variables, which might feel like a waste of valuable time, but compared to getting consistently unactionable results or worse, false positives, you’ll be happy you put in the extra effort.

Too much data, too often

Once you have the data, only check it when you might learn something from it, and check it at the level of granularity that makes the most sense, often weekly (if not even monthly) to prevent daily fluctuations from throwing you off. Very few metrics will be consistent on a daily basis, says Jorge,  and paying attention to background noise fluctuations will only be a waste of effort.

The wrong North Star metric

There’s no perfect North Star metric: Any single metric will be unable to grasp all the ins and outs of even the most simple of businesses. But there are better and worse North Star metrics. To start, the metric should be somehow paired with the value you bring to your customers.

Read the original post: Data-driven blunders and how to avoid them

Comments 0

Join the community

Sign up for free to share your thoughts

About the author

Jorge Rodriguez-Ramos looks at those categories most likely to lead to data-driven blunders, and how to avoid them. Broadly, these categories are: improper testing, too much data too often, and picking the wrong North Star metric.

Improper testing

With testing, says Jorge, keep it simple and test one variable at a time. You will have to run multiple tests or create more than two variables, which might feel like a waste of valuable time, but compared to getting consistently unactionable results or worse, false positives, you’ll be happy you put in the extra effort.

Too much data, too often

Once you have the data, only check it when you might learn something from it, and check it at the level of granularity that makes the most sense, often weekly (if not even monthly) to prevent daily fluctuations from throwing you off. Very few metrics will be consistent on a daily basis, says Jorge,  and paying attention to background noise fluctuations will only be a waste of effort.

The wrong North Star metric

There’s no perfect North Star metric: Any single metric will be unable to grasp all the ins and outs of even the most simple of businesses. But there are better and worse North Star metrics. To start, the metric should be somehow paired with the value you bring to your customers. Read the original post: Data-driven blunders and how to avoid them

#mtpcon LONDON | 20 OCT 2023

Join world-class product experts for a jam-packed day of inspiring talks and interactive sessions

Book now