post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Successful product management in companies where it’s least understood

Measuring critical user journeys – Javier Andrés Bargas-Avila (UX Director, Google)

A new way to look at applied experiments

Product survey findings: Only 15% of users are embracing AI features 

Building high-performing product teams: The PDLC approach

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Overcoming the 20% feature usage challenge

Product Management

Three product leaders to learn from at #mtpcon inside Pendomonium

Sebastian Straube started his career as a consultant focusing on digital transformation and digital strategy. Then he was eager to actually execute the strategies and build real products. Thus, Sebastian became a product manager developing mainly eCommerce applications and innovative mobile apps. Building on that experience, Sebastian wanted to bring his passion for product development to other teams. Now he is a product management & discovery coach at Accenture Business Agility and helps clients build empowered product teams that develop extraordinary products. His focus lies on product visioning, product strategy, and product discovery.

Sebastian Straube

“What gets measured gets managed — even when it’s pointless to measure and manage it, and even if it harms the purpose of the organisation to do so.” 
<a href="https://www.jstor.org/stable/2390989?seq=1" target="_blank" rel="noopener">(V. F. Ridgway 1956)</a>
Ridgway clearly was onto something in 1956. Not everything that matters can be measured. Not everything that we can measure matters.
This article focuses on measuring the right things in order to build successful products. Throughout the piece, I&#8217;ll discuss different types of metrics and provide an actionable framework that can be used by Product Managers to measure the path from the customer problem to reaching the product vision. I&#8217;ll also provide actionable insights into how the execution of the product strategy is performing. It is important to focus on the most relevant metrics in order to be efficient and not get lost in overwhelming data.
First, we examine different types of metrics. <a href="https://assets.productplan.com/content/Product-Success-Metrics-by-ProductPlan.pdf?utm_campaign=Leads%20%7C%20Asset%20%7C%20Product%20Success%20Metrics&amp;utm_medium=email&amp;_hsmi=93893101&amp;_hsenc=p2ANqtz-_CmKEU6jUAQCFzJk2Sf67dtTOjgEqXV2GmPywOOMtNFlMF1RqZozqmORr5l7HoLoSTQ2rSU8-rcQ2JDOit5zSKe51Q1A&amp;utm_content=93893101&amp;utm_source=hs_automation" target="_blank" rel="noopener">ProductPlan</a> defines three tiers of product success metrics, from least to most actionable metrics:
Tier 3: Vanity metrics: These are the vanity metrics that can boost a product team’s ego (e.g. number of views of a promotional banner). Be careful with those and do not put too much emphasis on those ones.
Tier 2: Proxy metrics: These are proxy metrics that can suggest something about your product’s potential success (e.g. number of prospects who take action showing interest in your product, such as downloading a document about it). But because they do not themselves represent direct evidence of how your product will resonate with users, you need to be careful about these metrics.
Tier 1: Business and customer-oriented metrics: These are the business and customer-oriented metrics you should focus on. They capture concrete data about revenue, customer retention, acquisition, the size of your user base, etc.
<h2>What is a North Star Metric?</h2>
The North Star metric should provide evidence of a clear and direct relationship between your product’s problem and the degree to which it is solving it for your target market.
It is the single metric your team or company decides will be the one that best represents how well your product is performing in the market.
A north star metric has usually the following <a href="https://amplitude.com/north-star" target="_blank" rel="noopener">characteristics</a>:
<ul>
<li>Expresses value</li>
<li>Represents vision &amp; strategy</li>
<li>A leading indicator</li>
<li>Actionable</li>
<li>Quantifiable</li>
</ul>
Usually, the north star metric is measured by certain leading indicators which might be tier 2 and tier 3 metrics. <a href="https://www.mindtheproduct.com/north-star-maahir-shah-the-product-experience/" target="_blank" rel="noopener">Listen to this podcast to find out when to not use the North Star metric. </a>
<h2>The North Star framework</h2>
So how do I actually define the right north star metric? You have to focus on the customer problem you want to solve and the product vision, so to say the envisioned solution for the customer problem. The product strategy describes the path to reach the product vision. The north star metric measures the degree to which the customer’s problem is solved by your product. This metric is the core metric showing your progress on how successful your product performs.
Your north star metric must be derived from a true understanding of what action provides realized value to the customer. This means that “Daily Active Users” or “Registered Users” are not good metrics as they belong to the tier 3 metrics (vanity metrics). They do not give you any meaningful information about what your customers value about your product. When product teams fail to establish a direct connection between customer value and the north star metric, they risk leading their business along the wrong alley.
<a href="https://www.mindtheproduct.com/metrics-that-matter-live-panel/" target="_blank" rel="noopener">Watch this MTP Panel on defining what metrics matter. </a>
The north star metric is usually measured as a multiplication of several leading indicators, most times a combination of reach, engagement and frequency:
Reach: Number of relevant users
Engagement: A certain action
Frequency: Number of repetitions of the action taken
<figure style="width: 1200px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/04/b096ad99-5984-4078-b913-6561afc8e722_Untitled.png" alt="North Star Framework" width="1200" height="728" /><figcaption class="wp-caption-text">North Star Framework</figcaption></figure>
<h2>The North Star framework applied to Netflix</h2>
Let’s have a look at what the North Star Framework could look like for Netflix. The product vision of Netflix might be something like: “Entertain the world”. The product strategy might be summarized and simplified as: “Netflix is a movie subscription service that delivers fast, easy entertainment in a friendly, straightforward way.”
So how can I measure if Netflix is “entertaining the world”? One possible north star metric might be to focus on how much users engage with the product, the streaming service. So the north star metric can be “Time spent watching streaming content”. This metric measures the customer value and is aligned with the product strategy.
The north star metric example could be measured by:
&lt; “The number of users”&gt; x &lt;”hours watched per session”&gt; x &lt;”sessions per week&gt;”
With this north star metric in mind and some leading indicators defined I can start to run different experiments. For instance, I could run an A/B test with different personalized TV show recommendation algorithms to examine if the one algorithm increases &lt;”sessions per week&gt;”. If there is a positive significant effect it directly influences the north star metric. Thus, this framework provides actionable insights to test hypotheses by experimenting and focussing on the most relevant metrics.
<figure style="width: 1200px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/04/bc6e92b8-2c0d-4172-b15b-d97e36841706_Untitled.png" alt="Exemplary North Star Framework for Netflix" width="1200" height="739" /><figcaption class="wp-caption-text">Exemplary North Star Framework for Netflix</figcaption></figure>
<h2>What makes a good North Star Metric</h2>
<a href="https://blog.amplitude.com/product-north-star-metric" target="_blank" rel="noopener">Amplitude</a> states that a good north star has three attributes:
<ol>
<li>it measures the moment that a customer finds value from your product,</li>
<li>it represents the core of your current product strategy and</li>
<li>is a leading (not lagging) indicator of a future business outcome that your company cares about.</li>
</ol>
Here you can see some exemplary potential north star metrics for known products:
<figure style="width: 1400px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/04/98304b5d-be96-4598-85e4-90a110d51689_Untitled.png" alt="Exemplary North Star Metrics" width="1400" height="462" /><figcaption class="wp-caption-text">Exemplary North Star Metrics</figcaption></figure>
<h2>Wrapping up</h2>
To sum up, it is important to have a good product vision defined in order to build your specific North Star Framework. The north star metric needs to be selected in a way that it provides evidence of a clear and direct relationship between your product’s problem and the degree to which it is solving it for your target market, representing the core of your product strategy..
<h3>There&#8217;s more where that came from! Access more great content on KPIs</h3>
<ul>
<li><a href="https://www.pendo.io/product-led/8-kpis-that-every-product-team-should-measure/?&amp;utm_source=mtp&amp;utm_medium=display&amp;utm_campaign=mtp-top-kpis-q3" target="_blank" rel="noopener">8 KPIs that every product team should measure</a></li>
<li><a href="https://www.mindtheproduct.com/metrics-kpis-every-saas-product-manager/" target="_blank" rel="noopener">Metrics and KPIs every SaaS product manager should track</a></li>
<li><a href="https://www.mindtheproduct.com/essential-kpis-for-data-driven-product-managers/" target="_blank" rel="noopener">Essential KPIs for data-driven product managers 
</a></li>
</ul>

<div class="g g-21"><div class="g-single a-170"><a class="gofollow" data-track="MTcwLDIxLDEsNjA=" href="https://www.pendo.io/pendomonium/"><img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/06/MTP-Footer_ad.png" /></a></div></div>

Measuring the right North Star metric

Sebastian Straube

Comments

Read next