post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Successful product management in companies where it’s least understood

Measuring critical user journeys – Javier Andrés Bargas-Avila (UX Director, Google)

A new way to look at applied experiments

Product survey findings: Only 15% of users are embracing AI features 

Building high-performing product teams: The PDLC approach

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Overcoming the 20% feature usage challenge

Product Management

Three product leaders to learn from at #mtpcon inside Pendomonium

As a passionate product person, Mareike works for the Amsterdam-based European scale-up ParkBee and their vision to give space back to cities by moving cars off the street and into underutilized urban space.

Mareike Leitermann

<p>Most product teams review goals in hindsight to see whether they have succeeded. But what if you could not just assess what you’ve already done but prioritize your actions along the way? To help do that with a strong focus on outcomes, Product Management coach and author Tim Herbig took ProductTank Amsterdam through a hands-on workshop. He provided context behind the idea of OKRs and surprised some of the other attendees with new thoughts on the matter.</p>
<p>The session was a mixture of both theory and practical exercises for the audience to directly try out the introduced concepts and get feedback from Tim and the community. Tim closed the workshop by discussing questions from the audience. Below is a summary of the workshop’s takeaways:</p>
<ul>
<li>There are no right or wrong key results</li>
<li>Adding the dimension of leading / lagging indicators</li>
<li>Most common (underestimated) mistakes</li>
<li>Using output-driven key results to establish a product discovery practice within the company</li>
</ul>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/03/36d2acbd-3133-462b-a4e6-6ebfb8977487_workshop.jpg" alt="" width="1600" height="941" /><figcaption class="wp-caption-text">ProductTank audience participating in a workshop exercise</figcaption></figure>
<h1>There are no right or wrong key results</h1>
<p>“Outcome over output” is a well-known claim in product management. Output OKRs (e.g. “feature x has been released”) are said to be rather shallow, not inspirational and are likely to block learning opportunities. However, there is nothing wrong with output OKRs per se for measuring success. The team should just be aware of the <span style="font-weight: bold;">consequences</span> when they settle on a specific type of key result. The key results should give a holistic picture of the objective, capturing the objective from as many perspectives and levels as possible. This will give more space to come up with the best solution(s), but also requires more confidence and skill from the team.</p>
<p>Based on the consequences of the key results, OKRs can be separated into three different types:</p>
<ul>
<li><span style="font-weight: bold;">Impact-ish OKRs</span>: a high-level expression of the <span style="font-weight: bold;">company’s</span> strategic priority expressed through a result/metric</li>
<li><span style="font-weight: bold;">Outcome-ish OKRs</span>: a change in human behaviour that creates an impact on <span style="font-weight: bold;">department</span> level. It can be validated through the “how might we” test.</li>
<li><span style="font-weight: bold;">Output-ish OKRs</span>: a completed activity that aims to create a change in behaviour and has an impact on <span style="font-weight: bold;">team</span> level</li>
</ul>
<h1>Adding the dimension of leading/lagging indicators</h1>
<p>Categorising your OKRs like this will likely not be enough for actually working with them on a day-to-day basis. A second layer should be pointing out the <span style="font-weight: bold;">likelihood/certainty</span> of the aimed change. This can be measured by a concept that has been around for a while:</p>
<ul>
<li>Leading indicators are more difficult to spot since they require insights from actual user behavior. They are responsive to team actions. They also most likely can be used to predict future success, trading a certain degree of certainty.</li>
<li>Lagging indicators: are easier to spot (e.g. user growth, revenue) but are often unresponsive and hard to change from a company perspective. Also, they are definitive results of the past.</li>
</ul>
<p>⚠️ Be conscious about the difference between causation and correlation here: the more leading the indicator is, the less certain you can be about the success of this action. “Outcomes over outputs” generally is a good idea—but not at all cost. It does not help you to pick an outcome indicator just for the sake of it when it leads to a metric of a lagging nature.</p>
<p>⚠️ The nature of the metric highly depends on the context of your company: how your business works, the business cadence, if this metric changes and how often</p>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/03/0f8878ce-1cd9-4b00-b204-7f0bf8ebabd0_pasted20image200.png" alt="" width="1600" height="900" /><figcaption class="wp-caption-text">Leading/ lagging indicators and outcome and output sequence and difference &#8211; example of team OKRs for a plugin marketplace</figcaption></figure>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/03/996b9f6b-f628-49a0-8384-dd05e61176d3_pasted20image200.png" alt="" width="1600" height="900" /><figcaption class="wp-caption-text">If you try to move from lagging to leading indicators, you can try and clarify the activities that have to take place to achieve this success metric (reverse customer journey mapping)</figcaption></figure>
<h2>Most common (underestimated) mistakes</h2>
<p>The most common and risky mistake when using these techniques is to ignore a lack of clarity:</p>
<ul>
<li>Lack of clarity on the inputs for your OKR definition: You need to have your vision, strategy, customer insights, and roadmap in place to be able to estimate your next contribution to your success. <span style="font-weight: bold;">The quality of your OKR inputs highly correlates with the quality of your OKR sets.</span></li>
<li>Lack of clarity of the goals of your OKRs: Do you want to measure performance, enable more focus, get the team more autonomy? This can have a huge impact on whether your OKR sets are output or outcome-driven.</li>
</ul>
<h2>Using output-driven key results to establish a product discovery practice within the company</h2>
<p>Output key results for Product Discovery are a bit controversial since they are easy to misuse, but can be helpful for teams that struggle with prioritizing discovery work and/or discussing its progress. Metrics like &#8220;number of winning prototypes&#8221; or &#8220;number of opt-ins to user testing&#8221; can help make Discovery become a more sustainable practice.</p>
<p>Besides regular (e.g. weekly, bi-weekly) OKR check-ins with the team, make sure to have regular (e.g. quarterly) OKRs retrospectives and make sure that there is a process or person responsible to circle back the learnings to the management team to (potentially) reflect on the way the company measures success altogether.</p>
<h2>In summary</h2>
<p>In order to be able to assess your OKRs continuously and successfully…</p>
<ul>
<li>Mind that there are no right or wrong OKRs, just different dimensions (with relating consequences) that you as a team should be aware of</li>
<li>Be aware of unclear aspects of your OKR inputs as well as the goals you want to achieve</li>
<li>Consider using output-driven OKRs as a helpful tool to establish a product discovery practice</li>
<li>Set up regular check-ins &#8211; on team and company level</li>
</ul>
<h2>Helpful resources written by Tim</h2>
<ul>
<li>Tim‘s article on how to measure the progress of OKRs using leading and lagging indicators:<a href="https://herbig.co/leading-lagging-indicators-okrs/"> </a><span style="text-decoration: underline;"><a href="https://herbig.co/leading-lagging-indicators-okrs/" target="_blank" rel="noopener">https://herbig.co/leading-lagging-indicators-okrs/</a></span> &#8211; also includes more information about reverse customer journey mapping</li>
<li>Tim‘s article on thinking beyond outcomes in OKRs:<a href="https://herbig.co/okrs-beyond-outcomes/"> </a><span style="text-decoration: underline;"><a href="https://herbig.co/okrs-beyond-outcomes/" target="_blank" rel="noopener">https://herbig.co/okrs-beyond-outcomes/</a></span> &#8211; helpful for teams that are still hesitating to start using &#8220;wrong&#8221; OKRs</li>
<li>And if you’re curious, here is <span style="text-decoration: underline;"><a href="https://drive.google.com/file/d/1EAeruV0XqOouj2KGJ5fuoU9Zr4SUoQ8h/view?usp=sharing" target="_blank" rel="noopener">the recording of the workshop with all the details.</a></span></li>
</ul>
<div></div>
<div class="g g-21"><div class="g-single a-170"><a class="gofollow" data-track="MTcwLDIxLDEsNjA=" href="https://www.pendo.io/pendomonium/"><img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/06/MTP-Footer_ad.png" /></a></div></div>

How product teams can measure progress through outcome OKRs

Mareike Leitermann

Comments

Read next