post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

Sunday Rewind: Video: Hardware vs software product management

Guest Post

How accessibility users drive better product development

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why is hiring product managers so hard?

What burnout taught me: Lessons from product managers

Meet the new AI CEO: Klarna’s bold customer feedback loop bet

What I learned from building products in Africa

What does it take to build world class products today? Ezinne & Oji Udezue (Co-Authors at ProductMind, ex-CPOs of Calendly, Typeform & WP Engine)

Eira is an editor for Mind the Product. She's been a business journalist, editor, and copywriter for longer than she cares to think about.

Eira Hayward

In this #mtpcon San Francisco 2023 keynote, <a href="https://www.linkedin.com/in/tomersharon" target="_blank" rel="noopener">Tomer Sharon,</a> Co-founder and CXO at workplace experience platform <a href="https://www.anywell.com/" target="_blank" rel="noopener">anywell</a>, talks about measuring the user experience and the advantages of high-level metrics. Watch the video in full of read on for his key points. 
<hr />
He starts by asking the audience to rate the conference so far and wonders what variables would affect their answers &#8211; the time, the temperature, their past experience might all come into play.
Tomer then tells a story from his time working on the Google Search team more than 10 years ago. The team loved looking at two metrics, long and short clicks. The team thought that long clicks &#8211; where a user clicked on a link and stayed there for a long time &#8211; were good, because the user had gone to the right place. They thought short clicks &#8211; where the user clicked back and forth through many links  &#8211; were bad. It was only when they watched users in a lab that they realised this wasn’t the case. “It was just that the internet was a mess and they couldn’t find what they were looking for,” Tomer says.
<h3>Experience metrics</h3>
Experience metrics are quantitative scores for important and actionable phenomena related to using products and services, Tomer says.
He splits a product launch into four stages of a cycle &#8211; someone has the idea, you build it, launch it and learn from it.
<ul>
<li>Tactical research happens from the time we learn something till we have an idea</li>
<li>Strategic research should happen all the time. It looks into motivations and needs</li>
<li>Metrics come into their own after product launch, when we want to learn</li>
</ul>
The biggest challenge that a team has is understanding the answer to the question “how are we doing?”, Tomer says. Dashboards aren’t clear, and there’s no clear answer to this question and so teams focus on detailed metrics rather than high-level metrics. “People strive to solve the problems that humans have but they’re not looking at the data that helps them to solve these problems,” he says.
<h3>Principles of high-level metrics</h3>
Tomer then talks about some of the principles of high-level metrics and overall versus specific metrics. “I’d argue that coming up with a number for an overall satisfaction score should not come from a question about the overall experience.It should come from a series of questions about the most important components which are then aggregated into one score.”
You should also focus on behaviour rather than opinion, because our opinions are very unstable. “Satisfaction is extremely biased and there are other, more telling, metrics that show the actual behaviour,” Tomer says.
Tomer moves on to the Google Heart framework of metrics (happiness, engagement, adoption, retention, task success), omitting the last metric of task success because it’s more relevant to tactical research. Happiness is opinion, he explains, but the other three metrics are behavioural.
One of the biggest advantages of high-level metrics is that you can very quickly understand what’s going on. They can be extremely useful in creating OKRs, Tomer says, and for understanding the effect of change.
<h3>Want to turn the learning from this talk into action?</h3>
Our exciting #mtpcon San Francisco 2023 <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Keynote Kit</a> brings you all of the insights from our San Francisco keynote talks plus additional helpful discussion points and thought starters so you can easily translate the insights into actions – perfect for making effective improvements to your role, team, and product. Plus, get an email notification when each talk is published! <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Sign up now</a>.

core/freeform

Product Management Conference

Why emotional connection drives successful products: Nesrine Changuel at #mtpcon London (Google, Spotify, Microsoft)

Product teams in flux – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Berlin’s leading companies – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Amsterdam’s leading companies – Pendomonium+#mtpcon roadshow: Amsterdam

Product teams in flux – Pendomonium+#mtpcon roadshow: London

AI in practice at London’s leading companies – Pendomonium+#mtpcon roadshow: London

What’s next for product management in 2024? Nichole Mace (SVP Product and User Experience, Pendo)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Perspectives from an unconventional CPO – Yuelin Li (CPO, Onfido)

The future of product management – Trisha Price (CPO, Pendo)

Measuring the user experience by Tomer Sharon

Product Management Foundations BST

Product Management Foundations ET

ProductTank Amsterdam

ProductTank Edinburgh

ProductTank Casablanca

ProductTank Des Moines

ProductTank Auckland

ProductTank Birmingham

ProductTank London

ProductTank Philadelphia

ProductTank Washington

ProductTank Reston

ProductTank Sydney

ProductTank Dubai

ProductTank Prague

ProductTank Reading

ProductTank Jacksonville

ProductTank Raleigh

ProductTank Rio de Janeiro

ProductTank Buenos Aires

ProductTank Atlanta

ProductTank Orlando

ProductTank Los Angeles

ProductTank Palo Alto

ProductTank Pune

ProductTank Bielefeld

ProductTank Köln

Communication & Alignment BST

Communication & Alignment ET

ProductTank Vilnius

ProductTank Paris

ProductTank Dallas

ProductTank Frankfurt

ProductTank Milton Keynes

ProductTank Tokyo

ProductTank Norwich

ProductTank Pittsburgh

ProductTank Hamburg

ProductTank Leeds

ProductTank Manchester

ProductTank Bristol

ProductTank Exeter

ProductTank Würzburg

ProductTank Columbus

ProductTank Malmö

ProductTank Chicago