post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Why setting short-term goals can be problematic for high-tech companies

Product Management

Sunday Rewind: Video: Hardware vs software product management

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why is hiring product managers so hard?

What burnout taught me: Lessons from product managers

Meet the new AI CEO: Klarna’s bold customer feedback loop bet

What I learned from building products in Africa

What does it take to build world class products today? Ezinne & Oji Udezue (Co-Authors at ProductMind, ex-CPOs of Calendly, Typeform & WP Engine)

Paula Stürmer has 8+ years of experience in product management working with SAAS B2B products, helping companies scale their businesses and launching new products from the ground up.

Paula Stürmer

<p><em>Senior Product Manager, <a href="https://www.linkedin.com/in/paulasturmer/" target="_blank" rel="noopener">Paula Stürmer</a>, shares her thoughts on product managers who tend to regularly use NPS as a metric in their B2B practices.</em></p>
<hr />
<p>Net Promoter Score (NPS) is a metric used to measure clients&#8217; loyalty and consists of a single question &#8220;How likely is it that you would recommend this company to a friend or colleague?&#8221;. Fred Reichheld introduced it in 2003, and even today, 20 years later, NPS is a widely used measure of customer satisfaction. But the simplicity of the survey that made it gain popularity has its pitfalls, especially in B2B products:</p>
<h2>1. It&#8217;s a snapshot of the moment</h2>
<p>After hosting an annual event for our clients, we sent out the quarterly NPS survey and received the highest score ever. While we took the survey seriously and worked hard on the feedback, it was unlikely that our efforts could have significantly improved all of our product portfolios in just one quarter. On the other hand, another team experienced a sharp decline in their NPS score after two quarters due to a major cloud provider&#8217;s instability which has never happened before. In both cases, it became clear that NPS only provided a snapshot of the moment and did not paint a comprehensive picture. The challenge was determining what actions to take to improve (or maintain) the scores influenced by such rare events.</p>
<h2>2. It&#8217;s not clear what is the problem</h2>
<p>Once, I received a detractor score from a customer who had interacted with multiple products and services we offer. It was difficult to pinpoint the root cause of their dissatisfaction: Was it due to issues in product A or B? Did they have concerns about the quality of service provided by our support team? Or were they unhappy about our yearly cost increase? Relying solely on a score and a vague comment wouldn&#8217;t give us meaningful insights. We had to engage with the client to fully understand their concerns and the underlying issues behind the detractor score.</p>
<h2>3. High time lag in feedback and action</h2>
<p>A major challenge with NPS surveys is the time lag between receiving feedback and taking action. NPS surveys are usually conducted at regular intervals, such as quarterly or annually, which means that by the time the feedback is received, a significant amount of time has passed. This delay can lead to missed opportunities to address issues promptly and prevent further damage to customer relationships. Additionally, it can be difficult to trace the root cause of problems when there is a time gap between the feedback and the occurrence of the issue.</p>
<h2>4. An excellent score doesn&#8217;t mean much</h2>
<p>We were once caught off guard by a client who consistently gave us promoters&#8217; scores, only to cancel their contract shortly after. When we inquired about the sudden churn, they explained that their company had been acquired and would be standardizing all software to match the parent company&#8217;s system. Another pitfall of high scores is getting in the comfort zone compared to the competitors. When you have several high grades and the client is happy with your service, what should you do with it? You can easily fall into the trap of continuing to do the same things. But your competitors are evolving and finding others ways to improve their products and services. You have to be cautious and continuously identify areas of improvement, even if your clients cannot pinpoint them.</p>
<h2>5. The non-responders bias</h2>
<p>Neglecting the number of non-responders is a common mistake in measuring NPS that can result in a misleading score. A decrease in the number of respondents from the previous survey can create a false impression of improvement in the score. An Account Executive once asked a client to respond to an NPS survey, but the client declined, citing that they had the same concerns as the previous survey and everything had stayed the same. In this case, the client would have been classified as &#8220;Passive&#8221; in the NPS methodology, but it was clear that they were a detractor. Especially in B2B, customers with a high probability to churn are less likely to respond to the survey.</p>
<h2>6. Benchmarks are not very helpful</h2>
<p>If it&#8217;s hard to use your competitors&#8217; software in the B2B market, imagine getting their NPS score. Even if you get benchmarks that segment by industry, factors such as company size, customer demographics and geographic region can affect NPS scores. It&#8217;s already challenging to compare NPS with different products in the same company because of those nuances. It gets even harder doing it across the industry when you don&#8217;t know how the survey was applied. There is no one-size-fits-all benchmark, even for B2C.</p>
<h2>7. Pay attention to the averages</h2>
<p>B2B companies often have a smaller customer base than B2C companies. That directly impacts the sample size used to calculate the NPS score, which makes it challenging to obtain a reliable score. The opinion of a few customers or a significant change in the number of respondents can significantly impact the overall score. Another problem with relying on averages in a B2B context is that they often assign equal weight to all responses, regardless of their relevance or significance. There are often multiple stakeholders who have varying needs and expectations. While it&#8217;s essential to gather feedback from all, they shouldn&#8217;t have the same weight. Positive feedback from stakeholders with little influence over contract renewals is relevant and has to carry on, but it&#8217;s not as critical as the sponsor&#8217;s answer.</p>
<h2>8. It&#8217;s not that honest</h2>
<p>In B2B, the person is answering the survey on behalf of his company, and it&#8217;s hardly anonymous, like in B2C. This particular scenario doesn&#8217;t generate a safe space for a sincere answer, especially when the respondent is concerned that his response will affect the work of their Account Executive. That&#8217;s why you can see promoters&#8217; scores sometimes, but with implicit problems written in the comments.</p>
<h2>9. The customer life cycle can skew results</h2>
<p>NPS scores can be skewed based on the customer life cycle. If a client is in the discovery or adoption stage, they may enjoy the experience but still need to see the product&#8217;s value or promise fully. Once a new client answered our survey with a 6 score, followed by a long paragraph explaining his reasons: he was overall satisfied with the product, but it was too soon to be sure he would recommend it to family and friends. That was a fair point. Asking for recommendations at this stage may not accurately reflect their satisfaction level. It&#8217;s important to consider where customers are in their journey before interpreting NPS scores.</p>
<p>While NPS is still a widely used measure of customer satisfaction, it has some pitfalls in B2B products. Despite this, NPS can still be a helpful metric if used cautiously and with an understanding of its limitations. It&#8217;s essential to engage with clients to understand their concerns fully and use NPS in conjunction with other measures to obtain a comprehensive picture of customer satisfaction.</p>
<h3>Discover more great content on product metrics</h3>
<ul>
<li><a href="https://www.mindtheproduct.com/metrics-kpis-every-saas-product-manager/" target="_blank" rel="noopener">Metrics and KPIs every SaaS product manager should track</a></li>
<li><a href="https://www.mindtheproduct.com/metrics-that-matter-live-panel/" target="_blank" rel="noopener">MTP panel: How to define the metrics that matter</a></li>
<li><a href="https://www.pendo.io/product-led/8-kpis-that-every-product-team-should-measure/?&amp;utm_source=mtp&amp;utm_medium=display&amp;utm_campaign=mtp-kpis-fy23-q3" target="_blank" rel="noopener">8 KPIs that every product team should measure</a></li>
</ul>


The 9 ugliest truths about NPS in B2B

Paula Stürmer

Read more