post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Successful product management in companies where it’s least understood

Measuring critical user journeys – Javier Andrés Bargas-Avila (UX Director, Google)

A new way to look at applied experiments

Product survey findings: Only 15% of users are embracing AI features 

Building high-performing product teams: The PDLC approach

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Overcoming the 20% feature usage challenge

Product Management

Three product leaders to learn from at #mtpcon inside Pendomonium

Andriy Zapisotskyi is a  Growth Marketing Lead at Mailtrap. He has 5+ years of experience in the field of marketing &amp; product. Mentor &amp; product marketing consultant. Andriy loves to network with people &amp; running is his hobby.

Andriy Zapisotskyi

Anna Dzehilevich is a Lead Product Manager at Jooble. Has 5+ year of experience in product field. Mentor and consultant for early-stage start ups and product managers.

Anna Dzehilevich

The term &#8220;<a href="https://www.mindtheproduct.com/a-product-managers-guide-to-customer-development/" target="_blank" rel="noopener">customer development</a>&#8221; is gaining more and more popularity, attracting not only startups that create digital products but also offline businesses owners. Everyone who works with products is advised to communicate with customers and ask them the right product questions. However, “CustDev” is not only about conducting interviews. In the first part of this series, we looked at the most effective channels to gain customer feedback from. In this part, we&#8217;ll be delving into the best ways to summarize and process it.
<h2>How to analyze the received feedback?</h2>
All the feedback you get needs to be analyzed. It becomes valuable when it can be used to make decisions and act on them. Thus, we have prepared a framework for documenting, evaluating, and prioritizing feedback.
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/01/9f6a57f3-6e71-4575-b543-26c45b777ff1_Untitled.jpg" alt="" width="1600" height="843" /><figcaption class="wp-caption-text">Framework for processing and prioritizing feedback</figcaption></figure>
This method allows you to gather feedback in one place, find patterns, segment, and build a good foundation for further action. Usually, after the analysis, we set priorities that we can take for additional validation, research, develop solution hypotheses or immediately take into development (for example, some apparent problems with usability).
Feel free to <a href="https://docs.google.com/spreadsheets/d/1vod0jZI5qOAvJjVNtJnO8W2nWl77IgjtL6w3oQrYKbk/edit#gid=0" target="_blank" rel="noopener">check a template of the framework</a> and a brief description of how to complete it. The framework can be copied and adapted to your needs. You can collect aggregate feedback in such a table or break it down into separate tabs by channel. It&#8217;s all up to you.
<h2>Customer development in Jooble</h2>
At Jooble, we take it seriously when it comes to collecting customer feedback, both for the product as a whole and for particular solutions. We built up our process and use the <a href="https://niftypm.com/blog/what-is-scrumban/">Scrumban</a> methodology to drive customer-centric decisions inside the product. Having user research and analytical teams in the product structure helps us analyze customer feedback and behavior by balancing between qualitative and quantitative data. Thus is crucial for each stage of the <a href="https://www.mindtheproduct.com/what-channels-to-use-to-gain-customer-feedback-part-1-of-2/" target="_blank" rel="noopener">product development lifecycle</a> and allows us to have better decisions.
Have a read of <a href="https://www.mindtheproduct.com/product-development-strategy-setup-your-product-for-success/" target="_blank" rel="noopener">Product development strategy: setup your product for success</a>
At all stages of feature development or other tasks and initiatives, we interact in one way or another to obtain qualitative and quantitative feedback. We use different methods for both B2C and B2B. We often spend a lot of time analyzing behavioral and product analytics, conducting A/B testing, user tests,<a href="https://www.mindtheproduct.com/tag/customer-feedback/" target="_blank" rel="noopener"> customer feedback surveys</a>, looking at users in Hotjar, and collecting feedback from support and sales teams.
A few more words on the support and sales team’s feedback. For some reason, this channel is leveled most often. Our process is quite simple. Support teams put &#8220;tags&#8221; – a short description of the dialogue in a few words (for example, a bug: the feedback page does not work, a <a href="https://www.mindtheproduct.com/creating-a-feature-request-process-for-b2b-product-and-customer-success-teams/" target="_blank" rel="noopener">request for a feature</a>: I want to save the phone number). These tags are then used to generate reports for product teams, which we analyze and make decisions based on the number and criticality of the request. Sometimes we can go into more detail, read conversations that indicate problems or product capabilities. The situation is similar with the B2B side of the product with the sales and account teams. In the process of analyzing feedback, we prioritize and identify what we will take into further work.
&#8220;We have a separate Slack channel where teams share important requests, suggestions from their side, and reports. There are also periodic calls to discuss existing issues and set priorities.” Anna Dzegilevich, Jooble
In addition to in-depth interviews, we also conduct moderated and non-moderated user tests. The latter helps us understand whether the functionality we make solves the user problem and makes a user-friendly, clear, and simple interface. We conduct moderated tests online or offline in the form of an interview if it is more complex product functionality. If these are minor changes, but we want to understand the reaction and user behavior, we do unmoderated user tests using Figma (Prototype), Maze, or Hotjar.
<h2>Customer development in Mailtrap</h2>
Customer development plays an essential part in Mailtrap&#8217;s development and growth. We even have a separate team regularly engaged in customer development activities. We use many channels to receive and process feedback: user interviews, A/B tests, heat maps, support tickets, information written about us in the media, forums and blogs, behavioral analytics, and more. Of course, each of the methods has its own intensity. We look at user analytics every day, support tickets – several times a week, while mentions on blogs can be checked every six months.
&#8220;We look at user analytics every day, support tickets – several times a week while mentions on blogs – every six months.&#8221; Andriy Zapisotskyi, Mailtrap
We usually conduct interviews in pairs, with one having a conversation and the other taking notes on all the key insights. Moreover, we create a separate Coda document for each interview session. It usually contains basic questions and information about the user. 15-20 minutes of preparation allows you to feel more confident in talking to the user.
We summarize the interview results in a single table, which allows us to see the patterns better, and what to look for in the first place. Thanks to such interview series, we validated the hypothesis, the problem, and the actual need for functionality, which the technical team has been working on for the last year already. We plan to launch a beta version soon and test the new functionality on users too.
What’s interesting, we interview customers for advertising campaigns as well. Frequent conversations give us a deeper understanding of what our customers were looking for to solve their problem, what they paid attention to when registering or buying a Mailtrap subscription. Obtained insights are then used in advertising, while product loyalty is measured through the NPS score.
We also have a <a href="https://www.mindtheproduct.com/fundamentals-building-better-data-products/" target="_blank" rel="noopener">feedback loop</a> set up at the stage when the user wants to cancel the paid subscription. In the interface, we collect information about the reasons, and once the client unsubscribes, we send a plain email for additional context, asking to specify the reason for unsubscription. If the user gives an extended answer, we continue the conversation through emails or give the opportunity to arrange a call, where we discuss the decision in more detail. After the call, we usually provide our customers with a one-month free subscription as a small reward for their time.
<a href="https://www.mindtheproduct.com/how-the-growing-importance-of-customer-retention-is-changing-product-management/" target="_blank" rel="noopener">Read how the growing importance of customer retention is changing product management.</a>
<figure style="width: 1600px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="//wp-content/uploads/2022/01/7ba3f4ec-6a21-4679-a785-741cfb4116be_Untitled.jpg" alt="" width="1600" height="803" /><figcaption class="wp-caption-text">Mailtrap account deletion interface</figcaption></figure>
In addition, we have now launched more campaigns to collect feedback after registering with Mailtrap. It is important for us to learn about customer expectations, their motivation to use our service and how they learned about Mailtrap.
<h2>In conclusion</h2>
Summarizing, receiving, and processing feedback for a product is one of the most critical factors in its development at various stages – from hypothesis to the launch of new functionality. Regardless of the niche, domain, or product type, this is something worth spending your time and attention on.
Setting up feedback channels for customer development activities will take time, but the result is worth the effort. This helps make the product valuable to users, achieve the company&#8217;s goals, and help save time and money on product development.
Read <a href="https://www.mindtheproduct.com/what-channels-to-use-to-gain-customer-feedback-part-1-of-2/" target="_blank" rel="noopener">The most effective channels to gain customer feedback: Part one</a> and discover more content on <a href="https://www.mindtheproduct.com/tag/customer-research/" target="_blank" rel="noopener">Customer Research</a>.
<div class="g g-21"><div class="g-single a-170"><a class="gofollow" data-track="MTcwLDIxLDEsNjA=" href="https://www.pendo.io/pendomonium/"><img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/06/MTP-Footer_ad.png" /></a></div></div>

The most effective channels to gain customer feedback: Part 2

Andriy Zapisotskyi

Anna Dzehilevich

Comments

Read next