post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Successful product management in companies where it’s least understood

Measuring critical user journeys – Javier Andrés Bargas-Avila (UX Director, Google)

A new way to look at applied experiments

Product survey findings: Only 15% of users are embracing AI features 

Building high-performing product teams: The PDLC approach

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Overcoming the 20% feature usage challenge

Product Management

Three product leaders to learn from at #mtpcon inside Pendomonium

Rosemary is an experienced product manager who has specialized in software development, agile enablement and lean methodologies for the past seven years. She has worked across diverse domains including government, finance, retail and enterprise. After starting her tech career in the New York City start-up scene, she moved into consulting and has spent time with ThoughtWorks and Pivotal Labs London. She has done freelance consulting and training with incubator programs like start-up bootcamp, done UX research on four continents and likes cold water surfing.

Rosemary King

<p>The <a href="https://www.mindtheproduct.com/product-management-training/">Mind the Product Training curriculum</a> is written in collaboration with dozens of expert product managers from countries and companies around the world. One the most consistent and frequent lessons that we teach in different workshops is “test early, test often”, also known as lean methodologies.</p>
<p>Two years ago, when I started as Director of Training Products, I knew that we wanted to create the world’s most comprehensive library of training topics for the product development lifecycle and all the skills therein, for product managers. It’s a Herculean task &#8211; which I began alone &#8211; and I began learning straight from the start.</p>
<p>In January 2018, we moved forward to create our third full-day workshop on the much-anticipated topic of Metrics and Analytics. However, because of the size and complexity of this topic, I rather lost the plot on the creation process. We ended up writing and then completely trashing two entire versions of the full-day workshop.  This was wasteful, maddening, and completely avoidable. Luckily, we kept learning, and kept iterating, and in October 2018, rolled out our full-day workshop, titled <span style="font-style: italic;">A Product Mindset on Metrics</span>, which received extremely positive feedback from a group of product managers at our London conference.</p>
<p><img loading="lazy" decoding="async" class="alignnone wp-image-14262" src="//wp-content/uploads/2018/11/rosemary-training-300x200.jpg" alt="" width="677" height="451" srcset="/wp-content/uploads/2018/11/rosemary-training-300x200.jpg 300w, /wp-content/uploads/2018/11/rosemary-training-768x512.jpg 768w, /wp-content/uploads/2018/11/rosemary-training-1024x683.jpg 1024w, /wp-content/uploads/2018/11/rosemary-training.jpg 2048w" sizes="(max-width: 677px) 100vw, 677px" /></p>
<p>I’d like to reflect on the lessons we’ve learned over the past year, in the hope that these will help other product managers to identify and rejig their experimentation process.</p>
<h3>The Process Stays the Same, no Matter What you Create</h3>
<ul>
<li>I initially lost the plot creating the Metrics workshop because I was thinking of it as something different from software, but it is still a product. It still solves a customer’s problem, it is still experienced, and its value proposition still needs to be clear. One of the most surprising things I discovered when I moved into service design is just how universal the product process is.</li>
</ul>
<h3>Start With Your Customer and Their Current Reality</h3>
<ul>
<li>We were making decisions about which new content to focus on based on customer requests and feedback, which is a good first step. However, I neglected to do a round of in-depth research about what product managers’ experience is with specific skills and how they learn them. If we had conducted that research upfront we could have saved ourselves a lot of time and tears.</li>
</ul>
<h3>Slice up the Product Into Testable Chunks</h3>
<ul>
<li>On two occasions I waited until the majority of the full-day workshop was in place before showing it to people. I didn’t have to. I could have done smaller review sessions with two or three product managers and got enough information to know if a specific module made sense and created value. It’s a fallacy to think that the whole experience has to be in place before you reveal it. Find your perforated edges and get your feedback.</li>
</ul>
<h3>Don’t be Afraid to say “This Isn’t Working”</h3>
<ul>
<li>Chucking out two versions of the workshop was not an easy choice, but carrying on blindly with content that I ultimately knew wasn’t fixable would have been worse. It’s a product manager’s job to report truth to power and to stand up for quality work. I took responsibility for not getting the research in place that would have helped us to course-correct sooner.</li>
</ul>
<h3>Fix the Process</h3>
<ul>
<li>While it came late in the game, we finally lined up the information we needed to write the workshop our audience needed. We had the courage to say “not good enough” and go back to the drawing board with the data and perspective we needed to do it right. You can also bet your boots that I will never embark on a writing project, large or small, without following the process that we developed through our mistakes.</li>
</ul>
<p>While some people might give us side-eye for our admission that writing Metrics was tough, I think it’s beneficial to the community to admit when stuff is hard. It’s difficult to remember that we are not the user, it’s difficult to remember not to just go heads-down on something, it’s difficult to show ideas we are unsure of to critical audiences. At the end of the day, if we do not do these things, our customer’s suffer and we suffer. Mind the Product has believed for eight years that talking about the messy side of things is how we learn, and learning helps us build better products. In this case, it helps us build better product training.</p>
<hr/>
<p>Find out more about the latest <a href="https://www.mindtheproduct.com/product-management-training/mind-product-training-public-workshops/">Mind the Product Training workshops</a>.</p>
<div class="g g-21"><div class="g-single a-170"><a class="gofollow" data-track="MTcwLDIxLDEsNjA=" href="https://www.pendo.io/pendomonium/"><img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/06/MTP-Footer_ad.png" /></a></div></div>

Why is it so Hard to Lean Test?

Rosemary King

Comments

Read next