post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Strategy

How Bain & Company adapted its product strategy for AI: Kasia Mrowca (Director of Product) — Product Unplugged

Product Management

Sunday Rewind: Product, dance, and pockets of brilliance by Pippa Topp

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

What AI can’t—and shouldn’t—do for product managers

5 difficult conversations and how to have them

A no-code approach to building MVPs 

Why great product managers think like therapists

Netflix introduces major TV product redesign

Patrick is a technology leader with over a decade of experience scaling marketplace startups from seed stage to IPO. He’s launched industry-defining initiatives at companies such as Uber, Redfin, and Getsafe. A builder at heart, he earned dual degrees in computer science and business from the University of Washington in Seattle.

Head of Product & Engineering

Patrick Tsao

The hype around artificial intelligence (AI) and machine learning has led to lots of jargon, so that this very powerful technique has become more difficult to understand. The tips below have all helped me, so I hope this article will help product managers to cut through the noise and better understand how AI can fit into their daily work.
<figure id="attachment_18407" aria-describedby="caption-attachment-18407" style="width: 761px" class="wp-caption aligncenter"><img loading="lazy" decoding="async" class="wp-image-18407" src="https://www.mindtheproduct.com/wp-content/uploads/2020/01/AI-shutterstock_674863345-300x200.jpg" alt="" width="761" height="507" srcset="https://www.mindtheproduct.com/wp-content/uploads/2020/01/AI-shutterstock_674863345-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2020/01/AI-shutterstock_674863345-768x512.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2020/01/AI-shutterstock_674863345-1024x683.jpg 1024w" sizes="(max-width: 761px) 100vw, 761px" /><figcaption id="caption-attachment-18407" class="wp-caption-text">Machine learning being employed to recognize vehicles (Image: Shutterstock)</figcaption></figure>
<h3>A Broad Definition Enables Better Problem-solving</h3>
Let’s forget the buzzwords for a moment: what is AI anyway?
In my experience from working on data-driven products, I’ve found that a broad definition of AI helps me to focus on defining the problem I’m trying to solve, rather than fixate on specific techniques to use in the solution.
As product managers, we must thoroughly understand our problem space so that we can properly define requirements and allow our team to solve the right problems. This often leads to the topic of “how” coming up prematurely; before we know it, we have accidentally biased ourselves towards specific solutions before we’ve properly defined this problem.
To help avoid this, I prefer to define AI as “automated decision-making”.
Most products we work on require decision-making based on data, though the method for making decisions can vary. For example, decisions can be made by machines or humans, and the data can be static or dynamic. A focus on decision-making abstracts away the intricacies of specific methodologies or the noise of industry jargon. This broader definition enables product managers to be more attentive to the problem space &#8211; it removes distractions that can lead us to think about solutions too early in our process.
<h3>AI is a Tactic That Helps to Solve Problems</h3>
There are three key concepts that serve as the foundation of everything we do as product managers:
Vision: The end goal we aim to achieve
Strategy: Doing the right things to realize our vision
Tactic: Doing the things right to properly execute our strategy
Depending on the product lifecycle, product managers need to operate on all three of these levels at any given time. We must align our teams to the vision we are trying to achieve, while ensuring everyone understands the strategy and how our daily, operational tactics fit into the overall plan. It’s important to remember that AI is a tactic that can be used to solve specific problems rather than a strategy or vision. Deploying AI without an end goal usually brings no value to end users.
To give a concrete example, here is how the application of AI might fit into a team at Netflix, one of the first companies to effectively productize AI at scale:
Netflix Vision: Become the best global entertainment distribution service
Netflix Strategy: Drive member retention via engaging, personalized UX
Netflix Tactics: Ratings system, recommendations, personalized hero shots, usage tracking, etc
As you can see, there are a number of tactics within the personalization strategy that could be used to achieve the goal of improving member retention. The degree to which data and AI are used varies from tactic to tactic, while the vision and strategy statements abstain from dictating which technologies or algorithms must be used.
<h3>AI can Empower Humans, Rather Than Replace Them</h3>
The current discussion on topics like automation has raised some interesting ethical questions about the future of work, and subsequently, the narrative around how AI can empower humans has become a bit lost. A common example that illustrates this point is self-driving cars. Within the industry, autonomous capabilities for vehicles are classified into <a href="https://en.wikipedia.org/wiki/Self-driving_car#Classification" target="”_blank”" rel="”noopener” noopener noreferrer">five different categories</a>, with much of the conversation fixated around what would happen in a world where cars were fully self-driving (level 5 autonomy).
<figure id="attachment_18409" aria-describedby="caption-attachment-18409" style="width: 677px" class="wp-caption aligncenter"><img loading="lazy" decoding="async" class="wp-image-18409" src="https://www.mindtheproduct.com/wp-content/uploads/2020/01/self-driving-shutterstock_251998009-300x200.jpg" alt="man in a self driving car" width="677" height="451" srcset="https://www.mindtheproduct.com/wp-content/uploads/2020/01/self-driving-shutterstock_251998009-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2020/01/self-driving-shutterstock_251998009-768x512.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2020/01/self-driving-shutterstock_251998009-1024x683.jpg 1024w" sizes="(max-width: 677px) 100vw, 677px" /><figcaption id="caption-attachment-18409" class="wp-caption-text">What would happen in a world where cars were fully self-driving? (Image: Shutterstock)</figcaption></figure>
It is important for product managers to recognize that AI capabilities are typically developed in stages over time, rather than turned on instantaneously. Machines are good at different types of tasks from humans, so certain decisions are easier to automate than others. High-performing AI capabilities require a sizable training dataset to get started, and training datasets need to be well-structured high volume, and machine-readable. Ideally, the dataset should also have well-defined notions of success and failure, where past outcomes are predictive of future results. Here is a framework that I often use when considering how to apply automated decision-making:
<img decoding="async" class="aligncenter" src="https://www.mindtheproduct.com/wp-content/uploads/2020/01/d664dd55-b972-45ab-82eb-9beac677c58d_pasted20image200.png" alt="" />
Along the y axis, routine scenarios happen in high frequency and have low variability in how they unfold, while nuanced scenarios seldom occur and could contain hard-to-replicate subtleties. On the x axis, informational decisions provide additional context to the end user, while action-oriented decisions perform an action on behalf of the end user. Routine scenarios tend to generate more reliable training datasets and are therefore easier for machines to learn; informational decisions tend to be lower risk than action-oriented decisions. Combining these two dimensions yields four categories of automated decisions:
<ul>
<li>Routine information: Easy to predict and low risk if wrong</li>
</ul>
<ul>
<li>Example: Car estimating remaining driving distance based on remaining fuel and driving behavior</li>
</ul>
<ul>
<li>Nuanced information: Hard to predict and low risk if wrong</li>
</ul>
<ul>
<li>Example: Car warns when the driver is falling asleep based on image recognition and driving behavior</li>
</ul>
<ul>
<li>Routine action: Easy to predict and high risk if wrong</li>
</ul>
<ul>
<li>Example: Car autonomously driving on highways under normal conditions</li>
</ul>
<ul>
<li>Nuanced action: Hard to predict and high risk if wrong</li>
</ul>
<ul>
<li>Example: Car autonomously driving through busy construction zones</li>
</ul>
<h3>AI can Drive Impact in Three Different Ways</h3>
From working on data-driven products over the last decade, I’ve identified three primary buckets of use cases for how product managers can drive impact with data:
AI can optimize and/or automate operational processes. Products with proper behavioral tracking can generate a dataset that empowers teams to make more informed decisions about how to run the business. For example, customer touchpoints and communications can be optimized based on data in order to increase conversion or reduce churn. Support requests can be triaged or routed more effectively based on the predicted topic or outcome. In this sense, AI serves as an advanced business intelligence tool that drives productivity and effectiveness for teams.
AI can dramatically improve the user experience of products. Here are some examples of how some companies have been able to use AI to create delightful experiences for their customers:
<table>
<tbody>
<tr>
<td>Brand</td>
<td>Product</td>
<td>AI-enhanced UX Example</td>
</tr>
<tr>
<td><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2020/01/4ca6c8d1-860d-4f60-8838-e41faf1b9f93_pasted20image200.png" alt="" width="290" height="108" /></td>
<td>Mobility</td>
<td>
<ul>
<li>Trip Duration Estimation</li>
<li>Rider-Driver Matchmaking</li>
</ul>
</td>
</tr>
<tr>
<td><img loading="lazy" decoding="async" class="aligncenter wp-image-18411" src="https://www.mindtheproduct.com/wp-content/uploads/2020/01/refin-logo.png" alt="" width="290" height="120" srcset="https://www.mindtheproduct.com/wp-content/uploads/2020/01/refin-logo.png 495w, https://www.mindtheproduct.com/wp-content/uploads/2020/01/refin-logo-300x124.png 300w" sizes="(max-width: 290px) 100vw, 290px" /></td>
<td>Homes</td>
<td>
<ul>
<li>Home Value Estimate</li>
<li>Home Recommendations</li>
</ul>
</td>
</tr>
<tr>
<td><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2020/01/277fe4f9-bacd-4fc8-bb0b-ceee24e3b093_pasted20image200.png" alt="" width="272" height="74" /></td>
<td>Entertainment</td>
<td>
<ul>
<li>Movie Recommendations</li>
<li>Hero Shot Optimization</li>
</ul>
</td>
</tr>
</tbody>
</table>
&nbsp;
In each of these examples, the fundamental product delivered to end users remains the same (for example, mobility via Uber), but the experience around the product is better with the application of data (being matched to a nearby Uber driver). Using this pattern, product teams can often create unique user experiences that become long-term competitive advantages for their company.
AI can fundamentally change products themselves. Perhaps the most famous example of this is the story behind Netflix’s “<a href="https://en.wikipedia.org/wiki/House_of_Cards_(American_TV_series)" target="”_blank”" rel="”noopener” noopener noreferrer">House of Cards</a>” series, where the usage of data <a href="https://www.nytimes.com/2013/02/25/business/media/for-house-of-cards-using-big-data-to-guarantee-its-popularity.html" target="”_blank”" rel="”noopener” noopener noreferrer">redefined how entertainment is created</a>. This series not only <a href="https://en.wikipedia.org/wiki/List_of_awards_and_nominations_received_by_House_of_Cards" target="”_blank”" rel="”noopener” noopener noreferrer">won many awards</a>, but it is also <a href="https://www.imdb.com/title/tt1856010/" target="”_blank”" rel="”noopener” noopener noreferrer">loved by </a>Netflix subscribers. It also marked the beginning of a new era of <a href="https://money.cnn.com/2017/11/01/investing/netflix-stock-house-of-cards-kevin-spacey/index.html" target="”_blank”" rel="”noopener” noopener noreferrer">significant growth</a> for the company. It shows that AI has the potential to create new categories of products and new trends for an entire industry.
<h3>Conclusion</h3>
To sum up, here are four ground rules for how product managers might think about integrating AI into their daily work:
<ol>
<li>Defining AI broadly frees us to focus on problem-solving rather than the end solution.</li>
<li>AI is a tactic that helps solve problems, not a strategy or an end-goal.</li>
<li>AI can empower humans, rather than replace them.</li>
<li>AI can drive impact in three different ways: optimize operations, improve product experiences, and create new product categories.</li>
</ol>

core/freeform

AI ethics advice from former White House technologist – Kasia Chmielinski (Co-founder, The Data Nutrition Project)

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

LLM workflows for product managers: 3 key takeaways (Niloufar Salehi, Assistant Professor at UC Berkeley) – ProductTank SF

The future of product management: Insights from ProductTank San Francisco

Product lessons learned making early moves with AI in media: Lindsey Jayne (CPO, Financial Times)

A year with ChatGPT and product innovation: Navigating the AI landscape

How to keep your head about generative AI (when everyone is losing theirs) by Claire Woodcock

Ground Rules for Applying AI to Product Management

Patrick Tsao

Read more