post

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Successful product management in companies where it’s least understood

Measuring critical user journeys – Javier Andrés Bargas-Avila (UX Director, Google)

A new way to look at applied experiments

Product survey findings: Only 15% of users are embracing AI features 

Building high-performing product teams: The PDLC approach

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Overcoming the 20% feature usage challenge

Product Management

Three product leaders to learn from at #mtpcon inside Pendomonium

Todd is a Stanford-educated product manager with 15+ years of experience in the B2B2C tech industry. Currently he leads his own freelance consultancy advising on product management, user research, and professional writing. Recently he worked as an early employee at Deliverr and Matterport, both successful exits. Before that, he worked as a technical writer including several years working abroad in Taiwan. Todd earned his BS and MS in Electrical Engineering from Stanford University and has a deep intellectual passion for interdisciplinary fields such as computer vision, robotics, and machine learning. Outside of work, Todd loves to run marathons as well as read history and philosophy.

Todd Lewandowski

This article is part of our AI Knowledge Hub, created with <a href="https://www.pendo.io/?&amp;utm_source=mtp&amp;utm_medium=website&amp;utm_campaign=ai-hub-post" target="_blank" rel="noopener">Pendo</a>. For similar articles and even more free AI resources, <a class="c-link" href="https://www.mindtheproduct.com/ai-knowledge-hub/" target="_blank" rel="noopener noreferrer" data-stringify-link="https://www.mindtheproduct.com/ai-knowledge-hub/" data-sk="tooltip_parent">visit the AI Knowledge Hub now.</a>
<hr />
Right now (June 2023) ChatGPT and all generative AI is undeniably hot. It&#8217;s dominating headlines and water cooler discussions. On its own, it&#8217;s an amazing piece of technology. But we are all still figuring out what it can and can&#8217;t do, much less the long term implications.
Product managers, with hands in both business and technology, are right in the middle of it. Bosses and coworkers are confronting us with a simple question:
“Should we use ChatGPT in our own company&#8217;s product?”
That’s what I aim in to help you answer in this blog post.
<h2>Address the Emotional Concern</h2>
First, acknowledge the underlying concern behind this question. There is a whole lot of peer pressure in tech. It&#8217;s especially intense if the pressure comes from executives or investors. But what drives peer pressure is actually an underlying fear of &#8220;Are we being left behind?&#8221; or &#8220;Are we not being innovative enough?&#8221;.
Second, ChatGPT is quite an amazing tool. Just play with it yourself and see! Immediately taking a critical attitude (to any new technology) won&#8217;t match their positive emotions towards it and is likely to scare them away from further interactions with you.
So before you provide a logical answer be sure to address their emotional concerns first.
<h2>The Right Way to Make Decisions</h2>
However,  your internal alarm should be going off right now as both of those ways of thinking are inappropriate. As product managers, we don&#8217;t make product decisions based on authority (peer pressure or a rich/powerful person) …  because authority is subjective and can fade. Nor do we decide based on a tech&#8217;s own novelty or capabilities … because that&#8217;s working forward from the technology instead of working backwards from customer problems.
Of course, the &#8220;right&#8221; reasoning is:
Is this the right thing for our users? Does it further our company&#8217;s mission?
If you pose it this way, no doubt your coworkers will wholeheartedly agree.  Plus it&#8217;s easy to point to &#8220;Put customers first&#8221; as the #1 value for every company.
Our answer could still be &#8220;yes&#8221; or varying degrees of &#8220;yes&#8221;, but now our arguments are much more sound. Now we&#8217;re using logical/quantitative arguments like opportunity size or emotional/qualitative arguments like &#8220;Will this help the user.&#8221; Now our arguments are based on customers who actually pay us. Customers are numerous, and as a whole, have needs that are a lot more consistent than any single stakeholder.
<h2>Working backwards through product sense</h2>
Every product manager is familiar with &#8220;product sense.&#8221; We use it in verbal discussions,  writing PRDs, and of course when interviewing. Traditional product sense goes from general to specific:
<ol>
<li>Mission, vision, strategy</li>
<li>Users, segments, customers</li>
<li>Pain points, opportunities, use cases</li>
<li>User flows, mockups, MVPs</li>
</ol>
Sometimes an interview will switch things up. For example: &#8220;You&#8217;re a product manager at Apple or Google. An engineer approaches you with a new technology to detect smells. Should we include it in the next mobile phone?&#8221;
This is still product sense, but in the opposite direction. So we just reverse the framework:
<ul>
<li>Describe the technology: How it works and its limitations</li>
<li>Abstract to use cases: How someone would use it to solve a problem or gain something new</li>
<li>Abstract to segments: What kinds of people have these use cases and the frequency and intensity of those uses.</li>
<li>Abstract to mission-vision: How this gives overall value to society and any larger trends.</li>
</ul>
The only difference with traditional product sense is that along the way you are comparing it to your own company&#8217;s product-market fit. There will never be a 100% fit as it is new technology. If there was, your team was probably considering it before it went mainstream. But of course, the more overlap the easier it is to say &#8220;yes.&#8221;
<h2>(0) Limit the Scope</h2>
Product sense begins by asking questions and making basic assumptions. These limit the scope and simplify the problem.
<ul>
<li>Limit to a single mode. So just text-input to text-output, as in ChatGPT in its first iteration. Exclude text-input to image-output (Midjourney, Stable Diffusion) and output to video, databases, or any structured format.</li>
<li>Exclude AGI (artificial generative intelligence) ie a sentient robot brain. Impractical, fanciful, and too many philosophical, psychological, and social issues.</li>
<li>Limit to American English, though other languages are possible.</li>
</ul>
<h2>(1) Describe the Technology</h2>
MVP
<ul>
<li>Input: Freeform text area input. User inputs a question, request, or comment in natural prose.</li>
<li>Output: Text response in natural prose. User consumes directly or copy-pastes elsewhere.</li>
<li>Format: Web app for users to create and read past conversations. API for partners to integrate with their own software. With the right resources, companies can build their own large language models.</li>
</ul>
Nuances
<ul>
<li>Memory: Remembers questions/answers in same conversation up to 50 interactions.</li>
<li>Reactive: Only responds to a direct user prompt. Never proactively tells you of anything, ie a push notification.</li>
<li>Non-deterministic: Doesn&#8217;t give the exact same answer every time. There is randomness, though the overall message is the same.</li>
</ul>
Limitations
<ul>
<li>Limited knowledge based on its training data. Does not have the most current information like news and weather.</li>
<li>Predictive based on paths of high probability. Does not inherently reason through logic, concepts, or proofs.</li>
<li>Hallucinates sometimes to make claims that are not true. Does not share sources, so can make claims that seem authoritative but are based on spurious sources.</li>
<li>Generic output. Simple prompts lead to simple answers. Better answers require more detailed questions.</li>
<li>Lacks spirit. Can display facsimiles of emotions, but is not a human. Users may project human emotions onto it when it is actually just an algorithm.</li>
</ul>
<h2>(2) Abstract to Use Cases</h2>
The tech is text-in text-out which is language as a representation of information. User functionality is then manipulating information (the content the text represents) or manipulating language (the symbols that represent the content).
<ul>
<li>Searching: Query for information like a search engine but returning in natural human prose. By extension, providing product support.</li>
<li>Summarizing: Gathering main points and condensing data from a large source. By extension categorizing, classifying, or evaluating.</li>
<li>Editing/rewriting: Modifying content to a different style or tone. By extension, translation to another language.</li>
<li>Coding: Creating compilable computer code.</li>
<li>Content generation: Creating fiction or non-fiction.</li>
</ul>
<h2>(3) Abstract to Segments</h2>
Some appropriate segments  (not mutually exclusive):
<ul>
<li>Basic tech literacy: Limited to people with a smartphone/laptop and a stable internet connection.</li>
<li>Knowledge workers: Those who discover and manipulate knowledge for their work. Teachers, scientists, software engineers, product managers, and similar white collar employees.</li>
<li>Professional communicators: Those who primarily communicate with others for their work. Writers/creatives, media, support agents, content creators, and similar.</li>
</ul>
<h2>(4) Abstract to Mission-Vision</h2>
Automate Basic Tasks
In general, AI replaces the easiest, most common, and most rote knowledge tasks. It &#8216;cuts costs&#8217; in a basic sense of time and effort. However, job displacement is not complete, and it depends on the repeatability of the task as well as the economy-of-scale of the organization.
For example, while automation is common in warehouses and factories, they still have a large amount of workers. While there are a ton of consumer packaged goods, we still go to farmers markets and local restaurants. So labor displacement is truly only marginal for those extremely rote knowledge tasks that are already machine-like.
Even knowledge workers doing very specialized tasks do some rote things. In this sense, AI acts as your writing and search assistant. It supercharges your workday to make it easier, faster, and more productive.
Springboard for Quality
AI&#8217;s output tends to be generic, which makes sense as it is based on the most common trends in language and thought. It can be refined with prompts (though you have to know how to prompt), but ultimately won&#8217;t produce anything as creative as James Joyce&#8217;s Ulysses.
On the flip side though, AI can create rapid prototyping upon which to see if a creative idea has potential … and then human experts refine it to make it better. AI thus helps you &#8216;grow revenue&#8217; (happiness) in a general sense. As I like to say it:
&#8220;AI is the beginning of great writing. Not the end.&#8221;
<h2>Make a recommendation</h2>
Finally, it&#8217;s time to make a recommendation. Compare reverse-product-sense to your company&#8217;s product fit on those four criteria: (1) technology (2) use cases (3) user segments (4) mission vision. The more overlap (especially on the latter criteria), the easier it is to say yes.
But rarely is the answer black and white. Consider the degree of fit (very strong to very weak), the category of fit (better on some parts not others), and the perception of fit (how to spin it to execs or customers). For a start:
<ul>
<li>Good fit: Yes, here&#8217;s how it super-charges our current product-market fit</li>
<li>Lukewarm fit: Yes, but maybe later in the future after they improve X, best for a big customer, or we might use a vendor that uses X.</li>
<li>No fit: No, but we are at the bleeding edge of doing something else very cool and innovative (addresses the underlying emotional fear).</li>
</ul>
<h2>Final thoughts</h2>
Finally, this method of   &#8220;reverse product sense&#8221; is applicable to any new technology, not just ChatGPT and generative AI. Feel free to use it for your next big thing or in your next interview.
Is this framework perfect? Not necessarily. But frameworks come easily to us product managers. They also provide some basic structure and are a great starting point for further discussions. Best of luck to you in the future.
<h2>Discover more great content on AI</h2>
<ul>
<li><a href="https://www.mindtheproduct.com/a-deep-dive-into-how-ai-can-help-product-managers-succeed/" target="_blank" rel="noopener">Deep dive: Revolutionising product management with ChatGPT</a></li>
<li><a href="https://www.mindtheproduct.com/the-chatgpt-hype-separating-reality-from-fiction-in-product/" target="_blank" rel="noopener">The ChatGPT hype: Separating reality from fiction in product</a></li>
<li><a href="https://www.mindtheproduct.com/how-canva-uses-ai-powered-features-to-drive-plg/" target="_blank" rel="noopener">How Canva uses AI-powered features to drive PLG</a></li>
</ul>
<div class="g g-21"><div class="g-single a-170"><a class="gofollow" data-track="MTcwLDIxLDEsNjA=" href="https://www.pendo.io/pendomonium/"><img decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2024/06/MTP-Footer_ad.png" /></a></div></div>

core/freeform

The future of product management: Insights from ProductTank San Francisco

Product lessons learned making early moves with AI in media: Lindsey Jayne (CPO, Financial Times)

A year with ChatGPT and product innovation: Navigating the AI landscape

How to keep your head about generative AI (when everyone is losing theirs) by Claire Woodcock

What we get wrong about technology by Tim Harford

Product management in the age of ChatGPT by Yana Welinder

How Canva uses AI-powered features to drive PLG

The role of an AI product manager by Hiroki Nakamura

A gentle introduction to AI in product by Rand Hindi

Metrics don’t have all the answers: a human-centered approach to business strategy by Samihah Azim

Viewing ChatGPT through the lens of product sense

Todd Lewandowski

Comments

Read next