Analyzing User Feedback

Analyzing User Feedback

Transform raw signals into actionable insights by scaling empathy and synthesis.

Help the user with analyzing user feedback using insights from 19 guests and posts across Lenny's Podcast and Newsletter.

How to Help

1. Categorize signals - Help the user group disparate feedback into themes or segments based on user influence and frequency.
2. Assess representativeness - Determine if feedback reflects a vocal minority or a broad user need using representation frameworks.
3. Set up dogfooding - Design internal processes to experience friction firsthand through audits and mandatory usage programs.
4. Apply AI synthesis - Guide the user in using LLMs to process large datasets like transcripts, reviews, and support tickets.

Core Principles

Experiential Empathy

Jeff Weinstein: "We show up four to eight people total pretend to be some company with some outcome problem. Rule one is you do not work at Stripe and rule two is we're not here to solve any problems. This is just about practicing empathy for the customer."

Build deeper empathy by having internal teams experience product friction firsthand without the distraction of immediate problem solving.

Mandatory Service Participation

Keith Yandell: "We have a program called WeDash, where, four times, a year all employees are required to go do deliveries. And I love doing it. I do it more than four times a year, and I usually take my daughters with me."

Require every employee to perform the core service of the business to build authentic empathy and surface operational bugs.

Creator Mindset Immersion

Maya Prohovnik: "If they talk to users all the time, they see the data, but all of them, once they finally start doing their podcast, they're like, I get it. Something clicked and now I feel like I really understand what they need. And I guess building tools for creators is similar to building a B2B product where you really have to understand business, it's their livelihood."

Directly immerse team members in the product to transform abstract data into a deep understanding of complex user workflows.

Statistical Representation Filtering

From "What 5 years at Reddit taught us about building for a highly opinionated user base": "Just because someone is loud doesn’t mean you should act on their complaints. You need to get good at identifying whom you should pay attention to. That starts with examining who is being loud."

Evaluate feedback based on its statistical representation and the influence of the users providing it to avoid building for a vocal minority.

Templates & Frameworks

• Duolingo Dogfooding Process (How Duolingo builds product) - A structured internal testing process where every product change goes live to employees before rolling out to users
• Feedback Evaluation: Representation × Influence Matrix (What 5 years at Reddit taught us about building for a highly opinionated user base) - A two-factor framework for assessing whether user feedback is worth acting on, based on what percentage of users the feedback represents and whether those users
• The Trust Vault (What 5 years at Reddit taught us about building for a highly opinionated user base) - A metaphor and measurement system for tracking how much trust your user base has in you. Trust can be deposited (through wins and transparency) and depleted (th
• Walk the Store / Essential Journeys Audit (Katie Dill) - A quarterly process where cross-functional leaders manually test critical user journeys and log friction.
• Customer Feedback Hub (Coda Template) (This Week #8: Splitting equity with late-joining co-founders, favorite roadmap templates, and small changes that improve your org) - A Coda template for systematically tracking every piece of customer feedback and following up after improvements are shipped
• Ramp AI User Personas for PM Feedback (25 proven tactics to accelerate AI adoption at your company) - AI personas loaded with user research context that give PMs instant feedback on product specs
• Confluent LLM-Powered Customer Feedback Clustering (Shaun Clowes) - Confluent uses LLMs internally to semantically cluster inbound customer requests, identify the most popular ideas, and track trending demand over time.
• WeDash Dogfooding Program (Keith Yandell) - A mandatory company-wide program requiring all employees to use the product in the real world to build empathy and find bugs.
• Feedback Prioritization 2×2: Depth of Effect × Breadth of Effect (What 5 years at Reddit taught us about building for a highly opinionated user base) - A 2x2 matrix for deciding which user feedback to act on, plotting the depth of a feature's impact against how many users it affects.