#164 - UX Lessons from a Decade Researching AI with Jess Holbrook of Microsoft

#164 - UX Lessons from a Decade Researching AI with Jess Holbrook of Microsoft

Author: User Interviews April 9, 2025 Duration: 49:29

Much of the conversation around AI in UX involves how it will shape and change researchers' work. Today's guest, Jess Holbrook, who leads UX research for Microsoft AI, has been thinking a lot about how this technology can be improved with design and UX best practices. Jess has spent over a decade working on the UX of AI at companies like Meta and Google. He's also helped develop foundational principles for the ethical use of LLMs.

Jess joins Erin and Ben to reframe the AI conversation, focusing on how UXRs can and should adapt, what working on these systems has taught him about the UX discipline, and his philosophy for building teams that are ready to take on the innovative challenges of tomorrow.

Jess's recommendations: Matt Webb, Maggie Appleton, and the Pessimists Archive Newsletter.

Highlights

  • 07:15 Human-Centered AI Evolution
  • 17:53 Evolving AI Forecast Strategies
  • 24:04 Diverse AI Team Building
  • 33:27 Navigating Responsible AI Challenges
  • 37:01 Qualitative Analysis with AI Tools
  • 40:15 Optimism and Concerns About AI

About Jess
Senior Director of Research specializing in human-centered AI. Early stage investor in AI, AI hardware ecosystems, climate, and anything that seems like the world would be better with it in it. Currently leading UX research for Microsoft AI. Previously led the Generative AI team and supported all UX functions for the Responsible AI and data transparency teams at Meta. I also served on the Board of Forging Youth Resilience, a nonprofit that empowers young people to build physical and mental strength for life by providing access to a national network of community-based fitness programs and mentorship.

Resources


Awkward Silences is a conversation about the human side of building things. Hosts Erin May and Carol Guest, both VPs at User Interviews, don't just talk about theory-they get into the messy, real-world practice of talking to users and making sense of what they say. Each episode pulls back the curtain on the craft of user research, featuring candid chats with the practitioners who do this work every day. You'll hear stories about navigating tricky interviews, the weight of interpreting qualitative data, and how genuine understanding directly shapes better products and smarter business decisions. This isn't a dry lecture; it's a geeky, relatable dive into the questions and quiet moments that define UX research. The Awkward Silences podcast lives in the intersection of technology and business, focusing on the people and processes that connect them. Listen for practical insights, empathetic strategies, and the occasional shared laugh about the inevitable fumbles that come with trying to understand anyone. It’s for anyone who believes that building effectively starts with listening well.
Author: Language: English Episodes: 100

Awkward Silences
Podcast Episodes
#189 - Throwback: Quantifying Research Impact with Ruby Pryor of Rex [not-audio_url] [/not-audio_url]

Duration: 47:44
This week we're revisiting one of Awkward Silences' most memorable episodes.This episode welcomed Ruby Pryor, founder of Rex, a consulting firm specializing in UX research and strategic design.This episode gets into what…
#184 - Use Context For More Influence with Kristen DeLap of Econify [not-audio_url] [/not-audio_url]

Duration: 39:34
Ben talks with Kristen DeLap, fractional COO at Econify, to explore how UX'ers can build influence without formal authority. Kristen brings a unique perspective, having evolved from interior design to leading product tea…
#182 - The Future of Research (In a Moment of Change) [not-audio_url] [/not-audio_url]

Duration: 40:40
Ben sits down with Basel Fakhoury, CEO and Co-founder of User Interviews, and Baran Erkel, Chief Strategy Officer at UserTesting, for a conversation about the research industry's evolution. With AI reshaping customer beh…
#181 - Why We Need Design Now More Than Ever with Karl Randay of 383 [not-audio_url] [/not-audio_url]

Duration: 51:19
Ben Wiedmaier sits with Karl Randay, Experience Director at 383, to explore how designers can stay relevant in an increasingly automated world. Karl shares insights from working with major brands like Hilton and Jaguar o…