Evaluating Representativeness in Healthcare Claims Data: A Framework for AI Fairness in Actuarial Applications

Evaluating Representativeness in Healthcare Claims Data: A Framework for AI Fairness in Actuarial Applications

Author: Research Insights August 21, 2026 Duration: 20:19

In this episode of the Research Insights Podcast, Lisa Schilling, Director of Practice Research at the Society of Actuaries Research Institute, speaks with Dr. Rob Lieberthal, lead author of Evaluating Representativeness in Healthcare Claims Data: A Framework for Representativeness-Based Fairness in Actuarial Applications of AI.

Their discussion explores why strong overall model performance does not necessarily mean an AI or machine learning model performs equitably across populations. Dr. Lieberthal explains how gaps in healthcare claims data can affect rural, lower-income, underdiagnosed, and other populations—and why actuaries should examine representativeness before relying on model results.

Listeners will learn about the report's three-stage bias assessment covering input bias, model bias, and application bias; examples involving geographic representation, missing data, and intersectionality; and practical approaches for evaluating subgroup performance. The episode also highlights the companion Model Card Generator and Decision Assist Tool, which are designed to help actuaries document model limitations, compare model alternatives, and apply professional judgment throughout the modeling process.

Explore the full research report and companion resources through the Society of Actuaries Research Institute at SOA.org, and discover practical ways to strengthen fairness, transparency, and informed decision-making in actuarial applications of AI.

https://www.soa.org/resources/research-reports/2026/dei127-represent-hc-data/


Hosted by R. Dale Hall, FSA, MAAA, CERA, the Managing Director of the SOA Research Institute, Research Insights, a Society of Actuaries Podcast is a direct line to the critical studies shaping the actuarial field and related disciplines. This isn't just a summary of papers; it's a series of conversations that unpack the implications, methodologies, and real-world applications found within the Society of Actuaries Research Institute's extensive work. You'll hear discussions on recently released research reports, deep dives into studies featured at major SOA meetings, and explorations of other pivotal findings produced by the institute. Each episode is designed to translate complex data and sophisticated models into accessible insights, whether you're a practicing actuary, a professional in a related financial or risk management field, or simply someone with a keen interest in the science of uncertainty. The podcast serves as an essential audio companion for anyone looking to stay informed on the latest evidence-based approaches to insurance, retirement, finance, and health. By tuning in, you gain a clearer understanding of how rigorous research informs better business decisions and public policy. Occasional guest hosts bring additional perspectives, ensuring a well-rounded examination of each topic. For those committed to continuous learning and professional self-improvement, this series provides a thoughtful and substantive resource, naturally integrating detailed analysis with broader educational context.
Author: Language: English Episodes: 50

Research Insights, a Society of Actuaries Podcast
Podcast Episodes
50th Anniversary of The Universal Life Insurance Policy [not-audio_url] [/not-audio_url]

Duration: 39:09
In this special episode of the Research Insights Podcast, Dale Hall, Managing Director of the Society of Actuaries Research Institute, honors the legacy of James C.H. Anderson—a pioneering actuary and visionary in the in…
Long Term Drivers of Future Mortality – Episode 6 – Health Care [not-audio_url] [/not-audio_url]

Duration: 13:06
In Episode 6 of the Society of Actuaries Research Institute's podcast series Long-Term Drivers of Future Mortality, Kara Clark is joined by Al Klein, Principal and Consulting Actuary at Milliman, and Erik Pickett, Actuar…
2025 - SOA Research Institute - Student Research Case Study Challenge [not-audio_url] [/not-audio_url]

Duration: 21:29
In this episode of the Society of Actuaries Research Insights Podcast, Dale Hall, Managing Director of Research and Lisa Schilling, Director of Practice Research, at the SOA Research Institute, are joined by the 2025 Stu…
Long Term Drivers of future Mortality – Episode 5 - Diseases [not-audio_url] [/not-audio_url]

Duration: 16:57
In the fifth episode of the Society of Actuaries Research Institute's special podcast series on the Long-Term Drivers of Future Mortality, host Kara Clark, Senior Practice Research Actuary, is joined by Al Klein, Princip…
May 2025 Classic Edition - COVID-19 Mental Health Impact [not-audio_url] [/not-audio_url]

Duration: 23:11
In this special classic episode of Research Insights, we revisit a powerful discussion from May 2020, when the world was grappling with the mental health effects of the COVID-19 pandemic. Five years later, this conversat…
Long Term Drivers of Future Mortality – Episode 4 - Inequality [not-audio_url] [/not-audio_url]

Duration: 14:04
🎙️ New Episode Alert! 🎙️ In this episode, we learn that although inequality, per se, is not a direct driver of future mortality, it is an underlying cause of many other important drivers. Don't miss out on this insightfu…