Leveraging LLMs to Accurately Simulate Human Behavior

Leveraging LLMs to Accurately Simulate Human Behavior

Tuesday, February 18, 2025
12:40 PM - 2:00 PM
(Pacific)

Stanford Law School Building, Manning Faculty Lounge (Room 270)
559 Nathan Abbott Way Stanford, CA 94305

Speaker: 
  • Robb Willer
robb willer

Join the Cyber Policy Center on February 18 from 1PM–2PM Pacific for a seminar with Robb Willer, Director of the Polarization and Social Change Lab and Co-Director of the Center on Philanthropy and Civil Society. Stanford affiliates are invited to join us at 12:40 PM for lunch, prior to the seminar.  

About the Seminar

Advances in large language models (LLMs) now enable simulation of human behavior for application to social science research. In this talk, I present two interrelated lines of work. First, we use GPT-4 to simulate responses of experimental participants, predicting observed experimental effects with accuracy comparable to—or better than—human forecasters, even for unpublished studies. Second, we introduce a generative agent architecture that replicates the responses and behaviors of over 1,000 individuals, approaching the accuracy of repeated self-assessment and largely mitigating gaps in predictive accuracy for different demographic groups. I conclude by highlighting the promise and challenges of leveraging LLMs to augment social science research and inform policy.

About the Speaker

Robb Willer is a Professor of Sociology, Psychology, and Business at Stanford University where he is Director of the Polarization Social Change Lab and Co-Director of the Center on Philanthropy and Civil Society. Willer’s research focuses on addressing critical societal challenges through rigorous scientific methods and practical applications. Working across the fields of social psychology, sociology, political science, organizational behavior, and cognitive science, he aims to develop actionable solutions in three main areas: pathways to healthy democracy, strategies for social change, and rapid application of social science to emerging technologies and current events.