HCC: RI: Medium: Improving Human-AI Decision-Making Partnerships Through Shared Understanding

NSF Award Search · 01002526DB NSF RESEARCH & RELATED ACTIVIT · $900,000 · view on nsf.gov ↗

Abstract

Artificial intelligence (AI) is becoming a key partner in critical human decision making — from diagnosing diseases to everyday driving. To ensure these partnerships work effectively, this project develops new ways to accurately measure and track how well both people and AI perform tasks over time. These assessments will help determine in what situations it is better for a human to take the lead in decision-making and in what situations the AI can be trusted. Equally important is creating AI systems that respect and reinforce human goals, like fairness, teamwork, and preserving a sense of personal control. By combining techniques from statistical modeling and cognitive science, this project will improve how people and AI collaborate, making these interactions not just effective but also aligned with human values and expectations. The research project is interdisciplinary in nature, building on Bayesian learning and cognitive modeling to systematically study and optimize human-AI interaction. It focuses on three core research activities: (1) developing Bayesian inference frameworks to dynamically evaluate the evolving abilities of both humans and AI agents; (2) creating adaptive optimization algorithms to manage decision policies under uncertainty, incorporating costs and constraints inherent in real-world human-AI collaboration; and (3) exploring human-centered aspects, integrating subjective metrics such as perceived fairness, teamwork, and agency into multi-objective op

Key facts

NSF award ID
2505006
Awardee
University of California-Irvine (CA)
SAM.gov UEI
MJC5FCYQTPE6
PI
Padhraic Smyth
Primary program
01002526DB NSF RESEARCH & RELATED ACTIVIT
All programs
Cyber-Human Systems, MEDIUM PROJECT
Estimated total
$900,000
Funds obligated
$900,000
Transaction type
Standard Grant
Period
10/01/2025 → 09/30/2029