Research

My group builds AI that senses human behavior (faces, voices, movement, language) and turns it into tools people can use: screening for disease at home, practicing hard conversations, and understanding how ideas and beliefs spread. Most of the work is done with clinicians and social scientists, and much of it is tested in trials and real deployments. The lab's own site is roc-hci.com.

Flagship projects

Health · Active

PARK: Parkinson's screening from a webcam

Short tasks in a web browser (speaking, smiling, finger tapping) analyzed by AI to screen for Parkinson's disease and measure its severity at home, without a clinic visit.

NEJM AI 2025 · npj Digital Medicine 2023 · Communications Medicine 2026 · AAAI 2025 · MICCAI 2026

Validated across diverse settings; highlighted by NSF and in the University of Rochester's 175-year history of innovation.

Project page → · Related papers

Clinical training · Active

SOPHIE: an AI virtual patient for clinicians

A virtual standardized patient that lets clinicians practice serious-illness conversations and receive automated feedback on how they communicate.

JMIR Medical Education 2026 (randomized controlled trial) · IEEE TAC 2021 · ACII 2023

Adopted in medical curricula at the University of Rochester Medical Center.

Project page → · Related papers

Social computing · Active

AI, creativity and belief in social networks

Online experiments on how network structure and AI shape idea generation, belief rigidity and misinformation, including how personalized LLM responses can counter political misinformation.

PNAS Nexus 2022 · Scientific Reports 2021 · IEEE TAC 2025 · npj Artificial Intelligence 2026

Funded by the Army Research Office; collaborations with James Druckman and Gourab Ghoshal.

Project page → · Related papers

Communication skills · Completed

MACH and the conversation coach

A 3D virtual coach that reads facial expressions, speech and prosody in real time to help people practice job interviews and social conversations; followed by ROC Speak, Rhema and AutoManner for public speaking.

UbiComp 2013 Best Paper · UbiComp 10-Year Impact Award 2023 · US Patent 9,691,296

Microsoft later built on the idea in PowerPoint's Speaker Coach.

Project page → · Related papers

Other active work

Archive

Earlier projects. Click a picture to play its video.

ROC Speak

UbiComp 2015

Record a talk in your browser and get automated and crowd feedback on your nonverbal behavior.

Project page →

Aging and Engaging

AJGP 2017, IUI 2018, AJGP 2020

An AI conversation coach that helps older adults practice social engagement, tested in a pilot randomized trial.

Project page →

Zaca

Earlier project

SMS market prices for farmers, so resource-strapped growers can check wholesale prices from any phone.

Project page →