We research human-AI systems for accessibility and hearing health. Our research targets the entire design and deployment pipeline from conducting formative studies to understand user needs to developing systems to address those needs, to crucially, deploying the systems in the field and understanding their usage.
This has led to widescale industry and community impact. For example, our SoundWatch app for sound awareness on smartwatches has over 4,000 downloads. Our indoor navigation system for visually impaired users has been used more than 100,000 times in museums across India. Our clinical communication tools are being deployed at Michigan Medicine. A feature we pioneered for people with paralysis is now built into every iPhone, and our work has directly influenced real-time captioning tools at Google.