REVIEW 01Beyond Visual Perception: Insights from Smartphone Interaction of Visually Impaired Users with Large Multimodal Models
Jingyi Xie, Rui Yu, He Zhang, Syed Masum Billah, Sooyeon Lee, John M. Carroll
Be My AI gave blind and low-vision smartphone users useful descriptions and follow-up answers for everyday visual tasks, but participants still needed their own senses, orientation and mobility skills, and human help when the system invented details, misunderstood their goal, made sensitive identity assumptions, or could not provide real-time guidance.