← 研踪 PaperTrailarXiv:2606.07642 · v2
Do VLMs See What Sensors Feel? A Scalable Expert-Guided Design for Wheelchair Accessibility Assessment from Street View
首次提交 2026-06-02 02:46
版本更新 2026-11-05 11:55
雷达观测 2026-11-06 11:06
摘要
Assessing built-environment interaction, such as wheelchair accessibility, is challenging because real-world mobility is shaped by context-dependent and temporary barriers that are difficult to capture at scale. This paper examines whether vision-language models (VLMs) can identify potential accessibility barriers from Google Street View (GSV) imagery. We propose an expert-guided retrieval-augmented framework that combines GSV imagery, ADA-informed guidance, and expert-derived rubrics to evaluate multiple accessibility dimensions. We collect a campus-scale dataset at the University of Florida, linking 407 unique GSV locations with GPS-derived wheelchair dwell behavior as a proxy for potential mobility friction. Results show that VLM ratings are negatively correlated with dwell time and exhibit distributional similarity, with the expert-guided configuration strengthening the correlation from $r=-0.40$ to $r=-0.54$ for the strongest model. Visual cue analysis further shows that features such as curb ramps and crosswalks are associated with higher VLM accessibility scores, while correspondence remains limited for subtle surface conditions, transient obstructions, and viewpoint-dependent barriers. Overall, our findings demonstrate the potential of expert-guided VLMs for scalable preliminary accessibility screening and prioritizing locations for further investigation.
作者备注：Accepted to IEEE/CVF WACV 2027. 8 pages of main content, 2 pages of references
观测到的版本
相邻记录可能跳过中间版本；首次发现 v2 及以上也会标为版本更新。
v2 · 2026-11-05 11:55 · 最新观测版本
Do VLMs See What Sensors Feel? A Scalable Expert-Guided Design for Wheelchair Accessibility Assessment from Street View
Assessing built-environment interaction, such as wheelchair accessibility, is challenging because real-world mobility is shaped by context-dependent and temporary barriers that are difficult to capture at scale. This paper examines whether vision-language models (VLMs) can identify potential accessibility barriers from Google Street View (GSV) imagery. We propose an expert-guided retrieval-augmented framework that combines GSV imagery, ADA-informed guidance, and expert-derived rubrics to evaluate multiple accessibility dimensions. We collect a campus-scale dataset at the University of Florida, linking 407 unique GSV locations with GPS-derived wheelchair dwell behavior as a proxy for potential mobility friction. Results show that VLM ratings are negatively correlated with dwell time and exhibit distributional similarity, with the expert-guided configuration strengthening the correlation from $r=-0.40$ to $r=-0.54$ for the strongest model. Visual cue analysis further shows that features such as curb ramps and crosswalks are associated with higher VLM accessibility scores, while correspondence remains limited for subtle surface conditions, transient obstructions, and viewpoint-dependent barriers. Overall, our findings demonstrate the potential of expert-guided VLMs for scalable preliminary accessibility screening and prioritizing locations for further investigation.
查看此版本解读 →查看此版本原文 ↗