论文标题

交互式3D地图的可行性,用于远程视力援助

Feasibility of Interactive 3D Map for Remote Sighted Assistance

论文作者

Xie, Jingyi, Yu, Rui, Lee, Sooyeon, Lyu, Yao, Billah, Syed Masum, Carroll, John M.

论文摘要

远程瞄准援助(RSA)已成为一种对话辅助技术,在该技术中,远程视力的工人(即代理商)通过类似视频聊天的通信为视力障碍的用户提供实时援助。研究人员发现,代理商缺乏环境知识,使用户在周围环境中定位的困难以及无法估算用户相机供稿的距离是对瞄准剂的关键挑战。为了应对这些挑战,研究人员建议协助代理商使用计算机视觉技术,尤其是3D重建。本文介绍了这种RSA的高保真原型,其中代理使用具有本地化功能的交互式3D地图。我们对13名特工进行了一项演练研究,并使用此原型进行了模拟视力障碍的用户。研究表明,与基线RSA相比,代理商在向用户提供导航援助方面的速度明显更快,并且其心理工作量大大减少 - 所有这些都表明RSA中3D地图的可行性和前景。

Remote sighted assistance (RSA) has emerged as a conversational assistive technology, where remote sighted workers, i.e., agents, provide real-time assistance to users with vision impairments via video-chat-like communication. Researchers found that agents' lack of environmental knowledge, the difficulty of orienting users in their surroundings, and the inability to estimate distances from users' camera feeds are key challenges to sighted agents. To address these challenges, researchers have suggested assisting agents with computer vision technologies, especially 3D reconstruction. This paper presents a high-fidelity prototype of such an RSA, where agents use interactive 3D maps with localization capability. We conducted a walkthrough study with thirteen agents and one user with simulated vision impairment using this prototype. The study revealed that, compared to baseline RSA, the agents were significantly faster in providing navigational assistance to users, and their mental workload was significantly reduced -- all indicate the feasibility and prospect of 3D maps in RSA.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源