行动中的视觉：比较远程视觉援助与多模态语音代理在检查序列中的表现
(Computer) Vision in Action: Comparing Remote Sighted Assistance and a Multimodal Voice Agent in Inspection Sequences
AI总结：
研究比较了远程视觉援助与多模态语音代理在检查任务中的表现，发现代理无法产生基于环境的视觉动作，从而缺乏关键资源。
摘要：
人类与人工智能的协助是否与人类之间的协助方式相同？本研究探讨了从盲人个体和有视觉志愿者的专业知识中可以学到什么，以指导多模态语音代理的设计，并解决持续存在的主动性挑战。基于对更大语料库中两个代表性片段的细致分析，我们对比了经验丰富的远程视觉助理和盲人参与者在电话中协作寻找毯子上的污渍时所采用的做法，与当同一参与者在几小时前与多模态语音代理进行相同任务时所取得的成果。这种对比使我们能够精确确定代理在现实环境中未能执行哪些基本主动性做法。我们得出结论，只要多模态语音代理无法产生基于环境的视觉动作，它们将缺乏人类远程视觉助理所依赖的关键资源。
英文摘要：
Does human-AI assistance unfold in the same way as human-human assistance? This research explores what can be learned from the expertise of blind individuals and sighted volunteers to inform the design of multimodal voice agents and address the enduring challenge of proactivity. Drawing on granular analysis of two representative fragments from a larger corpus, we contrast the practices co-produced by an experienced human remote sighted assistant and a blind participant-as they collaborate to find a stain on a blanket over the phone-with those achieved when the same participant worked with a multimodal voice agent on the same task, a few moments earlier. This comparison enables us to specify precisely which fundamental proactive practices the agent did not enact in situ. We conclude that, so long as multimodal voice agents cannot produce environmentally occasioned vision-based actions, they will lack a key resource relied upon by human remote sighted assistants.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
