arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2005.12741cs.CVcs.AIcs.LG
收藏

我在寻找什么:视觉搜索中的Zero-shot目标身份推断

What am I Searching for: Zero-shot Target Identity Inference in Visual Search

Mengmi Zhang, Gabriel Kreiman

摘要:

我们能从一个人的行为中推断出他的意图吗?作为一个示例问题,这里我们考虑如何通过解码他们的眼球运动行为来破译一个人正在搜索的内容。我们进行了两个心理物理学实验,我们监测眼球运动,而受试者寻找一个目标对象。我们将落在\textit{non-target}对象上的注视点定义为“错误注视点”。利用这些错误固定,我们开发了一个模型(InferNet)来推断目标是什么。InferNet使用预先训练的卷积神经网络从错误固定中提取特征,并计算错误固定与搜索图像中所有位置之间的相似性图。该模型整合了跨层的相似性图,并将这些图集成到所有错误固定中。InferNet成功地识别了受试者的目标,并优于竞争性空模型,即使在推理任务上没有任何特定于对象的训练。

英文摘要:

Can we infer intentions from a person's actions? As an example problem, here we consider how to decipher what a person is searching for by decoding their eye movement behavior. We conducted two psychophysics experiments where we monitored eye movements while subjects searched for a target object. We defined the fixations falling on \textit{non-target} objects as "error fixations". Using those error fixations, we developed a model (InferNet) to infer what the target was. InferNet uses a pre-trained convolutional neural network to extract features from the error fixations and computes a similarity map between the error fixations and all locations across the search image. The model consolidates the similarity maps across layers and integrates these maps across all error fixations. InferNet successfully identifies the subject's goal and outperforms competitive null models, even without any object-specific training on the inference task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑