发表机构
School of Science and Engineering; The Chinese University of Hong Kong, Shenzhen(理工学院; 香港中文大学(深圳))
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本文提出一种评估视角,区分直接视觉可读性与任务信息可恢复性,通过书籍封面实验证明实体链接恢复在视觉退化下仍能获取信息,强调应沿指定途径评估任务信息。
AI 中文摘要
直接视觉可读性与任务信息可恢复性是两种不同的量。从固定观测中未能解码出目标,并不必然意味着无法通过其他恢复途径获取该目标。我们提出了一种评估视角,该视角明确观测、查询、目标及可用知识,并度量各途径成功集之间的重叠程度。对于在适当成像条件下原始可见表面上可用的信息,直接光学恢复从图像中读取目标,必要时可先进行恢复处理;实体链接恢复则利用残余视觉证据识别所描绘的实体,并通过指定知识资源中的实体-属性关系访问其目标。此类访问可借助存储知识或外部来源。一项受控的书籍封面研究以固定标题-作者目录实例化外部访问,比较了光学作者恢复与视觉标题解析及在分辨率退化下的确定性查找。实体链接成功在测试的视觉-语言模型中持续存在,尽管绝对性能存在显著差异,仍揭示了超出所测试直接视觉前沿的信息访问。仍存在一个相当大的仅光学区域。这些互补结果表明,视觉退化应通过指定途径和知识资源可访问的任务信息来评估,同时兼顾直接可读性。
英文摘要
Direct visual readability and task-information recoverability are different quantities. Failure to decode a target from a fixed observation need not eliminate access to that target through another recovery route. We develop an evaluation perspective that makes the observation, query, target, and available knowledge explicit and measures the overlap between routes' success sets. For information available on the original visible surface under suitable imaging conditions, direct optical recovery reads the target from the image, optionally after restoration; entity-linked recovery uses residual visual evidence to identify the depicted entity and accesses its target through an entity--attribute relation in a specified knowledge resource. Such access can draw on stored knowledge or an external source. A controlled book-cover study instantiates external access with a fixed title--author catalog, comparing optical author recovery with visual title resolution and deterministic lookup under resolution degradation. Entity-linked successes persist across the tested vision--language models, revealing information access beyond the tested direct visual frontier despite substantial differences in absolute performance. A substantial optical-only region remains. These complementary outcomes show why visual degradation should be evaluated through the task information accessible along specified routes and knowledge resources, alongside direct readability.