认证的接口别名:视觉-语言预处理中的精确碰撞及其存在条件
Certified Interface Aliases: Exact Collisions in Vision-Language Preprocessing, and When They Exist
AI总结:
提出AliasForge,通过定点重采样构造视觉-语言预处理中的精确碰撞,证明验证器无法区分相反标签的图像,并给出存在性准则与认证结果。
AI中文摘要:
视觉-语言验证器和路由器必须区分可通过更多推理修复的错误与由视觉证据从未到达语言模型而导致的错误。这种区分缺乏地面真值,因为标注者看到的是全分辨率图像,而模型接收的是预处理后的张量。我们引入了AliasForge来构造相关事实可证明地不存在于接口中的案例。定点重采样使预舍入的缩放成为一个精确的整数线性映射,该映射可以将非零整数扰动发送到零。在那里隐藏一个翻转标签的扰动,会产生具有相反逐步正确性标签但接口状态比特级相同的图像。因此,每个验证器在两个成员上具有相同的输出规律,给出配对平衡准确率恰好为二分之一,并且从语言侧修复的增益为零。我们证明了每个定点下采样器都有这样的零向量,并界定了它们在最常见比率下的最小尺寸,这排除了当界限超过255时的8位拟合。仅从缩放配置来看,一个格准则提供了可实现的碰撞,并证明了它们在指定构造族内的缺失。它解决了所有20个筛选配置,其中17个可构造,3个不可构造。我们构造了跨三个架构的认证配对,并认证了四个额外的处理器,在所有18个评分配对和18个对照中决策逻辑间隙为零。这些配对还筛选了在重新注意力或进一步推理上浪费计算的路由器。在自然项目上,逐项目路由余量存在,但没有任何仅接口的路由器优于停止。我们的光纤上限界定了可从接口恢复的余量。代码:此https URL。
英文摘要:
Vision-language verifiers and routers must distinguish errors repairable by more reasoning from those caused by visual evidence never reaching the language model. This distinction lacks ground truth because annotators see full-resolution images while models receive preprocessed tensors. We introduce AliasForge to create cases where the relevant fact is provably absent from the interface. Fixed-point resampling makes the pre-rounding resize an exact integer linear map that can send nonzero integer perturbations to zero. Hiding a label-flipping perturbation there produces images with opposite step-correctness labels but bit-identical interface states. Every verifier therefore has the same output law on both members, giving pair-balanced accuracy exactly one half and zero gain from language-side repair. We prove that every fixed-point downscaler has such null vectors and bound their smallest size at the most common ratios, which rules out an 8-bit fit whenever the bound exceeds 255. From the resize configuration alone, a lattice criterion supplies realizable collisions and certifies their absence within the specified construction family. It resolves all 20 screened configurations, 17 as constructible and 3 as non-constructible. We construct certified pairs across three architectures and certify four additional processors, with zero decision-logit gap on all 18 scored pairs and none of the 18 controls. The pairs also screen routers that waste computation on re-attention or further reasoning. On natural items, per-item routing headroom exists, but no tested interface-only router improves over stopping. Our fiber ceiling bounds the headroom recoverable from the interface. Code: https://github.com/KurbanIntelligenceLab/aliasforge.