arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.02404cs.CVcs.AI
收藏

受扰动但稳定:CNN、ViT和自监督ViT中的人猫不变表征

Purrturbed but Stable: Human-Cat Invariant Representations Across CNNs, ViTs and Self-Supervised ViTs

Department of Computer Science, Indian Institute of Technology Gandhinagar(计算机科学系,印度理工学院冈德辛纳加尔)

Arya Shah, Vaibhav Tripathi

AI总结:

提出统一冻结编码器基准,通过CKA和RSA量化多类视觉模型的人猫跨物种表征对齐,发现自监督DINO ViT对齐最佳,为跨物种视觉计算提供神经科学假设。

摘要:

猫和人类在眼部解剖结构上存在差异。最显著的是,Felis Catus(家猫)具有与伏击捕食相关的垂直拉长瞳孔;然而,这种特化如何体现在下游视觉表征中仍不完全清楚。我们提出了一个统一的冻结编码器基准,使用逐层中心化核对齐(线性和RBF)和表征相似性分析,量化卷积网络、有监督Vision Transformers、窗口化transformers和自监督ViTs(DINO)在自然环境下的人猫跨物种表征对齐情况,论文中还报告了额外的分布和稳定性测试。在所有模型中,DINO ViT-B/16实现了最显著的对齐(平均CKA-RBF≈0.814,平均CKA-linear≈0.745,平均RSA≈0.698),在早期块达到峰值,表明token级自监督诱导了桥接物种特定统计特征的早期特征。有监督ViTs在CKA上具竞争力,但几何对应弱于DINO(如ViT-B/16在block8处RSA≈0.53;ViT-L/16在block14处≈0.47),揭示了相似性与表征几何间依赖深度的分歧。CNNs是强基线但在对齐上低于普通ViTs,窗口化transformers表现不如普通ViTs,表明架构归纳偏置影响跨物种对齐。结果表明,自监督与ViT归纳偏置结合产生的表征几何比广泛使用的CNNs和窗口化Transformers更紧密地契合猫和人类视觉系统,为跨物种视觉计算在何处及如何趋同提供了可测试的神经科学假设。我们发布了代码和数据集供参考和复现。

英文摘要:

Cats and humans differ in ocular anatomy. Most notably, Felis Catus (domestic cats) have vertically elongated pupils linked to ambush predation; yet, how such specializations manifest in downstream visual representations remains incompletely understood. We present a unified, frozen-encoder benchmark that quantifies feline-human cross-species representational alignment in the wild, across convolutional networks, supervised Vision Transformers, windowed transformers, and self-supervised ViTs (DINO), using layer-wise Centered Kernel Alignment (linear and RBF) and Representational Similarity Analysis, with additional distributional and stability tests reported in the paper. Across models, DINO ViT-B/16 attains the most substantial alignment (mean CKA-RBF $\approx0.814$, mean CKA-linear $\approx0.745$, mean RSA $\approx0.698$), peaking at early blocks, indicating that token-level self-supervision induces early-stage features that bridge species-specific statistics. Supervised ViTs are competitive on CKA yet show weaker geometric correspondence than DINO (e.g., ViT-B/16 RSA $\approx0.53$ at block8; ViT-L/16 $\approx0.47$ at block14), revealing depth-dependent divergences between similarity and representational geometry. CNNs remain strong baselines but below plain ViTs on alignment, and windowed transformers underperform plain ViTs, implicating architectural inductive biases in cross-species alignment. Results indicate that self-supervision coupled with ViT inductive biases yields representational geometries that more closely align feline and human visual systems than widely used CNNs and windowed Transformers, providing testable neuroscientific hypotheses about where and how cross-species visual computations converge. We release our code and dataset for reference and reproducibility.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑