arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.20535cs.CVcs.AI
收藏

用于高效测试时训练的异步感知机

Asynchronous Perception Machine For Efficient Test-Time-Training

Centre for Research in Computer Vision(计算机视觉研究中心);University of Central Florida(中央佛罗里达大学)

Rajat Modi, Yogesh Singh Rawat

AI总结:

本文提出计算高效的异步感知机APM用于测试时训练,无需特定数据集预训练等即可识别分布外图像,与现有方法性能相当,还具有独特学习属性及超越TTT的应用,为验证GLOM见解提供证据,助力共享硬件实现插值和感知。

摘要:

在这项工作中,我们提出了异步感知机(APM),这是一种用于测试时训练(TTT)的计算高效架构。APM可以以任何顺序一次处理图像的补丁,并且仍然在网络中编码语义感知。我们展示了APM在无需特定数据集预训练、增强或任何前置任务的情况下识别分布外图像的能力。APM与现有TTT方法相比具有竞争力。为了执行TTT,APM只需一次提取测试样本的表示。APM具有独特属性:它可以仅使用此单一表示进行学习并开始预测语义感知特征。APM展示了超越测试时训练的潜在应用:它可以扩展到2D图像数据集并在单次前向传播中产生语义聚类。APM还为验证GLOM的见解提供了首个实证证据,即输入感知是一个场。因此,APM帮助我们朝着能够在共享连接主义硬件上进行插值和感知的实现方向发展。我们的代码可在此链接公开获取:此https URL。

英文摘要:

In this work, we propose Asynchronous Perception Machine (APM), a computationally-efficient architecture for test-time-training (TTT). APM can process patches of an image one at a time in any order asymmetrically and still encode semantic-awareness in the net. We demonstrate APM's ability to recognize out-of-distribution images without dataset-specific pre-training, augmentation or any-pretext task. APM offers competitive performance over existing TTT approaches. To perform TTT, APM just distills test sample's representation once. APM possesses a unique property: it can learn using just this single representation and starts predicting semantically-aware features. APM demostrates potential applications beyond test-time-training: APM can scale up to a dataset of 2D images and yield semantic-clusterings in a single forward pass. APM also provides first empirical evidence towards validating GLOM's insight, i.e. input percept is a field. Therefore, APM helps us converge towards an implementation which can do both interpolation and perception on a shared-connectionist hardware. Our code is publicly available at this link: https://rajatmodi62.github.io/apm_project_page/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑