In this work, we propose Asynchronous Perception Machine (APM), a computationally-efficient architecture for test-time-training (TTT). APM can process patches of an image one at a time in any order asymmetrically and still encode semantic-awareness in the net. We demonstrate APM's ability to recognize out-of-distribution images without dataset-specific pre-training, augmentation or any-pretext task. APM offers competitive performance over existing TTT approaches. To perform TTT, APM just distills test sample's representation once. APM possesses a unique property: it can learn using just this single representation and starts predicting semantically-aware features.
APM demostrates potential applications beyond test-time-training: APM can scale up to a dataset of 2D images and yield semantic-clusterings in a single forward pass. APM also provides first empirical evidence towards validating GLOM's insight, i.e. input percept is a field. Therefore, APM helps us converge towards an implementation which can do both interpolation and perception on a shared-connectionist hardware. Our code is publicly available at this link: https://rajatmodi62.github.io/apm_project_page/.
CoDynTrust: Robust Asynchronous Collaborative Perception via Dynamic Feature Trust Modulus
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);School of Future Science and Engineering, Soochow University(苏州大学未来科学与工程学院);City University of Hong Kong(香港城市大学)
EgoRefine: Ego-Referenced Predictive Alignment and Trajectory-Conditioned Reliability-Aware Fusion for Asynchronous Collaborative Perception
Hunan University(湖南大学);National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University(湖南大学机器人视觉感知与控制技术国家工程研究中心);Nanjing University of Posts and Telecommunications(南京邮电大学)
CADENet: Condition-Adaptive Asynchronous Dual-Stream Enhancement Network for Adverse Weather Perception in Autonomous Driving
Computer Science & Engineering Department, German University in Cairo (GUC), Egypt(德国开罗大学(GUC)计算机科学与工程系,埃及);C-DRiVeS Lab: Cognitive Driving Research in Vehicular Systems, Cairo, Egypt(认知驾驶系统实验室(C-DRiVeS Lab),开罗,埃及)
A biological vision inspired framework for machine perception of abutting grating illusory contours
Sichuan Cancer Hospital & Institute, School of Life Science and Technology, University of Electronic Science and Technology of China(四川肿瘤医院及研究院、电子科技大学生命科学与技术学院)