arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2210.11389cs.CVcs.AIcs.LG

TTTFlow: Unsupervised Test-Time Training with Normalizing Flow

LIVIA, ÉTS Montréal(蒙特利尔高等技术学院LIVIA实验室);International Laboratory on Learning Systems (ILLS)(国际学习系统实验室(ILLS));ÉTS Montréal(蒙特利尔高等技术学院);MILA(蒙特利尔学习算法研究所);CNRS(法国国家科学研究中心);Université Paris-Saclay(巴黎萨克雷大学);CentraleSupélec(中央理工-高等电力学院)

David Osowiechi, Gustavo A. Vargas Hakim, Mehrdad Noori, Milad Cheraghalikhani, Ismail Ben Ayed, Christian Desrosiers

英文摘要:

A major problem of deep neural networks for image classification is their vulnerability to domain changes at test-time. Recent methods have proposed to address this problem with test-time training (TTT), where a two-branch model is trained to learn a main classification task and also a self-supervised task used to perform test-time adaptation. However, these techniques require defining a proxy task specific to the target application. To tackle this limitation, we propose TTTFlow: a Y-shaped architecture using an unsupervised head based on Normalizing Flows to learn the normal distribution of latent features and detect domain shifts in test examples. At inference, keeping the unsupervised head fixed, we adapt the model to domain-shifted examples by maximizing the log likelihood of the Normalizing Flow. Our results show that our method can significantly improve the accuracy with respect to previous works.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑