Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation
TU Berlin(柏林工业大学);SCIoI Excellence Cluster(SCIoI卓越集群);University of Pennsylvania(宾夕法尼亚大学);Einstein Center Digital Future(爱因斯坦数字未来中心);Robotics Institute Germany(德国机器人研究所);Archimedes(阿基米德机构);Athena RC(雅典娜研究中心)
Current optical flow and point-tracking methods rely heavily on synthetic datasets. Event cameras are novel vision sensors with advantages in challenging visual conditions, but state-of-the-art frame-based methods cannot be easily adapted to event data due to the limitations of current event simulators. We introduce a novel self-supervised loss combining the Contrast Maximization framework with a non-linear motion prior in the form of pixel-level trajectories and propose an efficient solution to solve the high-dimensional assignment problem between non-linear trajectories and events. Their effectiveness is demonstrated in two scenarios: In dense continuous-time motion estimation, our method improves the zero-shot performance of a synthetically trained model on the real-world dataset EVIMO2 by 29%. In optical flow estimation, our method elevates a simple UNet to achieve state-of-the-art performance among self-supervised methods on the DSEC optical flow benchmark. Our code is available at https://github.com/tub-rip/MotionPriorCMax.
A Fast Geometric Regularizer to Mitigate Event Collapse in the Contrast Maximization Framework
Keio University(庆应义塾大学);Technische Universität Berlin(柏林工业大学);Einstein Center Digital Future(爱因斯坦数字未来中心);Science of Intelligence Excellence Cluster(科学智慧卓越集群)
Iterative Event-based Motion Segmentation by Variational Contrast Maximization
Keio University(庆应大学);Technische Universität Berlin(柏林技术大学);Einstein Center Digital Future(爱因斯坦数字未来研究中心);Science of Intelligence Excellence Cluster, Germany(德国智能科学卓越集群)
Dense Semantic Contrast for Self-Supervised Visual Representation Learning
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);University of Chinese Academy of Sciences(中国科学院大学);Mashang Consumer Finance Co., Ltd.(马上消费金融股份有限公司)
Homeomorphism Prior for False Positive and Negative Problem in Medical Image Dense Contrastive Representation Learning
Southeast University(东南大学);Centre de Recherche en Information Biomédicale Sino-Français (CRIBs)(中法生物医学信息研究中心(CRIBs));Jiangsu Provincial Joint International Research Laboratory of Medical Information Processing(江苏省医疗信息处理联合国际研究实验室);School of Instrument Science and Engineering, Southeast University(东南大学仪器科学与工程学院);Western University(西安大略大学);Case Western Reserve University(凯斯西储大学)
ZScribbleSeg: A comprehensive segmentation framework with modeling of efficient annotation and maximization of scribble supervision
School of Data Science, Fudan University, Shanghai, 200433, China(复旦大学数据科学学院);Department of Electrical and Computer Engineering, Johns Hopkins University, Baltimore, USA(约翰霍普金斯大学电气与计算机工程系)