Contrast maximization (CMax) is a framework that provides state-of-the-art results on several event-based computer vision tasks, such as ego-motion or optical flow estimation. However, it may suffer from a problem called event collapse, which is an undesired solution where events are warped into too few pixels. As prior works have largely ignored the issue or proposed workarounds, it is imperative to analyze this phenomenon in detail. Our work demonstrates event collapse in its simplest form and proposes collapse metrics by using first principles of space-time deformation based on differential geometry and physics. We experimentally show on publicly available datasets that the proposed metrics mitigate event collapse and do not harm well-posed warps. To the best of our knowledge, regularizers based on the proposed metrics are the only effective solution against event collapse in the experimental settings considered, compared with other methods. We hope that this work inspires further research to tackle more complex warp models.
A Fast Geometric Regularizer to Mitigate Event Collapse in the Contrast Maximization Framework
Keio University(庆应义塾大学);Technische Universität Berlin(柏林工业大学);Einstein Center Digital Future(爱因斯坦数字未来中心);Science of Intelligence Excellence Cluster(科学智慧卓越集群)
Enhancing Information Maximization with Distance-Aware Contrastive Learning for Source-Free Cross-Domain Few-Shot Learning
University of Oulu(奥卢大学);National University of Defense Technology(国防科技大学);College of Electronic Science and Technology, National University of Defense Technology(国防科技大学电子科学学院);College of Computer, National University of Defense Technology(国防科技大学计算机学院);College of Computer Science, Nankai University(南开大学计算机学院)
Motion-prior Contrast Maximization for Dense Continuous-Time Motion Estimation
TU Berlin(柏林工业大学);SCIoI Excellence Cluster(SCIoI卓越集群);University of Pennsylvania(宾夕法尼亚大学);Einstein Center Digital Future(爱因斯坦数字未来中心);Robotics Institute Germany(德国机器人研究所);Archimedes(阿基米德机构);Athena RC(雅典娜研究中心)
Iterative Event-based Motion Segmentation by Variational Contrast Maximization
Keio University(庆应大学);Technische Universität Berlin(柏林技术大学);Einstein Center Digital Future(爱因斯坦数字未来研究中心);Science of Intelligence Excellence Cluster, Germany(德国智能科学卓越集群)