As a beloved sport worldwide, dancing is getting integrated into traditional and virtual reality-based gaming platforms nowadays. It opens up new opportunities in the technology-mediated dancing space. These platforms primarily rely on passive and continuous human pose estimation as an input capture mechanism. Existing solutions are mainly based on RGB or RGB-Depth cameras for dance games. The former suffers in low-lighting conditions due to the motion blur and low sensitivity, while the latter is too power-hungry, has a low frame rate, and has limited working distance. With ultra-low latency, energy efficiency, and wide dynamic range characteristics, the event camera is a promising solution to overcome these shortcomings. We propose YeLan, an event camera-based 3-dimensional high-frequency human pose estimation(HPE) system that survives low-lighting conditions and dynamic backgrounds. We collected the world's first event camera dance dataset and developed a fully customizable motion-to-event physics-aware simulator. YeLan outperforms the baseline models in these challenging conditions and demonstrated robustness against different types of clothing, background motion, viewing angle, occlusion, and lighting fluctuations.
Bullying10K: A Large-Scale Neuromorphic Dataset towards Privacy-Preserving Bullying Recognition
University of Chinese Academy of Sciences(中国科学院大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Center for Long-term Artificial Intelligence(长期人工智能研究中心)
Inria(法国国家信息与自动化研究所);Univ. Grenoble Alpes(格勒诺布尔阿尔卑斯大学);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔国立理工学院);Institut de Robòtica i Informàtica Industrial, CSIC-UPC(西班牙国家研究委员会-加泰罗尼亚理工大学工业机器人与信息技术研究所)
USP-Gaussian: Unifying Spike-based Image Reconstruction, Pose Correction and Gaussian Splatting
School of Computer Science, Peking University(北京大学计算机科学学院);State Key Laboratory for Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
EgoMusic-driven Human Dance Motion Estimation with Skeleton Mamba
FPT Software AI Center(FPT软件AI中心);The University of Western Australia(西澳大学);TU Wien(维也纳技术大学);Meta;University of Arkansas(阿肯色大学);National University of Singapore(新加坡国立大学);University of Liverpool(利物浦大学)
ESVO2: Direct Visual-Inertial Odometry with Stereo Event Cameras
School of Robotics, Hunan University(湖南大学机器人学院);Neuromorphic Automation and Intelligence Lab (NAIL)(神经形态自动化与智能实验室);Department of Electronic and Computer Engineering(电子与计算机工程系);Hong Kong University of Science and Technology(香港科学与技术大学);TU Berlin(柏林工业大学);Science of Intelligence Excellence Cluster(智能科学卓越集群);Robotics Institute Germany(德国机器人研究所);Einstein Center Digital Future(爱因斯坦中心数字未来)
UTA-Sign: Unsupervised Thermal Video Augmentation via Event-Assisted Traffic Signage Sketching
School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院);Deparment of Automation, Tsinghua University(清华大学自动化系);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电子与电气工程学院)
Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Application
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);The University of Hong Kong(香港大学);Global Innovation Exchange, Tsinghua University(清华大学全球创新交换)