The standard approach to densely reconstruct the motion in a volume of fluid is to inject high-contrast tracer particles and record their motion with multiple high-speed cameras. Almost all existing work processes the acquired multi-view video in two separate steps, utilizing either a pure Eulerian or pure Lagrangian approach. Eulerian methods perform a voxel-based reconstruction of particles per time step, followed by 3D motion estimation, with some form of dense matching between the precomputed voxel grids from different time steps. In this sequential procedure, the first step cannot use temporal consistency considerations to support the reconstruction, while the second step has no access to the original, high-resolution image data. Alternatively, Lagrangian methods reconstruct an explicit, sparse set of particles and track the individual particles over time. Physical constraints can only be incorporated in a post-processing step when interpolating the particle tracks to a dense motion field. We show, for the first time, how to jointly reconstruct both the individual tracer particles and a dense 3D fluid motion field from the image data, using an integrated energy minimization. Our hybrid Lagrangian/Eulerian model reconstructs individual particles, and at the same time recovers a dense 3D motion field in the entire domain. Making particles explicit greatly reduces the memory consumption and allows one to use the high-res input images for matching. Whereas the dense motion field makes it possible to include physical a-priori constraints and account for the incompressibility and viscosity of the fluid. The method exhibits greatly (~70%) improved results over our recently published baseline with two separate steps for 3D reconstruction and motion estimation. Our results with only two time steps are comparable to those of sota tracking-based methods that require much longer sequences.
FluidGaussian: Propagating Simulation-Based Uncertainty Toward Functionally-Intelligent 3D Reconstruction
Simon Fraser University(西蒙弗雷泽大学);Lawrence Berkeley National Lab(劳伦斯伯克利国家实验室);University of California, Berkeley(加州大学伯克利分校);International Computer Science Institute(国际计算机科学研究所)
Physics Informed Neural Fields for Smoke Reconstruction with Sparse Data
Max Planck Institute for Informatics, SIC(马克斯·普朗克信息学研究所SIC);Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);Technical University of Munich(慕尼黑工业大学)
Integrated Forward-Inverse Network for Lensless Image Reconstruction
Department of Mechanical Engineering, Seoul National University(韩国首尔国立大学机械工程系);School of Mechanical and Aerospace Engineering/SNU-IAMD, Seoul National University(韩国首尔国立大学机械与航空航天工程学院/SNU-IAMD);Department of Electrical and Electronic Engineering, Yonsei University(韩国延世大学电气与电子工程系);Department of Biomedical Engineering, University of Michigan(美国密歇根大学安娜堡分校生物医学工程系)
Unrolled Reconstruction with Integrated Super-Resolution for Accelerated 3D LGE MRI
Kahlert School of Computing, University of Utah, Salt Lake City, UT, USA Radiology \& Imaging Sciences, University of Utah, Salt Lake City, UT, USA Cardiology, University of Utah, Salt Lake City, UT, USA
FINDER: Zero-Shot Field-Integrated Network for Distortion-free EPI Reconstruction in Diffusion MRI
Sejong University(世宗大学);Forschungszentrum Jülich(于利希研究中心);Athinoula A. Martinos Center for Biomedical Imaging(Athinoula A. Martinos生物医学成像中心);Harvard Medical School(哈佛医学院);Hongik University(弘益大学)
Calibration & Reconstruction: Deep Integrated Language for Referring Image Segmentation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Integrated Image Reconstruction and Target Recognition based on Deep Learning Technique
Wharton Research Data Services University of Pennsylvania(宾夕法尼亚大学沃顿研究数据服务);Centre for Wireless Innovation Queen’s University Belfast(女王大学贝尔法斯特无线创新中心);Department of Electrical Engineering City University of Hong Kong(香港城市大学电气工程系)
URA-Net: Uncertainty-Integrated Anomaly Perception and Restoration Attention Network for Unsupervised Anomaly Detection
State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University(精密测量技术与仪器国家重点实验室,清华大学精密仪器系);State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology(智能制造装备与技术国家重点实验室,华中科技大学);School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院)
Dual-Integrated Low-Latency Single-Lens Infrared Computational Imaging for Object Detection
MOE Key Laboratory of Advanced Micro-Structured Materials(教育部先进微结构材料重点实验室);Institute of Precision Optical Engineering(精密光学工程研究院);School of Physics Science and Engineering(物理科学与工程学院);Shanghai Frontiers Science Center of Digital Optics(上海前沿科学中心数字光学中心);School of Computer Science and Artificial Intelligence(计算机科学与人工智能学院);Shandong Normal University(山东师范大学);Shandong Engineering Research Center for Multimodal Computing and Intelligent Decision Making(山东省多模态计算与智能决策中心)