针对密集4D光场的能量压缩问题,设计了基于几何感知的局部图变换。局部图是在超射线上构建的,超射线可以被看作是空间和几何相关的角度相关像素的分组。不可分离和可分离的转换被认为是。尽管由超射线定义的有限大小的局部支持,不可分图的拉普拉斯矩阵仍然是高维的,并且其对角化以计算变换特征向量仍然是计算昂贵的。为了解决这个问题,我们然后执行本地空间角度变换在一个可分离的方式。我们发现,当不同视图中对应的超像素的形状不是等距的时,空间变换的基函数是不相干的,导致空间变换系数之间的相关性降低。因此,我们提出了一种新的变换优化方法,旨在保持角度相关性,即使当超像素的形状不是等距的。实验结果表明该方法在能量压缩方面的好处。还描述了一种编码方案,以评估所提出的变换的率失真性能,并将其与现有技术的编码器(即HEVC和JPEG Pleno VM 1.1)进行比较。
英文摘要:
The paper addresses the problem of energy compaction of dense 4D light fields by designing geometry-aware local graph-based transforms. Local graphs are constructed on super-rays that can be seen as a grouping of spatially and geometry-dependent angularly correlated pixels. Both non separable and separable transforms are considered. Despite the local support of limited size defined by the super-rays, the Laplacian matrix of the non separable graph remains of high dimension and its diagonalization to compute the transform eigen vectors remains computationally expensive. To solve this problem, we then perform the local spatio-angular transform in a separable manner. We show that when the shape of corresponding super-pixels in the different views is not isometric, the basis functions of the spatial transforms are not coherent, resulting in decreased correlation between spatial transform coefficients. We hence propose a novel transform optimization method that aims at preserving angular correlation even when the shapes of the super-pixels are not isometric. Experimental results show the benefit of the approach in terms of energy compaction. A coding scheme is also described to assess the rate-distortion perfomances of the proposed transforms and is compared to state of the art encoders namely HEVC and JPEG Pleno VM 1.1.
Uncertainty-Aware Knowledge Distillation for Compact and Efficient 6DoF Pose Estimation
SnT, University of Luxembourg(卢森堡大学SnT分校);Cristal Lab, ENSI, University of Manouba(曼努巴大学ENSI的Cristal实验室);Infinite Orbits, Toulouse(图卢兹的Infinite Orbits)
Pre-training Point Cloud Compact Model with Partial-aware Reconstruction
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Research Center of Artificial Intelligence, Peng Cheng Laboratory(鹏城实验室人工智能研究中心);College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机与软件学院)
PolyRoom: Room-aware Transformer for Floorplan Reconstruction
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Ocean University of China(中国海洋大学);Wuhan University(武汉大学)
ART: Adaptive Relational Transformer for Pedestrian Trajectory Prediction with Temporal-Aware Relations
Department of Computer Science, Durham University(杜伦大学计算机科学系);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院)
SBAT: Video Captioning with Sparse Boundary-Aware Transformer
College of Information Science & Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院);Baidu Research(百度研究院);Alibaba Group(阿里巴巴集团);Department of Computer Science, Binghamton University(宾汉姆顿大学计算机科学系)