Quanzhen Wan
A real-time elemental image array (EIA) generation method which does not sacrifice accuracy nor rely on high-performance hardware is developed, through raytracing and pre-stored voxel-pixel lookup table (LUT). Benefiting from both offline and online working flow, experiments will verified the effectiveness.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
继续探索
A Real-world Display Inverse Rendering Dataset
针对显示器-相机系统缺乏公开真实世界逆渲染数据集的问题，本文构建并校准了含LCD显示器和立体偏振相机的系统，捕获多样物体的逐光（OLAT）模式数据及真实几何形状，提供合成工具并评估现有方法，提出更优基线。
Snapshot Polarimetric Display Inverse Rendering
本文提出一种快照偏振显示逆渲染方法，利用LCD投影线性偏振RGB图案和偏振相机获取光谱偏振测量，通过前馈Transformer预测每像素法线、反照率、粗糙度和金属度，在真实桌面场景中优于现有方法。
DirectL: Efficient Radiance Fields Rendering for 3D Light Field Displays
DirectL提出面向3D光场显示器的辐射场高效渲染范式，通过子像素重利用直接渲染光场图像，相比标准方法提速40倍且不损质量，可无缝集成至后续任务。
Light Field Display Point Rendering
本研究提出LFDPR方法，通过改进点渲染和引入多视图mipmapping等技术，提升光场显示的实时渲染效率与图像质量。
PowerGS: Display-Rendering Power Co-Optimization for Neural Rendering in Power-Constrained XR Systems
PowerGS提出首个在质量约束下联合优化3DGS渲染与显示功率的框架，通过等质量曲线和闭式解实现高达86%的总功率降低。
Most commercially available optical see-through head-mounted displays (OST-HMDs) utilize optical combiners to simultaneously visualize the physical background and virtual objects. The displayed images perceived by users are a blend of rendered pixels and background colors. Enabling high fidelity color perception in mixed reality (MR) scenarios using OST-HMDs is an important but challenging task. We propose a real-time rendering scheme to enhance the color contrast between virtual objects and the surrounding background for OST-HMDs. Inspired by the discovery of color perception in psychophysics…
The goal of inverse rendering is to decompose geometry, lights, and materials given pose multi-view images. To achieve this goal, we propose neural direct and joint inverse rendering, NDJIR. Different from prior works which relies on some approximations of the rendering equation, NDJIR directly addresses the integrals in the rendering equation and jointly decomposes geometry: signed distance function, lights: environment and implicit lights, materials: base color, roughness, specular reflectance using the powerful and flexible volume rendering framework, voxel grid feature, and Bayesian prior.…
Visual Acuity Consistent Foveated Rendering towards Retinal Resolution
本文提出视觉锐度一致性注视点渲染VaFR，通过基于人类视觉锐度模型的对数极坐标映射函数，在视网膜分辨率下保持感知质量并显著提升渲染速度。
We develop a framework for rendering photographic images, taking into account display limitations, so as to optimize perceptual similarity between the rendered image and the original scene. We formulate this as a constrained optimization problem, in which we minimize a measure of perceptual dissimilarity, the Normalized Laplacian Pyramid Distance (NLPD), which mimics the early stage transformations of the human visual system. When rendering images acquired with higher dynamic range than that of the display, we find that the optimized solution boosts the contrast of low-contrast features withou…
Recent advances in differentiable rendering have enabled high-quality reconstruction of 3D scenes from multi-view images. Most methods rely on simple rendering algorithms: pre-filtered direct lighting or learned representations of irradiance. We show that a more realistic shading model, incorporating ray tracing and Monte Carlo integration, substantially improves decomposition into shape, materials & lighting. Unfortunately, Monte Carlo integration provides estimates with significant noise, even at large sample counts, which makes gradient-based inverse rendering very challenging. To address t…
Fast Wave-optics Rendering of Multiplane Images for 3D Holographic Displays
针对神经渲染在2D设备上查看限制感知真实感问题，提出基于多平面图像的波光学渲染管道，该算法在运行时大幅超越现有算法，速度提升显著，且图像质量优，经多数据集验证性能出色。
While the presentation of photo-realistic appearance plays a major role in immersion in an augmented virtuality environment, displaying the photo-realistic appearance of real objects remains a challenging problem. Recent developments in photogrammetry have facilitated the incorporation of real objects into virtual space. However, photo-realistic photogrammetry requires a dedicated measurement environment, and there is a trade-off between measurement cost and quality. Furthermore, even with photo-realistic appearance measurements, there is a trade-off between rendering quality and framerate. Th…
Inverse rendering seeks to estimate scene characteristics from a set of data images. The dominant approach is based on differential rendering using Monte-Carlo. Algorithms as such usually rely on a forward model and use an iterative gradient method that requires sampling millions of light paths per iteration. This paper presents an efficient framework that speeds up existing inverse rendering algorithms. This is achieved by tailoring the iterative process of inverse rendering specifically to a GPU architecture. For this cause, we introduce two interleaved steps - Path Sorting and Path Recyclin…
LentiAvatar: Pseudo-Multiview Reconstruction and Subpixel Prism Rendering for Real-Time Stereoscopic Communication
提出PrismAvatar系统，通过单目视频重建可控头部化身，并利用亚像素编码光栅实现实时裸眼立体通信，采用伪多视图监督和轮廓感知损失提升侧视质量。
We propose a scene-level inverse rendering framework that uses multi-view images to decompose the scene into geometry, a SVBRDF, and 3D spatially-varying lighting. Because multi-view images provide a variety of information about the scene, multi-view images in object-level inverse rendering have been taken for granted. However, owing to the absence of multi-view HDR synthetic dataset, scene-level inverse rendering has mainly been studied using single-view image. We were able to successfully perform scene-level inverse rendering using multi-view images by expanding OpenRooms dataset and designi…
With the recent interest in virtual reality and augmented reality, there is a newfound demand for displays that can provide high resolution with a wide field of view (FOV). However, such displays incur significantly higher costs for rendering the larger number of pixels. This poses the challenge of rendering realistic real-time images that have a wide FOV and high resolution using limited computing resources. The human visual system does not need every pixel to be rendered at a uniformly high quality. Foveated rendering methods provide perceptually high-quality images while reducing computatio…
Evaluating Foveated Frame Rate Reduction in Virtual Reality for Head-Mounted Displays
本文通过15名参与者的VR用户研究，验证了仅降低周边注视区域帧率可在用户明显感知伪影前大幅减少渲染像素数量，为头显性能优化提供依据。
Real-time 3D Visualization of Radiance Fields on Light Field Displays
针对光场显示需要多视角高分辨率渲染而辐射场计算密集的问题，提出统一高效框架，通过共享中间扫描平面单次合成密集光场视图，实现实时渲染（200+ FPS），速度提升22倍。
Rotated Lights for Consistent and Efficient 2D Gaussians Inverse Rendering
RotLight通过旋转物体减少逆渲染中的模糊性，结合代理网格提升全局光照处理，实现更准确的albedo估计。
This paper presents a Progressively-connected Light Field network (ProLiF), for the novel view synthesis of complex forward-facing scenes. ProLiF encodes a 4D light field, which allows rendering a large batch of rays in one training step for image- or patch-level losses. Directly learning a neural light field from images has difficulty in rendering multi-view consistent images due to its unawareness of the underlying 3D geometry. To address this problem, we propose a progressive training scheme and regularization losses to infer the underlying geometry during training, both of which enforce th…
We present a method for composing photorealistic scenes from captured images of objects. Our work builds upon neural radiance fields (NeRFs), which implicitly model the volumetric density and directionally-emitted radiance of a scene. While NeRFs synthesize realistic pictures, they only model static scenes and are closely tied to specific imaging conditions. This property makes NeRFs hard to generalize to new scenarios, including new lighting or new arrangements of objects. Instead of learning a scene radiance field as a NeRF does, we propose to learn object-centric neural scattering functions…
DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models
针对经典PBR依赖难获取的精确场景表示的问题，提出DiffusionRenderer，依托视频扩散模型先验实现统一的神经逆向与正向渲染，性能优于SOTA，支持单视频的重光照等应用。
We suggest a rasterization pipeline tailored towards the need of head-mounted displays (HMD), where latency and field-of-view requirements pose new challenges beyond those of traditional desktop displays. Instead of rendering and warping for low latency, or using multiple passes for foveation, we show how both can be produced directly in a single perceptual rasterization pass. We do this with per-fragment ray-casting. This is enabled by derivations of tight space-time-fovea pixel bounds, introducing just enough flexibility for requisite geometric tests, but retaining most of the the simplicity…
Perceptual Requirements for World-Locked Rendering in AR and VR
本文构建无可见漂移的世界锁定渲染实验平台，测量AR与VR中渲染相机位置误差的感知阈值，并提出解析模型解释深度与视觉方向变化。
With the increasing computational power of today's workstations, real-time physically-based rendering is within reach, rapidly gaining attention across a variety of domains. These have expeditiously applied to medicine, where it is a powerful tool for intuitive 3D data visualization. Embedded devices such as optical see-through head-mounted displays (OST HMDs) have been a trend for medical augmented reality. However, leveraging the obvious benefits of physically-based rendering remains challenging on these devices because of limited computational power, memory usage, and power consumption. We …
Recently neural volumetric representations such as neural reflectance fields have been widely applied to faithfully reproduce the appearance of real-world objects and scenes under novel viewpoints and lighting conditions. However, it remains challenging and time-consuming to render such representations under complex lighting such as environment maps, which requires individual ray marching towards each single light to calculate the transmittance at every sampled point. In this paper, we propose a novel method based on precomputed Neural Transmittance Functions to accelerate the rendering of neu…
RenderCore -- a new WebGPU-based rendering engine for ROOT-EVE
本研究将面向图形学研究的RenderCore渲染引擎集成进ROOT-Eve事件显示模块，并基于下一代浏览器GPU接口WebGPU重构该引擎，优化了渲染性能与数据传输效率，在CMS实验的高数据量物理事件显示中验证了效果。
AEGIR: Modeling Area Emitters for Indoor Inverse Rendering using Gaussian Splatting
提出AEGIR框架，在可重光照高斯泼溅表示中显式建模局部面光源，通过可微延迟渲染管线结合多重重要性采样与正则化，实现更一致的照明与材质分解，提升局部光照场景的重光照效果。
Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relighting
针对逆渲染评估缺乏真实重光照数据的问题，本文提出带光照物体的真实世界数据集，构建现成方法基线并测试多种SOTA方法，证明新视角合成不能可靠衡量重光照性能。
The quest for deeper understanding of biological systems has driven the acquisition of increasingly larger multidimensional image datasets. Inspecting and manipulating data of this complexity is very challenging in traditional visualization systems. We developed syGlass, a software package capable of visualizing large scale volumetric data with inexpensive virtual reality head-mounted display technology. This allows leveraging stereoscopic vision to significantly improve perception of complex 3D structures, and provides immersive interaction with data directly in 3D. We accomplished this by de…
Real-time Image-based Lighting of Glints
本文提出一种基于图像光照的实时闪光渲染近似方法，通过将环境贴图划分为均匀区域并用双门控高斯近似二项分布进行分层采样，实现动态材质下的高效稳定闪光渲染，性能接近真实渲染且开销极低。
Light Sampling Field and BRDF Representation for Physically-based Neural Rendering
本文提出光采样场和BRDF表示，用于构建基于物理的神经面部皮肤着色器，以消除设备依赖并提升PBR渲染质量与效率。
PS-GS: Gaussian Splatting for Multi-View Photometric Stereo
本文提出 PS-GS，将 Gaussian Splatting 与多视图光度立体视觉结合，通过延迟逆渲染、法线正则化和光线追踪联合恢复几何、材质与光照，提升重建精度与效率。
Ambient-robust Inverse Rendering using Active RGB-NIR Imaging
提出一种利用主动RGB-NIR成像的三阶段逆渲染方法，通过结合环境光照下的多视角RGB图像和主动NIR闪光图像，实现对外部光照变化鲁棒的几何与反射率重建。
While ray tracing has become increasingly common and path tracing is well understood by now, a major challenge lies in crafting an easy-to-use and efficient system implementing these technologies. Following a purely physically-based paradigm while still allowing for artistic workflows, the Iray light transport simulation and rendering system allows for rendering complex scenes by the push of a button and thus makes accurate light transport simulation widely available. In this document we discuss the challenges and implementation choices that follow from our primary design decisions, demonstrat…
Recent works have shown exciting results in unsupervised image de-rendering -- learning to decompose 3D shape, appearance, and lighting from single-image collections without explicit supervision. However, many of these assume simplistic material and lighting models. We propose a method, termed RADAR, that can recover environment illumination and surface materials from real single-image collections, relying neither on explicit 3D supervision, nor on multi-view or multi-light images. Specifically, we focus on rotationally symmetric artefacts that exhibit challenging surface properties including …
Perceptual error optimization for Monte Carlo animation rendering
针对蒙特卡洛渲染独立估像素致误差白噪声分布、现有蓝噪声优化多忽略动画时间感知效应的问题，提出同时考量时空域的感知误差优化算法，验证了其有效性。
IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images
提出 IRIS 框架，从多视角 LDR 图像联合恢复室内场景的物理材质、空间变化 HDR 光照和相机响应函数，降低逆向渲染使用门槛。
Pointersect: Neural Rendering with Cloud-Ray Intersection
本文提出 Pointersect，通过 set transformer 直接估计光线与点云底层表面的交点及法向量等信息，无需场景优化即可实现高质量神经渲染、逆渲染与全局光照。
GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians
提出GaussianHair显式头发表示方法，将发丝建模为相连的圆柱形3D高斯基元并结合GaussianHair Scattering Model，实现了高保真几何与外观重建，支持编辑、重照明与动态渲染。
Multi-scale Attention-Guided Intrinsic Decomposition and Rendering Pass Prediction for Facial Images
MAGINet通过多尺度注意力引导的网络，从单张RGB图像预测512×512的漫反射albedo地图，并生成五个物理渲染通道，实现高保真度的面部内在分解与重照明。
Physically based rendering is a discipline in computer graphics which aims at reproducing certain light and material appearances that occur in the real world. Complex scenes can be difficult to compute for rendering algorithms. This paper introduces a new comprehensive test database of scenes that treat different light setups in conjunction with diverse materials and discusses its design principles. A lot of research is focused on the development of new algorithms that can deal with difficult light conditions and materials efficiently. This database delivers a comprehensive foundation for eval…
Triplet: Triangle Patchlet for Mesh-Based Inverse Rendering and Scene Parameters Approximation
本文提出基于网格的Triangle Patchlet（Triplet）框架，通过光栅化、光线追踪及迭代网格提取等技术，在无先验条件下统一估计光照、材质与几何，实现了最先进的视觉质量与高精度逆向渲染。
We propose an image warping-based remote rendering technique for volumes that decouples the rendering and display phases. Our work builds on prior work that samples the volume on the client using ray casting and reconstructs a z-value based on some heuristic. The color and depth buffer are then sent to the client that reuses this depth image as a stand-in for subsequent frames by warping it according to the current camera position until new data was received from the server. We augment that method by implementing the client renderer using ray tracing. By representing the pixel contributions as…
3D Gaussian Splatting for Real-Time Radiance Field Rendering
本文提出3D高斯泼溅方法，通过稀疏点初始化、交错优化与密度控制以及可见性感知渲染算法，在1080p分辨率下实现高质量实时新视角合成。
Neural Radiance Fields employ simple volume rendering as a way to overcome the challenges of differentiating through ray-triangle intersections by leveraging a probabilistic notion of visibility. This is achieved by assuming the scene is composed by a cloud of light-emitting particles whose density changes in space. This technical report summarizes the derivations for differentiable volume rendering. It is a condensed version of previous reports, but rewritten in the context of NeRF, and adopting its commonly used notation.
Environment Maps Editing using Inverse Rendering and Adversarial Implicit Functions
本文提出结合可微逆渲染与带权重对抗扰动的隐式神经表示来编辑 HDR 环境贴图，在保持背景、反射和视觉一致性的同时实现低成本、平滑的光照操控。
CityGo: Lightweight Urban Modeling and Rendering with Proxy Buildings and Residual Gaussians
本文提出CityGo混合框架，融合建筑代理网格、残差与周围3D高斯，实现航空视角大规模城市场景的轻量化照片级实时渲染。
We present a system for acquiring, processing, and rendering panoramic light field still photography for display in Virtual Reality (VR). We acquire spherical light field datasets with two novel light field camera rigs designed for portable and efficient light field acquisition. We introduce a novel real-time light field reconstruction algorithm that uses a per-view geometry and a disk-based blending field. We also demonstrate how to use a light field prefiltering operation to project from a high-quality offline reconstruction model into our real-time model while suppressing artifacts. We intr…
PTIR-GS: Path-Traced Inverse Rendering with Global Illumination in 3D Gaussian Fields
提出一种无溅射的路径追踪逆渲染框架，在统一光线追踪管线中定义前向光传输和反向梯度传播，实现3D高斯场的全局光照逆渲染，提升材质反演和渲染质量。
Virtual Reality systems provide many opportunities for scientific research and consumer enjoyment; however, they are more demanding than traditional desktop applications and require a wired connection to desktops in order to enjoy maximum quality. Standalone options that are not connected to computers exist, yet they are powered by mobile GPUs, which provide limited power in comparison to desktop rendering. Alternative approaches to improve performance on mobile devices use server rendering to render frames for a client and treat the client largely as a display device. However, current streami…
Machine Learning-Driven Volumetric Cloud Rendering: Procedural Shader Optimization and Dynamic Lighting in Unreal Engine for Realistic Atmospheric Simulation
本研究针对计算机图形学中实时体云渲染问题，在虚幻引擎中开发专用着色器，结合光线投射光照算法与双层程序化噪声模型，实现无2D天气纹理的程序化天空配置，渲染耗时35ms/帧且云真实感较传统2D技术提升15%，推进真实大气模拟。
Real-Time Rendering of Glints in the Presence of Area Lights
本文提出一种实时渲染面光源下闪光效果的高效方法，利用线性变换余弦或局部常数近似估计微面朝向概率，并结合二项分布计数模型，易于集成且开销极小。
Recent differentiable rendering techniques have become key tools to tackle many inverse problems in graphics and vision. Existing models, however, assume steady-state light transport, i.e., infinite speed of light. While this is a safe assumption for many applications, recent advances in ultrafast imaging leverage the wealth of information that can be extracted from the exact time of flight of light. In this context, physically-based transient rendering allows to efficiently simulate and analyze light transport considering that the speed of light is indeed finite. In this paper, we introduce a…
Online Photon Guiding with 3D Gaussians for Caustics Rendering
本文提出一种结合全局3D高斯混合模型与自适应光源采样的在线光子引导方法，通过方向变换和光源聚类树提升多光源大场景中的焦散渲染质量。
Recently, virtual reality (VR) technology has been widely used in medical, military, manufacturing, entertainment, and other fields. These applications must simulate different complex material surfaces, various dynamic objects, and complex physical phenomena, increasing the complexity of VR scenes. Current computing devices cannot efficiently render these complex scenes in real time, and delayed rendering makes the content observed by the user inconsistent with the user's interaction, causing discomfort. Foveated rendering is a promising technique that can accelerate rendering. It takes advant…
We present a new motion-compensated hierarchical compression scheme (HMLFC) for encoding light field images (LFI) that is suitable for interactive rendering. Our method combines two different approaches, motion compensation schemes and hierarchical compression methods, to exploit redundancies in LFI. The motion compensation schemes capture the redundancies in local regions of the LFI efficiently (local coherence) and hierarchical schemes capture the redundancies present across the entire LFI (global coherence). Our hybrid approach combines the two schemes effectively capturing both local as we…
In this paper, we introduce Harmonics Virtual Lights (HVL), to model indirect light sources for interactive global illumination of dynamic 3D scenes. Virtual Point Lights (VPL) are an efficient approach to define indirect light sources and to evaluate the resulting indirect lighting. Nonetheless, VPL suffer from disturbing artifacts, especially with high frequency materials. Virtual Spherical Lights (VSL) avoid these artifacts by considering spheres instead of points but estimates the lighting integral using Monte Carlo which results to noise in the final image. We define HVL as an extension o…
Gaussian Light Transport
提出用13维高斯混合模型表达光传输方程解，通过最小化渲染方程残差直接估计参数，并引入剔除策略实现毫秒级实时全局光照渲染，内存需求远低于神经渲染方法。
IllumiNeRF: 3D Relighting Without Inverse Rendering
针对现有可重光照视图合成方法依赖逆渲染、计算成本高且不稳定的问题，提出IllumiNeRF方法，先通过条件图像扩散模型重光照输入图像，再用其重建NeRF实现目标光照下新视图渲染，在多个基准上达SOTA。
扫码添加微信好友，提出您的宝贵建议 👇
💡 备注请填写：网站反馈
发表机构由 AI 从论文文本抽取，如发现错误，欢迎反馈修正建议。