Novel View Synthesis (NVS) aims to generate unseen views of a 3D object given a limited number of known views. Existing methods often struggle to synthesize plausible views for unobserved regions, particularly under single-view input, and still face challenges in maintaining geometry- and appearance-consistency. To address these issues, we propose OrbitNVS, which reformulates NVS as an orbit video generation task. Through tailored model design and training strategies, we adapt a pre-trained video generation model to the NVS task, leveraging its rich visual priors to achieve high-quality view synthesis. Specifically, we incorporate camera adapters into the video model to enable accurate camera control. To enhance two key properties of 3D objects, geometry and appearance, we design a normal map generation branch and use normal map features to guide the synthesis of the target views via attention mechanism, thereby improving geometric consistency. Moreover, we apply a pixel-space supervision to alleviate blurry appearance caused by spatial compression in the latent space. Extensive experiments show that OrbitNVS significantly outperforms previous methods on the GSO and OmniObject3D benchmarks, especially in the challenging single-view setting (\eg, +2.9 dB and +2.4 dB PSNR).
Harnessing Frequency Spectrum Insights for Image Copyright Protection Against Diffusion Models
Zhejiang University(浙江大学);Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(杭州高新区(滨江)区块链与数据安全研究院);National University of Singapore(新加坡国立大学);South China University of Technology(华南理工大学)
HP-GAN: Harnessing pretrained networks for GAN improvement with FakeTwins and discriminator consistency
School of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea(电气电子工程学院,延世大学,首尔,大韩民国);Robotics Institute, Korea Institute of Science and Technology, Seoul, Republic of Korea(机器人研究所,韩国科学技术院,首尔,大韩民国);Department of Oral and Maxillofacial Radiology, Yonsei University College of Dentistry, Seoul, Republic of Korea(口腔和颌面放射科,延世大学牙科学院,首尔,大韩民国)
Neural Radiance Fields (NeRF) have led to breakthroughs in the novel view synthesis problem. Positional Encoding (P.E.) is a critical factor that brings the impressive performance of NeRF, where low-dimensional coordinates are mapped to high-dimensional space to better recover scene details. However, blindly increasing the frequency of P.E. leads to overfitting when the reconstruction problem is highly underconstrained, \eg, few-shot images for training. We harness low-frequency neural fields to regularize high-frequency neural fields from overfitting to better address the problem of few-shot …
Polarization Multi-Image Synthesis with Birefringent Metasurfaces
Department of Applied Physics, Harvard University(哈佛大学应用物理系);Elmore Family School of Electrical and Computer Engineering, Purdue University(普渡大学埃尔莫尔家族电气与计算机工程学院);Department of Electrical and Computer Engineering, Harvard University(哈佛大学电气与计算机工程系)
Harnessing Meta-Learning for Controllable Full-Frame Video Stabilization
School of Computing and Artificial Intelligence(计算与人工智能学院);Southwest Jiaotong University(西南交通大学);Department of Computer Science(计算机科学系);Hanynag University(汉阳大学);School of Computing and Augmented Intelligence(计算与增强智能学院);Arizona State University(亚利桑那州立大学)
Macau University of Science and Technology(澳门科技大学);Communication University of Zhejiang(浙江传媒学院);Zhejiang Lab(之江实验室);Communication University of China(中国传媒大学);Zhejiang University(浙江大学);Zhejiang Institute of Economics and Trade(浙江经贸职业技术学院)
GeoSurDepth: Harnessing Foundation Model for Spatial Geometry Consistency-Oriented Self-Supervised Surround-View Depth Estimation
State Key Laboratory of Intelligent Green Vehicle and Mobility, School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China(1 智能绿色车辆与移动国家重点实验室,车辆与移动学院,清华大学,北京100084,中国);California PATH, University of California, Berkeley, CA, United States(2 加州PATH,加州大学伯克利分校,加州,美国)
HiCoM: Hierarchical Coherent Motion for Streamable Dynamic Scene with 3D Gaussian Splatting
School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);Pengcheng Laboratory(鹏城实验室);Peking University Shenzhen Graduate School(北京大学深圳研究生院)