Modern image-and-text-to-video diffusion models can synthesize highly realistic videos by iteratively denoising an initial Gaussian noise tensor conditioned on reference image and text inputs. However, existing approaches still lack precise and unified controllability over both object motion and camera motion within a single generation process. We present UniCaMo, a unified framework that enables simultaneous control of object trajectories and camera viewpoints by directly constructing the input noise of the diffusion model. Specifically, UniCaMo builds a shared 3D-grounded motion-consistent noise space across latent video frames. Sparse 3D point tracks are used to warp the Gaussian noise of the reference frame along desired object trajectories, while a virtual spherical noise representation provides globally consistent noise values for newly revealed scene regions under camera motion. By combining local track-guided noise warping with global sphere-based noise sampling, UniCaMo maintains geometric and temporal consistency under both object movement and viewpoint changes. Because UniCaMo modifies only the input noise, it requires no auxiliary adapters, control branches, or architectural changes to the underlying video diffusion model. With lightweight LoRA fine-tuning on large pretrained video diffusion models, including Wan 2.1 (14B), UniCaMo achieves state-of-the-art results in both video quality and motion controllability on standard controllable video generation benchmarks.
Language-Grounded Multi-Domain Image Translation via Semantic Difference Guidance
Department of Artificial Intelligence, Chung-Ang University(人工智能系, Chung-Ang 大学);Hyundai Mobis;Korea Advanced Institute of Science and Technology(韩国科学技术院)
3D Scene-Adaptive Trajectory-Controllable Human Image Animation with Camera Movement
Engineering Research Center of Autonomous Unmanned System Technology(自主无人系统工程研究中心);Ministry of Education(教育部);Anhui Provincial Key Laboratory of Security Artificial Intelligence(安徽省安全人工智能重点实验室);School of Artificial Intelligence, Anhui University(安徽大学人工智能学院);University of Warwick(沃林格大学);Zhejiang Yuexiu University(浙江越秀大学);University of Surrey(萨里大学)
Lighting-grounded Video Generation with Renderer-based Agent Reasoning
State Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机学院多媒体信息处理国家重点实验室);National Engineering Research Center of Visual Technology, School of Computer Science, Peking University(北京大学计算机学院国家视觉技术工程研究中心);Beijing Academy of Artificial Intelligence(北京智源人工智能研究院);OpenBayes Information Technology Co., Ltd.(北京开贝信息技术有限公司);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
MotionGrounder: Grounded Multi-Object Motion Transfer via Diffusion Transformer
School of Electrical Engineering, Korea Advanced Institute of Science and Technology(韩国科学技术院电气工程学院);Adobe Research(Adobe研究院);CMLab, Chung-Ang University(中央大学CMLab)
Pain in 3D: Generating Controllable Synthetic Faces for Automated Pain Assessment
Vector Institute(向量研究所);KITE Research Institute(KITE研究机构);University Health Network(大学健康网络);Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Department of Medical Imaging, University of Toronto(多伦多大学医学成像系);Institute of Biomedical Engineering, University of Toronto(多伦多大学生物医学工程研究所)
DanceCrafter: Fine-Grained Text-Driven Controllable Dance Generation via Choreographic Syntax
East China Normal University(东华大学);Beijing Dance Academy(北京舞蹈学院);Beijing University of Posts and Telecommunications(北京邮电大学);New York University Shanghai(纽约大学上海分校);Zhongguancun Academy(中关村学院);Zhongguancun Institute of Artificial Intelligence(中关村人工智能研究院)
Grounded and Controllable Image Completion by Incorporating Lexical Semantics
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Alibaba Group(阿里巴巴集团);Faculty of Engineering and Information Technology, University of Technology Sydney(悉尼科技大学工程与信息技术学院)
A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models
Texas A&M University(德克萨斯大学);University of Minnesota(明尼苏达大学);Marquette University(马奎特大学);Yale University(耶鲁大学);University of Texas at Austin(德克萨斯大学奥斯汀分校);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);NVIDIA(英伟达);Stanford University(斯坦福大学)