Tuning-free long video diffusion has been proposed to generate extended-duration videos with enriched content by reusing the knowledge from pre-trained short video diffusion model without retraining. However, most works overlook the fine-grained long-term video consistency modeling, resulting in limited scene consistency (i.e., unreasonable object or background transitions), especially with multiple text inputs. To mitigate this, we propose the Consistency Noise Injection, dubbed CoNo, which introduces the "look-back" mechanism to enhance the fine-grained scene transition between different video clips, and designs the long-term consistency regularization to eliminate the content shifts when extending video contents through noise prediction. In particular, the "look-back" mechanism breaks the noise scheduling process into three essential parts, where one internal noise prediction part is injected into two video-extending parts, intending to achieve a fine-grained transition between two video clips. The long-term consistency regularization focuses on explicitly minimizing the pixel-wise distance between the predicted noises of the extended video clip and the original one, thereby preventing abrupt scene transitions. Extensive experiments have shown the effectiveness of the above strategies by performing long-video generation under both single- and multi-text prompt conditions. The project has been available in https://wxrui182.github.io/CoNo.github.io/.
VII: Visual Instruction Injection for Jailbreaking Image-to-Video Generation Models
National Anti-Counterfeit Engineering Research Center, Huazhong University of Science and Technology(华中科技大学反伪工程研究中心);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院);Sydney AI Centre, The University of Sydney(悉尼大学AI中心)
GenHOI: Towards Object-Consistent Hand-Object Interaction with Temporally Balanced and Spatially Selective Object Injection
Department of Computer Vision Technology(VIS), Baidu Inc.(百度公司计算机视觉技术部);Shenzhen Campus of Sun Yat-Sen University(中山大学深圳校区);Northwestern Polytechnical University(西北工业大学)
Inconsistency-aware Multimodal Schrödinger Bridge for Deepfake Localization
Department of Computer Science and Techonology, Huaqiao University(华侨大学计算机科学与技术系);Xiamen Key Laboratory of Computer Vision and Pattern Recognition, Huaqiao University(厦门计算机视觉与模式识别重点实验室);Tongji University(同济大学);School of Cyber Science and Engineering, Wuhan University(武汉大学网络空间安全学院)
Balancing Emotional Alignment and Semantic Consistency in Image Generation via Reinforcement Learning with Valence-Arousal Anchoring
Lanzhou University(兰州大学);China University of Mining and Technology(中国矿业大学);Shenzhen University(深圳大学);Beijing Institute of Technology(北京理工大学);National University of Singapore(新加坡国立大学)
ContextDrag: Precise Drag-Based Image Editing via Context-Preserving Token Injection and Position-Aligned Attention
School of Electronic and Information Engineering, South China University of Technology(华南理工大学电子与信息学院);KlingAI Research, Kuaishou Technology(快手科技KlingAI研究);The University of Hong Kong(香港大学);Shenzhen Loop Area Institute(深圳河套学院)
Sculpt3D: Multi-View Consistent Text-to-3D Generation with Sparse 3D Prior
Nanyang Technological University(南洋理工大学);Institute for Infocomm Research A*STAR(新加坡资讯通信研究院(新加坡科技研究局下属));Centre for Frontier AI Research, A*STAR(新加坡前沿人工智能研究院(新加坡科技研究局下属))
CoFi-UCGen: Coarse-to-Fine Unsupervised Conditional Generation without Label Priors
Department of Electronic Information Engineering, Beihang University(信息工程系,北航);School of Cyber Science and Technology, Beihang University(网络安全科学与技术学院,北航);College of Electronic Science, National University of Defense Technology(电子科学学院,国防科技大学);Institute of Artificial Intelligence, Beihang University(人工智能研究院,北航)
Echoes of ownership: Adversarial-guided dual injection for copyright protection in MLLMs
School of Information Science and Engineering, Lanzhou University(兰州大学信息科学与工程学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
SWIFT: Prompt-Adaptive Memory for Efficient Interactive Long Video Generation
University of Science and Technology of China(中国科学技术大学);Fudan University(复旦大学);Georgia Institute of Technology(佐治亚理工学院);Shanghai Jiao Tong University(上海交通大学)
DINORANKCLIP: DINOv3 Distillation and Injection for Vision-Language Pretraining with High-Order Ranking Consistency
University of California, Los Angeles(加州大学洛杉矶分校);Aimaikj(阿米亚克j);HFIPS, Chinese Academy of Sciences(中国科学院HFIPS);University of Science and Technology of China(中国科学技术大学);Chinese Academy of Sciences(中国科学院);National University of Defense Technology(国防科技大学)
CRISP: Contrastive Residual Injection and Semantic Prompting for Continual Video Instance Segmentation
State Key Laboratory of Robotics and Intelligent Systems, Shenyang Institute of Automation, Chinese Academy of Sciences(机器人与智能系统国家重点实验室,沈阳自动化研究所,中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Efficient Flow Matching for Sparse-View CT Reconstruction
Centrum Wiskunde en Informatica(数学与信息学研究中心);LIACS, Leiden University(莱顿大学LIACS);Great Bay University(大湾大学);Mathematical Institute, Utrecht University(乌得勒支大学数学研究所)