Recent advances in video generative models have enabled flexible conditional generation and editing pipelines, such as text-to-video, image-to-video, and reference-guided synthesis. However, these workflows are inherently one-directional, mapping conditions to videos without providing a mechanism to invert this process. In complex media production settings, the ability to recover controllable textual conditions from a given video is highly desirable, yet remains underexplored. While inverse prompting has been studied for image generation, directly extending these approaches to video is challenging due to the need to capture temporal dynamics beyond static appearance, as well as the substantial computational cost of per-video optimization. In this work, we propose the first practical framework for efficient video inverse prompting. Specifically, we formulate inverse prompting as a meta-learning problem and introduce Meta Video Inverse Prompting (MVIP), which learns a meta-prompt optimized over temporal dimensions to enable fast and effective prompt inference. Our approach amortizes the inversion process, eliminating the need for costly iterative optimization at test time. Experimental results demonstrate that MVIP recovers higher-quality inverse prompts with significantly improved reconstruction fidelity compared to image-based inversion and iterative captioning baselines, while achieving substantial gains in efficiency. Code and video results are available at https://ueriniuno.github.io/mvip-page/.
IP-Prompter: Training-Free Theme-Specific Image Generation via Dynamic Visual Prompting
MAIS, Institute of Automation, CAS(MAIS,自动化研究所,中国科学院);China School of Artificial Intelligence, UCAS(中国人工智能学院,UCAS);ByteDance Inc.(字节跳动公司);University of Konstanz(康斯坦茨大学);National Cheng-Kung University(国立成功大学)
Inner-ear Augmented Metal Artifact Reduction with Simulation-based 3D Generative Adversarial Networks
Université Côte d’Azur(蔚蓝海岸大学);Inria Sophia Antipolis Méditerranée(法国国家信息与自动化研究所索菲亚·安蒂波利斯-地中海研究中心);Head and Neck University Institute, Nice University Hospital(尼斯大学医院头颈大学研究所);Department of Radiology, Nice University Hospital(尼斯大学医院放射科);Oticon Medical(奥迪康医疗公司)
University of Science and Technology of China(中国科学技术大学);Microsoft Cloud AI(微软云人工智能部门);Wormpex AI Research(Wormpex人工智能研究院)
提出了Diversity-Aware Meta Visual Proximating ~(DAM-VP),它是一种高效的提示方法,用于将预先训练好的模型转移到具有冻结主干的下游任务中。视觉提示中的一个具有挑战性的问题是,图像数据集有时具有很大的数据多样性,而每个数据集的通用提示很难处理复杂的分布偏移向原始预训练数据分布正确。为了解决这个问题,我们提出了一个数据集的多样性意识的提示策略,其初始化是由一个元提示。具体来说,我们以多样性自适应的方式将下游数据集聚类成小的同质子集,每个子集都有自己的提示单独优化。这种分而治之的设计大大降低了优化的难度,并显着提高了提示性能。此外,所有提示都使用元提示进行初始化,该元提示是在多个数据集上学习的。这是一个自举的范例,关键的观察是,从以前的数据集学习的提示知识可以帮助提示更快地收敛,并在新的数据集上表现得更好。在推理过程中,我们根据输入和每个子集之间的特征距离为每个输入动态选择适当的提示。通过大量的实验,我们的DAM-VP表现出了卓越的效率和有效性,在不同预训练模型的一系列下游数据集中明显超过了以前的提示方法。我们的代码可从以下网址获得:\url{https://github.com/shikiw/DAM-VP}。
IF-Bench: Benchmarking and Enhancing MLLMs for Infrared Images with Generative Visual Prompting
MAIS, Institute of Automation(自动化研究所信息处理中心);School of Artificial Intelligence, UCAS(中国科学院大学人工智能学院);Research Center of Aerospace Information, Institute of Automation(自动化研究所航空信息研究中心)
Visual Prompting in Multimodal Large Language Models: A Survey
UC San Diego(加州大学圣地亚哥分校);Dartmouth College(达特茅斯学院);Rutgers University(罗格斯大学);UC Los Angeles(加州大学洛杉矶分校);Adobe Research(奥多比研究院);The University of New South Wales(新南威尔士大学);CSIRO’s Data61(联邦科学与工业研究组织Data61)
Beyond Templates: Revisiting Zero-Shot Remote Sensing through Meta-Prompting
Remote Sensing Lab, National Technical University of Athens(遥感实验室,国家技术大学雅典分校);Remote Sensing Lab, Department of Engineering and Sciences, National Technical University of Athens(遥感实验室,工程与科学系,国家技术大学雅典分校);Universitas Mercatorum(默卡托大学)
Meta-Prompting for Automating Zero-shot Visual Recognition with LLMs
ICG, TU Graz(格拉茨工业大学ICG研究所);CDL-EML(CDL-EML中心);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);JKU(约翰内斯开普勒大学);IBM Research(IBM研究院);Weizmann Institute of Science(魏茨曼科学研究所);University of Bonn(波恩大学)
Prompting Decision Transformer for Few-Shot Policy Generalization
Carnegie Mellon University(卡内基梅隆大学);University of Montreal(蒙特利尔大学);Mila(米拉);MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);Massachusetts Institute of Technology(麻省理工学院);UMass Amherst(马萨诸塞大学阿默斯特分校)