Subject-driven text-to-image diffusion models empower users to tailor the model to new concepts absent in the pre-training dataset using a few sample images. However, prevalent subject-driven models primarily rely on single-concept input images, facing challenges in specifying the target concept when dealing with multi-concept input images. To this end, we introduce a textual localized text-to-image model (Texual Localization) to handle multi-concept input images. During fine-tuning, our method incorporates a novel cross-attention guidance to decompose multiple concepts, establishing distinct connections between the visual representation of the target concept and the identifier token in the text prompt. Experimental results reveal that our method outperforms or performs comparably to the baseline models in terms of image fidelity and image-text alignment on multi-concept input images. In comparison to Custom Diffusion, our method with hard guidance achieves CLIP-I scores that are 7.04%, 8.13% higher and CLIP-T scores that are 2.22%, 5.85% higher in single-concept and multi-concept generation, respectively. Notably, our method generates cross-attention maps consistent with the target concept in the generated images, a capability absent in existing models.
LocInv: Localization-aware Inversion for Text-Guided Image Editing
University of Chinese Academy of Sciences(中国科学院大学);Computer Vision Center(计算机视觉中心);College of Computer Science(计算机学院);Nankai University(南开大学);Universitat Autonoma de Barcelona(巴塞罗那自治大学)
AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);University of Electronic Science and Technology of China(电子科技大学);University of Science and Technology Beijing(北京科技大学);College of Information and Control Engineering, China University of Petroleum (East China)(中国石油大学(华东)信息与控制工程学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
DesignDiffusion: High-Quality Text-to-Design Image Generation with Diffusion Models
University of Science and Technology of China(中国科学技术大学);Microsoft Research Asia(微软亚洲研究院);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
ManipShield: A Unified Framework for Image Manipulation Detection, Localization and Explanation
Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University(上海交通大学图像通信与网络工程研究所);University of Electronic and Science Technology of China(电子科技大学);Tianjin University(天津大学)
Localization-Infused Vision-Language Semantic Fusion for Text-Guided Medical Image Segmentation
Air Force Engineering University(空军工程大学);Harbin Institute of Technology(哈尔滨工业大学);University of Sydney(悉尼大学);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Zhongguancun Institute of Artificial Intelligence(中关村人工智能研究院)
Wuhan University(武汉大学);Technical University of Munich(慕尼黑技术大学);Institute of Artificial Intelligence (TeleAI)(人工智能研究院(TeleAI));China Telecom(中国电信);University of Cambridge(剑桥大学);University of Science and Technology of China(中国科学技术大学);national university of defense technology(国防科技大学)
CIEC: Coupling Implicit and Explicit Cues for Multimodal Weakly Supervised Manipulation Localization
School of Computer Science and Engineering(计算机科学与工程学院);MoE Key Laboratory of Information Technology(信息技术关键实验室);Key Laboratory of Information Security Technology(信息安全技术重点实验室);Sun Yat-sen University(中山大学);State Key Laboratory of Mathematical Engineering and Advanced Computing(数学工程与先进计算国家重点实验室);Alibaba Group(阿里巴巴集团)
Grad-ECLIP: Gradient-based Visual and Textual Explanations for CLIP
Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);Division of Social Science and Department of Computer Science & Engineering, Hong Kong University of Science & Technology(香港科学与技术大学社会科学学院及计算机科学与工程系);SenseTime Group Ltd(时光集团有限公司)
Text2Loc: 3D Point Cloud Localization from Natural Language
Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);LMU Munich(慕尼黑大学);Visual Geometry Group, University of Oxford(牛津大学视觉几何组)
Bridging Semantic Logic Gaps: A Cognition Inspired Multimodal Boundary Preserving Network for Image Manipulation Localization
School of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);School of Electronic and Information Engineering, Shenzhen University(深圳大学电子与信息工程学院);College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);School of Computer Science and Information Engineering, Hefei University of Technology(合肥工业大学计算机科学与信息工程学院)
Reasoning-Driven Anomaly Detection and Localization with Image-Level Supervision
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北京航空航天大学虚拟现实技术与系统国家重点实验室);Hangzhou Innovation Institute, Beihang University(北京航空航天大学杭州创新研究院)
Faculty of Technology, Natural Sciences and Maritime Sciences, University of South-Eastern Norway(东南挪威大学技术、自然科学与海洋科学学院);Center for Cancer and Blood Diseases, Vestfold Hospital Trust(西福尔信托医院癌症与血液疾病中心);Faculty of Biomedical Engineering, Silesian University of Technology(西里西亚工业大学生物医学工程学院)
Scale-Aware UAV-to-Satellite Cross-View Geo-Localization: A Semantic Geometric Approach
College of Aerospace Science and Engineering, National University of Defense Technology(航天工程学院,国防科技大学);Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation(湖南省图像测量与视觉导航重点实验室);School of Information Science and Engineering, Lanzhou University(信息科学与工程学院,兰州大学)
LLM-powered Query Expansion for Enhancing Boundary Prediction in Language-driven Action Localization
Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science & Technology(北京智能信息科技重点实验室,计算机科学与技术学院);Beijing Institute of Technology(北京理工大学);Guangdong Laboratory of Machine Perception and Intelligent Computing(广东机器感知与智能计算实验室);Shenzhen MSU-BIT University(深圳MSU-BIT大学)
Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPO
National University of Singapore(新加坡国立大学);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学);Wuhan University(武汉大学)