Enhancing Multimodal Retrieval via Complementary Information Extraction and Alignment
School of Intelligent Systems Engineering, Sun Yat-sen University（1 智能系统工程学院，中山大学）；Alibaba Group（2 阿里巴巴集团）；Guangdong Provincial Key Laboratory of Fire Science and Intelligent Emergency Technology（3 广东省火灾科学与智能应急技术重点实验室）
Multimodal retrieval has emerged as a promising yet challenging research direction in recent years. Most existing studies in multimodal retrieval focus on capturing information in multimodal data that is similar to their paired texts, but often ignores the complementary information contained in multimodal data. In this study, we propose CIEA, a novel multimodal retrieval approach that employs Complementary Information Extraction and Alignment, which transforms both text and images in documents into a unified latent space and features a complementary information extractor designed to identify and preserve differences in the image representations. We optimize CIEA using two complementary contrastive losses to ensure semantic integrity and effectively capture the complementary information contained in images. Extensive experiments demonstrate the effectiveness of CIEA, which achieves significant improvements over both divide-and-conquer models and universal dense retrieval models. We provide an ablation study, further discussions, and case studies to highlight the advancements achieved by CIEA. To promote further research in the community, we have released the source code at https://github.com/zengdlong/CIEA.
DeKeyNLU: Enhancing Natural Language to SQL Generation through Task Decomposition and Keyword Extraction
The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））；HSBC（汇丰银行）；South China University of Technology（华南理工大学）；Harvard University（哈佛大学）；Chicago University（芝加哥大学）
Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddings
Institute for Research in Technology, ICAI School of Engineering, Comillas Pontifical University（技术研究所，ICAI工程学院，科米利亚斯宗座大学）；DD-AIM, Senior Machine Learning Researcher（DD-AIM，高级机器学习研究员）
Jiangxi University of Finance and Economics（江西财经大学）；Stony Brook University（石溪大学）；Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））
Towards Enhancing Linked Data Retrieval in Conversational UIs using Large Language Models
School of Computer Science and Informatics, Cardiff University（卡迪夫大学计算机科学与信息学院）；College of Computing and Informatics, Saudi Electronic University（沙特电子大学计算与信息学院）；School of Biosciences, Cardiff University（卡迪夫大学生物科学学院）
Trifuse: Enhancing Attention-Based GUI Grounding via Multimodal Fusion
College of Computer Science and Technology, National University of Defense Technology（计算机科学与技术学院，国防科技大学）；Intelligent Game and Decision Lab, Academy of Military Sciences（智能游戏与决策实验室，军事科学院）
Few-shot Continual Relation Extraction via Open Information Extraction
Hanoi University of Science and Technology（河内科技大学）；Oraichain Labs Inc.（Oraichain实验室公司）；VinAI Research（VinAI研究院）；Bytedance（字节跳动）；VNU University of Engineering and Technology（越南国家大学工程技术大学）；University of Oregon（俄勒冈大学）
