通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2510.17685cs.CVcs.AI
通过双向关系推理与对齐实现多语言文本到图像行人检索
Multilingual Text-to-Image Person Retrieval via Bidirectional Relation Reasoning and Aligning
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);School of Computer Science, Wuhan University(武汉大学计算机学院);Key Laboratory of New Generation Artificial Intelligence Technology & Its Interdisciplinary Applications (Southeast University), Ministry of Education, China(新 generation 人工智能技术及交叉应用重点实验室(东南大学),教育部,中国)
Min Cao, Xinyu Zhou, Ding Jiang, Bo Du, Mang Ye, Min Zhang
Text-to-image person retrieval (TIPR) aims to identify the target person using textual descriptions, facing challenge in modality heterogeneity. Prior works have attempted to address it by developing cross-modal global or local alignment strategies. However, global methods typically overlook fine-grained cross-modal differences, whereas local methods require prior information to explore explicit part alignments. Additionally, current methods are English-centric, restricting their application in multilingual contexts. To alleviate these issues, we pioneer a multilingual TIPR task by developing a multilingual TIPR benchmark, for which we leverage large language models for initial translations and refine them by integrating domain-specific knowledge. Correspondingly, we propose Bi-IRRA: a Bidirectional Implicit Relation Reasoning and Aligning framework to learn alignment across languages and modalities. Within Bi-IRRA, a bidirectional implicit relation reasoning module enables bidirectional prediction of masked image and text, implicitly enhancing the modeling of local relations across languages and modalities, a multi-dimensional global alignment module is integrated to bridge the modality heterogeneity. The proposed method achieves new state-of-the-art results on all multilingual TIPR datasets. Data and code are presented in https://github.com/Flame-Chasers/Bi-IRRA.
FIZ Karlsruhe – Leibniz Institute for Information Infrastructure(FIZ卡尔斯鲁厄——莱布尼茨信息基础设施研究所);Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院)
Representation Learning of words and Knowledge Graphs (KG) into low dimensional vector spaces along with its applications to many real-world scenarios have recently gained momentum. In order to make use of multiple KG embeddings for knowledge-driven applications such as question answering, named entity disambiguation, knowledge graph completion, etc., alignment of different KG embedding spaces is necessary. In addition to multilinguality and domain-specific information, different KGs pose the problem of structural differences making the alignment of the KG embeddings more challenging. This pap…
Indic-TunedLens: Interpreting Multilingual Models in Indian Languages
Dwarkadas Jivanlal Sanghvi College of Engineering(达沃拉斯·吉文拉尔工程学院);Indian Institute of Technology Jodhpur(印度理工学院乔浦尔分校);King’s College London(伦敦国王学院);Indian Institute of Technology Patna(印度理工学院帕特纳分校)
Lip reading has received increasing attention in recent years. This paper focuses on the synergy of multilingual lip reading. There are about as many as 7000 languages in the world, which implies that it is impractical to train separate lip reading models with large-scale data for each language. Although each language has its own linguistic and pronunciation rules, the lip movements of all languages share similar patterns due to the common structures of human organs. Based on this idea, we try to explore the synergized learning of multilingual lip reading in this paper, and further propose a s…
Same Values, Different Languages? From Multilingual Probing to Steering LLMs Toward Chinese Social Values
School of Information Science and Technology, Beijing Foreign Studies University(北京外国语大学信息科学与技术学院);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beihang University(北京航空航天大学)
Northeastern Uni at Multilingual Counterspeech Generation: Enhancing Counter Speech Generation with LLM Alignment through Direct Preference Optimization
Capital One(第一资本);Northeastern University(东北大学);Apple Inc.(苹果公司)
Mind the Gap: Aligning Vision Foundation Models to Image Feature Matching
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence(人机混合增强智能国家重点实验室);National Engineering Research Center for Visual Information and Applications(视觉信息与应用国家工程研究中心);Institute of Artificial Intelligence and Robotics(人工智能与机器人研究院);Xi’an Jiaotong University(西安交通大学)
Ultrasound Report Generation with Multimodal Large Language Models for Standardized Texts
Shenzhen Institutes of Advanced Technology(深圳先进技术研究院);University of Macau(澳门大学);Chinese PLA General Hospital(中国人民解放军总医院);Macau University of Science and Technology(澳门科学技术大学)
ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation
Peking University Shenzhen Graduate School(北京大学深圳研究生院);Pengcheng Laboratory(鹏城实验室);University of Oxford(牛津大学);Oxford-Suzhou Centre for Advanced Research(牛津-苏州高等研究院);Tencent AI Lab(腾讯AI实验室)
International Institute of Information Technology Hyderabad(海得拉巴国际信息技术学院)
Multimodal Machine Translation (MMT) enriches the source text with visual information for translation. It has gained popularity in recent years, and several pipelines have been proposed in the same direction. Yet, the task lacks quality datasets to illustrate the contribution of visual modality in the translation systems. In this paper, we propose our system under the team name Volta for the Multimodal Translation Task of WAT 2021 from English to Hindi. We also participate in the textual-only subtask of the same language pair for which we use mBART, a pretrained multilingual sequence-to-sequen…
Multilingual Vision-Language Pre-training for the Remote Sensing Domain
INESC-ID;Instituto Superior Técnico(高等技术学院);University of Lisbon(里斯本大学);NOVA-LINCS;Faculty of Science and Technology(科学与技术学院);NOVA University(NOVA大学);EPFL(洛桑联邦理工学院);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院);LUMLIS (Lisbon ELLIS Unit)(LUMLIS(里斯本ELLIS单元))
Shanghai Jiao Tong University(上海交通大学);Peking University(北京大学);Queen’s University Belfast(贝尔法斯特女王大学)
In this paper, we propose an effective method for fast and accurate scene parsing called Bidirectional Alignment Network (BiAlignNet). Previously, one representative work BiSeNet~\cite{bisenet} uses two different paths (Context Path and Spatial Path) to achieve balanced learning of semantics and details, respectively. However, the relationship between the two paths is not well explored. We argue that both paths can benefit each other in a complementary way. Motivated by this, we propose a novel network by aligning two-path information into each other through a learned flow field. To avoid the …
Silhouette-to-Contour Registration: Aligning Intraoral Scan Models with Cephalometric Radiographs
School of AI and Advanced Computing, Xi'an Jiaotong-Liverpool University, China(人工智能与先进计算学院,西安交通大学利物浦大学,中国);School of Electrical Engineering, Electronics and Computer Science, University of Liverpool, United Kingdom(电子工程、电子科学与计算机科学学院,利物浦大学,英国);School of Advanced Technology, Xi'an Jiaotong-Liverpool University, China(先进技术学院,西安交通大学利物浦大学,中国);School of Physical Sciences, University of Liverpool, Liverpool, United Kingdom(物理科学学院,利物浦大学,英国);School of Mathematics and Physics, Xi'an Jiaotong-Liverpool University, China(数学与物理学院,西安交通大学利物浦大学,中国);Institute of Artificial Intelligence Innovation, Zhejiang University of Technology, China(人工智能创新研究院,浙江工业大学,中国)