ReasonEmbed: Enhanced Text Embeddings for Reasoning-Intensive Document Retrieval
University of Science and Technology of China(中国科学技术大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing University of Posts and Telecommunications(北京邮电大学);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);Hong Kong Polytechnic University(香港理工大学)
Jianlyu Chen, Junwei Lan, Chaofan Li, Defu Lian, Zheng Liu
In this paper, we introduce ReasonEmbed, a novel text embedding model developed for reasoning-intensive document retrieval. Our work includes three key technical contributions. First, we propose ReMixer, a new data synthesis method that overcomes the triviality problem prevalent in previous synthetic datasets, enabling large-scale production of 82K high-quality training samples. Second, we design Redapter, a self-adaptive learning algorithm that dynamically adjusts training each sample's weight based on its reasoning intensity. This allows the model to effectively capture the complex semantic relationships between queries and documents. Third, we implement ReasonEmbed across multiple backbones of varying sizes, all of which achieve superior performance on reasoning-intensive retrieval tasks. Notably, our ReasonEmbed-Qwen3-8B model offers a record-high nDCG@10 score of 38.1 on the BRIGHT benchmark, which significantly outperforms existing text embedding models. We will fully open-source our created resources in ReasonEmbed to push forward the research advancement in this field.
Retro*: Optimizing LLMs for Reasoning-Intensive Document Retrieval
University of Science and Technology of China(中国科学技术大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Beijing University of Posts and Telecommunications(北京邮电大学);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);Hong Kong Polytechnic University(香港理工大学);Hong Kong University of Science and Technology(香港科技大学)
On the Vulnerability of Applying Retrieval-Augmented Generation within Knowledge-Intensive Application Domains
Department of ECE University of Minnesota(电子工程系明尼苏达大学);Data Science Institute University of Chicago(数据科学研究所芝加哥大学);Carlson School of Management University of Minnesota(卡尔森管理学院明尼苏达大学);Department of Surgery University of Minnesota(外科系明尼苏达大学);Cisco Research(思科研究);School of Statistics University of Minnesota(统计学学院明尼苏达大学)
Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval
Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Alibaba Cloud Computing(阿里云计算);Hong Kong University of Science and Technology(香港科技大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校)
NeuroSym-BioCAT: Leveraging Neuro-Symbolic Methods for Biomedical Scholarly Document Categorization and Question Answering
TIB—Leibniz Information Centre for Science and Technology(莱布尼茨科学与技术信息中心(TIB));L3S Research Center, Leibniz University Hannover(汉诺威莱布尼茨大学L3S研究中心);Daffodil International University(水仙国际大学)
Retrieval as Attention: End-to-end Learning of Retrieval and Reading within a Single Transformer
Carnegie Mellon University(卡内基梅隆大学);Bosch Research North America(博世北美研究院);Amazon(亚马逊)
知识密集型任务的系统,如开放领域的问答(QA)通常包括两个阶段:从一个大的语料库中有效检索相关的文件和详细阅读所选择的文件,以产生答案。检索器和读取器通常是单独建模的,这需要繁琐的实现,并且很难以端到端的方式进行训练和调整。在本文中,我们重新审视了这种设计,并避开了单独的架构和培训,而是使用单个Transformer来执行Retrieval as Attention(ReAtt),并仅基于来自最终QA任务的监督进行端到端培训。我们第一次证明,一个单一的模型训练的端到端可以实现竞争检索和QA性能,匹配或略优于最先进的分别训练检索和读者。此外,端到端自适应显著提高了其在有监督和无监督环境下对域外数据集的性能,使我们的模型成为知识密集型任务的简单且适应性强的解决方案。代码和模型可在https://github.com/jzbjyb/ReAtt上获得。
CoCR-RAG: Enhancing Retrieval-Augmented Generation in Web Q&A via Concept-oriented Context Reconstruction
University of Southern Queensland(昆士兰大学);University of Technology Sydney(新南威尔士大学);The Hong Kong Polytechnic University(香港理工大学);National University of Singapore(新加坡国立大学);Qatar Computing Research Institute(卡塔尔计算研究所);The Education University of Hong Kong(香港教育大学)
MRMR: A Realistic and Expert-Level Multidisciplinary Benchmark for Reasoning-Intensive Multimodal Retrieval
Nanyang Technological University(南洋理工大学);Yale University(耶鲁大学);NYU Shanghai(纽约大学上海分校);Shanghai Jiao Tong University(上海交通大学);University of the Chinese Academy of Sciences(中国科学院大学);Center for Data Science, New York University(纽约大学数据科学中心);VinUniversity(越南 Vin 大学)
CorpusBrain++: A Continual Generative Pre-Training Framework for Knowledge-Intensive Language Tasks
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of Amsterdam(阿姆斯特丹大学)
BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval
The University of Hong Kong(香港大学);Princeton University(普林斯顿大学);Stanford University(斯坦福大学);University of Washington(华盛顿大学);Google Cloud AI Research(谷歌云人工智能研究)
OCR for TIFF Compressed Document Images Directly in Compressed Domain Using Text segmentation and Hidden Markov Model
Indian Institute of Information Technology Allahabad(印度理工学院阿拉哈巴德分校)
在当今的技术时代,文档图像在我们的日常生活中发挥着重要和不可或缺的作用,特别是随着COVID-19的激增,数字扫描文档已成为沟通的主要来源,从而避免了任何形式的身体接触感染。扫描文档图像的存储和传输是一项非常占用内存的任务,因此压缩技术被用于在存档和传输之前减小图像大小。为了提取信息或对压缩图像进行操作,我们有两种方法:第一种方法是对图像进行压缩和操作,然后再次压缩图像,以提高存储和传输的效率。另一种方法是使用底层压缩算法的特性直接处理压缩形式的图像,而不涉及解压缩和重新压缩。本文提出了一种新的思路,即在压缩域中直接为CCITT(The International Telegraph and Telephone Consultative Committee,国际电报电话咨询委员会)压缩机打印的TIFF文档图像开发OCR。在将文本区域分割成行和词之后,使用CCITT的三种编码模式(水平、垂直和通过模式)应用HMM进行识别。实验结果表明,光学字符识别的通过模式给出了一个有前途的结果。