嵌入模型对于各种自然语言处理任务至关重要,但可能受到词汇量有限、缺乏上下文和语法错误等因素的限制。本文提出了一种新颖的方法,通过在嵌入过程之前利用大型语言模型(LLMs)来丰富和重写输入文本,从而提升嵌入性能。通过利用ChatGPT 3.5提供额外的上下文、纠正不准确之处并整合元数据,所提出的方法旨在增强嵌入模型的实用性和准确性。该方法的有效性在三个数据集上进行了评估:Banking77Classification、TwitterSemEval 2015和Amazon Counter-factual Classification。结果表明,在TwitterSemEval 2015数据集上,该方法相对于基线模型取得了显著改进,最佳提示在Massive Text Embedding Benchmark(MTEB)排行榜上得分达到85.34,而此前最佳得分为81.52。然而,在其他两个数据集上的表现则不那么突出,这凸显了考虑领域特定特征的重要性。研究结果表明,基于LLM的文本丰富在提升嵌入性能方面已显示出有前景的结果,尤其是在某些领域。因此,嵌入过程中的众多局限性可以被避免。
英文摘要:
Embedding models are crucial for various natural language processing tasks but can be limited by factors such as limited vocabulary, lack of context, and grammatical errors. This paper proposes a novel approach to improve embedding performance by leveraging large language models (LLMs) to enrich and rewrite input text before the embedding process. By utilizing ChatGPT 3.5 to provide additional context, correct inaccuracies, and incorporate metadata, the proposed method aims to enhance the utility and accuracy of embedding models. The effectiveness of this approach is evaluated on three datasets: Banking77Classification, TwitterSemEval 2015, and Amazon Counter-factual Classification. Results demonstrate significant improvements over the baseline model on the TwitterSemEval 2015 dataset, with the best-performing prompt achieving a score of 85.34 compared to the previous best of 81.52 on the Massive Text Embedding Benchmark (MTEB) Leaderboard. However, performance on the other two datasets was less impressive, highlighting the importance of considering domain-specific characteristics. The findings suggest that LLM-based text enrichment has shown promising results to improve embedding performance, particularly in certain domains. Hence, numerous limitations in the process of embedding can be avoided.
StoryLens: Preference-Aligned Story Rewriting via Context-Aware Narrative Enrichment
Beijing University of Posts and Telecommunications(北京邮电大学);AIM3 Lab, Renmin University of China(中国人民大学AIM3实验室);Nanyang Technological University(南洋理工大学)
LLM-guided headline rewriting for clickability enhancement without clickbait
Intelligent Systems, Afeka Academic College of Engineering(阿菲卡工程学院智能系统系);School of Computer Science, Faculty of Sciences, HIT-Holon Institute of Technology(霍隆理工学院理学院计算机科学系)
Unseen from Seen: Rewriting Observation-Instruction Using Foundation Models for Augmenting Vision-Language Navigation
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Shanghai Jiao Tong University(上海交通大学);The University of Hong Kong(香港大学);Hunan Artificial Intelligence and Robotics Institute Company Ltd.(湖南人工智能与机器人研究院有限公司);Huawei Noah’s Ark Lab(华为诺亚实验室);Peng Cheng Laboratory(鹏城实验室)
MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation
Weill Cornell Medicine(威尔康乃尔医学院);University of Western Australia(西澳大利亚大学);Indiana University(印第安纳大学);Regenstrief Institute(瑞根斯特里夫研究所);Yale University(耶鲁大学);University of California, Los Angeles(加州大学洛杉矶分校)
LevelRAG: Enhancing Retrieval-Augmented Generation with Multi-hop Logic Planning over Rewriting Augmented Searchers
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Chinese Academy of Sciences(中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
CoT-Driven Framework for Short Text Classification: Enhancing and Transferring Capabilities from Large to Smaller Model
Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院空天信息创新研究院);University of Chinese Academy of Sciences(中国科学院大学);School of Electronic, Electrical and Communication Engineering, University of Chinese Academy of Sciences(中国科学院大学电子电气与通信工程学院)
ChatRetriever: Adapting Large Language Models for Generalized and Robust Conversational Dense Retrieval
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Université de Montréal(蒙特利尔大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Waseda University(早稻田大学)
Rewrite-to-Rank: Optimizing Ad Visibility via Retrieval-Aware Text Rewriting
University of Oxford, Oxford, England(牛津大学);University of Berkeley, Berkeley, CA, USA(伯克利大学);Carnegie Mellon University, Pittsburgh, PA, USA(卡内基梅隆大学);Algoverse AI Research, Remote(Algoverse AI研究)
From Exploration to Mastery: Enabling LLMs to Master Tools via Self-Driven Interactions
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Baidu Inc.(百度公司);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
Span-level Detection of AI-generated Scientific Text via Contrastive Learning and Structural Calibration
Beijing Renhe Information Technology Co., Ltd.(北京润和信息技术有限公司);Key Laboratory of Digital Publishing and Total Process Management of Scientific and Technical Journals(科技期刊数字出版与全流程管理重点实验室)
ReVision: A Dataset and Baseline VLM for Privacy-Preserving Task-Oriented Visual Instruction Rewriting
School of Information(信息学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Department of Statistics and Data Science(统计与数据科学系);Yale University(耶鲁大学);School of Computing and Augmented Intelligence(计算与增强智能学院)
TEAMMix: Taxonomy Enrichment Augmentation and Minority-augmented Mixing Strategy for LLM-enhanced Weak-Supervised Hierarchical Text Classification
School of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);ZJU-UIUC Institute, Zhejiang University(浙江大学ZJU-UIUC研究院);Shaoxing K3i Technology Co. Ltd(绍兴K3i科技有限公司);State Key Laboratory of CAD&CG, Zhejiang University(浙江大学CAD&CG国家重点实验室)
The IgboAPI Dataset: Empowering Igbo Language Technologies through Multi-dialectal Enrichment
Lanfrica(兰非里亚);Masakhane(马萨卡内);UCREL(乌克雷尔);Lancaster University(兰卡斯特大学);Nnamdi Azikiwe University(纳姆迪·阿齐基韦大学);University of Nigeria(尼日利亚大学);University of Ibadan(伊巴丹大学)
LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition
School of Computer Science, Fudan University(复旦大学计算机科学学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院);Institute of Modern Languages and Linguistics, Fudan University(复旦大学现代语言与语言学研究所)