Authors seeking to communicate with broader audiences often share their ideas in various document formats, such as slide decks, newsletters, reports, and posters. Prior work on document generation has generally tackled the creation of each separate format to be a different task, leading to fragmented learning processes, redundancy in models and methods, and disjointed evaluation. We consider each of these documents as templatic views of the same underlying knowledge/content, and we aim to unify the generation and evaluation of these templatic views. We begin by showing that current LLMs are capable of generating various document formats with little to no supervision. Further, a simple augmentation involving a structured intermediate representation can improve performance, especially for smaller models. We then introduce a novel unified evaluation framework that can be adapted to measuring the quality of document generators for heterogeneous downstream applications. This evaluation is adaptable to a range of user defined criteria and application scenarios, obviating the need for task specific evaluation metrics. Finally, we conduct a human evaluation, which shows that people prefer 82% of the documents generated with our method, while correlating more highly with our unified evaluation framework than prior metrics in the literature.
A Rationale-centric Counterfactual Data Augmentation Method for Cross-Document Event Coreference Resolution
School of Engineering, Westlake University(西湖大学工程学院);Zhejiang University(浙江大学);Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Advanced Technology, Westlake Institute for Advanced Study(西湖高等研究院先进技术研究院)
针对跨文档事件共指消解中触发词词汇匹配的虚假偏差,本文基于结构因果模型提出 LLM 参与闭环的理据中心反事实数据增强方法,在三个基准上达到 SOTA 并具备域外鲁棒性。
Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking
University of Science and Technology of China(中国科学技术大学);Yuanbao Team, Tencent(腾讯元宝团队);University of Chinese Academy of Sciences(中国科学院大学);Shandong University(山东大学)
From Documents to Spans: Span-Centric Learning for LLM-based Explainable Medical Coding
School of Biomedical Engineering, Division of Life Sciences and Medicine, USTC(生物医学工程学院,生命科学与医学系,中国科学技术大学);MIRACLE Center, Suzhou Institute for Advance Research, USTC(MIRACLE中心,苏州先进研究院,中国科学技术大学);Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology(江苏省多模态数字孪生技术重点实验室);State Key Laboratory of Precision and Intelligent Chemistry, USTC(精密与智能化学国家重点实验室)
Quest: Query-centric Data Synthesis Approach for Long-context Scaling of Large Language Model
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Xiaohongshu Inc(小红书科技有限公司)
Data-Centric AI in the Age of Large Language Models
National University of Singapore(新加坡国立大学);Agency for Science, Technology and Research(新加坡科技研究局);Singapore-MIT Alliance for Research and Technology Centre(新加坡-麻省理工研究与技术联盟中心);Guangdong Lab of AI and Digital Economy (SZ)(广东人工智能与数字经济实验室(深圳));Massachusetts Institute of Technology(麻省理工学院);Allen Institute for AI(艾伦人工智能研究所);University of Washington(华盛顿大学)
Term-Centric Hierarchy Induction from Heterogeneous Corpora
MaiNLP, Center for Information and Language Processing, LMU Munich(LMU慕尼黑大学信息与语言处理中心MaiNLP);Fraunhofer Institute for Systems and Innovation Research ISI(弗劳恩霍夫系统与创新研究所ISI);Department of Computer Science, IT University of Copenhagen(哥本哈根IT大学计算机科学系)
Document-level Entity-based Extraction as Template Generation
Information Sciences Institute, University of Southern California(南加州大学信息科学研究所);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
NUS Graduate School for Integrative Sciences and Engineering(新加坡国立大学综合科学与工程研究生院);School of Computing, National University of Singapore(新加坡国立大学计算机学院);Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所)
MoM: Mixtures of Scenario-Aware Document Memories for Retrieval-Augmented Generation Systems
School of Information, Renmin University of China, Beijing, China(中国人民大学信息学院);MemTensor (Shanghai) Technology Co., Ltd.(MemTensor(上海)技术有限公司);Institute for Advanced Algorithms Research, Shanghai(上海先进算法研究所)