Unfaithful text generation is a common problem for text generation systems. In the case of Data-to-Text (D2T) systems, the factuality of the generated text is particularly crucial for any real-world applications. We introduce R2D2, a training framework that addresses unfaithful Data-to-Text generation by training a system both as a generator and a faithfulness discriminator with additional replacement detection and unlikelihood learning tasks. To facilitate such training, we propose two methods for sampling unfaithful sentences. We argue that the poor entity retrieval capability of D2T systems is one of the primary sources of unfaithfulness, so in addition to the existing metrics, we further propose NER-based metrics to evaluate the fidelity of D2T generations. Our experimental results show that R2D2 systems could effectively mitigate the unfaithful text generation, and they achieve new state-of-the-art results on FeTaQA, LogicNLG, and ToTTo, all with significant improvements.
Text Revision by On-the-Fly Representation Optimization
The Chinese University of Hong Kong(香港中文大学);Mila;McGill University(麦吉尔大学);Microsoft Research Asia(微软亚洲研究院)
文本修改是指一类自然语言生成任务,其中源序列和目标序列在表面形式上具有适度的相似性,但在属性上存在差异,例如文本的正式性和简单性。目前最先进的方法将这些任务表述为序列到序列的学习问题,这依赖于大规模的并行训练语料库。在本文中,我们提出了一个迭代的就地编辑方法的文本修订,它不需要并行数据。在这种方法中,我们简单地使用掩码语言建模和属性分类来微调预训练的Transformer。在推理过程中,每次迭代的编辑都是通过两步跨度替换来实现的。在第一步,文本的分布式表示朝着属性函数动态优化。在第二步,一个文本跨度被掩盖,并提出另一个新的条件下的优化表示。对文本形式化和文本简化这两个典型的文本修改任务的实验表明了该方法的有效性。它在文本简化方面比最先进的监督方法具有竞争力甚至更好的性能,并且在文本形式化\footnote{Code and model are available at \url{https://github.com/jingjingli01/OREO}}方面比强无监督方法具有更好的性能。
How Fragile is Relation Extraction under Entity Replacements?
University of Southern California(南加州大学);Meta;Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Amazon(亚马逊公司);University of California, Davis(加州大学戴维斯分校);University of California, Los Angeles(加州大学洛杉矶分校);National University of Singapore(新加坡国立大学)
Natural Language Processing with Deep Learning for Medical Adverse Event Detection from Free-Text Medical Narratives: A Case Study of Detecting Total Hip Replacement Dislocation
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Karolinska Institutet(卡罗林斯卡学院);Sahlgrenska University Hospital(萨尔格伦斯卡大学医院)
RTD-Guard: A Black-Box Textual Adversarial Detection Framework via Replacement Token Detection
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院)
Searching for chromate replacements using natural language processing and machine learning algorithms
College of Engineering and Computer Science, The Australian National University(澳大利亚国立大学工程与计算机科学学院);ARC Research Hub for Australian Steel Innovation(澳大利亚研究理事会澳大利亚钢铁创新研究中心)
Enhancing Disinformation Detection with Explainable AI and Named Entity Replacement
Advanced Studies Center in ICT (CEATIC)(ICT高级研究中心(CEATIC));Universidad de Jaén(哈恩大学);Universidad de Castilla-La Mancha(卡斯蒂利亚-拉曼恰大学);Universidad de Granada(格拉纳达大学)
ROMER: Expert Replacement and Router Calibration for Robust MoE LLMs on Analog Compute-in-Memory Systems
The Department of Electrical and Computer Engineering, The University of Hong Kong(香港大学电子与计算机工程系);The School of Integrated Circuit Science and Engineering, Beihang University(北航集成电路科学与工程学院)