大语言模型(LLM)已展现出强大的文本生成能力。然而,对于给定提示或指令,要获得最优结果仍具挑战,尤其是十亿参数规模的模型。此外,还可能出现毒性或幻觉等不良行为。尽管更大的模型(例如 ChatGPT)在缓解这些问题方面表现出优势,但仍无法保证完全避免。在本研究中,我们提出将文本生成形式化为一个未来约束生成问题,以最小化不良行为并强制模型忠实遵循指令。该方法利用 LLM 估计未来约束满足情况,并以此指导文本生成过程。大量实验表明,所提方法在三类不同文本生成任务上均有效:关键词约束生成(Lin et al., 2020)、毒性降低(Gehman et al., 2020)以及问答中的事实正确性(Gao et al., 2023)。
英文摘要:
Large Language Models (LLMs) have demonstrated a powerful ability for text generation. However, achieving optimal results with a given prompt or instruction can be challenging, especially for billion-sized models. Additionally, undesired behaviors such as toxicity or hallucinations can manifest. While much larger models (e.g., ChatGPT) may demonstrate strength in mitigating these issues, there is still no guarantee of complete prevention. In this work, we propose formalizing text generation as a future-constrained generation problem to minimize undesirable behaviors and enforce faithfulness to instructions. The estimation of future constraint satisfaction, accomplished using LLMs, guides the text generation process. Our extensive experiments demonstrate the effectiveness of the proposed approach across three distinct text generation tasks: keyword-constrained generation (Lin et al., 2020), toxicity reduction (Gehman et al., 2020), and factual correctness in question-answering (Gao et al., 2023).
From Recognition to Understanding: Unlocking Cognitive Time Series Reasoning with LLMs
Institute of Digital Twin, Eastern Institute of Technology(东方理工数字孪生研究所);Zhejiang University(浙江大学);Munich Center for Machine Learning, LMU(慕尼黑机器学习中心,慕尼黑大学)
BitLM: Unlocking Multi-Token Language Generation with Bitwise Continuous Diffusion
Shanghai Jiao Tong University(上海交通大学);MMLab, The Chinese University of Hong Kong(中大香港机器学习实验室);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);SIAT, Chinese Academy of Sciences(中国科学院软件研究所)