Trustworthiness of generative language models (GLMs) is crucial in their deployment to critical decision making systems. Hence, certified risk control methods such as selective prediction and conformal prediction have been applied to mitigating the hallucination problem in various supervised downstream tasks. However, the lack of appropriate correctness metric hinders applying such principled methods to language generation tasks. In this paper, we circumvent this problem by leveraging the concept of textual entailment to evaluate the correctness of the generated sequence, and propose two selective generation algorithms which control the false discovery rate with respect to the textual entailment relation (FDR-E) with a theoretical guarantee: $\texttt{SGen}^{\texttt{Sup}}$ and $\texttt{SGen}^{\texttt{Semi}}$. $\texttt{SGen}^{\texttt{Sup}}$, a direct modification of the selective prediction, is a supervised learning algorithm which exploits entailment-labeled data, annotated by humans. Since human annotation is costly, we further propose a semi-supervised version, $\texttt{SGen}^{\texttt{Semi}}$, which fully utilizes the unlabeled data by pseudo-labeling, leveraging an entailment set function learned via conformal prediction. Furthermore, $\texttt{SGen}^{\texttt{Semi}}$ enables to use more general class of selection functions, neuro-selection functions, and provides users with an optimal selection function class given multiple candidates. Finally, we demonstrate the efficacy of the $\texttt{SGen}$ family in achieving a desired FDR-E level with comparable selection efficiency to those from baselines on both open and closed source GLMs. Code and datasets are provided at https://github.com/ml-postech/selective-generation.
Mix and Match: Learning-free Controllable Text Generation using Energy Language Models
University of California San Diego(加州大学圣迭戈分校);Toyota Technological Institute at Chicago (TTIC)(芝加哥丰田技术研究院(TTIC))
控制文本生成的最新工作要么需要基于属性的微调的基础语言模型(LM),或限制了参数化的属性映射,以兼容的基础自回归LM。在这项工作中,我们提出了Mix and Match LM,这是一种基于全局分数的可控文本生成方法,它结合了任意预训练的黑盒模型,用于在生成的文本中实现所需的属性,而不涉及任何关于黑盒模型的微调或结构假设。我们将可控生成的任务解释为从基于能量的模型中抽取样本,该模型的能量值是来自黑盒模型的分数的线性组合,黑盒模型分别负责流畅性、控制属性和对任何条件上下文的忠诚度。我们使用Metropolis-Hastings抽样方案从这个基于能量的模型中使用双向上下文和全局属性特征进行抽样。我们验证了我们的方法在各种控制生成和基于风格的文本修订任务的有效性,优于最近提出的方法,涉及额外的训练,微调,或限制性的假设模型的形式。
GraphVF: Controllable Protein-Specific 3D Molecule Generation with Variational Flow
Peking University(北京大学);National Research Council Canada(加拿大国家研究委员会);University of Ottawa(渥太华大学);Mila - Québec AI Institute(Mila - 魁北克人工智能研究所);HEC Montréal(蒙特利尔高等商学院)