Controllable text generation is a growing field within natural language generation (NLG) that focuses on producing text that meets specific constraints in real-world applications. Previous approaches, such as plug-and-play controllers (PPCs), aimed to steer the properties of generated text in a flexible manner. However, these methods often compromised the integrity of the language model's decoding process, resulting in less smooth text generation. Alternatively, other techniques utilized multiple attribute prompts to align the generated text with desired attributes, but this approach required prompt design for each attribute and was dependent on the size of the language model. This paper introduces a novel method for flexible attribute control in text generation using pre-trained language models (PLMs). The proposed approach aims to enhance the fluency of generated text by guiding the generation process with PPCs. The key idea is to dynamically adjust the distribution of generated text by modifying prompts, effectively constraining the output space of the language model and influencing the desired attribute. To enable smooth cooperation between the PLM and the PPC, our work innovatively proposes a new model fine-tuning method: Reinforcement Learning with Dynamic Adjust Feedback (RLDAF).This fine-tuning process adapts a small subset of the language model's parameters based on the generating actions taken during the PPC control process. The resulting harmonious collaboration between the PLM and PPC leads to improved smoothness in text generation during inference. Extensive experiments were conducted on the SST2 dataset, and the proposed method outperformed previous approaches in various evaluation metrics, including text fluency and attribute consistency.
Steering Language Generation: Harnessing Contrastive Expert Guidance and Negative Prompting for Coherent and Diverse Synthetic Data Generation
Mathematical Sciences Institute, Australian National University(澳大利亚国立大学数学科学研究所);Research School of Astronomy & Astrophysics, Australian National University(澳大利亚国立大学天文与天体物理研究学院);School of Computing, Australian National University(澳大利亚国立大学计算学院);Department of Astronomy, The Ohio State University(俄亥俄州立大学天文学系)
Self-Prompting Large Language Models for Zero-Shot Open-Domain QA
Shanghai Jiao Tong University(上海交通大学);SJTU-Paris Elite Institute of Technology, Shanghai Jiao Tong University(上海交通大学巴黎卓越工程师学院);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院)
Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learning
Hainan University(海南大学);Nanyang Technological University(南洋理工大学);Hithink Research(慧思研究);HKUST (Guangzhou)(香港科技大学(广州));IDEA Research(IDEA研究院);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);Nanjing University of Science and Technology(南京理工大学)
ICG: Improving Cover Image Generation via MLLM-based Prompting and Personalized Preference Alignment
Huazhong University of Science and Technology(华中科技大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Hong Kong Polytechnic University(香港理工大学);Zhejiang University(浙江大学)
German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM Studies
University of Mannheim(曼海姆大学);GESIS -- Leibniz Institute for the Social Sciences(莱布尼茨社会科学研究所);RWTH Aachen University(亚琛工业大学);Complexity Science Hub(复杂性科学中心)
Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning
Tencent BAC(腾讯BAC);Shenzhen International Graduate School, Tsinghua University(深圳国际研究生院,清华大学);School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);School of Mathematics and Statistics, University of Glasgow(格拉斯哥大学数学与统计学学院)
DiffLM: Controllable Synthetic Data Generation via Diffusion Language Models
University of Chinese Academy of Sciences(中国科学院大学);Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所信息处理实验室);ByteDance Inc.(字节跳动公司)