We extend sequence-to-sequence models with the possibility to control the characteristics or style of the generated output, via attention that is generated a priori (before decoding) from a latent code vector. After training an initial attention-based sequence-to-sequence model, we use a variational auto-encoder conditioned on representations of input sequences and a latent code vector space to generate attention matrices. By sampling the code vector from specific regions of this latent space during decoding and imposing prior attention generated from it in the seq2seq model, output can be steered towards having certain attributes. This is demonstrated for the task of sentence simplification, where the latent code vector allows control over output length and lexical simplification, and enables fine-tuning to optimize for different evaluation metrics.
SCAR: Data Selection via Style Consistency-Aware Response Ranking for Efficient Instruction-Tuning of Large Language Models
School of Computing Technologies, RMIT University, Australia（皇家墨尔本理工大学计算机科技学院）；School of Computer Science and Engineering, University of New South Wales（新南威尔士大学计算机科学与工程学院）；Department of Data Science & AI, Monash University, Australia（墨尔本大学数据科学与人工智能系）
Speaker Style-Aware Phoneme Anchoring for Improved Cross-Lingual Speech Emotion Recognition
Department of Electrical Engineering, National Tsing Hua University, Taiwan（National Tsing Hua University电子工程系）；Language Technologies Institute, Carnegie Mellon University, USA（卡内基梅隆大学语言技术研究所）
Generalized Multilingual Text-to-Speech Generation with Language-Aware Style Adaptation
School of Computer Science and Engineering, UNSW Sydney（新南威尔士大学悉尼分校计算机科学与工程学院）；School of Engineering, Institute of Science Tokyo（东京科学大学工程学院）；CSIRO’s Data61（澳大利亚联邦科学与工业研究组织数据61部门）
Style-Aware Radiology Report Generation with RadGraph and Few-Shot Prompting
Stanford University（斯坦福大学）；Jawaharlal Institute of Postgraduate Medical Education and Research (JIPMER)（贾瓦哈拉尔研究生医学教育与研究学院）；Hospital Israelita Albert Einstein（以色列阿尔伯特·爱因斯坦医院）；Johns Hopkins University（约翰斯·霍普金斯大学）；Massachusetts General Hospital（马萨诸塞总医院）；Harvard Medical School（哈佛医学院）
