Recent advancements in long-context Large Language Models (LLMs) have primarily concentrated on processing extended input contexts, resulting in significant strides in long-context comprehension. However, the equally critical aspect of generating long-form outputs has received comparatively less attention. This paper advocates for a paradigm shift in NLP research toward addressing the challenges of long-output generation. Tasks such as novel writing, long-term planning, and complex reasoning require models to understand extensive contexts and produce coherent, contextually rich, and logically consistent extended text. These demands highlight a critical gap in current LLM capabilities. We underscore the importance of this under-explored domain and call for focused efforts to develop foundational LLMs tailored for generating high-quality, long-form outputs, which hold immense potential for real-world applications.
Wisdom is Knowing What not to Say: Hallucination-Free LLMs Unlearning via Attention Shifting
Faculty of Information Technology, Monash University(墨尔本大学信息科技学院);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences)(教育部计算能力网络与信息安全重点实验室,山东计算机科学中心,齐鲁大学(山东科学院));Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science(山东省计算能力互联网与服务计算重点实验室,山东省计算机科学基础研究中心);School of Computer Science and Technology, Anhui University(安徽大学计算机科学与技术学院)
Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
Drexel University(德雷塞尔大学);AWS AI Lab(亚马逊云科技人工智能实验室);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Lawrence Livermore National Laboratory(劳伦斯利弗莫尔国家实验室)
Shifting AI Efficiency From Model-Centric to Data-Centric Compression
EPIC Lab, Shanghai Jiao Tong University(上海交通大学EPIC实验室);Sichuan University(四川大学);University of Electronic Science & Technology of China(电子科技大学);Shanghai AI Laboratory(上海人工智能实验室);Sun Yat-sen University(中山大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
Structured Outputs Enable General-Purpose LLMs to be Medical Experts
University of Bristol(布里斯托大学);Lehigh University(利哈伊大学);The University of Queensland(昆士兰大学);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);University of California, Merced(加利福尼亚大学默塞德分校)
LLMs Are Biased Towards Output Formats! Systematically Evaluating and Mitigating Output Format Bias of LLMs
National University of Singapore(新加坡国立大学);VinAI Research(VinAI研究院);Institute of High Performance Computing (IHPC), A*STAR(新加坡科技研究局高性能计算研究所);Salesforce Research(Salesforce研究院);Nanyang Technological University(南洋理工大学)
Tracing Stereotypes from Representation to Output in Multilingual LLMs
Saarland University(萨尔大学);Queen’s University Belfast(贝尔法斯特女王大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));University of Technology Nuremberg(纽伦堡工业大学)
The Dark Patterns of Personalized Persuasion in Large Language Models: Exposing Persuasive Linguistic Features for Big Five Personality Traits in LLMs Responses
Warsaw University of Technology(华沙理工大学);University of Warsaw(华沙大学)
G2: Guided Generation for Enhanced Output Diversity in LLMs
Southern University of Science and Technology(南方科技大学);Tsinghua University(清华大学);Shanghai University of Finance and Economics(上海财经大学);Alibaba International Digital Commerce(阿里巴巴国际数字商业)
Efficient Latent Semantic Clustering for Scaling Test-Time Computation of LLMs
Department of Computer Science and Engineering, POSTECH, South Korea(计算机科学与工程系,POSTECH,韩国);Graduate School of Artificial Intelligence, POSTECH, South Korea(人工智能研究生院,POSTECH,韩国)
StructEval: Benchmarking LLMs' Capabilities to Generate Structural Outputs
University of Waterloo(滑铁卢大学);University of Toronto(多伦多大学);HKUST(香港科技大学);Shanghai University(上海大学);Independent Contributor(独立贡献者);Vector Institute(向量研究所);University of British Columbia(不列颠哥伦比亚大学)
AdaPPA: Adaptive Position Pre-Fill Jailbreak Attack Approach Targeting LLMs
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
VoxEmo: Benchmarking Speech Emotion Recognition with Speech LLMs
Department of Computer Science, University of Sheffield, United Kingdom(英国谢菲尔德大学计算机科学系);Signal Analysis and Interpretation Laboratory (SAIL), Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA 90089, USA(美国南加州大学电气与计算机工程系信号分析与解释实验室(SAIL))