LLM Probability Concentration: How Alignment Shrinks the Generative Horizon
LLM概率集中:对齐如何缩小生成范围
Chenghao Yang, Sida Li, Ari Holtzman
专题命中
推理与问题求解
:LLM(title,abstract);large language model(abstract);language model(abstract);prompting(abstract)
AI总结
研究发现对齐微调通过减少生成多样性,使LLM生成更一致,从而影响复杂推理稳定性。
CommentsCodebase: https://github.com/yangalan123/LLMBranchingFactor. V3: Significantly rewrite the whole paper for a clearer structure. Correct problems in the theory parts (Remove emphasis on AEP, discussions on variable LLM generation lengths) and strengthen asymptotic analysis. Add Qwen and OLMo2 experiments. Preliminary SFT v.s. RL comparison to better understand the alignment effects on BF
EAGLE: Elevating Geometric Reasoning through LLM-empowered Visual Instruction Tuning
通过LLM赋能的视觉指令微调提升几何推理能力
Zhihao Li, Yao Du, Yang Liu, Yan Zhang, Yufang Liu, Mengdi Zhang, Xunliang Cai, Charles Ling, Boyu Wang
机构
*
Department of Computer Science, Western University(计算机科学系,西部大学)
;
Meituan Inc.(美团公司)
;
Department of Automation, Tsinghua University(自动化系,清华大学)
;
School of Computer Science and Technology, East China Normal University(计算机科学与技术学院,东华大学)
专题命中
推理与问题求解
:LLM(title,abstract);instruction tuning(title);large language model(abstract);language model(abstract)
机构
*
Department of Computer Science and Artificial Intelligence, University of Technology Nuremberg(计算机科学与人工智能系,图恩技术大学)
;
Department of Engineering ``Enzo Ferrari'' (DIEF), University of Modena and Reggio Emilia(恩佐·费尔拉蒂工程系(DIEF),摩德纳和雷吉奥艾米利亚大学)
;
Technical University of Munich(慕尼黑技术大学)
专题命中
推理与问题求解
:large language model(title,abstract);language model(title,abstract);foundation model(abstract)
Large Language Model-Driven Closed-Loop UAV Operation with Semantic Observations
基于大语言模型的闭环无人机操作与语义观测
Wenhao Wang, Yanyan Li, Long Jiao, Jiawei Yuan
机构
*
Department of CIS, University of Massachusetts Dartmouth(CIS系,马萨诸塞大学达特茅斯分校)
;
Department of CSIS, California State University San Marcos(CSIS系,加州州立大学桑马科斯分校)
专题命中
推理与问题求解
:large language model(title,abstract);language model(title,abstract);LLM(abstract)
Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models
面向多模态大语言模型的推理保留反学习
Hongji Li, Junchi yao, Manjiang Yu, Priyanka Singh, Xue Li, Di Wang, Lijie Hu
机构
*
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI)(Mohamed bin Zayed人工智能大学)
;
University of Queensland(昆士兰大学)
;
Provable Responsible AI and Data Analytics (PRADA) Lab(可证明责任人工智能与数据分析实验室)
;
King Abdullah University of Science and Technology (KAUST)(卡塔尔科学与技术大学)
专题命中
推理与问题求解
:large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Driving
DriveMLM: 通过行为规划状态对齐多模态大语言模型以实现自动驾驶
Erfei Cui, Wenhai Wang, Zhiqi Li, Jiangwei Xie, Haoming Zou, Hanming Deng, Gen Luo, Lewei Lu, Xizhou Zhu, Jifeng Dai
机构
*
Department of Electronic Engineering, Tsinghua University(清华大学电子工程系)
;
Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心)
专题命中
推理与问题求解
:large language model(title,abstract);language model(title,abstract);LLM(abstract)
Large language models can learn and generalize steganographic chain-of-thought under process supervision
大语言模型可以在过程监督下学习和泛化隐写链式思维
Joey Skaf, Luis Ibanez-Lissen, Robert McCarthy, Connor Watts, Vasil Georgiv, Hannes Whittingham, Lorena Gonzalez-Manzano, David Lindner, Cameron Tice, Edward James Young, Puria Radmard
机构
*
Mentorship for Alignment Research Students (MARS)(对齐研究 mentorship 项目)
;
University College London(伦敦大学学院)
;
Queen Mary University of London(伦敦女王学院)
;
ML Alignment & Theory Scholars (MATS)(对齐与理论学者)
;
Meridian Impact, Cambridge(剑桥 Meridian Impact)
;
Universidad Carlos III de Madrid(马德里卡洛斯三世大学)
;
Geodesic Research and University of Cambridge(Geodesic Research 和剑桥大学)
专题命中
推理与问题求解
:large language model(title,abstract);language model(title,abstract);分类 cs.CL、cs.AI、cs.LG
机构
*
University of Science and Technology of China(科学技术大学)
;
Singapore University of Technology and Design(新加坡科技设计大学)
;
Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
专题命中
推理与问题求解
:large language model(title,abstract);language model(title,abstract);prompting(abstract)