Large Reasoning Models (LRMs) still exhibit large performance gaps between English and other languages, yet much current work assumes these gaps can be closed simply by making reasoning in every language resemble English reasoning. This work challenges this assumption by asking instead: what actually characterizes successful reasoning traces in multilingual settings, and to what extent do English-derived reasoning features genuinely help in other languages? We first define a suite of measurable reasoning features spanning multilingual alignment, reasoning step, and reasoning flow aspects of reasoning traces, and use logistic regression to quantify how each feature associates with final answer accuracy. We further train sparse autoencoders over multilingual traces to automatically discover latent reasoning concepts that instantiate or extend these features. Finally, we use the features to re-rank traces and measure their impact on accuracy at test time. Across two mathematical reasoning benchmarks, four LRMs, and ten languages, we find that most features are positively associated with accuracy, but the strength of association varies considerably across languages and can even reverse in some. Our findings challenge English-centric reward designs and point toward adaptive objectives that accommodate language-specific reasoning patterns, with concrete implications for multilingual benchmark and reward design.
Paraphrase Generation as Zero-Shot Multilingual Translation: Disentangling Semantic Similarity from Lexical and Syntactic Diversity
Johns Hopkins University(约翰斯·霍普金斯大学)
最近的研究表明,多语言神经机器翻译(NMT)模型可以用来判断一个句子对同一语言中另一个句子的释义程度(Thompson and Post,2020);然而,试图使用标准束搜索从这样的模型中生成释义会产生微不足道的副本或近似副本。我们引入了一个简单的释义生成算法,该算法不鼓励在输入中产生n元语法。我们的方法可以从一个单一的多语言NMT模型中生成多种语言的释义。此外,输入和输出之间的词汇多样性的量可以在生成时控制。我们进行了一次人工评估,将我们的方法与在大型英语合成释义数据库ParaBank 2上训练的释义器进行比较(Hu等人,2019 c),并发现我们的方法产生的释义,更好地保留意义,更符合语法,为同一水平的词汇多样性。其他较小的人类评估表明,我们的方法也适用于两种非英语语言。
Disentangling Language and Culture for Evaluating Multilingual Large Language Models
Singapore Management University(新加坡管理学院);University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学);Institute of Trustworthy Embodied AI, Fudan University(复旦大学可信具身人工智能研究院);DAMO Academy, Alibaba Group(阿里集团大模型实验室);Singapore University of Technology and Design(新加坡科技设计大学)
Disentangling Language Roles in Multilingual LLM Task Execution
Marquette(马凯特大学);Cornell(康奈尔大学);UC San Diego(南加州大学圣地亚哥分校);UPenn(普林斯顿大学);UT Austin(德克萨斯大学奥斯汀分校);Maryland(马里兰大学);Michigan(密歇根大学);UIUC(伊利诺伊大学香槟分校);Melbourne(墨尔本大学);Stanford(斯坦福大学)
Improving Multilingual Neural Machine Translation by Utilizing Semantic and Linguistic Features
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);Key Laboratory of Intelligent Information Processing(智能信息处理重点实验室);Key Laboratory of AI Safety, Chinese Academy of Sciences(中国科学院人工智能安全重点实验室)
Macro: Enhancing Multilingual Counterfactual Explanations through Alignment-as-Preference Optimization
Technische Universität Berlin(柏林技术大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);University of Duisburg-Essen(杜伊斯堡- Essen大学);LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Saarland Informatics Campus(萨尔兰州信息学校区);BIFOLD – Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究院);Centre for European Research in Trusted AI (CERTAIN)(可信人工智能欧洲研究中心)
PETra: A Multilingual Corpus of Pragmatic Explicitation in Translation
Saarland University, Saarland Informatics Campus, Germany(萨尔兰大学,萨尔兰信息学院,德国);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Barcelona Supercomputing Center (BSC-CNS), Barcelona, Catalonia, Spain(巴塞罗那超级计算中心(BSC-CNS),巴塞罗那,加泰罗尼亚,西班牙)
Multilingual Political Views of Large Language Models: Identification and Steering
Saarland University(萨尔兰州大学);University of Trento(特伦特大学);Brno University of Technology(布拉格技术大学);Kempelen Institute of Intelligent Technologies(凯姆佩尔智能技术研究所);German Research Center for AI (DFKI)(人工智能德国研究中心(DFKI))
Towards a Phonology-Informed Evaluation of Multilingual TTS
Centre for Linguistic Science & Technology, IIT Guwahati(印度理工学院古瓦哈提分校语言科学与技术中心);Mehta Family School for Data Science & Artificial Intelligence, IIT Guwahati(印度理工学院古瓦哈提分校梅塔家族数据科学与人工智能学院);Department of Humanities & Social Sciences, IIT Guwahati(印度理工学院古瓦哈提分校人文与社会科学系)