Robustness evaluation for Natural Language to SQL (NL2SQL) systems is essential because real-world database environments are dynamic, noisy, and continuously evolving, whereas conventional benchmark evaluations typically assume static schemas and well-formed user inputs. In this work, we introduce a robustness evaluation benchmark containing approximately ten types of perturbations and conduct evaluations under both traditional and agentic settings. We assess multiple state-of-the-art large language models (LLMs), including Grok-4.1, Gemini-3-Pro, Claude-Opus-4.6, and GPT-5.2. Our results show that these models generally maintain strong performance under several perturbations; however, notable performance degradation is observed for surface-level noise (e.g., character-level corruption) and linguistic variation that preserves semantics while altering lexical or syntactic forms. Furthermore, we observe that surface-level noise causes larger performance drops in traditional pipelines, whereas linguistic variation presents greater challenges in agentic settings. These findings highlight the remaining challenges in achieving robust NL2SQL systems, particularly in handling linguistic variability.
Towards Corpus-Grounded Agentic LLMs for Multilingual Grammatical Analysis
University of Ljubljana, Faculty of Computer and Information Science(卢布尔雅那大学计算机与信息科学学院);University of Ljubljana, Faculty of Arts(卢布尔雅那大学艺术学院);Jožef Stefan Institute(乔塞夫·斯塔芬研究所)
Towards trustworthy agentic AI: a comprehensive survey of safety, robustness, privacy, and system security
Faculty of Engineering, Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学工程学院、计算机科学与工程系);Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化院);Shanghai Academy of AI for Science(上海人工智能科学研究院)
Lightweight but Linguistically Fair? Quantisation Robustness across Bavarian, German, and English
Leibniz Supercomputing Centre (LRZ)(莱布尼茨超级计算中心);Bavarian Academy of Sciences and Humanities(巴伐利亚科学与人文学院);TUM University Hospital(慕尼黑工业大学医院);Technical University of Munich(慕尼黑工业大学)
A Systematic Analysis of Linguistic Features in AI-Generated English Text Detection Across Domains and Models
Institute for Natural Language Processing, University of Stuttgart(斯图加特大学自然语言处理研究所);Interchange Forum for Reflecting on Intelligent Systems, University of Stuttgart(智能系统反思交流论坛,斯图加特大学);GESIS Leibniz Institute for the Social Sciences(莱比锡社会科学院);Heinrich-Heine University Düsseldorf(杜塞尔多夫海因里希-海涅大学)
Symbolic Intermediaries as a Linguistic-Numerical Interface for LLM-Driven Geometric Reasoning
Idiap Research Institute(Idiap研究 institute);École Polytechnique Fédérale de Lausanne(瑞士联邦理工学院);Honda Research Institute Europe(本田欧洲研究院);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);National Biomarker Centre, CRUK-MI, University of Manchester(曼彻斯特大学国家生物标记中心)
NAVER Cloud HyperCLOVA X Team(NAVER云HyperCLOVA X团队)
在这份报告中,我们提出了HyperCLOVA X 32 B认为,一个视觉语言模型设计,特别强调在韩国的语言和文化背景下的推理,以及代理能力。HyperCLOVA X 32B Think经过预先训练,重点关注推理能力,随后经过后期训练,以支持多模态理解,增强推理,代理行为以及与人类偏好保持一致。实验评估对smallsized模型表明,我们的模型实现了强大的性能,韩国的文本到文本和视觉到文本的基准,以及面向代理的评估任务。通过开源HyperCLOVA X 32B Think,我们的目标是支持更广泛的采用,并促进学术界和工业界的进一步研究和创新。
Agentic retrieval-augmented reasoning reshapes collective reliability under model variability in radiology question answering
RWTH Aachen University(亚琛工业大学);Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔朗根-纽伦堡大学);Technical University of Munich(慕尼黑工业大学);University Hospital RWTH Aachen(亚琛工业大学医院);University Hospital Erlangen(埃尔朗根大学医院);Erlangen National High Performance Computing Center(埃尔朗根国家高性能计算中心);Stanford University(斯坦福大学)
RewardFlow: Can Action-Level Reward Be Estimated from State-Graph Topology in Agentic RL?
TMLR Group(TMLR小组);Hong Kong Baptist University(香港 Baptist大学);TCL Corporate Research (HK) Co Ltd(TCL企业研究(香港)有限公司);Cooperative Medianet Innovation Center Shanghai Jiao Tong University(合作中位网创新中心上海交通大学);Department of Mathematics Hong Kong Baptist University(香港 Baptist大学数学系)
MUPA: Towards Multi-Path Agentic Reasoning for Grounded Video Question Answering
Lanzhou University(兰州大学);National University of Singapore(新加坡国立大学);Sun Yat-sen University(中山大学);Jinan University(暨南大学);Nanyang Technological University(南洋理工大学);Peking University(北京大学);University of Science and Technology of China(中国科学技术大学);Hefei University of Technology(合肥工业大学)
ContextNav: Towards Agentic Multimodal In-Context Learning
The University of Queensland(昆士兰大学);Nanjing University(南京大学);University of California, Los Angeles(加州大学洛杉矶分校);University of California, Merced(加州大学默塞德分校)
Towards Responsible and Explainable AI Agents with Consensus-Driven Reasoning
Old Dominion University, Norfolk, VA, USA(老奥本大学);Center for Wireless Communications, University of Oulu, Finland(无线通信中心,奥卢大学);Florida International University, USA(佛罗里达国际大学);Nanyang Technological University, Singapore(南洋理工大学);University of Colombo, Sri Lanka(科伦坡大学);Accenture Technology Labs, Arlington, VA, USA(Accenture技术实验室)