Large Language Models (LLMs) are increasingly used in software engineering (SE), yet there is no systematic study that determines to which degree these LLMs actually understand standardized SE terminology. Lack of such understanding can lead to miscommunication and misunderstanding, both by LLMs consuming text but also by human-developers acting on LLM-generated text. Within this paper, we investigate to which degree state-of-the-art LLMs are able to identify whether definitions from the ISO/IEC/IEEE 24765:2017 Systems and Software Engineering - Vocabulary are correct. We prompt LLMs both with correct definitions, as well as systematically falsified definitions. The falsifications are both semantic (substitution of key terms) and structural (removing critical information). We measure both classification accuracy and whether reasoning tokens generated by the LLMs make sense with respect to understanding the definition. While most LLMs detect falsified definitions with high accuracy, they also reject many correct definitions, indicating a systematic rejection bias rather than genuine discriminative understanding. Explicit reasoning does not consistently improve results and may even hinder performance through over-thinking. Our work demonstrates that while the performance of LLMs (including their agentic use) in many SE tasks is impressive, there are still fundamental issues to understand how this will impact SE, including the consistent use of terminology.
An Empirical Study of Generative AI Adoption in Software Engineering
Eindhoven University of Technology(埃因霍温理工大学);Izmir Institute of Technology(伊兹密尔理工学院);Pontifical Catholic University of Rio de Janeiro (PUC-Rio)(里约热内卢天主教大学);Blekinge Institute of Technology(布莱金厄理工学院);fortiss
Laboratorio de Investigación y Formación en Informática Avanzada (LIFIA)(先进信息与计算研究培训中心);Facultad de Informática - Universidad Nacional de La Plata(拉普拉塔国立大学信息学院);Comisión de Investiación Científica - CIC Bs.As.(布宜诺斯艾利斯省科学研究委员会)
School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);Jisuan Institute of Technology, Beijing JudaoYouda Network Technology Co. Ltd.(智算技术研究所,北京judaoYouda网络技术有限公司)
The Fusion of Large Language Models and Formal Methods for Trustworthy AI Agents: A Roadmap
National University of Singapore(新加坡国立大学);Peking University(北京大学);Huazhong University of Science and Technology(华中科技大学);Griffith University(格里菲斯大学);Beijing Institute of Technology(北京理工大学);Singapore Management University(新加坡管理大学);University of Auckland(奥克兰大学)