Understanding how large language models (LLMs) grasp the historical context of concepts and their semantic evolution is essential in advancing artificial intelligence and linguistic studies. This study aims to evaluate the capabilities of various LLMs in capturing temporal dynamics of meaning, specifically how they interpret terms across different time periods. We analyze a diverse set of terms from multiple domains, using tailored prompts and measuring responses through both objective metrics (e.g., perplexity and word count) and subjective human expert evaluations. Our comparative analysis includes prominent models like ChatGPT, GPT-4, Claude, Bard, Gemini, and Llama. Findings reveal marked differences in each model's handling of historical context and semantic shifts, highlighting both strengths and limitations in temporal semantic understanding. These insights offer a foundation for refining LLMs to better address the evolving nature of language, with implications for historical text analysis, AI design, and applications in digital humanities.
Large Language Model-Driven Dynamic Assessment of Grammatical Accuracy in English Language Learner Writing
National Institute of Standards（国家标准 institute）；Department of Physics, Colorado State University（物理系，科罗拉多州立大学）；Electrical Engineering Department, University of Colorado（电气工程系，科罗拉多大学）
Measuring Meaning Composition in the Human Brain with Composition Scores from Large Language Models
National Key Laboratory for Novel Software Technology, Nanjing University（南京大学计算机软件新技术国家重点实验室）；Department of Linguistics and Translation, City University of Hong Kong（香港城市大学语言及翻译学系）
Oasis: Data Curation and Assessment System for Pretraining of Large Language Models
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Beijing Unisound Information Technology Co., Ltd（北京云知声信息技术有限公司）
Department of Linguistics（语言学系）；Charles University（查尔斯大学）；Department（部门）；Claude Bernard University Lyon（克莱尔·伯纳德大学里昂）；Department of General Linguistics（一般语言学系）；Palacký University Olomouc（帕拉茨基大学奥洛穆克）
Large Language Models for Mental Health Diagnostic Assessments: Exploring The Potential of Large Language Models for Assisting with Mental Health Diagnostic Assessments -- The Depression and Anxiety Case
Indian Institute of Research and Science, Bhopal（博帕尔印度研究与科学学院）；Indian Institute of Technology, Kharagpur（克勒格布尔印度理工学院）
Evaluating Vision-Language and Large Language Models for Automated Student Assessment in Indonesian Classrooms
Quantic School of Business and Technology（Quantic商业与技术学院）；Mohamed bin Zayed University of Artificial Intelligence（穆罕默德·本·扎耶德人工智能大学）；Indonesia University of Education（印度尼西亚教育大学）；Monash University（莫纳什大学）
Aesthetic Assessment of Chinese Handwritings Based on Vision Language Models
The Open University of China（中国开放大学）；Engineering Research Center of Integration and Application of Digital Learning Technology, Ministry of Education（数字化学习技术集成与应用教育部工程研究中心）；OUC-online（国开在线）
LLMs Struggle to Measure What Distinguishes Students of Different Proficiency Levels: A Study of Item Discrimination in Reading Comprehension Assessment
MBZUAI（穆罕默德·本·扎耶德人工智能大学）；University of Maryland（马里兰大学）；Virginia Tech（弗吉尼亚理工大学）
Modeling the language cortex with form-independent and enriched representations of sentence meaning reveals remarkable semantic abstractness
University of California San Diego（加州大学圣地亚哥分校）；ShanghaiTech University（上海科技大学）；Kempner Institute, Harvard University（哈佛大学凯普勒研究所）；Shanghai Jiao Tong University（上海交通大学）；Carnegie Mellon University（卡内基梅隆大学）；Massachusetts Institute of Technology（麻省理工学院）
Argument Quality Assessment in the Age of Instruction-Following Large Language Models
Leibniz University Hannover（汉诺威莱布尼茨大学）；GESIS（莱布尼茨社会科学研究所）；Heinrich-Heine University Düsseldorf（杜塞尔多夫海因里希·海涅大学）；CNRS（法国国家科学研究中心）；Inria（法国国家信息与自动化研究所）；I3S（计算机、信号与系统实验室）；Universität Hamburg（汉堡大学）；University of Richmond（里士满大学）；University of Stuttgart（斯图加特大学）
PrompTrend: Continuous Community-Driven Vulnerability Discovery and Assessment for Large Language Models
University of Manouba（曼努巴大学）；University of Jendouba（杰努布大学）；LETI Laboratory, University of Sfax（萨克斯大学LETI实验室）；DataDoIt（DataDoIt公司）；South Mediterranean University（南地中海大学）
