Automatic scoring system is extremely complex for any language. Because natural language itself is a complex model. When we evaluate articles generated by natural language, we need to view the articles from many dimensions such as word features, grammatical features, semantic features, text structure and so on. Even human beings sometimes can't accurately grade a composition because different people have different opinions about the same article. But a composition scoring system can greatly assist language learners. It can make language leaner improve themselves in the process of output something. Though it is still difficult for machines to directly evaluate a composition at the semantic and pragmatic levels, especially for Japanese, Chinese and other language in high context cultures, we can make machine evaluate a passage in word and grammar levels, which can as an assistance of composition rater or language learner. Especially for foreign language learners, lexical and syntactic content are usually what they are more concerned about. In our experiments, we did the follows works: 1) We use word segmentation tools and dictionaries to achieve word segmentation of an article, and extract word features, as well as generate a words' complexity feature of an article. And Bow technique are used to extract the theme features. 2) We designed a Turing-complete automata model and create 300+ automatons for the grammars that appear in the JLPT examination. And extract grammars features by using these automatons. 3) We propose a statistical approach for scoring a specify theme of composition, the final score will depend on all the writings that submitted to the system. 4) We design an grammar hint function for language leaner, so that they can know currently what grammars they can use.
Performance Evaluation of Open-Source Large Language Models for Assisting Pathology Report Writing in Japanese
Department of Pathology, University of Yamanashi, Chuo, Japan（山梨大学病理科）；Division of Pathology, Exploratory Oncology Research & Clinical Trial Center, National Cancer Center, Kashiwa, Japan（国立癌症中心探索肿瘤研究与临床试验中心病理科）；Department of Preventive Medicine, Graduate School of Medicine, The University of Tokyo, Tokyo, Japan（东京大学医学部预防医学科）；Department of Medical Oncology, National Cancer Center Hospital East, Kashiwa, Japan（国立癌症中心东医院医学肿瘤科）；Department of Thoracic Surgery, National Cancer Center Hospital East, Kashiwa, Japan（国立癌症中心东医院胸外科）
From Prompting to Preference Optimization: A Comparative Study of LLM-based Automated Essay Scoring
Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam（信息科技学院，科学大学，胡志明市，越南）；Vietnam National University, Ho Chi Minh City, Vietnam（越南国家大学，胡志明市，越南）
Word Embedding for Response-To-Text Assessment of Evidence
University of Pittsburgh（匹兹堡大学）；Department of Computer Science（计算机科学系）；Department of Computer Science & LRDC（计算机科学系和LRDC）；Pittsburgh, PA 15260（宾夕法尼亚州匹兹堡市15260）
Unleashing Large Language Models' Proficiency in Zero-shot Essay Scoring
National Key Laboratory for Multimedia Information Processing, Peking University（北京大学多媒体信息处理国家重点实验室）；School of Computer Science, Peking University（北京大学计算机学院）；School of Software and Microelectronics, Peking University（北京大学软件与微电子学院）
JMedEthicBench: A Multi-Turn Conversational Benchmark for Evaluating Medical Safety in Japanese Large Language Models
Kyoto University（京都大学）；Hohai University（河海大学）；The University of Tokyo（东京大学）；University of Science and Technology of China（中国科学技术大学）；Hong Kong Polytechnic University（香港理工大学）
Exploring AI-Generated Text in Student Writing: How Does AI Help?
Precious Blood Secondary School（宝血中学）；The Education University of Hong Kong（香港教育大学）；The University of Hong Kong（香港大学）；Hoi Ping Chamber of Commerce Secondary School（海平商会中学）
EssayJudge: A Multi-Granular Benchmark for Assessing Automated Essay Scoring Capabilities of Multimodal Large Language Models
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Beijing Future Brain Education Technology Co., Ltd.（北京未来脑教育科技有限公司）；The Hong Kong University of Science and Technology（香港科技大学）；Tsinghua University（清华大学）；Guangxi Zhuang Autonomous Region Big Data Research Institute（广西壮族自治区大数据研究院）
Product vs. Process: Exploring EFL Students' Editing of AI-Generated Text for Expository Writing
Precious Blood Secondary School（宝血中学）；Shanghai Jiao Tong University（上海交通大学）；The University of Hong Kong（香港大学）；The Education University of Hong Kong（香港教育大学）；Hoi Ping Chamber of Commerce Secondary School（香港商会中学）
