We present a computational exploration of argument critique writing by young students. Middle school students were asked to criticize an argument presented in the prompt, focusing on identifying and explaining the reasoning flaws. This task resembles an established college-level argument critique task. Lexical and discourse features that utilize detailed domain knowledge to identify critiques exist for the college task but do not perform well on the young students data. Instead, transformer-based architecture (e.g., BERT) fine-tuned on a large corpus of critique essays from the college task performs much better (over 20% improvement in F1 score). Analysis of the performance of various configurations of the system suggests that while children's writing does not exhibit the standard discourse structure of an argumentative essay, it does share basic local sequential structures with the more mature writers.
WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays
Department of Informatics, King’s College London(伦敦国王学院信息学系);Waseda University(早稻田大学);Beijing University of Posts and Telecommunications(北京邮电大学);University of Sheffield(谢菲尔德大学);Hosei University(法政大学)
Argument Rarity-based Originality Assessment for AI-Assisted Writing
Ritsumeikan Global Innovation Research Organization (R-GIRO), Ritsumeikan University(日光全球创新研究组织(R-GIRO)、日光大学);Faculty of Business and Commerce, Kansai University(大阪大学商学部);Arbege Corporation(Arbege公司);College of Life Sciences, Ritsumeikan University(日光大学生命科学学院);Office of General Education, Ritsumeikan University(日光大学通识教育办公室)
Towards Comprehensive Argument Analysis in Education: Dataset, Tasks, and Method
Lab of Artificial Intelligence for Education, East China Normal University(教育人工智能实验室,华东师范大学);Shanghai Institute of Artificial Intelligence for Education, East China Normal University(教育人工智能上海研究院,华东师范大学);School of Computer Science and Technology, East China Normal University(计算机科学与技术学院,华东师范大学);Department of Chinese Language and Literature, East China Normal University(中文语言文学系,华东师范大学);College of Education, Zhejiang University(教育学院,浙江大学)
Exploring how EFL students talk to and through AI to develop texts
Everwrite Limited(Everwrite有限公司);Shanghai Jiao Tong University(上海交通大学);The Education University of Hong Kong(香港教育大学);The University of Hong Kong(香港大学);The Chinese University of Hong Kong(香港中文大学)