arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.27671cs.CL

ICLE++:为整体作文评分建模细粒度特征

ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring

Shengjie Li, Vincent Ng

首次发表
浏览论文内容

中文总结 AI 辅助

该研究推出标注了整体与特征分数的ICLE++语料库,可测试ASAP训练的AES模型泛化性,助力新型AES问题模型评估,为AES研究提供关键语料库。

中文摘要 AI 辅助

近期开发的多数自动作文评分(AES)模型仅在ASAP语料库上进行评估。然而ASAP存在局限,比如尚不清楚在ASAP上训练的模型在其他语料库上评估时能否良好泛化。鉴于这些局限,我们推出ICLE++,这是一个包含学生议论文的语料库,标注了整体分数和特定特征分数。ICLE++不仅可用于测试在ASAP上训练的AES模型的泛化能力,还能助力评估针对多特征评分、跨提示评分等新型AES问题开发的模型。我们认为,ICLE++是我们长期标注ICLE语料库论文的成果,为AES研究提供了急需的标注语料库。

英文摘要

The majority of the recently-developed models for automated essay scoring (AES) are evaluated solely on the ASAP corpus. However, ASAP is not without its limitations. For instance, it is not clear whether models trained on ASAP can generalize well when evaluated on other corpora. In light of these limitations, we introduce ICLE++, a corpus of persuasive student essays annotated with both holistic scores and trait-specific scores. Not only can ICLE++ be used to test the generalizability of AES models trained on ASAP, but it can also facilitate the evaluation of models developed for newer AES problems such as multi-trait scoring and cross-prompt scoring. We believe that ICLE++, which represents a culmination of our long-term effort in annotating the essays in the ICLE corpus, contributes to the set of much-needed annotated corpora for AES research.

补充信息

↑