arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.03364cs.CL

EXPATS: A Toolkit for Explainable Automated Text Scoring

LegalForce, Inc.(LegalForce 公司);Octanove Labs(Octanove 实验室)

Hitoshi Manabe, Masato Hagiwara

英文摘要:

Automated text scoring (ATS) tasks, such as automated essay scoring and readability assessment, are important educational applications of natural language processing. Due to their interpretability of models and predictions, traditional machine learning (ML) algorithms based on handcrafted features are still in wide use for ATS tasks. Practitioners often need to experiment with a variety of models (including deep and traditional ML ones), features, and training objectives (regression and classification), although modern deep learning frameworks such as PyTorch require deep ML expertise to fully utilize. In this paper, we present EXPATS, an open-source framework to allow its users to develop and experiment with different ATS models quickly by offering flexible components, an easy-to-use configuration system, and the command-line interface. The toolkit also provides seamless integration with the Language Interpretability Tool (LIT) so that one can interpret and visualize models and their predictions. We also describe two case studies where we build ATS models quickly with minimal engineering efforts. The toolkit is available at \url{https://github.com/octanove/expats}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑