arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.04367cs.SE
收藏

应用评论中的解释需求:分类体系与自动检测

Explanation Needs in App Reviews: Taxonomy and Automated Detection

Max Unterbusch, Mersedeh Sadeghi, Jannik Fischbach, Martin Obaidi, Andreas Vogelsang

AI总结:

本文通过人工标注1,730条应用评论构建解释需求分类体系,并提出自动检测方法,在486条未见评论上取得86%加权F-score,帮助工程师有效获取用户解释需求。

摘要:

可解释性,即系统向用户解释其行为的能力,已成为软件密集型系统的一项重要质量属性。近期研究主要关注为各类算法范式(如机器学习、自适应系统)生成解释的方法,但对于哪些情境和哪些类型的行为应当被解释,相关研究相对较少,同时也缺乏对可解释性需求进行获取的支持。在本工作中,我们探索了用户在应用评论中表达的解释需求。我们人工标注了来自8个应用的1,730条应用评论,并构建了一个解释需求分类体系。我们还探索了多种自动识别应用评论中解释需求的方法。我们最优的分类器在来自4个不同应用的486条未见过的评论上识别解释需求,取得了86%的加权F-score。我们的工作有助于更好地理解用户的解释需求。自动化工具可以帮助工程师关注这些需求,并最终获取有效的解释需求。

英文摘要:

Explainability, i.e. the ability of a system to explain its behavior to users, has become an important quality of software-intensive systems. Recent work has focused on methods for generating explanations for various algorithmic paradigms (e.g., machine learning, self-adaptive systems). There is relatively little work on what situations and types of behavior should be explained. There is also a lack of support for eliciting explainability requirements. In this work, we explore the need for explanation expressed by users in app reviews. We manually coded a set of 1,730 app reviews from 8 apps and derived a taxonomy of Explanation Needs. We also explore several approaches to automatically identify Explanation Needs in app reviews. Our best classifier identifies Explanation Needs in 486 unseen reviews of 4 different apps with a weighted F-score of 86%. Our work contributes to a better understanding of users' Explanation Needs. Automated tools can help engineers focus on these needs and ultimately elicit valid Explanation Needs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑