arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.11534cs.HCcs.CL
收藏

视觉文本分析评价与实验设计的跨学科视角:立场文件

An Interdisciplinary Perspective on Evaluation and Experimental Design for Visual Text Analytics: Position Paper

Linköping University(林雪平大学);Linnaeus University(林奈大学);University of Toronto(多伦多大学);Vrije Universiteit Amsterdam(阿姆斯特丹自由大学);Lund University(隆德大学);Uppsala University(乌普萨拉大学);LMU Munich(慕尼黑大学)

Kostiantyn Kucher, Nicole Sultanum, Angel Daza, Vasiliki Simaki, Maria Skeppstedt, Barbara Plank, Jean-Daniel Fekete, Narges Mahyar

摘要:

适当的评估和实验设计是经验科学的基础,特别是在数据驱动的领域。例如,由于语言计算建模的成功,研究成果对最终用户的影响越来越直接。随着最终用户采用的差距缩小,需要增加,以确保研究社区和从业人员开发的工具和模型是可靠的,值得信赖的,并支持用户的目标。在这份立场文件中,我们专注于评估视觉文本分析方法的问题。我们从可视化和自然语言处理社区的跨学科的角度来看,因为我们认为,视觉文本分析的设计和验证包括超越计算或视觉/交互方法本身的关注。我们确定了评估视觉文本分析方法的四个关键挑战组(数据模糊性,实验设计,用户信任和“大局”关注),并从跨学科的角度为研究机会提供建议。

英文摘要:

Appropriate evaluation and experimental design are fundamental for empirical sciences, particularly in data-driven fields. Due to the successes in computational modeling of languages, for instance, research outcomes are having an increasingly immediate impact on end users. As the gap in adoption by end users decreases, the need increases to ensure that tools and models developed by the research communities and practitioners are reliable, trustworthy, and supportive of the users in their goals. In this position paper, we focus on the issues of evaluating visual text analytics approaches. We take an interdisciplinary perspective from the visualization and natural language processing communities, as we argue that the design and validation of visual text analytics include concerns beyond computational or visual/interactive methods on their own. We identify four key groups of challenges for evaluating visual text analytics approaches (data ambiguity, experimental design, user trust, and "big picture" concerns) and provide suggestions for research opportunities from an interdisciplinary perspective.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑