arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.09030cs.CLcs.HC
收藏

协作对交互主题发现系统性能的影响

Effects of Collaboration on the Performance of Interactive Theme Discovery Systems

University of Colorado Boulder(科罗拉多大学波德沃分校)

Alvin Po-Chun Chen, Rohan Das, Dananjay Srinivas, Alexandra Barry, Maksim Seniw, Maria Leonor Pacheco

AI总结:

本文研究了同步与异步协作对三种NLP辅助定性研究工具性能的影响,分析了结果的一致性、凝聚力和正确性差异。

摘要:

NLP辅助解决方案在支持定性数据分析方面获得了广泛关注。然而,尚无统一的评估框架能涵盖定性研究者在多种设置中使用的各种情况。本文提出一个框架,用于评估协作设置如何在各种交互系统中产生不同的研究结果。具体而言,我们研究了同步与异步协作对三种不同的NLP辅助定性研究工具的影响,并对结果的一致性、凝聚力和正确性差异进行了全面分析。

英文摘要:

NLP-assisted solutions to support qualitative data analysis have gained considerable traction. However, no unified evaluation framework exists which can account for the many different settings in which qualitative researchers may employ them. In this paper, we propose a framework to evaluate the way collaboration settings may produce different research outcomes across a variety of interactive systems. Specifically, we study the impact of synchronous vs. asynchronous collaboration using three different NLP-assisted qualitative research tools and present a comprehensive analysis of the differences in the consistency, cohesiveness, and correctness of their outcomes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑