arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11158cs.HCcs.AIcs.CY
收藏

研究员工和学生对AI感知的方法学差异

Methodological Variation in Studying Staff and Student Perceptions of AI

Ulster University(阿尔斯特大学);Queen’s University Belfast(贝尔法斯特女王大学)

Juliana Gerard, Morgan Macleod, Kelly Norwood, Aisling Reid, Muskaan Singh

AI总结:

本文研究了不同方法学在比较学生和员工对AI感知时的差异,通过情感分析和专题分析揭示了数据来源和分析方法对结果的影响。

摘要:

在本文中,我们比较了比较学生和员工感知的不同方法,并提出问题:这些测量方法在不同方法之间有多大差异?我们专注于AI感知的情况,通常通过单一的定量或定性测量,或通过混合方法来比较两个不同的数据源——例如定量问卷和定性评论。为了比较不同的方法,我们收集了两种定性数据:独立评论和结构化焦点小组。我们对每种数据源进行两种分析:使用情感和立场分析,我们测量评论和焦点小组对话的整体负面/正面程度。同时,来自评论的词云和对焦点小组的专题分析提供了关于这种定性数据内容的进一步细节——特别是专题分析,它包括学生和员工之间的相似性和差异性。我们证明了不同的分析可以产生不同的结果——对于单一数据源。这种差异源于被评估的构念——整体的积极/消极程度可以产生不同的画面,与更详细的基于内容的分析不同。我们讨论了这种差异对机构环境以及先前研究比较的影响。

英文摘要:

In this paper, we compare methodological approaches for comparing student and staff perceptions, and ask: how much do these measures vary across different approaches? We focus on the case of AI perceptions, which are generally assessed via a single quantitative or qualitative measure, or with a mixed methods approach that compares two distinct data sources - e.g. a quantitative questionnaire with qualitative comments. To compare different approaches, we collect two forms of qualitative data: standalone comments and structured focus groups. We conduct two analyses for each data source: with a sentiment and stance analysis, we measure overall negativity/positivity of the comments and focus group conversations, respectively. Meanwhile, word clouds from the comments and a thematic analysis of the focus groups provide further detail on the content of this qualitative data - particularly the thematic analysis, which includes both similarities and differences between students and staff. We show that different analyses can produce different results - for a single data source. This variation stems from the construct being evaluated - an overall measure of positivity/negativity can produce a different picture from more detailed content-based analyses. We discuss the implications of this variation for institutional contexts, and for the comparisons from previous studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑