arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.02775cs.HC
收藏

期望过高,收获过低:探索异步AI面试官的挑战与设计机会

Expecting Too Much, Getting Too Little: Exploring the Challenges and Design Opportunities of Asynchronous AI Interviewers

University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校)

Md Nazmus Sakib, Naga Manogna Rayasam, Sanorita Dey

AI总结:

研究探讨了异步AI面试系统对用户自主性的影响,通过分析和访谈揭示了期望不匹配问题,并设计了支持用户自主性的界面。

摘要:

组织使用异步AI面试系统来高效管理大量申请人池,实现快速且一致的评估。然而,仍存在对其对用户自主性和申请人体验缺乏个性化方面的担忧。尽管已尽力使面试过程人性化,但用户期望往往未得到满足,尤其是在与系统承诺相比时。为了探讨申请人如何感知和体验这些工具,特别是随着他们对大语言模型(LLMs)的熟悉度增加,我们进行了两阶段研究。第一阶段分析了11个子Reddit讨论,随后与17名参与者进行了半结构化访谈。定性分析揭示了关键问题,如期望不匹配,这些因素影响了参与者的自主感和信任,常导致工作绕过和欺骗行为。在后续研究中,我们设计了一个具有两种功能的界面:响应变体和反馈变体,并在六个小组(N=180,每组30人)中评估其是否支持用户的自主性、能力及相关性。我们的分析表明,即使是细微的设计变化也能增强用户的自主性,而精心设计的反馈可以在高风险面试情境中提供有意义的支持。

英文摘要:

Organizations use asynchronous AI interview systems to efficiently manage large applicant pools, enabling quick and uniform evaluations. However, concerns remain about their impact on user agency and the lack of personalization applicants experience with these systems. Although efforts have been made to humanize the interview process, users' expectations are often unmet, especially when compared to the promises made by these systems. To examine how applicants perceive and experience these tools, particularly in the context of their growing familiarity with large language models (LLMs), we conducted a two-phase study. The first phase involved an analysis of 11 subreddit discussions on interview experiences with asynchronous AI interviewers, followed by a semi-structured interview study with 17 participants. Qualitative analysis revealed key issues such as mismatched expectations, amplified by organizational rhetoric and applicant expectations shaped by experiences with LLMs. These factors shaped participants' sense of agency and trust, often leading to workarounds and deceptive practices. In the follow-up study, we designed an interface with two features, response variants and feedback variants, and evaluated it across six groups (N = 180, 30 participants each) to assess whether these features support users' sense of agency, competence, and relatedness. Our analysis suggests that even subtle design changes can enhance user autonomy and that carefully designed feedback can provide meaningful support in high-stakes interview contexts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑