AI流利度的悖论
A paradox of AI fluency
AI总结:
研究揭示AI流利用户与初学者在任务复杂度和交互模式上的差异,指出流利用户虽经历更多失败但失败更显性,而初学者常有隐性失败,强调主动参与对AI成功的重要性。
摘要:
用户对AI的技能如何影响AI实际提供的结果?这一问题对用户、AI产品开发者和社会至关重要,但研究不足。利用27K注释的WildChat-4.8M转录文本,研究显示流利用户承担更复杂的任务,采用协作交互模式,通过迭代优化目标和批判性评估输出,而初学者则被动。这些差异导致AI流利度悖论:流利用户经历更多失败,但失败更显性,更可能部分恢复,且在复杂任务上更成功。初学者则常有隐性失败:看似成功但实际偏离目标。这些结果重新定义了AI成功的依赖因素,强调主动参与而非被动接受,AI开发者应设计促进深度互动而非无摩擦体验,以实现更大成功。代码和数据可在https://github.com/bigspinai/bigspin-fluency-outcomes获取。
英文摘要:
How much does a user's skill with AI shape what AI actually delivers for them? This question is critical for users, AI product builders, and society at large, but it remains underexplored. Using a richly annotated sample of 27K transcripts from WildChat-4.8M, we show that fluent users take on more complex tasks than novices and adopt a fundamentally different interactional mode: they iterate collaboratively with the AI, refining goals and critically assessing outputs, whereas novices take a passive stance. These differences lead to a paradox of AI fluency: fluent users experience more failures than novices -- but their failures tend to be visible (a direct consequence of their engagement), they are more likely to lead to partial recovery, and they occur alongside greater success on complex tasks. Novices, by contrast, more often experience invisible failures: conversations that appear to end successfully but in fact miss the mark. Taken together, these results reframe what success with AI depends on. Individuals should adopt a stance of active engagement rather than passive acceptance. AI product builders should recognize that they are designing not just model behavior but user behavior; encouraging deep engagement, rather than friction-free experiences, will lead to more success overall. Our code and data are available at https://github.com/bigspinai/bigspin-fluency-outcomes
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。