arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.26922cs.HCcs.AI
收藏

模仿对齐与ASPECT:AI推断个人资料的评估

Mimetic Alignment with ASPECT: Evaluation of AI-inferred Personal Profiles

University of Washington(华盛顿大学);Microsoft Research(微软研究院)

Ruoxi Shang, Dan Marshall, Edward Cutrell, Denae Ford

AI总结:

本文提出ASPECT方法,通过验证的沟通量表和职场数据评估LLM沟通特征,生成的个人资料在自评上表现良好,并在多个场景中优于通用和自述基线。

摘要:

AI代理需准确捕捉个体沟通方式,但现有方法存在成本高、输出泛化、偏好优化不建模沟通风格等问题。本文提出ASPECT(自动化社交心理测量评估沟通特征),通过验证的沟通量表和职场行为证据评估LLM特征,无需个性化训练。在20名参与者(1,840项配对评分,600个场景评估)的案例研究中,ASPECT生成的资料在自评上中等对齐,生成的回应在聚合上优于通用和自述基线,个体和场景间存在显著差异。在资料审查阶段,关联证据帮助参与者识别误判、校准自身评分并协商合适的情境表示。讨论了构建可检查、个体化沟通资料的启示,使个体能控制代理在工作中的表现方式。

英文摘要:

AI agents that communicate on behalf of individuals need to capture how each person actually communicates, yet current approaches either require costly per-person fine-tuning, produce generic outputs from shallow persona descriptions, or optimize preferences without modeling communication style. We present ASPECT (Automated Social Psychometric Evaluation of Communication Traits), a pipeline that directs LLMs to assess constructs from a validated communication scale against behavioral evidence from workplace data, without per-person training. In a case study with 20 participants (1,840 paired item ratings, 600 scenario evaluations), ASPECT-generated profiles achieved moderate alignment with self-assessments, and ASPECT-generated responses were preferred over generic and self-report baselines on aggregate, with substantial variation across individuals and scenarios. During the profile review phase, linked evidence helped participants identify mischaracterizations, recalibrate their own self-ratings, and negotiate context-appropriate representations. We discuss implications for building inspectable, individually scoped communication profiles that let individuals control how agents represent them at work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑