arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.14191cs.AIcs.HC
收藏

处理与可视化人类任务解决轨迹中的错位

Addressing and Visualizing Misalignments in Human Task-Solving Trajectories

GIST(全南国立大学);KAIST(韩国科学技术院)

Sejin Kim, Hosung Lee, Sundong Kim

AI总结:

本研究将人类任务解决轨迹中的错位分为三类,提出统一框架、启发式检测算法及意图估计方法,通过轨迹对齐实验证明意图对齐训练可提升AI模仿人类推理的性能。

摘要:

理解人类任务解决轨迹中的错位对于增强旨在紧密模仿人类推理的AI模型至关重要。本研究将此类错位分为三类:(1) 缺乏表达意图的功能,(2) 低效的动作序列,以及 (3) 无法解决任务的不正确意图。为解决这些问题,我们首先在统一框架中形式化并定义这三种错位类型。随后,提出一种启发式算法来检测ARCTraj轨迹中的错位,并分层且定量地分析其影响。我们还提出一种基于该形式化的意图估计方法,用于推断用户动作与意图间缺失的对齐。通过轨迹对齐,我们实验证明,在人类任务解决轨迹上训练的AI模型能提升模仿人类推理的性能。基于分层分析与实验,我们强调了轨迹-意图对齐的重要性,并证明了意图对齐训练的有效性。

英文摘要:

Understanding misalignments in human task-solving trajectories is crucial for enhancing AI models trained to closely mimic human reasoning. This study categorizes such misalignments into three types: (1) lack of functions to express intent, (2) inefficient action sequences, and (3) incorrect intentions that cannot solve the task. To address these issues, we first formalize and define these three misalignment types in a unified framework. We then propose a heuristic algorithm to detect misalignments in ARCTraj trajectories and analyze their impact hierarchically and quantitatively. We also present an intention estimation method based on our formalism that infers missing alignment between user actions and intentions. Through trajectory alignment, we experimentally demonstrate that AI models trained on human task-solving trajectories improve performance in mimicking human reasoning. Based on hierarchical analysis and experiments, we highlight the importance of trajectory-intention alignment and demonstrate the effectiveness of intention-aligned training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑