进食手势词汇研究
A Study of the Lexicography of Hand Gestures During Eating
摘要:
本文认为,定义一个人吃东西时采取的行动的词典编纂的挑战。我们的目标是根据可辨别的意图建立客观和可重复的手势定义。这样的标准将支持研究自动监测饮食摄入问题的研究人员之间共享数据和结果。我们定义了五种手势:咬一口食物(咬一口),啜饮液体饮料(饮料),操纵食物以准备摄入(吞咽),不动(休息)和非进食类别(其他)。为了测试这个词典,我们使用我们的定义来标记一个大型数据集,并测试评分者之间的可靠性。该数据集由总共276名参与者组成,他们吃了一顿饭,同时佩戴了一个类似手表的设备来跟踪手腕运动。同时记录视频,随后审查以标记手势。共有18名评分员手动标记了51,614个手势。每餐至少由1名评分员标记,95餐由2名评分员标记。评价者间的可靠性计算的协议,边界模糊,和错误。结果为92.5%的一致性(75%的准确一致性,17.5%的边界模糊性)。摄入姿势的错误(0.6%咬和1.9%喝)发生的频率远远低于非摄入姿势(16.5%咀嚼和8.7%休息)。在所有18名评分员中发现了相似的比率。最后,比较手势片段对单一的索引标签的咬和饮料从以前的努力显示了95.8%的协议,0.6%的模糊性和3.6%的错误。总的来说,这些发现朝着为研究界制定一个关于进食姿势的共识词典迈出了一步。
英文摘要:
This paper considers the lexicographical challenge of defining actions a person takes while eating. The goal is to establish objective and repeatable gesture definitions based on discernible intent. Such a standard would support the sharing of data and results between researchers working on the problem of automatic monitoring of dietary intake. We define five gestures: taking a bite of food (bite), sipping a drink of liquid (drink), manipulating food for preparation of intake (utensiling), not moving (rest) and a non-eating category (other). To test this lexicography, we used our definitions to label a large data set and tested for inter-rater reliability. The data set consists of a total of 276 participants eating a single meal while wearing a watch-like device to track wrist motion. Video was simultaneously recorded and subsequently reviewed to label gestures. A total of 18 raters manually labeled 51,614 gestures. Every meal was labeled by at least 1 rater, with 95 meals labeled by 2 raters. Inter-rater reliability was calculated in terms of agreement, boundary ambiguity, and mistakes. Results were 92.5% agreement (75% exact agreement, 17.5% boundary ambiguity). Mistakes of intake gestures (0.6% bite and 1.9% drink) occur much less frequently than non-intake gestures (16.5% utensiling and 8.7% rest). Similar rates were found across all 18 raters. Finally, a comparison of gesture segments against single index labels of bites and drinks from a previous effort showed an agreement of 95.8% with 0.6% ambiguity and 3.6% mistakes. Overall, these findings take a step towards developing a consensus lexicography of eating gestures for the research community.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。