arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.13705cs.HCcs.AI
收藏

大型语言模型在手势选择的文本分析中的应用

Large language models in textual analysis for gesture selection

University of Glasgow(格拉斯哥大学);Northeastern University(东北大学)

Laura B. Hensel, Nutchanon Yongsatianchot, Parisa Torshizi, Elena Minucci, Stacy Marsella

AI总结:

本文提出利用大型语言模型(如ChatGPT)基于最少提示生成特定语境手势,以解决自动手势生成中训练数据不足和设计师控制受限的挑战。

摘要:

手势执行多种交际功能,对人类面对面交流产生强烈影响。这种交际功能的实现方式因人而异,并取决于说话者的角色和交互的语境。自动手势生成方法不仅在依赖数据驱动技术的程度上有所不同,在能否生成特定语境和特定说话者的手势方面也有所不同。然而,这些方法面临两大挑战:首先是获取适合应用语境和目标的充足训练数据。其次与设计师控制有关,即实现其对应用程序的特定意图。在此,我们通过使用大型语言模型(LLMs)来应对这些挑战,以证明这些基于海量数据的强大模型可以适应手势的分析与生成。具体而言,我们使用ChatGPT作为工具,基于最少的提示来建议能够实现设计师意图的特定语境手势。我们还发现,ChatGPT能够建议在少量训练数据中不存在的、新颖且合适的手势。LLMs的使用是手势生成的一条有前途的途径,它减少了对繁琐标注的需求,并具有灵活快速适应不同设计师意图的潜力。

英文摘要:

Gestures perform a variety of communicative functions that powerfully influence human face-to-face interaction. How this communicative function is achieved varies greatly between individuals and depends on the role of the speaker and the context of the interaction. Approaches to automatic gesture generation vary not only in the degree to which they rely on data-driven techniques but also the degree to which they can produce context and speaker specific gestures. However, these approaches face two major challenges: The first is obtaining sufficient training data that is appropriate for the context and the goal of the application. The second is related to designer control to realize their specific intent for the application. Here, we approach these challenges by using large language models (LLMs) to show that these powerful models of large amounts of data can be adapted for gesture analysis and generation. Specifically, we used ChatGPT as a tool for suggesting context-specific gestures that can realize designer intent based on minimal prompts. We also find that ChatGPT can suggests novel yet appropriate gestures not present in the minimal training data. The use of LLMs is a promising avenue for gesture generation that reduce the need for laborious annotations and has the potential to flexibly and quickly adapt to different designer intents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑