arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.04059cs.CL
收藏

比较大型语言模型AI与人类生成的减重行为辅导信息

Comparing Large Language Model AI and Human-Generated Coaching Messages for Behavioral Weight Loss

Northeastern University(东北大学);VA Connecticut Healthcare System(康涅狄格州医疗系统);Portland Psychotherapy Clinic, Research and Training Center(波特兰心理治疗诊所、研究与培训中心);University of Washington(华盛顿大学);The University of Melbourne(墨尔本大学);Drexel University(德雷塞尔大学)

Zhuoran Huang, Michael P. Berry, Christina Chwyl, Gary Hsieh, Jing Wei, Evan M. Forman

AI总结:

本研究比较了LLM AI与人类生成的减重辅导信息,发现AI信息在修订后有用性相当,且半数被误认为人类撰写,初步验证了其可行性与可接受性。

摘要:

用于体重控制的自动化辅导信息可以节省时间和成本,但其重复、通用的特性可能限制其与人类辅导相比的有效性。基于大型语言模型(LLM)的人工智能(AI)聊天机器人,如ChatGPT,凭借其数据处理能力,可能提供更加个性化和新颖的信息以解决重复性问题。尽管LLM AI在鼓励更健康的生活方式方面展现出潜力,但尚未有研究考察基于LLM的减重(BWL)辅导的可行性和可接受性。一项减重试验中的87名成年人使用5点李克特量表对十条辅导信息(五条人类撰写、五条ChatGPT生成)的有用性进行评分,并提供额外的开放式反馈以证明其评分。参与者还识别了他们认为由AI生成的信息。评估分两个阶段进行:第一阶段的信息被认为缺乏人情味且带有负面色彩,促使对第二阶段信息进行修订。在第一阶段,AI生成的信息被评为不如人类撰写的信息有用,其中66%的信息获得3分或以上的有用性评分。然而,在第二阶段,AI信息在有用性方面与人类撰写的信息持平,82%的评分达到3分或以上。此外,50%的AI信息被误认为人类撰写,这表明AI在模仿人类生成内容方面的复杂性。对开放式反馈的主题分析显示,参与者欣赏AI的共情和个性化建议,但认为其更具公式化、缺乏真实性且过于以数据为中心。本研究揭示了LLM AI(如ChatGPT)在制作潜在有效的体重控制辅导信息方面的初步可行性和可接受性。我们的发现也强调了未来改进的领域。

英文摘要:

Automated coaching messages for weight control can save time and costs, but their repetitive, generic nature may limit their effectiveness compared to human coaching. Large language model (LLM) based artificial intelligence (AI) chatbots, like ChatGPT, could offer more personalized and novel messages to address repetition with their data-processing abilities. While LLM AI demonstrates promise to encourage healthier lifestyles, studies have yet to examine the feasibility and acceptability of LLM-based BWL coaching. 87 adults in a weight-loss trial rated ten coaching messages' helpfulness (five human-written, five ChatGPT-generated) using a 5-point Likert scale, providing additional open-ended feedback to justify their ratings. Participants also identified which messages they believed were AI-generated. The evaluation occurred in two phases: messages in Phase 1 were perceived as impersonal and negative, prompting revisions for Phase 2 messages. In Phase 1, AI-generated messages were rated less helpful than human-written ones, with 66 percent receiving a helpfulness rating of 3 or higher. However, in Phase 2, the AI messages matched the human-written ones regarding helpfulness, with 82% scoring three or above. Additionally, 50% were misidentified as human-written, suggesting AI's sophistication in mimicking human-generated content. A thematic analysis of open-ended feedback revealed that participants appreciated AI's empathy and personalized suggestions but found them more formulaic, less authentic, and too data-focused. This study reveals the preliminary feasibility and acceptability of LLM AIs, like ChatGPT, in crafting potentially effective weight control coaching messages. Our findings also underscore areas for future enhancement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑