Glow的初始风险探测与可行性测试:一种生成式人工智能驱动的辩证行为疗法技能教练,用于物质使用康复和HIV预防
Initial Risk Probing and Feasibility Testing of Glow: a Generative AI-Powered Dialectical Behavior Therapy Skills Coach for Substance Use Recovery and HIV Prevention
AI总结:
Glow是一种生成式人工智能驱动的辩证行为疗法技能教练,旨在通过风险探测和可行性测试评估其在物质使用康复和HIV预防中的安全性与有效性。
摘要:
背景:HIV和物质使用代表相互交织的流行病,具有共享的心理驱动因素——冲动性和适应不良的应对机制。辩证行为疗法(DBT)针对这些机制,但面临可扩展性挑战。生成式人工智能(GenAI)提供了大规模提供个性化DBT指导的潜力,但快速的发展已超过了安全基础设施。方法:我们开发了Glow,一种由生成式人工智能驱动的DBT技能教练,为有HIV和物质使用风险的个体提供链条和解决方案分析。与洛杉矶社区健康组织合作,我们进行了可用水性测试,与临床工作人员(n=6)和有实际经验的个体(n=28)进行测试。使用“有帮助、诚实和无害”(HHH)框架,我们采用用户驱动的对抗性测试,让参与者识别目标行为并生成上下文相关的风险探测。我们评估了37次风险探测交互的安全性能。结果:Glow正确处理了73%的风险探测,但性能因代理而异。解决方案分析代理显示出90%的正确处理,而链条分析代理仅为44%。安全失败集中在鼓励物质使用和正常化有害行为上。链条分析代理陷入了一个“共情陷阱”,提供验证,强化了适应不良的信念。此外,发现了27例DBT技能误导实例。结论:本研究提供了首次系统评估生成式人工智能交付的DBT指导用于HIV和物质使用风险减少的安全性。发现揭示了需要缓解的漏洞,以便在临床试验之前。HHH框架和用户驱动的对抗性测试为评估生成式人工智能心理健康干预提供了可复制的方法。
英文摘要:
Background: HIV and substance use represent interacting epidemics with shared psychological drivers - impulsivity and maladaptive coping. Dialectical behavior therapy (DBT) targets these mechanisms but faces scalability challenges. Generative artificial intelligence (GenAI) offers potential for delivering personalized DBT coaching at scale, yet rapid development has outpaced safety infrastructure. Methods: We developed Glow, a GenAI-powered DBT skills coach delivering chain and solution analysis for individuals at risk for HIV and substance use. In partnership with a Los Angeles community health organization, we conducted usability testing with clinical staff (n=6) and individuals with lived experience (n=28). Using the Helpful, Honest, and Harmless (HHH) framework, we employed user-driven adversarial testing wherein participants identified target behaviors and generated contextually realistic risk probes. We evaluated safety performance across 37 risk probe interactions. Results: Glow appropriately handled 73% of risk probes, but performance varied by agent. The solution analysis agent demonstrated 90% appropriate handling versus 44% for the chain analysis agent. Safety failures clustered around encouraging substance use and normalizing harmful behaviors. The chain analysis agent fell into an "empathy trap," providing validation that reinforced maladaptive beliefs. Additionally, 27 instances of DBT skill misinformation were identified. Conclusions: This study provides the first systematic safety evaluation of GenAI-delivered DBT coaching for HIV and substance use risk reduction. Findings reveal vulnerabilities requiring mitigation before clinical trials. The HHH framework and user-driven adversarial testing offer replicable methods for evaluating GenAI mental health interventions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。