ELEVATE-GenAI:在卫生经济学与结果研究中应用大语言模型的报告指南:ISPOR生成式人工智能工作组报告
ELEVATE-GenAI: Reporting Guidelines for the Use of Large Language Models in Health Economics and Outcomes Research: an ISPOR Working Group on Generative AI Report
AI总结:
本文提出ELEVATE GenAI框架及核查清单,为在卫生经济学与结果研究中使用大语言模型提供涵盖模型特征、准确性、可重复性和公平性等十个领域的标准化报告指南,并通过两个案例验证其可用性。
摘要:
引言:生成式人工智能(AI),尤其是大语言模型(LLMs),在卫生经济学与结果研究(HEOR)中展现出重要前景。然而,目前缺乏针对LLM辅助研究的标准化报告指南。本文介绍了ELEVATE GenAI框架及核查清单——专门为涉及LLM的HEOR研究设计的报告指南。方法:该框架通过对现有报告指南、AI评估框架进行针对性文献综述,并结合ISPOR生成式人工智能工作组的专家意见而制定。框架包含十个领域,包括模型特征、准确性、可重复性以及公平性与偏倚。配套核查清单将框架转化为可操作的报告条目。为说明其应用,该框架被应用于两项已发表的HEOR研究:一项聚焦于系统文献综述任务,另一项聚焦于经济建模。结果:ELEVATE GenAI框架为报告LLM辅助的HEOR研究提供了全面的结构,而核查清单则促进了实际实施。其在两个案例研究中的应用证明了该框架在不同HEOR场景下的相关性和可用性。局限性:尽管该框架提供了稳健的报告指南,但仍需进一步的实证检验来评估其有效性、完整性、可用性以及在多样化HEOR用例中的普适性。结论:ELEVATE GenAI框架和核查清单通过为LLM辅助的HEOR研究提供透明、准确且可重复报告的结构化指南,填补了一项关键空白。未来工作将侧重于广泛的测试与验证,以支持更广泛的采用和进一步完善。
英文摘要:
Introduction: Generative artificial intelligence (AI), particularly large language models (LLMs), holds significant promise for Health Economics and Outcomes Research (HEOR). However, standardized reporting guidance for LLM-assisted research is lacking. This article introduces the ELEVATE GenAI framework and checklist - reporting guidelines specifically designed for HEOR studies involving LLMs. Methods: The framework was developed through a targeted literature review of existing reporting guidelines, AI evaluation frameworks, and expert input from the ISPOR Working Group on Generative AI. It comprises ten domains, including model characteristics, accuracy, reproducibility, and fairness and bias. The accompanying checklist translates the framework into actionable reporting items. To illustrate its use, the framework was applied to two published HEOR studies: one focused on systematic literature review tasks and the other on economic modeling. Results: The ELEVATE GenAI framework offers a comprehensive structure for reporting LLM-assisted HEOR research, while the checklist facilitates practical implementation. Its application to the two case studies demonstrates its relevance and usability across different HEOR contexts. Limitations: Although the framework provides robust reporting guidance, further empirical testing is needed to assess its validity, completeness, usability, as well as its generalizability across diverse HEOR use cases. Conclusion: The ELEVATE GenAI framework and checklist address a critical gap by offering structured guidance for transparent, accurate, and reproducible reporting of LLM-assisted HEOR research. Future work will focus on extensive testing and validation to support broader adoption and refinement.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。