arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2504.16601cs.CLcs.AI

比较大语言模型与传统机器翻译工具在翻译医疗咨询摘要中的应用:一项初步研究

Comparing Large Language Models and Traditional Machine Translation Tools for Translating Medical Consultation Summaries: A Pilot Study

Faculty of Information Technology, Monash University(信息技术学院,莫纳什大学);Faculty of Medicine, Nursing and Health Sciences, Monash University(医学、护理与健康科学学院,莫纳什大学);Supportive and Palliative Care Unit, Monash Health(支持与姑息护理单元,莫纳什健康)

Andy Li, Wei Zhou, Rashina Hoda, Chris Bain, Peter Poon

AI总结:

本研究初步比较了大语言模型与传统机器翻译工具在医疗咨询摘要翻译中的表现,发现传统工具总体更优,大语言模型在简单文本上有潜力,并强调需领域训练、改进评估和人工监督。

摘要:

本研究评估了大语言模型(LLMs)和传统机器翻译(MT)工具将医疗咨询摘要从英语翻译成阿拉伯语、中文和越南语的效果。研究使用标准自动化指标评估了面向患者、友好的文本和面向临床医生、聚焦的文本。结果表明,传统机器翻译工具总体表现更好,尤其是在处理复杂文本时;而大语言模型在翻译较简单的摘要时显示出潜力,特别是在越南语和中文方面。由于阿拉伯语的形态学特点,阿拉伯语翻译质量随文本复杂性增加而提升。总体而言,尽管大语言模型提供了上下文灵活性,但它们仍然表现不稳定,且当前的评估指标未能捕捉临床相关性。本研究强调了在医疗翻译中进行领域特定训练、改进评估方法以及引入人工监督的必要性。

英文摘要:

This study evaluates how well large language models (LLMs) and traditional machine translation (MT) tools translate medical consultation summaries from English into Arabic, Chinese, and Vietnamese. It assesses both patient, friendly and clinician, focused texts using standard automated metrics. Results showed that traditional MT tools generally performed better, especially for complex texts, while LLMs showed promise, particularly in Vietnamese and Chinese, when translating simpler summaries. Arabic translations improved with complexity due to the language's morphology. Overall, while LLMs offer contextual flexibility, they remain inconsistent, and current evaluation metrics fail to capture clinical relevance. The study highlights the need for domain-specific training, improved evaluation methods, and human oversight in medical translation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑