EmoMed：一种具有实时信息检索功能的多模态医疗支持情感感知智能体
EmoMed: An Emotionally-Aware Agent for Multimodal Medical Support with Real-Time Information Retrieval
浏览论文内容
中文总结 AI 辅助
EmoMed是一种多模态医疗咨询智能体，通过双重检索机制确保事实可靠性，并根据用户情绪调整响应，实验表明其情感自适应响应在多个模型和指标上优于中性基线，且不损害临床准确性。
中文摘要 AI 辅助
我们提出了EmoMed——一种多模态医疗咨询智能体，它根据用户的情绪状态调整其响应，同时保持临床准确性。该系统处理文本和医学图像，从用户输入中检测情感指标（焦虑、困惑、紧迫性），并相应地调整响应的语气、结构和详细程度。为了确保事实可靠性，该智能体通过双重检索机制对临床信息进行验证：基于网络的事实核查和API连接的持续更新的医学知识库。我们使用包括LLM-as-judge评估、MedQA风格准确性测试、BERT Score、安全性/有用性评级以及多模态医学基准在内的综合指标，在七个最先进的语言模型（GPT-4/5、Qwen3、Llama 4、Gemini 2.5、Grok4、Claude3）上评估了我们的方法。结果表明，情感自适应响应在所有评估维度上始终优于中性基线，且不损害临床准确性。一项受控用户研究验证了这些发现，参与者报告感知到的同理心和沟通清晰度有所提高，同时保持了对事实准确性的信任。源代码：此https URL。
英文摘要
We present EmoMed - a multimodal medical consultation agent that adapts its responses based on users' emotional states while maintaining clinical accuracy. The system processes text and medical images, detects affect indicators (anxiety, confusion, urgency) from user input, and adjusts response tone, structure, and detail level accordingly. To ensure factual reliability, the agent grounds clinical information through a dual retrieval mechanism: web-based fact-checking and an API-connected, continuously updated medical knowledge base. We evaluate our approach across seven state-of-the-art language models (GPT-4/5, Qwen3, Llama 4, Gemini 2.5, Grok4, Claude3) using comprehensive metrics including LLM-as-judge assessments, MedQA style accuracy tests, BERT Score, safety/helpfulness ratings, and multimodal medical benchmarks. The results demonstrate that emotionally adaptive responses consistently outperform neutral baseline across evaluation dimensions, without compromising clinical accuracy. A controlled user study validated these findings, with participants reporting improved perceived empathy and communication clarity, while maintaining trust in factual accuracy. Source code: https://github.com/NasonovIvan/EmoMed-Agent
发表机构
- ISP RAS Research Center for Trusted Artificial Intelligence（俄罗斯科学院信息学与自动化研究所可信人工智能研究中心）
- National University of Science and Technology (NUST) MISIS（国立科技大学MISIS）
- Innopolis University（Innopolis大学）
- SkolTech（斯科尔科沃科技学院）
- SB AI Lab（SB人工智能实验室）
机构由 AI 辅助整理，请以论文原文为准。
