Errors in medical text can cause delays or even result in incorrect treatment for patients. Recently, language models have shown promise in their ability to automatically detect errors in medical text, an ability that has the opportunity to significantly benefit healthcare systems. In this paper, we explore the importance of prompt optimisation for small and large language models when applied to the task of error detection. We perform rigorous experiments and analysis across frontier language models and open-source language models. We show that automatic prompt optimisation with Genetic-Pareto (GEPA) improves error detection over the baseline accuracy performance from 0.669 to 0.785 with GPT-5 and 0.578 to 0.690 with Qwen3-32B, approaching the performance of medical doctors and achieving state-of-the-art performance on the MEDEC benchmark dataset. Code available on GitHub: https://github.com/CraigMyles/clinical-note-error-detection
Prompt-Efficient Fine-Tuning for GPT-like Deep Models to Reduce Hallucination and to Improve Reproducibility in Scientific Text Generation Using Stochastic Optimisation Techniques
Higher School of Economics (HSE)(高等经济大学(HSE));AI for Computational biology (AIC)(计算生物学人工智能研究所(AIC))
Grammar-Guided Evolutionary Search for Discrete Prompt Optimisation
Huawei Technologies, Ireland Research Center, Ireland(华为技术有限公司爱尔兰研究中心);University of Galway, Ireland(Galway大学);Dublin City University, Ireland(都柏林城市大学);Technological University Dublin, Ireland(都柏林技术大学)
Adversarial Fine-Tuning of Language Models: An Iterative Optimisation Approach for the Generation and Detection of Problematic Content
Australian National University(澳大利亚国立大学);Mathematical Sciences Institute(数学科学研究所);Research School of Astronomy(天文研究学院);College of Engineering and Computer Science(工程与计算机科学学院)
MedREK: Retrieval-Based Editing for Medical LLMs with Key-Aware Prompts
City University of Hong Kong(香港城市大学);Harvard Medical School(哈佛医学院);Institute of Automation, CAS(中国科学院自动化研究所);Columbia University(哥伦比亚大学);Ohio State University(俄亥俄州立大学);Westlake University(西湖大学);Nanjing University(南京大学)
Few-Shot Learning for Mental Disorder Detection: A Continuous Multi-Prompt Engineering Approach with Medical Knowledge Injection
Hefei University of Technology(合肥工业大学);Iowa State University(爱荷华州立大学);University of Delaware(特拉华大学);University of Rhode Island(罗德岛大学);University of Arizona(亚利桑那大学)
Prompt engineering paradigms for medical applications: scoping review and recommendations for better practices
Geneva University Hospitals(日内瓦大学医院);University of Geneva(日内瓦大学);Université Paris-Saclay(巴黎萨克雷大学);CNRS(法国国家科学研究中心);Sorbonne Université(索邦大学);INSERM(法国国家健康与医学研究院);Université Sorbonne Paris-Nord(索邦巴黎北大学)
EMPOWER: Evolutionary Medical Prompt Optimization With Reinforcement Learning
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发智能感知与认知国家重点实验室,中国科学技术大学);Department of Computer Science, University of Minnesota-Twin Cities(计算机科学系,明尼苏达大学双城分校);Center of Research for Cyber Security and Network (CSNET), Faculty of Computer Science and Information Technology, Universiti Malaya(网络安全与网络研究中心(CSNET),马来亚大学计算机科学与信息技术学院);DSLAB, School of Information Science & Engineering, Lanzhou University(信息科学与工程学院,兰州大学);Institute of Computing Technology, Chinese Academy of Sciences(计算技术研究所,中国科学院);Department of AI, Prince Mohammad bin Fahd University(人工智能系,普林姆·法赫德大学);Department of Computer Engineering, College of Computer Science, King Khalid University(计算机工程系,国王·卡利德大学)
Prompt Triage: Structured Optimization Enhances Vision-Language Model Performance on Medical Imaging Benchmarks
Stanford University, Department of Computer Science, Stanford, CA, USA(斯坦福大学计算机科学系);Stanford University, Department of Biomedical Data Science, Stanford, CA, USA(斯坦福大学生物医学数据科学系);Stanford University, Stanford Institute for Human-Centered Artificial Intelligence, Stanford, CA, USA(斯坦福大学人类中心人工智能研究所);Stanford University, School of Medicine, Department of Dermatology, Stanford, CA, USA(斯坦福大学医学院皮肤科系);Stanford University, Department of Radiology, Stanford, CA, USA(斯坦福大学放射科)
ProMedTS: A Self-Supervised, Prompt-Guided Multimodal Approach for Integrating Medical Text and Time Series
Hong Kong Baptist University(香港 Baptist 大学);Shanxi University(山西大学);Shanghai Institute for Advanced Study of Zhejiang University(浙江大学上海研究院);Tencent AI Lab(腾讯人工智能实验室);Manchester Metropolitan University(曼彻斯特 Metropolitan 大学);The University of Manchester(曼彻斯特大学)
BP4ER: Bootstrap Prompting for Explicit Reasoning in Medical Dialogue Generation
Macau University of Science and Technology(澳门科技大学);Paradigm Inc.(第四范式公司);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Zhongkai University of Agriculture and Engineering(仲恺农业工程学院)
MEPNet: Medical Entity-balanced Prompting Network for Brain CT Report Generation
College of Computer Science, Beijing University of Technology(北京工业大学计算机学院);School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院)
AutoMedPrompt: A New Framework for Optimizing LLM Medical Prompts Using Textual Gradients
Keck Data Science Institute, Pepperdine University(佩珀代因大学凯克数据科学研究所);Department of Medicine, University of California, Los Angeles(加利福尼亚大学洛杉矶分校医学院);Biological Sciences Division, University of Chicago(芝加哥大学生物科学部);Brain Research Institute, University of California, Los Angeles(加利福尼亚大学洛杉矶分校脑研究所)
Can Large Language Models Self-Correct in Medical Question Answering? An Exploratory Study
Department of Electrical and Computer Engineering, University of Minnesota(明尼苏达大学电气与计算机工程系);Division of Computational Health Sciences, Department of Surgery, University of Minnesota(明尼苏达大学外科学系计算健康科学部);Department of Software Engineering, University of St. Thomas(圣托马斯大学软件工程系)
TV-SAM: Increasing Zero-Shot Segmentation Performance on Multimodal Medical Images Using GPT-4 Generated Descriptive Prompts Without Human Annotation
Sichuan University(四川大学);Case Western Reserve University(凯斯西储大学);Beijing University of Posts and Telecommunications(北京邮电大学);Urgench State University(乌尔根奇国立大学);Gansu Agricultural University(甘肃农业大学)
Efficient Prompt Optimisation for Legal Text Classification with Proxy Prompt Evaluator
Technical University of Munich(慕尼黑技术大学);Department of Computer Science, University of Copenhagen(哥本哈根大学计算机科学系);Faculty of Law, University of Copenhagen(哥本哈根大学法学院)
Medical Image Synthesis via Fine-Grained Image-Text Alignment and Anatomy-Pathology Prompting
City University of Hong Kong(香港城市大学);The Chinese University of Hong Kong(香港中文大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Lehigh University(里海大学)
针对医学图像数据稀缺及现有方法难以准确呈现解剖与病理细节的问题,提出结合解剖-病理提示和视觉码本细粒度图文对齐的合成模型,并在胸部 X 射线数据上验证其语义准确性。
PromptCBLUE: A Chinese Prompt Tuning Benchmark for the Medical Domain
East China Normal University(华东师范大学);Alibaba Group(阿里巴巴集团);Holoflow Digital Technology(全息数字技术(杭州)有限公司);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳))
Enhancing Medical Dialogue Generation through Knowledge Refinement and Dynamic Prompt Adjustment
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学公安学院人工智能学院);Sichuan University(四川大学);School of Computer Science and Technology, Xinjiang University(新疆大学计算机科学与技术学院);Tsinghua University(清华大学);School of Computer Science, Wuhan University(武汉大学计算机学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);Engineering Research Center of Next-Generation Intelligent Search and Recommendation, Ministry of Education(教育部下一代智能搜索与推荐工程研究中心)
Guiding Medical Vision-Language Models with Explicit Visual Prompts: Framework Design and Comprehensive Exploration of Prompt Variations
Sichuan University Pittsburgh Institute(四川大学匹兹堡学院);Beijing University of Posts and Telecommunications(北京邮电大学);Brown University(布朗大学);Case Western Reserve University(凯斯西储大学);Shanghai Jiao Tong University(上海交通大学)
P-Transformer: A Prompt-based Multimodal Transformer Architecture For Medical Tabular Data
Saw Swee Hock School of Public Health, National University of Singapore(新加坡国立大学苏瑞福公共卫生学院);Institute of Data Science, National University of Singapore(新加坡国立大学数据科学研究院);Singapore General Hospital(新加坡综合医院)
Which Client is Reliable?: A Reliable and Personalized Prompt-based Federated Learning for Medical Image Question Answering
Graduate School of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术研究院);Faculty of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术学院)