With an increasing number of parameters and pre-training data, generative large language models (LLMs) have shown remarkable capabilities to solve tasks with minimal or no task-related examples. Notably, LLMs have been successfully employed as evaluation metrics in text generation tasks. Within this context, we introduce the Eval4NLP 2023 shared task that asks participants to explore prompting and score extraction for machine translation (MT) and summarization evaluation. Specifically, we propose a novel competition setting in which we select a list of allowed LLMs and disallow fine-tuning to ensure a focus on prompting. We present an overview of participants' approaches and evaluate them on a new reference-free test set spanning three language pairs for MT and a summarization dataset. Notably, despite the task's restrictions, the best-performing systems achieve results on par with or even surpassing recent reference-free metrics developed using larger models, including GEMBA and Comet-Kiwi-XXL. Finally, as a separate track, we perform a small-scale human evaluation of the plausibility of explanations given by the LLMs.
Tell Me Why: Explainable Public Health Fact-Checking with Large Language Models
School of Computing, Dublin City University（都柏林城市大学计算机学院）；Iran University of Science and Technology（伊朗科技大学）；School of Computer Science and Informatics, Cardiff University（卡迪夫大学计算机科学与信息学院）；Lucerne School of Computer Science and Information Technology（卢塞恩计算机科学与信息技术学院）
Error Analysis Prompting Enables Human-Like Translation Evaluation in Large Language Models
Southeast University（东南大学）；Nanjing University（南京大学）；The University of Sydney（悉尼大学）；Shenzhen Research Institute（深圳研究院）；Microsoft（微软公司）；Nanyang Technological University（南洋理工大学）
MaLei at MultiClinSUM: Summarisation of Clinical Documents using Perspective-Aware Iterative Self-Prompting with LLMs
University of Manchester, UK（曼彻斯特大学）；Modul University Vienna, Austria（维也纳Modul大学）；Leiden Institute of Advanced Computer Science (LIACS), Leiden University, The Netherlands（莱顿先进计算机科学研究所（LIACS）、莱顿大学）；Leiden University Medical Center, The Netherlands（莱顿大学医学中心）
Triadic Fusion of Cognitive, Functional, and Causal Dimensions for Explainable LLMs: The TAXAL Framework
Department of Computer Science and Artificial Intelligence（计算机科学与人工智能系）；Andalusian Institute of Data Science and Computational Intelligence（安达卢西亚数据科学与计算智能研究所）；University of Granada（格拉纳达大学）
Prompting is not enough: supervised baselines and leakage control for measuring shared decision-making with LLMs in pediatric encounters
University of Utah（犹他大学）；University of Utah Spencer Fox Eccles School of Medicine（犹他大学斯宾塞·福克斯·埃克尔斯医学院）；Kahlert School of Computing, University of Utah（犹他大学卡勒特计算机学院）；Huntsman Cancer Institute, University of Utah（犹他大学亨茨曼癌症研究所）
MUCnoHARM@GermEval Shared Task 2026: Retrieval-based In-Context Learning for Defamatory Offences, and Where It Falls Short
Central Office for Information Technology in the Security Sector (ZITiS)（安全领域信息技术中央办公室（ZITiS））；LMU Munich（慕尼黑大学）；Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心）
!MSA at AraHealthQA 2025 Shared Task: Enhancing LLM Performance for Arabic Clinical Question Answering through Prompt Engineering and Ensemble Learning
Faculty of Computer Science, MSA University（计算机科学学院，MSA大学）
Multilingual and Explainable Text Detoxification with Parallel Corpora
Technical University of Munich（慕尼黑工业大学）；Universidade de Santiago de Compostela（圣地亚哥-德孔波斯特拉大学）；Shenkar College（申卡尔学院）；University of Hamburg（汉堡大学）；Bahir Dar University（巴达尔大学）；IIT Kharagpur（印度理工学院克勒格布尔分校）；Skoltech（斯科尔科沃科技学院）；AIRI（人工智能研究所）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）；University of Sharjah（沙迦大学）
Edinburgh Clinical NLP at MEDIQA-CORR 2024: Guiding Large Language Models with Hints
School of Informatics, University of Edinburgh（爱丁堡大学信息学院）；Usher Institute, University of Edinburgh（爱丁堡大学厄舍研究所）；Edinburgh Futures Institute, University of Edinburgh（爱丁堡未来研究所）；School of Literatures, Languages and Cultures, University of Edinburgh（爱丁堡大学文学、语言与文化学院）
Sakura at BEA 2026 Shared Task 1: What Makes Vocabulary Difficult?
RIKEN；The University of Osaka（大阪大学）；Nara Institute of Science and Technology（奈良科学技術大學）；National Tsing Hua University（國立清華大學）；The University of Tokyo（東京大學）；Tohoku University（東北大學）
