Evaluating LLMs Without Oracle Feedback: Agentic Annotation Evaluation Through Unsupervised Consistency Signals
机构 * Australian Artificial Intelligence Institute (AAII), University of Technology Sydney, Australia(澳大利亚人工智能研究所(AAII)、悉尼技术大学) ; Centre for Frontier AI Research, Institute of High Performance Computing(前沿人工智能研究中心、高性能计算研究所) ; Agency for Science, Technology and Research, Singapore(科技研究局(新加坡)) ; College of Computing and Data Science, Nanyang Technological University, Singapore(计算与数据科学学院、南洋理工大学)
Comments 11 pages, 10 figures
Journal ref Published ICLR 2025 Workshop on Scaling Self-Improving Foundation Models without Human Supervision