This study aims to address the pervasive challenge of quantifying uncertainty in large language models (LLMs) without logit-access. Conformal Prediction (CP), known for its model-agnostic and distribution-free features, is a desired approach for various LLMs and data distributions. However, existing CP methods for LLMs typically assume access to the logits, which are unavailable for some API-only LLMs. In addition, logits are known to be miscalibrated, potentially leading to degraded CP performance. To tackle these challenges, we introduce a novel CP method that (1) is tailored for API-only LLMs without logit-access; (2) minimizes the size of prediction sets; and (3) ensures a statistical guarantee of the user-defined coverage. The core idea of this approach is to formulate nonconformity measures using both coarse-grained (i.e., sample frequency) and fine-grained uncertainty notions (e.g., semantic similarity). Experimental results on both close-ended and open-ended Question Answering tasks show our approach can mostly outperform the logit-based CP baselines.
Clone What You Can't Steal: Black-Box LLM Replication via Logit Leakage and Distillation
Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);Embry-Riddle Aeronautical University(埃姆布里-里德尔航空大学);Department of Mathematics(数学系)
CBD: API-Only LLM Black-Box Unlearning through Controlled Behavioral Divergence
State Key Laboratory of Networking and Switching Technology, Beijing University of Posts and Telecommunications(北京邮电大学网络与交换技术国家重点实验室);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(北京未来区块链与隐私计算高精尖创新中心);Department of Electronic and Electrical Engineering, Sungkyunkwan University(成均馆大学电子与电气工程系)
Hey, That's My Data! Label-Only Dataset Inference in Large Language Models
The Chinese University of Hong Kong(香港中文大学);Indiana University Bloomington(印第安纳大学布卢明顿分校);Yale University, School of Medicine(耶鲁大学医学院);IBM Research(IBM研究院);University of California, Davis(加州大学戴维斯分校)
KDFlow: A User-Friendly and Efficient Knowledge Distillation Framework for Large Language Models
Key Laboratory of Big Data & Artificial Intelligence in Transportation, (Beijing Jiaotong University), Ministry of Education(大数据与人工智能交通运输联合实验室,(北京交通大学)教育部);School of Computer Science and Technology, Beijing Jiaotong University, Beijing, China(计算机科学与技术学院,北京交通大学,北京,中国);Tencent Inc, China(腾讯公司,中国)
Innate Reasoning is Not Enough: In-Context Learning Enhances Reasoning Large Language Models with Less Overthinking
AI Safety of Chinese Academy of Sciences, Institute of Computing Technology, CAS(中国科学院人工智能安全研究院,中国科学院计算技术研究所);University of California, Merced(加州大学默塞德分校);Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);University of Chinese Academy of Sciences(中国科学院大学)
When One LLM Drools, Multi-LLM Collaboration Rules
University of Washington(华盛顿大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Google(谷歌公司);Massachusetts Institute of Technology(麻省理工学院);Stanford University(斯坦福大学)
Training-Free Cultural Alignment of Large Language Models via Persona Disagreement
Faculty of Information and Technology, University of Science, Vietnam National University(信息与技术学院,科学大学,越南国家大学);Department of Computer Science, University of Warwick(计算机科学系,沃里克大学);School of Computing, Engineering and Digital Technologies, Teesside University(计算、工程和数字技术学院,泰赛德大学)
Trusted Uncertainty in Large Language Models: A Unified Framework for Confidence Calibration and Risk-Controlled Refusal
University of Liechtenstein(列支敦士登大学);University of the Republic of San Marino(圣马尔科共和国大学);University of Mauritius(毛里求斯大学);International University of Monaco(摩纳哥国际大学);University of Andorra(安道尔大学);University of Gibraltar(直布罗陀大学);University of the Faroe Islands(法罗群岛大学);Ilisimatusarfik (University of Greenland)(格陵兰岛研究所(格陵兰大学));University of Prizren(普里兹伦大学)