大模型对齐与安全

Conservative Prediction via Data-Driven Confidence Minimization

Caroline Choi, Fahim Tajwar, Yoonho Lee, Huaxiu Yao, Ananya Kumar, Chelsea Finn

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Comments Transactions on Machine Learning Research (TMLR), 2024

The Critique of Critique

Shichao Sun, Junlong Li, Weizhe Yuan, Ruifeng Yuan, Wenjie Li, Pengfei Liu

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CL、cs.AI

Comments Accepted to Findings of ACL 2024

An Evaluation of Estimative Uncertainty in Large Language Models

Zhisheng Tang, Ke Shen, Mayank Kejriwal

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CL、cs.AI

SUTRA: Scalable Multilingual Language Model Architecture

Abhijit Bendale, Michael Sapienza, Steven Ripplinger, Simon Gibbs, Jaewon Lee, Pranav Mistry

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CL、cs.AI

Tiny Deep Ensemble: Uncertainty Estimation in Edge AI Accelerators via Ensembling Normalization Layers with Shared Weights

Soyed Tuhin Ahmed, Michael Hefenbrock, Mehdi B. Tahoori

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Automatic AI controller that can drive with confidence: steering vehicle with uncertainty knowledge

Neha Kumari, Sumit Kumar. Sneha Priya, Ayush Kumar, Akash Fogla

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Comments arXiv admin note: substantial text overlap with arXiv:2303.08187

Exploring the Transferability of Visual Prompting for Multimodal Large Language Models

Yichi Zhang, Yinpeng Dong, Siyuan Zhang, Tianzan Min, Hang Su, Jun Zhu

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.AI、cs.LG

Comments Accepted in CVPR 2024 as Poster (Highlight)

Extracting Norms from Contracts Via ChatGPT: Opportunities and Challenges

Amanul Haque, Munindar P. Singh

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.CL、cs.AI

Comments Accepted at COINE-AAMAS 2024

Uncertainty Quantification for In-Context Learning of Large Language Models

Chen Ling, Xujiang Zhao, Xuchao Zhang, Wei Cheng, Yanchi Liu, Yiyou Sun, Mika Oishi, Takao Osaki, Katsushi Matsuda, Jie Ji, Guangji Bai, Liang Zhao, Haifeng Chen

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.CL、cs.LG

Comments Accepted to the main conference of NAACL 2024

Uncertainty Quantification in Machine Learning for Engineering Design and Health Prognostics: A Tutorial

Venkat Nemani, Luca Biggio, Xun Huan, Zhen Hu, Olga Fink, Anh Tran, Yan Wang, Xiaoge Zhang, Chao Hu

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Journal ref Mechanical Systems and Signal Processing 205 (2023) 110796

Evidence-Driven Retrieval Augmented Response Generation for Online Misinformation

Zhenrui Yue, Huimin Zeng, Yimeng Lu, Lanyu Shang, Yang Zhang, Dong Wang

专题命中 幻觉与事实性 ：RLHF(abstract)；分类 cs.CL、cs.AI

Comments Accepted to NAACL 2024

Multi-Modal Hallucination Control by Visual Information Grounding

Alessandro Favero, Luca Zancato, Matthew Trager, Siddharth Choudhary, Pramuditha Perera, Alessandro Achille, Ashwin Swaminathan, Stefano Soatto

专题命中 幻觉与事实性 ：DPO(abstract)；分类 cs.CL、cs.LG

Journal ref IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024

GPT-4 Technical Report

OpenAI, Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, Red Avila, Igor Babuschkin, Suchir Balaji, Valerie Balcom, Paul Baltescu, Haiming Bao, Mohammad Bavarian, Jeff Belgum, Irwan Bello, Jake Berdine, Gabriel Bernadett-Shapiro, Christopher Berner, Lenny Bogdonoff, Oleg Boiko, Madelaine Boyd, Anna-Luisa Brakman, Greg Brockman, Tim Brooks, Miles Brundage, Kevin Button, Trevor Cai, Rosie Campbell, Andrew Cann, Brittany Carey, Chelsea Carlson, Rory Carmichael, Brooke Chan, Che Chang, Fotis Chantzis, Derek Chen, Sully Chen, Ruby Chen, Jason Chen, Mark Chen, Ben Chess, Chester Cho, Casey Chu, Hyung Won Chung, Dave Cummings, Jeremiah Currier, Yunxing Dai, Cory Decareaux, Thomas Degry, Noah Deutsch, Damien Deville, Arka Dhar, David Dohan, Steve Dowling, Sheila Dunning, Adrien Ecoffet, Atty Eleti, Tyna Eloundou, David Farhi, Liam Fedus, Niko Felix, Simón Posada Fishman, Juston Forte, Isabella Fulford, Leo Gao, Elie Georges, Christian Gibson, Vik Goel, Tarun Gogineni, Gabriel Goh, Rapha Gontijo-Lopes, Jonathan Gordon, Morgan Grafstein, Scott Gray, Ryan Greene, Joshua Gross, Shixiang Shane Gu, Yufei Guo, Chris Hallacy, Jesse Han, Jeff Harris, Yuchen He, Mike Heaton, Johannes Heidecke, Chris Hesse, Alan Hickey, Wade Hickey, Peter Hoeschele, Brandon Houghton, Kenny Hsu, Shengli Hu, Xin Hu, Joost Huizinga, Shantanu Jain, Shawn Jain, Joanne Jang, Angela Jiang, Roger Jiang, Haozhun Jin, Denny Jin, Shino Jomoto, Billie Jonn, Heewoo Jun, Tomer Kaftan, Łukasz Kaiser, Ali Kamali, Ingmar Kanitscheider, Nitish Shirish Keskar, Tabarak Khan, Logan Kilpatrick, Jong Wook Kim, Christina Kim, Yongjik Kim, Jan Hendrik Kirchner, Jamie Kiros, Matt Knight, Daniel Kokotajlo, Łukasz Kondraciuk, Andrew Kondrich, Aris Konstantinidis, Kyle Kosic, Gretchen Krueger, Vishal Kuo, Michael Lampe, Ikai Lan, Teddy Lee, Jan Leike, Jade Leung, Daniel Levy, Chak Ming Li, Rachel Lim, Molly Lin, Stephanie Lin, Mateusz Litwin, Theresa Lopez, Ryan Lowe, Patricia Lue, Anna Makanju, Kim Malfacini, Sam Manning, Todor Markov, Yaniv Markovski, Bianca Martin, Katie Mayer, Andrew Mayne, Bob McGrew, Scott Mayer McKinney, Christine McLeavey, Paul McMillan, Jake McNeil, David Medina, Aalok Mehta, Jacob Menick, Luke Metz, Andrey Mishchenko, Pamela Mishkin, Vinnie Monaco, Evan Morikawa, Daniel Mossing, Tong Mu, Mira Murati, Oleg Murk, David Mély, Ashvin Nair, Reiichiro Nakano, Rajeev Nayak, Arvind Neelakantan, Richard Ngo, Hyeonwoo Noh, Long Ouyang, Cullen O'Keefe, Jakub Pachocki, Alex Paino, Joe Palermo, Ashley Pantuliano, Giambattista Parascandolo, Joel Parish, Emy Parparita, Alex Passos, Mikhail Pavlov, Andrew Peng, Adam Perelman, Filipe de Avila Belbute Peres, Michael Petrov, Henrique Ponde de Oliveira Pinto, Michael, Pokorny, Michelle Pokrass, Vitchyr H. Pong, Tolly Powell, Alethea Power, Boris Power, Elizabeth Proehl, Raul Puri, Alec Radford, Jack Rae, Aditya Ramesh, Cameron Raymond, Francis Real, Kendra Rimbach, Carl Ross, Bob Rotsted, Henri Roussez, Nick Ryder, Mario Saltarelli, Ted Sanders, Shibani Santurkar, Girish Sastry, Heather Schmidt, David Schnurr, John Schulman, Daniel Selsam, Kyla Sheppard, Toki Sherbakov, Jessica Shieh, Sarah Shoker, Pranav Shyam, Szymon Sidor, Eric Sigler, Maddie Simens, Jordan Sitkin, Katarina Slama, Ian Sohl, Benjamin Sokolowsky, Yang Song, Natalie Staudacher, Felipe Petroski Such, Natalie Summers, Ilya Sutskever, Jie Tang, Nikolas Tezak, Madeleine B. Thompson, Phil Tillet, Amin Tootoonchian, Elizabeth Tseng, Preston Tuggle, Nick Turley, Jerry Tworek, Juan Felipe Cerón Uribe, Andrea Vallone, Arun Vijayvergiya, Chelsea Voss, Carroll Wainwright, Justin Jay Wang, Alvin Wang, Ben Wang, Jonathan Ward, Jason Wei, CJ Weinmann, Akila Welihinda, Peter Welinder, Jiayi Weng, Lilian Weng, Matt Wiethoff, Dave Willner, Clemens Winter, Samuel Wolrich, Hannah Wong, Lauren Workman, Sherwin Wu, Jeff Wu, Michael Wu, Kai Xiao, Tao Xu, Sarah Yoo, Kevin Yu, Qiming Yuan, Wojciech Zaremba, Rowan Zellers, Chong Zhang, Marvin Zhang, Shengjia Zhao, Tianhao Zheng, Juntang Zhuang, William Zhuk, Barret Zoph

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CL、cs.AI

Comments 100 pages; updated authors list; fixed author names and added citation

Detecting misinformation through Framing Theory: the Frame Element-based Model

Guan Wang, Rebecca Frederick, Jinglong Duan, William Wong, Verica Rupar, Weihua Li, Quan Bai

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.CL、cs.CY

Comments 17 pages, 9 figures, 7 tables

Human-Aligned Calibration for AI-Assisted Decision Making

Nina L. Corvelo Benz, Manuel Gomez Rodriguez

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CY、cs.LG

Consistency-Guided Temperature Scaling Using Style and Content Information for Out-of-Domain Calibration

Wonjeong Choi, Jungwuk Park, Dong-Jun Han, Younghyun Park, Jaekyun Moon

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.AI、cs.LG

Comments Accepted at AAAI-24 (The 38th AAAI Conference on Artificial Intelligence, February 2024)

Specious Sites: Tracking the Spread and Sway of Spurious News Stories at Scale

Hans W. A. Hanley, Deepak Kumar, Zakir Durumeric

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.CY、cs.LG

Comments Accepted to IEEE S&P 2024. Updated Emails

Characterizing Large Language Models as Rationalizers of Knowledge-intensive Tasks

Aditi Mishra, Sajjadur Rahman, Hannah Kim, Kushan Mitra, Estevam Hruschka

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.CL、cs.AI

Act as You Learn: Adaptive Decision-Making in Non-Stationary Markov Decision Processes

Baiting Luo, Yunuo Zhang, Abhishek Dubey, Ayan Mukhopadhyay

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Comments Accepted for publication at the International Conference on Autonomous Agents and MultiAgent Systems (AAMAS), 2024

Improving fine-grained understanding in image-text pre-training

Ioana Bica, Anastasija Ilić, Matthias Bauer, Goker Erdogan, Matko Bošnjak, Christos Kaplanis, Alexey A. Gritsenko, Matthias Minderer, Charles Blundell, Razvan Pascanu, Jovana Mitrović

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.AI、cs.LG

Comments 26 pages

Scope Compliance Uncertainty Estimate

Al-Harith Farhad, Ioannis Sorokos, Mohammed Naveed Akram, Koorosh Aslansefat, Daniel Schneider

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Can Large Language Models Serve as Rational Players in Game Theory? A Systematic Analysis

Caoyun Fan, Jindou Chen, Yaohui Jin, Hao He

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CL、cs.AI

Comments AAAI 2024

Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Prompting

Miles Turpin, Julian Michael, Ethan Perez, Samuel R. Bowman

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.CL、cs.AI

Comments NeurIPS 2023

Learning-Based Approaches to Predictive Monitoring with Conformal Statistical Guarantees

Francesca Cairoli, Luca Bortolussi, Nicola Paoletti

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Understanding Your Agent: Leveraging Large Language Models for Behavior Explanation

Xijia Zhang, Yue Guo, Simon Stepputtis, Katia Sycara, Joseph Campbell

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG

Uncertainty in Additive Feature Attribution methods

Abhishek Madaan, Tanya Chowdhury, Neha Rana, James Allan, Tanmoy Chakraborty

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.AI、cs.LG

Comments 14

Investigating Uncertainty Calibration of Aligned Language Models under the Multiple-Choice Setting

Guande He, Peng Cui, Jianfei Chen, Wenbo Hu, Jun Zhu

专题命中 幻觉与事实性 ：alignment(abstract)；分类 cs.CL、cs.LG

Empirical evaluation of Uncertainty Quantification in Retrieval-Augmented Language Models for Science

Sridevi Wagle, Sai Munikoti, Anurag Acharya, Sara Smith, Sameera Horawalavithana

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.CL、cs.AI

Selectively Answering Ambiguous Questions

Jeremy R. Cole, Michael J. Q. Zhang, Daniel Gillick, Julian Martin Eisenschlos, Bhuwan Dhingra, Jacob Eisenstein

专题命中 幻觉与事实性 ：trustworthy(abstract)；分类 cs.CL、cs.AI

Comments To appear in EMNLP 2023. 9 pages, 5 figures, 2 pages of appendix

Uncertainty Wrapper in the medical domain: Establishing transparent uncertainty quantification for opaque machine learning models in practice

Lisa Jöckel, Michael Kläs, Georg Popp, Nadja Hilger, Stephan Fricke

专题命中 幻觉与事实性 ：safety(abstract)；分类 cs.AI、cs.LG