Question answering systems are rapidly advancing, but their opaque nature may impact user trust. We explored trust through an anti-monitoring framework, where trust is predicted to be correlated with presence of citations and inversely related to checking citations. We tested this hypothesis with a live question-answering experiment that presented text responses generated using a commercial Chatbot along with varying citations (zero, one, or five), both relevant and random, and recorded if participants checked the citations and their self-reported trust in the generated responses. We found a significant increase in trust when citations were present, a result that held true even when the citations were random; we also found a significant decrease in trust when participants checked the citations. These results highlight the importance of citations in enhancing trust in AI-generated content.
LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports
Faculty of Data Science, City University of Macau(澳门城市大学数据科学学院);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Southern University of Science and Technology(南方科技大学)
Transparentize the Internal and External Knowledge Utilization in LLMs with Trustworthy Citation
The Key Laboratory of Cognition and Decision Intelligence for Complex Systems Institute of Automation, Chinese Academy of Sciences(认知与决策智能复杂系统重点实验室,中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);University of Chinese Academy of Sciences(中国科学院大学);Unisound Al Technology Co,Ltd(Unisound人工智能技术有限公司);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
A Citation-Grounded Benchmark for Trustworthy Earnings Call Transcript Analysis with Large Language Models
American Express(美国运通);Singapore Decision Science Center of Excellence, American Express(美国运通新加坡决策科学卓越中心);Global Decision Science, American Express(美国运通全球决策科学部)
Model Internals-based Answer Attribution for Trustworthy Retrieval-Augmented Generation
Center for Language and Cognition (CLCG), University of Groningen(格罗宁根大学语言与认知中心(CLCG));Institute for Logic, Language and Computation (ILLC), University of Amsterdam(阿姆斯特丹大学逻辑、语言与计算研究所(ILLC))
Citation Failure: Definition, Analysis and Efficient Mitigation
Ubiquitous Knowledge Processing Lab (UKP Lab)(普遍知识处理实验室);Department of Computer Science(计算机科学系);Hessian Center for AI (hessian.AI)(黑森人工智能中心);Technical University of Darmstadt(达姆施塔特技术大学)
Citation-Enhanced Generation for LLM-based Chatbots
Tsinghua University(清华大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院);Jiangsu Collaborative Innovation Center for Language Competence(江苏省语言能力协同创新中心)
Verified Misguidance: Measuring Structural Citation Failures in Search-Augmented LLMs
Department of Artificial Intelligence, Yonsei University(延世大学人工智能系);Department of Computer Science and Engineering, Konkuk University(Konkuk大学计算机科学与工程系);Incheon International Airport Corporation(仁川国际机场公司);Department of Computer Science and Engineering, Ewha Womans University(成均馆女子大学计算机科学与工程系)
From scratch to silver: Creating trustworthy training data for patent-SDG classification using Large Language Models
Department of Industrial Engineering, Polytechnic University of Turin(工业工程系,都灵理工学院);Venice School of Management, Ca Foscari University of Venice(威尼斯管理学院,威尼斯福斯卡里大学)
Citekit: A Modular Toolkit for Large Language Model Citation Generation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
CRISS: A Retrieval-Augmented AI Chatbot for Assisting Cancer Registrars
University of Missouri(密苏里大学);Missouri Cancer Registry and Research Center(密苏里癌症登记与研究中心);MU Institute for Data Science and Informatics(密苏里大学数据科学与信息学研究所)
Source Coverage and Citation Bias in LLM-based vs. Traditional Search Engines
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Rutgers University(罗格斯大学);Rutgers University New Brunswick United States(罗格斯大学新 Brunswick美国)
Curated retrieval versus open web search in public AI information services: a coverage-trust trade-off
Faculty of Industrial Engineering, Mechanical Engineering and Computer Science, University of Iceland(工业工程、机械工程和计算机科学学院,爱沙尼亚大学);Faculty of Political Science, University of Iceland(政治学学院,爱沙尼亚大学);The Icelandic Web of Science, University of Iceland(冰岛科学网络,爱沙尼亚大学)