在人机决策中,给出解释的欺骗性AI系统与诚实的AI系统一样令人信服
Deceptive AI Systems That Give Explanations Are Just as Convincing as Honest AI Systems in Human-Machine Decision Making
摘要:
辨别真假信息的能力对于做出正确的决定至关重要。然而,随着最近基于人工智能的虚假信息活动的增加,了解欺骗性系统对人类信息处理的影响变得至关重要。在实验(N=128)中,我们通过研究当人工智能系统被视为人类事实检查者或人工智能事实检查系统时,以及当这些事实检查者提供的解释是欺骗性的或诚实的时,他们辨别真实新闻和假新闻的能力如何变化,来调查人们对欺骗性人工智能系统的敏感程度。我们发现,欺骗性的解释会显著降低准确性,这表明人们相信欺骗性人工智能解释的可能性与诚实的人工智能解释一样大。虽然在获得人工智能系统的帮助之前,人们对虚假标题的加权识别准确率明显高于真实标题,但我们发现,在人工智能系统的帮助下,当对真实标题和虚假标题给出诚实的解释时,识别准确率显着提高,当对真实标题和虚假标题给出欺骗性解释时,识别准确率显着下降。此外,与人工智能事实检查器相比,我们没有观察到来自人类事实检查器的解释之间的任何显着差异。同样,我们在信任方面也没有发现显著差异。这些发现揭示了欺骗性人工智能系统的危险,以及寻找新方法来限制它们对人类信息处理的影响的必要性。
英文摘要:
The ability to discern between true and false information is essential to making sound decisions. However, with the recent increase in AI-based disinformation campaigns, it has become critical to understand the influence of deceptive systems on human information processing. In experiment (N=128), we investigated how susceptible people are to deceptive AI systems by examining how their ability to discern true news from fake news varies when AI systems are perceived as either human fact-checkers or AI fact-checking systems, and when explanations provided by those fact-checkers are either deceptive or honest. We find that deceitful explanations significantly reduce accuracy, indicating that people are just as likely to believe deceptive AI explanations as honest AI explanations. Although before getting assistance from an AI-system, people have significantly higher weighted discernment accuracy on false headlines than true headlines, we found that with assistance from an AI system, discernment accuracy increased significantly when given honest explanations on both true headlines and false headlines, and decreased significantly when given deceitful explanations on true headlines and false headlines. Further, we did not observe any significant differences in discernment between explanations perceived as coming from a human fact checker compared to an AI-fact checker. Similarly, we found no significant differences in trust. These findings exemplify the dangers of deceptive AI systems and the need for finding novel ways to limit their influence human information processing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。