为什么我们需要一个AI韧性社会
Why we need an AI-resilient society- Profiling Large Language Models
AI总结:
本文探讨AI对社会的影响,提出通过认知主权、可测量控制和部分自主性构建AI韧性框架,以应对AI带来的系统性风险。
摘要:
软件的三重世代转变了人工智能在社会中的角色。第一代由程序员编写显式逻辑;第二代神经网络从数据中学习程序;第三代大语言模型将自然语言本身转化为编程接口。这些转变的后果远超计算机科学,重塑了社会获取知识、做出决策和自我治理的方式。尽管生成对抗网络引入了深度伪造和合成媒体时代,大语言模型却引入了全新的系统性风险。本文应用犯罪心理学剖析方法,基于九个已记录的特征对AI进行表征:幻觉、偏见和毒性、阿谀奉承和回音室、伪造和轻信、无理解的知识、断续性和无法从经验中学习、锯齿状智能和扩展限制、捷径和破碎表征、以及认知退化。所得表征揭示了一个能够流畅编造、镜像用户偏见、拥有百科全书式记忆但缺乏因果理解、并侵蚀依赖它的能力的实体。这些影响扩展到法律、学术、新闻和民主治理等制度领域。为应对这些挑战,本文提出AI韧性的三支柱框架:认知主权,保留独立判断能力;可测量控制,将伦理承诺转化为可执行标准和红线;部分自主性,在关键决策点维持人类主导。本文是arXiv:1912.08786v1的更新和扩展版本。
英文摘要:
Three generations of software have transformed the role of artificial intelligence in society. In the first, programmers wrote explicit logic. In the second, neural networks learned programs from data. In the third, large language models turn natural language itself into a programming interface. These shifts reach far beyond computer science, reshaping how societies generate knowledge, make decisions, and govern themselves. While generative adversarial networks introduced the era of deepfakes and synthetic media, large language models have added a new class of systemic risks. This report performs "mindhunting" for LLMs by applying a forensic-psychology profiling methodology to characterize AI based on documented features, e.g., hallucinations, bias and toxicity, sycophancy, fabrication and confabulation, knowledge without understanding, discontinuity and the inability to learn from experience, jagged intelligence, shortcuts and fractured representations. The resulting profile reveals an "entity" that confabulates fluently, amplifies its users' biases, possesses encyclopedic recall without causal understanding, and erodes the competence of those who depend on it. The implications extend to institutional erosion across law, academia, journalism, and democratic governance. To address these challenges, this report proposes a four-pillar framework for AI resilience: (i) cognitive sovereignty, which preserves the capacity for independent judgment, (ii) measurable control, which translates ethical commitments into enforceable standards and red lines, (iii) partial autonomy, which maintains human agency at critical decision points, and (iv) openness to guarantee transparency and accessibility (open-source, open-access, and open-data). This report is an updated and extended version of arXiv:1912.08786v1.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。