Hundreds of millions of people use AI for writing assistance. We asked how AI distorts perceptions of AI users and their opinions. Writers (N=2,939) wrote political opinion paragraphs with and without AI assistance. Separate readers (N=11,091) blindly evaluated these paragraphs and made inferences about the writers. With AI, writers seemed more opinionated, competent, positive, and demographically privileged. Writers objected to many of these distortions yet preferred AI-assisted text even when made aware of them. Reward models trained on our data mitigated objectionable distortions but reduced user acceptance. Additional readers (N=8,798) trusted AI-assisted writers more and were more persuaded by AI writing when AI was more distortive. Overall, distortions from AI writing assistance are pervasive, persistent under human oversight, and likely to have consequential effects on human behaviours and attitudes.
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Center for Data Science, Peking University(北京大学数据科学中心);Microsoft(微软);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院);State Key Laboratory of Media Convergence Production Technology and Systems(媒体融合生产技术与系统国家重点实验室)
本文提出Smart Word Suggestions(SWS)任务与基准,通过端到端评估识别写作中需改进的词汇并提供替换建议,构建了含人工标注测试集与远监督训练集的评估框架,实验表明该任务具挑战性并指明未来方向。
Towards Real-World Writing Assistance: A Chinese Character Checking Benchmark with Faked and Misspelled Characters
Tsinghua University(清华大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Peng Cheng Laboratory(鹏城实验室);Alibaba Group(阿里巴巴集团);Baidu Inc.(百度公司);OPPO Research Institute(OPPO研究院);Sun-Yat Sen University(中山大学)
MODOC: A Modular Interface for Flexible Interlinking of Text Retrieval and Text Generation Functions
Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所);ETH Zurich(苏黎世联邦理工学院);Linguistic Research Infrastructure, University of Zurich(苏黎世大学语言研究基础设施)
ParaRev: Building a dataset for Scientific Paragraph Revision annotated with revision instruction
Nantes Université(南特大学);École Centrale Nantes(南特中央理工学院);CNRS(法国国家科学研究中心);LS2N(南特数字科学实验室);JFLI(日本信息学研究所联合实验室);Nantes University(南特大学);National Institute of Informatics(日本信息学研究所)