arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.04601cs.CY
收藏

禁止生成式人工智能对在线问答社区的双刃剑效应:来自Stack Exchange的证据

The Double-edged Effect of Banning Generative AI on Online Question-and-Answer Communities: Evidence from Stack Exchange

Harbin Institute of Technology(哈尔滨工业大学);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);HEC Paris(巴黎高等商学院);The Wharton School, University of Pennsylvania(宾夕法尼亚大学沃顿商学院)

Yuanhong Ma, Qinglai He, Xitong Li, Lynn Wu

AI总结:

研究禁止生成式人工智能对在线问答社区的影响,采用双重差分法,发现禁令有双刃剑效应,非STEM社区问题量增但回答效率降,还探讨了潜在因素及对用户行为的影响,为相关方提供启示。

摘要:

我们研究了禁止生成式人工智能生成的内容(AIGC)如何影响在线问答社区中的知识寻求、知识贡献和贡献效率。2022年11月下旬ChatGPT推出后,几个Stack Exchange社区因内容可靠性和社交参与度等问题对AIGC实施了官方禁令。利用Stack Exchange社区全网数据,采用双重差分法研究这些禁令的影响。结果揭示了一种双刃剑效应:AIGC禁令增加了知识寻求(提问量增加),但同时降低了贡献效率(在预期时间内获得满意答案的问题比例降低)。值得注意的是,这些影响仅在非STEM社区中明显。我们从社会技术角度探讨信息可靠性和社会互动性这两个可能的潜在因素。机制探索表明,AIGC禁令在AIGC可靠性较低且社会互动性较高的主题中刺激了问题量。相比之下,禁令在大型语言模型能够产生可靠答案且社会互动性最小的社区中阻碍了回答效率。此外,我们的结果表明禁令后知识寻求者和贡献者的人力参与增加。他们通过发布信息更丰富、社交性更强的问题和答案来调整自己的行为。总体而言,我们的发现为在线问答社区的平台管理者、社区版主和政策制定者提供了可操作的启示。

英文摘要:

We investigate how banning generative artificial intelligence-generated content (AIGC) affects knowledge seeking, knowledge contribution, and contribution efficiency in online question-and-answer communities. After the launch of ChatGPT in late November 2022, several Stack Exchange communities implemented official bans on AIGC over concerns such as less reliable and socially engaged content. Leveraging data from the full network of Stack Exchange communities, we employ a difference-in-differences (DID) approach to examine the impacts of these bans. Our results reveal a double-edged impact: while the AIGC ban increases knowledge seeking, as evidenced by a higher volume of posted questions, it simultaneously reduces contribution efficiency, reflected in a lower proportion of questions receiving satisfactory answers within the expected time frame. Notably, these impacts are only evident in non-STEM communities. We take a socio-technical perspective to explore information reliability and social interactivity as two plausible underlying factors driving the observed changes. Our mechanism exploration reveals that the AIGC ban spurs question volume in topics where AIGC is less reliable and where social interaction is highly expected. In contrast, the ban hampers answer efficiency in communities where LLMs are capable of producing reliable answers and where social interactivity is minimal. Additionally, our results indicate the increased human involvement from knowledge seekers and contributors following the ban. They adapt their behavior by posting questions and answers that are more informationally rich and socially engaging. Overall, our findings offer actionable implications for platform managers, community moderators, and policymakers of online Q&A communities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑