Prior study shows that LLMs sometimes generate content that violates copyright. In this paper, we study another important yet underexplored problem, i.e., will LLMs respect copyright information in user input, and behave accordingly? The research problem is critical, as a negative answer would imply that LLMs will become the primary facilitator and accelerator of copyright infringement behavior. We conducted a series of experiments using a diverse set of language models, user prompts, and copyrighted materials, including books, news articles, API documentation, and movie scripts. Our study offers a conservative evaluation of the extent to which language models may infringe upon copyrights when processing user input containing protected material. This research emphasizes the need for further investigation and the importance of ensuring LLMs respect copyright regulations when handling user input to prevent unauthorized use or reproduction of protected content. We also release a benchmark dataset serving as a test bed for evaluating infringement behaviors by LLMs and stress the need for future alignment.
Project Alexandria: Towards Freeing Scientific Knowledge from Copyright Burdens via LLMs
LAION;Open-Ψ (Open-Sci) Collective(Open-Ψ(Open-Sci)集体);L3S Research Center, Leibniz University Hannover(汉诺威莱布尼茨大学L3S研究中心);Stanford University(斯坦福大学);TIB—Leibniz Information Centre for Science and Technology(莱布尼茨科技信息中心);Juelich Supercomputing Center(于利希超级计算中心);Technical University of Munich(慕尼黑工业大学)
Inner-Probe: Discovering Copyright-related Data Generation in LLM Architecture
School of Computer Science and the State Key Laboratory of Multimedia Information Processing, Peking University(计算机科学系和多媒体信息处理国家重点实验室,北京大学);Institute for Artificial Intelligence, Peking University(人工智能研究院,北京大学);department of Electrical and Computer Engineering, University of California, Santa Cruz(电气与计算机工程系,加州大学圣克鲁兹分校);Alibaba DAMO Academy, Beijing(阿里巴巴达摩院,北京);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学);School of Integrated Circuits, Peking University(集成电路系,北京大学);YanXin MicroElectronics Co., Ltd.(YXME), Shanghai, China(燕芯微电子有限公司(YXME),上海,中国)
AI Disclosures Project, Code for Science and Society(AI披露项目,代码用于社会);O’Reilly Media(O’Reilly媒体);Institute for Innovation and Public Purpose, University College London(创新与公共目的研究所,伦敦大学学院)
LMU Munich(慕尼黑大学);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Technical University of Munich(慕尼黑技术大学);Siemens AG(西门子股份公司);University of Oxford(牛津大学)