版权材料对大型语言模型的影响:挪威视角
The Impact of Copyrighted Material on Large Language Models: A Norwegian Perspective
AI总结:
本文提出一个框架,实证评估出版商控制的版权语料库对挪威语生成式大型语言模型性能的影响,发现书籍和报纸有益,虚构作品有害,可为作者补偿方案提供参考。
摘要:
在训练语言模型中使用版权材料引发了关键的法律和伦理问题。本文提出了一个框架,并展示了实证评估出版商控制的版权语料库对挪威语生成式大型语言模型(LLM)性能影响的结果。在一组多样化的任务上进行评估时,我们发现将书籍和报纸添加到LLM的数据混合中往往会提升其性能,而添加虚构作品似乎会产生不利影响。我们的实验可为制定针对其作品助力人工智能发展的作者的补偿方案提供参考。
英文摘要:
The use of copyrighted materials in training language models raises critical legal and ethical questions. This paper presents a framework for and the results of empirically assessing the impact of publisher-controlled copyrighted corpora on the performance of generative large language models (LLMs) for Norwegian. When evaluated on a diverse set of tasks, we found that adding both books and newspapers to the data mixture of LLMs tend to improve their performance, while the addition of fiction works seems to be detrimental. Our experiments could inform the creation of a compensation scheme for authors whose works contribute to AI development.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。