语言模型必须多开放才能实现可靠的科学推断?
How Open Must Language Models be to Enable Reliable Scientific Inference?
AI总结:
本文探讨了语言模型的开放程度如何影响基于其研究的科学推断可靠性,指出封闭模型通常不适合科学用途,并提出系统识别和缓解推断威胁的方法。
摘要:
语言模型的开放程度如何影响基于其研究的科学推断?本文分析了模型构造和部署信息的限制如何威胁可靠的推断。我们论证当前封闭模型通常不适合科学用途(有例外情况),并讨论如何解决或缓解它们对可靠推断的威胁。我们建议在研究中使用模型时,应系统地识别潜在的推断威胁,并采取相应的缓解措施,同时提供具体模型选择的正当理由。
英文摘要:
How does the extent to which a model is open or closed impact the scientific inferences that can be drawn from research that involves it? In this paper, we analyze how restrictions on information about model construction and deployment threaten reliable inference. We argue that current closed models are generally ill-suited for scientific purposes, with some notable exceptions, and discuss ways in which the issues they present to reliable inference can be resolved or mitigated. We recommend that when models are used in research, potential threats to inference should be systematically identified along with the steps taken to mitigate them, and that specific justifications for model selection should be provided.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。