arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.08161cs.CLcs.AIcs.HCcs.IRcs.LG
收藏

h2oGPT:让大语言模型走向普及

h2oGPT: Democratizing Large Language Models

H2O.ai, Inc.(H2O.ai公司)
Arno Candel, Jon McKinney, Philipp Singer, Pascal Pfeiffer, Maximilian Jeblick, Prithvi Prabhu, Jeff Gambera, Mark Landry, Shivam Bansal, Ryan Chesler, Chun Min… 展开作者

Arno Candel, Jon McKinney, Philipp Singer, Pascal Pfeiffer, Maximilian Jeblick, Prithvi Prabhu, Jeff Gambera, Mark Landry, Shivam Bansal, Ryan Chesler, Chun Ming Lee, Marcos V. Conde, Pasha Stetsenko, Olivier Grellier, SriSatish Ambati

AI总结:

针对现有大语言模型的风险与闭源局限,研究团队推出开源的h2oGPT项目,提供多参数规模的可商用微调模型与隐私文档搜索功能,助力AI公平普及。

摘要:

基于GPT-4等大语言模型(LLM)构建的应用凭借其在自然语言处理方面的人类级能力,代表了人工智能领域的一场革命。但这些模型也存在诸多重大风险,比如生成带有偏见、涉及隐私或有害的文本,以及未经授权纳入受版权保护的内容。\n 我们推出h2oGPT,这是一套用于创建和使用基于生成式预训练Transformer(GPT)的大语言模型的开源代码仓库集合。该项目的目标是打造全球顶尖的、真正的闭源方案开源替代选项。我们与卓越且发展势不可挡的开源社区合作,并作为该社区的一部分,开源了多款参数规模从70亿到400亿的经过微调的h2oGPT模型,这些模型遵循完全宽松的Apache 2.0许可证,可直接用于商业用途。我们的发布内容还包括支持100%隐私保护的自然语言文档搜索功能。\n 开源语言模型有助于推动人工智能发展,让其更易获取、更值得信赖。它们降低了准入门槛,使个人和团队能够根据自身需求定制这些模型。这种开放性提升了创新性、透明度与公平性。要公平分享人工智能的益处,就需要采取开源策略,H2O.ai也将持续推动人工智能和大语言模型的普及化。

英文摘要:

Applications built on top of Large Language Models (LLMs) such as GPT-4 represent a revolution in AI due to their human-level capabilities in natural language processing. However, they also pose many significant risks such as the presence of biased, private, or harmful text, and the unauthorized inclusion of copyrighted material. We introduce h2oGPT, a suite of open-source code repositories for the creation and use of LLMs based on Generative Pretrained Transformers (GPTs). The goal of this project is to create the world's best truly open-source alternative to closed-source approaches. In collaboration with and as part of the incredible and unstoppable open-source community, we open-source several fine-tuned h2oGPT models from 7 to 40 Billion parameters, ready for commercial use under fully permissive Apache 2.0 licenses. Included in our release is 100\% private document search using natural language. Open-source language models help boost AI development and make it more accessible and trustworthy. They lower entry hurdles, allowing people and groups to tailor these models to their needs. This openness increases innovation, transparency, and fairness. An open-source strategy is needed to share AI benefits fairly, and H2O.ai will continue to democratize AI and LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑