arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.07288cs.AI
收藏

LLM-Net:通过基于区块链的专家网络实现LLMs即服务的民主化

LLM-Net: Democratizing LLMs-as-a-Service through Blockchain-based Expert Networks

Kwansei Gakuin University(关西学院大学);Victoria University of Wellington(惠灵顿维多利亚大学)

Zan-Kai Chong, Hiroyuki Ohsaki, Bryan Ng

AI总结:

本文提出基于区块链的去中心化框架LLM-Net,通过整合分布式领域专家模型与协作提示机制实现LLMs即服务的民主化,并利用声誉机制维持服务质量。

摘要:

大型语言模型(LLMs)发展的中心化给AI进步造成了重大障碍,限制了这些强大技术的民主化。这种中心化,加上高质量训练数据的稀缺,以及在快速扩展的知识领域中维持全面专业知识的日益复杂性,对LLMs的持续增长构成了关键挑战。尽管检索增强生成(RAG)等解决方案提供了潜在的补救措施,但在不同领域维持最新的专家知识仍然是一个重大挑战,特别是考虑到专业信息的指数级增长。本文介绍了LLMs网络(LLM-Net),这是一个基于区块链的框架,通过由专门的LLM提供商组成的去中心化网络实现LLMs即服务的民主化。通过利用集体计算资源和分布式领域专业知识,LLM-Net为各种特定领域整合了微调的专家模型,通过协作提示机制确保持续的知识增长,同时保持服务质量。该框架的稳健设计包含区块链技术,用于透明的交易和性能验证,建立不可变的服务交付记录。我们的模拟建立在Claude 3.5 Sonnet、Llama 3.1、Grok-2和GPT-4o等最先进的LLMs之上,验证了基于声誉的机制在通过选择高性能响应者(LLM提供商)来保持服务质量方面的有效性。从而证明了LLM-Net通过整合去中心化专业知识和基于区块链的问责制来维持AI进步的潜力。

英文摘要:

The centralization of Large Language Models (LLMs) development has created significant barriers to AI advancement, limiting the democratization of these powerful technologies. This centralization, coupled with the scarcity of high-quality training data and mounting complexity of maintaining comprehensive expertise across rapidly expanding knowledge domains, poses critical challenges to the continued growth of LLMs. While solutions like Retrieval-Augmented Generation (RAG) offer potential remedies, maintaining up-to-date expert knowledge across diverse domains remains a significant challenge, particularly given the exponential growth of specialized information. This paper introduces LLMs Networks (LLM-Net), a blockchain-based framework that democratizes LLMs-as-a-Service through a decentralized network of specialized LLM providers. By leveraging collective computational resources and distributed domain expertise, LLM-Net incorporates fine-tuned expert models for various specific domains, ensuring sustained knowledge growth while maintaining service quality through collaborative prompting mechanisms. The framework's robust design includes blockchain technology for transparent transaction and performance validation, establishing an immutable record of service delivery. Our simulation, built on top of state-of-the-art LLMs such as Claude 3.5 Sonnet, Llama 3.1, Grok-2, and GPT-4o, validates the effectiveness of the reputation-based mechanism in maintaining service quality by selecting high-performing respondents (LLM providers). Thereby it demonstrates the potential of LLM-Net to sustain AI advancement through the integration of decentralized expertise and blockchain-based accountability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑