LLM无处不在:通过空中计算实现AI模型的泛在化利用
LLMs are everywhere: Ubiquitous Utilization of AI Models through Air Computing
AI总结:
本文提出将边缘计算扩展至三维空中计算(air computing)范式,通过无人机等空中单元卸载计算任务,以增强LLM和生成式AI应用的泛在执行能力,并通过灾难响应案例验证了该协同方法能显著提升关键场景下的服务效率与体验质量。
摘要:
我们正见证一个新时代,从代码生成到假期规划等不同领域的问题解决和认知任务正越来越多地委托给大型语言模型(LLMs)来完成。这一趋势也催生了对在各种环境中泛在执行LLM驱动应用的需求,而传统的地面二维网络基础设施在这些环境中可能显得不足。在此背景下,一个有前景的解决方案是将边缘计算扩展到三维环境中,纳入按多层组织的空中平台,我们将这一范式称为空中计算(air computing),以增强运行LLM和生成式AI(GenAI)应用的本地设备。这种方法通过将计算任务卸载到无人机(UAV)等相应的空中单元,减轻了现有基础设施的压力,同时提高了服务效率。此外,各种空中单元的协同部署能够确保无缝、自适应且具有弹性的任务执行,从而显著提升体验质量(QoE)。在本研究中,我们探讨了基于LLM的应用与空中计算之间的协同作用,探索了它们在各种用例中的潜力。此外,我们提出了一个灾难响应案例研究,展示了LLM与空中计算的协作利用如何显著改善关键情况下的结果。
英文摘要:
We are witnessing a new era where problem-solving and cognitive tasks are being increasingly delegated to Large Language Models (LLMs) across diverse domains, ranging from code generation to holiday planning. This trend also creates a demand for the ubiquitous execution of LLM-powered applications in a wide variety of environments in which traditional terrestrial 2D networking infrastructures may prove insufficient. A promising solution in this context is to extend edge computing into a 3D setting to include aerial platforms organized in multiple layers, a paradigm we refer to as air computing, to augment local devices for running LLM and Generative AI (GenAI) applications. This approach alleviates the strain on existing infrastructure while enhancing service efficiency by offloading computational tasks to the corresponding air units such as UAVs. Furthermore, the coordinated deployment of various air units can significantly improve the Quality of Experience (QoE) by ensuring seamless, adaptive, and resilient task execution. In this study, we investigate the synergy between LLM-based applications and air computing, exploring their potential across various use cases. Additionally, we present a disaster response case study demonstrating how the collaborative utilization of LLMs and air computing can significantly improve outcomes in critical situations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。