不可变张量架构:一种纯数据流方法用于安全、节能的AI推理
The Immutable Tensor Architecture: A Pure Dataflow Approach for Secure, Energy-Efficient AI Inference
AI总结:
不可变张量架构通过将模型权重转化为物理电路拓扑,实现安全、节能的AI推理。
摘要:
将大型语言模型(LLMs)部署到消费级边缘设备时受到
英文摘要:
The deployment of Large Language Models (LLMs) on consumer edge devices is throttled by the "Memory Wall" -- the prohibitive bandwidth and energy cost of fetching gigabytes of model weights from DRAM for every token generated. Current architectures (GPUs, NPUs) treat model weights as mutable software data, incurring massive energy penalties to maintain general-purpose programmability. We propose The Immutable Tensor Architecture (ITA), a paradigm shift that treats model weights not as data, but as physical circuit topology. By encoding parameters directly into the metal interconnects and logic of mature-node ASICs (28nm/40nm), ITA eliminates the memory hierarchy entirely. We present a "Split-Brain" system design where a host CPU manages dynamic KV-cache operations while the ITA ASIC acts as a stateless, ROM-embedded dataflow engine.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。