PIMphony: Overcoming Bandwidth and Capacity Inefficiency in PIM-based Long-Context LLM Inference System
PIMphony: 逾越基于PIM的长上下文LLM推理系统的带宽和容量低效问题
专题命中 长上下文与记忆 :LLM(title,abstract);large language model(abstract);language model(abstract);分类 cs.AI
AI总结 PIMphony通过三种协同设计技术解决基于PIM的长上下文LLM推理系统的带宽和容量低效问题,显著提升吞吐量和效率。
Comments 21 pages, 20 figures, Accepted to 2026 IEEE International Symposium on High-Performance Computer Architecture