FlowMM: Cross-Modal Information Flow Guided KV Cache Merging for Efficient Multimodal Context Inference
机构 * Zhejiang University(浙江大学) ; Huazhong Agricultural University(华中农业大学) ; Alibaba(阿里巴巴)
高校专区
机构 * Zhejiang University(浙江大学) ; Huazhong Agricultural University(华中农业大学) ; Alibaba(阿里巴巴)
机构 * School of Philosophy, Zhejiang University(浙江大学哲学系) ; College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院) ; The State Key Lab of Brain-Machine Intelligence(脑机智能国家重点实验室)
机构 * Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology (Shandong Academy of Sciences)(计算能力网络与信息安全部分省计算机科学中心,青岛科技大学(山东省科学院)) ; Shandong Provincial Key Laboratory of Industrial Network and Information System Security, Shandong Fundamental Research Center for Computer Science(山东省工业网络与信息系统安全省重点实验室,山东省计算机科学基础研究中心) ; School of Computer Science and Technology, Shandong University(山东大学计算机科学与技术学院) ; School of Computer Science and Cyber Engineering, Guangzhou University(广州大学计算机科学与网络工程学院) ; State Key Lab. of Industrial Control Technology, Zhejiang University(浙江省工业控制技术重点实验室,浙江大学)