MeanCache: User-Centric Semantic Caching for LLM Web Services
机构 * Virginia Tech(弗吉尼亚理工大学) ; Cisco(思科) ; University of Minnesota(明尼苏达大学)
Comments Accepted at 2025 IEEE 39th International Parallel and Distributed Processing Symposium (IPDPS)
Journal ref 2025 IEEE International Parallel and Distributed Processing Symposium (IPDPS)