Artificial intelligence is one of the important technologies for industrial applications, but it requires a lot of computing resources and sensor data to support it. With the development of edge computing and the Internet of Things, artificial intelligence are playing an increasingly important role in the field of edge services. Therefore, how to make intelligent algorithms provide better services and the development of the Internet of Things has become an increasingly important topic. This paper focuses on the application of edge service distribution strategy, and proposes an edge service distribution strategy based on intelligent prediction, which reduces the bandwidth consumption of edge service providers and minimizes the cost of edge service providers. In addition, this article uses the real data provided by the Wangsu Technology Company and an improved long and short term memory prediction method to dynamically change the bandwidth, and achieves better optimization of resources allocation comparing with actual industrial applications.The simulation results show that our intelligent prediction can achieve good results, and the mechanism can achieve higher resource utilization.
Memory at Your Service: Fast Memory Allocation for Latency-critical Services
在诸如键值存储和web搜索之类的延迟关键型服务与尽力而为的批处理作业之间的协同定位和存储器共享是提高多租户数据中心系统中的存储器利用率的有吸引力的方法。然而,我们发现,非常不同的目标的工作协同定位和GNU/Linux系统堆栈可能会导致严重的性能下降的延迟关键服务的内存压力下,在多租户系统。我们通过快速内存分配和主动回收来解决延迟关键型服务的内存压力。我们发现,内存分配延迟占主导地位的整体查询延迟,特别是在内存压力。我们分析了GNU/Linux系统栈提供的默认存储管理机制,并找出了它在多租户系统中对延迟关键服务效率低下的原因。我们提出了Hermes,一个快速的内存分配机制,在用户空间,自适应地保留内存的延迟关键的服务。它建议Linux操作系统主动回收批处理作业的内存。我们在GNU C Library中实现了Hermes。实验结果表明,Hermes在微基准测试中,平均内存分配延迟和$99^{th}$百分比内存分配延迟分别降低了54.4%和62.4%.对于两个实际的延迟关键型服务,Hermes将平均和$99^{th}$百分位数尾部查询延迟降低了40.3%。与默认的Glibc、jemalloc和TCMalloc相比,Hermes在内存压力下将服务级别目标违规减少了84.3%。
Resource Allocation and Service Provisioning in Multi-Agent Cloud Robotics: A Comprehensive Survey
Swinburne University of Technology(斯威本科技大学);CSIRO(澳大利亚联邦科学与工业研究组织);Engineering Institute of Technology (EIT)(工程技术学院);South China University of Technology(华南理工大学);University of Manitoba(曼尼托巴大学)
Two-Timescale Model Caching and Resource Allocation for Edge-Enabled AI-Generated Content Services
Xiamen University(厦门大学);University of Hong Kong(香港大学);Tsinghua University(清华大学);University at Buffalo–SUNY(纽约州立大学布法罗分校);Nanyang Technological University(南洋理工大学);The Hong Kong University of Science and Technology(香港科技大学)