arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2607.02518cs.DCcs.AI
收藏

用于OpenClaw的GLM-5服务参数调优:针对长上下文代理工作负载的单部署MaaS推理优化

GLM-5 Serving Parameter Tuning for OpenClaw: Single-Deployment MaaS Inference Optimization for Long-Context Agent Workloads

China Unicom(中国联合网络通信集团有限公司)

Minjie Hua, Ning Wang, Peijun Yang, Kai Wang, Shiguo Lian

AI总结:

研究在MaaS多模型推理优化架构中对GLM-5服务参数调优,在单节点优化模块调整相关参数,找到最佳配置,相比基线提升了请求和总令牌吞吐量,降低了平均TTFT和延迟P90,推荐其为默认部署配置。

摘要:

OpenClaw请求由长的、工具增强的前缀主导。本报告研究MaaS多模型推理优化架构内的GLM-5服务参数调优,在推理优化层的单节点优化模块调整相关参数,测试得出最佳配置,相比基线有性能提升及成本降低,结果表明最优配置因工作负载而异。

英文摘要:

OpenClaw requests are dominated by long, tool-augmented prefixes, including system prompts, conversation history, and tool outputs fed back into the context window. For this workload, with about 28k-30k input tokens and 500 output tokens per request, serving quality is governed by throughput, TTFT, and tail latency rather than short-prompt throughput alone. This report studies GLM-5 serving-parameter tuning within a MaaS multi-model inference optimization architecture. The scope is the Single-Node Optimization block of the inference-optimization layer, where chunked prefill, tensor parallelism (TP), pipeline parallelism (PP), and request concurrency are tuned for one GLM-5 serving deployment; in this report, "Single-Node Optimization" denotes the architecture block, while experiments run on a two-node, sixteen-GPU cluster. Within the tested space, the best configuration is chunked-prefill-size=3072, tp=4, pp-size=4, and max-running-requests=24. Compared with the conservative 2048/4/4/16 baseline, it increases request throughput from 0.43 to 0.48 req/s and total token throughput from 9029.64 to 9993.23 tok/s, while reducing average TTFT from 8.98 to 6.69 s and latency P90 from 40.23 to 32.64 s. Under the same hardware footprint, this corresponds to an estimated 10.4% lower serving cost per request and 9.6% lower cost per token. The results show that the optimum is workload-specific: larger chunk sizes and deeper queueing do not monotonically improve performance. We therefore recommend 3072 / tp4 / pp4 / max24 as the default OpenClaw deployment profile.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑