Backstitch:在生产微服务集群中恢复请求因果性
Backstitch: Restoring Request Causality Across a Production Microservice Fleet
浏览论文内容
中文总结 AI 辅助
针对微服务集群中上下文传播断裂的无声问题,Backstitch通过重放、源码分析和有界变更修复因果链,使断裂率大幅下降。
中文摘要 AI 辅助
一个大型视频平台运行在数千个微服务上,每个请求都会传播一个上下文,以便下游工作能够被追踪和管理。在插桩路径之外的交界处(例如自定义队列和回调),负载继续传递但上下文不再传播,且请求在现有测试下仍然成功。此类断裂是无声且广泛的:1,133个服务中有673个至少存在一处断裂。Backstitch是一个专门的智能体系统,利用存活的执行作为参考来修复这些断裂:重放确定可疑调用是否与请求相关,源码分析定位到负责的交界处,有界变更恢复其契约,并再次通过重放验证修复。修复恢复了因果链而不干扰其所描述的工作:在修复的240处调用中,断裂率从90.46%降至4.69%,且在112天内,整个集群的断裂率降低了一半以上。
英文摘要
A major video platform runs on thousands of microservices, each request propagating a context so downstream work can be traced and governed. At handoffs outside instrumented paths, e.g., custom queues and callbacks, the payload continues but the context does not, and the request still succeeds under existing tests. Such breaks are silent and widespread: 673 of 1,133 services carried at least one. Backstitch, a specialized agentic system, repairs them using the surviving execution as its reference: replay determines whether a suspicious call is request-correlated, source analysis reaches the responsible handoff, a bounded change restores its contract, and the same replay validates the fix. Repairs restore the causal chain without disturbing the work it describes: breaks at 240 of the repaired calls fell from 90.46% to 4.69%, and over 112 days the fleet's break rate more than halved.
发表机构
- TikTok Inc.(TikTok公司)
- Douyin Vision Co., Ltd.(抖音视界有限公司)
机构由 AI 辅助整理,请以论文原文为准。