arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.11643cs.DC
收藏

无状态雪花:一种基于网络衍生身份的云无关分布式ID生成器

Stateless Snowflake: A Cloud-Agnostic Distributed ID Generator Using Network-Derived Identity

Manideep Reddy Chinthareddy

AI总结:

无状态雪花通过容器网络属性生成唯一ID,无需中心协调,实现云无关和无限制横向扩展。

摘要:

雪花风格的分布式ID生成器是生产大规模k-有序唯一标识的标准。然而,传统方法对人工分配或中心协调的工作者ID有显著的摩擦,在现代容器编排环境中(如Kubernetes),工作负载是易逝且自动扩展的。在这些系统中,维护稳定的工作者身份需要复杂的有状态集合或外部协调服务(如ZooKeeper),这抵消了无状态微服务的操作优势。本文提出了一种云无关、容器原生的ID生成协议,消除了对显式工作者ID的依赖。通过从易逝的网络属性(特别是容器的私有IPv4地址)中确定性地推导节点唯一性,所提出的方法消除了对中心协调的需求。我们引入了一种修改的位分配方案(1-41-16-6),该方案容纳16位网络衍生熵,同时保持严格的单调性。我们验证了该方法在AWS、GCP和Azure环境中的表现。评估结果表明,尽管该设计在理论上单节点上限约为64,000 TPS,但在实际微服务部署中,网络I/O主导延迟,导致端到端性能(大约在3节点集群上为31,000 TPS)与经典有状态生成器相当,同时提供几乎无限制的横向扩展能力。

英文摘要:

Snowflake-style distributed ID generators are the industry standard for producing k-ordered, unique identifiers at scale. However, the traditional requirement for manually assigned or centrally coordinated worker IDs introduces significant friction in modern container-orchestrated environments (e.g., Kubernetes), where workloads are ephemeral and autoscaled. In such systems, maintaining stable worker identities requires complex stateful sets or external coordination services (e.g., ZooKeeper), negating the operational benefits of stateless microservices. This paper presents a cloud-agnostic, container-native ID generation protocol that eliminates the dependency on explicit worker IDs. By deriving node uniqueness deterministically from ephemeral network properties - specifically the container's private IPv4 address - the proposed method removes the need for centralized coordination. We introduce a modified bit-allocation scheme (1-41-16-6) that accommodates 16 bits of network-derived entropy while preserving strict monotonicity. We validate the approach across AWS, GCP, and Azure environments. Evaluation results demonstrate that while the design has a theoretical single-node ceiling of approximately 64,000 TPS, in practical microservice deployments the network I/O dominates latency, resulting in end-to-end performance (approximately 31,000 TPS on a 3-node cluster) comparable to classic stateful generators while offering effectively unbounded horizontal scalability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑