arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.13938cs.CV

ASTRA:通过检索增强的姿势引导和解纠缠位置嵌入增强多主体生成

ASTRA: Enhancing Multi-Subject Generation with Retrieval-Augmented Pose Guidance and Disentangled Position Embedding

Huazhong University of Science and Technology(华中科技大学)

Tianze Xia, Zijian Ning, Zonglin Zhao, Mingjia Wang

AI总结:

ASTRA通过检索增强的姿势引导和解纠缠位置嵌入,解决多主体生成中身份与姿势结构的分离问题,提升姿态一致性和身份保真度。

摘要:

ASTRA通过检索增强的姿势引导和解纠缠位置嵌入,解决多主体生成中身份与姿势结构的分离问题,提升姿态一致性和身份保真度。

英文摘要:

Subject-driven image generation has shown great success in creating personalized content, but its capabilities are largely confined to single subjects in common poses. Current approaches face a fundamental conflict when handling multiple subjects with complex, distinct actions: preserving individual identities while enforcing precise pose structures. This challenge often leads to identity fusion and pose distortion, as appearance and structure signals become entangled within the model's architecture. To resolve this conflict, we introduce ASTRA(Adaptive Synthesis through Targeted Retrieval Augmentation), a novel framework that architecturally disentangles subject appearance from pose structure within a unified Diffusion Transformer. ASTRA achieves this through a dual-pronged strategy. It first employs a Retrieval-Augmented Pose (RAG-Pose) pipeline to provide a clean, explicit structural prior from a curated database. Then, its core generative model learns to process these dual visual conditions using our Enhanced Universal Rotary Position Embedding (EURoPE), an asymmetric encoding mechanism that decouples identity tokens from spatial locations while binding pose tokens to the canvas. Concurrently, a Disentangled Semantic Modulation (DSM) adapter offloads the identity preservation task into the text conditioning stream. Extensive experiments demonstrate that our integrated approach achieves superior disentanglement. On our designed COCO-based complex pose benchmark, ASTRA achieves a new state-of-the-art in pose adherence, while maintaining high identity fidelity and text alignment in DreamBench.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑