arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.28343cs.IRcs.AI
收藏

拥挤的嵌入空间:检索增强型智能体中涌现边缘化的平均场机制

The Crowded Embedding Space: A Mean-Field Mechanism for Emergent Marginalization in Retrieval-Augmented Agents

Shwan Ashrafi, Dan Roth

AI总结:

研究检索增强型智能体中密集检索导致少数内容被边缘化的问题,通过静态和动态分析揭示平均场机制,证明局部相关性目标会系统性地排斥少数兴趣。

摘要:

检索增强型生成智能体依赖检索进行 grounding,但通常以逐查询方式评估。这隔离了在共享嵌入空间中几何耦合的交互。例如,我们表明服务多数兴趣(如通用“犯罪”电影)所需的高文档密度会几何上过度拥挤语义相似少数群体(如“黑色电影”)的检索邻域,有效将少数内容从 top-k 结果中驱逐。我们引入一个正式框架来分析密集检索中此类目标冲突如何导致基本性能限制和空间拥挤固有的新兴公平问题。在我们的静态分析中,我们证明对于固定嵌入空间,存在一个相变点,其中少数用户目标随着多数目标密度的增加而经历灾难性的性能下降。然后我们将其扩展到动态模型,并推导出一个非线性 Fokker-Planck 方程,该方程控制文档嵌入在智能体更新它们以最大化检索准确性时的演化。我们的分析揭示,这种局部相关性目标触发了一个新兴的全局机制,系统性地边缘化少数兴趣。我们证明此类目标驱动系统自组织成一个专门服务多数兴趣的状态。这些结果为理解检索增强型智能体中的关键 grounding 失败模式提供了理论基础。

英文摘要:

Retrieval-augmented generative agents rely on retrieval for grounding, yet are typically evaluated on a query-by-query basis. This isolates interactions that are geometrically coupled in a shared embedding space. For example, we show that the high document density required to serve majority interests (e.g., generic "Crime" movies) can geometrically overcrowd the retrieval neighborhood of a semantically similar minority (e.g., "Film Noir"), effectively expelling minority content from top-$k$ results. We introduce a formal framework to analyze how such goal collisions in dense retrieval induce fundamental performance limits and emergent fairness issues inherent to spatial crowding. In our static analysis, we demonstrate that for a fixed embedding space, a phase transition occurs where minority user goals suffer a catastrophic collapse in performance as the density of majority goals increases. We then extend this to a dynamic model and derive a non-linear Fokker-Planck equation that governs the evolution of document embeddings as the agent updates them to maximize retrieval accuracy. Our analysis reveals that this local relevance objective triggers an emergent global mechanism that systematically marginalizes minority interests. We prove that such objectives drive the system to self-organize into a state that exclusively serves majority interests. These results provide a theoretical foundation for understanding a critical grounding failure mode in retrieval-augmented agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑