变化环境中的学习、多样性与适应性:弱连接的作用
Learning, Diversity and Adaptation in Changing Environments: The Role of Weak Links
AI总结:
本研究针对动态环境下智能体多样性难维持的问题,基于社会网络贝叶斯学习模型,证明环境快速变化时仅强连接的网络表现接近随机选择,而强弱连接结合的网络可实现更高长期收益,揭示了弱连接在维持多样性与提升适应性中的关键作用。
摘要:
适应动态环境需要一定程度的多样性。如果所有智能体都采取当前最优行动,那么获知底层状态已发生变化、行为应当调整的速度就会更慢。当智能体之间存在快速通信时,多样性更难维持,因为它们往往会迅速发现并追求最优行动。我们通过社会网络上的(贝叶斯)学习模型探究这些问题。智能体可从通过强连接相连的其他个体处快速学习,也可能有动机与这些个体协调行动。然而我们证明,当底层环境变化足够快时,仅由强连接构成的任何网络在长期表现上仅比随机选择略好。相比之下,结合强连接与弱连接的网络(其中弱连接仅缓慢传递信息)能实现高得多的长期平均收益。最优的社会网络结构是:将大部分智能体纳入一个强连通分量,同时仍保留足够数量的做出多样化选择的小型社群,这些社群通过弱连接与该强连通分量通信。
英文摘要:
Adaptation to dynamic conditions requires a certain degree of diversity. If all agents take the best current action, learning that the underlying state has changed and behavior should adapt will be slower. Diversity is harder to maintain when there is fast communication between agents, because they tend to find out and pursue the best action rapidly. We explore these issues using a model of (Bayesian) learning over a social network. Agents learn rapidly from and may also have incentives to coordinate with others to whom they are connected via strong links. We show, however, that when the underlying environment changes sufficiently rapidly, any network consisting of just strong links will do only a little better than random choice in the long run. In contrast, networks combining strong and weak links, whereby the latter type of links transmit information only slowly, can achieve much higher long-run average payoffs. The best social networks are those that combine a large fraction of agents into a strongly-connected component, while still maintaining a sufficient number of smaller communities that make diverse choices and communicate with this component via weak links.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。