arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2102.03588cs.AIcs.MA
收藏

基于强化学习策略和自适应策略切换机制的自主协商Agent框架

An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

NEC Corporation(日本电气股份有限公司)

Ayan Sengupta, Yasser Mohammad, Shinji Nakadai

摘要:

尽管文献中有大量的谈判策略,但自动谈判的复杂性使得单个策略在不同的谈判场景中无法占主导地位。为了克服这一点,一种方法是使用混合专家模型,但同时,这种方法的一个问题是专家的选择,因为这种方法受到所选择的专家的能力的限制。大多数谈判策略的另一个问题是它们不能适应对手在单个谈判会话中的行为的动态变化,从而导致性能不佳。这项工作侧重于两个,解决专家选择和适应对手的行为与我们的自主谈判代理框架的问题。该框架允许对手的行为的实时分类,并提供了一种机制,选择,切换或组合策略在一个单一的谈判会话。此外,我们的框架有一个审查员组件,使自我增强的能力,决定包括新的战略或更换旧的更好的战略定期。我们通过使用基于深度学习的对手分类器实现基于最大熵强化学习的策略来演示我们的框架的实例。最后,我们评估我们的代理对国家的最先进的谈判者在不同的谈判场景下的性能。

英文摘要:

Despite abundant negotiation strategies in literature, the complexity of automated negotiation forbids a single strategy from being dominant against all others in different negotiation scenarios. To overcome this, one approach is to use mixture of experts, but at the same time, one problem of this method is the selection of experts, as this approach is limited by the competency of the experts selected. Another problem with most negotiation strategies is their incapability of adapting to dynamic variation of the opponent's behaviour within a single negotiation session resulting in poor performance. This work focuses on both, solving the problem of expert selection and adapting to the opponent's behaviour with our Autonomous Negotiating Agent Framework. This framework allows real-time classification of opponent's behaviour and provides a mechanism to select, switch or combine strategies within a single negotiation session. Additionally, our framework has a reviewer component which enables self-enhancement capability by deciding to include new strategies or replace old ones with better strategies periodically. We demonstrate an instance of our framework by implementing maximum entropy reinforcement learning based strategies with a deep learning based opponent classifier. Finally, we evaluate the performance of our agent against state-of-the-art negotiators under varied negotiation scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑