arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2105.00682cs.NE
收藏

面向多容器质量差异算法的包络特征提取

Ensemble Feature Extraction for Multi-Container Quality-Diversity Algorithms

Leo Cazenille

摘要:

质量多样性算法搜索大量不同的高性能解决方案,而不是像典型的优化方法那样只搜索单个解决方案。它们特别适用于可以以多种不同方式解决的多模态问题,例如复杂的强化学习或机器人任务。然而,这些方法是高度依赖于选择的特征描述符(FD)量化的解决方案的行为的相似性。虽然FD通常需要手工设计,但最近的研究已经提出了通过使用特征提取技术(如PCA或自动编码器)自动定义FD的方法,以从先前探索的解决方案中学习问题的表示。在这里,我们将这些方法扩展到更复杂的问题,这些问题不能只依靠单一的表示进行有效的探索,而是需要一组不同的和互补的表示。我们描述了MC-AURORA,质量多样性的方法,同时优化几个集合的解决方案,每个具有不同的FD,这反过来,自动定义的一个合奏的模块化自动编码器。我们表明,这种方法产生的解决方案比单一代表方法产生的解决方案更多样化。

英文摘要:

Quality-Diversity algorithms search for large collections of diverse and high-performing solutions, rather than just for a single solution like typical optimisation methods. They are specially adapted for multi-modal problems that can be solved in many different ways, such as complex reinforcement learning or robotics tasks. However, these approaches are highly dependent on the choice of feature descriptors (FDs) quantifying the similarity in behaviour of the solutions. While FDs usually needs to be hand-designed, recent studies have proposed ways to define them automatically by using feature extraction techniques, such as PCA or Auto-Encoders, to learn a representation of the problem from previously explored solutions. Here, we extend these approaches to more complex problems which cannot be efficiently explored by relying only on a single representation but require instead a set of diverse and complementary representations. We describe MC-AURORA, a Quality-Diversity approach that optimises simultaneously several collections of solutions, each with a different set of FDs, which are, in turn, defined automatically by an ensemble of modular auto-encoders. We show that this approach produces solutions that are more diverse than those produced by single-representation approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑