arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1407.4364cs.AI
收藏

一步或两步优化与过拟合现象--以时间序列分类为例

One-Step or Two-Step Optimization and the Overfitting Phenomenon: A Case Study on Time Series Classification

The University of Tromsø - The Arctic University of Norway(特罗姆瑟大学 - 挪威北极大学)

Muhammad Marwan Muhammad Fuad

摘要:

在过去的几十年里,优化一直在快速发展。生物启发优化算法是受自然启发的元算法。这些算法已被应用于解决工程、经济和其他领域的不同问题。生物启发算法也被应用于信息技术的不同分支,如网络和软件工程。时间序列数据采掘是信息技术的一个领域,也有它的这些应用份额。在以前的工作中,我们展示了如何生物启发算法,如遗传算法和差分进化可以用来找到时间序列表示的符号聚集近似中使用的断点的位置,在另一项工作中,我们展示了如何利用粒子群优化,著名的生物启发算法之一,以设置符号聚集近似表示中的不同段的权重。在本文中,我们提出了,在两种不同的方法,一个新的Meta优化过程中,产生的断点的最佳位置,除了最佳的片段的权重。我们进行的时间序列分类任务的实验显示了一个有趣的例子,如何过拟合现象,一个经常遇到的问题,在数据采掘时发生的模型过拟合的训练集,可以干扰优化过程,隐藏优化算法的优越性能。

英文摘要:

For the last few decades, optimization has been developing at a fast rate. Bio-inspired optimization algorithms are metaheuristics inspired by nature. These algorithms have been applied to solve different problems in engineering, economics, and other domains. Bio-inspired algorithms have also been applied in different branches of information technology such as networking and software engineering. Time series data mining is a field of information technology that has its share of these applications too. In previous works we showed how bio-inspired algorithms such as the genetic algorithms and differential evolution can be used to find the locations of the breakpoints used in the symbolic aggregate approximation of time series representation, and in another work we showed how we can utilize the particle swarm optimization, one of the famous bio-inspired algorithms, to set weights to the different segments in the symbolic aggregate approximation representation. In this paper we present, in two different approaches, a new meta optimization process that produces optimal locations of the breakpoints in addition to optimal weights of the segments. The experiments of time series classification task that we conducted show an interesting example of how the overfitting phenomenon, a frequently encountered problem in data mining which happens when the model overfits the training set, can interfere in the optimization process and hide the superior performance of an optimization algorithm.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑