arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.20139cs.DB
收藏

轨迹中现有异常检测与清理工具的实验研究

An experimental study of existing tools for outlier detection and cleaning in trajectories

Ain Shams University(艾因夏姆斯大学)

Mariana M Garcez Duarte, Mahmoud Sakr

AI总结:

本文通过实验评估了十种开源库在轨迹中异常检测与清理的性能,分类了五种主流算法,并为用户选择合适工具提供了指导。

摘要:

异常检测和清理是数据预处理中的关键步骤,以确保数据分析的完整性和有效性。本文专注于单条轨迹中的异常点,即在单条轨迹内部显著偏离的点。我们使用十种开源库对现有工具进行了全面评估,比较了它们在识别和清理异常点的效率和准确性。本实验考虑了库在实际应用中的可用性。我们比较了现有的异常检测库,介绍了一种建立真实情况的方法,并旨在指导用户选择最适合其异常检测需求的工具。此外,我们调查了最新算法,并将它们分为五种类型:基于统计的方法、滑动窗口算法、基于聚类的方法、基于图的方法和基于启发式的方法。我们的研究提供了这些库性能的见解,并促进了数据预处理和异常检测方法的发展。

英文摘要:

Outlier detection and cleaning are essential steps in data preprocessing to ensure the integrity and validity of data analyses. This paper focuses on outlier points within individual trajectories, i.e., points that deviate significantly inside a single trajectory. We experiment with ten open-source libraries to comprehensively evaluate available tools, comparing their efficiency and accuracy in identifying and cleaning outliers. This experiment considers the libraries as they are offered to end users, with real-world applicability. We compare existing outlier detection libraries, introduce a method for establishing ground-truth, and aim to guide users in choosing the most appropriate tool for their specific outlier detection needs. Furthermore, we survey the state-of-the-art algorithms for outlier detection and classify them into five types: Statistic-based methods, Sliding window algorithms, Clustering-based methods, Graph-based methods, and Heuristic-based methods. Our research provides insights into these libraries' performance and contributes to developing data preprocessing and outlier detection methodologies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑