Log data are generated from logging statements in the source code, providing insights into the execution processes of software applications and systems. State-of-the-art log-based anomaly detection approaches typically leverage deep learning models to capture the semantic or sequential information in the log data and detect anomalous runtime behaviors. However, the impacts of these different types of information are not clear. In addition, most existing approaches ignore the timestamps in log data, which can potentially provide fine-grained sequential and temporal information. In this work, we propose a configurable Transformer-based anomaly detection model that can capture the semantic, sequential, and temporal information in the log data and allows us to configure the different types of information as the model's features. Additionally, we train and evaluate the proposed model using log sequences of different lengths, thus overcoming the constraint of existing methods that rely on fixed-length or time-windowed log sequences as inputs. With the proposed model, we conduct a series of experiments with different combinations of input features to evaluate the roles of different types of information in anomaly detection. The model can attain competitive and consistently stable performance compared to the baselines when presented with log sequences of varying lengths. The results indicate that the event occurrence information plays a key role in identifying anomalies, while the impact of the sequential and temporal information is not significant for anomaly detection on the studied public datasets. On the other hand, the findings also reveal the simplicity of the studied public datasets and highlight the importance of constructing new datasets that contain different types of anomalies to better evaluate the performance of anomaly detection models.
Modelling and Simulation of Neuromorphic Datasets for Anomaly Detection in Computer Vision
Bio-Inspired Systems and Technologies Lab, University of York(约克大学生物启发系统与技术实验室);Faculty of Natural Sciences, University of Stirling(斯特林大学自然科学学院);School of Computer Science and Informatics, Cardiff University(卡迪夫大学计算机科学与信息学院);School of Electrical and Electronic Engineering, University of Manchester(曼彻斯特大学电子与电气工程学院);Electronics and Computer Science, University of Southampton(南安普顿大学电子与计算机科学)
LEAD1.0: A Large-scale Annotated Dataset for Energy Anomaly Detection in Commercial Buildings
Singapore Management University(新加坡管理大学)
现代建筑物密集地配备了智能电表,这些电表定期生成大量的时间序列数据,每天产生数百万个数据点。这些数据可用于发现底层负载、推断其能源消耗模式、环境因素的相互依赖性以及建筑物的运营属性。此外,它使我们能够同时识别电力消耗曲线中存在的异常情况,这是朝着节约能源和实现全球可持续发展迈出的一大步。然而,到目前为止,缺乏大规模的标注能耗数据集阻碍了正在进行的异常检测研究。我们通过发布一个公开的ASHRAE Great Energy Predictor III数据集的注释版本来促进这一努力,该数据集包含跨越一年的1,413个智能电表时间序列。此外,我们在我们的数据集上对八种最先进的异常检测方法的性能进行了基准测试,并比较了它们的性能。
Fast Wireless Sensor Anomaly Detection based on Data Stream in Edge Computing Enabled Smart Greenhouse
Qufu Normal University(曲阜师范大学);Weifang University of Science and Technology(潍坊科技学院);Nanjing University of Science and Technology(南京理工大学);Shandong First Medical University (Shandong Academy Of Medical Sciences)(山东第一医科大学(山东省医学科学院))
Why Ranking Anomaly Detection Algorithms Isn't as Reliable as You May Think
Carnegie Mellon University(卡内基梅隆大学);TU Dortmund University(多特蒙德工业大学);Lamarr Institute for Machine Learning and Artificial Intelligence(拉马尔机器学习与人工智能研究所);iits Consulting GmbH(iits咨询有限公司);Fraunhofer Institute for Material Flow and Logistics IML(弗劳恩霍夫物流与材料流动研究所IML)
CCAD: Compressed Global Feature Conditioned Anomaly Detection
Columbia University(哥伦比亚大学);Ping An Property & Casualty Insurance Company(平安财产保险股份有限公司);University of Michigan(密歇根大学);University of California at Berkeley(加州大学伯克利分校);Stevens Institute of Technology(史蒂文斯理工学院);VisionX LLC.(VisionX有限责任公司)
Quantum-Inspired Tensor Network Autoencoders for Anomaly Detection: A MERA-Based Approach
Department of Physics, Sinop University(锡诺普大学物理系);Institute for Quantum Materials and Technologies, Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院量子材料与技术研究所)
From Pixels to Graphs: Deep Graph-Level Anomaly Detection on Dermoscopic Images
Department of Computer Science, TU Dortmund University, Germany(图腾大学计算机科学系);Research Center Trustworthy Data Science and Security, University Alliance Ruhr (UA Ruhr), Germany(可信数据科学与安全研究所以及鲁尔大学联盟(UA Ruhr))
Exploring the Universe with SNAD: Anomaly Detection in Astronomy
Space Research Institute of the Russian Academy of Sciences(俄罗斯科学院空间研究所);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Center for AstroPhysical Surveys(天体物理巡天中心);National Center for Supercomputing Applications(国家超级计算应用中心);Lomonosov Moscow State University(罗蒙诺索夫莫斯科国立大学);Université Clermont Auvergne(克莱蒙奥弗涅大学);CNRS/IN2P3(法国国家科学研究中心/核物理与粒子物理研究所);Sternberg Astronomical Institute(斯特恩伯格天文研究所);National Research University Higher School of Economics(国立研究型大学高等经济学院)
本文综述国际项目 SNAD 如何结合主动学习等机器学习方法,在大规模天文巡天中检测异常,推动天文现象发现分类及机器学习在天体物理中的应用。