Anomaly Detection: A Survey
Lecture notes in networks and systemsPublished 26 October 2021
Tahani Hussein Abu Musa, Abdelaziz Bouras
Citations1,017
SJR quartileQ4
SJR score0.17
SNIP0.23
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Anomaly detection (AD) is considered one of the important research areas that have a diverse range of application domains. Some of the anomaly detection techniques presented in the literature were specifically implemented for certain domains, whereas others were more generic. In this paper, we aim at providing a structured yet extensive overview of current research directions on anomaly detection, including the definition of anomalies and their types, current anomaly detection modes, the output of anomaly detection techniques, and an overview of those techniques presented in the literature, in order to provide a guide when selecting the appropriate approach for certain application domains. 2022, The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
Keywords
Computer Science
CirculationPhysioBank, PhysioToolkit, and PhysioNet
14,525 Citations2000Ary L. Goldberger, Luı́s A. Nunes Amaral +8 more
ACM Computing SurveysAnomaly detection
11,146 Citations2009Varun Chandola, Arindam Banerjee +1 more
This survey tries to provide a structured and comprehensive overview of the research on anomaly detection by grouping existing techniques into different categories based on the underlying approach adopted by each technique.
Introduction to Data Mining
7,026 Citations2008
Neural ComputationEstimating the Support of a High-Dimensional Distribution
5,946 Citations2001Bernhard Schölkopf, John Platt +3 more
The algorithm is a natural extension of the support vector algorithm to the case of unlabeled data by carrying out sequential optimization over pairs of input patterns and providing a theoretical analysis of the statistical performance of the algorithm.
TechnometricsProcedures for Detecting Outlying Observations in Samples
3,730 Citations1969Frank E. Grubbs
neural information processing systemsHandwritten Digit Recognition with a Back-Propagation Network
3,637 Citations1989Yann LeCun, Bernhard E. Boser +5 more
Minimal preprocessing of the data was required, but architecture of the network was highly constrained and specifically designed for the task, and has 1% error rate and about a 9% reject rate on zipcode digits provided by the U.S. Postal Service.
Computers & SecurityAnomaly-based network intrusion detection: Techniques, systems and challenges
2,008 Citations2008Pedro García‐Teodoro, Jesús E. Dı́az-Verdejo +2 more
The main challenges to be dealt with for the wide scale deployment of anomaly-based intrusion detectors, with special emphasis on assessment issues are outlined.
PLoS ONEA Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data
941 Citations2016Markus Goldstein, Seiichi Uchida
This paper aims to be a new well-funded basis for unsupervised anomaly detection research by publishing the source code and the datasets, and reveals the strengths and weaknesses of the different approaches for the first time.
Columbia Academic Commons (Columbia University)Intrusion detection with unlabeled data using clustering
756 Citations2000Leonid Portnoy
ACM SIGKDD Explorations NewsletterMinority report in fraud detection
448 Citations2004Clifton Phua, Damminda Alahakoon +1 more
This paper compares the new fraud detection method (meta-learning approach) against C4.5 trained using undersampling, oversamplings, and SMOTEing without partitioning, and shows that, given a fixed decision threshold and cost matrix, the partitioning and multiple algorithms approach achieves marginally higher cost savings than varying the entire training data set with different class distributions.
Credit card fraud detection with a neural-network
416 Citations1994Ghosh, Reilly
Using data from a credit card issuer, a neural network based fraud detection system was trained on a large sample of labelled credit card account transactions and tested on a holdout data set that consisted of all account activity over a subsequent two-month period of time.
Learning object motion patterns for anomaly detection and improved object detection
378 Citations2008Arslan Basharat, Alexei Gritai +1 more
The proposed method provides a new higher-level layer to the traditional surveillance pipeline for anomalous event detection and scene model feedback and successfully used the proposed scene model to detect local as well as global anomalies in object tracks.
Incremental Local Outlier Detection for Data Streams
375 Citations2007Dragoljub Pokrajac, Aleksandar Lazarević +1 more
The paper provides theoretical evidence that insertion of a new data point as well as deletion of an old data point influence only limited number of their closest neighbors and thus the number of updates per such insertion/deletion does not depend on the total number of points in the data set.
Neighborhood Formation and Anomaly Detection in Bipartite Graphs
317 Citations2006Jimeng Sun, Huiming Qu +2 more
This work introduces two operations on bipartite graphs: identifying similar nodes (Neighborhood formation), and finding abnormal nodes (Anomaly detection), and proposes algorithms to compute the neighborhood for each node using random walk with restarts and graph partitioning.
Knowledge and Information SystemsAutomatic outlier detection for time series: an application to sensor data
230 Citations2006Sabyasachi Basu, Martin Meckesheimer
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE<title>Outlier detection and motion segmentation</title>
209 Citations1993Philip H. S. Torr, David W. Murray
A new method for solving the problem of motion segmentation, identifying the objects within an image moving independently of the background by utilizing the fact that two views of a static 3D point set are linked by a 3 X 3 Fundamental Matrix (F).
Approximations to Magic: Finding Unusual Medical Time Series
135 Citations2005Jessica Lin, Eamonn Keogh +2 more
A simple algorithm is shown that is 3 to 4 orders of magnitude faster than brute force in finding time series discords, while guaranteed to produce identical results.
Detection, synthesis and compression in mammographic image analysis with a hierarchical image probability model
102 Citations2002Clay D. Spence, Lucas C. Parra +1 more
A probability model over image spaces that employs a pyramid representation to factor images across scale and a tree-structured set of hidden variables to capture long-range spatial dependencies and is a hierarchical mixture of conditional probabilities, similar to a hidden Markov model on a tree.
Anomaly Detection Model Over Blockchain Electronic Transactions
96 Citations2019Sirine Sayadi, Sonia Ben Rejeb +1 more
This work proposes a new model for anomaly detection over bitcoin electronic transactions using the One Class Support Vector Machines (OCSVM) algorithm to detect outliers and the K-Means algorithm in order to group the similar outliers with the same type of anomalies.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIEResampling approach for anomaly detection in multispectral images
74 Citations2003James Theiler, D. Michael Cai
This work proposes a novel approach for identifying the "most unusual" samples in a data set, based on a resampling of data attributes, which produces a "background class" and then binary classification is used to distinguish the original training set from the background.
Analytical SciencesSimultaneous Wavelength Selection and Outlier Detection in Multivariate Regression of Near-Infrared Spectra
65 Citations2005Da Chen, Xueguang Shao +2 more
A new algorithm is presented for simultaneous wavelength selection and outlier detection in NIR spectrometry and it is indicated that the combination of CWT and mIPOW-PLS produces robust and parsimonious regression models with very few wavelengths.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIELong-term stability of normal condition data for novelty detection
31 Citations2000G. Manson, Gareth Pierce +4 more
Robust clustering of acoustic emission signals using the Kohonen network
26 Citations2002Vahid Emamian, M. Kaveh +1 more
The clustering results confirm the capability of the Kohonen network for reliable source identification of acoustic emission signals, assuming enough care has been taken in implementing the training algorithm of the network.
Lecture notes in computer scienceMining Class Outliers: Concepts, Algorithms and Applications
19 Citations2004Zengyou He, Joshua Zhexue Huang +2 more
The method can find interesting outliers and can be used in practice, and its potential applications in CRM (customer relationship management) are discussed.
Enhancing Trust of Supply Chain Using Blockchain Platform with Robust Data Model and Verification Mechanisms
10 Citations2019Byungsoo Oh, Tae Joon Jun +4 more
This paper proposes a novel distributed ledger system for supply chain, enabled by anomaly detection framework that verifies semantic correctness of transactions based on business context data and evaluates the correctness and effectiveness of the system with scenario-based simulations.