Novelty detection using extreme value statistics

IEE Proceedings - Vision Image and Signal ProcessingPublished 1 January 1999

Stephen Roberts

DOI10.1049/ip-vis:19990428

Citations192

TL;DR

It is shown that a more principled approach may be taken using extreme value statistics in the area of novelty detection, and points that lie outside of the range of expected extreme values may be flagged as outliers.

Abstract

Extreme value theory is a branch of statistics that concerns the distribution of data of unusually low or high value, i.e. in the tails of some distribution. These extremal points are important in many applications as they represent the outlying regions of normal events against which we may wish to define abnormal events. In the context of density modelling, novelty detection or radial-basis function systems, points that lie outside of the range of expected extreme values may be flagged as outliers. There has been interest in the area of novelty detection, but decisions as to whether a point is an outlier or not tend to be made on the basis of exceeding some (heuristic) threshold. It is shown that a more principled approach may be taken using extreme value statistics.

Keywords

MathematicsEconomics, Econometrics and Finance

Choice Reviews OnlineNeural networks for pattern recognition

18,687 Citations1994

This is the first comprehensive treatment of feed-forward neural networks from the perspective of statistical pattern recognition, and is designed as a text, with over 100 exercises, to benefit anyone involved in the fields of neural computation and pattern recognition.

AutomaticaModeling by shortest data description

5,944 Citations1978J. Rissanen

The number of digits it takes to write down an observed sequence x1,...,xN of a time series depends on the model with its parameters that one assumes to have generated the observed data.

Modelling Extremal Events

4,369 Citations1997Paul Embrechts, Claudia Klüppelberg +1 more

Columbia University Press eBooksStatistics of Extremes

3,896 Citations1958Emil Julius Gumbel

Novelty Detection and Neural Network Validation

439 Citations1993Chris Bishop

This paper provides a quantitative procedure for measuring novelty, and its performance is demonstrated using an application involving the monitoring of oil flow in multi-phase pipelines.

IEE Proceedings - Vision Image and Signal ProcessingNovelty detection and neural network validation

389 Citations1994Chris Bishop

Novelty detection for the identification of masses in mammograms

342 Citations1995Lionel Tarassenko

An alternative approach is explored in which a description of normality is attempted using the large number of available mammograms which do not show any evidence of mass-like structures to try and identify candidate masses in previously unseen images analysis and interpretation.

IEEE Transactions on Pattern Analysis and Machine IntelligenceBayesian approaches to Gaussian mixture modeling

319 Citations1998Stephen Roberts, Dirk Husmeier +2 more

A Bayesian-based methodology is presented which automatically penalizes overcomplex models being fitted to unknown data and is able to select an "optimal" number of components in the model and so partition data sets.

IEEE Transactions on Biomedical EngineeringStochastic complexity measures for physiological signal analysis

291 Citations1998Iead Rezek, Stephen Roberts

This paper takes a paradigm shift and investigates four stochastic-complexity features and their advantages are demonstrated on synthetic and physiological signals; the latter recorded during periods of Cheyne-Stokes respiration, anesthesia, sleep, and motor-cortex investigation.

Neural ComputationA Probabilistic Resource Allocating Network for Novelty Detection

186 Citations1994Stephen Roberts, Lionel Tarassenko

A robust method for novelty detection is developed, which aims to minimize the number of heuristically chosen thresholds in the novelty decision process by growing a gaussian mixture model to form a representation of a training set of normal system states.