Anomaly Detection in Data with Extremely High Dimensional Space via Online Oversampling Principal Component Analysis
Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2014, Vol 16, Issue 3
Abstract
Abstract: Anomaly detection is a crucial analysis topic in the field of data mining as well as machine learning. Several real-world applications like Intrusion or MasterCard fraud detection need a good and efficient framework to spot deviated data instances. A good anomaly detection methodology must be able to accurately establish many varieties of anomalies, robust, need comparatively very little resources, and perform detection in period of time. In this paper we proposed the idea of combining the two different algorithms i.e. Median Based Outlier Detection and Online Oversampling PCA for effective detection of anomaly in online updating mode. Median Based outlier detection uses the interquartile range which is a measure of statistical dispersion being equal to the difference between the upper and lower quartiles. Whereas oversampling PCA does not need to store the entire covariance matrix or data matrix and thus this approach is a more useful in online or large scale problem. Compared with other anomaly detection algorithm our experimental result verifies the feasibility of our proposed method.
Authors and Affiliations
Swapnil S. Raut , Sachin N. Deshmukh
Keywords
Related Articles
- EP ID EP88649
- DOI 10.9790/0661-16376773
- Views 116
- Downloads 0
Distributed Computing Challenges
Abstract: In recent years, distributed computing systems has been widely explored in order to improve system performance in terms of scalability and reliability.A distributed computing system allows the user to sha...
A Reflective Swarm Intelligence Algorithm
Swarm Intelligence (SI) algorithms are heuristics for finding the optimal solutions of optimization problems. They are made up of groups of swarms that interact with one another in the search effort within their...
Security based Clock Synchronization technique in WirelessSensor Network for Event Driven Measurement Applications
Abstract: In this paper, secure based novel clock synchronization in wireless sensor network for event drivenmeasurement application is proposed with security. The main objectives are 1) To provide high accuracy in thear...
Port Site Tuberculous Infection a Case Report and Review of Literature
As the surgeries done by laparoscopy are increasing, associated complications are also increasing. One among them is port site infection especially port site infections due to Atypical Mycobacteriae .There is a con...
A Exploratory Review on Soft Computing SegmentationTechniques
Abstract: Segmentation is a process to divides the images into its regions or objects that have similar featuresor characteristics. Segmentation has no single standard procedure and it is very difficult in non-trivial im...