Intrusion Detection System using Apache Spark Analytic System

Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2019, Vol 21, Issue 1

Abstract

In this study, an Intrusion Detection System (IDS) is proposed based on the use of machine learning and distributed computing. The proposed system uses classification techniques that are implemented in the built-in machine learning library in Apache Spark distributed computing framework. As the use of distributed computing allows the proposed method to provide rapid predictions for the packets flowing in the network, two classifiers are cascaded in order to combine their decisions for more accurate decisions. The Multi-Layer Perceptron (MLP) classifier is used as a binary classifier, where the output of this classifier only indicates whether the packet is a normal or attack packet. Packets predicted to be normal by this classifier are allowed through the network. However, packets predicted as attacks are classified again using the random forest classifier, which provides the state of the packet and the type of the attack as its output. If the packet is classified as a normal packet, it is also allowed to the network, otherwise it is filtered out. The results show that he proposed methodology has been able to improve the performance of IDS to 99.12%, which outperforms the state-of-the-art systems in the literature.

Authors and Affiliations

Asst. Prof. Dr. Sefer KURNAZ

Keywords

Related Articles

 Preventing Web-Proxy Based DDoS using Request SequenceFrequency

 Abstract: In order to control the request flow in Computer Networks, a proxy server is used. Proxy Server is aserver which acts as an intermediary server between server and clients. The more adaptable and converted...

 Interference Aware & SINR Estimation in Femtocell Networks

 In wireless communication two main limitations are capacity and range. In the areas of high population density cellular service is far superior compared to scarcely populated areas. The initial cell...

 Passive Image Forensic Method to detect Copy Move Forgery in Digital Images

 Abstract: Tampering in digital images has become very easy due to the availability of advanced image editing softwares to the users. Images are being tampered in a very efficient manner without leaving any visual c...

 Efficient design of feedforward network for pattern classification

 A feedforward neural network is a computing device whose processing units (the nodes) are distributed in adjacent layers connected through unidirectional links (the weights).Feedforward networks are widely used...

 Grid Computing- An Emerging Technology that enables large-scale resource sharing

 Abstract: In the last few years there has been a rapid exponential increase in computer processing power, data storage and communication. But still there are many complex and computation intensive problems, which c...

Download PDF file
  • EP ID EP441069
  • DOI 10.9790/0661-2101013237.
  • Views 136
  • Downloads 0

How To Cite

Asst. Prof. Dr. Sefer KURNAZ (2019). Intrusion Detection System using Apache Spark Analytic System. IOSR Journals (IOSR Journal of Computer Engineering), 21(1), 32-37. https://europub.co.uk/articles/-A-441069