Highly Available Hadoop Name Node Architecture-Using Replicas of Name Node with Time Synchronization among Replicas
Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2014, Vol 16, Issue 3
Abstract
Abstract : Hadoop is a Java software framework that supports data - intensive distributed applications and is developed under open source license. It enables applications to work with thousands of nodes and petabytes of data. The two major pieces of Hadoop are HDFS and MapReduce. HDFS works with two types of hardware machines, the DataNode (Slave machine) which is the machine on which application’s data is stored and the NameNode (Master machine) which store the metadata of file system. Where NameNode is the only single machine for storing metadata of file system and is the Single Point of Failure (SPOF) for the HDFS. SPOF of NameNode machine affects the overall availability of Hadoop. When NameNode goes down the entire system become offine and cannot do any operation until NameNode gets restart. If the NameNode machine fails, the system needs to be re-started manually, making the system less available. This paper proposes a highly available architecture and its working principle for the HDFS NameNode against its SPOF utilizing well-known 2-Phase Commit (2PC) Protocol and election by bully with Time synchronization mechanism.
Authors and Affiliations
Soubhagya V N , Nikhila T Bhuvan
Keywords
Related Articles
- EP ID EP99757
- DOI 10.9790/0661-16325862
- Views 129
- Downloads 0
Congestion Control Technique for Wireless Networks
Congestion control in wireless networks has been extensively investigated over the years and several schemes and techniques have been developed, all with the aim of improving performance in wireless net-work. With the...
DWT and P C a Based Image Enhancement with local Neighborhood filter Mask
In this letter, a new satellite image contrast enhance- ment technique based on the discrete wavelet transform (DWT) and singular value decomposition has been proposed. The tech- nique decomposes the input ima...
Challenges and Issues of Cluster Based Security in MANET
Abstract: Mobile ad-hoc networks are a specific kind of wireless networks that can be quickly deployed without pre- existing infrastructures. Even though there are various studies on cluster based security in MANET but t...
Web-Based System for Software Requirements Quality Analysis Using Case-Based Reasoning and Neural Network
The overall success of a software project depends on the quality of its software requirements specifications (SRS). Hence, it is very important to get the requirements correct from the onset of the project. This...
Adaptive Digital Filter Design for Linear Noise Cancellation Using Neural Networks
Abstract: Noise is the most serious issue in the filters and adaptive filters are subjected to this unwanted component. This paper deals with the problem of the adaptive noise and various adaptive algorithms functions wh...