New Framework for Improving Big Data Analysis Using Mobile Agent
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2014, Vol 5, Issue 3
Abstract
The rising number of applications serving millions of users and dealing with terabytes of data need to a faster processing paradigms. Recently, there is growing enthusiasm for the notion of big data analysis. Big data analysis becomes a very important aspect for growth productivity, reliability and quality of services (QoS). Processing of big data using a powerful machine is not efficient solution. So, companies focused on using Hadoop software for big data analysis. This is because Hadoop designed to support parallel and distributed data processing. Hadoop provides a distributed file processing system that stores and processes a large scale of data. It enables a fault tolerant by replicating data on three or more machines to avoid data loss.Hadoop is based on client server model and used single master machine called NameNode. However, Hadoop has several drawbacks affecting on its performance and reliability against big data analysis. In this paper, a new framework is proposed to improve big data analysis and overcome specified drawbacks of Hadoop. These drawbacks are replication tasks, Centralized node and nodes failure. The proposed framework is called MapReduce Agent Mobility (MRAM). MRAM is developed by using mobile agent and MapReduce paradigm under Java Agent Development Framework (JADE).
Authors and Affiliations
Youssef ESSA, Gamal ATTIYA, Ayman EL-SAYED
Keywords
Related Articles
- EP ID EP115788
- DOI 10.14569/IJACSA.2014.050303
- Views 109
- Downloads 0
PSO-based Optimized Canny Technique for Efficient Boundary Detection in Tamil Sign Language Digital Images
For the hearing impaired, sign language is the most prevailing means of communication for their day-to-day life. It is always a challenge to develop an optimized automated system to recognize and interpret the implicatio...
Design and Implementation for Multi-Level Cell Flash Memory Storage Systems
The flash memory management functions of write coalescing, space management, logical-to-physical mapping, wear leveling, and garbage collection require significant on-going computation and data movement. MLC flash memory...
Software Abstractions for Large-Scale Deep Learning Models in Big Data Analytics
The goal of big data analytics is to analyze datasets with a higher amount of volume, velocity, and variety for large-scale business intelligence problems. These workloads are normally processed with the distribution on...
Detection and Identification System of Bacteria and Bacterial Endotoxin Based on Raman Spectroscopy
Sepsis is a global health problem that causes risk of death. In the developing world, about 60 to 80 % of death cases are caused by Sepsis. Rapid methods for detecting its causes, represent one of the major factors that...
A Study on Cross Layer MAC design for performance optimization of routing protocols in MANETs
One of the most visible trends in today’s commercial communication market is the adoption of wireless technology. Wireless networks are expected to carry traffic that will be a mix of real time traffic such as voice, mul...