Mobile Agent Based MapReduce Framework for Big Data Processing
Journal Title: International journal of Emerging Trends in Science and Technology - Year 2015, Vol 2, Issue 1
Abstract
Distributed computing accomplished broad appropriation because of consequently parallelizing and transparently executing tasks in distributed environments. Straggling tasks is an essential test confronted by all Big Data Processing Frameworks, for example, Mapreduce[3], Dryad[4], Spark[5] . Stragglers are the assignments that run much slower than different tasks and since a job completes just when it’s last undertaking completions, stragglers postponement work fruition. The literature reviews stragglers recognition and rescheduling systems proposed so far and brings up their strengths and shortcomings. This thesis additionally displays wise attributes and impediments of the existing state- ofthe- craftsmanship calculations to take care of the issue of stragglers relief. This thesis presents a systematic and organized study of community detection techniques. The literature survey shows that most of the algorithms fail to efficiently reschedule the stragglers. Innocently one may anticipate that straggler taking care of will be a simple assignment, doubling tasks that are sufficiently slower. Actually it is a complex issue for a few reasons. In the first place, Speculative assignments are not free they seek certain assets, for example, system with other running tasks. Second, picking the node to run speculative task on is as significant as picking the task. Third, in Heterogeneous environment it may be challenging to recognize nods that are marginally slower than the mean and stragglers. At long last, Stragglers ought to be recognized as right on time as could reasonably be expected. The proposed framework uses mobile agent approach for rescheduling because the agent can start the execution at the other place from the very same place they left in the earlier machine. The implementation and results shows the proposed work is efficient and improves the overall performance of a big data processing framework
Authors and Affiliations
Sonu Yadav
Keywords
Related Articles
- EP ID EP221533
- DOI -
- Views 88
- Downloads 0
Wrapper Approach for IDS Using Fuzzy Genetic Algorithm
The intrusion detection systems (IDS) are becoming indispensable for effective protection against attacks that are constantly changing in magnitude and complexity. This paper proposes a fuzzy genetic algorithm (FGA) for...
Noble Metal Functionalized MoO3: NiO Nanocomposite for Fabrication of CO2Gas Sensor
Over the past few years, considerable interest has been focused on semiconducting nanoparticles due to their potential applications in diverse fields including catalysis, magnetic...
Investigating the Adoption and Integration of ICT in the Teaching and Learning of Mathematics
This paper investigates the perceptions of undergraduate and postgraduate in-service teachers towards adoption and integration of ICT in the teaching and learning of mathematics in Zimbabwe’s schools. A total of 43 parti...
A Yoruba Cultural Tradition Repository Knowledge Based System
In recent years researchers and experts have traditionally focused on how to enhance the look and functionality of how life issues are been tackled with respect to Africa cultural tradition for academic purposes and the...
Varietal susceptibility and effect of antibiotics on little leaf Phytoplasma of brinjal (Solanummelongena L)
Among the vegetable crops grown in India, brinjal or egg plant (Solanummelongena L is quite popular. The crop is highly susceptible to several viruses and phytoplasma (The Wealth of India 1972) . Out of various pathogens...