Mobile Agent Based MapReduce Framework for Big Data Processing
Journal Title: International journal of Emerging Trends in Science and Technology - Year 2015, Vol 2, Issue 1
Abstract
Distributed computing accomplished broad appropriation because of consequently parallelizing and transparently executing tasks in distributed environments. Straggling tasks is an essential test confronted by all Big Data Processing Frameworks, for example, Mapreduce[3], Dryad[4], Spark[5] . Stragglers are the assignments that run much slower than different tasks and since a job completes just when it’s last undertaking completions, stragglers postponement work fruition. The literature reviews stragglers recognition and rescheduling systems proposed so far and brings up their strengths and shortcomings. This thesis additionally displays wise attributes and impediments of the existing state- ofthe- craftsmanship calculations to take care of the issue of stragglers relief. This thesis presents a systematic and organized study of community detection techniques. The literature survey shows that most of the algorithms fail to efficiently reschedule the stragglers. Innocently one may anticipate that straggler taking care of will be a simple assignment, doubling tasks that are sufficiently slower. Actually it is a complex issue for a few reasons. In the first place, Speculative assignments are not free they seek certain assets, for example, system with other running tasks. Second, picking the node to run speculative task on is as significant as picking the task. Third, in Heterogeneous environment it may be challenging to recognize nods that are marginally slower than the mean and stragglers. At long last, Stragglers ought to be recognized as right on time as could reasonably be expected. The proposed framework uses mobile agent approach for rescheduling because the agent can start the execution at the other place from the very same place they left in the earlier machine. The implementation and results shows the proposed work is efficient and improves the overall performance of a big data processing framework
Authors and Affiliations
Sonu Yadav
Keywords
Related Articles
- EP ID EP221533
- DOI -
- Views 80
- Downloads 0
Improving Cluster-Based Certificate Revocation and Integral Component CCRVC Scheme for Authentication in Mobile Adhoc Network
Certificate revocation is a crucial integral element to secure network communications. During this paper, we tend to specialize in the problem of certificate revocation to isolate attackers from any collaborating in netw...
Combined Algorithm For Minimize the Blocking Probability of Real Time and Non-Real Time Services in Handoff
This algorithm is used to minimize the blocking probability and increase the services. Handoff is very important concern in communication. It is related with the mobile phone. When a mobile user travels from one area of...
Behavior of Steel Fiber Reinforced Concrete for M-25 Grade
It is now well established that one of the important properties of steel fibre reinforced concrete (SFRC) is its superior resistance to cracking and crack propagation. As a result of this ability to arrest cracks, fibre...
Treatment of Galvanized Waste Water by Membrane Distillation with Natural Adsorbent: A Review
Wastewater containing high concentrations of metal ions can be harmful to aquatic life and degrade the water quality. The metal ions are removed by Adsorption and Membrane distillation process. However, these methods are...
Screening of Phytochemical and In Vitro Antioxidant Efficacy of Vitex negundo L. leaf Extract
Objective: The present study was carried out to evaluate the qualitative and quantitative phytochemical and In vitro antioxidant activities of methanolic leaf extract of vitex negundo. Materials and Methods: Vitex negund...