Hadoop Map Reduce Job Scheduler Implementation and Analysis in Heterogeneous Environment
Journal Title: International Journal of Research in Computer and Communication Technology - Year 2015, Vol 4, Issue 3
Abstract
Hadoop MapReduce is one of the popular framework for BigData analytics. MapReduce cluster is shared among multiple users with heterogeneous workloads. When jobs are concurrently submitted to the cluster, resources are shared among them so system performance might be degrades. The issue here is that schedule the tasks and provide the fairness of resources to all jobs. Hadoop supports different schedulers than the default FIFO scheduler We started experiment on Hadoop FIFO, Fair and Capacity scheduler with heterogeneous workloads. Our aim is to compare the different job scheduler with heterogeneous workload and it is important to understand the task scheduler parameter, based on that we considered few parameter for the performance analysis.
Authors and Affiliations
Swathi Prabhu, Anisha P Rodrigues
Keywords
Related Articles
- EP ID EP28171
- DOI -
- Views 247
- Downloads 2
Verification of Metadata by Encryption for Data Storage Security in Cloud
Cloud Computing provides the way to share distributed resources and services that belong to different organizations or sites. Since Cloud Computing share distributed resources via network in the open environment thus...
Load Shedding in Mobile Systems with MobiQual
In location-based, mobile continual query (CQ) systems, two key measures of quality-of-service (QoS) are: freshness and accuracy. To achieve freshness, the CQ server must perform frequent query reevaluations. To atta...
Transforming Digital Unstructured and Semi-structured Data into Structured Data with the Aid of IE and KDT
Data growth has seen an exponential acceleration with the advent of computer and network, which have imparted the digital form to data. Data can be classified into three categories: Unstructured data, Semi-structured...
Real-Time Face Detection System for Virtual Classroom Environment
In today’s fast paced world where human computer interaction systems are working towards becoming more user-friendly. Face detection has become an integral part of many of these systems. It also has varying range of...
Survey on Suspicious URL Detection Schemes in Twitter Stream
Twitter is a micro-blogging and online social networking service that enables its users to send and read "tweets”. Tweets are text messages limited to 140 characters. Twitter is prone to a lot of malicious tweets whi...