Survey on Schedulers Optimization to Handle Multiple Jobs in Hadoop Cluster

Journal Title: UNKNOWN - Year 2015, Vol 4, Issue 3

Abstract

An apache Hadoop project is a good platform that supports cost-effective such as commodity hardware implementation, with scalable infrastructure called Hadoop Distributed File System HDFS with parallel processing mechanism called MapReduce. Hadoop is well known for Big Data analytics requires more resources for collecting; storing, processing petabytes of large data requires one meaningful resource management. Hadoop handles jobs in batch modes, allocating resources, scheduling to these modes is an important issue in terms of Network Bandwidth, CPU time and Memory. Resources handled by MapReduce schedulers assigning resources in the form of MapReduceTasks. The MapReduceTasks are carefully handled by MapReduce schedulers by setting some benchmarks for individual namely MapCombineReducer and different Block Sizes, which ensures schedulers are optimized to achieve maximum efficiency in storage capacity, time and cost for handling multiple batch jobs in multiple cluster while guaranteeing the effectiveness of individual scheduler in terms of job execution.

Authors and Affiliations

Keywords

Related Articles

Non Invasive Blood Glucose Measurement through Microwave Resonator

Non Invasive Blood Glucose Measurement through Microwave Resonator

Cloud-Based Mobile Multimedia to Design a Distributed Recommendation Cache

As we know that cloud is upcoming technology in the world. It provide several types of services for the user, one of them is Storage as a Service. Our project is related to the Saas services of the cloud. Multimedia is t...

Impact of Maternal Acceptance and Rejection on Adjustment Level of Girls

The purpose of the present study was to examine the impact of perceived maternal acceptance and rejection on adjustment level of college going girls. It was hypothesized that girls who perceived maternal acceptance will...

Review of Various Data Storage Techniques

Review of Various Data Storage Techniques

Gender Difference in Personality of School Going Children Belongs to Different Socio-Economic Groups

"ABSTRACT This study aimed to investigate the differences in personality of boys and girls. A Sample of 300 school going children from different income groups families were selected purposively from the school of Luckno...

Download PDF file
  • EP ID EP357167
  • DOI -
  • Views 63
  • Downloads 0

How To Cite

(2015). Survey on Schedulers Optimization to Handle Multiple Jobs in Hadoop Cluster. UNKNOWN, 4(3), -. https://europub.co.uk/articles/-A-357167