A Novel Approach for Processing of Real Time Big Data for Machine Learning By Using Map reduce Paradigm


As of late Big Data and its investigation assuming overwhelming part in ideal stockpiling of semi or unstructured information and Decision making by utilizing mining systems and prescient examination. Particularly Remote Sensing gathers colossal information as multispectral high determination satellite pictures. These pictures contain assortment of information in tremendous volume as pixels. Dispersing high volume information into various product frameworks utilizing disseminated record framework is a noteworthy upset made by Hadoop system to deal with enormous information with the accessible equipment and computational abilities. Delineate is a strategy which performs Map capacities and Reduce works on the disseminated document framework. This paper examined on continuous Big Data Analytical design for remote detecting satellite application. To deal with Remote Sensing Data proposed engineering contains three fundamental units, for example, Data Pre-Processing Unit (DPREU), Data Analysis Unit (DAU) and Data Post-Processing Unit (DPOSTU). In the first place, DPREU gets the required information from satellite sensors by utilizing filtration, adjusted conveyed stockpiling and parallel preparing utilizing Hadoop condition. Second, DAU recognizes the concealed examples from information put away in disseminated File System utilizing Map capacities took after by Reduce works in Map-Reduce worldview. At last, DPOSTU is the upper layer unit of the proposed design, which is in charge of arranging stockpiling of the outcomes, and era of choice in light of the outcomes got from DAU. Mapper capacities are part into number of record perusers and they will read the information stacked circulates document framework by utilizing key-esteem combine. The yield of each Map capacity is taken by Reducer work for further investigation.

Authors and Affiliations

Lakshmi Padmaja Paruchuri| Assistant Professor, Department of IT, Gudlavalleru Engineering College, A.P., India, B V N Prasad Paruchuri| Associate Professor, Department of Computer Science and Engineering, MVR College of Engineering College. A.P., India


Related Articles

Evaluate the Key Management of Identity-Based Digital Signature To Routing In Cluster-Based Wireless Sensor Networks

Cluster-based information transmission in WSNs has been analyzed by scientists keeping in mind the end goal to accomplish the system scalability and administration, which capitalize on hub life and diminish transfer...

Enhancement of Power Quality by Using Shunt Hybrid Power Filter With TCR

This paper presents a thyristor-controlled reactor (TCR) in combination with a fifth-tuned LC passive filter and active power filter (APF) in order to compensate the reactive power and to reduce harmonics.In addition...

A Noval Converter For Integrated Wind – Pv Energy System

This paper proposes a novel dc/dc converter topology that interfaces the non-conventional energy sources. It consists of four power ports: two sources (namely solar and wind), one bidirectional storage port, and one...

Grid Connected Single Phase Rooftop Pv System With Limited Reactive Power Supply

In this paper SRF theory based PV system with MPPT DC-DC controller for grid connected single phase rooftop system have been presented. Photovoltaic (PV) systems are the alternative source of generation because these...

Percolate And M Supremacy User Walls By Using Pfw

Users have attraction about on social networks they are ready to keep in touch with his/her friends by seesawing different information of meta data. Now a day social networks have more privacy and security problems a...

Download PDF file
  • EP ID EP16889
  • DOI -
  • Views 217
  • Downloads 8

How To Cite

Lakshmi Padmaja Paruchuri, B V N Prasad Paruchuri (2017). A Novel Approach for Processing of Real Time Big Data for Machine Learning By Using Map reduce Paradigm. International Journal of Science Engineering and Advance Technology, 5(3), 242-245. https://europub.co.uk/articles/-A-16889