A Novel Approach for Processing of Real Time Big Data for Machine Learning By Using Map reduce Paradigm
Journal Title: International Journal of Science Engineering and Advance Technology - Year 2017, Vol 5, Issue 3
Abstract
As of late Big Data and its investigation assuming overwhelming part in ideal stockpiling of semi or unstructured information and Decision making by utilizing mining systems and prescient examination. Particularly Remote Sensing gathers colossal information as multispectral high determination satellite pictures. These pictures contain assortment of information in tremendous volume as pixels. Dispersing high volume information into various product frameworks utilizing disseminated record framework is a noteworthy upset made by Hadoop system to deal with enormous information with the accessible equipment and computational abilities. Delineate is a strategy which performs Map capacities and Reduce works on the disseminated document framework. This paper examined on continuous Big Data Analytical design for remote detecting satellite application. To deal with Remote Sensing Data proposed engineering contains three fundamental units, for example, Data Pre-Processing Unit (DPREU), Data Analysis Unit (DAU) and Data Post-Processing Unit (DPOSTU). In the first place, DPREU gets the required information from satellite sensors by utilizing filtration, adjusted conveyed stockpiling and parallel preparing utilizing Hadoop condition. Second, DAU recognizes the concealed examples from information put away in disseminated File System utilizing Map capacities took after by Reduce works in Map-Reduce worldview. At last, DPOSTU is the upper layer unit of the proposed design, which is in charge of arranging stockpiling of the outcomes, and era of choice in light of the outcomes got from DAU. Mapper capacities are part into number of record perusers and they will read the information stacked circulates document framework by utilizing key-esteem combine. The yield of each Map capacity is taken by Reducer work for further investigation.
Authors and Affiliations
Lakshmi Padmaja Paruchuri| Assistant Professor, Department of IT, Gudlavalleru Engineering College, A.P., India, B V N Prasad Paruchuri| Associate Professor, Department of Computer Science and Engineering, MVR College of Engineering College. A.P., India
Keywords
Related Articles
- EP ID EP16889
- DOI -
- Views 355
- Downloads 8
CFD Analysis of a Rocket Nozzle withFour Inlets at Mach 2.1.
In this work CFD investigation of weight and temperature for a rocket spout with four channels at Mach 2.1 is examined with the assistance of familiar programming. at the point when the fuel and air enter in the ign...
A New Distribute Cryptographic Keys by a Semi-Trusted Certification Authority
We propose a STP evidence conspire named SpatialTemporal provenance Assurance with Mutual Proofs (STAMP). STAMP goes for guaranteeing the trustworthiness and non-transferability of the STP proofs, with the capacity of...
Multi-keyword Ranked Search over Encrypted Cloud Data Using RSA Algorithm
Ever since Cloud computing introduced, data owners are motivated to outsource their complex data management systems from local sites to the commercial public cloud for great flexibility and economic savings. But for...
A PWM Controlled IGBT based VSCS with a Battery Energy Storage System for an Isolated Wind-Hydro Hybrid System Using Cage Generators
This paper presents a Pulse Width Modulation (PWM) controlled Insulated Gate Bipolar Transistor (IGBT) based Voltage Source Converters (VSCs) with a battery energy storage system (BESS) for an isolated wind-hydro hybr...
Key logging Prevention by QR code with Visual Authentication
Key logging is an activity of capturing users’ keyboard the activity key logger hardware and software. The key loggers secretly monitor and log all keystrokes. Malicious programs, key loggers do not cause any threat...