Big Data System Architecture Using Hadoop Cluster
Journal Title: Challenges of Modern Technology - Year 2015, Vol 6, Issue 1
Abstract
The document presents basic problems related to the knowledge discovery in Big Data context. The current growth rate is imposed by the use of different data analysis, adapted for detecting valuable information from many uncorrelated locations. The aggregation of key content generated by various sources is in line with the current trend visible in the world of analytics, exploring the business value dormant in ever-increasing volumes of data. This article describes the architecture of Big Data systems, explains the MapReduce programming paradigm, the Hadoop Distributed File System, Hadoop layers, its architecture, advantages and disadvantages of Hadoop and also clarifies what Big Data is. An integrated approach for Big Data system architecture is illustrated with an example of implementation of NoSQL database and Hadoop Cluster. NoSQL is a technology that is used to store vast databases that are non-relational in nature and that support CRUD (Create, Read, Update and Delete) operations. The results are the basis for the comparison of traditional database systems and large-scale data systems.
Authors and Affiliations
Joanna Konopko
Co-housing as the way to achieve a good density in the cities – Warsaw case study
Constant population growth in urban areas is one of the main global problems, and its importance grows with the depletion of non-renewable resources. The efficient, effective and responsible use of land is supposed to be...
Variability of roughness parameters calculated using data obtained by TLS depending on scan resolution and beam's angle of incidence
Spatial data obtained by Terrestrial Laser Scanning (TLS) can be used in order to create various inventories and analyses of the surveyed surfaces. This paper presents a use of orthogonal regression line in order to iden...
Research on dehydrogenation of gomphrenin in heated ammonia solutions of organic solvents
In this report, the influence of ammonia on dehydrogenation of gomphrenin pigment, isolated from purple inflorescences of Gomphrena globosa L., in selected organic solvents (methanol, ethanol, acetone and acetonitrile) a...
Public participation in planning in the Egyptian context
Public participation is a critical aspect in the planning, also spatial planning. Its role is changing dramatically as it is present not only in social development but also tackles issues connected with cultural, educati...
Investigation on lineworks printed with different types of flexographic printing forms for purposes of printed electronics
Nowadays one can observe fast development of materials and technologies dedicated to inexpensive mass production of electronic devices with conventional printing techniques. One of them is flexography. In this paper inve...