Beyond Hadoop: The Paradigm Shift of Data From Stationary to Streaming Data for Data Analytics
Journal Title: Saudi Journal of Engineering and Technology - Year 2017, Vol 2, Issue 6
Abstract
Abstract: The paradigm shift of data from static to fast flowing data is an important move in the industry, to accommodate growing size of data. The velocity and volume of data are continuing to expand which has started to make its impact in business and other applications of Big Data. The paper describes the paradigm shift of data from static data to streaming data for data analytics beyond Hadoop. It describes how the first generation of Hadoop applications were largely built for batch-oriented paradigm . Streaming data is essentially different from traditional data handling patterns and comes with its own set of challenges and requirements. New applications such as Storm, Flume, Kafka, and other technologies are evolving to bring in an era of real-time analytics Data is generated incessantly from thousands of sources simultaneously and it can be of various type such as log files, mobile and web data, transaction etc. The sections of my paper are Introduction followed by Streaming data, Hadoop, Streaming data analytics, Apache Spark, Comparing Streaming models and Streaming analytics use cases followed by conclusion. The information presented is from secondary source i.e. journal, conference proceedings and websites. Keywords: paradigm, Hadoop, Apache Spark.
Authors and Affiliations
Affreen Ara, Aftab Ara
Keywords
Related Articles
- EP ID EP401729
- DOI -
- Views 144
- Downloads 0
Sustainability of Groundwater for Domestic Uses in Rural Communities of Kogi State, Nigeria
Abstract:Groundwater is a natural resource that is of immense importance to life and its characteristics are greatly determined by the properties of the immediate geologic formations. Generally, the development of ground...
Assembling of Desktop Computer System with In-Built Uninterrupted Power Supply (UPS)
Abstract: Desktop computer system been DIY (assembled) or Branded has become sine-qua-non compare to other tools in business organizations like banks and schools. This desktop computer requires clean electricity power t...
Unsaturated Hydraulic Conductivity of Bagasse Ash Treated Foundry Sand
Abstract: Laboratory investigations were conducted to assess the unsaturated hydraulic conductivity of foundry sand waste treated with up to 8% bagasse ash (a pozzolana) by dry weight of soil. Specimens were prepared at...
Survey: The Reliability of VANETs for Safety Applications
Abstract:Vehicular ad hoc networks (VANETs) have become a hot research area over the past few years. The main purpose of VANETs is to improve traffic safety, traffic efficiency, and driving comfort. Particularly, traffic...
Effect of the Different Energy of Compaction on Subbse Course of Roads
Abstract: Compaction of subbase is often the main load-bearing layer of a pavement. It is designed to evenly spread the load of the paving, it compacted with heavy equipment until the material forms a dense layer of inte...