Beyond Hadoop: The Paradigm Shift of Data From Stationary to Streaming Data for Data Analytics
Journal Title: Saudi Journal of Engineering and Technology - Year 2017, Vol 2, Issue 6
Abstract
Abstract: The paradigm shift of data from static to fast flowing data is an important move in the industry, to accommodate growing size of data. The velocity and volume of data are continuing to expand which has started to make its impact in business and other applications of Big Data. The paper describes the paradigm shift of data from static data to streaming data for data analytics beyond Hadoop. It describes how the first generation of Hadoop applications were largely built for batch-oriented paradigm . Streaming data is essentially different from traditional data handling patterns and comes with its own set of challenges and requirements. New applications such as Storm, Flume, Kafka, and other technologies are evolving to bring in an era of real-time analytics Data is generated incessantly from thousands of sources simultaneously and it can be of various type such as log files, mobile and web data, transaction etc. The sections of my paper are Introduction followed by Streaming data, Hadoop, Streaming data analytics, Apache Spark, Comparing Streaming models and Streaming analytics use cases followed by conclusion. The information presented is from secondary source i.e. journal, conference proceedings and websites. Keywords: paradigm, Hadoop, Apache Spark.
Authors and Affiliations
Affreen Ara, Aftab Ara
Keywords
Related Articles
- EP ID EP401729
- DOI -
- Views 118
- Downloads 0
Investigation of Functional Properties Changing in Different Chemical Treatments of Various Cellulosic Fibers Using FTIR
Abstract:The effects of combined scouring-bleaching and reactive dyeing were investigated by characterizing the functional groups changed of cotton, betel nut, banana and jute fibers using caustic soda, Hydrogen peroxide...
Evaluation of Parshall flume efficiency for free flow condition open channel
Abstract: Parshall flume provides economical and flexible water measurement capabilities for a wide variety of open channel flow situations. The advantages of this structure include minimal head loss, low construction co...
Prediction and Appraisal of solar radiations and its Intensity in South East Geopolitical Region, Nigeria
Abstract: This research work is shows the variability of solar parameters. The parameters that are solar radiation, sun intensity and temperature were optimized and predicted in other to investigate its influence in Perm...
Survey of Semi Automatic Viscous Fluid Filling Machine
Abstract: Changes in today’s manufacturing environment allow tedious, fatiguing and repetitive tasks to be mechanically performed by robots, as manually controlled work is transition to auto-cycle control equipment. Such...
Weighted Exponential - G Family of Probability Distributions
Abstract:Many generalized families of distributions have been proposed and studied over the last two decades for modeling data in many applied areas. In this paper, depending on the idea of Bourguignon et al., a new fami...