Beyond Hadoop: The Paradigm Shift of Data From Stationary to Streaming Data for Data Analytics
Journal Title: Saudi Journal of Engineering and Technology - Year 2017, Vol 2, Issue 6
Abstract
Abstract: The paradigm shift of data from static to fast flowing data is an important move in the industry, to accommodate growing size of data. The velocity and volume of data are continuing to expand which has started to make its impact in business and other applications of Big Data. The paper describes the paradigm shift of data from static data to streaming data for data analytics beyond Hadoop. It describes how the first generation of Hadoop applications were largely built for batch-oriented paradigm . Streaming data is essentially different from traditional data handling patterns and comes with its own set of challenges and requirements. New applications such as Storm, Flume, Kafka, and other technologies are evolving to bring in an era of real-time analytics Data is generated incessantly from thousands of sources simultaneously and it can be of various type such as log files, mobile and web data, transaction etc. The sections of my paper are Introduction followed by Streaming data, Hadoop, Streaming data analytics, Apache Spark, Comparing Streaming models and Streaming analytics use cases followed by conclusion. The information presented is from secondary source i.e. journal, conference proceedings and websites. Keywords: paradigm, Hadoop, Apache Spark.
Authors and Affiliations
Affreen Ara, Aftab Ara
Keywords
Related Articles
- EP ID EP401729
- DOI -
- Views 136
- Downloads 0
Survey: The Reliability of VANETs for Safety Applications
Abstract:Vehicular ad hoc networks (VANETs) have become a hot research area over the past few years. The main purpose of VANETs is to improve traffic safety, traffic efficiency, and driving comfort. Particularly, traffic...
Optimization of friction stir welding process parameters using RSM based Grey–Fuzzy approach
Abstract: Friction stir welding (FSW) is proved as a promising welding technology for joining dissimilar aluminium alloys. Aluminium alloys are used extensively within the aerospace industry for applications such as fuse...
Survey of Semi Automatic Viscous Fluid Filling Machine
Abstract: Changes in today’s manufacturing environment allow tedious, fatiguing and repetitive tasks to be mechanically performed by robots, as manually controlled work is transition to auto-cycle control equipment. Such...
Effect of Waste Cement Dust as Mineral Filler on Marshall Properties of Hot Mix Asphalt
Abstract:Using cement dust in asphalt mixing can have many environmental advantages. Before widely adapting cement dust in asphalt paving, trial sections and adequate provisions should be provided. By pass cement dust is...
Arduino Microcontroller Based Heart Rate Monitor Using Fingertip Sensors
Abstract:Medical devices can be categorized into two categories which is invasive and non-invasive method. Invasive method needs medical device to be inserted into patient body regarding to check or do the treatment on t...