Beyond Hadoop: The Paradigm Shift of Data From Stationary to Streaming Data for Data Analytics
Journal Title: Saudi Journal of Engineering and Technology - Year 2017, Vol 2, Issue 6
Abstract
Abstract: The paradigm shift of data from static to fast flowing data is an important move in the industry, to accommodate growing size of data. The velocity and volume of data are continuing to expand which has started to make its impact in business and other applications of Big Data. The paper describes the paradigm shift of data from static data to streaming data for data analytics beyond Hadoop. It describes how the first generation of Hadoop applications were largely built for batch-oriented paradigm . Streaming data is essentially different from traditional data handling patterns and comes with its own set of challenges and requirements. New applications such as Storm, Flume, Kafka, and other technologies are evolving to bring in an era of real-time analytics Data is generated incessantly from thousands of sources simultaneously and it can be of various type such as log files, mobile and web data, transaction etc. The sections of my paper are Introduction followed by Streaming data, Hadoop, Streaming data analytics, Apache Spark, Comparing Streaming models and Streaming analytics use cases followed by conclusion. The information presented is from secondary source i.e. journal, conference proceedings and websites. Keywords: paradigm, Hadoop, Apache Spark.
Authors and Affiliations
Affreen Ara, Aftab Ara
Keywords
Related Articles
- EP ID EP401729
- DOI -
- Views 126
- Downloads 0
Application of Forecasting Techniques in Nissan Urvan Income Generation of Anambra State Transport Sector
Abstract: This research work studies several forecasting techniques to predict future income generation and its implications on the Nissan Urvan income generation in Anambra State Transport sector .This paper presents th...
Automatic Building Change Detection and 3D Map Generation Using Multispectral Imagery and Height Data
Abstract:Automatic building change detection required for metropolitan and urban planning , industrial city planning, road and highway planning, unauthorized construction detecting, stopping any new construction on risky...
Evaluation of Parshall flume efficiency for free flow condition open channel
Abstract: Parshall flume provides economical and flexible water measurement capabilities for a wide variety of open channel flow situations. The advantages of this structure include minimal head loss, low construction co...
A study of First geometric-Arithmetic Index with Chemical Applications
Abstract: The first geometric–arithmetic index 〖GA〗_1 is found to be useful in compute the numerical value of certain graphs and chemical graphs, which is defined as〖GA〗_1=∑_(uv∈E(G))▒(2√(d_u d_v ))/(d_u+d_v ). We de...
Productivity of Lagoon Cattle Farms on the Islands of the Municipality of Sô-Ava in the South of Benin
Abstract:This study, which examines the productivity of Lagoon cattle farms located on the islands at risk of flooding in the municipality of Sô-Ava in the Oueme river valley in southern Benin, took place between Novembe...