Data Integration in Big Data Environment
Journal Title: Bonfring International Journal of Data Mining - Year 2015, Vol 5, Issue 1
Abstract
Data Integration is the process of transferring the data in source format into the destination format. Many data warehousing and data management approaches has been supported by integration tools for data migration and transportation by using Extract-Transform-Load (ETL) approach. These tools are widely fit for handling large volumes of data and not flexible to handle semi or unstructured data. To overcome these challenges in big data world, programmatically driven parallel techniques such as map-reduce models were introduced. Data Integration as a process is highly cumbersome and iterative especially to add new data sources. The process of adding these new data sources are time consuming which results in delay, loss of data and irrelevance of the data and improper utilization of useful information. Traditionally waterfall approach is used in EDW (Enterprise Data Warehouse), where one cannot move to the next phase before completing the earlier one. This approach has its merits to ensure the right data sources are picked and right data integration processes are developed to sustain the usefulness of EDW. In big data environment, the situation is completely different. Therefore the traditional approaches of integration are inefficient in handling the current situation. So people are expected to do something regarding this issue. In this paper the importance of data integration in Big Data world are identified and the open problems of Big Data Integration are outlined to proceed future research in Big Data environment.
Authors and Affiliations
B. Arputhamary, L. Arockiam
Keywords
Related Articles
- EP ID EP127121
- DOI 10.9756/BIJDM.8001
- Views 159
- Downloads 0
Data Integration in Big Data Environment
Data Integration is the process of transferring the data in source format into the destination format. Many data warehousing and data management approaches has been supported by integration tools for data migration...
Review on Analysis of Gene Expression Data Using Biclustering Approaches
In this paper, survey on biclustering approaches for Gene Expression Data (GED) is carried out. Some of the issues are Correlation, Class discovery, Coherent biclusters and coregulated biclusters. Each table entry is cal...
Conditional Variables Double Sampling Plan for Weibull Distributed Lifetimes under Sudden Death Testing
n this paper, we propose a conditional sampling plan called conditional double sampling plan for lot acceptance of parts whose life time follows a Weibull distribution with known shape parameter under sudden death testin...
A New Algorithm for Model Order Reduction of Interval Systems
Mixed method of interval systems is a combination of classical reduction methods and stability preserving methods of interval systems. This paper proposed a new method for model order reduction of systems with uncertain...
Classification Mining SNPs from Leukaemia Cancer Dataset Using Linear Classifier with ACO
Single Nucleotide Polymorphisms(SNP) are the foremost common type of genetic variation in human comprising nearly1/1,000th of the typical human genome. SNP offer the foremost complete information for genome-wide associat...