A Multi-Agent Framework for Data Extraction,Transformation and Loading in Data Warehouse
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2016, Vol 7, Issue 11
Abstract
The rapid growth in size of data sets poses chal-lenge to extract and analyze information in timely manner for better prediction and decision making. Data warehouse is the solution for strategic decision making. Data warehouse serves as a repository to store historical and current data. Extraction, Transformation and Loading (ETL) process gather data from different sources and integrate it into data warehouse. This paper proposes a multi-agent framework that enhance the efficiency of ETL process. Agents perform specific task assigned to them. The identification of errors at different stages of ETL process become easy. This was difficult and time consuming in traditional ETL process. Multi-agent framework identify data sources, extract, integrate, transform, and load data into data warehouse. A monitoring agent remains active during this process and generate alerts if there is issue at any stage.
Authors and Affiliations
Ramzan Talib, Muhammad Kashif Hanif, Fakeeha Fatima, Shaeela Ayesha
Keywords
Related Articles
- EP ID EP397053
- DOI 10.14569/IJACSA.2016.071146
- Views 84
- Downloads 0
NEB in Analysis of Natural Image 8 × 8 and 9 × 9 High-contrast Patches
In this paper we use the nudged elastic band tech-nique from computational chemistry to investigate sampled high-dimensional data from a natural image database. We randomly sample 8 × 8 and 9 × 9 high-contrast patches of...
Triangle Hyper Hexa-cell Interconnection Network A Novel Interconnection Network
The interconnection networks play the main role in many applications, because it has a direct influence on it. Nowadays; the challenge is to find suitable topology that can deal with fewer requirements and min-cost. One...
Urdu Word Segmentation using Machine Learning Approaches
Word Segmentation is considered a basic NLP task and in diverse NLP areas, it plays a significant role. The main areas which can be benefited from Word segmentation are IR, POS, NER, sentiment analysis, etc. Urdu Word Se...
Classifying Arabic Text Using KNN Classifier
With the tremendous amount of electronic documents available, there is a great need to classify documents automatically. Classification is the task of assigning objects (images, text documents, etc.) to one of several pr...
Impact of Web 2.0 on Digital Divide in AJ&K Pakistan
Digital divide is normally measured in terms of gap between those who can efficiently use new technological tools, such as internet, and those who cannot. It was also hypothesized that web 2.0 tools motivate people to us...