A Multi-Agent Framework for Data Extraction,Transformation and Loading in Data Warehouse
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2016, Vol 7, Issue 11
Abstract
The rapid growth in size of data sets poses chal-lenge to extract and analyze information in timely manner for better prediction and decision making. Data warehouse is the solution for strategic decision making. Data warehouse serves as a repository to store historical and current data. Extraction, Transformation and Loading (ETL) process gather data from different sources and integrate it into data warehouse. This paper proposes a multi-agent framework that enhance the efficiency of ETL process. Agents perform specific task assigned to them. The identification of errors at different stages of ETL process become easy. This was difficult and time consuming in traditional ETL process. Multi-agent framework identify data sources, extract, integrate, transform, and load data into data warehouse. A monitoring agent remains active during this process and generate alerts if there is issue at any stage.
Authors and Affiliations
Ramzan Talib, Muhammad Kashif Hanif, Fakeeha Fatima, Shaeela Ayesha
Keywords
Related Articles
- EP ID EP397053
- DOI 10.14569/IJACSA.2016.071146
- Views 122
- Downloads 0
Adaptive Neuro-Fuzzy Inference Systems for Modeling Greenhouse Climate
The objective of this work was to solve the problem of non linear time variant multi-input multi-output of greenhouse internal climate for tomato seedlings. Artificial intelligent approaches including neural networks and...
A Game Theoretic Approach to Demand Side Management in Smart Grid with Multiple Energy Sources and Storage
A smart grid is an advancement in electrical grid which includes a variety of operational and energy measures. To utilize energy distribution in an efficient manner, demand side management has become the fore-runner. In ou...
Classification of Human Emotions from Electroencephalogram (EEG) Signal using Deep Neural Network
Estimation of human emotions from Electroencephalogram (EEG) signals plays a vital role in developing robust Brain-Computer Interface (BCI) systems. In our research, we used Deep Neural Network (DNN) to address EEG-based...
An Interoperable Data Framework to Manipulate the Smart City Data using Semantic Technologies
During the last decade, enormous volumes of urban data have been produced by the Government agencies, the NGOs and the citizens. In such a scenario, we are presented with a diverse sets of data which holds valuable infor...
Investigating Students’ Acceptance of Online Courses at Al-Ahliyya Amman University
Online courses allow students to access the course materials anytime and anywhere. Those courses are meant to enhance and improve the learning processes. Unfortunately, by analyzing data of an online course in Al-Ahliyya...