Optimization of ETL Process in Data Warehouse Through a Combination of Parallelization and Shared Cache Memory
Journal Title: Engineering, Technology & Applied Science Research - Year 2016, Vol 6, Issue 6
Abstract
Extraction, Transformation and Loading (ETL) is introduced as one of the notable subjects in optimization, management, improvement and acceleration of processes and operations in data bases and data warehouses. The creation of ETL processes is potentially one of the greatest tasks of data warehouses and so its production is a time-consuming and complicated procedure. Without optimization of these processes, the implementation of projects in data warehouses area is costly, complicated and time-consuming. The present paper used the combination of parallelization methods and shared cache memory in systems distributed on the basis of data warehouse. According to the conducted assessment, the proposed method exhibited 7.1% speed improvement to kattle optimization instrument and 7.9% to talend instrument in terms of implementation time of the ETL process. Therefore, parallelization could notably improve the ETL process. It eventually caused the management and integration processes of big data to be implemented in a simple way and with acceptable speed.
Authors and Affiliations
M. Faridi Masouleh, M. A. Afshar Kazemi, M. Alborzi, A. Toloie Eshlaghy
Keywords
Related Articles
- EP ID EP110817
- DOI -
- Views 245
- Downloads 0
An Automated Surveillance System Based on Multi-Processor and GPU Architecture
Video surveillance systems are a powerful tool applied in various systems. Traditional systems based on human vision are to be avoided due to human errors. An automated surveillance system based on suspicious behavior pr...
Optimal Allocation of DSTATCOM in Distribution Network Using Whale Optimization Algorithm
This paper deals with a new approach implemented to decrease power losses and improve voltage profile in distribution networks using Distribution STATic COMpensator (DSTATCOM). DSTATCOM location can be determined by the...
Fading Legacy of the Architectural Heritage of the Historic Core of Karachi
In 1839 British East India Company captured the town of Karachi. After an effortless resistance from the locals the fort was conquered by the British commander sir Charles Napier. The village of Kolachi then was annexed...
Cloud Computing in Science and Engineering and the “SciShop.ru” Computer Simulation Center
Various aspects of cloud computing applications for scientific research, applied design, and remote education are described in this paper. An analysis of the different aspects is performed based on the experience from th...
Cumulative Effect of Crumb Rubber and Steel Fiber on the Flexural Toughness of Concrete
Concrete properties, such as toughness and ductility, are enhanced to resist different impacts or blast loads. Rubberized concrete, which could be considered a green material, is produced from recycled waste tires grinde...