Web Service for Incremental and Automatic Data Warehouses Fragmentation

Abstract

The data warehouses (DW) are proposed to collect and store heterogeneous and bulky data. They represent a collection of thematic, integrated, non-volatile and histories data. They are fed from different data sources through transactional queries and offer analytical data through decisional queries. Generally, the decisional queries execution cost on large tables is very high. Reducing this cost becomes essential to enable decision-makers to interact in a reasonable time. In this context, DW administrators use different optimization techniques such as fragmentation, indexing, materialized views, and parallelism. On the other hand, the volume of data residing in the DW is constantly evolving. This can increase the complexity of frequent queries, which can degrade the performance of DW. The administrator always has to manually design a new fragmentation scheme from the new load of frequent queries. Having an automatic fragmentation tool of DW becomes important. The approach proposed in this paper aims at an incremental horizontal fragmentation technique of the DW through a web service. This technique is based on the updating of the queries load by adding the new frequent queries and eliminating the queries which do not remain frequent. The goal is to automate the implementation of the incremental fragmentation in order to optimize the new queries load. An experimental study on a real DW is carried out and comparative tests show the satisfaction of our approach.

Authors and Affiliations

Ettaoufik Abdelaziz, Mohammed Ouzzif

Keywords

Related Articles

A Comparison of Collaborative Access Control Models

Collaborative environments need access control to data and resources to increase working cooperation efficiently yet effectively. Several approaches are proposed and multiple access control models are recommended in this...

A Parallel Community Detection Algorithm for Big Social Networks

Mining social networks has become an important task in data mining field, which describes users and their roles and relationships in social networks. Processing social networks with graph algorithms is the source for dis...

Towards Building an Intelligent Call Routing System

This paper presents EduICR - an Intelligent Call Routing system. This system can route calls to the most appropriate agent using routing rules built by the text classifier. EduICR includes the following main components:...

A Novel Architecture for Network Coded Electronic Health Record Storage System

The use of network coding for large scale content distribution improves download time. This is demonstrated in this work by the use of network coded Electronic Health Record Storage System (EHR-SS). A Novel Architecture...

Empirical Evaluation of Social and Traditional Search Tools for Adhoc Information Retrieval

The nature of World Wide Web (www) has evolved over the passage of time. Easier and faster availability of Internet has given rise to huge volumes of data available online. Another cause of huge volumes of data is the em...

Download PDF file
  • EP ID EP259944
  • DOI 10.14569/IJACSA.2017.080661
  • Views 90
  • Downloads 0

How To Cite

Ettaoufik Abdelaziz, Mohammed Ouzzif (2017). Web Service for Incremental and Automatic Data Warehouses Fragmentation. International Journal of Advanced Computer Science & Applications, 8(6), 454-463. https://europub.co.uk/articles/-A-259944