Development of Intellectual System for Data De-Duplication and Distribution in Cloud Storage

Journal Title: Webology - Year 2019, Vol 16, Issue 2

Abstract

The system for backing up the data is designed. Client software works on the computer of user, takes all the necessary files for backup, and turns them into Stream of bytes. Then breaks it into blocks (from 32 KB to 64KB) using a Rabin algorithm. It is based on hash ring that is absorbing every incoming byte if the current hash mask or equal to a certain reach 64KB, there is division committed. This approach helps to avoid is coping all data if the content of a file has changed in separately. For each data block client software calculates the hash. Then sends parts even 256 times or more of those hashes to the server and checks if they already know the system. The blocks are not known, refers to the server. As part of the de-duplication, data on distribution and cloud distribution occurs on hashes, hashes are SHA1, so that 20 bytes are given in hexadecimal format. First number or letter and will serve key distribution. So essentially, you can evenly distribute the data among the workers from 2 to 16 pieces. You need to take the second number of hash, and more commit distribution.

Authors and Affiliations

Vasyl Lytvyn, Victoria Vysotska, Mykhailo Osypov, Olha Slyusarchuk and Yuriy Slyusarchuk

Keywords

Related Articles

How to use recommender systems in e-business domains

Recommender systems (RS) were developed by research as a means to manage the information retrieval problem for users searching large databases. Recently they have become very popular among businesses as online marketing...

The Eurasian Economic Union in the Context of Digital Transformation: Main Directions in the Development of Industrial Cooperation

The development of digital technologies in organizations and the level of Internet penetration has a significant impact on the volume of the e-Commerce market as an indicator of the potential of the digital economy. The...

The cataloging of virtual communities of educational thematic

This article considers the current problem of investigation the specific of specialized catalog of educational virtual communities. Peculiarities of catalogs of virtual communities are formed. This study provides a met...

Egyptian and American Internet-Based Cross-Cultural Information Seeking Behavior. Part I: Research Instrument

This article is the first of three in an exploratory study of the cross-cultural, cross-language information-seeking (IS) behavior of a group of eighty-four academic and public reference librarians from Egypt and the U...

Perceptions, awareness and acceptance of library 2.0 applications among librarians at the International Islamic University Malaysia

The paper has investigated the perceptions, level of awareness, and acceptance of Library 2.0 applications among librarians at the International Islamic University Malaysia (IIUM). The paper also identified perceived fac...

Download PDF file
  • EP ID EP687816
  • DOI 10.14704/WEB/V16I2/a188
  • Views 293
  • Downloads 0

How To Cite

Vasyl Lytvyn, Victoria Vysotska, Mykhailo Osypov, Olha Slyusarchuk and Yuriy Slyusarchuk (2019). Development of Intellectual System for Data De-Duplication and Distribution in Cloud Storage. Webology, 16(2), -. https://europub.co.uk/articles/-A-687816