Development of Intellectual System for Data De-Duplication and Distribution in Cloud Storage

Journal Title: Webology - Year 2019, Vol 16, Issue 2

Abstract

The system for backing up the data is designed. Client software works on the computer of user, takes all the necessary files for backup, and turns them into Stream of bytes. Then breaks it into blocks (from 32 KB to 64KB) using a Rabin algorithm. It is based on hash ring that is absorbing every incoming byte if the current hash mask or equal to a certain reach 64KB, there is division committed. This approach helps to avoid is coping all data if the content of a file has changed in separately. For each data block client software calculates the hash. Then sends parts even 256 times or more of those hashes to the server and checks if they already know the system. The blocks are not known, refers to the server. As part of the de-duplication, data on distribution and cloud distribution occurs on hashes, hashes are SHA1, so that 20 bytes are given in hexadecimal format. First number or letter and will serve key distribution. So essentially, you can evenly distribute the data among the workers from 2 to 16 pieces. You need to take the second number of hash, and more commit distribution.

Authors and Affiliations

Vasyl Lytvyn, Victoria Vysotska, Mykhailo Osypov, Olha Slyusarchuk and Yuriy Slyusarchuk

Keywords

Related Articles

Evaluation of scientific status of endocrine, diabetes, and metabolism research centers in Iran using exergy method

The aim of this study was to determine the scientific status of endocrine, diabetes and metabolism research centers in Iran using exergy method in terms of scientific publications indexed in the Web of Science, Scopus, a...

Fundamental Differences between Hyperlinks and Citations

The Web is a growing organism and one of the most important characteristics of the Web is that a web page has ability to link to other web pages through hyperlinks. Since 1996, hyperlinks have been studied extensively by...

Delinking: An Exploratory Study

The objective of this exploratory study is to determine the delinking practices of webmasters of colleges and universities in Canada and the US. An online questionnaire was created and all the 92 webmasters of Canadian c...

Metadata and Its Impact on Libraries.

Metadata is a subject that has attracted a lot of interest from many and diverse scientific communities over the years. Numerous papers and international conferences reflect the contributions and the variations in the...

A Comparative Theoretical and Empirical Analysis of Machine Learning Algorithms

With the explosion of data in recent times, Machine learning has emerged as one of the most important methodical approaches to observe significant insights from the vast amount of data. Particularly, it is witnessed that...

Download PDF file
  • EP ID EP687816
  • DOI 10.14704/WEB/V16I2/a188
  • Views 291
  • Downloads 0

How To Cite

Vasyl Lytvyn, Victoria Vysotska, Mykhailo Osypov, Olha Slyusarchuk and Yuriy Slyusarchuk (2019). Development of Intellectual System for Data De-Duplication and Distribution in Cloud Storage. Webology, 16(2), -. https://europub.co.uk/articles/-A-687816