An Efficient Approach towards Duplicate Detection System
Journal Title: International Journal for Research in Applied Science and Engineering Technology (IJRASET) - Year 2017, Vol 5, Issue 1
Abstract
Information on the web is very huge in size and the tasks of search engines have become more and more complex as a single entity on the web have two or more representations in databases. The duplicate detection is the process of identifying the entities who has multiple representation of the same real world entity, as the duplicate detection methods has to process large datasets, the identification of duplicate document in a large database is a issue significantly with wide-spread applications. In this paper a review on various approaches of duplicate detection will be presented. Proposed system will compare two Duplication detection methods, the first is based on two novel progressive duplicate detection algorithms that significantly increase the efficiency of finding duplicates if the execution time is limited. The second is based on Secure Hashing Algorithm which will detect and delete duplicate data, the secure hash algorithm will perform data de-duplication task in order to overcome the issues of time and to reduce hash collision.
Authors and Affiliations
Miss. Ruchira Dhananjay Deshpande, Sonali Bodkhe
Keywords
Related Articles
- EP ID EP23038
- DOI -
- Views 297
- Downloads 4
Imperative Study on WIMAX Technology
Worldwide Interoperability for Microwave Access (WiMAX) is a recent wireless broadband standard that has promised high bandwidth over long-range transmission. The standard specifies the air interface, including the medi...
Performance Evaluation of Water Treatment Plant at Motijheel, Gwalior
The conventional water Treatment plant, especially in developing countries faces major challenges in term of assessing its operation and performance due to inappropriate technologies, insufficient equipment and deficien...
DPSK-OFDM System for Reliable Data Transmission using QRcode System in Mobile Devices
The work of 2-D barcodes is of great relevance for evaluate in wireless data transmission between handheld electronic devices. In a typical setup, any file on a mobile phone, for concrete illustration, can be transferre...
Lattice Points Of A Cubic Diophantine Equation 11(X+Y)^2= 4(Xy+11z^3)
The ternary cubic Diophantine equation ( , ࢠ + ࢟࢞ = )࢟ + ࢞is considered for determining its non-zero distinct integral solutions employing the linear transformations ࢜ − ࢛ = ࢟ ,࢜ + ࢛ = ࢞and employing the method...
Mechanical Properties of cementitious composite by using ZnO nanoparticles
The split tensile and the setting time of cement with different Concentration of ZnO Nanoparticles (0.5%, 0.1%, 1.5% , 2.0%,2.5% ,3% by weight) has been studied. the mechanical (flexural and split tensile) strength of t...