Smart Crawler: A Two Stage Crawler for Concept Based Semantic Search Engine.
Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2015, Vol 17, Issue 6
Abstract
Abstract: The internet is a vast collection of billions of web pages containing terabytes of information arranged in thousands of servers using HTML. The size of this collection itself is a formidable obstacle in retrieving necessary and relevant information. This made search engines an important part of our lives. Search engines strive to retrieve information as relevant as possible. One of the building blocks of search engines is the Web Crawler. We tend to propose a two - stage framework, specifically two smart Crawler, for efficientgathering deep net interfaces. Within the first stage, smart Crawler, performs site-based sorting out centre pages with the assistance of search engines, avoiding visiting an oversized variety of pages. To realize additional correct results for a targeted crawl, smart Crawler, ranks websites to order extremely relevant ones for a given topic. Within the second stage, smart Crawler, achieves quick in – site looking by excavating most relevant links with associate degree accommodative link -ranking.
Authors and Affiliations
Ajit T. Raut , Ajit N. Ogale , Subhash A. Kaigude , Uday D. Chikane
Keywords
Related Articles
- EP ID EP122756
- DOI -
- Views 110
- Downloads 0
An Integrated Approach to Design an EAF for the CCS of ICDSin India
Abstract: E-government is getting a positive thrust in view of `Digital India Project` initiatives by the currentgovernment in India. At present, information and communication technology (ICT) has become an essenti...
Clustering Of Images Based On Image Properties
Abstract: Image Properties are used for the analysis of quality of the given image. The Intensity images, Contrast images, Weibull images and Fractal images are extracted from the input images. Eight basic image properti...
Socio Media Connect: A Social Profile based P2P Network
Abstract: It is observed that users tend to like and follow a particular type music/movies based on their socialinterests. Users like music of particular artists, album; movies/TV shows of a particular actor, direc...
Photo Catalytic Degradation of Effluent of Iron and Power Plant Industries in Aqueous Solution by CDS Nano Catalyst Using UVIrradiation
Abstract: The iron and power plant industries consume significant amount of water during the power generation and finishing operations. In this operation a used water having high chemical oxygen demand contents and the w...
Performance Evaluation of Wlan by Varying Pcf, Dcf and Enhanced Dcf Slots To Improve Quality of Service
Researchers have proposed a number of co-ordination functions in literature for improving quality of service. Each one is based on different characteristics and properties. In this paper, we evaluate the perfor...