Smart Crawler: A Two Stage Crawler for Concept Based Semantic Search Engine.

Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2015, Vol 17, Issue 6

Abstract

Abstract: The internet is a vast collection of billions of web pages containing terabytes of information arranged in thousands of servers using HTML. The size of this collection itself is a formidable obstacle in retrieving necessary and relevant information. This made search engines an important part of our lives. Search engines strive to retrieve information as relevant as possible. One of the building blocks of search engines is the Web Crawler. We tend to propose a two - stage framework, specifically two smart Crawler, for efficientgathering deep net interfaces. Within the first stage, smart Crawler, performs site-based sorting out centre pages with the assistance of search engines, avoiding visiting an oversized variety of pages. To realize additional correct results for a targeted crawl, smart Crawler, ranks websites to order extremely relevant ones for a given topic. Within the second stage, smart Crawler, achieves quick in – site looking by excavating most relevant links with associate degree accommodative link -ranking.

Authors and Affiliations

Ajit T. Raut , Ajit N. Ogale , Subhash A. Kaigude , Uday D. Chikane

Keywords

Related Articles

 Regression Test Case Selection &PrioritizationUsing Dependence Graph and Genetic Algorithm

 Abstract: Regression testing is very important process in software maintenance. Unfortunately, it iscostly and time consumingto allow for the re-execution of all test cases during regression testing. The challenge...

 Secured Genetic Algorithm based image hiding technique with location number compression

 Abstract: Data hiding involves hiding of information in a cover media to obtain the indistinguishable media, in such a way that the cover media is supposed not to have any embedded image for its unintended recipien...

The Vulnerabilities of Cloud Computing: Security Threats

Clouds give an intense figuring stage that empowers people and associations to perform assortment levels of undertakings, for example, utilization of online storage room, selection of business applications, improvement o...

 A Study on Quality of Service for Computer Networks

 This paper presents some of the basic concepts of Quality of Service. The major research areas of Quality of Service for Computer Networks are represented. The paper also correlates and compares few of the curren...

 Texture Analysis As An Aid In CAD And Computational Logic

Abstract: The thought to utilize composition examination in restorative imaging has been considered followingthe mid-1970s. Then again, the energizing advancement of both surface investigation calculations and PCinnovati...

Download PDF file
  • EP ID EP122756
  • DOI -
  • Views 105
  • Downloads 0

How To Cite

Ajit T. Raut, Ajit N. Ogale, Subhash A. Kaigude, Uday D. Chikane (2015). Smart Crawler: A Two Stage Crawler for Concept Based Semantic Search Engine.. IOSR Journals (IOSR Journal of Computer Engineering), 17(6), 40-43. https://europub.co.uk/articles/-A-122756