A Methodical Study Of Web Crawler
Journal Title: International Journal of engineering Research and Applications - Year 2018, Vol 8, Issue 11
Abstract
World Wide Web (or simply web) is a massive, wealthy, preferable, effortlessly available and appropriate source of information and its users are increasing very swiftly now a day. To salvage information from web, search engines are used which access web pages as per the requirement of the users. The size of the web is very wide and contains structured, semi structured and unstructured data. Most of the data present in the web is unmanaged so it is not possible to access the whole web at once in a single attempt, so search engine use web crawler. Web crawler is a vital part of the search engine. It is a program that navigates the web and downloads the references of the web pages.Search engine runs several instances of the crawlers on wide spread servers to get diversified information from them. The web crawler crawls from one page to another in the World Wide Web, fetch the webpage, load the content of the page to search engine’s database and index it. Index is a huge database of words and text that occur on different webpage. This paper presentsa systematic study of the web crawler. The study of web crawler is very important because properly designed web crawlers always yield well results most of the time.
Authors and Affiliations
Vandana shrivastava
Keywords
Related Articles
- EP ID EP406765
- DOI 10.9790/9622-0811010108.
- Views 136
- Downloads 0
Achieving Sustainability By Partial Replacement Of Cement With Rice Husk Ash
India is a major rice producing country , and the husk generated during milling is mostly used as a fuel in the boilers for processing paddy, So for every 1000 kgs of paddy milled , about 220 kgs ( 22 % ) of husk is prod...
Investigation on Mechanical Properties of Hybrid Fibre Reinforced Polymer Composites
The main intention of this review is to learn the potential of agro-residues as reinforcements for composite materials as a substitute to natural and synthetic fibre. In recent times, there has been a rapid advancement i...
Investigation of contamination of phosphorus pesticides in the groundwater of Varamin Plain
Worldwide, insects and pests, including those that are less sustainable in the environment, are causing millions of dollars of damage to crops every year.Usually, after spraying and granulation in agricultural fields, re...
Enhancing the Hypervisor as a Second Layer of Authentication
Hosting Services Over The Internet Has Become One Of The Most Terms Pervaded The IT World. Cloud Computing Is A General Term Refers To The Platform Of Hardware And Software Being Used To Migrating Computing Resources To...
Synthesis of bio-diesel from Kenaf seed oil and performance analysis of bio-diesel blends on four stroke, CI engine.
Biodiesel has attracted attention towards world because of its eco-friendly nature, low pollution emitting and non-toxic properties. Globally, there are hundreds of crops which can be used as a biodiesel feedstock. Use o...