Year: 2014
Type: article
Abstract: Due to the current size of the Web and its dynamic nature, building an efficient search mechanism is very important.A vast number of web pages are continually being added every day, and information is constantly changing.Search engines are used to extract valuable Information from the internet.Web crawlers are the principal part of search engine, is a computer program or software that browses the World Wide Web in a methodical, automated manner or in an orderly fashion.It is an essential method for collecting data on, and keeping in touch with the rapidly increasing Internet.This Paper briefly reviews the concepts of web crawler, its architecture and its various types.
Authors: Trupti V. Udapure, Ravindra D. Kale, Rajesh C. Dharmik
Language: English
Topic: Web Data Mining and Analysis
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
OpenAlex ID: W2321471970