Year: 2005
Type: article
Abstract: The Web is a massive and interlinked collection of documents, built using a \ndecentralized design to encourage the participation of many authors who \npublish information through a huge number of Web sites. Its characteristics \nare the result of the interaction between many organizations and individuals, \nand those interactions generate a large amount of diversity. This diversity \nmeans that several different topics are represented on the Web, and at the \nsame time that the overall quality of pages and Web sites is very variable. The \nWeb is very dynamic and is growing at a very fast pace, and even when some \nof its properties have been studied, there are several characteristics of it that \nare still not fully known. \nThis article reports the results of an in-depth study over a large collection of \nWeb pages. On September and October 2004 we downloaded more than 16 \nmillion Web pages from about 300,000 Web sites from the Web of Spain. We \nshow the characteristics of this collection at three different granularity levels: \nWeb pages, sites and domains. For each level, we analyze contents, links, and \ntechnologies, and present statistics and models. We found that some of the \ncharacteristics of this collection resemble the ones of the Web at large, while \nothers are specific to the Web of Spain, or have not been studied in the past
Institution: Universitat Pompeu Fabra
Language: English
Subfield: Information Systems
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funder: Universitat Pompeu Fabra
OpenAlex ID: W2142201818