Work

Automated Data Collection withR- A Practical Guide to Web Scraping and Text Mining

Year: 2015
Type: book-review
Abstract: Extracting content from diversified web resources, cleaning up the raw data, preparing them for the statistical analysis and actually performing the analysis it is far from being a simple task.A single researcher must have competences in different fields including web technologies and services, authentication strategies, regular expressions and text parsing, different encoding systems, efficient data storage and data base structures, machine learning and advanced statistical techniques to mention a few.Fortunately all of them are available in R today, directly or through additional layers, but this is still not enough.The workflow that works for, e.g.Twitter, does not necessarily work for Facebook.The same workflow can break down at any time when the provider of some service changes its API, the authentication method or the data access policies.And while Twitter, Facebook, etc., are more or less stable, any other digital source from the web may have a very diversified structure, may result in incomplete or malformed data, and so on.
Institution: University of Milan
Language: English
Open Access status: diamond
OpenAlex ID: W2175608337
Cites:
Cited by: 13
Related to: 9