Learn R Programming

datamart (version 0.3.2)

scrape: Scrape external data source

Description

The scrape method extracts external data and stores it in a SqliteDataStore.

Arguments

self
an Xdata object
dbconn
a SQLiteDataStore object (which is a DBIConnection)

Details

By default (Xdata), the method scrapes is used to determine which resources are "scrapeable" (as opposed to to "refined" resources). For each of the resources, query is called (with ignore.db=TRUE) and thus the data extraction and transformation is performed. The result of the query is stored in the datastore. Usually the method needs not be overwritten by inherited classes.

References

http://en.wikipedia.org/wiki/Data_scraping