Learn R Programming

ETLUtils

ETLUtils provides utility functions to execute standard ETL operations (using package ff) on large data. Currently the following functions might be useful to you if you have some large dataset in SQL and want to import it immediately in an ffdf object

  • read.dbi.ffdf (reading of SQL data through DBI)
  • read.odbc.ffdf (reading of SQL data through RODBC)
  • read.jdbc.ffdf (reading of SQL data through RJDBC)

An example can be found at http://www.bnosac.be/index.php/blog/5-get-your-large-sql-data-in-ff-swiftly and at http://www.bnosac.be/index.php/blog/6-readodbcffdf-a-readdbiffdf-for-fetching-large-corporate-sql-data

For users who want to store data from an ffdf back in a database, the package also provides

  • write.dbi.ffdf (writing of ffdf data to a database table through DBI)
  • write.odbc.ffdf (writing of ffdf data to a database table through RODBC)
  • write.jdbc.ffdf (writing of ffdf data to a database table through RJDBC)

Other utilities

Other functions include factorise, matchmerge, recoder, naLOCFPlusone and renameColumns.

CRAN

This is the development version of the package which is available at CRAN.

To install the latest version from github remotes::install_github("jwijffels/ETLUtils")

To get the lastest version from CRAN:

Copy Link

Version

Install

install.packages('ETLUtils')

Monthly Downloads

243

Version

1.5

License

GPL-2

Issues

Pull Requests

Stars

Forks

Maintainer

Last Published

August 3rd, 2020

Functions in ETLUtils (1.5)

read.odbc.ffdf

Read data from a ODBC connection into an ffdf.
read.dbi.ffdf

Read data from a DBI connection into an ffdf.
recoder

Recodes the values of a character vector
factorise

Put character vectors, columns of a data.frame or list elements as factor
matchmerge

Merge two data frames (fast) by common columns by performing a left (outer) join or an inner join.
ETLUtils-package

Extra utility functions to execute standard ETL operations on large data
write.odbc.ffdf

Write ffdf data to a database table by using a ODBC connection.
read.jdbc.ffdf

Read data from a JDBC connection into an ffdf.
write.jdbc.ffdf

Write ffdf data to a database table by using a JDBC connection.
naLOCFPlusone

Performs NA replacement by last observation carried forward but adds 1 to the last observation carried forward.
renameColumns

Renames variables in a data frame.
write.dbi.ffdf

Write ffdf data to a database table by using a DBI connection.