Learn R Programming

⚠️There's a newer version (1.5) of this package.Take me there.

ETLUtils

ETLUtils provides utility functions to execute standard ETL operations (using package ff) on large data. Currently the following functions might be useful to you if you have some large dataset in SQL and want to import it immediately in an ffdf object

  • read.dbi.ffdf (reading of SQL data through DBI)
  • read.odbc.ffdf (reading of SQL data through RODBC)
  • read.jdbc.ffdf (reading of SQL data through RJDBC)

An example can be found at http://www.bnosac.be/blog/19-get-your-large-sql-data-in-ff-swiftly

For users who want to store data from an ffdf back in a database, the package also provides

  • write.dbi.ffdf (writing of ffdf data to a database table through DBI)
  • write.odbc.ffdf (writing of ffdf data to a database table through RODBC)
  • write.jdbc.ffdf (writing of ffdf data to a database table through RJDBC)

Other utilities

Other functions include factorise, matchmerge, recoder, naLOCFPlusone and renameColumns.

CRAN

This is the development version of the package which is available at CRAN.

To install the latest version from github:

devtools::install_github("jwijffels/ETLUtils")

To get the lastest version from CRAN:

Copy Link

Version

Install

install.packages('ETLUtils')

Monthly Downloads

337

Version

1.3

License

GPL-2

Issues

Pull Requests

Stars

Forks

Maintainer

Jan Wijffels

Last Published

May 18th, 2015

Functions in ETLUtils (1.3)

read.dbi.ffdf

Read data from a DBI connection into an ffdf.
naLOCFPlusone

Performs NA replacement by last observation carried forward but adds 1 to the last observation carried forward.
write.dbi.ffdf

Write ffdf data to a database table by using a DBI connection.
matchmerge

Merge two data frames (fast) by common columns by performing a left (outer) join or an inner join.
factorise

Put character vectors, columns of a data.frame or list elements as factor
ETLUtils-package

Extra utility functions to execute standard ETL operations on large data
read.odbc.ffdf

Read data from a ODBC connection into an ffdf.
renameColumns

Renames variables in a data frame.
write.jdbc.ffdf

Write ffdf data to a database table by using a JDBC connection.
read.jdbc.ffdf

Read data from a JDBC connection into an ffdf.
write.odbc.ffdf

Write ffdf data to a database table by using a ODBC connection.
recoder

Recodes the values of a character vector