bmeta

Generates a list that can be passed to the bfile_split() function
in order to indicate the number of rows and the name of columns in the file.
The output can be saved in a variable and provided in the meta_output
argument to save time. Counting rows in very large files can take some time.

A simple set of wrapper functions for data.table::fread() that allows subsetting or
filtering rows and selecting columns of table-formatted files too large for the available RAM.
'b stands for 'big files'.
bread makes heavy use of Unix commands like 'grep', 'sed', 'wc', 'awk' and 'cut'. They are available
by default in all Unix environments.
For Windows, you need to install those commands externally in order to simulate a
Unix environment and make sure that the executables are in the Windows PATH variable.
To my knowledge, the simplest ways are to install 'RTools', 'Git' or 'Cygwin'. If they have been
correctly installed (with the expected registry entries), they should be detected on loading
the package and the correct directories will be added automatically to the PATH.

Vincent Guegan

bread

Analyze Big Files Without Loading Them in Memory

bmeta function

<dl><dt>file</dt>
<dd>String. Name or full path to a file compatible with data.table::fread()</dd>
<dt>...</dt>
<dd>Arguments that must be passed to data.table::fread() like 'sep'.</dd></dl>

Arguments

Helper function generating nrow and colnames for the target file without loading it in memory — bmeta

<dl>

<dt>file</dt>
<dd>String. Name or full path to a file compatible with data.table::fread()</dd>


<dt>...</dt>
<dd>Arguments that must be passed to data.table::fread() like 'sep'.</dd>

</dl>

bmeta: Helper function generating nrow and colnames for the target file without loading it in memory

Description

Usage

Value

Arguments

Examples