stream_in

Given a file of streaming JSON (ndjson) this function reads in the records
and creates a flat <code>data.table</code> / <code>tbl</code> from it.

Streaming 'JSON' ('ndjson') has one 'JSON' record per-line
and many modern 'ndjson' files contain large numbers of records.
These constructs may not be columnar in nature, but it is often
useful to read in these files and "flatten" the structure out to
enable working with the data in an R 'data.frame'-like context.
Functions are provided that make it possible to read in plain
'ndjson' files or compressed ('gz') 'ndjson' files and either
validate the format of the records or create "flat" 'data.table'
structures from them.

Bob Rudis

ndjson

Wicked-Fast Streaming 'JSON' ('ndjson') Reader

Niels Lohmann

Deepak Bandyopadhyay

Lutz Kettner

Neal Fultz

Maarten Demeyer

stream_in function

<dl><dt>path</dt>
<dd>path to file (supports "<code>gz</code>" files)</dd>
<dt>cls</dt>
<dd>the package uses <code><a href="https://Rdatatable.gitlab.io/data.table/reference/rbindlist.html">data.table::rbindlist</a></code> for speed but
that's not always the best return type for everyone, so you have
option of keeping it a <code>data.table</code> or converting it to a <code>tbl</code></dd></dl>

Arguments

Stream in &amp; flatten an ndjson file into a data.table — stream_in

<dl>

<dt>path</dt>
<dd>path to file (supports "<code>gz</code>" files)</dd>


<dt>cls</dt>
<dd>the package uses <code><a href='https://Rdatatable.gitlab.io/data.table/reference/rbindlist.html'>data.table::rbindlist</a></code> for speed but
that's not always the best return type for everyone, so you have
option of keeping it a <code>data.table</code> or converting it to a <code>tbl</code></dd>

</dl>

stream_in: Stream in & flatten an ndjson file into a `data.table`

Description

Usage

Value

Arguments

References

Examples