sdf_from_avro

Convert column(s) from avro format

R interface to Apache Spark, a fast and general
engine for big data processing, see <https://spark.apache.org/>. This
package supports connecting to local and remote Apache Spark clusters,
provides a 'dplyr' compatible back-end, and provides an interface to
Spark's built-in machine learning algorithms.

Edgar Ruiz

sparklyr

R Interface to Apache Spark

Javier Luraschi

Kevin Kuo

Kevin Ushey

JJ Allaire

Samuel Macedo

Hossein Falaki

Lu Wang

Andy Zhang

Yitao Li

Jozef Hajnala

Maciej Szymkiewicz

Wil Davis

 RStudio

 The Apache Software Foundation

sdf_from_avro function

<dl><dt>x</dt>
<dd>An object coercible to a Spark DataFrame</dd>
<dt>cols</dt>
<dd>Named list of columns to transform from Avro format plus a valid Avro
schema string for each column, where column names are keys and column schema strings
are values (e.g.,
<code>c(example_primitive_col = "string",
example_complex_col = "{\"type\":\"record\",\"name\":\"person\",\"fields\":[
{\"name\":\"person_name\",\"type\":\"string\"}, {\"name\":\"person_id\",\"type\":\"long\"}]}")</code></dd></dl>

Arguments

Convert column(s) from avro format — sdf_from_avro

<dl>

<dt>x</dt>
<dd>An object coercible to a Spark DataFrame</dd>


<dt>cols</dt>
<dd>Named list of columns to transform from Avro format plus a valid Avro
schema string for each column, where column names are keys and column schema strings
are values (e.g.,
<code>c(example_primitive_col = "string",
example_complex_col = "{\"type\":\"record\",\"name\":\"person\",\"fields\":[
{\"name\":\"person_name\",\"type\":\"string\"}, {\"name\":\"person_id\",\"type\":\"long\"}]}")</code></dd>

</dl>

Convert column(s) from avro format

sdf_from_avro: Convert column(s) from avro format

Description

Usage

Arguments