transform_sdf

transform a subset of column(s) in a Spark Dataframe

R interface to Apache Spark, a fast and general
engine for big data processing, see <https://spark.apache.org/>. This
package supports connecting to local and remote Apache Spark clusters,
provides a 'dplyr' compatible back-end, and provides an interface to
Spark's built-in machine learning algorithms.

Edgar Ruiz

sparklyr

R Interface to Apache Spark

Javier Luraschi

Kevin Kuo

Kevin Ushey

JJ Allaire

Samuel Macedo

Hossein Falaki

Lu Wang

Andy Zhang

Yitao Li

Jozef Hajnala

Maciej Szymkiewicz

Wil Davis

 RStudio

 The Apache Software Foundation

transform_sdf function

<dl><dt>x</dt>
<dd>An object coercible to a Spark DataFrame</dd>
<dt>cols</dt>
<dd>Subset of columns to apply transformation to</dd>
<dt>fn</dt>
<dd>Transformation function taking column name as the 1st parameter, the
corresponding <code>org.apache.spark.sql.Column</code> object as the 2nd parameter,
and returning a transformed <code>org.apache.spark.sql.Column</code> object</dd></dl>

Arguments

transform a subset of column(s) in a Spark Dataframe — transform_sdf

<dl>

<dt>x</dt>
<dd>An object coercible to a Spark DataFrame</dd>


<dt>cols</dt>
<dd>Subset of columns to apply transformation to</dd>


<dt>fn</dt>
<dd>Transformation function taking column name as the 1st parameter, the
corresponding <code>org.apache.spark.sql.Column</code> object as the 2nd parameter,
and returning a transformed <code>org.apache.spark.sql.Column</code> object</dd>

</dl>

transform a subset of column(s) in a Spark Dataframe

transform_sdf: transform a subset of column(s) in a Spark Dataframe

Description

Usage

Arguments