spark_session_config

Retrieves or sets runtime configuration entries for the Spark Session

R interface to Apache Spark, a fast and general
engine for big data processing, see <https://spark.apache.org/>. This
package supports connecting to local and remote Apache Spark clusters,
provides a 'dplyr' compatible back-end, and provides an interface to
Spark's built-in machine learning algorithms.

Edgar Ruiz

sparklyr

R Interface to Apache Spark

Javier Luraschi

Kevin Kuo

Kevin Ushey

JJ Allaire

Samuel Macedo

Hossein Falaki

Lu Wang

Andy Zhang

Yitao Li

Jozef Hajnala

Maciej Szymkiewicz

Wil Davis

 RStudio

 The Apache Software Foundation

spark_session_config function

<dl><dt>sc</dt>
<dd>A <code>spark_connection</code>.</dd>
<dt>config</dt>
<dd>The configuration entry name(s) (e.g., <code>"spark.sql.shuffle.partitions"</code>).
Defaults to <code>NULL</code> to retrieve all configuration entries.</dd>
<dt>value</dt>
<dd>The configuration value to be set. Defaults to <code>NULL</code> to retrieve
configuration entries.</dd></dl>

Arguments

Runtime configuration interface for the Spark Session — spark_session_config

<dl>

<dt>sc</dt>
<dd>A <code>spark_connection</code>.</dd>


<dt>config</dt>
<dd>The configuration entry name(s) (e.g., <code>"spark.sql.shuffle.partitions"</code>).
Defaults to <code>NULL</code> to retrieve all configuration entries.</dd>


<dt>value</dt>
<dd>The configuration value to be set. Defaults to <code>NULL</code> to retrieve
configuration entries.</dd>

</dl>

Runtime configuration interface for the Spark Session

spark_session_config: Runtime configuration interface for the Spark Session

Description

Usage

Arguments

See Also