checkpoint_directory: Set/Get Spark checkpoint directory
Description
Set/Get Spark checkpoint directory
Usage
spark_set_checkpoint_dir(sc, dir)spark_get_checkpoint_dir(sc)
Arguments
- sc
A spark_connection
.
- dir
checkpoint directory, must be HDFS path of running on cluster