Learn R Programming

sparklyr (version 1.8.4)

sdf_drop_duplicates: Remove duplicates from a Spark DataFrame

Description

Remove duplicates from a Spark DataFrame

Usage

sdf_drop_duplicates(x, cols = NULL)

Arguments

x

An object coercible to a Spark DataFrame

cols

Subset of Columns to consider, given as a character vector