Saves a SparkDataFrame as a DSS dataset

Saves a SparkDataFrame as a DSS dataset

dkuSparkWriteDataset(
  df,
  name,
  partition = NULL,
  deleteFirst = TRUE,
  schema = TRUE
)

Arguments

df

SparkDataFrame

name

DSS dataset name

partition

Optional partition to write, otherwise writes entire dataset

deleteFirst

Delete existing contents before write, otherwise append

schema

If TRUE, sets dataset schema to match dataframe schema