HDFS

DSS can connect to filesystems based on the “Hadoop Filesystem” API to

  • Read and write datasets
  • Read and write managed folders

Compatible filesystems

DSS can read/write from any kind of Hadoop Filesystem and has been tested with the following URL schemes:

  • hdfs://
  • maprfs://
  • s3a://
  • wasb://
  • adl://

Note

DSS collectively refers all “Hadoop Filesystem” URIs as the “HDFS” dataset, even though it supports more than hdfs:// URIs

For more information about connecting to Hadoop filesystems and connection details, see Hadoop filesystems connections (HDFS, S3, EMRFS, WASB, ADLS, GS).