HDFS

DSS can connect to filesystems based on the “Hadoop Filesystem” API to

  • Read and write datasets
  • Read and write managed folders

Compatible filesystems

DSS can read/write from any kind of Hadoop Filesystem and has been tested with the following URL schemes:

  • hdfs://
  • maprfs://
  • s3a://
  • wasb://
  • adl://

Note

DSS collectively refers all “Hadoop Filesystem” URIs as the “HDFS” dataset, even though it supports more than hdfs:// URIs

For more information about connecting to Hadoop filesystems and connection details, see hadoop/hadoop-fs-connections.