Distribution-specific notes

Each supported Hadoop distribution makes different choices in terms of packaging, versions of the different components of the Hadoop stack, supported ecosystems.

Each distribution bundles its own libraries and backports specific bugs that can modify the behavior of the Hadoop ecosystem components.

Therefore, there are some specificities related to the support of each Hadoop distribution

• Cloudera CDP
  • Spark support
  • Security
• Cloudera CDH
  • Security
    • DSS regular security and Sentry
  • Scala notebook
  • S3 datasets and Spark 2
  • Impala
• Hortonworks HDP
  • HDP 3.1 support
  • Limitations
  • Security
    • DSS regular security and Ranger
    • DSS User Isolation Framework and Ranger
  • Migrating to HDP 3.X
• Amazon Elastic MapReduce
  • Supported versions
  • Security
  • Deployment scenarios
    • Let DSS dynamically manage one or several EMR clusters
    • Connect DSS to an existing EMR cluster
      • DSS running on one of the cluster nodes
      • DSS outside of the cluster
    • Connect DSS to multiple existing EMR clusters
  • Using EMRFS
    • EMRFS credentials
• Google Cloud Dataproc
  • Security
  • Known limitations
  • Connecting DSS to Cloud Dataproc
    • DSS running on one of the cluster nodes
    • DSS outside of the cluster