DSS in GCP

DSS features deep integration with multiple GCP services:

• Connecting to GCS data

• Connecting to Google Cloud SQL

• Connecting to BigQuery, including fast copy between GCS and BigQuery

• Leveraging Dataproc, including dynamically-managed Dataproc clusters

• Leveraging GKE, including dynamically-managed GKE clusters

• Reference architecture: managed compute on GKE and storage on GCS
  • Overview
  • Security
  • Main steps
    • Prepare the instance
    • Install DSS
    • Setup containerized execution configuration in DSS
    • Setup Spark and metastore in DSS
    • Setup GCS connections
    • Install GKE plugin
    • Create your first cluster
    • Use your cluster