Upgrading FM

Description

This guided setup allows you to upgrade an existing Dataiku Cloud Stacks for Google Cloud. It assumes you had followed the guided setup example to build your initial setup.

This guide is also valid when switching from Google Deployment Manager to Infrastructure Manager, as Deployment Manager will be discontinued.

Steps

Warning

For any upgrade to Fleet Manager version 12.6.0 or higher, it is required to previously stop the virtual machine hosting Fleet Manager, or the upgrade process could fail.

Stop Fleet Manager server

  • In Infrastructure Manager (or Deployment Manager), find your deployment. We call it <deployment>

  • Find the Fleet Manager instance instance-<deployment> in Compute Engine VM instances

  • In section Network interfaces, find the Primary internal IP address and make a note of it. We call it <fm-ip-address>

  • Then, click on the vertical dots More actions menu at the top right, then click on Stop

  • Wait for the instance the reach the state Stopped

Backup Fleet Manager’s data disk

  • Go to Compute Engine Disks

  • Look for data-<deployment>

  • Click on Manage resource at the top right

  • Click on Create snapshot

  • Give it an identifiable name, for instance fm-backup-YYYYMMDD, make a note of it, then click on Create

  • Wait for the snapshot to reach status Ready for use

Delete the existing deployment

  • Go back to the deployment in the Infrastucture Manager

  • Click on Delete, then Confirm

If you were previously using Deployment Manager, and the tool is no longer accessible, you may need to delete resources manually.

Create the new stack

  • Follow the guided setup example to deploy the new version of Fleet Manager, but add new elements to the terraform.tfvars file:

    • private_ip_address = <fm-private-ip>

    • snapshot = "global/snapshots/<snapshot-name>" or snapshot = "projects/<project-name>/global/snapshots/<snapshot-name>" if the snapshot is in a different project

Troubleshooting

DSS machines seem unresponsive

In case the DSS machines seem unresponsive in the FM UI following the upgrade, reprovision the different DSS machines for them to be able to communicate again with FM.