Update Cluster with New HySDS Release

This guide walks the user through the steps required to deploy a HySDS core release on an existing cluster. This should take roughly 30 minutes.

2. Log into Mozart and stop the cluster

sds stop all -f

3. Log into the AWS console and zero all auto-scaling groups

4. Navigate to current HySDS core tarballs

cd pcm_tarballs/jpl-projects

5. Remove current HySDS core tarballs from this directory

6. Pull HySDS core tarballs from Artifactory (example is for Conda – this command needs to be run for all five component tarballs)

curl -O "https://cae-artifactory.jpl.nasa.gov/artifactory/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2/hysds-conda_env-v3.0.2.tar.gz"

7. Navigate to the home directory

8. Change conda and mozart directory names to temporarily back them up

mv conda conda.back
mv mozart mozart.back

9. Remove the verdi directory (this will be recreated)

rm -rf verdi

10. Run the following commands to unpack conda (make sure to change the tarball name):

cd ~
mkdir ~/conda
tar xvfz pcm_tarballs/jpl-projects/hysds-conda_env-v3.0.2.tar.gz -C conda
conda-unpack

11. Run the following commands to unpack Mozart (make sure to change the tarball name):

tar xvfz pcm_tarballs/jpl-projects/hysds-mozart-venv-v3.0.2.tar.gz

12. Ensure repos are cloned from ~/mozart.back/ops to new folder

13. Edit the sds config file and update verdi version references

vim ~/.sds/config

VERDI_PRIMER_IMAGE: s3://.../hysds-verdi-v3.0.2.tar.gz
VERDI_TAG: v3.0.2

13. Run sds update

sds update all -f

14. Navigate to this directory:

cd ~/mozart/pkgs

15. Copy verdi tar to s3

aws s3 cp hysds-verdi-v3.0.2.tar.gz s3://<BUCKET_NAME>/

16. Run this command:

fab -f ~/.sds/cluster.py -R mozart,factotum,verdi update_aria_packages

Note: you may need to copy the settings.yaml from the backed-up mozart directories to the newly-created directories.

17. Run this command:

sds ship

18. Start cluster back up

sds start all -f