This guide walks the user through the steps required to deploy a HySDS core release on an existing cluster. This should take roughly 30 minutes.
Refer to Artifactory for a list of releases:
https://cae-artifactory.jpl.nasa.gov/artifactory/webapp/#/artifacts/browse/tree/General/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2
2. Log into Mozart and stop the cluster
sds stop all -f
3. Log into the AWS console and zero all auto-scaling groups
4. Navigate to current HySDS core tarballs
cd pcm_tarballs/jpl-projects
5. Remove current HySDS core tarballs from this directory
6. Pull HySDS core tarballs from Artifactory (example is for Conda – this command needs to be run for all five component tarballs)
curl -O "https://cae-artifactory.jpl.nasa.gov/artifactory/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2/hysds-conda_env-v3.0.2.tar.gz"
7. Navigate to the home directory
8. Change conda and mozart directory names to temporarily back them up
mv conda conda.back mv mozart mozart.back
9. Remove the verdi directory (this will be recreated)
rm -rf verdi
10. Run the following commands to unpack conda (make sure to change the tarball name):
cd ~ mkdir ~/conda tar xvfz pcm_tarballs/jpl-projects/hysds-conda_env-v3.0.2.tar.gz -C conda conda-unpack
11. Run the following commands to unpack Mozart (make sure to change the tarball name):
tar xvfz pcm_tarballs/jpl-projects/hysds-mozart-venv-v3.0.2.tar.gz
12. Edit the sds config file and update verdi version references
vim ~/.sds/config
VERDI_PRIMER_IMAGE: s3://.../hysds-verdi-v3.0.2.tar.gz VERDI_TAG: v3.0.2
13. Run sds update
sds update all -f
14. Navigate to this directory:
cd ~/mozart/pkgs
15. Copy verdi tar to s3
aws s3 cp hysds-verdi-v3.0.2.tar.gz s3://<BUCKET_NAME>/
16. Run this command:
fab -f ~/.sds/cluster.py -R mozart,factotum,verdi update_aria_packages
Note: you may need to copy the settings.yaml from the backed-up mozart directories to the newly-created directories.
17. Run this command:
sds ship
18. Start cluster back up
sds start all -f