Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

(blue star) Confidence Level Moderate  This article includes input from several JPLers. Multiple subject matter experts can indicate that a page is more frequently reviewed and updated.

This guide walks the user through the steps required to deploy a HySDS core release on an existing cluster. This should take roughly 30 minutes.


  1. Refer to Artifactory for a list of releases:
    https://cae-artifactory.jpl.nasa.gov/artifactory/webapp/#/artifacts/browse/tree/General/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2

2. Log into Mozart and stop the cluster

Code Block
sds stop all -f

3. Log into the AWS console and zero all auto-scaling groups

4. Navigate to current HySDS core tarballs

Code Block
cd pcm_tarballs/jpl-projects

5. Remove current HySDS core tarballs from this directory

6. Pull HySDS core tarballs from Artifactory (example is for Conda – this command needs to be run for all five component tarballs)

Code Block
curl -O "https://cae-artifactory.jpl.nasa.gov/artifactory/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2/hysds-conda_env-v3.0.2.tar.gz"

7. Navigate to the home directory

8. Change conda and mozart directory names to temporarily back them up

Code Block
mv conda conda.back
mv mozart mozart.back

9. Remove the verdi directory (this will be recreated)

Code Block
rm -rf verdi

10. Run the following commands to unpack conda (make sure to change the tarball name):

Code Block
cd ~
mkdir ~/conda
tar xvfz pcm_tarballs/jpl-projects/hysds-conda_env-v3.0.2.tar.gz -C conda
conda-unpack

11. Run the following commands to unpack Mozart (make sure to change the tarball name):

Code Block
tar xvfz pcm_tarballs/jpl-projects/hysds-mozart-venv-v3.0.2.tar.gz

12. Ensure repos are cloned from ~/mozart.back/ops to new folder

13. Edit the sds config file and update verdi version references

Code Block
vim ~/.sds/config
Code Block
VERDI_PRIMER_IMAGE: s3://.../hysds-verdi-v3.0.2.tar.gz
VERDI_TAG: v3.0.2

13. Run sds update

Code Block
sds update all -f

14. Navigate to this directory:

Code Block
cd ~/mozart/pkgs

15. Copy verdi tar to s3

Code Block
aws s3 cp hysds-verdi-v3.0.2.tar.gz s3://<BUCKET_NAME>/

16. Run this command:

Code Block
fab -f ~/.sds/cluster.py -R mozart,factotum,verdi update_aria_packages

Note: you may need to copy the settings.yaml from the backed-up mozart directories to the newly-created directories.

17. Run this command:

Code Block
sds ship

18. Start cluster back up

Code Block
sds start all -f


(lightbulb) Have Questions? Ask a HySDS Developer:

Anyone can join our public Slack channelto learn more about HySDS. JPL employees can join #HySDS-Community

(blue star)

JPLers can also ask HySDS questions atStack Overflow Enterprise

(blue star)

Live Search
placeholderSearch HySDS Wiki