/
Update Cluster with New HySDS Release

Update Cluster with New HySDS Release

Owned by Marjorie Lucas
Last updated: Aug 17, 2020 by Topher Allen
2 min read

Confidence Level Moderate  This article includes input from several JPLers. Multiple subject matter experts can indicate that a page is more frequently reviewed and updated.

Confidence Level Moderate  This article includes input from several JPLers. Multiple subject matter experts can indicate that a page is more frequently reviewed and updated.

 

This guide walks the user through the steps required to deploy a HySDS core release on an existing cluster. This should take roughly 30 minutes.

  1. Refer to Artifactory for a list of releases:
    https://cae-artifactory.jpl.nasa.gov/artifactory/webapp/#/artifacts/browse/tree/General/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2

2. Log into Mozart and stop the cluster

sds stop all -f

3. Log into the AWS console and zero all auto-scaling groups

4. Navigate to current HySDS core tarballs

cd pcm_tarballs/jpl-projects

5. Remove current HySDS core tarballs from this directory

6. Pull HySDS core tarballs from Artifactory (example is for Conda – this command needs to be run for all five component tarballs)

curl -O "https://cae-artifactory.jpl.nasa.gov/artifactory/general-develop/gov/nasa/jpl/iems/sds/pcm/v3.0.2/hysds-conda_env-v3.0.2.tar.gz"

7. Navigate to the home directory

8. Change conda and mozart directory names to temporarily back them up

mv conda conda.back mv mozart mozart.back

9. Remove the verdi directory (this will be recreated)

rm -rf verdi

10. Run the following commands to unpack conda (make sure to change the tarball name):

cd ~ mkdir ~/conda tar xvfz pcm_tarballs/jpl-projects/hysds-conda_env-v3.0.2.tar.gz -C conda conda-unpack

11. Run the following commands to unpack Mozart (make sure to change the tarball name):

tar xvfz pcm_tarballs/jpl-projects/hysds-mozart-venv-v3.0.2.tar.gz

12. Ensure repos are cloned from ~/mozart.back/ops to new folder

13. Edit the sds config file and update verdi version references

vim ~/.sds/config
VERDI_PRIMER_IMAGE: s3://.../hysds-verdi-v3.0.2.tar.gz VERDI_TAG: v3.0.2

13. Run sds update

sds update all -f

14. Navigate to this directory:

cd ~/mozart/pkgs

15. Copy verdi tar to s3

aws s3 cp hysds-verdi-v3.0.2.tar.gz s3://<BUCKET_NAME>/

16. Run this command:

fab -f ~/.sds/cluster.py -R mozart,factotum,verdi update_aria_packages

Note: you may need to copy the settings.yaml from the backed-up mozart directories to the newly-created directories.

17. Run this command:

sds ship

18. Start cluster back up

sds start all -f

 

 

Related Articles:

Have Questions? Ask a HySDS Developer:

Anyone can join our public Slack channel to learn more about HySDS. JPL employees can join #HySDS-Community

JPLers can also ask HySDS questions at Stack Overflow Enterprise

Search HySDS Wiki

Page Information:

Was this page useful?

Yes No

Contribution History:

Subject Matter Expert:

@Andrew M Zhang

Find an Error?

Is this document outdated or inaccurate? Please contact the assigned Page Maintainer:

@Andrew M Zhang

Related content

Note: JPL employees can also get answers to HySDS questions at Stack Overflow Enterprise:

https://stackoverflow.jpl.nasa.gov/