v3.0.0-rc.4: HySDS framework version 3.0.0-rc.4 (Greta Thunberg)

pymonger released this 23 days ago · 2 commits to master since this release

Bug fixes and enhancements:

container-builder[v0.1.3]

https://github.com/hysds/container-builder/releases/tag/v0.1.3

handle publish to figaro/mozart interface

hysds_commons[v0.2.3]

https://github.com/hysds/hysds_commons/releases/tag/v0.2.3

Bug fixes and enhancements:

fix schema type for 'optional'
add unit test and bump version

hysds-cloud-functions[v0.0.1]

https://github.com/hysds/hysds-cloud-functions/releases/tag/v0.0.1

Bug fixes and improvements:

HC-103: Update create cloud staging area command to support non-signal file based triggers
HC-104: Update ingest lambda to support regex to job type mapping

lightweight-jobs[v0.0.8]

https://github.com/hysds/lightweight-jobs/releases/tag/v0.0.8

Bug fixes and enhancements:

Add exclude glob option in wget job (#10)
Refine defaults needed for thresholding
change defaults to make sure globs get the file only, not the full paths!
verify json

sdscli[v0.2.4]

https://github.com/sdskit/sdscli/releases/tag/v0.2.4

Bug fixes and enhancements:

HC-103: Update create cloud staging area command to support non-signal file based triggers (#32)
- Do not set a default value for the --suffix flag
HC-104: Updated to support a mapping of job types to regexes for ingest lambda (#33)
- This update was made to support having an ingest lambda with a regex to job type mapping.
don't croak if pele data and migration already created and initialized
add option to only update configuration (--config-only) (#31)
- cleanup previous duplication
fix kibana dashboard importer
- wait for kibana to start up
set absolute path to ifconfig and route
freeze version to fix import error in prompt_toolkit version 1.0.17
bump version

tosca[v0.3.4]

https://github.com/hysds/tosca/releases/tag/v0.3.4

Bug fixes and enhancements:

changes for configurable native zoom
bump version

Assets21

chimera-v1.0.0-rc.0.tar.gz79.2 KB

container-builder-v0.1.3.tar.gz52.1 KB

figaro-v2.1.2.tar.gz11.1 MB

grq2-v1.1.1.tar.gz4.55 MB

hysds-cloud-functions-v0.0.1.tar.gz691 KB

hysds-dockerfiles-v0.2.2.tar.gz32.5 KB

hysds-v0.3.3.tar.gz118 KB

hysds-verdi-v3.0.0-rc.4.tar.gz1.08 GB

hysds_commons-v0.2.3.tar.gz29 KB

lightweight-jobs-v0.0.8.tar.gz24.2 KB

mozart-v1.1.2.tar.gz11.1 MB

osaka-v0.1.2.tar.gz6.8 MB

pele-v0.0.1-rc.0.tar.gz19 KB

prov_es-v0.2.1.tar.gz18.2 KB

s3-bucket-listing-v0.0.1-beta.1.tar.gz40.9 KB

sciflo-v1.3.2.tar.gz531 KB

sdscli-v0.2.4.tar.gz1.14 MB

spyddder-man-v0.1.0.tar.gz21.2 KB

tosca-v0.3.4.tar.gz38.2 MB

Source code(zip)

Source code(tar.gz)

v3.0.0-rc.3: HySDS framework version 3.0.0-rc.3 (Jack Ryan)

pymonger released this on Sep 6 · 10 commits to master since this release

Bug fixes and enhancements:

container-builder[v0.1.2]

https://github.com/hysds/container-builder/releases/tag/v0.1.2

Bug fixes and enhancements:

HC-51: Update build-container.bash (#6)
HC-26: Use docker registry for storing container images in s3 (#7)
Fix checking of existence of CONTAINER_REGISTRY variable
HC-70 add switch for publishing and gzip image (#8)
HC-70 skip publish (#9)
HC-70 add switch for publishing and gzip image
update README.md

hysds[v0.3.3]

https://github.com/hysds/hysds/releases/tag/v0.3.3

Bug fixes and enhancements:

use regex to extract job type
default job type to unknown
enable task requeueing on worker lost errors
HC-26: Use docker registry for storing container images in s3 (#30)
Bump twisted from 19.2.0 to 19.2.1 (#29)
update requirements
require celery v4.4.0rc3
sync redis dep version
remediate CVE-2019-12855
fix config parsing for queues
source entire environment
HC-83: decouple process_events event handler (#31)
optimize event processing by using unix domain socket to query redis
utilize existing task worker metadata for offline job detection
set various options to optimize celery/rabbitmq interactions
bump version

hysds-dockerfiles[v0.2.2]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v0.2.2

Bug fixes and enhancements:

remove installation of bundled celery v4.2.1
ensure HOME is set and bash profile sourced
update periodic build parameters
publish latest verdi docker image to latest hysds-framework release
not pushing up develop builds as latest
- trigger weekly builds off of master

hysds_commons[v0.2.2]

https://github.com/hysds/hysds_commons/releases/tag/v0.2.2

Bug fixes and enhancements:

HC-50: Make disk_usage, soft_time_limit, and time_limit required
HC-51: job-spec and hysds-io JSON validation
- Added schemas for the job-spec and hysds-io
- Added unit tests to test the schemas
- Updated setup.py in HySDS Commons to install the jsonschema module
- Added a validate.py, which is based off of the one in the container-builder repo.
install checked out repo
fixed bytes decode bug for python3 (#5)
add new system queue
add missing pattern: passthrough
patch fix for validating dataset_jpath specifications (#6)
add test for from value: passthrough (#7)
bump version

lightweight-jobs[v0.0.7]

https://github.com/hysds/lightweight-jobs/releases/tag/v0.0.7

Bug fixes and enhancements:

Add new wget job to download with glob (#8)
correct what we need for thresholding
add required job-spec parameters soft_time_limit and time_limit
update hysds-io for figaro component

osaka[v0.1.2]

https://github.com/hysds/osaka/releases/tag/v0.1.2

Bug fixes and enhancements:

HC-76 Only call startswith with a string parameter if the result is a string
- This prevents TypeError from being thrown when the response is bytes which can happen when given a direct download link
HC-77 open destination file as binary file if the stream is of type urllib3.response.HTTPResponse
HC-76 Osaka HTTP Storage isComposite fails when given URL to binary file
HC-77 TypeError when downloading binary file via HTTP
bump version

sciflo[v1.3.2]

https://github.com/hysds/sciflo/releases/tag/v1.3.2

Bug fixes and enhancements:

update unit tests for lxml 4.4.1
- version 4.4.1 of lxml maintains the ordering of the attribute mapping
  passed in during element creation:
  https://lxml.de/4.4/changes-4.4.1.html
bump version

sdscli[v0.2.2]

https://github.com/sdskit/sdscli/releases/tag/v0.2.2

Bug fixes and enhancements:

disable pty on openssl commands
HC-26: Use docker registry for storing container images in s3
Add CONTAINER_REGISTRY_BUCKET to hold docker registry contents
Updates to install.sh, config.xml, and config-branch.xml
HC-55 (#27)
- use LaunchTemplate
- LaunchTemplate update
- add create_lt, create launch template
- add required launch template config
- update ship verdi
- remove launch template prompt
- add launch template parameters
HC-26: patch update
- Support the use case where CONTAINER_REGISTRY and CONTAINER_REGISTRY_BUCKET are not defined in the config
Keep it consistent with current core and don't add the build args
HC-26: patch update
HC-78 add queues/instance_types questions during sds cloud asg create
remove queue/instance from configure.py
add defaut values
change instance types to be medium
HC-78 add command line support for queues and instance types
- add SKIP_PUBLISH condition check
- add skip publish
HC-70
remove installation of bundled celery v4.2.1
no longer install from git
restore default queues
handle import to mozart or figaro from hysds_ios
bump version

tosca[v0.3.3]

https://github.com/hysds/tosca/releases/tag/v0.3.3

Bug fixes and enhancements:

removed sar avail tmpl from tosca
bump version

Assets21

v3.0.0-rc.2: HySDS framework version 3.0.0-rc.2 (Ally Maine)

pymonger released this on Jun 17 · 12 commits to master since this release

Bug fixes and enhancements:

container-builder[v0.1.1]

https://github.com/hysds/container-builder/releases/tag/v0.1.1

Bug fixes and enhancements:

resolve dependency image urls to cluster code bucket (#5)

figaro[v2.1.2]

https://github.com/hysds/figaro/releases/tag/v2.1.2

Bug fixes and enhancements:

sync figaro/mozart settings
use HTTPS exposed Kibana url

hysds[v0.3.2]

https://github.com/hysds/hysds/releases/tag/v0.3.2

Bug fixes and enhancements:

set autorestart for process_events (#28)
HC-28 Triage ID is now configureable (#24)
added background community resource links
address CVE-2019-12387
add supervisord conf for pele

hysds-dockerfiles[v0.2.1]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v0.2.1

Bug fixes and enhancements:

update periodic build parameters
publish latest verdi docker image to latest hysds-framework release

mozart[v1.1.2]

https://github.com/hysds/mozart/releases/tag/v1.1.2

Bug fixes and enhancements:

use HTTPS exposed Kibana url

pele[v0.0.1-rc.1]

https://github.com/hysds/pele/releases/tag/v0.0.1-rc.1

Bug fixes and enhancements:

remove maka
initial pre-release

sdscli[v0.2.1]

https://github.com/sdskit/sdscli/releases/tag/v0.2.1

Bug fixes and enhancements:

downgrade elasticsearch package version for compatibility with other hysds packages
cleanup datasets.json templates
add fabric commands for remote ls, cat, and tail
sync figaro/mozart settings and datasets.json
use HTTPS exposed Kibana url
populate netrc pointing to mozart-rabbitmq
add capability to do remote docker-compose run
increase connection timeout
remove cryptography pin for paramiko/paramiko#1369
provision pele and chimera
populate pele settings conf
rsync chimera
call correct create-db command

sciflo[v1.3.1]

https://github.com/hysds/sciflo/releases/tag/v1.3.1

Bug fixes and enhancements:

add examples of workflows with chained PGE processes
- one workflow with 5 PGEs in single chain and another with 2 parallel 5 PGE chains merged by one PGE
use exponential backoff querying for job status
add example of early workflow execution stoppage
configure ci/cd on circleci; add build badge
set correct location for celeryconfig.py
ensure UUID is type bytes

tosca[v0.3.2]

https://github.com/hysds/tosca/releases/tag/v0.3.2

Bug fixes and enhancements:

Use more performant billingual mapping via ESRI MapServer

Assets21

v3.0.0-rc.1: HySDS framework version 3.0.0-rc.1 (Frank Hamer)

pymonger released this on May 28 · 20 commits to master since this release

Bug fixes and enhancements:

figaro[v2.1.1]

https://github.com/hysds/figaro/releases/tag/v2.1.1

Bug fixes and enhancements:

add retry count in job description (#3)
added retry count facet and removed retry count display on bottom of results (#9)
moved exit code facet higher, moved retry count display higher (#11)
bump version

grq2[v1.1.1]

https://github.com/hysds/grq2/releases/tag/v1.1.1

Bug fixes and enhancements:

restore exception string
bump version

hysds[v0.3.1]

https://github.com/hysds/hysds/releases/tag/v0.3.1

Bug fixes and enhancements:

added pre-processing checksum functions in hysds/utils.py
added the checksum pre-processing to the list of pre-processing functions
added unit tests
add config for pytest; update reqs
add circleci config
verify integration with circleci pull request builder
address CVE-2019-11324 and CVE-2019-10906; add build badge
address CVE-2017-18342
decode IP address returned from dig
bump version

hysds-dockerfiles[v0.2.0]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v0.2.0

Bug fixes and enhancements:

add script to build releases; build develop release
use circleci environment variables
use CIRCLE_BRANCH env
access buildkit on circleci
trigger on develop branch only

hysds_commons[v0.2.1]

https://github.com/hysds/hysds_commons/releases/tag/v0.2.1

Bug fixes and enhancements:

configure circleci; add build badge
bump version

mozart[v1.1.1]

https://github.com/hysds/mozart/releases/tag/v1.1.1

Bug fixes and enhancements:

fix queue_peeker for python3
bump version

osaka[v0.1.1]

https://github.com/hysds/osaka/releases/tag/v0.1.1

Bug fixes and enhancements:

configure circleci; add build badge
bump version

prov_es[v0.2.1]

https://github.com/hysds/prov_es/releases/tag/v0.2.1

Bug fixes and enhancements:

configure circleci; add build badge
bump version

sdscli[v0.2.0]

https://github.com/sdskit/sdscli/releases/tag/v0.2.0

Bug fixes and enhancements:

add initial framework for container orchestration
print help when no subcommand specified
fix issue where unspecified subcommands gave uninformative error
use autopep8 to style
hammer down requirements
- add boto3 requirement
- add dependency on Jinja2
initial integration of sdsadm
add subcommand for showing logs
allow specification of HySDS release
provide more informative error message
add capability to list containers
refactor start/stop orchestration; add grq init
update README
add cluster configuration to init step
configure credentials
bump version

sciflo[v1.3.1]

https://github.com/hysds/sciflo/releases/tag/v1.3.1

Bug fixes and enhancements:

add examples of workflows with chained PGE processes
- one workflow with 5 PGEs in single chain and another with 2 parallel 5 PGE chains merged by one PGE
use exponential backoff querying for job status
add example of early workflow execution stoppage
configure ci/cd on circleci; add build badge
set correct location for celeryconfig.py
bump version

tosca[v0.3.1]

https://github.com/hysds/tosca/releases/tag/v0.3.1

Bug fixes and enhancements:

enable billingual mapping via german version (#10)
bump version

Assets19

v3.0.0-rc.0: HySDS framework version 3.0.0-rc.0 (Guido van Rossum)

pymonger released this on Apr 8 · 42 commits to master since this release

Bug fixes and enhancements:

port to python3

hysds-dockerfiles[v0.1.0]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v0.1.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
add test script
add usage
install celery-v4.2.1
fix args to rebuild_periodically.sh; run weekly at 07:00 UTC Sunday (00:00 PT Sunday)
update base image
- install gcc to build deps
- install python, libffi and openssl development headers

prov_es[v0.2.0]

https://github.com/hysds/prov_es/releases/tag/v0.2.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
pasteurized
remove imports not yet installed via install_requires
require future
bump version

mozart[v1.1.0]

https://github.com/hysds/mozart/releases/tag/v1.1.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
remediate CVE-2015-8857 and CVE-2015-8858
pasteurized
require future
encode unicode string for hexdigest
bump version

osaka[v0.1.0]

https://github.com/hysds/osaka/releases/tag/v0.1.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
determine how to open local file; dump traceback for better visibility
pasteurized
require future
remove imports not yet installed via install_requires
bump version

sdscli[v0.1.0]

https://github.com/sdskit/sdscli/releases/tag/v0.1.0

Bug fixes and enhancements:

python3 port
remove import of distribute
format to PEP8 spec
pasteurized
remove imports not yet installed via install_requires
require future
install fabric3 and pin cryptography to v2.4.2 to prevent warnings: paramiko/paramiko#1369
install supervisor using master branch with python3 support
update to celery v4.2.1
encode unicode string
load yaml securely
bump version
encode unicode object before hashing

grq2[v1.1.0]

https://github.com/hysds/grq2/releases/tag/v1.1.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
remediate CVE-2015-8857 and CVE-2015-8858
pasteurize
remove imports not yet installed via install_requires
require future
bump version

lightweight-jobs[v0.0.6]

https://github.com/hysds/lightweight-jobs/releases/tag/v0.0.6

Bug fixes and enhancements:

port to python3
format to PEP8 spec

tosca[v0.3.0]

https://github.com/hysds/tosca/releases/tag/v0.3.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
fix location of views/services imports; fix encoding issues
pasteurized
remove imports not yet installed via install_requires
require future
bump version

sciflo[v1.3.0]

https://github.com/hysds/sciflo/releases/tag/v1.3.0

Bug fixes and enhancements:

python3 port
update url location
format to PEP8 spec
add package dependencies
require libxml2-python3 bindings; prettyprint using standard xml lib
remove dependency on libxml2 and libxslt; update packages
disable SOAPpy and m2crypto
fix all unicode encoding issues and assertion results
update sciflo document validation
update to use multiprocessing
update alias
update tests
terminate pool
clean out webservices and soap libs
fix bug in -h/--help option; import correct binning64 module
call updated function name: isAlive()->is_alive()
update signal handling for propagating work unit execution termination
fix encoding issue pulling results from ExecutableWorkUnit; clean up unit test
update all calls to open() to use with statement
fix issues with "ResourceWarning: unclosed file".
fix unit test issues importing modules when running via python setup.py test.
fix bug in generating user's sciflo config directory (~/.sciflo)
fix bug in calling tearDown() in unit test.
create test directory for unit test.
remove dependency on SOAPpy and M2Crypto
call reload() from importlib
bump version

figaro[v2.1.0]

https://github.com/hysds/figaro/releases/tag/v2.1.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
pasteurized
coerce to native string
remove imports not yet installed via install_requires
require future
encode unicode string for hexdigest
bump version

hysds_commons[v0.2.0]

https://github.com/hysds/hysds_commons/releases/tag/v0.2.0

Bug fixes and enhancements:

python3 port
format to PEP8 spec
pasteurized
remove imports not yet installed via install_requires
require future
check type properly
bump version

container-builder[v0.1.0]

https://github.com/hysds/container-builder/releases/tag/v0.1.0

Bug fixes and enhancements:

port to python3
format to PEP8 spec

spyddder-man[v0.1.0]

https://github.com/hysds/spyddder-man/releases/tag/v0.1.0

Bug fixes and enhancements:

removing sling_extract
port to python3
format to PEP8 spec

hysds[v0.3.0]

https://github.com/hysds/hysds/releases/tag/v0.3.0

Bug fixes and enhancements:

python3 port
remove supervisor from required (not python3 compatible yet)
format to PEP8 spec
pasteurized

install future

remove imports not yet installed via install_requires
update to celery v4.2.1
update for redis-py API change (v3.2.0)
- Handle error: redis.exceptions.DataError: Invalid input of type: 'list'. Convert to a byte, string or number first.
decode bytes
install fabric3; decode messaging thread items
decode check_output() output for logging
update README.md
bump version
require prov_es v0.2.0 (python3) version or higher

Assets18

on Mar 20

python2

86d9dbb

tar.gz

v2.1.1-rc.2: HySDS framework version 2.1.1-rc.2 (Neil McCauley)

pymonger released this on Mar 14 · 44 commits to master since this release

Bug fixes and enhancements:

osaka[v0.0.2]

https://github.com/hysds/osaka/releases/tag/v0.0.2

Bug fixes and enhancements:

bump version

sdscli[v0.0.13]

https://github.com/sdskit/sdscli/releases/tag/v0.0.13

Bug fixes and enhancements:

resolve staging area parameter values in ~/.sds/config
resolve ASG parameter values in ~/.sds/config
add ci subcommands to build and remove jenkins jobs

lightweight-jobs[v0.0.5]

https://github.com/hysds/lightweight-jobs/releases/tag/v0.0.5

Bug fixes and enhancements:

added Azure credentials folder import to allow purging of datasets to work
Merge pull request #3 from earthobservatory/azure-dev-1
malarout: Added reprioritize and increment priority feature to retry
malarout: Added from field in retry job spec
malarout: applied bounds on the incremented priority
malarout: updated value of priority increment to +1
malarout: Improved log statements
malarout: changed label for desctructive mozart actions

tosca[v0.2.3]

https://github.com/hysds/tosca/releases/tag/v0.2.3

Bug fixes and enhancements:

add grq mappings on initial user_rules creation
malarout: added facet view template for SAR Avail Tool

container-builder[v0.0.2]

https://github.com/hysds/container-builder/releases/tag/v0.0.2

Bug fixes and enhancements:

ensure previous image is cleaned out prior to build

hysds[v0.2.4]

https://github.com/hysds/hysds/releases/tag/v0.2.4

Bug fixes and enhancements:

bug fixes
- detect additional case of orphaned dataset (no ES doc but exists in store)
increment version

grq2[v1.0.3]

https://github.com/hysds/grq2/releases/tag/v1.0.3

Bug fixes and enhancements:

enhancements
- handle center extraction of multipolygon
bump version

Assets18

v2.1.1-rc.1: HySDS framework version 2.1.1-rc.1 (Michael Corleone)

pymonger released this on Jan 23 · 45 commits to master since this release

Bug fixes and enhancements:

sdscli[v0.0.12]

https://github.com/sdskit/sdscli/releases/tag/v0.0.12

Bug fixes and enhancements:

enhancements
- SSDS-547: updates to move building and shipping of verdi code/config bundles to mozart (https://cae-jira.jpl.nasa.gov/browse/SSDS-547)
- SSDS-548: add script to create user_rules index with proper mapping (https://cae-jira.jpl.nasa.gov/browse/SSDS-548)
- change filter used during describe_images (sdskit/sdscli#19)
- allow override of celeryconfig.py for autoscale workers in hybrid cluster
- SSDS-585: ensure unique jenkins job name based on venue (#21) (https://cae-jira.jpl.nasa.gov/browse/SSDS-585)
  - allows for multiple venues sharing a single ci instance
- remove usage of pip's --process-dependency-links option (removed in pip 19.0)

hysds-dockerfiles[v0.0.4]

https://github.com/hysds/hysds-dockerfiles/releases/tag/v0.0.4

Specify body of new release. Previous release's body below:

Bug fixes and enhancements:

use ISCE v2.2 rev 2532
build images on circleci
- nightlies
- build & deploy to dockerhub
give tosca and figaro on-demand jobs their own queue
remove usage of pip's --process-dependency-links option (removed in pip 19.0)

osaka[v0.0.1]

https://github.com/hysds/osaka/releases/tag/v0.0.1

Bug fixes and enhancements:

-enhancements

updated setup.py (six>=1.10.0)
remove protobuf from requires; let google storage lib handle
updated Azure implementation
- implemented isObjectStore for the Azure adaptor (#4)
- implemented the isObjectStore function on the Azure Blob storage adaptor to eliminate "Azure does not implement 'isObjectStore' call" exceptions
- added .gitignore to support custom vscode configurations
- bugfixes for size() function and overall code cleanup for az.py adaptor
- updated azure-storage to use latest 1.4.0
- added auto credential parsing for Azure adaptor to emulate S3 behavior
- updated README to reflect upgrade of azure-storage package
updated Google Cloud Platform implementation
- updated six and google-cloud-monitoring
- fix google.api_core.exceptions.TooManyRequests: 429
- remove specific version range for google-monitoring-api.
- differentiate object stores that don't have concept of directories (e.g. webdav vs. s3/gs)
added chunk_size parameter for large file uploads
CHUNK_SIZE parameter for large file uploads
bug fixes
- update rmall() to not attempt to remove top level directories if object store.
- fixed some typos in README
- install configparser dependency

grq2[v1.0.2]

https://github.com/hysds/grq2/releases/tag/v1.0.2

Bug fixes and enhancements:

bug fixes
- HC-23: Dataset index only gets one alias from a list of aliases (https://hysds-core.atlassian.net/browse/HC-23)

tosca[v0.2.2]

https://github.com/hysds/tosca/releases/tag/v0.2.2

Bug fixes and enhancements:

enhancements
- merge branch 'merge-saravail' as a feature flag
  - detect if AOI and link to sar availability UI
  - detect if SAR_AVAIL_URL is set
- SSDS-548: add script to create user_rules index with proper mapping (https://cae-jira.jpl.nasa.gov/browse/SSDS-548)
- add URS authentication capability
- provide queue specific for on-demand jobs
bug fixes
ignore status code 400 if user_rules already created

figaro[v2.0.1]

https://github.com/hysds/figaro/releases/tag/v2.0.1

Bug fixes and enhancements:

enhancements
- provide queue specific for on-demand jobs

hysds_commons[v0.1.2]

https://github.com/hysds/hysds_commons/releases/tag/v0.1.2

Bug fixes and enhancements:

enhancements
- filter out new on-demand queues

spyddder-man[v0.0.5]

https://github.com/hysds/spyddder-man/releases/tag/v0.0.5

Bug fixes and enhancements:

enhancements
- doing both sling and extract
- removing sling_extract

hysds[v0.2.3]

https://github.com/hysds/hysds/releases/tag/v0.2.3

Bug fixes and enhancements:

enhancements
- handle multiple profiles during input localization
- to configure profile mapping, define the following in celeryconfig.py:
```
BUCKET_PROFILES = [
    {
        "profile": "default",
        "bucket_patterns": [
            "/hysds-code-bucket/",
            "/hysds-dataset-bucket/"
        ]
    },
    {
        "profile": "grfn-ro",
        "bucket_patterns": None
    }
]
```
- remove redundant call that fails
- handle backwards incompatible changes to redis-py v3.0.1
  - https://github.com/andymccurdy/redis-py#upgrading-from-redis-py-2x-to-30
- copy mounts only if running on kubernetes
- improve disk usage of L1 caching feature
- give tosca and figaro on-demand jobs their own queue
cleanup
- remediate vulnerability: https://nvd.nist.gov/vuln/detail/CVE-2018-18074
- remediate https://nvd.nist.gov/vuln/detail/CVE-2018-20060
- tidy up README.md (#10)

Assets18

v2.1.1-rc.0: HySDS framework version 2.1.1-rc.0 (Michael Myers)

pymonger released this on Oct 22, 2018 · 46 commits to master since this release

Bug fixes and enhancements:

sdscli[v0.0.10]

https://github.com/sdskit/sdscli/releases/tag/v0.0.10

Bug fixes and enhancements:

enhancements
- SSDS-413: added --no-deps for no dependencies
- added running kibana import
- HC-1: pass mozart and grq REST urls to jenkins job configuration
  - remove id and gid args being passed to docker during build.
- SSDS-526: allow creation of minimal AWS creds to enable instance roles on PCM and verdi workers
cleanup
- remove tsunamid from supervisord conf

grq2[v1.0.1]

https://github.com/hysds/grq2/releases/tag/v1.0.1

Bug fixes and enhancements:

use TransverseMercator to determine center
- Handles longitudes -180 to 180 and 0 to 360.

lightweight-jobs[v0.0.4]

https://github.com/hysds/lightweight-jobs/releases/tag/v0.0.4

Bug fixes and enhancements:

clean up build-time

sciflo[v1.2.0]

https://github.com/hysds/sciflo/releases/tag/v1.2.0

Bug fixes and enhancements:

cleanup
- remove irrelevant subpackages: data, catalog, db, plotlib

container-builder[v0.0.1]

https://github.com/hysds/container-builder/releases/tag/v0.0.1

Bug fixes and enhancements:

enhancements
- HC-1 & SSDS-409: remove dependency on celeryconfig.py for mozart and grq rest urls
- HC-14: remove explicit call to encrypt file on s3
  - cluster deployment responsible for turning on default encryption on buckets

spyddder-man[v0.0.3]

https://github.com/hysds/spyddder-man/releases/tag/v0.0.3

Bug fixes and enhancements:

update to use latest pge-base

hysds[v0.2.2]

https://github.com/hysds/hysds/releases/tag/v0.2.2

Bug fixes and enhancements:

enhancements
- specify command as an init process
- HC-4: add dataset publishing self-recovery using publish context
  - clobber orphaned datasets without ES doc
  - submit custom event for clobbering orphaned datasets
- HC-15: add support for K8S
  - generalize handling of container mounts
cleanup
- remove tsunamid from supervisord conf
- HC-7: upgrade requirements with vulnerabilities

Assets18

v2.1.0: HySDS framework version 2.1.0 (Thanos)

pymonger released this on Sep 14, 2018 · 47 commits to master since this release

Changelog

grq2[v1.0.0]

https://github.com/hysds/grq2/releases/tag/v1.0.0

Bug fixes and enhancements:

add W3C PROV concepts to dataset schema

lightweight-jobs[v0.0.3]

https://github.com/hysds/lightweight-jobs/releases/tag/v0.0.3

Bug fixes and enhancements:

enhancement: handle non-file backed datasets

tosca[v0.2.1]

https://github.com/hysds/tosca/releases/tag/v0.2.1

Bug fixes and enhancements:

update to handle non-file backed datasets
- if there is no publish urls, "Browse" button will not be shown
- remove hard-coded legacy urls
- use regex to determine OpenDAP urls

figaro[v2.0.0]

https://github.com/hysds/figaro/releases/tag/v2.0.0

Bug fixes and enhancements:

enhancement: show task errors
enhancement: fix base64 encoding of share link

hysds[v0.2.1]

https://github.com/hysds/hysds/releases/tag/v0.2.1

Bug fixes and enhancements:

bug fixes
- enable harikiri process to page through all autoscaling groups
- catch errors evaluating user rules for jobs and datasets
enhancements
- add script to clean partial datasets that failed on osaka cooperate errors
- add support for non-file backed dataset ingest
- track dataset level W3C PROV relations and elements

Assets18

PreviousNext

Terms
Privacy
Security
Status
Help

Browser not supported