HySDS-Core



The Hybrid Cloud Science Data System

SUMMARY

The Hybrid Cloud Science Data System, or HySDS (pronounced Hi-S-D-S) started development in 2009 at the NASA Jet Propulsion Laboratory. Science data systems ingest raw scientific data as input and process it into more useful information (climate models, CO2 levels, water levels, etc). JPL's HySDS processes satellite and radar data for use in natural disaster response (ARIA), climate monitoring and prediction (OCO2), and many other large scale projects that need real time environmental data.



As a Hybrid Cloud system, HySDS leverages the processing power of the cloud and on premise computing. This allows maximum flexibility as projects can be scaled up or down as required in a cost efficient way. The mission of HySDS is to provide powerful computing resources to the scientific research community. This way, if one needs to process several petabytes of data, they can do so in several hours without having to utilize an on-site data center. It was released as open source software in 2017 under the Apache License.

A Real World Example

On July 4th and 5th 2019, Ridgecrest California was hit with two large earthquakes, a magnitude 6.4 and magnitude 7.1. The largest earthquakes to hit the region in approximately 40 years.


On July 8th 2019, NASA's Advanced Rapid Image and Analysis (ARIA) team captured satellite RADAR data of the area and compared it against data of the same area captured just 3 months before. 
Using HySDS, the team was able to produce this image:

The map shows changes in surface soil, with the colors representing a level change of 4.8 inches higher or lower than the previous reading. Using this map, scientists in the field are able to assess damage in the area and track the fault lines that gave way. Projects like ARIA allow NASA to promote disaster prediction, preparation, response, and recovery. 

HySDS is the tool that produced these images. While there are plenty of Science Data Systems that can do similar jobs, HySDS provides a convenient, economical, and open source solution.

This collaborative site will be used to document and manage our HySDS projects including Deployment, Operations and Development of JPL's ARIA, NISAR and OCO-2 missions.

 

Have Questions? Ask a HySDS Developer

Join our public Slack channel to learn more about HySDS.

Some useful information for all visitors:

If you aren't sure where to start, check out our guides:

  • Browse HySDS documentation by keyword labels: