...
Security Groups: Define network settings and firewall on EC2 instances
Elastic Block Store (EBS): Provides block level storage to be used with EC2 instances, allows you to choose which file system you want.
Simple Cloud Storage Service (S3): Object store, primarily used to store files.
All data products (inputs and outputs) are stored in S3
PGE Code is stored in S3 buckets
Snapshots stored in S3
Amazon Machine Image (AMI): Used to create virtual machine within EC2. It contains a snapshot (OS, Application, Application Server), launch permissions, etc. HySDS uses 4 AMIs :
HySDS uses 4 AMIsthat correspond to the EC2 instances:
GRQ
Factotum
Metrics
Mozart
Elastic search: AWS allows you to integrate Elasticsearch in order to store metadata
All relevant metadata associated with jobs is stored in Elasticsearch. To access elasticsearch in HySDS, open the resource manager and press es:head in the navigation bar
...