Facet Search

Available for metrics, resources

Metrics

Available for jobs, infrastructure

Trigger Rules

Enact automated and customized processing and analysis

Jobs Resiliency

Generic trigger rules enable handling of common failed jobs

Support for "job drain" handling

Support for network disconnects from compute fleet

Cloud Features

Cross-cloud hybrid

Can run on: AWS, Azure, GCP, NASA High-End Computing (HEC) in development, On-premise (via OpenStack and bare metal), Kubernetes in development

Support for AWS EC2 spot market terminations

Support for AWS AZ load re-balancing termination

Workers can run on pre-emptable compute instances with resiliency

Multi-tier dataset caching (Dataset Orphan Finder)

SDS Watch

Real-time metrics of events at the SDS domain layer (separate from infrastructure or cloud layer)

@Hook Hua *Unclear how/where to classify:

With the volatility of running at large-scales in the cloud, data publishing of especially large datasets may eventually encounter disruptions during upload to S3 and catalog indexing.