Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 46 Next »

Question

Answer

Slack Link

Comments

1

Where can I find feature milestones for HySDS?

under the general module: https://github.jpl.nasa.gov/hysds-org/general/milestones

2

How/where can users be added to the Github repo?

https://github.jpl.nasa.gov/hysds-org/general/issues

needs to be re-worded to be specific to hysds core”

3

Where are project level issues posted to?

https://github.jpl.nasa.gov/hysds-org/general/issues

question is important but answer needs to be checked for accuracy.”

4

A little off topic question, can jobs be run as lambdas?

Hook Hua  1:25 PM

@Sujen Shah great question. We are planning for that in our AIST 2018 project. Also looking into running serverless equivalents across AWS, Google Cloud Platform, and Azure

https://jpl.slack.com/archives/C99QZ9THS/p1585678154018600

5

Documentation question: After you stand up HySDS system, how do you add another queue?

https://jpl.slack.com/archives/C99QZ9THS/p1587670631026100

6

How do you do the import of the kibana in the dashboard?

https://github.com/sdskit/sdscli/blob/develop/sdscli/adapters/hysds/files/kibana_dashboard_import/import_dashboard.sh.tmpl

7

Does any one remember what was the resolution for this error ?

Failed to download image {}:

Cooperation error for /data/work/cache{}: Unable to locate credentials

https://jpl.slack.com/archives/C99QZ9THS/p1592504922164800

8

Please advise whether there is a better way of doing it than this:

Cloned git repos.  Finished updating code to remove triage and update queues.

After I pushed the source code, had to go to each repo to cut a new release

Then I had to startup both dev Mozart and Tosca and [cont.]

  

https://jpl.slack.com/archives/C99QZ9THS/p1587597632025400

9

do we have a post processor job in hysds configured in the job_spec that is run after the current job has successfully finished publishing to the database ?

My use case is to download the generated product to a location on prem at JPL (Product delivery to LOM) ?

Currently we are using triggers to achieve this, but it is not efficient. Since the PGE and delivery jobs are different and run on different nodes we are not leveraging caching.

Lan B Dang  10:45 AM

Isn't that what triage uses?

Hook Hua  10:48 AM

@Sujen Shah I think there are many ways to achieve this. The default way is via triggers to keep it generic and flexible. Another way to avoid triggered rules evaluation is to have the PGE (or post-step) directly submit the “localize to on-prem” job.

https://jpl.slack.com/archives/C99QZ9THS/p1585676549002300

10

Could either of you give me the commands to backup the elasticsearch indices in mozart and grq?  I want to start with a relatively clean slate on OCO-2 HySDS processing but I'd like to keep the ES indices for later analysis.

Do you want to back it up to a different ES installation, or to a file ?

Lan B Dang  1:56 PM

to a file

Sujen Shah  1:56 PM

I use the npm elasticdump utility to back up to a file

https://jpl.slack.com/archives/C99QZ9THS/p1578952465001200

11

Is there example code to populate a new ES index based on products already ingested into an S3 bucket?

https://jpl.slack.com/archives/C99QZ9THS/p1574742336001700

12

Is there a master list of HySDS TPS by release?

as far a TPS such as ES, rabbitmq, and redis, no. But in each release tarball in artifactory, there is a list of the python dependency packages included in the tarball.

https://jpl.slack.com/archives/C99QZ9THS/p1571856108002100

13

 as per our latest community forum, we have multiple functionalities that are being developed and brought into core, for eg. Caching, Triaging, etc… Is there a place wiki / github where these core features are being designed, reviewed and commented upon before they are actually developed and pushed  on github ?

If not I would like to propose we create an issue against the https://github.com/hysds/hysds-framework repo and discuss there before the actual development begins.

great idea. we have pushed out features as github milestones. They are on JPL’s GHE under the “general” module https://github.jpl.nasa.gov/hysds-org/general/milestones. it documents things like multi-tier caching https://github.jpl.nasa.gov/hysds-org/general/milestone/16

I understand that SWOT also has their own separate repos for HySDS Core features.

The current bottleneck is that we did a previous initial copy our onto https://github.com/hysds/ and it went out of sync since there are other HySDS Core repos

https://jpl.slack.com/archives/C99QZ9THS/p1523660808000108

14

Who is HySDS for?

FAQ

15

What kind of data does it process?

16

Where do you get the raw data before it's processed?

17

Is the raw data something I can access? If so, how?

18

Is the hysds processed data something I can access? If so, how?

19

How much is running HySDS on Amazon going to cost me?

20

How much time will it take for me to learn how to use this?

21

How do I interpret the interferograms that HySDS produces?

22

How do I write some code that HySDS can utilize?

23

I’m a scientist conducting earth science research, how do I access the data produced by hysds?

24

I’m a member of the scientific community, where can I go to download the hysds software and set it up?

25

Can I use hysds to process my own earth science data?

26

Purple questions = Questions posed on placeholder FAQ page

Jira ticket for question revision: https://hysds-core.atlassian.net/browse/HC-240



Note: JPL employees can also find answers to HySDS questions at Stack Overflow Enterprise


  • No labels