1 of 14

Working with NASA Earthdata in the Cloud

We believe Open Science can accelerate data- driven solutions and increase diversity, equity, inclusion, and belonging in research and beyond.

Amy Steiker • Bri Lind • Julie Lowndes • Luis López • Michele Thornton •

and the NASA Openscapes Mentors

Winter ESIP 2023

NASA Award# 20-TWSC20-2-0003 Leads: Julia Stewart Lowndes & Erin Robinson

Openscapes artwork by Allison Horst; @allison_horst

slides: https://nasa-openscapes.github.io/about

2 of 14

Teaching NASA Earthdata Cloud

… by learning as a community

NASA Openscapes

A mentor team across NASA Earth science data centers (DAACs)

Co-creating and teaching common tutorials alongside researchers as they migrate analytical workflows to the Cloud

3 of 14

https://nasa-openscapes.github.io/earthdata-cloud-cookbook/cheatsheet.html#tools-services-roadmap

4 of 14

Working alongside NASA Earthdata

Do it yourself

Create an AWS Account
Create and connect to an EC2 instance
See Earthdata Cloud Primer for more info on setup and cost management

Managed Cloud Service

Organizations like 2i2c provide cloud-hosted JupyterHubs for research and education

Institutional support

Smaller or larger scale options may exist for your research group or institution
NASA funding opportunities for cloud computing

https://www.nccs.nasa.gov/nccs-users/instructional/adapt-instructional/jupyter

https://2i2c.org/service/

5 of 14

Working alongside NASA Earthdata

Your preferred language and environment are connected to a remote compute instance:

On the backend, your compute is running in the same place as where the data are stored

For NASA Earthdata Cloud, this is in AWS region us-west-2

Mac Terminal Prompt

6 of 14

https://nasa-openscapes.github.io/earthdata-cloud-cookbook/cheatsheet.html#tools-services-roadmap

7 of 14

Working with NASA Earthdata in the cloud

1. Dataset discovery by keyword, DOI, etc.

8 of 14

Working with NASA Earthdata in the cloud

2. Search files over season of interest

3. Open and plot directly

9 of 14

Earthdata Cloud Cookbook

Supporting NASA Earth science research

teams’ migration to the cloud

https://nasa-openscapes.github.io/earthdata-cloud-cookbook/

Curated collection of tutorials we’ve iterated on and adapted following versions and feedback from live (virtual) training events
Focus on the common steps across DAACs/users
For self-paced learning
Links back to underlying GitHub repo
Under active, open development

A place to learn, share, and experiment with NASA Earthdata on the Cloud. We know this has a lot of moving parts, and we are iterating as we go, and welcome feedback and contributions.

10 of 14

Consistent feedback and iteration has shaped development of migration tools and support mechanisms

End-Users

NASA Openscapes Mentor Community Values

DAAC Staff

Open Science Community

11 of 14

Earthdata Cloud Cookbook

Cheatsheets & Guides

Workflow Cheatsheet

Practical reference guide as user begins taking the conceptual pieces to explore and implement in their own workflows
Guide to selecting from available tools to enable and implement the Access Pathway(s)
Links concepts and tool resources (tutorials)

https://nasa-openscapes.github.io/earthdata-cloud-cookbook/cheatsheet.html#workflow-cheatsheet

12 of 14

https://nasa-openscapes.github.io/earthdata-cloud-cookbook/cheatsheet.html#tools-services-roadmap

13 of 14

Data reduction and transformation

in the cloud

https://github.com/michele-personal/earthdata_hyraxOPeNDAP_access/blob/main/DaymetV4_access_subsetting_NGAP_Hyrax_OPeNDAP_Cali.ipynb

OPeNDAP

Harmony

GIS

https://harmony.earthdata.nasa.gov/�{collectionId}/ogc-api-coverages/�1.0.0

https://nasa-openscapes.github.io/2021-Cloud-Hackathon/tutorials/07_Harmony_Subsetting.html

http://gis.earthdata.nasa.gov/

14 of 14

Thank you!

Find out more:

NASA Openscapes