diff --git a/.nojekyll b/.nojekyll index 57d270e..82bdfc4 100644 --- a/.nojekyll +++ b/.nojekyll @@ -1 +1 @@ -a4ca5328 \ No newline at end of file +17a364b7 \ No newline at end of file diff --git a/listings.json b/listings.json index e64260a..b248fe1 100644 --- a/listings.json +++ b/listings.json @@ -3,6 +3,7 @@ "listing": "/news.html", "items": [ "/news/2024-09-26-openscapes-whitehouse/index.html", + "/news/2024-09-17-news-sep-2024/index.html", "/news/2024-09-10-nasa-pi-plenary/index.html", "/news/2024-08-30-esip-summer-2024/index.html", "/news/2024-07-24-2024-nasa-champions-cohort/index.html", diff --git a/news.html b/news.html index 9570fce..168f355 100644 --- a/news.html +++ b/news.html @@ -212,7 +212,7 @@
+
Categories
All (38)
blog (28)
champions (5)
community-call (5)
conference (4)
event (10)
how-we-work (5)
nasa-framework (35)
newsletter (2)
noaa-fisheries (9)
pathways (4)
reflections (1)
talk (2)
water-boards (2)
@@ -241,7 +241,7 @@

NEWS

-
+
-
+
+
+

+

+

+
+ + +
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
@@ -1204,7 +1252,7 @@

-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+
-
+

diff --git a/news/2024-09-17-news-sep-2024/index.html b/news/2024-09-17-news-sep-2024/index.html new file mode 100644 index 0000000..d669cd3 --- /dev/null +++ b/news/2024-09-17-news-sep-2024/index.html @@ -0,0 +1,717 @@ + + + + + + + + + + + + +Openscapes Newsletter #10: Fall 2024 – NASA-Openscapes + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
+
+ +
+ +
+ + +
+ + + +
+ +
+
+

Openscapes Newsletter #10: Fall 2024

+
+
blog
+
newsletter
+
nasa-framework
+
noaa-fisheries
+
pathways
+
reflections
+
+
+ + + +
+ +
+
Authors
+
+

Julie Lowndes

+

Stefanie Butland

+
+
+ +
+
Published
+
+

September 17, 2024

+
+
+ + +
+ + + +
+ + +

Welcome to Openscapes’ tenth newsletter! If you’re interested in seeing these infrequent updates in your inbox, please sign up here (linked from our connect with us page). And! If you have signed up but did not see this in your inbox, please check your spam folder!

+

Cross-posted at openscapes.org/blog, nmfs-openscapes.github.io/blog, nasa-openscapes.github.io/news, openscapes.github.io/pathways-to-open-science/blog

+
+

Hello all,

+

We are feeling rejuvenated momentum and hope going into Fall 2024, and we hope this newsletter finds you well. We have had some recent big inflection points.

+

Openscapes is going to the White House! Openscapes is being recognized at the “Celebration of the OSTP Year of Open Science Recognition Challenge Winners” on September 19. This is a BIG DEAL and we are excited to share the joy with our community. Our September 26 Community Call debriefing The White House trip – which also includes presenting at the Dynamic Convergence Workshop - will continue the celebration as Ileana Fenwick and Julie Lowndes interview each other about their experiences. Please sign up here!

+

NOAA Fisheries announced a 3-year commitment to open science as part of the Biden-Harris Administration Inflation Reduction Act. Openscapes is thrilled to be part of this work. We have been scaffolding with NOAA Fisheries for the past few years – through 10 Champions Cohorts and developing a cross-agency grassroots mentor community (read next paragraph about a recent publication!). This is such a celebration for the open science community as a whole, a high-profile example of what open science can look like in the government. It means open science directly helping meet the needs of changing oceans by supporting the NOAA workforce focused on climate resilience for fishing communities. It is also a huge celebration for NASA, whom NOAA has been watching and inspired by for their efforts in open science.

+

Read our peer-reviewed paper co-authored by Openscapes mentors across organizations – including NASA Earthdata, NOAA Fisheries, U.S. EPA, California Water Boards, Pathways to Open Science, and the Fred Hutch Cancer Center - recently published in Ecology & Evolution. From co-author Anna Holder, Cal EPA / Water Boards: “It’s a short read and quite uplifting and inspirational and provides some more insight and what we’re learning as we implement Openscapes across organizations.” https://doi.org/10.1002/ece3.11341; Blog post

+

Openscapes update from Julie Lowndes, summer 2024 is another big deal. Julie talks about and codifies the Opencapes ethos, the organization’s structure, shares updates on new core team members Liz Neeley and Andy Teucher, how we all work together, and how we are igniting real culture change across science.

+

2023 marked 5 years of Openscapes! We’ve been reflecting on our momentum and impact, and invite you to share what stands out to you in our Openscapes Survey. We’ve been sharing insights via talks and our submission to the Challenge.gov (the catalyst for The White House visit). We plan to share more at a submitted talk at the AGU Fall Meeting in Washington DC in December.

+
+

More highlights

+ + + +
+
+

Talks, workshops, conferences (see Events)

+

Recordings and slides are linked from the posts below.

+ +

Thank you for reading, and for all that you do. Read more about what this amazing community has been up to via blog posts, talks on our media page and events page.

+
+
+

photo with fluffy clouds dominating a blue sky, blue-grey mountains in background, purple clusters of flowers in foreground, green-yellow groundcover and a river barely visible in midground running across the photo

+
Photo by Elliot Lowndes
+
+
+ + +
+ +

Citation

BibTeX citation:
@online{lowndes2024,
+  author = {Lowndes, Julie and Butland, Stefanie},
+  title = {Openscapes {Newsletter} \#10: {Fall} 2024},
+  date = {2024-09-17},
+  url = {https://openscapes.org/blog/2024-09-17-news-sep-2024/},
+  langid = {en}
+}
+
For attribution, please cite this work as:
+Lowndes, Julie, and Stefanie Butland. 2024. “Openscapes Newsletter +#10: Fall 2024.” September 17, 2024. https://openscapes.org/blog/2024-09-17-news-sep-2024/. +
+ +
+
+ +
+ + + + + \ No newline at end of file diff --git a/news/2024-09-17-news-sep-2024/mr-lowndesDSCF1746-square.jpg b/news/2024-09-17-news-sep-2024/mr-lowndesDSCF1746-square.jpg new file mode 100644 index 0000000..f4079f4 Binary files /dev/null and b/news/2024-09-17-news-sep-2024/mr-lowndesDSCF1746-square.jpg differ diff --git a/search.json b/search.json index 256511f..fae3c59 100644 --- a/search.json +++ b/search.json @@ -252,319 +252,291 @@ "text": "We are so thrilled that the Openscapes community is included in the White House Fact Sheet as the Biden-⁠Harris Administration Marks the Anniversary of OSTP’s Year of Open Science!\nThis is a huge deal — and not only because now you can google “White House Openscapes”! This Fact Sheet celebrates The Year of Open Science and a lot of hard work by many people within and across agencies and communities. Congratulations to the many many people involved in this movement. We are proud and honored to be recognized as part of this work.\nWhile Openscapes supports many groups including US Federal agencies like NASA Earthdata, NOAA Fisheries, and the EPA, the Fact Sheet names us specifically as part of our efforts with NOAA Fisheries Open Science. We are so grateful to the NOAA Fisheries team members, some of whom are shown and listed below!\n\n\n\n\n\n\nNOAA Fisheries Openscapes Mentors attending a community session. Mentors: Elizabeth Eli Holmes, Adyan Rios, Em Markowitz, Megsie Siple, Josh London, Molly Stevens, Kathryn Doering, Amanda Bradford, Phoebe Woodworth-Jefcoats, Christine Stawitz, Craig Millard, Andy Jones, Julie Rose, Ana Vaz, John Holzman, Erin Steiner, Matt Grossi, Anna Abelman, Jennifer Bigman, Hem Nalini Mozaria-Luna, Monica Diaz, Elizabeth Gugliotti, Juliette Verstaen, Dale Robinson, Sunny Hospital, Brian Fadely, Craig Faunce, Kristin Holsman, Stacie Koslovsky, Jonathan Richar, Ben Williams, Shannon Hennessey, Maggie Ball, Eric Ward, Jon Brodziak, Devin Johnson, Michael Marsik, Meg Oshima, Eva Schemmel, Kevin Stierhoff, Lynn deWitt, Diana Dishman\n\n\nRead more about our work with open science in government and academia.\n\n3 approaches for the year of open science (post). Summary of a conference panel with Openscapes Mentors from NOAA Fisheries, California Water Boards, NASA’s National Snow and Ice Data Center, and NASA’s Physical Oceanography Distributed Active Archive Center, and University of North Carolina.\nNOAA Fisheries invests in Open Science Mentorship. Report out on the first NMFS Mentor workshops with Openscapes (post)\nExciting Progress for Research Teams using NASA Earthdata in the Cloud: 2023 NASA Openscapes Champions Wrap-up (post)\nCalifornia Water Boards’ 2nd Annual Openscapes Champions Program - Reflections & Future (post)\n2024 Pathways to Open Science Program - in collaboration with PREreview (post). Building community for Black environmental and marine scientists and HBCU students.\nOn-ramp to Open Science at the Fred Hutch Cancer Center. 2023 Fred Hutch Openscapes Champions Wrap-up (post)\n\n\n\n\n\n\n\n\n\n\nCitationBibTeX citation:@online{2024,\n author = {, Openscapes},\n title = {White {House} {Fact} {Sheet} {Mentions} {Openscapes!}},\n date = {2024-02-09},\n url = {https://openscapes.org/blog/2024-02-09-white-house-factsheet-openscapes/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nOpenscapes. 2024. “White House Fact Sheet Mentions\nOpenscapes!” February 9, 2024. https://openscapes.org/blog/2024-02-09-white-house-factsheet-openscapes/." }, { - "objectID": "news/2022-05-12-nasa-2022-champions/index.html", - "href": "news/2022-05-12-nasa-2022-champions/index.html", - "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", + "objectID": "news/2024-05-14-noaa-edmw/index.html", + "href": "news/2024-05-14-noaa-edmw/index.html", + "title": "How the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud", "section": "", - "text": "In Spring 2022 we led our first NASA Openscapes Champions Cohort for research teams that work with NASA EarthData. This cohort is funded by NASA and part of our NASA Openscapes Framework project. For this Cohort, we co-led the cohort with the NASA DAAC mentors and we focused on shifting toward Open science, collaborative, reproducible practices to support research teams as they transition from the download model to the Cloud. We also actively experimented with cloud data access through the Openscapes 2i2c-hosted JupyterHub.\nQuick links:" - }, - { - "objectID": "news/2022-05-12-nasa-2022-champions/index.html#nasa-champions-cohort-overview", - "href": "news/2022-05-12-nasa-2022-champions/index.html#nasa-champions-cohort-overview", - "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", - "section": "NASA Champions Cohort overview", - "text": "NASA Champions Cohort overview\nThe NASA Openscapes Framework project is a 3-year project to support scientists using NASA Earthdata from NASA’s Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs), as they migrate workflows to the cloud. We are just wrapping up Year 1 and amazed at how much we have collectively accomplished this year with the DAAC mentors and participating DAACs as well as all the researchers and research teams we have worked with. You can read more about our first year in our 2021 annual report. \nAs part of this work, with the DAAC mentors, we co-led our first NASA Openscapes Champions cohort. Based on Openscapes’ flagship program, Openscapes Champions, theNASA Openscapes Champions Cohort was a professional development and mentorship opportunity for early adopter, science teams that use NASA Earthdata and were interested in migrating their existing workflows to the cloud through collaborative open data science practices. The Openscapes Champions Cohort ran formally in March - April 2022. \nThe ten research teams who participated were interested in a wide variety of NASA Earthdata and various stages of cloud technology familiarity. You can learn more about their research below. Together as a Champions cohort they discussed what worked and didn’t work as they migrated workflows to the cloud, with a focus on collaboration and open science. We met as a cohort five times over two months, on alternating Fridays. Each cohort call included a welcome and code of conduct reminder, two teaching sessions with time for reflection in small groups or silent journaling and group discussion, before closing with suggestions for future team meeting topics (“Seaside Chats”), Efficiency Tips, and Inclusion Tips. Additional hands-on clinics and coworking sessions were scheduled within this period and will extend for the next two months to support these teams as they continue to work on the cloud workflow migration. In addition, the teams were supported by the Openscapes DAAC mentors and staff and Element84 and had access to Openscapes’ 2i2c Jupyter Hub, which will continue for the next year.\n\n\n\nZoomie class photo of NASA Champions" - }, - { - "objectID": "news/2022-05-12-nasa-2022-champions/index.html#what-did-participants-achieve", - "href": "news/2022-05-12-nasa-2022-champions/index.html#what-did-participants-achieve", - "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", - "section": "What did participants achieve?", - "text": "What did participants achieve?\nJust like our DAAC mentors have built collaborative bridges across the distributed data centers to identify the common parts of cloud data access over the first year of our project, this cohort was an opportunity to connect NASA Earthdata users, building a community that is eager to use data in the cloud and provides a forum to discuss common techniques and challenges. The teams devoted at least 8 hours a month to focus on their workflows. In this time, they thought through and discussed their current NASA Earthdata workflows and planned and experimented with transitioning their workflows to the cloud using Openscapes’ 2i2c-hosted Jupyter Hub as a first step. As in other Openscapes Champions cohorts, teams also realized the power of onboarding to create more resilient labs and they explored creating collaborative spaces for their teams through Google Drive, Slack, and GitHub. \nThemes we revisited throughout the cohort included: \nThe Open science underpinnings of the Openscapes Champions program are important. During our last Champions session when the teams presented their pathways, it was amazing to hear how many times that teams were trying to use Github, Gitlab, or taking away other Open science practices in addition to the cloud-specific. It wasn’t all or nothing, they were taking small steps. It was also great to hear that a takeaway from this cohort is, working more openly and reproducibly provides for a more resilient workflow and team. \nWe intentionally focus on providing a kind welcome to technical topics. The kind space that we co-created with the teams and DAAC mentors provided an opportunity to collaborate as teams and ask questions that may in other settings go unasked because of fear that everyone else already knows. (Note: everyone else doesn’t know and will be glad you asked!)   \nThis also led to several challenges that consistently surfaced and still need more focused effort to resolve. The vocabulary to understand the Cloud needs to be clearly explained. For example, what is an S3 bucket or a “requester pays bucket” and why does a user need to know about AWS West-2? Cloud cost is another challenge. We lower the barrier by providing the 2i2c Jupyterhub, but teams don’t want to depend on our hub. They want their own workspace and want to be able to predict costs more effectively. Finally, our work has been focused on Python because that was the language of choice for DAAC mentors and it is a widely used open-source language in the broader Earth science community. In the Champions Cohort we had three teams using Matlab and one team using R; we need to think about how to expand our support and tutorial materials for these other languages." + "text": "The NOAA Enterprise Data Management Workshop (EDMW) is an annual workshop organized by NOAA staff and affiliates. The purpose of the workshop is to build on past work in enterprise data management at NOAA by highlighting progress, identifying issues, fostering discussions, and determining where new technologies can be applied. This year’s theme is “Bridging the Gap: Ensuring Seamless Data Flow from Acquisition to Access”\nNASA Openscapes was invited to present via Bri Lind (NASA Land Processes data center, LP DAAC). Julie Lowndes (Openscapes) & Ian Carroll (NASA Ocean Biology data center, OB.DAAC) will co-present.\nHow the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud\nAbstract: NASA Openscapes is a community where staff with similar roles supporting users across 12 NASA Earth Science Data Centers (DAACs) have been able to learn, develop common tutorials, and teach together to support users migrating workflows to the Cloud. NASA Openscapes Mentors co-create and maintain an open Earthdata Cloud Cookbook of common reusable open source tutorials that they have co-developed for specific audiences and tested and refined through frequent workshops, hackathons, and Openscapes Champions Cohorts. They also created the earthaccess Python library which made users’ first experience with NASA Earthdata Cloud be two lines of Python code rather than 30 lines of bash code (that also required clicking and managing hidden files for authentication). The work these Mentors do together as a small community has enormous cascading effects, particularly as they visibly practice open science daily via contributions to open source code and documentation. Further, they are connected to other open communities to enable further innovation: like when a conversation at the Ecological Society of America conference led to building the earthdatalogin R library to support researchers R as well as Python and create portable docker containers cloud users. We will share stories and how we work, and how approaches fit and can be leveraged by the NOAA Enterprise Data Management community." }, { - "objectID": "news/2022-05-12-nasa-2022-champions/index.html#closing-thoughts", - "href": "news/2022-05-12-nasa-2022-champions/index.html#closing-thoughts", - "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", - "section": "Closing thoughts", - "text": "Closing thoughts\nAs we indicated at the beginning of this blog, this transition isn’t one that is completed in 2.5 months and so this is not the end for this Cohort. We are moving from the structured sessions of the Champions program into two additional months of coworking time and 1-1 interactions with DAAC mentors and staff and Element84 in order to make lasting changes with cloud data access. \nWe will focus on specific topics like: \n\nPracticing GitHub workflows and teaching others on your team \nCloud spatial subsetting \nEnvironment management for creating cloud computing space that is reproducible and scalable (e.g. docker images) \nDask/Pangeo software stack to enable scalable processing \nCloud costs and setup \nNetCDF to Zarr\nDocker containers \n\nFinally, we are grateful to this Champion Cohort’s early adopter spirit, their time and effort to make this migration, and all of the feedback and input they provided. They all participated in this cohort knowing that they were some of the first research teams to use NASA Earthdata in the cloud and that they were the first NASA Openscapes Champions cohort. This meant that there would be technical challenges as we work out migrating to the cloud, yet what they learn will make it easier for subsequent teams making this same shift. It also exhibited the reciprocal learning that happens; we will refine the NASA Openscapes Champions as we plan for our next cohort and our work with the DAAC mentors in year 2." + "objectID": "news/2024-03-14-emit-methane/index.html", + "href": "news/2024-03-14-emit-methane/index.html", + "title": "Learn about and use methane plume data from EMIT!", + "section": "", + "text": "Please join NASA’s JPL EMIT Science Team and the LP DAAC for a 2-hour virtual workshop demonstrating how to use methane data products (EMITL2BCH4ENH v001 and EMITL2BCH4PLM v001) from the Earth Surface Mineral Dust Source Investigation (EMIT) mission at 12:00 pm PST on March 14, 2024. You can find out more about the EMIT mission, see the contributions these data are making to the US GHG Center, watch the EMIT tutorial series 1-3, and explore EMIT python resources before attending. Please fill out this form to help us better estimate workshop resources. \nDuring the workshop we will use a learning platform that requires a GitHub account to login. Please make an account here if you do not already have one. We will contact you prior to the workshop with more details." }, { - "objectID": "news/2022-05-12-nasa-2022-champions/index.html#nasa-openscapes-champions-teams", - "href": "news/2022-05-12-nasa-2022-champions/index.html#nasa-openscapes-champions-teams", - "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", - "section": "NASA Openscapes Champions Teams", - "text": "NASA Openscapes Champions Teams\nThe Cryosphere Geophysics and Remote Sensing (CryoGARS) Glaciology Team at Boise State University analyzes modern changes to the Earth’s cryosphere, with a focus on rapid changes in glacier flow, glacier-ocean interactions, iceberg melting, and seasonal snow accumulation and melt. Nearly all of our projects use Landsat imagery to map changes in glacier, iceberg, and/or snow extent. Several projects also use Landsat data to map glacier velocities or rely on NASA-produced glacier velocities computed from Landsat and Sentinel-2 data. We also use ICESat-2 data to map glacier volume change and seasonal snow in mountain regions. We look forward to using more cloud resources so that we can expand our analyses in space and time in order to advance our understanding of Cryosphere change!\nThe Mapes Team at the University of Miami studies atmospheric dynamics through multi-source data synthesis, with global grids as the glue. The global grids are huge, so downloading is out of the question. Fetching from aggregations (THREDDS, GDS) works for case studies, but sometimes we need to process it all (simplest example: make a multi-year climatology, to give context to actual fields as “anomalies”). So the data lake in the cloud will be a nice resource, and open new vistas like machine learning which always benefits from more data.\nThe Cornillon Team at the University of Rhode Island has several projects making use of MODIS and VIIRS sea surface temperature (SST). The project of focus for this cohort has been the statistical description of the location, strength, and temporal evolution of SST fronts. As part of this project, we developed an algorithm to unmask pixels improperly flagged as cloud contaminated in the standard MODIS SST products. The improved masks will be made available to the community at large as will the fronts identified by our edge detection algorithm. \nThe Ladies of Landsat Team has members from USGS, UCSB, and the University of Arizona. Kate uses dense time series of Landsat data to build harmonic models to predict land use cover and land use change and its links to climatological signals. Crista and Sarah research the human dimensions of earth observation data, such as Landsat. Nikki uses NASA drought models to map climate hazards in her Navajo Nation community. The research project “Power of the Pixel: Connecting Indigenous Communities through Remote Sensing in the United States” combines the power of all three foci to use NASA/USGS Landsat data to build earth observation capacity in Indigenous communities across the United States.\nThe SASSIE Team has members from the University of Washington, JPL, and APL. They are part of the NASA salinity and SWOT science teams, and regularly use satellite salinity, temperature, altimetry and sea ice data, as well as in situ holdings (SPURS-2, upcoming SASSIE experiment).\nThe Tandon Team at the University of Massachusetts Dartmouth uses remotely sensed data to setup the larger scale perspectives for our more in depth analysis and cruise based work for in-situ experimental data from initiatives in the Indian Ocean such as ASIRI and MISOBOB.\nThe Palter Team at the University of Rhode Island uses NASA data to compare with in-situ observations taken from ships and Uncrewed Surface Vehicles. NASA data provides additional parameters (like ocean surface topography) that are useful in the understanding of in-situ data (for example identifying fronts in the ACC). We have also used ocean color data from MODIS-Aqua to map distributions of ocean surface properties, such as chlorophyll concentration & sea surface salinity (region-specific algorithm), to analyze seasonal, annual, and decadal trends of key biogeochemical processes in the ocean.\nThe Just Team at the Icahn School of Medicine at Mount Sinai uses earth observations to reconstruct ground-level environmental exposures to fine particulate matter, air temperature, and humidity which we use in epidemiologic health studies with cohorts and large registries in the US and Mexico. In a project that started out by seeking to understand the pattern of error in Aerosol Optical Depth (AOD) retrievals, we have developed an R-based reproducible workflow using the targets package for collocating and correcting AOD from the MAIAC algorithm (product MCD19A2 for Aqua and Terra) versus ground stations using gradient-boosted machine learning. This workflow adds reproducibility and extensibility for further development and new applications, building on results we have published for AOD (https://doi.org/10.3390/rs10050803) and for column water vapor (https://doi.org/10.5194/amt-13-4669-2020; data/code in Zenodo: 10.5281/zenodo.3568449).\nThe Hain/SPoRT Team is a directly funded NASA activity and engages with operational stakeholders to transition unique NASA observations and capabilities to improve decision-making.\nThe Roberts Team supports evaluation of global energy and water budgets, develops retrieval algorithms and climate data records (e.g. SeaFlux V1), evaluates air-sea interaction and ocean winds, and downscales and bias corrects models for use in hydrologic and agricultural modeling)." + "objectID": "news/2024-03-04-earthaccess-tech-spotlight/index.html", + "href": "news/2024-03-04-earthaccess-tech-spotlight/index.html", + "title": "earthaccess: Accelerating NASA Earthdata access through open, collaborative development", + "section": "", + "text": "earthaccess is Python library that simplifies data discovery and access to NASA Earthdata. On February 26, the authors co-presented at the NASA Earth Science Data Systems (ESDS) Tech Spotlight meeting — to a crowd of 88 people! The author list is testament to this open community of developers: Luis López, Matt Fisher and Amy Steiker are at the National Snow and Ice Data Center (NSIDC), Aaron Friesz is at the Land Processes Distributed Active Archive Center (LP DAAC), and Qiusheng Wu is at University of Tennessee and an active open science community leader. This is a brief post to share resources and a few highlights - we encourage you to review the slides, recording, repos, and notebooks below. Additionally, please join this open science community effort via regular remote hackdays!\nQuicklinks:\n\nslides - slides co-presented by the authors\nrecording\nearthaccess and the cloud: the force awakens notebook - from Luis’ demo\nOpenGeos: NASA-Earth-Data GitHub repository - from Qiusheng’s demo\nleafmap: nasa earth data notebook - from Qiusheng’s demo\nBi-weekly hackdays, Announcement and ongoing discussions for more info.\n\n\nAmy Steiker began the presentation framing the problems that earthaccess addresses: data accessibility, API fragmentation, and authentication in the cloud.\n\n\n\nearthaccess eliminates the need to know the intricacies of NASA’s Application Programming Interfaces (APIs) and cloud data storage systems.\n\n\nShe described earthaccess as a community, with roots in the NASA Openscapes community where staff with similar roles supporting users across the DAACs (NASA data centers) have been able to learn, develop common tutorials, and teach together.\n\n\n\nThe earthaccess design came from learning/responding to researcher pain points from cross-DAAC Hackathons and Champions Cohorts\n\n\n\n\n\nThis community strategy is a theme and enabler of earthaccess growth and utilization.\n\n\nAaron Friesz then shared about Earthdata Authentication - Old vs New. The old approach was 30 lines of code, where the user also had to interface with the Earthdata login site. earthaccess now replaces this with 1 line of code. Plus, earthaccess also takes care of AWS credentials.\nLP DAAC uses earthaccess in all of its tutorials and teaching events, including ECOSTRESS and EMIT workshops and hackathons. It has changed the way they work, develop, and teach.\nLuis López, earthaccess lead developer, then shared about scaling in the cloud using earthaccess from a earthaccess and the cloud: the force awakens notebook. He shared how earthaccess interfaces between DAACs-AWS and open science community resources.\n\n\n\nearthaccess interfaces between DAACs-AWS and open science community resources.\n\n\nLuis demo’ed many parts of earthaccess:\n\nAccess remote files, automatically handling authentication and serialization.\nGenerate an on-the-fly Zarr compatible cache with Kerchunk!\nSmart Access - Sneak peak today, more details at SciPy 2024!\nScale out workflows with Dask - Processing Terabyte-Scale NASA Cloud Datasets with Coiled\n\nLuis demo’d upcoming features in development for earthaccess that reduce egress sizes (saves NASA $$) and time to science! This is incredibly exciting!\nEgress:\n without earthaccess: 3199.29 MB \n with earthaccess : 112.0 MB\n\nTime to science:\n without earthaccess: 15.9 minutes \n with earthaccess : 0.52 minutes\nQiusheng Wu then shared earthaccess in action with leafmap. Qiusheng built the NASA Earth Data Catalog on top of earthaccess, which uses GitHub Actions to pull the most recent metadata records for NASA Earthdata. Then, using leafmap — Python package for geospatial analysis and interactive mapping in a Jupyter environment that Qiusheng developed — users can interact and view the metadata on a map, exploring and selecting to find the data they want.\nThis is so exciting to have earthaccess involved as the 88th notebook example in the leafmap resource list! You can click to launch the notebook in different coding environments, including Google Colab.\nearthaccess has a lot of momentum moving forward as an open science community, and we welcome you to join our bi-weekly hackdays: fostering new contributions through small group work aligning around specific topics or features. Please reach out if you are interested in joining! See our Announcement and ongoing discussions for more info.\n\n\n\nCitationBibTeX citation:@online{lópez2024,\n author = {López, Luis and Fisher, Matt and Friesz, Aaron and Wu,\n Qiusheng and Steiker, Amy and community, earthaccess},\n title = {Earthaccess: {Accelerating} {NASA} {Earthdata} Access Through\n Open, Collaborative Development},\n date = {2024-03-04},\n url = {https://nasa-openscapes.github.io/news/2024-03-04-earthaccess-tech-spotlight/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nLópez, Luis, Matt Fisher, Aaron Friesz, Qiusheng Wu, Amy Steiker, and\nearthaccess community. 2024. “Earthaccess: Accelerating NASA\nEarthdata Access Through Open, Collaborative Development.” March\n4, 2024. https://nasa-openscapes.github.io/news/2024-03-04-earthaccess-tech-spotlight/." }, { - "objectID": "news/2024-02-28-github-community-call/index.html", - "href": "news/2024-02-28-github-community-call/index.html", - "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", + "objectID": "news/2023-05-11-pathway-cloud-computing/index.html", + "href": "news/2023-05-11-pathway-cloud-computing/index.html", + "title": "Introducing pathway of cloud computing to the NASA user community", "section": "", - "text": "Quicklinks\nOur 10th Openscapes Community Call was a screenshare-and-tell of how we’re using GitHub Issues, Projects, and the new Roadmap feature to have an open, dynamic way for many people to use and contribute to a “calendar”. We embrace working in the open and sharing how-we-work early before trying to make something “perfect” that doesn’t suit people’s needs so we were grateful for questions and suggestions from participants! Presented by Bri Lind, a Geospatial Data Scientist at NASA’s Land Processes Distributed Active Archive Center (LP DAAC) and a NASA Openscapes Mentor and Stefanie Butland Openscapes team member." + "text": "This post is by Xiaohua Pan, from NASA GSFC/Goddard Earth Sciences Data and Information Services Center (GES DISC). Pan participated in the 2021 Cloud Hackathon, led by NASA Data Center (DAAC) staff who are part of the NASA Openscapes Mentor community. Following this first hands-on introduction to NASA Earthdata in the cloud, Pan continued to experiment with transitioning her workflow to the cloud. Sharing her experience through posters, talks, and here in this blog post, she is a research scientist, a data curator, and a bridge-builder between data centers and the user community.\nQuick links" }, { - "objectID": "news/2024-02-28-github-community-call/index.html#how-do-we-know-what-were-doing-together-and-when-were-doing-it", - "href": "news/2024-02-28-github-community-call/index.html#how-do-we-know-what-were-doing-together-and-when-were-doing-it", - "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", - "section": "How do we know what we’re doing together and when we’re doing it?", - "text": "How do we know what we’re doing together and when we’re doing it?\nNASA Openscapes Mentors develop, teach, and support many conference workshops, webinars, and participate in project hackdays with their main goal being to support scientists using NASA Earthdata as they migrate their workflows to the cloud. Bri set the stage with our motivation. People working across 11 NASA data centers (DAACs) need a way to see a year’s worth of “who’s here; what are we doing; when are we doing it; where can we find overlap with each other?” The work requires advance planning, and we’d love to avoid having everyone need to separately look up the registration deadlines for conferences. That can all be on a community calendar. We need a solution that is lightweight, with a low barrier to entry, and agnostic to specific calendaring software like Google Calendar vs Microsoft Outlook." + "objectID": "news/2023-05-11-pathway-cloud-computing/index.html#introducing-pathway-of-cloud-computing-to-the-nasa-user-community", + "href": "news/2023-05-11-pathway-cloud-computing/index.html#introducing-pathway-of-cloud-computing-to-the-nasa-user-community", + "title": "Introducing pathway of cloud computing to the NASA user community", + "section": "Introducing Pathway of Cloud Computing to the NASA user community", + "text": "Introducing Pathway of Cloud Computing to the NASA user community\nOn May 4, 2023, Xiaohua Pan, Christopher Battisto, and Nicholas Lenssen (GES DISC) gave a presentation titled “Pathway Finder of Cloud Computing using NASA Resources: A Case Study of Characterizing Wildfires in Western U.S.,“ hosted by the NASA GSFC Ocean Ecology Lab.\nIn brief, the main purpose of this presentation will be to share with the broad NASA user communities what cloud computing looks like and what the benefits of cloud computing are for an interdisciplinary study. We also share the lessons and challenges learned from this case study. By the way, this talk IS for cloud novices, NOT for cloud gurus.\n\n\n\nTitle slide from the presentation by Pan et al.\n\n\nThis presentation aims to inform and educate the NASA user community on cloud data and cloud computing. They shared the pathways, benefits, and roadblocks to cloud computing using an interdisciplinary case study and live demos of various cloud-accessing scenarios done in a JupyterHub that is part of the NASA Openscapes project managed by 2i2c.\n\n\n\nOutline of the presentation by Pan et al.\n\n\nXiaohua also shared her journal from a scientist doing her research with all on-premises data to a pathfinder conducting her wildfire research in the cloud to shed some light on others to find their journeys to the cloud. Finally, she emphasized the importance of cloud training gained through openscapes as a DAAC staff. This presentation reached about 70 people from NASA earth science divisions and universities. It was well received, with many questions and positive feedback, reflecting the interest and puzzlement of the NASA user community on cloud data and cloud computing.\n\n\n\nInterdisciplinary case study of characterizing wildfires in the western US, from the presentation by Pan et al.\n\n\nXiaohua Pan:\nDr. Pan joined Goddard Earth Sciences Data and Information Services Center (GES DISC) at NASA GSFC in 2020 as a senior scientific software developer, working on data services including curating NASA’s earth data (e.g., MERRA-2) and user support. She also actively writes scientific articles and data recipes, and interacts with data user communities. She had worked on understanding the interaction of air pollution with climate using models and satellite observations in the NASA GSFC Atmospheric Chemistry and Dynamics Laboratory as a research scientist during 2009-2020, and as a NASA NPP postdoc fellow during 2013-2015. Dr. Pan received her Ph.D. majoring in Climate Dynamics in 2009 from George Mason University.\nChris Battisto:\nChris Battisto is an AWS Certified Solutions Architect and Scientific Software Developer at GES DISC since 2021. Chris is part of the User Needs team, and assists in creating tutorials and resources for users who wish to access GES DISC data using programming tools, such as Python, or for training staff and users on cloud resources. Chris has a background in atmospheric science, and received his M.S. in Geography from Northern Illinois University in 2021.\nNick Lenssen:\nNick has been a Scientific Developer at GES DISC since 2021. Nick is responsible for Level 2 subsetting services using Harmony in the cloud and is currently working on onboarding more datasets to the subsetting service. Nick has a background in Meteorology and received his B.S in Meteorology at Florida Institute of Technology." }, { - "objectID": "news/2024-02-28-github-community-call/index.html#how-were-using-github-for-calendaring-and-management", - "href": "news/2024-02-28-github-community-call/index.html#how-were-using-github-for-calendaring-and-management", - "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", - "section": "How we’re using GitHub for calendaring and management", - "text": "How we’re using GitHub for calendaring and management\n\n\n“I’ve been waiting for something like this for… probably a year” - Bri Lind, NASA Land Processes data center.\n\n\nFor the past three years, we have been using GitHub as a community to collaborate around code, tutorials, and documentation, taking advantage of its features for version control, code review, and workshop book publishing. This is important not only because it helps us develop collaboratively as a team, but it’s also the same technology that Earth science researchers use, so we are able to develop practical experience to help them every day as we work. It made sense to explore using GitHub more deeply for our planning and calendaring. \nWe started using GitHub as a centralized place where any of the ~40 NASA Openscapes Mentors can post dates and information for a conference workshop they are leading, for example. Everyone else can see it, and someone might comment “I’m speaking at the same conference. I can give some hands-on help.”, or “Here’s a python notebook I created for a similar workshop last month.” During the Community Call, Stef screenshared our MainPlanning GitHub Project, the Roadmap view (screenshot below) that gives a calendar perspective and the Table view for details on each item. She demo’d creating a GitHub Issue, associating it with the Project, adding topic labels, and a Start date to have it appear in the Roadmap. She showed how we’re also documenting this as we go with screenshots in NASA Earthdata Cloud Cookbook - GitHub for Calendaring and Project Management.\n\n\n\nRoadmap view of a GitHub Project for NASA Openscapes Mentors and collaborators" + "objectID": "news/2023-05-31-zenodo-community/index.html", + "href": "news/2023-05-31-zenodo-community/index.html", + "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", + "section": "", + "text": "We want to share our work in a way that people can find it, use it, improve it, and cite it, or get credit for their contributions. For people who have participated in our programs like Openscapes Champions1, or Pathways to Open Science2, we want a robust way to add these to their CV as professional development. For contributors to our open educational resources, like the NASA Earthdata Cloud Cookbook3, we want them to get credit and visibility. For people who want to reuse or remix a slide from a presentation, we want them to feel great about it by providing an easy way to cite the presentation. To enable all of this, we created a Zenodo Openscapes Community as a semantically meaningful group of selected research products. NASA’s Transform to Open Science (TOPS) and the Center for Scientific Collaboration and Community Engagement’s (CSCCE) Zenodo Communities were inspirations for ours.\nZenodo is a general-purpose open repository that allows researchers to deposit research related digital artefacts like research papers, data sets, research software, reports, lesson materials, and presentations. For each submission, a persistent digital object identifier (DOI) is minted, which makes the stored items easily citable (adapted from Wikipedia). Zenodo allows for versioning and we can preserve GitHub repositories in Zenodo too (GitHub itself is not a repository!).\n\n\n\n\n\n\n\n\nThe Openscapes Approach Guide gives instructions for our use cases, with pointers for things that might not be obvious to a first-time user.\n\nWhat do we curate in our Zenodo Openscapes Community?\nHow to add your existing Zenodo record to the Zenodo Openscapes Community\nHow to publish a new record in Zenodo to get a DOI\nHow to get a DOI for materials on GitHub\nHow to cite Openscapes publications\n\n\n\n\nOf course I want credit for my contributions! When we add an author’s ORCID ID to a Zenodo record, their ORCID profile is automatically updated. I learned of this bonus when I uploaded a post on which I’m a co-author, and then received email notification that this record had been added to my ORCID profile. Why is this so cool? An ORCID ID is a unique, open digital identifier that distinguishes you from every other researcher with the same or a similar name to you. My ORCID profile is a bit like a CV. I use it to collect my research publications (not limited to peer reviewed papers) along with things like education and service on boards. Having it automatically updated is great.\n\n\n\n\n\n\n\nAssociating a Zenodo record with an author’s ORCID ID results in that record being automatically listed in their ORCID profile.\n\n\nWant to create a Zenodo Community? Play in the Sandbox first, where anyone can create and refine a draft Community before publishing it in Zenodo. Creating a Sandbox version forced me to recognize decisions to make before creating the real thing, like: needing to create it from an account that looks professional like “curator”, rather than my personal email username; or deciding what types of research products to include or exclude. This webinar section “How to create a community” screenshares a walk-through that makes things crystal clear." }, { - "objectID": "news/2024-02-28-github-community-call/index.html#how-nasas-lp-daac-and-emit-science-teams-are-expanding-this-approach", - "href": "news/2024-02-28-github-community-call/index.html#how-nasas-lp-daac-and-emit-science-teams-are-expanding-this-approach", - "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", - "section": "How NASA’s LP DAAC and EMIT science teams are expanding this approach", - "text": "How NASA’s LP DAAC and EMIT science teams are expanding this approach\nNASA JPL’s Earth Surface Mineral Dust Source Investigation (EMIT) instrument aboard the International Space Station (ISS) uses imaging spectroscopy to detect surface mineralogy, methane gas plumes and ground surface characteristics from space. The NASA Land Processes data center works closely with the EMIT science team to distribute data and develop tutorial resources and they wanted a way to do that more fluidly. A place to strategically link meeting agendas/ notes/ tasks/ progress in a single ‘open’ location that allows individuals on both teams to be aware of progress and decisions as they are being made. The teams are using this space to do more things in the open and having fewer reasons to say “Where’s that doc? Can you email it to me?”\n\n\n\nTable view of a GitHub Project for NASA Land Processes data center and EMIT science team" + "objectID": "news/2023-05-31-zenodo-community/index.html#our-use-cases", + "href": "news/2023-05-31-zenodo-community/index.html#our-use-cases", + "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", + "section": "", + "text": "The Openscapes Approach Guide gives instructions for our use cases, with pointers for things that might not be obvious to a first-time user.\n\nWhat do we curate in our Zenodo Openscapes Community?\nHow to add your existing Zenodo record to the Zenodo Openscapes Community\nHow to publish a new record in Zenodo to get a DOI\nHow to get a DOI for materials on GitHub\nHow to cite Openscapes publications" }, { - "objectID": "news/2024-02-28-github-community-call/index.html#dig-into-the-discussion", - "href": "news/2024-02-28-github-community-call/index.html#dig-into-the-discussion", - "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", - "section": "Dig into the discussion", - "text": "Dig into the discussion\nFollowing the presentations, we had a rich discussion driven by participants’ questions. Topics included:\n\nhow to get different teams and people to ‘buy into’ a system like this; \nhow readily government agencies adopt this sort of approach with this level of transparency; \nthe importance of having something like this to support collaborations with groups that cannot access an organization’s internal Jira project management system;\nquirks people encounter while GitHub continually improves the Projects system;\n\nWe all agreed on the need to start small to build comfort for people who aren’t yet familiar with GitHub. See our shared notes doc for details of questions and tips from participants" + "objectID": "news/2023-05-31-zenodo-community/index.html#bonus-things-i-learned", + "href": "news/2023-05-31-zenodo-community/index.html#bonus-things-i-learned", + "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", + "section": "", + "text": "Of course I want credit for my contributions! When we add an author’s ORCID ID to a Zenodo record, their ORCID profile is automatically updated. I learned of this bonus when I uploaded a post on which I’m a co-author, and then received email notification that this record had been added to my ORCID profile. Why is this so cool? An ORCID ID is a unique, open digital identifier that distinguishes you from every other researcher with the same or a similar name to you. My ORCID profile is a bit like a CV. I use it to collect my research publications (not limited to peer reviewed papers) along with things like education and service on boards. Having it automatically updated is great.\n\n\n\n\n\n\n\nAssociating a Zenodo record with an author’s ORCID ID results in that record being automatically listed in their ORCID profile.\n\n\nWant to create a Zenodo Community? Play in the Sandbox first, where anyone can create and refine a draft Community before publishing it in Zenodo. Creating a Sandbox version forced me to recognize decisions to make before creating the real thing, like: needing to create it from an account that looks professional like “curator”, rather than my personal email username; or deciding what types of research products to include or exclude. This webinar section “How to create a community” screenshares a walk-through that makes things crystal clear." }, { - "objectID": "news/2024-02-28-github-community-call/index.html#related-resources", - "href": "news/2024-02-28-github-community-call/index.html#related-resources", - "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", - "section": "Related Resources", - "text": "Related Resources\n\nNASA Earthdata Cloud Cookbook developed by NASA Openscapes Mentors\nOpenscapes GitHub Clinics \nCSCCE Open Source Tools Trials:\n\nUsing GitHub to facilitate community activities\nGitHub and Bitergia to support research and developer communities\nUsing GitHub and HedgeDoc to organize and support community events" + "objectID": "news/2023-05-31-zenodo-community/index.html#footnotes", + "href": "news/2023-05-31-zenodo-community/index.html#footnotes", + "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", + "section": "Footnotes", + "text": "Footnotes\n\n\nJulia Stewart Lowndes & Erin Robinson. (2022). Openscapes Champions Lesson Series (2022.12). Zenodo. https://doi.org/10.5281/zenodo.7407247↩︎\nIleana Fenwick & Julia Stewart Lowndes. (2023). Pathways to Open Science (2023.02). Zenodo. https://doi.org/10.5281/zenodo.7662700↩︎\nAndy Barrett, Chris Battisto, Brandon Bottomley, Aaron Friesz, Alexis Hunzinger, Mahsa Jami, Alex Lewandowski, Bri Lind, Luis López, Jack McNelis, Cassie Nickles, Catalina Oaida Taglialatela, Celia Ou, Brianna Pagán, Sargent Shriver, Amy Steiker, Michele Thornton, Makhan Virdi, Jessica Nicole Welch, Erin Robinson, Julia Stewart Lowndes. (2023). NASA EarthData Cloud Cookbook (2023.03). Zenodo. https://doi.org/10.5281/zenodo.7786711↩︎" }, { - "objectID": "news/2024-02-20-github-calendaring/index.html", - "href": "news/2024-02-20-github-calendaring/index.html", - "title": "Community Call: GitHub for NASA Openscapes community calendaring & project management", + "objectID": "news/2023-12-10-agu-fall-meeting/index.html", + "href": "news/2023-12-10-agu-fall-meeting/index.html", + "title": "Activities at the AGU Fall Meeting", "section": "", - "text": "Date: Tuesday, February 20, 2024\nTime: 10:00 - 11:00 am PT (find your local time)\nWhere: Zoom\nRegister (free) via Zoom to get the meeting link\nNASA Openscapes Mentors develop, teach, and support many workshops, events, conversations, and each other with their main goal to support scientists using NASA Earthdata as they migrate workflows to the cloud. We all want (need!) to be able to see ongoing NASA Openscapes events and relevant events across 11 NASA data centers, their planning status, and where they fit in our calendars. We need something that is lightweight with a low barrier to entry. Sure, there are many add-ons to make it more “functional” (GitHub templates, Actions), but for whom? These might be barriers to people less familiar with GitHub.\nWe embrace working in the open and sharing how-we-work early before trying to make something “perfect” that doesn’t suit people’s needs. Join us for a screenshare-and-tell of how we’re using GitHub Issues, Projects, and Roadmap to have an open, dynamic way for many people to use and contribute to this “calendar”. It’s not just about the tools though. We’ll talk about how it started, how it’s going, the mindset, skills, and how we document as we go.\nBring your questions and your experiences. We’re keen to hear about how others have done this and how we can improve our setup. We always save time for audience discussion!\nSpeakers will include Bri Lind, a Geospatial Data Scientist at NASA’s Land Processes Distributed Active Archive Center (LP DAAC) and a NASA Openscapes Mentor, Stefanie Butland from the Openscapes team, and staff from other NASA data centers who are trying out this approach." - }, - { - "objectID": "news/2024-02-20-github-calendaring/index.html#background-and-resources", - "href": "news/2024-02-20-github-calendaring/index.html#background-and-resources", - "title": "Community Call: GitHub for NASA Openscapes community calendaring & project management", - "section": "Background and Resources", - "text": "Background and Resources\nStarter documentation in our NASA Earthdata Cloud Cookbook: GitHub for Calendaring and Project Management\nRead more on our blog about how we work with NASA Openscapes Mentors to support scientists using data from NASA Earthdata as they migrate workflows to the cloud.\nRelated CSCCE Open Source Tools Trials:\n\nUsing GitHub to facilitate community activities\nGitHub and Bitergia to support research and developer communities\nUsing GitHub and HedgeDoc to organize and support community events\n\n\n\n\n\n\nMainPlanning GitHub Project - Roadmap Schedule view" + "text": "At this year’s AGU Fall Meeting Dec 11 - 15, 2023, NASA Openscapes Mentors and collaborators will be giving learning workshops, talks, posters, demos, and more. We’ll also have a Sunday Happy Hour and invite you to join us!\nOur NASA-Openscapes Planning page has up-to-date information of our activities.\nSee also the AGU Searchable Schedule.\nHave a great Fall Meeting and we hope to connect with you there.\n\n\n\nCitationBibTeX citation:@online{openscapes2023,\n author = {Openscapes, NASA},\n title = {Activities at the {AGU} {Fall} {Meeting}},\n date = {2023-12-10},\n url = {https://openscapes.org/blog/2023-12-10-agu-fall-meeting},\n langid = {en}\n}\nFor attribution, please cite this work as:\nOpenscapes, NASA. 2023. “Activities at the AGU Fall\nMeeting.” December 10, 2023. https://openscapes.org/blog/2023-12-10-agu-fall-meeting." }, { - "objectID": "news/2023-10-17-matlab-on-openscapes/index.html", - "href": "news/2023-10-17-matlab-on-openscapes/index.html", - "title": "MATLAB on Openscapes", + "objectID": "news/2023-12-08-coiled-community-call/index.html", + "href": "news/2023-12-08-coiled-community-call/index.html", + "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", "section": "", - "text": "Lisa Kempler works at MathWorks as a Research and Geoscience Strategist. She supports research and educator communities seeking to integrate their platforms with software tools and resources that enable effective data access, computing, and results sharing and publishing. She regularly meets with research communities, including site developers and users of data and compute services, developing programs and working with teams to provide implementation and user support. Lisa attended Brown University, Boston University, and Northeastern University.\nQuick links:\nMore and more data is being made available for users on NASA’s Earthdata Cloud platform. NASA Openscapes collaborates with a community of user-support staff across ten of the NASA Earth science Distributed Active Archives (DAACs), with the aim to help researchers transition their computational workflows to the Cloud using NASA Earthdata.\nThrough the NASA Openscapes Champions, an annual program that supports cohorts of science teams, a number of researchers expressed interest in using the data hosted on NASA Earthdata with MATLAB. The initial NASA Openscapes’ JupyterHub platform hosted by 2i2c, and tutorials, were Python-based. However, to make this transition, users need to be able to use software tools that are familiar to them that enable access to the data and can process it. The NASA Openscapes team reached out to MathWorks, developers of MATLAB, to support the effort to integrate MATLAB into NASA Openscapes JupyterHub and tutorials. The goal was to enable direct Cloud data access from MATLAB.\nTogether, our two teams have successfully installed MATLAB on NASA Openscapes JupyterHub, visible in the screenshot below. It is now available for researchers participating in NASA Openscapes affiliated learning events to try out with Earthdata data. Researchers will “bring their own license” (BYOL) and will be prompted to input that information to access MATLAB.\nThe MATLAB implementation on Openscapes JupyterHub consists of\nIn addition, we’ve written a detailed tutorial to help users learn the system and process the data. The MATLAB tutorial from NASA Openscapes includes code examples, that cover:\nIt’s new to work with NASA Earthdata on the NASA Openscapes JupyterHub, and even newer with MATLAB! We are excited that teams participating in the 2022 and 2023 NASA Openscapes Champions program are already logging into Openscapes and using MATLAB on the platform and continuing to push forward NASA Earthdata Cloud access through MATLAB. We will share more results on this work at the upcoming American Geophysical Union Fall Meeting on Tuesday, December 12. If you are interested in this work, please get in touch (lisak@mathworks.com).\nTo learn more about using MATLAB with data on NASA Openscapes, watch the video presentation to the NASA Openscapes Mentors or read the MATLAB Tutorial.\nAcknowledgements: A special thanks to Erin Robinson of NASA Openscapes and Luis Lopez Espinosa of the National Snow and Ice Data Center (NSIDC) for their collaboration on the NASA Openscapes MATLAB implementation and their contributions to this blog post." + "text": "Quicklinks\nOur 9th Openscapes Community Call featured NASA Openscapes Mentors and the Coiled team demoing approaches to supporting researchers using NASA Earthdata in the Cloud. This built from a previous demo at the National Snow and Ice Data Center User Working Group that presented different Cloud Environment Opportunities to meet users where they are (blog post).\nGoing to AGU 2023? Come say hi to the Coiled team at their booth (right at the entrance next to Google)" }, { - "objectID": "news/2023-10-17-matlab-on-openscapes/index.html#footnotes", - "href": "news/2023-10-17-matlab-on-openscapes/index.html#footnotes", - "title": "MATLAB on Openscapes", - "section": "Footnotes", - "text": "Footnotes\n\n\nMany universities and research institutes have site-wide licenses for MATLAB – called “Campus-Wide Licenses” and “Institute-Wide Licenses”, respectively. Most universities in the U.S. and Canada have CWLs. In those cases, all researchers, faculty and students have access to a MATLAB license via their institutions that work in this BYOL setup. Check with your university system administrators to find out if you have access to a MATLAB license at your institution.↩︎" + "objectID": "news/2023-12-08-coiled-community-call/index.html#background", + "href": "news/2023-12-08-coiled-community-call/index.html#background", + "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", + "section": "Background", + "text": "Background\nNASA Openscapes is a project and community supporting researchers using NASA Earthdata in the Cloud. This community call welcomed our speakers Amy Steiker, Luis Lopez, and Andy Barrett from the National Snow and Ice Data Center (NSIDC) who are NASA Openscapes Mentors, and James Bourbeau from Coiled who is collaborating with NASA Openscapes Mentors and Champions science teams. \nWe followed the Liberating Structures What? So What? Now What? format, with silent journal prompts for reflections and 15 mins of Q&A from questions in chat." }, { - "objectID": "news/2022-12-31-previous-news/index.html", - "href": "news/2022-12-31-previous-news/index.html", - "title": "Previous News 2021-2022", - "section": "", - "text": "As we migrate posts from 2021-2022, please find them here on the main openscapes.org website:\nhttps://openscapes.org/events#category=nasa-framework" + "objectID": "news/2023-12-08-coiled-community-call/index.html#easy-scalable-cloud-computing-with-coiled", + "href": "news/2023-12-08-coiled-community-call/index.html#easy-scalable-cloud-computing-with-coiled", + "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", + "section": "Easy Scalable Cloud Computing with Coiled", + "text": "Easy Scalable Cloud Computing with Coiled\nThe call started with a few demos, first from Andy Barrett and Amy Steiker from NSIDC. Andy shared a science use case based on translating photons measurements from ICESAT-2 to sea ice thickness. These data were first accessed with the earthaccess Python library, then needed to be regridded over geographic areas, which Amy demoed in this Jupyter notebook. Amy ran this code on her laptop and used Coiled to spin up remote virtual machines (VMs) in the cloud to run her computations.\n\n\n\nThen, James ran through two common workflows that process terabyte-scale cloud datasets. In the first example, we saw how to churn through many cloud-hosted NASA Earthdata files (~500 GB of NetCDF files) in parallel on the cloud. This involved lightly decorating an existing Python function with the Coiled Function decorator. The entire workflow ran in <10 minutes and cost ~$0.36.\nIn the next example, we used Xarray to process 6 TB of the cloud-hosted NOAA water model where we computed the average water table depth for each county in the US for the year 2020. We parallelized and distributed the work across 50 VMs using a Coiled cluster. The workflow ran in < 5 minutes and cost ~$1.\n\n\n\nLuis commented on how cloud computing is a barrier for many teams, but tools like Coiled provide options for working in the cloud easily. In fact, Coiled is just half the magic (provisioning cloud resources); the rest is the open source packages, which together help science move faster." }, { - "objectID": "news/2022-12-31-previous-news/index.html#were-migrating-previous-posts", - "href": "news/2022-12-31-previous-news/index.html#were-migrating-previous-posts", - "title": "Previous News 2021-2022", - "section": "", - "text": "As we migrate posts from 2021-2022, please find them here on the main openscapes.org website:\nhttps://openscapes.org/events#category=nasa-framework" + "objectID": "news/2023-12-08-coiled-community-call/index.html#closing", + "href": "news/2023-12-08-coiled-community-call/index.html#closing", + "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", + "section": "Closing", + "text": "Closing\nDiscussion topics included questions about egress costs, compute time, community standards, and more. See the meeting notes for full details." }, { - "objectID": "news/2024-02-26-esds-tech-spotlight/index.html", - "href": "news/2024-02-26-esds-tech-spotlight/index.html", - "title": "NASA Earth Science Data Systems Technology Spotlight", - "section": "", - "text": "Date: Monday, February 26, 2024\nTime: 11:00 - 12:00 MT / 1:00 - 2:00 ET Presenter: Luis Lopez, National Snow and Ice Data Center\nThe monthly Earth Science Data Systems (ESDS) Technology Spotlight webinars provide a platform for ESDIS, the DAACs (NASA Data Centers), IMPACT, and other ESDS initiatives and competitive programs to showcase technology innovations to an ESDS-wide audience and to discuss how these technologies might be adapted and used throughout ESDS. The webinars are open to everyone in the greater ESDS community." + "objectID": "news/2023-12-08-coiled-community-call/index.html#resources", + "href": "news/2023-12-08-coiled-community-call/index.html#resources", + "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", + "section": "Resources", + "text": "Resources\n\nGeospatial Cloud Resources from Coiled\nProcessing Terabyte-Scale NASA Cloud Datasets with Coiled \nProcessing a 250 TB dataset with Coiled, Dask, and Xarray \nCloud Environment Opportunities. Managed JupyterHub options for Cryosphere and NASA Earthdata user communities." }, { - "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html", - "href": "news/2024-03-12-nasa-earthdata-webinar/index.html", - "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", + "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html", + "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html", + "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", "section": "", - "text": "On Wednesday, February 28, NASA Openscapes Mentors from 4 data centers shared how to use the Openscapes Earthdata Cloud Cookbook—a compilation of open-source tutorials, workflows, libraries, and cheatsheets that help users find, access, and work with Earth science data. This was really exciting to have the opportunity for the Mentors to share about this work on a big stage! There were 106 attendees, and recordings of these webinars are often watched by many more! Presenters were Bri Lind from the Land Processes Data Active Archive Center(LP DAAC); Luis Alberto Lopez Espinosa, from the National Snow and Ice Data Center (NSIDC); Cassie Nickles from the Physical Oceanography Data Active Archive Center (PO.DAAC); and Alexis Hunzinger from the Goddard Earth Sciences Data and Information Services Center (GES DISC).\nQuicklinks:" + "text": "From April-May 2024, the NASA Mentors who span eleven Distributed Active Archive Centers (DAACs) co-led the third Champions Cohort with the NASA Openscapes project team, this year focusing on, teaching lessons they adapted for geospatial and cloud analysis. The Cohort included nine international research teams from academia and government that were curious about working with NASA Earthdata in the Cloud. Many teams were interested in using data from multiple DAACs. User cloud adaption takes time, given the new conceptual mindsets and technical skillsets it requires. During the ten weeks we worked together, NASA Mentors refined and extended previous lessons to focus on thinking through and planning the transition to using the Cloud for science research and applications, and initial experiments using the Cloud through our 2i2c JupyterHub. Below are these updates and YouTube clips!\nThere were also recurring themes/questions that we have heard before, some of which remain as open questions and continue to remain a challenge. Importantly, Amazon Web Services (AWS) Cloud onboarding, when to use what resources, how to set them up, and how to discuss needs with organizational leadership and IT staff, which often falls outside the scope of NASA DAACs, yet it’s a key element of helping users adopt the Cloud and use NASA data in the Cloud. It is encouraging to hear some of the champions starting to have conversations with their institutions, IT departments, and making their needs known, which is likely a big part of the solution, too. We are thankful to NASA Openscapes Champions for informing and nudging these conversations! All of this work is underpinned by Openscapes and NASA’s commitment to open science practices and a kinder collaborative culture. This cohort is funded by NASA and is part of our NASA Openscapes Framework project.\nQuick links:" }, { - "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#community-developed-resourcesexplore-the-openscapes-earthdata-cloud-cookbook", - "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#community-developed-resourcesexplore-the-openscapes-earthdata-cloud-cookbook", - "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", - "section": "Community Developed Resources—Explore the Openscapes Earthdata Cloud Cookbook", - "text": "Community Developed Resources—Explore the Openscapes Earthdata Cloud Cookbook\nBri Lind kicked things off by describing data stewardship at NASA. NASA has many discipline specific data centers that archive and manage data from all of the Earth observation missions. She then shifted to NASA Openscapes - a mentor community across those NASA Earth science data centers that helps support users though co-creating common tutorials, hosting cloud training events, and practicing open science ourselves! Bri shared how open science is something we do in our daily work - we write open source code using tools like python, R, Quarto, and GitHub, and interact with open communities like leafmap, Pangeo, and rOpenSci.\n\n\n“We really like to be active in other open source communities” - Bri Lind, Land Processes data center (LP DAAC)\n\n\n\n\n\nLike a spiralling shell, we co-developed across different teams of people that work with NASA Earthdata\n\n\nBri showed an illustration we refer to as the “shell” that shows how like a spiraling shell we co-developed across different teams of people that work with NASA Earthdata. The way this plays out for us: We as a small mentor community (in gray at the top) are able bring our deep expertise about NASA Earthdata from our data centers together to co-develop and learn across the data centers. Then we share back and incorporate with our colleagues at each of our data centers (blue). This means more people and time focussing real-life users (yellow). And we incorporate what we learn back into the open science community (orange). She emphasized that our resources are built with consistent feedback and iteration has shaped development of migration tools and support mechanisms (purple)\nBri also shared that in addition to everything we’ve accomplished together, we’ve all learned new skills and developed new friendships. This trust and ability to work together helps all of the data centers: we can help diverse users and also address the common needs across all users." + "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#nasa-champions-cohort-overview", + "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#nasa-champions-cohort-overview", + "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", + "section": "NASA Champions Cohort Overview", + "text": "NASA Champions Cohort Overview\nNASA Openscapes is a multi-year project to develop a cohesive approach to building cloud migration capacity across NASA Earthdata from NASA’s Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs) and the research teams supported by the DAACs. We do this through supporting a community of NASA DAAC mentors, who are primarily dedicated to user support. This community has learned together how to use NASA Earthdata in the Cloud. They have translated that experience into a series of hackathons, workshops, self-paced tutorial material in the NASA Earthdata Cloud Cookbook, and through an intensive, 10-week NASA Openscapes Champions program.\nUser cloud adaption can often have a steep learning curve and feel overwhelming. The NASA Openscapes Champions Cohort brings together research teams that are interested in migrating their existing NASA Earthdata workflows to the Cloud with NASA DAAC Mentors who are extremely knowledgeable about the data they serve and the initial pathways to using that data in the Cloud. This Cohort provides a common, welcoming place for teams to learn together, ask questions about using the Cloud, plan their transition, and do initial experimentation using the NASA Openscapes 2i2c JupyterHub. Because this is a more intensive experience, the teams build collaborative partnerships with DAAC mentors, and the mentors can more quickly identify and work on solving issues that will make cloud migration easier for many more users. We led the first NASA Openscapes Champions Cohort in 2022.\nThe third NASA Openscapes Champions Cohort ran during April-May 2024 with nine research teams interested in a wide variety of NASA Earthdata and various stages of cloud technology familiarity. You can learn more about their research below.\n\n\n\nVideo conference screen shot (♥) of some researchers in the 2024 NASA Openscapes Champions Cohort.\n\n\nTogether as a Champions Cohort, these teams discussed what worked and didn’t work as they migrated workflows to the Cloud, focusing on collaboration and Open Science. We met as a cohort five times over two months on alternating Wednesdays. Each cohort call included a welcome and code of conduct reminder and two teaching sessions with time for reflection in small groups or silent journaling and group discussion before closing with suggestions for future team meeting topics (“Seaside Chats”), Efficiency Tips, and Inclusion Tips. All topics and the slides presented are shared on the 2024 Cohort page. Additional coworking sessions were scheduled on alternate weeks, where researchers could work quietly, screenshare to ask questions, or meet with their team to discuss further. In addition, the teams have access to Openscapes’ 2i2c Jupyter Hub, which will continue for the next year. \nThe NASA Openscapes Mentors supported the Champions and contributed to the curriculum (all available at https://openscapes.github.io/series). In particular, the NASA Openscapes Champions Curriculum had important additions. \n\nAronne Merrelli (University of Michigan, 2023 Champion) shared his experiences of First Forays into the Cloud, and how it’s possible to go from cloud novice to feeling like it’s a superpower and doing real analyses for his American Geophysical Union (AGU) poster (and beyond!). YouTube clip \nCatalina Taglialatela (PO.DAAC) led the Earthdata Cloud Clinic with datasets from several DAACs and using the earthaccess Python library for NASA Earthdata search & access in the Cloud. \nMatt Fisher (NSIDC) updated psychological safety examples - this lesson particularly resonated with the Champions teams who reflected together about how this is important for learning new things. YouTube clip.\nAlexis Hunzinger (GES DISC) extended the Data strategies in the Cloud lesson with considerations of environmental impact /climate change and streaming data in the same way you stream video on a streaming service such as Netflix, without downloading to a local computer or server.\nCassie Nickles (PO.DAAC) walked through and welcomed contributions to NASA Earthdata Cloud Cookbook, a learning-oriented resources hub to support scientific researchers who use NASA Earthdata as NASA migrates data and workflows to the cloud.- YouTube clip.\nBrianna Lind (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey)’s Open Communities lesson solicited many additional examples including Cloud Native Computing Foundation (CNCF), US Research Software Engineering (US-RSE), Research Data Alliance (RDA), Earth Science Information Partners (ESIP), CryoCloud, Project Pythia.\nMahsa Jami (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey) shared coding strategies for parallelizing code and dove into parallel processing from a scientist perspective. “Pleasingly parallel” is a term for tasks that are completely independent from each other - for example, to validate whether each value in a dataset is within a threshold. YouTube clip.\nLuis Lopez (NSIDC) demonstrated new interactive features of the earthaccess Python library: earthaccess.explore()which provides interactivity without having to download data. This feature only streams metadata (of the dataset’s spatial coverage, volume size) and not the data itself. earthaccess.explore() enables previewing the data and helps narrow down what you may eventually want to stream to memory or download. Additional features enable you to identify different satellite swath overlaps in a selected area and save egress costs because it works more efficiently. YouTube clip.\nAndy Teucher demoed data storage strategies in the Cloud, first via a notebook tutorial about How to store data in the Cloud (including where to store and how to delete your intermediate & test files) and then about storage strategies & costs. YouTube clip.\n\n\n\n\nLuis López demonstrates new interactive features of the earthaccess Python library that enable users to identify different satellite swath overlaps in a selected area.\n\n\n\n\n\nFigure by Andy Teucher showing costs of compute (purple) and storage (blue and green) in the Cloud. HOME directory (Amazon calls this EFS on the backend) is far more expensive than the other options (Amazon calls these S3 buckets).\n\n\nTeams also heard a NASA Earthdata Cloud Update (slides) from Special Guest Justin Rice, NASA Goddard Space Flight Center, ESDIS Project Office, Deputy Project Manager/Data Systems." }, { - "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#when-to-cloud", - "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#when-to-cloud", - "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", - "section": "When to Cloud?", - "text": "When to Cloud?\nAlexis Hunzinger started the “When to Cloud” portion by reminding us that “Cloud” can mean multiple things at once - we also work with data from clouds in the sky!\nWhat is the Cloud? An analogy is helpful: we can compare to how we shifted from renting physical movie DVDs from a store to how we now stream them online. When we think about scientific analysis in the Cloud, we can also think about streaming data. Like streaming a movie, we have to create an account with a provider, choose files from the provider’s archive, and then using your own device (computer), view and analyze with the provider’s resources (remote computers).\n\n\n“What is the Cloud? Any internet-accessible system providing on-demand computing and distributed mass storage” - Alexis Hunzinger, Goddard Earth Sciences Data and Information Services Center (GES DISC)\n\n\n\n\n\nSlide from Alexis showing “What is the Cloud” for NASA Earthdata Cloud\n\n\nNow that we have a shared understanding of what is the Cloud, we can ask ourselves these questions to consider when to Cloud:\n\nWhat is the data volume?\nHow long will it take to download?\nCan you store all that data (cost and space)?\nDo you have the computing power for processing?\nDoes your team need a common computing environment?\nDo you need to share data at each step or just an end product?\n\nThe Cookbook chapter When To ‘Cloud’ section shares more!" + "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#what-we-learned-and-challenges", + "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#what-we-learned-and-challenges", + "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", + "section": "What we learned and challenges", + "text": "What we learned and challenges\nThe Openscapes Champions provides a space for teams to come together to learn from each other and across teams. It is a way to collaborate and distribute leadership roles across the various teams, helping to reduce the burden team leaders often feel of needing to learn everything first before teaching it to the rest of the team. \nHere are the highlights of the third Champions Cohort:\n\nScience teams were using data across DAACs - more this year than ever! It felt great to demonstrate the same earthaccess workflows with datasets from different DAACs.\nEveryone had less capacity to engage this year - both from the Mentors’ side and Champions side. We saw less activity between sessions on Slack and in Coworking. This could in part be video conferencing fatigue, but also might highlight the benefit of people (Mentors + Champions) having additional time outside of the normal five calls to experiment, ask questions, and develop. This kind of engagement has led to useful development in the past (refer to next bullet).\nPast Champions Cohorts have resulted in useful developments, including the earthaccess Python library and MATLAB integration in the Hub. This year, emerging development is around “how to talk to your institution’s IT about your cloud needs” and NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) data access. More to come!\nWe had a lot of “new” content added from what we learned in the last year (Hub storage in S3 buckets, computing concepts, psychological safety!). This meant that we spent less time on core open science skills & practices that we do in the Core Champions Lesson Series (https://openscapes.github.io/series). These core open science skills & practices can help people feel confident and willing to share needs.\nFeedback from participants was valuable:\n\n“Openscapes has allowed me to see that working in Python and in the Cloud is not as scary as I once thought it was. I hope to collaborate more with others that are already using cloud computing so I can get my feet wet in some publishable research using S3 buckets. Where before I would not have thought that I could be a viable contributor.”\n“I used to think that cloud computing was for parallelizing processes and when you needed a really fast computer. I never thought about its ability to store data in a format that is easily accessed for VERY large data sets. I wish that more people in fisheries would start thinking about how their data could be stored in multidimensional arrays rather than flat data frames.”\n“Many people have great ideas but facilitators often have to work to get those ideas out into the open and the same method of getting those ideas out will NOT work on everyone. So, if you care about progress you should care about using multiple avenues to allow people to express themselves.”\n\n\nSeveral challenges working with NASA Earthdata in the Cloud are still unresolved, many which apply more broadly than just NASA data and rather to user adoption of the cloud computing technology in general. These include: \n\nWhile Aronne Merrelli’s story was inspiring, Champions reflected that they find it hard to think about projects that would be good for the Cloud when they have no experience using the Cloud – so how can you find a project to move to the Cloud when your brain won’t let you go there in the first place?\nCost - we still need to have and communicate a better sense of this. We intentionally do not have the “how much does it cost” conversation early on because our intention is to help people experience what it involves and first think about “when to cloud.” However, we do have cost numbers from previous years and plan to gather more cost statistics for the upcoming ESIP summer meeting.\nWe need to think about storage differently in the Cloud because users pay daily to store data in the Cloud. Champions commented that they often “over-produce” files because storage is cheap and access is easy on local machines. How do we learn what is really important and what we can “toss”?\nFolks had interest in learning more about working with confidential data in the Cloud, as researchers often combine non-NASA data for their analyses and this is expected to be an increasing need.\nSeveral themes/questions recurred that we have heard before and for which remain as open questions. Importantly, Amazon Web Services (AWS) Cloud onboarding, when to use what resources, how to set them up, and how to discuss needs with organizational leadership and IT staff, often falls outside the scope of NASA DAACs, yet it’s a key element of helping users adopt the Cloud and use NASA data in the Cloud. It is encouraging to hear some of the champions starting to have conversations with their institutions, IT departments, and making their needs known, which is likely a big part of the solution, too.\n\n\n\n\n\n\nFigure by Alexis Hunzinger showing the focus of cloud for data storage and compute. This figure was also used to frame the EDMW-EarthData-Workshop-2024 taught by the NOAA Coastwatch Champions team." }, { - "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#openscapes-cloud-infrastructure", - "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#openscapes-cloud-infrastructure", - "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", - "section": "Openscapes Cloud Infrastructure", - "text": "Openscapes Cloud Infrastructure\nLuis Lopez said that once we have decided we will work in the Cloud, there are infrastructure considerations.\n\n\n“We are working to bridge the technological gap as well as the knowledge gap to make it easer for everyone to get started in the Cloud” - Luis Lopez, National Snow and Ice Data Center (NSIDC)\n\n\nLuis shared that working in the Cloud in a curated environment supports new learners by lowering technical barriers. In our NASA Openscapes JupyterHub managed by 2i2c, we’re able to support Python, RStudio, MATLAB users, and users can also bring their own base image. AND, the ecosystem of packages like matplotlib and ggplot2 are available from any of those images! This is important since many researchers use a combination of tools.\n\n\n\nA slide from Luis: infrastructure like Jupyter, RStudio, and MATLAB that the user selects will work with the whole ecosytem of R and Python tools" + "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#team-pathways-and-cloud-momentum", + "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#team-pathways-and-cloud-momentum", + "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", + "section": "Team Pathways and Cloud Momentum", + "text": "Team Pathways and Cloud Momentum\nPart of the Openscapes Champions approach is that teams decide what to work on. The teams devoted at least 8 hours a month to focus on their workflows, learning, and collaborating within and across their teams. During this time, they thought through and discussed their current NASA Earthdata workflows and planned and experimented with transitioning their workflows to the Cloud using Openscapes’ 2i2c-hosted Jupyter Hub as a first step. As in other Openscapes Champions cohorts, teams also realized the power of Open Science and that open is a spectrum that includes considering future us - potentially just you or your group in 3 months. \n“Fledging” was a big theme this year, especially following Aronne Merrelli’s talk. We think of this as where do researchers go to do their real science, when they leave the Openscapes 2i2c Hub for experimental purposes? What do they need to know in terms of cost estimates, docker images, administrative personnel (potentially both technical and policy)? We saw teams and the NASA DAAC mentors make substantial progress in migrating workflows to the Cloud. A few highlights from teams that participated in the cohort included:\n\n\nThe Ocean Science Analytics team experimented with and found ‎earthaccess to be insightful and useful! This was valuable as a hands-on activity. The team members have questions about setting up AWS on their own and would like to understand what tools are needed for a specific task. For example, when could dask, an open-source Python library for parallel computing, be used for a task or would another tool be more appropriate?\nThe NOAA IEA (Integrated Ecosystem Assessment) team benefitted from having an improved conceptual understanding of what is involved with cloud workflows – they would like to work with NOAA IT to understand what’s available and possible with JupyterHubs and find workable solutions, now that we understand more of the possibilities.\nThe PACE Hackweek team found Hubs ‎very instrumental in learning cloud computing and helping to create hackweek tutorials. They have used their seaside chats for tutorial development, using GitHub, and have included people outside their team. They have gained more understanding about AWS EC2/storage service by having conversations with Science Managed Cloud Environment (SMCE) for gaining access to Open Science Studio (OSS).\nThe NOAA Coastwatch team took what they learned from the Earthdata Cloud Clinic and reused it to teach 70 colleagues from across NOAA at the NOAA Enterprise Data Management Workshop in their EDMW-EarthData-Workshop-2024. They taught the same tutorials twice, first in Python using earthaccess and then in R using earthdatalogin.\nThe Wimberly Lab Team shared their pathway with a bridge metaphor and how they are tackling challenges through talking about this in lab meetings and learning new tools together. \nAsynchronously, Lucas Barbedo from the Liu-Zhang team shared about using NASA PACE data [comment + thread] in the 2i2c JupyterHub following the Earthdata Cloud Clinic, and shared progress through a GitHub discussion: What’s happening on the NASA Openscapes Hub!? . \n\n\n\n\nFigure by Wimberly Lab (Yusuf Jamal) showing the teams’ pathway with a bridge metaphor. \n\n\nAdditional Cloud resources shared from the NOAA Enterprise Data Management Workshop\n\nhttps://guide.cloudnativegeo.org/\nhttps://abarciauskas-bgse.github.io/presentations/noaa-edmw-intro-2024‎\nhttps://projectpythia.org/dask-cookbook/" }, { - "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#earthdata-cloud-cookbook-walk-through", - "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#earthdata-cloud-cookbook-walk-through", - "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", - "section": "Earthdata Cloud Cookbook Walk-through", - "text": "Earthdata Cloud Cookbook Walk-through\nCassie screenshared a live walk-through of the NASA Earthdata Cloud Cookbook. She pointed out the When to Cloud chapter, as well as a glossary and cheatsheets, Cloud environment setup (under active development), a ‘How do I …’ chapter to do things like find and subset data, or use APIs, a Tutorials chapter with notebooks, and a chapter of workshops and hackathon materials developed by the Mentors.\n\n\n“We would love for anyone to be able to contribute to this. If you’re thinking, ‘I have a workflow that I would love share’, please send it our way”! - Cassie Nickles, Physical Oceanography Data Active Archive Center (PO.DAAC)\n\n\nCassie welcomed people to contribute - the Cookbook is built on Quarto and GitHub - and showed how to cite the Cookbook.\n\n\n\nSlide from Cassie showing the NASA Earthdata Cloud Cookbook\n\n\nIn closing, on behalf of the NASA Openscapes Mentors, Cassie shared her joy of working with this open community of people who are united around shared interests and needs." + "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#onward", + "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#onward", + "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", + "section": "Onward!", + "text": "Onward!\nIf the 2024 NASA Openscapes Champions Cohort is any indication, the NASA Earthdata community is making substantial strides in building capacity to use cloud resources, and the transition is successfully happening. Although the cohort is officially over, these teams are just at their beginning, and we are excited to follow their results as they experiment with parallelizing code and incorporating storage considerations in their workflows. We plan to continue to work with them in the next year, as their 2i2c managed cloud Hub access continues. As we did last year, we are planning to offer the Carpentries Instructor Training for interested Champions this summer. The Carpentries is a nonprofit that teaches introductory coding skills around the world. Instructor Training is not coding-specific, but it is an educational approach to teaching technical topics. As part of our NASA grant, we have partnered with The Carpentries and are excited to extend this opportunity to Champions because many of them mentioned wanting to contribute more to open science efforts going forward.\nWe are grateful to this Champion Cohort for their early adopter spirit, their time and effort to make this migration, and all the feedback and input they provided. They all participated in this cohort, knowing that while this was the third Cohort, they were among the first research teams to use NASA Earthdata in the Cloud. What they learned and shared will make it easier for subsequent teams to make this same shift. Many teams articulated this spirit of open leadership, explicitly asking how they could help other teams. We also learned so much from this cohort, which will help us refine the NASA Openscapes Champions program, as we plan for our next cohort and our work with the DAAC mentors in the future years of our project." }, { - "objectID": "news/2024-07-16-swot-workshop/index.html", - "href": "news/2024-07-16-swot-workshop/index.html", - "title": "Learn about and use Surface Water and Ocean Topography (SWOT) Data!", - "section": "", - "text": "We have an upcoming free hands-on virtual workshop led by NASA PO.DAAC on data access for the Surface Water Ocean Topography (SWOT) satellite. The SWOT session will be held July 16, 2024, as part of the Hacking Limnology Virtual Summit, a week-long series of talks and workshops broadly focused on open data science and modeling by early career scientists and researchers. This remote sensing SWOT session will be introduced by Merritt Harlan from the USGS and feature an exciting talk from Craig Brinkerhoff on SWOT-related research, followed by a 2-hour hands on demonstration by Cassie Nickles with support from NASA Openscapes Mentors.\nTo find out more about SWOT, visit the SWOT PO.DAAC Website and explore other SWOT tutorials and resources in our PO.DAAC Cookbook: SWOT Chapter ahead of time.\nRegistration is free and open to all career stages: https://aquaticdatasciopensci.github.io/registration/\nThe hands-on demonstration will be using this GitHub Repository with Binder: https://github.com/podaac/2024-SWOT-ECR-Workshop." + "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#about-the-nasa-openscapes-champions-teams", + "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#about-the-nasa-openscapes-champions-teams", + "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", + "section": "About the NASA Openscapes Champions Teams", + "text": "About the NASA Openscapes Champions Teams\nThe Liu-Zhang (University of Louisiana at Lafayette & University of Southern Mississippi) team primarily uses NASA Earthdata Search to access datasets from Earth Surface Mineral Dust Source Investigation (EMIT) and The ECOsystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS) missions, which we then use to create algorithms for ecosystem analysis. We have a particular interest in using hyperspectral data, such as the upcoming PACE data to study vegetation and algae in water bodies. Our work involves developing deep learning models for habitat classification and analyzing water quality. Transitioning to hyperspectral imaging and deep learning greatly increases computational demands, making it challenging to execute code locally compared to leveraging cloud computing resources. Additionally, this transition enhances the accessibility of our algorithm to the public. Currently funded by EMIT and serving as early adopters of PACE, we are eager to contribute to the NASA Cookbook by offering new algorithms that apply to NASA’s latest satellite data, such as EMIT and PACE.\nThe Ocean Science Analytics team incorporates NASA data in our studies of coastal and offshore marine regions, specifically as it pertains to marine mammals. Combining in situ data from hydrophones to determine the vocal occurrence of marine mammals with remotely sensed ocean color data, we use chlorophyll, net primary productivity, sea surface temperature, etc. to characterize the associated habitat and document changes over time. As a PACE early adopter, we are incorporating PACE data in our studies through large scale observations of photosynthesizing organisms, which will allow us to incorporate direct measurements of the presence and distributions of plankton species. This in connection with feeding behavior will provide a better understanding of the spatial use of these habitats.\nThe PACE Hackweek team supports the NASA PACE mission, which launched in February 2024 and is collecting unprecedented data from our global oceans, atmosphere, and land. PACE data will be hosted in the Cloud; therefore, we are interested in learning more about cloud-based workflows to access and analyze PACE data and contribute our efforts and outcomes to our community of end-users.\nThe NOAA CoastWatch team is motivated by how rising ocean temperatures, higher sea levels, melting ice, and increasing ocean acidity are changing the way marine life and ecosystems function in our world’s oceans. This affects everything from how we manage fisheries and protect communities that depend on fishing to how we protect important habitats and species. The ocean is expected to continue changing and changes are expected to become more extreme. A lot is at stake. Improving how we use Earth data in our workflows is essential. We have much we can learn about migrating to the Cloud by connecting with other earth science teams at NASA and with the NASA Openscapes mentors.\nThe Wimberly Lab (University of Oklahoma) team explores the impacts of changing climate and landscapes on ecosystems and human health, with an emphasis on developing spatial decision support tools to support public health decisions, land use planning, and natural resource management. We address these topics through landscape, regional, and global analyses using satellite remote sensing and other sources of environmental monitoring data. Specific research areas include the effects of environmental change on vector-borne disease outbreaks, the influences of human land use and wildfires on forest landscape dynamics, the impacts of agricultural expansion and intensification on native ecosystems, and the development of computer software for disease outbreak forecasting and landscape change modeling. We conduct our research in locations throughout the world including North America, West Africa, Ethiopia, and India.\nThe NOAA IEA team’s approach provides cross-disciplinary science to support ecosystem-based management in the Gulf of Mexico. For example, we conduct research on climate-fisheries interactions, changes in species ranges and distributions, and environmental impacts on fisheries such as those driven by harmful algal blooms. We use data from earth system modeling and remotely sensed data, including sea surface temperature, sea surface height, ocean currents, wind, ocean color, salinity, dissolved oxygen, and primary production indices. We are particularly interested in integrating modern open-science techniques to automate our core deliverables, called Ecosystem Status Reports, and other data products related to NOAA surveys. We’re beginning to test some of these approaches in ongoing projects. For example, the ongoing IEA-Wind project aims to develop data baselines to track the impacts of forthcoming offshore wind energy infrastructure development. The project has been conceptualized and executed thus far with an open-data approach. We believe that a deeper understanding of the concepts and approaches offered by this Cohort would allow for a more holistic application across Gulf of Mexico IEA efforts. \nThe NASA SERVIR Central America team are representatives of Costa Rica’s National System of Conservation Areas (SINAC, in Spanish), the Forest Research and Services Institute of the National University of Costa Rica, and the Central America Aerospace Network (RAC, in Spanish). The NASA / USAID SERVIR program is helping to connect the Costa Rican researchers with Openscapes. The team is responsible for generating Costa Rica’s official national forest cover maps, in the context of its national forest monitoring system. Therefore, involving the team will have a notable national impact in terms of their reporting to international commitments (e.g., the United Nations Convention on Biological Diversity (CBD), the United Nations Convention to Combat Desertification (UNCCD), the United Nations Framework Convention on Climate Change (UNFCCC), and Sustainable Development Goals (SDG) 15.2). The team is currently using Google Earth Engine (GEE) to access and process data from Sentinel-1 (SAR) and Sentinel-2 (optical). They combine these datasets and perform a supervised classification to generate land cover maps. While the team’s workflow is already in the Cloud (via GEE), they are interested in exploring additional computational capabilities that may be available via AWS for processing big data, including the inclusion of other datasets like that of the Landsat archive.\nThe POSTECH (University South Korea) team is actively engaged in climate modeling research, utilizing both Python and NCAR Command Language (NCL) scripts to analyze climate data. We are eager to expand our knowledge and skills by collaborating with experts in the field, and we are keen to explore new methodologies and insights. Joining your team presents an exciting opportunity for us to enhance our expertise and broaden our exposure to cutting-edge techniques in climate science.\nDisclaimer: Any use of trade, firm, or product names is for descriptive purposes only and does not imply endorsement by the U.S. Government.\nReference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise, does not constitute or imply its endorsement by the United States Government or the Jet Propulsion Laboratory, California Institute of Technology." }, { - "objectID": "news/2023-11-07-coiled-openscapes/index.html", - "href": "news/2023-11-07-coiled-openscapes/index.html", - "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "objectID": "news/2024-04-03-nasa-champions/index.html", + "href": "news/2024-04-03-nasa-champions/index.html", + "title": "NASA Openscapes Champions Cohort", "section": "", - "text": "Cross-posted from the Coiled blog. James Bourbeau is Lead OSS Engineer at Coiled, a company providing software and expertise for scalable Cloud computing built on Dask. Through the NASA Openscapes community, we support researchers using NASA Earthdata as they migrate their data analysis workflows to the Cloud. This Fall, Openscapes is partnering with Coiled to support us experimenting with another approach to Cloud access.\nAmy Steiker, Luis Lopez, and Andy Barrett from NSIDC and Aronne Merrelli from the University of Michigan shared their scientific use cases which motivated this post.\nWe show how to run existing NASA data workflows on the cloud, in parallel, with minimal code changes using Coiled. We also discuss cost optimization.\nPeople often run the same function over many files in cloud storage. This looks something like the following:\nThis straightforward but important pattern occurs frequently in groups working with NASA Earthdata and NASA Distributed Active Archive Centers (DAACs) to move scientific workloads to the cloud. Here are some examples:\nIn this post we’ll show how to run this same “function on many files” analysis pattern on the cloud with Coiled, which you can copy and modify for your own use case. We’ll also highlight cost optimization strategies for processing terabyte-scale data for fractions of a dollar." + "text": "This is a mentorship and professional development opportunity for research teams using NASA Earthdata to learn open science practices and spend time experimenting and planning what their analytical workflows with NASA Earthdata look like in the Cloud.\nFor details, please see the 2024 NASA Openscapes Champions Cohort webpage and summary blog post about the 2023 Champions: Exciting Progress for Research Teams using NASA Earthdata in the Cloud: 2023 NASA Openscapes Champions Wrap-up" }, { - "objectID": "news/2023-11-07-coiled-openscapes/index.html#processing-locally", - "href": "news/2023-11-07-coiled-openscapes/index.html#processing-locally", - "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", - "section": "Processing Locally", - "text": "Processing Locally\nIn this example we process many NetCDF files stored on S3 from the MUR Global Sea Surface Temperature NASA dataset to look at surface temperature variation over the US Great Lakes region:\nimport os\nimport tempfile\nimport earthaccess\nimport numpy as np\nimport xarray as xr\n\n# Step 1: Get a list of all files.\n# Use earthacess to authenticate and find data files (total of 500 GB).\ngranules = earthaccess.search_data(\n short_name=\"MUR-JPL-L4-GLOB-v4.1\",\n temporal=(\"2020-01-01\", \"2021-12-31\"),\n)\n\n\n# Step 2: Create a function to process each file.\n# Load and subset each data granule / file.\ndef process(granule):\n results = []\n with tempfile.TemporaryDirectory() as tmpdir:\n files = earthaccess.download(granule, tmpdir)\n for file in files:\n ds = xr.open_dataset(os.path.join(tmpdir, file))\n ds = ds.sel(lon=slice(-93, -76), lat=slice(41, 49))\n cond = (ds.sea_ice_fraction < 0.15) | np.isnan(ds.sea_ice_fraction)\n result = ds.analysed_sst.where(cond)\n results.append(result)\n return xr.concat(results, dim=\"time\")\n\n\n# Step 3: Run function on each file in a loop\nresults = []\nfor granule in granules:\n result = process(granule)\n results.append(result)\n\n\n# Step 4: Combine and plot results\nds = xr.concat(results, dim=\"time\")\nds.std(\"time\").plot(figsize=(14, 6), x=\"lon\", y=\"lat\")\nThis specific example uses earthacess to authenticate with NASA Earthdata and download our dataset (~500 GB of NetCDF files) and Xarray to load and select the region of the data we’re interested in, but we’ve seen many different approaches here, including file formats like HDF, Zarr, and GeoTIFF, as well as libraries like Xarray, rasterio, and pandas. In each case though the underlying pattern is the same.\nWe then combine the results from processing each data file and plot the results.\n\n\n\n\nStandard deviation of sea surface temperature over the Great Lakes region in the US.\n\n\n\nRunning this locally on my laptop takes ~6.4 hours and costs NASA ~$25 in data egress costs (based on a $0.05/GB egress charge rate – normal is $0.10/GB, but presumably NASA gets a good deal)." + "objectID": "news/2024-07-23-esip-summer-2024/index.html", + "href": "news/2024-07-23-esip-summer-2024/index.html", + "title": "Supporting NASA Earthdata users in the Cloud: NASA Openscapes onboarding and ‘fledging’", + "section": "", + "text": "NASA Openscapes Mentors Aaron Friesz, Andy Barrett, Danny Kaufman, Rhys Leahy, Alexis Hunzinger, with Julia Lowndes are co-leading this session at the ESIP Summer 2024 meeting.\nESIP Meeting theme: Grounded in Trust: Data Ethics Empower Collaboration\nDetails on the ESIP site.\nPurpose of our session: Facilitate a space to find common challenges & solutions for “moving to the cloud”, which includes onboarding people to a shared compute space and fledging them to their own space. We will share stories of how people go from 0 to Hub and then fledge to other clouds. Have mechanisms to hear many voices and come up with creative solutions. We will also invite people to contribute (earthaccess, Cookbook) and how we onboard. Share stories of how people go from 0 to Hub and then fledge to other cloud. \nOutcomes from our session: Learn from participants: what are challenges encountered from onboarding & fledging? Co-design solutions. Blog post - summary posted on ESIP/NASA-Openscapes blog. We’ll include authors from Roll Call unless you’d prefer to opt out; we’ll share a draft beforehand. \nProcess: Stories from NASA Openscapes (30 min); Breakout groups (25 min); Discussion (25 min)\n\n\nNASA Openscapes is a community where staff with similar roles supporting users across 12 NASA Earth Science Data Centers (DAACs) – through building trust – have been able to learn, develop common tutorials, and teach together to support users migrating workflows using NASA Earthdata to the Cloud. NASA Openscapes Mentors co-create and maintain an open Earthdata Cloud Cookbook of common reusable open source tutorials that they have co-developed for specific audiences and tested and refined through frequent workshops, hackathons, and Openscapes Champions Cohorts. We also created the earthaccess Python library which made users’ first experience with NASA Earthdata Cloud be two lines of Python code rather than 30 lines of bash code (that also required clicking and managing hidden files for authentication). The work we do together as a small community has enormous cascading effects, particularly as they visibly practice open science daily via contributions to open source code and documentation. We have supported hundreds of users to have their first hands-on experience with NASA Earthdata in the Cloud in a 2i2c JupyterHub configured for Jupyter, RStudio, MATLAB, and QGIS using our tutorials and docker base images (set up for libraries/environments, Quarto, etc). As the purpose of our JupyterHub is initial learning and exploration, we are now focused on “fledging” – answering the question “where do researchers go when they leave the Openscapes 2i2c JupyterHub?” We will share first stories of researchers shifting to their own cloud spaces, attaching their university credit cards in order to do science at scale in the cloud. We will share stories and challenges, and how approaches fit and can be leveraged by the ESIP community." }, { - "objectID": "news/2023-11-07-coiled-openscapes/index.html#processing-on-the-cloud-with-coiled", - "href": "news/2023-11-07-coiled-openscapes/index.html#processing-on-the-cloud-with-coiled", - "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", - "section": "Processing on the Cloud with Coiled", - "text": "Processing on the Cloud with Coiled\nLet’s run the exact same analysis on the cloud. Running on the cloud helps in a couple of ways:\n\nData Proximate Computing: Running computations closer to where the data is stored increases performance and avoids data transfer costs.\nScale: Distributing the processing over many machines in parallel lets us tackle larger volumes.\n\nUsing Coiled to run the same workflow on the cloud involves lightly annotating our process function with the @coiled.function decorator:\nimport coiled\n\n@coiled.function(\n region=\"us-west-2\", # Run in the same region as data\n environ=earthaccess.auth_environ(), # Forward Earthdata auth to cloud VMs\n)\ndef process(granule):\n # Keep everything inside the function the same\n ...\nThis tells Coiled to run our processing function on a VM in AWS and then return the result back to our local machine.\nAdditionally, we switch to using the Coiled Function .map() method (similar to Python’s builtin map function) to run our process function across all the input files in parallel:\n# Step 3: Run function on each file in a loop\n# results = []\n# for granule in granules:\n# result = process(granule)\n# results.append(result)\nresults = process.map(granules) # This runs on the cloud in parallel\nWith these two small code changes, the same data processing runs in parallel across many VMs on AWS. The runtime drops to ~9 minutes (a factor of ~42x speedup) and costs ~$1.52 (a factor ~16x less)." + "objectID": "news/2024-01-18-agu-talk-2023/index.html", + "href": "news/2024-01-18-agu-talk-2023/index.html", + "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", + "section": "", + "text": "In December at the AGU Fall Meeting in San Francisco, we were so grateful to connect with so many colleagues in person. We supported NASA Mentors Cloud Workshops on Sunday and organized a Happy Hour with colleagues from across NASA and the Open Science world. We attended and gave talks thoughout the week in addition to making many great connections in the Exhibition Hall, Poster Hall, and outside in the sun. This is a brief summary of our Friday 8-minute talk titled NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud.\nQuick links:" }, { - "objectID": "news/2023-11-07-coiled-openscapes/index.html#optimizing-costs", - "href": "news/2023-11-07-coiled-openscapes/index.html#optimizing-costs", - "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", - "section": "Optimizing Costs", - "text": "Optimizing Costs\nProcessing 500 GB of data costs us $1.52. This is cheap.\nWe bring this cost down further to $0.36 with the following techniques:\n\nSpot: Use spot instances, which are excess capacity offered at a discount.\nARM: Use ARM-based instances, which are less expensive than their Intel-based equivalents, often with similar, or better, performance.\nInstance Type Selection: Use single-core instances (only available when using ARM), because this particular computation doesn’t require large computing resources.\n\nWith this additional configuration made to the Coiled Functions decorator, our full cost-optimized cloud workflow looks like the following:\nimport os\nimport tempfile\nimport coiled\nimport earthaccess\nimport numpy as np\nimport xarray as xr\n\n# Step 1: Get a list of all files.\n# Use earthacess to authenticate and find data files (total of 500 GB).\ngranules = earthaccess.search_data(\n short_name=\"MUR-JPL-L4-GLOB-v4.1\",\n temporal=(\"2020-01-01\", \"2021-12-31\"),\n)\n\n\n# Step 2: Create a function to process each file.\n# Load and subset each data granule / file.\n@coiled.function(\n region=\"us-west-2\", # Run in the same region as data\n environ=earthaccess.auth_environ(), # Forward Earthdata auth to cloud VMs\n spot_policy=\"spot_with_fallback\", # Use spot instances when available\n arm=True, # Use ARM-based instances\n cpu=1, # Use Single-core instances\n)\ndef process(granule):\n results = []\n with tempfile.TemporaryDirectory() as tmpdir:\n files = earthaccess.download(granule, tmpdir)\n for file in files:\n ds = xr.open_dataset(os.path.join(tmpdir, file))\n ds = ds.sel(lon=slice(-93, -76), lat=slice(41, 49))\n cond = (ds.sea_ice_fraction < 0.15) | np.isnan(ds.sea_ice_fraction)\n result = ds.analysed_sst.where(cond)\n results.append(result)\n return xr.concat(results, dim=\"time\")\n\n\n# Step 3: Run function on each file in parallel\nresults = process.map(granules) # This runs on the cloud in parallel\n\n\n# Step 4: Combine and plot results\nds = xr.concat(results, dim=\"time\")\nds.std(\"time\").plot(figsize=(14, 6), x=\"lon\", y=\"lat\")\nand, while code runtime stays the same at ~9 minutes, cost drops to ~$0.36 (a factor of ~70x less than running locally)." + "objectID": "news/2024-01-18-agu-talk-2023/index.html#why-we-work-motivated-by-climate-and-social-change", + "href": "news/2024-01-18-agu-talk-2023/index.html#why-we-work-motivated-by-climate-and-social-change", + "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", + "section": "Why we work: motivated by climate and social change", + "text": "Why we work: motivated by climate and social change\n\n\n“What if we connected our skills & values as a daily practice, for climate?”\n\n\nWe kicked off our talk with this question to center the motivation for the work we do. As the NASA Openscapes Mentors had given many talks, workshops, and posters throughout the week showcasing and teaching their shared work, we summarized their efforts with a quote from Cassie Nickles:\n\n\n“NASA Openscapes is a collaborative environment for data center [DAAC] staff to collectively support open science initiatives for NASA Earthdata users. We’ve developed awesome material to help Earthdata users (cheatsheets, a python package (earthaccess), NASA Earthdata Cloud Cookbook).\nPerhaps just as important as what we’ve done however, are mindsets we’ve grown into along the way. It’s okay to share imperfect works in progress. Ideas are not too big or too small to share. We are better at dreaming and implementing the future together.” – Cassie Nickles (PO.DAAC)\n\n\nThen we centered our talk on a layer above: how we work to support these amazing user support staff to collaborate across data centers and as early adopters, co-develop teaching resources and infrastructure to support researchers in the Cloud." }, { - "objectID": "news/2023-11-07-coiled-openscapes/index.html#summary", - "href": "news/2023-11-07-coiled-openscapes/index.html#summary", - "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", - "section": "Summary", - "text": "Summary\nWe ran a common data subsetting-style workflow on NASA data in the cloud with Coiled. This demonstrated the following:\n\nEasy: Minimal code changes to migrate existing code to run on the cloud.\nFast: Acceleration of the workflow runtime by ~42x.\nCheap: Cost reduction of ~70x.\n\nWe hope this post shows that with just a handful of lines of code you can migrate your data workflow to the cloud in a straightforward manner. We also hope it provides a template you can copy and adapt for your own analysis use case.\n\n\n\n\nComparing cost and duration between running the same workflow locally on a laptop (data egress costs), running on AWS, and running with cost optimizations on AWS.\n\n\n\nWant to run this example yourself?\n\nGet started with Coiled for free at coiled.io/start. This example runs comfortably within the free tier.\nCopy and paste the code snippet above.\n\nGoing to AGU 2023? Come by the Coiled booth and say hi (right by the entrance next to Google)." + "objectID": "news/2024-01-18-agu-talk-2023/index.html#how-we-work-openscapes-flywheel", + "href": "news/2024-01-18-agu-talk-2023/index.html#how-we-work-openscapes-flywheel", + "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", + "section": "How we work: Openscapes Flywheel", + "text": "How we work: Openscapes Flywheel\nThe Openscapes Flywheel is a tool for movement building (Robinson & Lowndes 2022). We developed this from the early days collaborating with the NASA Mentors and it is open source: available for you to reuse and fork as other groups are starting to do. We reach for the Flywheel as a tool for planning, implementation and communication, just as we reach for R, Quarto, and JupyterHubs for analysis, documentation, and cloud computing.\nThe Flywheel is a concept developed by Jim Collins, where transformations occur from consistently doing key activities that add up over time. The Openscapes Flywheel at its simplest form has six steps that we repeat daily, monthly, and over years. Starting from the bottom and going clockwise: Leverage common workflows, skills, and tools; Inspire; Welcome; Create space & place; Invest in learning and trust; Work openly.\n\n\n\n\nThe Openscapes Flywheel\n\n\n\nWe talked through what this looked like for the NASA Openscapes project in Year 1, and then again in Years 2-3 as the Flywheel gained momentum as the Mentor community grew and supported researchers on the Cloud." }, { - "objectID": "news/2023-11-07-coiled-openscapes/index.html#acknowledgements", - "href": "news/2023-11-07-coiled-openscapes/index.html#acknowledgements", - "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", - "section": "Acknowledgements", - "text": "Acknowledgements\nThis work was done in collaboration with NASA Openscapes, a community supporting research teams’ cloud migration with different Cloud environments and technologies, including Coiled.\nWe’d also like to thank Amy Steiker, Luis Lopez, and Andy Barrett from NSIDC and Aronne Merrelli from the University of Michigan for sharing their scientific use cases which motivated this post." + "objectID": "news/2024-01-18-agu-talk-2023/index.html#turning-hundreds-thousands-of-times-in-ways-big-and-small", + "href": "news/2024-01-18-agu-talk-2023/index.html#turning-hundreds-thousands-of-times-in-ways-big-and-small", + "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", + "section": "Turning hundreds, thousands of times in ways big and small", + "text": "Turning hundreds, thousands of times in ways big and small\nWhat’s so exciting is that following these initial turns of the Flywheel, it is now turning hundreds, thousands of times in ways big and small: like when a researcher uses GitHub for the first time and then turns around to teach their supervisor, and when staff have the confidence to speak up in meetings with what they know from the broader open science community. We’ve shared these stories in several manuscripts and blog posts, including a cross-government collaboration:\n\nThe Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices (Robinson & Lowndes 2022)\nShifting institutional culture to develop climate solutions with Open Science (Lowndes et al 2023)\nhttps://openscapes.org" }, { - "objectID": "news/2024-02-15-nasa-openscapes-talking-points/index.html", - "href": "news/2024-02-15-nasa-openscapes-talking-points/index.html", - "title": "NASA Openscapes: Talking points for 3-year recap & vision for next two years", - "section": "", - "text": "This week we joined a standing meeting with NASA DAAC and ESDIS managers (DMC-ESDIS Telecon). We had 30 minutes to present the goals for the upcoming year, and describe why the increase in roles and responsibilities for the NASA Openscapes Mentors. We were introduced by Justin Rice ESDIS Deputy Project Manager, and were thrilled to have the opportunity to reconnect with this group and share the joy of what the Mentors have done and continue to do together. This blog post outlines our talking points that we covered in the meeting. There was a lot of support for the NASA Openscapes Mentors overall, and for the earthaccess python library. Someone even showed the contributors list, highlighting that contributors came from across DAACs and the broader open science community.\nThis post is addressed to the audience of NASA DAAC and ESDIS managers.\n\n\nSupporting users transitioning to the Cloud across different timelines\nOver the last several years, NASA has been making a transition from on-prem hosted data at each of the DAACs to migrating that data to the cloud. Each of the DAACs has been on its own transition path, with some DAACs nearing (or completely) migrating like PO.DAAC, and others just starting to explore, like the CDDIS DAAC. This shift has had ripple effects on how each of the DAACs supports their users accessing NASA Earthdata in the cloud.\nFortunately, the different timelines of each DAAC mean that we can learn from each other and there are a lot of common elements that can be shared across the DAACs in this transition. That is where our project, the NASA Openscapes project, sits - supporting a community of practice for staff that are charged with helping NASA Earthdata users migrate to the cloud. We want to pause here and underline that all the work that NASA Openscapes Mentors and team do, is in support of NASA Earthdata users.\n\n\nNASA Openscapes goals\nNASA Openscapes has three primary goals set in our initial proposal, that still stand going forward.\nFirst, to develop a NASA Earthdata Mentor community of collaborative cloud data instructors, that co-create, curate, and use shared resources (“make once, use often”).\n\nFrom there, we have connected DAAC staff with similar roles across 11 DAACs and provided space for them to learn from each other, and reuse material (like the cheatsheets).\n\nSecond, to support the Mentors as they empower science teams to migrate their download-intensive data analysis workflows to the cloud to continue to do the premier science that each of you supports.\n\nTo date we’ve supported 17 Champions teams, 285 users active within last 6 months; many of these folks are DAAC staff and from your UWGs (User Working Groups). 480 users logged in ever.\nThe transition takes time, but we are starting to see some initial science success stories! (Aronne Merrelli with PI Nadia Smith - developing CLIMCLAPS data product archived at GES DISC; used the Champions program as proposal planning for NASA ROSES. Aronne developed workflows in 2i2c, learned to parallelize workflows with Coiled, and swapped to his University credit card once he had a functional workflow. Aronne will present to a 2024 Champions Cohort to show what’s possible for better science in less time.\n\nThird, to scale Cloud workshop infrastructure, so that each DAAC can leverage it easily and efficiently.\n\nOur first workshop was the Nov 2021 hackathon led by PO.DAAC and supported by NSIDC, LP DAAC and many other mentors. This hackathon helped the mentors develop the seed material for new-to-cloud audiences. Collectively they have developed a curriculum in the Cloud Cookbook that helps a majority of NASA Earthdata users access data in the cloud. Just at the 2023 AGU Fall Meeting, there were 4 workshops using these common materials, two used the 2i2c JupyterHub, and we had 12 talks and posters that described different elements of the transition to the cloud. And in every slide deck the participating DAACs are recognized and acknowledged. This is a stunning amount of presented work from any group, and we hope that you all feel very proud.\n\nThe NASA Mentors group has rapidly identified user needs and developed resources. Two examples of that are:\nFirst, earthaccess, a Python library being developed openly on GitHub. The initial mechanism to access NASA data in the cloud required 30 lines of bash code that created a netrc file and adding earthdata login credentials to that file to get the AWS Secret keys. This as a first step for a new user to the cloud is a high barrier to entry. Luis Lopez from the NSIDC DAAC led the development of this package and we are grateful for the flexibility and support from NSDIC DAAC to meet this emergent need. Earthaccess now obscures those steps for the user with a single line of Python, and it works across DAACs easily accessing data from NSIDC, LP DAAC, PO.DAAC, and others. It is one of the things that most users comment about being a highlight. Also this early intervention means that just dozens of users experienced the clunky initial approach, but thousands of users moving forward will just know the easy earthaccess approach. We’ve worked directly with R and MATLAB developers from our networks who have developed R and MATLAB libraries as complements to earthaccess, which further enable a large swath of Earthdata users.\nSecond, cheatsheets. We know that Cloud jargon is intense. Cassie Nickles and Catalina Taglialatela from PO.DAAC spearheaded a set of cheat sheets that new users can refer to as they navigate planning and executing their transition to the cloud. They intentionally created them to meet PO.DAAC’s needs but in a way that was generalized so that all DAACs could use them so they are heavily reused in presentations and workshops.\nThere are so many other examples that we could provide of ways creating this space for these folks to work together has led to increased efficiency, overall better support for new users moving to the cloud and has avoided significant friction and frustration that users might have had if each DAAC was working alone. In the last three years, we have seen significant, exciting scientific advances in NASA Earthdata users’ ability to work in the cloud and this is in part thanks to your teams and your investment. Mindsets as leaders across DAACs and in the broader Open Science community\nToday, most DAACs have at least one mentor who is a Carpentries Instructor (many have undergone certification). This is something that our grant paid for and the benefits to each DAAC we hope will pay dividends for better teaching of many topics. All of the mentors are more comfortable teaching the Cloud Cookbook material and live coding in the 2i2c Hub than they were at the beginning. Each DAAC is able to leverage the collective resources for DAAC-specific workshops (a lot of value for a fraction of the cost). Many DAAC staff beyond the named mentors access the 2i2c Hub for DAAC-specific tutorial development, so they also have seen an increase in efficiency utilizing services that our grant and now contract provide.\nI hope that you can see that all of this work is aligned with the mission you are all supporting and not extra. Each mentor gives about .2WYE (work year equivalents) and we estimate that last year we had between 4 and 5 WYE total across the DAACs, in addition to the staff support that our NASA Openscapes team (Erin, Julie, Stefanie) provides ~ 1-2 WYE.\n\n\nGoing forward: the next two years\nWe started this project three years ago. Our hope was to connect with all the DAACs by the end of the award, to build instructor capacity and common tutorial material, and to leave the DAACs in a place where they would continue to sustain the work we started together transitioning users to the cloud.\nIn the next two years the Openscapes team (Erin, Julie and Stefanie) will phase out our involvement in the DAAC support, starting with Erin in July. The user support tasks will not go away at that point. We have been in discussions with Justin over the last eight months about this and have begun to set up scaffolding that documents the process and allows the systems to continue. Likely, when we step fully away it will require 5-6 WYE’s across the DAAC\nWe’d like to use this time to answer any questions you might have, discuss alignment across the DAACs, identify better ways we can support you all and how each of you see your DAACs contributing to this investment. Thank you, we appreciate you and continue to be so grateful for all the time that DAACs have put towards this work.\n\n\n\nSome NASA Openscapes Mentors and colleagues holding puppies at the AGU 2023 conference #NASAPuppyPorters\n\n\n\n\n\n\nCitationBibTeX citation:@online{robinson2024,\n author = {Robinson, Erin and Lowndes (Openscapes), Julie and\n Openscapes Team, NASA},\n title = {NASA {Openscapes:} {Talking} Points for 3-Year Recap \\&\n Vision for Next Two Years},\n date = {2024-02-15},\n url = {https://openscapes.org/blog/2024-02-15-nasa-openscapes-talking-points/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nRobinson, Erin, Julie Lowndes (Openscapes), and NASA Openscapes Team.\n2024. “NASA Openscapes: Talking Points for 3-Year Recap &\nVision for Next Two Years.” February 15, 2024. https://openscapes.org/blog/2024-02-15-nasa-openscapes-talking-points/." + "objectID": "news/2024-01-18-agu-talk-2023/index.html#technical-social-infrastructure-together", + "href": "news/2024-01-18-agu-talk-2023/index.html#technical-social-infrastructure-together", + "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", + "section": "Technical & social infrastructure together", + "text": "Technical & social infrastructure together\nWhat’s key here is that technical & social infrastructure have been prioritized together consistently from the start. We focus on developing a kinder, open science mindset together: Mentorship is a skill we can all develop, just as we can all learn coding or data management as a skill, no matter where we’re starting from. In the open science world, there are many places to learn from & we can all join existing efforts with humility and a growth mindset to learn.\n\n\n\n\nDeveloping a kinder, open science mindset. Slide from AGU talk" }, { - "objectID": "news/2024-07-09-2i2c-shared-password/index.html", - "href": "news/2024-07-09-2i2c-shared-password/index.html", - "title": "2i2c develops shared password access with LP DAAC for NASA Surface Biology and Geology Workshop", + "objectID": "news/2024-06-06-editorial-published/index.html", + "href": "news/2024-06-06-editorial-published/index.html", + "title": "Shifting institutional culture to develop climate solutions with Open Science", "section": "", - "text": "Read the blog post Openscapes Host a Surface Biology and Geology Workshop with Shared Password Feature by 2i2c Team members Yuvi Panda and Jenny Wong!\nBackground from Julie Lowndes: Recently Yuvi Panda and colleagues at 2i2c collaborated with NASA Openscapes Mentors Bri Lind and Erik Bolch and colleagues at the NASA Land Processes Distributed Activate Archive Center (LP DAAC) to setup a frictionless shared password access to the Openscapes JupyterHub for the Surface Biology and Geology: VITALS Workshop. This workshop had 250 participants, and this frictionless approach involved sharing a link for access (like you would with Zoom/Teams) rather than requiring participants to create and share GitHub usernames in advance (and workshop hosts to manage and add them to the Hub).\nWe will be continuing to use this approach for large workshops going forward, and have added instructions for workshop leads to the NASA Earthdata Cloud Cookbook - Policies & Admin section.\n \n\nOur partners 2i2c host our NASA Openscapes JupyterHub as part of their mission to support open science and building communities in the cloud using interactive computing. Learn more about their approach and other community impact stories!" + "text": "We are so happy to share that a paper co-authored by Openscapes mentors across organizations – including NASA Earthdata, NOAA Fisheries, EPA, California Water Boards, Pathways to Open Science, Fred Hutch Cancer Center – was just published: Shifting institutional culture to develop climate solutions with Open Science. From co-author Anna Holder, Cal EPA / Water Boards: “It’s a short read and quite uplifting and inspirational and provides some more insight and what we’re learning as we implement Openscapes across organizations.”\n\n\n“Our best advice to start shifting culture is to have regularly scheduled learning meetings—with structure and intention to make them different from other work meetings.”\n\n\nPlease let us know what you think, and share with colleagues!\nWe deeply appreciate the contributions made by all Openscapes Mentors and community members who are not listed here.\nCitation: Julia Stewart Lowndes, Anna M. Holder, Emily H. Markowitz, Corey Clatterbuck, Amanda L. Bradford, Kathryn Doering, Molly H. Stevens, Stefanie Butland, Devan Burke, Sean Kross, Jeffrey W. Hollister, Christine Stawitz, Margaret C. Siple, Adyan Rios, Jessica Nicole Welch, Bai Li, Farnaz Nojavan, Alexandra Davis, Erin Steiner, Josh M. London, Ileana Fenwick, Alexis Hunzinger, Juliette Verstaen, Elizabeth Holmes, Makhan Virdi, Andrew P. Barrett, Erin Robinson (2024). Shifting institutional culture to develop climate solutions with Open Science. Ecology and Evolution, 14, e11341. https://doi.org/10.1002/ece3.11341\n\n\n\nSimilar to how plants use the resources available to them to develop fruits and seeds for future plants, values, culture, and technical infrastructure continually influence the generation and reproduction of relevant, rigorous, and insightful science. Illustration by Adyan Rios and Su Kim, NOAA Fisheries.\n\n\n\n\n\nCitationBibTeX citation:@online{2024,\n author = {, Openscapes},\n title = {Shifting Institutional Culture to Develop Climate Solutions\n with {Open} {Science}},\n date = {2024-06-06},\n url = {https://https://nasa-openscapes.github.io/blog/2024-06-06-editorial-published},\n langid = {en}\n}\nFor attribution, please cite this work as:\nOpenscapes. 2024. “Shifting Institutional Culture to Develop\nClimate Solutions with Open Science.” June 6, 2024. https://https://nasa-openscapes.github.io/blog/2024-06-06-editorial-published." }, { - "objectID": "news/2024-07-18-openscapes-update/index.html", - "href": "news/2024-07-18-openscapes-update/index.html", - "title": "Openscapes update from Julie Lowndes, summer 2024", + "objectID": "news/2023-05-17-mentor-coach/index.html", + "href": "news/2023-05-17-mentor-coach/index.html", + "title": "How coaching skills have made us better open data science mentors", "section": "", - "text": "Hi friends, this is a status update about Openscapes — all good things as we’ve evolved structurally this year while concurrently supporting open science via leading cohorts with partners, sharing via talks & writing, and maintaining stability for mentor learning communities. It has also been a lot. Like everyone, I have been consumed with the weight of everything going on in the world, local and global, including wildfires growing nearby my house right now. My theme this year is “default to open” as I grow as a leader in the same way I do as a scientist. This post feels like a long time in the making in that lens. But it has been great to share about different pieces of this with some of you, and it feels really good to document it all more here. I hope you’re all doing ok, and please get in touch - my best email is julia at openscapes.org. Cheers, Julie Lowndes." - }, - { - "objectID": "news/2024-07-18-openscapes-update/index.html#openscapes-ethos", - "href": "news/2024-07-18-openscapes-update/index.html#openscapes-ethos", - "title": "Openscapes update from Julie Lowndes, summer 2024", - "section": "OPENSCAPES ETHOS", - "text": "OPENSCAPES ETHOS\nOpenscapes is an approach and community that helps researchers and those supporting research find each other and feel empowered to conduct data-intensive science. We support open science as “kinder science for future us”: the vision is a scientific culture that is more efficient, more kind, and more collaborative, and that can uncover solutions faster together to the most pressing climate and social challenges. Our main activity is mentorship to build open source technical and collaborative leadership skills within and across teams and organizations, connecting groups and role-modeling open practices that are critical elements to helping shift towards open science. All our lessons, curriculum, writing (blog posts, peer reviewed publications, slides, etc) are open source and shared publicly online – using the same tools we teach for data analysis and reproducible reports (GitHub, Quarto/RMarkdown, R, Python, Jupyter, Google Drive). We believe role-modeling open practices is critical to helping teams shift towards open science.\nOpenscapes is motivated by a question: What if we connected our skills & values in our daily work, for solutions to our most pressing climate and justice challenges? We work with actionable science teams at agencies like NASA Earth Science, NOAA Fisheries, EPA, California Water Boards, academic and non-profit groups like the Fred Hutch Cancer Center, Black Women in Ecology, Evolution, and Marine Science and Black in Marine Science. In our work we think that combining data science with open science with teamwork & community, is a way for us all to help address our climate emergency. As Ayana Elizabeth Johnson and Katharine Wilkinson say in the book All We Can Save: “To address our climate emergency, we must rapidly, radically reshape society. We need every solution and every solver”." + "text": "February through May 2023, Openscapes Mentors from across governments and academia came together for some hands-on learning and practice that had a profound effect on the way we will teach and lead going forward. We learned coaching skills that can help us as professionals – skills like listening rather than solutioneering, asking open-ended questions that empower people to find their own agency and meet their needs. This is a program designed and facilitated by Tara Robertson, a Certified Professional Co-Active and International Coaching Federation Associate Certified Coach. Openscapes has been developing a professional collaborative relationship with Tara since 2021. It was also impactful because it brought together Openscapes Mentors from across government groups (NASA Earthdata, NOAA Fisheries, EPA, California Waterboard) so they can learn together and support each other in the 2023 Year of Open Science.\nThis program had a profound impact on the three of us too, as participants as well as program designers and facilitators. We are still trying to define what it was about the program, the process, and everyone involved that led to such a profound sense of trust among us so that we were able to be vulnerable and do courageous things. While these Openscapes Mentors have been collaborating as colleagues together within their organizations (e.g. as NASA Earthdata Mentors or Pathways to Open Science Mentors), this was the first time most of these folks met as a cross-Openscapes mentor community (besides brief encounters at virtual ESIP conference sessions in 2023 and 2022).\nThis truly was a cohort of early adopter “bright spots” - folks who wanted to be better mentors and grow as leaders, even if we didn’t know what that meant yet. Not only were folks working across organizations with other mentors they didn’t know, they were expert scientists being asked to step way outside their comfort zone and be novices. In this setting, they were enthusiastic and fearless learners. There was a really high rate of participation and very few people dropped off over the six sessions. We saw individual growth and impacts feeding back and forth: something introduced gently here that we can practice together makes us comfortable, and now we can take this to other spaces and introduce it gently to others too." }, { - "objectID": "news/2024-07-18-openscapes-update/index.html#igniting-real-culture-change-across-science", - "href": "news/2024-07-18-openscapes-update/index.html#igniting-real-culture-change-across-science", - "title": "Openscapes update from Julie Lowndes, summer 2024", - "section": "IGNITING REAL CULTURE CHANGE ACROSS SCIENCE", - "text": "IGNITING REAL CULTURE CHANGE ACROSS SCIENCE\nWe are seeing real culture change across science through the Openscapes approach. This is a big deal and something I am really proud of. Change shows up as real improvements in how individuals, teams, and organizations operate. We see researchers’ daily efficiency and wellbeing benefit whole organizations since there is less time wasted, errors are identified and fixed earlier, and staff have less burnout and turnover. Through the Champions Program, we’ve seen a senior administrator who had participated for weeks on mute suddenly unmute, lean forward, and say “I need that, can you teach me?” when a colleague was screensharing their workflow for automating data-intensive reports. Through NASA Openscapes co-led with Erin Robinson, we have changed the way NASA teaches how to access Earthdata in the cloud. With NASA, NOAA, and the California Water Boards, we are supporting within-government open source community development that flourishes across historical institutional silos: examples include the earthaccess python library, Dr. Eli Holmes’s new 3-year position as NOAA Fisheries Open Science Lead, and the California Environmental Protection Agency’s (CalEPA) open data strategy (see the upcoming July Executive Director Report: https://www.waterboards.ca.gov/board_info/exec_dir_rpts).\n2023 marked 5 years of Openscapes! We have done and learned a lot – look out for an upcoming blog post with more details. But to share some – in early 2024, Openscapes was mentioned in the White House Fact Sheet as the Biden-⁠Harris Administration Marks the Anniversary of OSTP’s Year of Open Science! We’ve led 155 science teams through our flagship Champions program, upskilled 90 Mentors across several government organizations, and welcomed 120 Black marine and environmental scientists to Open Science through the Pathways Program. We’ve also led two years of the Reflections program, a lower-commitment way for people to participate in Openscapes and build open science skills. But real culture change is less about us leading events and more about the Openscapes approach and Flywheel spinning around the world as people practice, reuse, and teach it themselves. Openscapes has been successful because we are small, independent, and outside the organizations we work with, and teaching approaches that can be incorporated within organizations (for example with the CalEPA). We are keeping that going." + "objectID": "news/2023-05-17-mentor-coach/index.html#designing-a-courageous-space", + "href": "news/2023-05-17-mentor-coach/index.html#designing-a-courageous-space", + "title": "How coaching skills have made us better open data science mentors", + "section": "Designing a courageous space", + "text": "Designing a courageous space\nWe connected these bright spots by creating space and place. We met every 2 weeks for 6 remote sessions for a total of 12 hours. Twenty-eight people participated as part of their paid jobs, supported by their organizations rather than doing it “off the side of their desk”. We used a practice already familiar to all Openscapes Mentors: collaborative note-taking Agendas all in one Google doc where we had a shared responsibility to take notes, clarify explanations, add links to resources, and add shared joy and encouragement via emojis, +1’s and comments. We co-designed and helped each other when facilitating, which was instrumental when Tara got sick and lost her voice and Julie stepped in to facilitate the session based on Tara’s prep ahead of time.\nThe 6 sessions focused on specific topics: powerful questions, 3 levels of listening, identifying values, leader within, saboteurs and then taking these coaching skills into mentoring, supervising and sponsoring. For each of the topics, Tara briefly described the topic or skill, did a live demo with one of the participants, and the group described what they observed. Then, Tara gave us a topic to coach on, or some guardrails, and participants went into breakout rooms in pairs to practice coaching and being coached.\nThere was a lot of hands-on doing. Most of the participants said this was the best part of the course and also the most uncomfortable bit. In these pairs, the coaches were learning how to ask questions that help people open up…and this also challenged the coachees, who really dived into their needs and blockers for how to better support open science. It was also a testament to Tara’s own willingness to be vulnerable, demonstrating as a coachee and giving us her own real-life examples.\nThoughts from Tara: Something really special happened with this cohort. There were three main ingredients to this magic:\n\nThe participants were enthusiastic and fearless learners who were willing to step outside their comfort zones and learn new things together. This group of expert scientists from different organizations were willing to be beginner learners with each other. This group embodied courage.\nWe were intentional in the design to maximize psychological safety. At the start of Week 1 we designed an alliance together on how we wanted to be and learn together. I ordered the topics to start with the lower stakes topics and we were intentional about mixing people up across organizations. In the week 5 coaching demo one of the coaching demos the coachee chose to be quite vulnerable and bring a real challenge. This was a turning point where we saw that we can use these skills to surface challenging topics and have honest conversations about barriers in science.\nOpenscapes investment in coaching skills was a unique way to collectively learn some new skills AND build connections between open science leaders across different organizations and Openscapes initiatives: Mentors at NOAA Fisheries, NASA and from the growing Mentor community from CalEPA and Pathways to Open Science." }, { - "objectID": "news/2024-07-18-openscapes-update/index.html#an-open-source-community", - "href": "news/2024-07-18-openscapes-update/index.html#an-open-source-community", - "title": "Openscapes update from Julie Lowndes, summer 2024", - "section": "AN OPEN SOURCE COMMUNITY", - "text": "AN OPEN SOURCE COMMUNITY\nI’ve come to think of Openscapes itself as an open source community, which yes, might be obvious, and was the goal all along. But I realize it actually is. We as a community — and linked to many other communities all along the open spectrum — are all role modeling open, living open science as a process and daily activity (not only a product at the end), and bringing reuse and extension as a value of open. It’s happening!\nPart of the community being open source is that all our resources are open source; you’re welcome to them. We think of the Flywheel as an open source tool — I reach for the Flywheel when we are planning, designing programs, communicating impact, just as I reach for R and Quarto and JupyterHubs when I am doing data analysis. We also invest heavily in open documentation: through the Champions Lesson Series resources and the Approach Guide that document how we work and facilitate – these are other open source resources to reuse and extend, the way you would an R or Python package. It takes real work and time to make things open – that means posting on YouTube and formatting for GitHub rather than a PDF sitting in a corner of our laptops. Funding supports our time working with partners, and also invests in this work to keep the Flywheel going.\n“Forking” is a concept from GitHub and software programming where you can copy someone’s work into your own space to reuse/remix/extend it. It is still attached to the original source so that you can be connected, give credit, and also contribute back, if your changes might be useful to the original project. We are thrilled to see people “forking Openscapes” like teaching from each other’s slide decks, copying live notes and agenda structure, and reusing Champions cohorts and event structure to better suit audiences, like the CalEPA has done." + "objectID": "news/2023-05-17-mentor-coach/index.html#building-skills-for-listening-not-solutioneering", + "href": "news/2023-05-17-mentor-coach/index.html#building-skills-for-listening-not-solutioneering", + "title": "How coaching skills have made us better open data science mentors", + "section": "Building skills for listening not solutioneering", + "text": "Building skills for listening not solutioneering\nSo called “soft skills” are anything but. This was hard. Learning to ask open ended questions was hard, and what was harder still was listening to be able to ask the next powerful question. How we listen differs whether we are in mentor-mode or coach-mode:\n\nWhen we listen as mentors, we’re trying to understand where our expertise can help someone solve a problem.\nWhen we’re listening as coaches, we’re trying to help the other person define their problem, and tap into their own wisdom to find their solution, likely outside of our domain expertise.\n\nWhat do we mean by a “powerful question”? It’s a short question that can open up a really powerful conversation. It’s open-ended, usually starts with the word “What”, ideally is 5 words or less, and can’t be answered by yes or no. What feels like success to you? What’s in the way? What, if anything, is going unsaid? Which of your core values is being messed with?\nDistinguishing when we’re listening as mentors and when we’re listening as coaches is important, because it determines how we will respond as early adopters who may not know the answer to the question – think cloud computing, how to store increasingly large data, how to give hard feedback to a superior, and how to ask for help in a culture built on competition and the myth of the lone genius. Developing these coach listening skills, including what questions to ask, has helped us help others better (and notice and avoid solutioneering!). It’s also helped us feel less overwhelmed as we learn that it’s okay to not always have the answer!\n\n\n“We need these coaching skills to do powerful work and inspire meaningful connections; this program is a safe space to learn, to challenge our preconceptions, to practice, and to grow. I found it to be so invaluable because it’s a chance to acknowledge and learn about skills that are often unspoken in their ability to improve mentorship and collaboration.” — Ileana Fenwick\n\n\nThoughts from Stef. During the first two sessions, in the breakout rooms to practice coaching in pairs, I defaulted to talking more about the process and how we felt about it because actually practicing coaching, even with specific prompts, felt really really hard. But somehow over time, it got easier. Now I find myself trying out “powerful questions” with my peers in one-to-one conversations or coworking, rather than my usual behavior of suggesting solutions to people’s challenges. And people seem to respond!\nBut what really made this work?\n\nPeople were primed for this based on their prior experiences as Openscapes Mentors. They came expecting a familiar set of norms and psychological safety that allowed them first to get comfortable and then to take risks. With this foundation, together we were able to build trust early on. This is key to developing healthy teams and communities. We all knew it would be worth it even if we didn’t know what we were getting into.\nOften, to offer a program like this, an organization might contract an external professional to deliver it. We took it a step further. Openscapes contracted Tara, with whom we’ve collaborated before, and who is highly respected for her tell-it-like-it-is approach to diversity and inclusion. The core team of Tara, Julie, and me, worked to onboard ourselves and each other to this process using an open facilitation approach rather than working behind a curtain. We met frequently and defined our roles together, agreeing to role-model transparency and vulnerability and to name these things. Julie and I took turns managing breakout rooms each week so we could also take turns practicing coaching.\nThe mentors were not our students; they’re our peers and collaborators. Once people opted in, there was no judgment or “sorries” if someone was late or had to miss a session because of life’s responsibilities.\nPractice! We moved away from analyzing and into the doing. It was uncomfortable and people still came and showed up as leaders" }, { - "objectID": "news/2024-07-18-openscapes-update/index.html#our-core-team", - "href": "news/2024-07-18-openscapes-update/index.html#our-core-team", - "title": "Openscapes update from Julie Lowndes, summer 2024", - "section": "OUR CORE TEAM", - "text": "OUR CORE TEAM\nOpenscapes has an intentionally small core team. As we have grown, we have tried to keep a deliberately flattened organizational structure that works effectively and has the impact of a much bigger team. We define the core team right now as people who are paid directly from Openscapes funds (grants & contracts). Sustainability of people’s workload and financing is front of mind. Outside of me (aiming for 90% time), team members work up to 50% time, with everyone working as much as they want to. Our core team has shifted this year, and you’ll see these changes reflected in our website too.\nFirst, a huge thank you to Erin Robinson, who was instrumental in growing Openscapes into a sustainable initiative via her expertise in strategic sustainability planning and her leadership with the NASA Earthdata community. Erin Robinson has shifted off the core team: she is currently finishing her PhD in Information Science focused on knowledge infrastructures for Earth and environmental science applications and consulting with her company Metadata Game Changers. I have learned so much working together with Erin, it could be a whole book in itself. I’m so proud of the Openscapes Flywheel we developed together and that Jim Collins responded to us saying he was excited about our work when we shared our 2023 Earth Science Data Systems Working Group (ESDSWG) slides! Erin, I can’t wait to see what you do and where you take this all next, and continue to stay connected with us all.\nGrowing our team, we’ve welcomed two new team members: Liz Neeley and Andy Teucher! Both Liz and Andy have backgrounds as environmental scientists, so they are closely connected with researchers and understand deeply the challenges and opportunities as we work with teams, and are huge wonderful additions to the Openscapes Community.\nLiz Neeley brings a deep background of science communication and sense making, and is supporting me as well as NASA Mentors. The first thing we did together is Liz helped design a hiring rubric and interview conversation guides for our cloud position with 26 applicants earlier this year — this is something I had never done before and I learned a lot (blog post upcoming!) Liz is also a founding partner of the new initiative Liminal, which is a science communication collective. I am proud to say that I am part of the collective, alongside some amazing leaders. Liz and I have already co-chaired a workshop with the NIH National Libraries of Medicine, and I shared some of Openscapes’ work in environmental and Earth science communities. I am excited to contribute, learn, connect, and bring back what I learn to the Openscapes community.\nAndy Teucher is a data scientist and open source developer and teacher, and has been focused on cloud infrastructure with NASA Openscapes. In just a few short months already he has identified ways to lower costs for cloud computing and storage. And, making this immediately actionable, he has taught tutorials on technical and policy approaches to reduce costs for scientists and JupyterHub managers, which is so awesome. Andy is continuing to document this and identify other ways to contribute to reduce friction for users learning to access and use NASA Earthdata in the cloud. A current focus is on “fledging” — where do researchers go to do their real science once they have tested whether the Cloud is right for them through our 2i2c JupyterHub? (Look out for a blog post following our July ESIP session!)\nStefanie Butland and Ileana Fenwick and I continue to work closely together, across Openscapes activities. Ileana led the second annual Pathways to Open Science program with co-leads Aneese Williams and Alex Davis earlier this year, reusing what worked and extending the program activities. Ileana, Stef and I led the second year of the Reflections Program as well, and are excited to continue to have new channels and sponsorship so people have friendly entryways to engage with open science. Stefanie has led more and more core activities, doing all setup for Champions Cohorts, teaching lessons, supporting NASA mentors and coworking, and designing and leading the new Quarto + GitHub Contributing Clinic. Look out for Stef’s talk at posit::conf next month about how we use Sean Kross’s Kyber R package to save time and reduce manual errors in Champions Cohorts setup!\nAll of us work closely with Mentors and Champions and others in the greater Openscapes and open science community, and we appreciate you!" + "objectID": "news/2023-05-17-mentor-coach/index.html#building-mindsets-as-leaders", + "href": "news/2023-05-17-mentor-coach/index.html#building-mindsets-as-leaders", + "title": "How coaching skills have made us better open data science mentors", + "section": "Building mindsets as leaders", + "text": "Building mindsets as leaders\nDeveloping coaching skills also helped us build new mindsets. There was a braveness that grew throughout our time together that showed up in different ways. One person shared that they are more brave with whom/when/where they might interact as a coach and mentor. They had recently found themselves in-person with someone senior and rather than making nervous small talk found themselves asking powerful questions and really connecting with the senior person more, and felt that they both learned something in this short moment together.\nWe grew these new mindsets with our peers and built trust and community in a really profound way. The topics people surfaced and shared were so vulnerable – navigating racism, personal and structural saboteurs, and the integrations of personal and work life. We had never experienced such vulnerability in our work, and knew we could not shy away from difficult topics but needed to dig further and out based on the courage and trust in the room.\nThoughts from Julie. I’ve talked a lot about the impact of open data science on my career and my life. My science thinking was transformed when I realized I could do an analysis just as easily 100 times with a for-loop as doing it twice, and that I could publish my work via RMarkdown and GitHub to the open web and share via a single URL instead of sending followup emails with different versions of the same PDF or Word doc. Now, I am realizing that the impact of coaching on my thinking might be at this same level. I am still processing it all, but I am feeling more confident in places I have been struggling to show up as my full self. It is somehow helping me bring confidence into a room with me, knowing that I have new skills and a strengthened sense of shared braveness together with this cohort. When we first planned this cohort with Tara, this was new terrain. We asked ourselves, “If this is wildly successful what are the outcomes? What’s possible?“ Here are some ideas we laid out, and I think the Mentors are meeting each one:\n\nPeople model inclusive behavior in work, life, Openscapes, and our home organizations, to influence culture change\nPeople are braver, share stories and energy at work and other places\nSomeone speaks up in a meeting\nEveryone learns something new! (me too!)\nWe listen better/differently\nWe scale participation - use coaching strategies to empower others sooner, so that existing mentors don’t burn out\nMore people feel safe in Openscapes and open science, and in turn, inspire others to be braver" }, { - "objectID": "news/2024-07-18-openscapes-update/index.html#structure", - "href": "news/2024-07-18-openscapes-update/index.html#structure", - "title": "Openscapes update from Julie Lowndes, summer 2024", - "section": "STRUCTURE", - "text": "STRUCTURE\nIn 2022 I started Openscapes LLC as a mechanism to administer funds to support the Openscapes open source community. In my mind, the LLC is not synonymous with all the Openscapes community work described above, it is one piece supporting the community. Openscapes LLC is a value-driven vehicle to try to support open science as a career – a sustainable and lasting career — for myself and for others. An LLC was a mechanism that was possible for me. I do sometimes feel like I have to justify this choice, and I push back on the idea that companies are inherently bad or that non-profits uniquely embody the values of open science (see Chris Hartgerink’s eloquent post about this (Not-)for-profit in research). I see many people wondering how to make open science a sustainable job and we need more pathways – it’s important to be able to explore and discuss mechanisms together as an open community. So how is Openscapes LLC value-driven? We are not motivated by profit. We pay people for their time, we pay quickly, and aim to pay them well. We can work pro-bono at times to collaborate with partners, as we do with the Pathways for Open Science Program and the Tribal Exchange Network Group. We can also donate to causes aligned with our values. Since we believe that open science plays a critical role in climate solutions and justice, we joined 1% for the Planet and starting later in 2024 will donate at least 1% of revenue each year to environmental non-profits. This will be small, but small numbers matter, as does visibly connecting our values with how we work.\nAnd, I am now full time at Openscapes LLC! In May 2024 I shifted to an affiliate position at NCEAS/UC Santa Barbara, after working as a Project Scientist there for 11 years (2013-2024). I love the community and teams at NCEAS - the Ocean Health Index in particular as my open science origins (see 2021 SORTEE slides) along with the admin staff. From undergrad to PhD to NCEAS, I have been at universities since 1999, and this is a big shift for me. And I also feel prepared as I continue developing as a scientist, open science champion, feminist, anti-racist, and human, throughout all these years with all the people I have learned from and worked with along the way. So some underlying structure of my situation has changed, but Openscapes’ momentum is unchanged. \nBeing a small women-owned business owner and designing Openscapes values into the business structure is something I am really proud of. It feels different in some ways compared to being a scientist, but in fact I am solidly both. It has been a lot of work to build and manage a company and I continue to learn really important skills to support the work — and I have not done it alone! I so greatly value my accounting & contracts team, as well as my leadership coach and advisors. And so many practical conversations from people I admire in this community. And, I think that Openscapes LLC is a step. I would like the mechanism to administer funds on the back end to match the community approach on the front end. I am eyeing a collaborative structure in a not-too-distant future, and have talked with some of you about this already (and I am learning from Liminal this way as well). However, we’ll take it one step at a time. We are dedicated and in this for the long-haul: Openscapes LLC is a “keepgoing”, not a startup, to borrow language from open source community lead Greg Wilson." + "objectID": "news/2023-05-17-mentor-coach/index.html#fearless-in-service-of-something", + "href": "news/2023-05-17-mentor-coach/index.html#fearless-in-service-of-something", + "title": "How coaching skills have made us better open data science mentors", + "section": "Fearless in service of something", + "text": "Fearless in service of something\nWorking with Tara and bringing Openscapes Mentors across different organizations and initiatives is part of movement building with our Flywheel. This is a concept developed by Jim Collins that we adapted for Openscapes with Erin Robinson (Erin first brought coaching into Openscapes strategy and practices too!). Transformations occur from relentlessly pushing a giant, heavy flywheel that builds momentum over time. Using this model, we welcomed folks to opt in, created space and place so we could invest in learning and trust, and then worked openly together as we practiced as coaches and coachees, leveraging common experiences and skills. This turn of the flywheel is part of building the momentum of kinder and open science, building from past, parallel, and collaborative work from many places. Mentors are already inspiring others with their leadership, pushing the next turn of the flywheel.\nBravery has come up throughout this cohort and this post, and this braveness and fearlessness is in service of something. We’re wanting to connect our daily work with the global moment at hand, so we can better address issues stemming from climate change and social justice. As one participant said, “I don’t want to be scared to ask questions anymore”. We want to ask questions with no ego, in rooms with our science peers. We want to break the silences, opening up the rooms so that the next person who has a question but was not sure they would voice it is empowered to speak up.\nIn our final session we paired up to coach each other through developing our own statement of purpose in open science.\n\n\n“I am an elevator to a better tomorrow”\n\n\n\n\n\n“I am a pollinator who connects people to each other and ideas so everyone flourishes”\n\n\n\n\n\n“I am the momentum that answers to my peers”\n\n\n\nWe are all the momentum that answers to our peers. To make meaningful change, we must work across all levels and elevate those who will be the change along with us.\n\n ::: {.caption-text .center-text} Photo by Elliot Lowndes :::" }, { - "objectID": "news/2024-07-18-openscapes-update/index.html#questions-were-pondering", - "href": "news/2024-07-18-openscapes-update/index.html#questions-were-pondering", - "title": "Openscapes update from Julie Lowndes, summer 2024", - "section": "QUESTIONS WE’RE PONDERING", - "text": "QUESTIONS WE’RE PONDERING\nWe are deeply interested in the “so what” of open science. So teams are more efficient and morale is higher, science is more reproducible, data are more FAIR. So what – is response to wildfires faster, with partners and residents better informed due to open data and sharing? Are communities developing equitable solutions to water management also working on the other side of the world due to trust built and amplified? In my own neighborhood, I see wildfire communications vastly improved because of open data, and groups sharing information and visualizations openly. Fewer neighbors message to ask “where/how big”? And the conversations shift to what to do and how to help each other. This is because they can see the data easily themselves and are informed. I am ready for Openscapes to contribute to stories like these, for the Flywheel to spin for climate and social justice solutions. We’re in a moment where open science is still “new”, shifting from its early adopter moment to the early majority, so it feels early and energizing and new. And, at the same time, people have been working on this for decades, and there is an impatience for us to really gain traction and identify and tell these stories to connect us and unite us in hope and action due to all that we’ve done with open science. It’s about people, and we’re ready.\nI’ll end here for now, thank you for reading. There is so much more learned and on my mind and plate and I look forward to continue collaborating and making a difference with you all. I’m nothing but excited for going forward together.\n\n\n\nLlanwrst, Wales, photo by Julie Lowndes" + "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html", + "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html", + "title": "Engaging with a Cross-NASA Subcommunity", + "section": "", + "text": "Cross-posted from Carpentries, Engaging with a Cross-NASA Subcommunity\nIn a recent Carpentries Community Session a set of three programs with Carpentries memberships within the US National Aeronautics and Space Administration (NASA) shared a bit about how they currently engage with The Carpentries. The purpose of the session was to explore opportunities to support the activities of these programs through formation of a Carpentries subcommunity. A Carpentries subcommunity is defined as “a subset of our global community that can be local, regional, domain-specific, or a group of community members sharing a common language or interests.” Anyone interested in developing an engaged network of Instructors was invited to attend the session, resulting in 56 community members representing multiple US government agencies, state governments, universities, and non-profits.\nThe session began with three short presentations by representatives from each of the three NASA programs, which are summarised and with the presentation slides below." }, { - "objectID": "news/2024-04-04-nasa-earthdata-aaron-friesz/index.html", - "href": "news/2024-04-04-nasa-earthdata-aaron-friesz/index.html", - "title": "NASA Earthdata Data Chat with Aaron Friesz", - "section": "", - "text": "Aaron Friesz, science coordination lead at NASA’s Land Processes Distributed Active Archive Center (LP DAAC) and NASA Openscapes Mentor, helps promote open science principles to empower more diverse, inclusive, and effective data science communities.\nRead the NASA Earthdata Data Chat interview with Aaron where he discusses what being a NASA Openscapes Mentor entails, how he and his fellow mentors promote open science, and the resources available to help users develop their cloud computing skills.\n\n\n\n\nCitationBibTeX citation:@online{friesz2024,\n author = {Friesz, Aaron and M. Smith, Joseph},\n title = {NASA {Earthdata} {Data} {Chat} with {Aaron} {Friesz}},\n date = {2024-04-04},\n url = {https://nasa-openscapes.github.io/news/2024-04-04-nasa-earthdata-aaron-friesz/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nFriesz, Aaron, and Joseph M. Smith. 2024. “NASA Earthdata Data\nChat with Aaron Friesz.” April 4, 2024. https://nasa-openscapes.github.io/news/2024-04-04-nasa-earthdata-aaron-friesz/." + "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-openscapes-presented-by-chris-battisto", + "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-openscapes-presented-by-chris-battisto", + "title": "Engaging with a Cross-NASA Subcommunity", + "section": "NASA Openscapes presented by Chris Battisto", + "text": "NASA Openscapes presented by Chris Battisto\nPresentation slides\nChris Battisto, a scientist at Goddard Earth Sciences Data and Information Services Center (GES DISC) Distributed Active Archive Center, introduced the NASA Openscapes project and the approach that the community uses to collaborate together to support researchers using NASA Earthdata to migrate their analytical workflows to the cloud. Openscapes is, generally, an approach and a movement that helps researchers and those supporting research find each other and feel empowered to conduct data-intensive science. Through a Carpentries membership, all mentors in the NASA Openscapes community participate in Instructor Training. In addition, NASA Openscapes uses the Carpentries modular style teaching approach and many of the pedagogical tools like live coding to teach learners using NASA Earthdata to access and analyze data in the AWS Cloud." }, { - "objectID": "news/2024-08-30-esip-summer-2024/index.html", - "href": "news/2024-08-30-esip-summer-2024/index.html", - "title": "Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud", - "section": "", - "text": "This is a brief summary of the session we led at the 2024 ESIP summer conference, focused primarily on the breakout group feedback from the session! We define Onboarding as a friendly first experience in the Cloud, framed via technical infrastructure, lessons on open science and cloud concepts, and social support. We define Fledging as a friendly set up for Cloud that works for me, including a plan, how to do it, how to pay for it. It means leaving the nest, soaring high and perhaps building your own nest.\nQuicklinks:\nThe theme of the 2024 ESIP Summer meeting was “grounded in trust”, with a focus on ethics and establishing relationships. This theme rooted us: we’ve spent the last 3 years introducing people to the cloud for scientific computing, motivated by the fact that NASA is moving Earthdata to the cloud. We focused on helping scientists using NASA Earthdata and what this migration means for them. But only in the past year have we focused on “offboarding”, to complement our onboarding process (focused on where they go after they leave our JupyterHub) – but that term felt harsh, like walking the plank. We wanted a friendlier way to talk about this, so we call it “fledging” since people are spreading their wings after being in the “nest” with their nestmates, learning together in the JupyterHub we provide for workshop participants, in collaboration with our partners at 2i2c.\nFirst, Alexis Hunzinger (GES DISC) shared Aronne Merrelli’s story (show-not-tell). Aronne was a participant in the 2023 NASA Openscapes Champions group, and found the Cloud to be a “superpower” - see this blog post summary and video of Aronne sharing with the 2024 Champions science teams.\nThen, Aaron Friesz (LP DAAC) and Danny Kaufman (ASDC) broke down all the components that helped build that nest. This includes a central focus on researcher/user needs and iterating through teaching; How we work – openly, with synchronous and asynchronous space and place; and all the onboarding support for how they learn and work.\nAnd then Julie Lowndes (Openscapes) and Eli Holmes (NOAA Fisheries) shared about fledging experiences so far - what we do and think about. This focused on where people fledge to and cost. Eli Holmes shared how she fledged in a different way, not only as a researcher but also as a facilitator who sets up infrastructure for others within her government agency. She shared how not all the participants leaving the nest are birds. Some are zebras and others are fish. Their needs when fledging are fundamentally different from those of the birds. And even among the birds, there is variety." + "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-develop-presented-by-sean-mccartney", + "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-develop-presented-by-sean-mccartney", + "title": "Engaging with a Cross-NASA Subcommunity", + "section": "NASA DEVELOP presented by Sean McCartney", + "text": "NASA DEVELOP presented by Sean McCartney\nPresentation slides\nSean McCartney, Senior Scientific Analyst at NASA Goddard Space Flight Center, presented on NASA DEVELOP. NASA DEVELOP is a workforce training program that places staff in teams of four to five individuals to work on projects lasting ten weeks. Through this program, participants showed strong interest in gaining more technical training in coding and image processing skills. This resulted in a partnership with The Carpentries in 2018 to host Software Carpentry workshops at NASA centers across the United States. Since that partnership began, the program has trained 30 Instructors and hosts 3 workshops a year." }, { - "objectID": "news/2024-08-30-esip-summer-2024/index.html#breakout-groups---participant-feedback", - "href": "news/2024-08-30-esip-summer-2024/index.html#breakout-groups---participant-feedback", - "title": "Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud", - "section": "Breakout groups - participant feedback", - "text": "Breakout groups - participant feedback\nParticipants in the room self-identified as Cloud enablers/facilitators (60%), as well as Cloud users (35%) and neither (27%).\n\nWe asked participants to share their experiences in breakout groups. We wanted to know from our audience of cloud facilitators/enablers and cloud users, what solutions and challenges they have found when it comes to onboarding to and fledging from the Cloud. Between the feedback received during this breakout session and responses from a survey sent to past program participants about their current cloud usage and challenges, here are some common challenges and new points we haven’t heard before.\nStand out:\n\nCreate easy wins early on to make onboarding more encouraging!\nInterest in learning how to set up environments via tutorials.\nHow does one find or qualify for these “onboarding” opportunities? It seems like there is a privilege based on who you know.\n\nCommon ones:\n\nFor onboarding, keep tutorials simple, but relevant to the discipline.\nPeople feel successful and supported through many, open channels of connection (e.g. Slack, hack/coworking times, anonymous questions, etc.).\nSome feedback from users: when I go to nasa.gov, I can’t find any cross-DAAC stuff, or earthaccess.\nNot all data is in the cloud, we are still operating in hybrid mode.\nIt’s a challenge to spend time and energy optimizing legacy code and data formats for the cloud - it’s tempting to just “lift and shift”.\nOrganizational silos and management priorities are a barrier to experimenting with cloud capabilities.\n\nThe following screenshots illustrate participants responses to several questions. We include them here for readers to consider where their own communities land.\n\n\n\n\nOne thing we noted was that more people had thoughts about onboarding rather than fledging. And that’s ok! Fledging is very new to us as an idea, having really started talking about it last summer at ESIP and more readily (and calling it fledging) at AGU and this spring, in conversations with Yuvi Panda, Carl Boettiger, and Eli Holmes." + "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-tops-presented-by-katherine-blanchette", + "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-tops-presented-by-katherine-blanchette", + "title": "Engaging with a Cross-NASA Subcommunity", + "section": "NASA TOPS presented by Katherine Blanchette", + "text": "NASA TOPS presented by Katherine Blanchette\nPresentation slides\nKatherine Blanchette, STEM Engagement Specialist at NASA’s Ames Research Center & Armstrong Flight Research Center, presented on NASA TOPS. This program began in response to the White House’s Transform to Open Science Initiative and the identification of 2023 as the Year of Open Science. As part of this program, a curriculum has been developed that includes five modules on a range of open science topics where learners get badges for each module completed. Instructors are needed to teach these modules, and this has been facilitated through participation in Instructor Training. A modified version of Instructor Training was piloted on 27 October to support these Instructors teaching the curricula." }, { - "objectID": "news/2024-08-30-esip-summer-2024/index.html#closing-thoughts", - "href": "news/2024-08-30-esip-summer-2024/index.html#closing-thoughts", - "title": "Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud", - "section": "Closing thoughts", - "text": "Closing thoughts\nJulie Lowndes - ESIP is a great conference - for me it feels like RStudio and rOpenSci conferences, which means it is welcoming and highly productive and filled with friends everywhere - even when you don’t know them yet. This is my 4th year of ESIP confs (starting in 2020 when Erin Robinson invited me to keynote and this kicked off our NASA Openscapes collaboration!), and my second in person. Last year, I took away how Aaron Friesz remarked that “I’ve been to many ESIP conferences representing my data center (LP DAAC), but this year I felt like people saw me as someone to collaborate with as an expert on supporting users in the cloud”. This year, I’m taking away how embraced and loved “earthaccess” is. “Earthaccess” is a python library that has vastly improved everyone’s experience accessing NASA Earthdata programmatically (both locally and in the cloud). It was first developed by Luis López through working closely with Champions science teams and is now awesomely co-developed by a NASA open source community with contributors extending across DAACs, other parts of NASA, and beyond. I heard “earthaccess” everywhere, in talks, in hallways. People used “earthaccess” used like “Zoom” or “ggplot” - it’s a tool you use, no need to discuss further, we all know it as a vital part of the picture. I also really felt how the word “Openscapes” was used by many as an “us” or “we”; “Openscapes does this” means a community with many many people involved – and people see and feel that. This was always the vision that Erin Robinson and I have had, and I really felt it here. It was amazing.\nCarl Boettiger, during a coworking debrief: Onboarding is a very visible thing, we can ensure there’s no sharp edges in the nest. But when you leave there are more edges - we can think of how to soften, where it works well, where there is a need. We can learn where there are training places and where it’s technical, what to develop to put in place." + "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#opportunities-for-a-nasa-subcommunity", + "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#opportunities-for-a-nasa-subcommunity", + "title": "Engaging with a Cross-NASA Subcommunity", + "section": "Opportunities for a NASA Subcommunity", + "text": "Opportunities for a NASA Subcommunity\nFrom the three presentations it was clear that across NASA, these programs find real benefits leveraging The Carpentries to extend data science skills within NASA’s internal and external communities of practice. As new Instructors complete training in support of these programs, there exist opportunities to build a subcommunity through programming and resources available through The Carpentries Community Development Program.\nAttendees discussed this general interest in forming a cross-NASA Carpentries subcommunity. To kick-off the discussion, Elizabeth Joyner led attendees in two rounds of 3-2-1 silent reflection where she asked participants to list three data science and coding skills that researchers and practical data users need at NASA, two questions about Carpentries subcommunities, and one metaphor or simile about what you envision for a thriving subcommunity of Carpentries Instructors. As we closed out of this discussion, clear themes emerged; attendees are interested in increasing efficiency with data, working more openly and collaboratively with data, building and maintaining reproducible workflows and increasing data fluency and dexterity with NASA data (Figure 1).\n\n\n\n\nFig. 1 - Word cloud of 50 most common words across both 3-2-1 exercises.\n\n\n\nFrom the second part of the reflection, the questions generated by the group acted as a starting point for a lively discussion, which will hopefully continue to be good fodder for the subcommunity to develop its initial charge. There were questions about how to find additional Instructors across NASA and who might be missing from this discussion. There were also questions about how to engage NASA grantees and other stakeholders who use NASA data, as well as about how to extend the curriculum being taught and explicit pointers to Library Carpentries.\nThe third prompt was for a metaphor or simile of a thriving community. Some of our favourite imagery was that a thriving community is like a networked dream catcher, a bee hive, or three goats on each other’s shoulders in a trenchcoat trying to sneak in.\nFollowing the teaching model advocated by The Carpentries, the three NASA programs have all intentionally cultivated communities that support learners and support ongoing learning. Considering this, there is general excitement about the possibility of a NASA subcommunity with 20 attendees indicating interest in joining a follow-up conversation." }, { - "objectID": "news/2023-02-21-news-february-2023/index.html", - "href": "news/2023-02-21-news-february-2023/index.html", - "title": "Openscapes Newsletter #6: Winter 2023", - "section": "", - "text": "Welcome to Openscapes’ sixth newsletter! If you’re interested in seeing these infrequent updates in your inbox, please sign up here (linked from our get involved page).\n\nHello! As we continue into 2023, we at Openscapes continue to come back to the core of what we do: we engage, empower, and amplify. Whether it is with tech like Quarto and JupyterHubs or communities like R-Ladies, Ladies of Landsat, Black in Marine Science, and NASA Earthdata, it’s about welcoming folks to better ways of working and open science.\nIn 2023, we’re committed to being braver in connecting the impact of our work to the environment and the climate movement; to culture and mindset change for individuals, for teams, and for institutions; and as always, to kinder science.\nIn the last year, what emerged was a clear sense of movement building towards better science for future us. The Openscapes community grew as Champions and Mentors prioritized time for learning, sharing, teaching with each other, and also advocated for themselves and their colleagues to have time to do so.\n\nNASA Openscapes Mentors continued co-creating and reusing teaching resources to support colleagues and researchers using NASA Earthdata to migrate workflows to the Cloud. Mentors also taught workshops, gave talks, participated and created in public forums, and built software and conceptual infrastructure to support users and practice open science, and are also investing their knowledge and lessons back into the Earthdata Cloud Cookbook. Co-lead Erin Robinson led a publication now under review about The Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices (preprint).\nNOAA Fisheries Mentors supported their colleagues through six Champions Cohorts. Read about the experiences and impacts of Fall 2022 Openscapes training nationwide, with additional posts from NOAA Fisheries Alaska, and Southwest, Summer Southeast, and Winter Alaska Fisheries Science Centers. Additional resources include the NMFS Openscapes site and NMFS Open Science Resource Book.\nCalifornia Water Boards / CalEPA Mentors forked the Champions program and co-led the first Cohort for the California Water Boards (blog post) and fully documented it in a Quarto book, Openscapes at the Water Boards.\n240 Champions participated in Openscapes this year; their work and energy has been awesome! It’s so wonderful to see teams of Champions come back to guest-teach their peers and share their ongoing journeys toward more open, kinder science. See their stories above with NASA, NOAA Fisheries, and CalEPA.\nIleana Fenwick and Stefanie Butland joined the Openscapes team (tweet)! They both do incredibly valuable work and we are so grateful to work together.\nWe hosted 3 Community Calls: A Qualitative Data Analysis Chat with Dr. Beth Duckles; Hello Quarto! A Quarto Chat with NASA Openscapes, co-hosted with R-Ladies Santa Barbara; Reimagining open science as part of the climate movement, a chat with Dr. Monica Granados (summary posts of Community Calls).\nJulie gave a co-keynote at rstudio::conf(2022) with Mine Cetinkaya-Rundel, titled Hello Quarto: share, collaborate, teach, reimagine. This was the official launch of Quarto (blog post) and it was such an honor to share about the Openscapes community on this big stage!\nOne of the things we hear often from researchers is that they feel like they can’t take vacation - too much rests solely on their shoulders, solely on their laptops. In the shared-joy and sustainability-through-open-science departments, Julie wrote about how our open science process made it possible for her to unplug for a 2-week vacation (blog post).\nShoutout to all the Champions and Mentors and community who have shared their successes - big and small - with us. You keep us energized!\n\nThis year, we’re continuing our work with NASA, NOAA, and the California Water Boards and have started new relationships and programs. We’re excited to continue to grow the Open Science movement as part of the Year of Open Science (Biden Harris administration announcement).\n\nAlready we’ve launched Pathways to Open Science for Black environmental & marine researchers, led by Ileana Fenwick in partnership with Black in Marine Science (BIMS) and Black Women in Ecology, Evolution, and Marine Science (BWEEMS). 80 people attended the first session(!) and we are committing to offer this annually.\nAt the ESIP Winter meeting in January we coordinated a panel discussion. Mentors from NASA, NOAA Fisheries, CalEPA, and Pathways to Open Science programs shared their stories of open science movement building through Openscapes. Look for a summary blog post in March!\nFebruary through May, five research teams from the U.S Environmental Protection Agency (EPA) Center for Environmental Measurement and Modeling (CEMM) are participating in an Openscapes Champions Cohort with help from new Mentors Gayle Hagler and Jeff Hollister.\nThirty Openscapes Mentors across all of our programs and the Openscapes core team are coming together in their own six-session Cohort to practice Mentoring with a Coach Approach, led by Tara Robertson, professional coach and Openscapes advisor and collaborator.\n\nComing up\n\nNominations open for our 2023 NASA Champions Cohort that will run April - June. Please spread the word for teams using NASA Earthdata and interested in migrating workflows to the Cloud.\nCommunity Calls with Ileana Fenwick, Aneese Williams and Alex Davis about their experiences leading the Pathways to Open Science program, and with Sean Kross describing the workflow creating kyber.\nIn June we’ll launch a brand new program, Openscapes Reflections! This will be a 3-week program, modeled after leadership coaching in a mostly self-paced format. It will offer structure and accountability for participants to reflect and plan on analytical and reporting workflows to improve daily habits and fuel institutional culture change.\n\nThanks for reading, and here’s to kinder science and the Year of Open Science 2023!" + "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#how-to-get-involved", + "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#how-to-get-involved", + "title": "Engaging with a Cross-NASA Subcommunity", + "section": "How to Get Involved", + "text": "How to Get Involved\nIf you are a member of the Carpentries community, work at NASA, and would be interested in being involved in this effort, please email community@carpentries.org. We will reach out shortly to schedule a follow-up call to this discussion. If you have interest in forming a subcommunity or have general interest in the Community Development Program, please email community@carpentries.org. You can also find information about upcoming meetings on the Etherpad." }, { - "objectID": "news/2023-02-21-news-february-2023/index.html#openscapes-newsletter-6-winter-2023", - "href": "news/2023-02-21-news-february-2023/index.html#openscapes-newsletter-6-winter-2023", - "title": "Openscapes Newsletter #6: Winter 2023", + "objectID": "news/2024-02-28-earthdata-webinar/index.html", + "href": "news/2024-02-28-earthdata-webinar/index.html", + "title": "NASA Earthdata Webinar. Community Developed Cloud Computing Resources: the Cloud Cookbook from NASA Openscapes", "section": "", - "text": "Welcome to Openscapes’ sixth newsletter! If you’re interested in seeing these infrequent updates in your inbox, please sign up here (linked from our get involved page).\n\nHello! As we continue into 2023, we at Openscapes continue to come back to the core of what we do: we engage, empower, and amplify. Whether it is with tech like Quarto and JupyterHubs or communities like R-Ladies, Ladies of Landsat, Black in Marine Science, and NASA Earthdata, it’s about welcoming folks to better ways of working and open science.\nIn 2023, we’re committed to being braver in connecting the impact of our work to the environment and the climate movement; to culture and mindset change for individuals, for teams, and for institutions; and as always, to kinder science.\nIn the last year, what emerged was a clear sense of movement building towards better science for future us. The Openscapes community grew as Champions and Mentors prioritized time for learning, sharing, teaching with each other, and also advocated for themselves and their colleagues to have time to do so.\n\nNASA Openscapes Mentors continued co-creating and reusing teaching resources to support colleagues and researchers using NASA Earthdata to migrate workflows to the Cloud. Mentors also taught workshops, gave talks, participated and created in public forums, and built software and conceptual infrastructure to support users and practice open science, and are also investing their knowledge and lessons back into the Earthdata Cloud Cookbook. Co-lead Erin Robinson led a publication now under review about The Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices (preprint).\nNOAA Fisheries Mentors supported their colleagues through six Champions Cohorts. Read about the experiences and impacts of Fall 2022 Openscapes training nationwide, with additional posts from NOAA Fisheries Alaska, and Southwest, Summer Southeast, and Winter Alaska Fisheries Science Centers. Additional resources include the NMFS Openscapes site and NMFS Open Science Resource Book.\nCalifornia Water Boards / CalEPA Mentors forked the Champions program and co-led the first Cohort for the California Water Boards (blog post) and fully documented it in a Quarto book, Openscapes at the Water Boards.\n240 Champions participated in Openscapes this year; their work and energy has been awesome! It’s so wonderful to see teams of Champions come back to guest-teach their peers and share their ongoing journeys toward more open, kinder science. See their stories above with NASA, NOAA Fisheries, and CalEPA.\nIleana Fenwick and Stefanie Butland joined the Openscapes team (tweet)! They both do incredibly valuable work and we are so grateful to work together.\nWe hosted 3 Community Calls: A Qualitative Data Analysis Chat with Dr. Beth Duckles; Hello Quarto! A Quarto Chat with NASA Openscapes, co-hosted with R-Ladies Santa Barbara; Reimagining open science as part of the climate movement, a chat with Dr. Monica Granados (summary posts of Community Calls).\nJulie gave a co-keynote at rstudio::conf(2022) with Mine Cetinkaya-Rundel, titled Hello Quarto: share, collaborate, teach, reimagine. This was the official launch of Quarto (blog post) and it was such an honor to share about the Openscapes community on this big stage!\nOne of the things we hear often from researchers is that they feel like they can’t take vacation - too much rests solely on their shoulders, solely on their laptops. In the shared-joy and sustainability-through-open-science departments, Julie wrote about how our open science process made it possible for her to unplug for a 2-week vacation (blog post).\nShoutout to all the Champions and Mentors and community who have shared their successes - big and small - with us. You keep us energized!\n\nThis year, we’re continuing our work with NASA, NOAA, and the California Water Boards and have started new relationships and programs. We’re excited to continue to grow the Open Science movement as part of the Year of Open Science (Biden Harris administration announcement).\n\nAlready we’ve launched Pathways to Open Science for Black environmental & marine researchers, led by Ileana Fenwick in partnership with Black in Marine Science (BIMS) and Black Women in Ecology, Evolution, and Marine Science (BWEEMS). 80 people attended the first session(!) and we are committing to offer this annually.\nAt the ESIP Winter meeting in January we coordinated a panel discussion. Mentors from NASA, NOAA Fisheries, CalEPA, and Pathways to Open Science programs shared their stories of open science movement building through Openscapes. Look for a summary blog post in March!\nFebruary through May, five research teams from the U.S Environmental Protection Agency (EPA) Center for Environmental Measurement and Modeling (CEMM) are participating in an Openscapes Champions Cohort with help from new Mentors Gayle Hagler and Jeff Hollister.\nThirty Openscapes Mentors across all of our programs and the Openscapes core team are coming together in their own six-session Cohort to practice Mentoring with a Coach Approach, led by Tara Robertson, professional coach and Openscapes advisor and collaborator.\n\nComing up\n\nNominations open for our 2023 NASA Champions Cohort that will run April - June. Please spread the word for teams using NASA Earthdata and interested in migrating workflows to the Cloud.\nCommunity Calls with Ileana Fenwick, Aneese Williams and Alex Davis about their experiences leading the Pathways to Open Science program, and with Sean Kross describing the workflow creating kyber.\nIn June we’ll launch a brand new program, Openscapes Reflections! This will be a 3-week program, modeled after leadership coaching in a mostly self-paced format. It will offer structure and accountability for participants to reflect and plan on analytical and reporting workflows to improve daily habits and fuel institutional culture change.\n\nThanks for reading, and here’s to kinder science and the Year of Open Science 2023!" + "text": "Join the NASA Earthdata Webinar Wednesday, February 28, 2:00 - 3:30 ET, to learn how to use the NASA Openscapes Earthdata Cloud Cookbook—a compilation of open-source tutorials, workflows, libraries, and cheatsheets that help users find, access, and work with Earth science data.\nDetails and to register (free)\nAbstract\nNASA Openscapes (nasa-openscapes.github.io) is a community of NASA data center staff and open science contributors who are supporting researchers migrating workflows to the Cloud. As part of this effort we are openly developing the Earthdata Cloud Cookbook: a compilation of open source tutorials, workflows, and cheatsheets that we have refined through teaching over 20 Cloud workshops with researchers using NASA Earthdata. We support NASA Earthdata users by developing an open science mindset focused on kindness and inclusion, as well as developing software to reduce time to science and meet researchers where they are. The earthaccess library and corn base image helps researchers access NASA Earthdata in a few lines of code – in Python, R, and MATLAB. We will share about this ongoing work and how we collaborate to share lessons learned and tackle challenges together - and welcome you to join the open science movement." }, { "objectID": "news/2023-08-01-nasa-champions/index.html", @@ -609,291 +581,340 @@ "text": "About the NASA Openscapes Champions Teams\nCLIMCAPS Team We use a number of NASA products in CLIMCAPS to stabilize and improve the retrieval of atmospheric profiles from hyperspectral infrared measurements. These include (i) MERRA-2 and (ii) the MEASURES CAMEL dataset. We distribute CLIMCAPS as Level 2 and Level 3 files to a range of different users. Our research focuses on maintaining/improving the CLIMCAPS algorithm and collaborating with users to improve and tailor CLIMCAPS data products. Since releasing the CLIMCAPS record via GES DISC in 2020 (2002–present), we have seen our user base grow. We have had the chance to collaborate with many groups. This gave us the opportunity to address their questions, clarify the product and help prepare custom Level 3 files that are tailored to target applications. The CLIMCAPS Level 2 product contains many different types of uncertainty metrics that can be used to filter and refine data usage. We would absolutely love the opportunity to make these workflows, that we’ve helped develop for users, more widely available. I have no doubt that other communities will find it useful also, and we want, in turn, to learn from others. Experience is teaching us that good science happens when developers and scientists collaborate together. And this is why I think Cloud-based workflows is one of the most exciting technology advances in recent years.\nHEAT (HydroEnergy Analytics Team) There is an increasing global demand for food, water and energy mainly driven by rapid urbanization, rising population, economic growth and regional conflicts. As water, energy and food are interconnected and are part of a system, we will adopt an integrated Water-Energy-Food Nexus (W-E-F) approach to examine the interdependence of water, energy and food and the impacts of climate change on water, energy, and food consumption in Nepal. Nepal, a country located in Southeast Asia, presents a unique case, where the datasets are either sparse, extremely challenging to obtain, or unavailable. Assessing W-E-F Nexus is particularly challenging due to gaps in datasets and lack of long-term observations. NASA’s Earth Observation data can be used to overcome these obstacles by providing ongoing long-term observations of the planet at various spatial and temporal resolutions, effectively filling in the gaps in the data. Our approach involves utilizing data-driven techniques to analyze the W-E-F nexus at watershed level in Nepal. Specifically, we plan to combine NASA’s Earth Observation data with hydropower generation, agricultural production and socioeconomic data in Nepal to gain a more comprehensive understanding of the W-E-F nexus in the region. We have identified several potential datasets, and will address two major questions in the cohort: 1) How has water availability, hydropower generation and consumption, demographics, crop yield changed in Nepal over the last 20 years? 2) What is the relationship between change in hydropower generation with respect to changes in hydrometeorology and demographics? Outcome: We will develop a Jupyter Notebook that outlines a comprehensive method for generating outputs from data acquisition using a Cloud environment. This end-to-end process will be clearly described in the notebook, providing an intuitive and efficient workflow that can be replicated by others adhering to the open science principles. Through this effort, we aim to facilitate the use of Cloud computing in data analysis and dissemination, streamlining the research process and enabling more efficient collaboration among researchers. The final Jupyter Notebook will be shared in the collaborative space (GitHub). The pain points encountered from an interdisciplinary user’s perspective will be documented.\nLASERS Team Our team has expertise in assessing vegetation biophysical parameters using data from all platforms, terrestrial, airborne and spaceborne. We have experience in using the Google Earth Engine and ICESat-2 data to produce gridded-maps of canopy height and canopy cover and we have produced open science software tools for displaying and labeling ICESat-2 photons, e.g., PhotonLabeler, or Waveformlidar, both available on GitHub. Our research efforts of producing Landsat-resolution gridded maps of canopy height, canopy cover, and biomass, are limited in scale by using local computing and data download-intensive approaches. Educational accounts on Cloud-based platforms, such as GEE, have limitations for data availability, data volume and modeling options, and the learning curve and cost for migrating to platforms like AWS, have their own challenges. As such, we hope that by joining NASA’s Openscapes we’ll remove barriers to producing timely vegetation products at continental and global scales to better answer pressing questions in ecology while empowering students and young scientists to use Cloud-computing and open science tools. We use ICESat-2 data, Landsat, and derived data to characterize vegetation structure and estimate biophysical parameters, such as height, cover, biomass. For producing gridded maps of vegetation parameters at scales larger than regional, e.g., continental and global, the volume of data download and processing time are hampering the workflow, therefore we intend to migrate the process to the Cloud.\nGeoweaver Team Our group has a lot of interests and collaboration history with DAACs and the Earth science community, and we are dedicated to developing Geoweaver to support Earth science teams as well as DAAC staff (data pipeline, ingestion, migration, analytics) to be productive, and their work are tangible and FAIR for other scientists to reproduce. We use NASA data as input variables to AI models to train the models with the ability to discover Earth insights in time and be actionable. We are very interested in migrating the workflow into the Cloud because that is where the data is and there are data retrieval and I/O steps in our workflows which are slow if they are executed outside the Cloud. By migrating workflows into Cloud, we want to experiment and showcase that: (1) scientists can easily switch from their personal computing environments to Cloud environment seamlessly and effortlessly using Geoweaver; (2) the hybrid collaboration environment provided by NASA and researchers’ home institution, including their laptops, can work together for one single workflow (/purpose) without under-using (wasting) resources; (3) make the building-testing-debugging iteration more quick, useful, transparent, and of course FAIR (Geoweaver records everything people did no matter where) and help scientists get serious about workflow run history sharing in a single zip file; (4) show that Geoweaver is a click-button solution if scientists want to deploy their AI workflows into operational services to run periodically like every day.\nS-MODE Team Our group has a diversity of professional experience, ranging from graduate students to PI’s. Everyone in our group is interested in exploring open-source workflows on the Cloud and building machinery to analyze a variety of data from S-MODE (Sub-Mesoscale Ocean Dynamics Experiment). Our collaboration will benefit the general S-MODE community as we plan on sharing our findings. Our overall goal is to foster a data analysis community for S-MODE by creating machinery that can be used by many research groups. From Mackenzie: “I work with NASA funded saildrone data to investigate submesoscale dynamics of the upper ocean and air-sea interactions. Specifically, I am working with saildrone datasets from the Atlantic Tradewind Ocean Atmosphere Interaction Campaign (ATOMIC) and S-MODE. I analyze the saildrone data using python and Jupyter notebooks. Additionally, I use satellite data from SMAP, Aquarius, and SWOT to provide environmental context on where the saildrone data was collected. I currently download most of the datasets and keep them on my university’s HPC system. I use open-source software to analyze the data, which includes python packages such as Xarray, numpy, matplotlib, cartopy, and pandas.”\nHydrometeorology Team We are highly motivated to migrate our ground validation workflow for the NASA GPM - Global Precipitation Measurement product to the Cloud. With over a decade of experience working with ground weather radar products and developing comprehensive workflows for ground validation work, we are eager to streamline and optimize our process. We use NASA data in three areas. First, we conduct cross-validation between NASA GPM products and NOAA ground weather radar products. Second, we create synergy of multiple NASA remote sensing measurements to achieve better precipitation product. Third, we apply NASA remote sensing data to monitor and forecast natural hazards such as flash flooding, drought, tornado, etc. Our team recognizes the numerous benefits that Cloud computing resources can provide. Firstly, Cloud services are highly scalable and can easily accommodate changes in demand from other scientists. Secondly, by migrating our workflow to the Cloud, we can automate many tasks and improve efficiency while reducing the risk of errors or delays. Thirdly, Cloud computing resources are accessible from anywhere with an internet connection, making it easier to collaborate with other scientists. Lastly, Cloud services can be integrated with other tools and services, such as machine learning or data analytics platforms, enhancing the overall capabilities of the workflow. We strongly believe that ground validation efforts require a global approach, and migrating our ground validation workflow to the Cloud can greatly enhance our ability to collaborate with other scientists and improve our work on a global scale.\nGESTAR Team We conduct sensor calibration, mission support and support data applications. I work in the GESTAR2 group (Goddard Earth Sciences Technology and Research II) at UMBC (University of Maryland, Baltimore County). Our team, lead by Dr. Strow with us has been responsible for the development of the CHIRP (Climate Hyperspectral Radiance Product) now being hosted on GES DISC DAAC and intimately concerned with the Aqua AIRS, NOAA CrIS MetOP IASI sensors so that their data can be used for climate studies. We are heavily invested in Matlab with C and Fortran libraries. We deal with 10s of TB data almost daily using the HPC at UMBC - a fantastic resource. There is an interest and growing incentive to migrate to the Cloud, but for us the capital (of effort) to ‘re-locate’ is very significant. We need to understand the cost/benefit in our situation. There is a very steep learning curve and very little time available and there isn’t a one solution to fit all." }, { - "objectID": "news/2024-02-28-earthdata-webinar/index.html", - "href": "news/2024-02-28-earthdata-webinar/index.html", - "title": "NASA Earthdata Webinar. Community Developed Cloud Computing Resources: the Cloud Cookbook from NASA Openscapes", + "objectID": "news/2023-02-21-news-february-2023/index.html", + "href": "news/2023-02-21-news-february-2023/index.html", + "title": "Openscapes Newsletter #6: Winter 2023", "section": "", - "text": "Join the NASA Earthdata Webinar Wednesday, February 28, 2:00 - 3:30 ET, to learn how to use the NASA Openscapes Earthdata Cloud Cookbook—a compilation of open-source tutorials, workflows, libraries, and cheatsheets that help users find, access, and work with Earth science data.\nDetails and to register (free)\nAbstract\nNASA Openscapes (nasa-openscapes.github.io) is a community of NASA data center staff and open science contributors who are supporting researchers migrating workflows to the Cloud. As part of this effort we are openly developing the Earthdata Cloud Cookbook: a compilation of open source tutorials, workflows, and cheatsheets that we have refined through teaching over 20 Cloud workshops with researchers using NASA Earthdata. We support NASA Earthdata users by developing an open science mindset focused on kindness and inclusion, as well as developing software to reduce time to science and meet researchers where they are. The earthaccess library and corn base image helps researchers access NASA Earthdata in a few lines of code – in Python, R, and MATLAB. We will share about this ongoing work and how we collaborate to share lessons learned and tackle challenges together - and welcome you to join the open science movement." + "text": "Welcome to Openscapes’ sixth newsletter! If you’re interested in seeing these infrequent updates in your inbox, please sign up here (linked from our get involved page).\n\nHello! As we continue into 2023, we at Openscapes continue to come back to the core of what we do: we engage, empower, and amplify. Whether it is with tech like Quarto and JupyterHubs or communities like R-Ladies, Ladies of Landsat, Black in Marine Science, and NASA Earthdata, it’s about welcoming folks to better ways of working and open science.\nIn 2023, we’re committed to being braver in connecting the impact of our work to the environment and the climate movement; to culture and mindset change for individuals, for teams, and for institutions; and as always, to kinder science.\nIn the last year, what emerged was a clear sense of movement building towards better science for future us. The Openscapes community grew as Champions and Mentors prioritized time for learning, sharing, teaching with each other, and also advocated for themselves and their colleagues to have time to do so.\n\nNASA Openscapes Mentors continued co-creating and reusing teaching resources to support colleagues and researchers using NASA Earthdata to migrate workflows to the Cloud. Mentors also taught workshops, gave talks, participated and created in public forums, and built software and conceptual infrastructure to support users and practice open science, and are also investing their knowledge and lessons back into the Earthdata Cloud Cookbook. Co-lead Erin Robinson led a publication now under review about The Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices (preprint).\nNOAA Fisheries Mentors supported their colleagues through six Champions Cohorts. Read about the experiences and impacts of Fall 2022 Openscapes training nationwide, with additional posts from NOAA Fisheries Alaska, and Southwest, Summer Southeast, and Winter Alaska Fisheries Science Centers. Additional resources include the NMFS Openscapes site and NMFS Open Science Resource Book.\nCalifornia Water Boards / CalEPA Mentors forked the Champions program and co-led the first Cohort for the California Water Boards (blog post) and fully documented it in a Quarto book, Openscapes at the Water Boards.\n240 Champions participated in Openscapes this year; their work and energy has been awesome! It’s so wonderful to see teams of Champions come back to guest-teach their peers and share their ongoing journeys toward more open, kinder science. See their stories above with NASA, NOAA Fisheries, and CalEPA.\nIleana Fenwick and Stefanie Butland joined the Openscapes team (tweet)! They both do incredibly valuable work and we are so grateful to work together.\nWe hosted 3 Community Calls: A Qualitative Data Analysis Chat with Dr. Beth Duckles; Hello Quarto! A Quarto Chat with NASA Openscapes, co-hosted with R-Ladies Santa Barbara; Reimagining open science as part of the climate movement, a chat with Dr. Monica Granados (summary posts of Community Calls).\nJulie gave a co-keynote at rstudio::conf(2022) with Mine Cetinkaya-Rundel, titled Hello Quarto: share, collaborate, teach, reimagine. This was the official launch of Quarto (blog post) and it was such an honor to share about the Openscapes community on this big stage!\nOne of the things we hear often from researchers is that they feel like they can’t take vacation - too much rests solely on their shoulders, solely on their laptops. In the shared-joy and sustainability-through-open-science departments, Julie wrote about how our open science process made it possible for her to unplug for a 2-week vacation (blog post).\nShoutout to all the Champions and Mentors and community who have shared their successes - big and small - with us. You keep us energized!\n\nThis year, we’re continuing our work with NASA, NOAA, and the California Water Boards and have started new relationships and programs. We’re excited to continue to grow the Open Science movement as part of the Year of Open Science (Biden Harris administration announcement).\n\nAlready we’ve launched Pathways to Open Science for Black environmental & marine researchers, led by Ileana Fenwick in partnership with Black in Marine Science (BIMS) and Black Women in Ecology, Evolution, and Marine Science (BWEEMS). 80 people attended the first session(!) and we are committing to offer this annually.\nAt the ESIP Winter meeting in January we coordinated a panel discussion. Mentors from NASA, NOAA Fisheries, CalEPA, and Pathways to Open Science programs shared their stories of open science movement building through Openscapes. Look for a summary blog post in March!\nFebruary through May, five research teams from the U.S Environmental Protection Agency (EPA) Center for Environmental Measurement and Modeling (CEMM) are participating in an Openscapes Champions Cohort with help from new Mentors Gayle Hagler and Jeff Hollister.\nThirty Openscapes Mentors across all of our programs and the Openscapes core team are coming together in their own six-session Cohort to practice Mentoring with a Coach Approach, led by Tara Robertson, professional coach and Openscapes advisor and collaborator.\n\nComing up\n\nNominations open for our 2023 NASA Champions Cohort that will run April - June. Please spread the word for teams using NASA Earthdata and interested in migrating workflows to the Cloud.\nCommunity Calls with Ileana Fenwick, Aneese Williams and Alex Davis about their experiences leading the Pathways to Open Science program, and with Sean Kross describing the workflow creating kyber.\nIn June we’ll launch a brand new program, Openscapes Reflections! This will be a 3-week program, modeled after leadership coaching in a mostly self-paced format. It will offer structure and accountability for participants to reflect and plan on analytical and reporting workflows to improve daily habits and fuel institutional culture change.\n\nThanks for reading, and here’s to kinder science and the Year of Open Science 2023!" }, { - "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html", - "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html", - "title": "Engaging with a Cross-NASA Subcommunity", + "objectID": "news/2023-02-21-news-february-2023/index.html#openscapes-newsletter-6-winter-2023", + "href": "news/2023-02-21-news-february-2023/index.html#openscapes-newsletter-6-winter-2023", + "title": "Openscapes Newsletter #6: Winter 2023", "section": "", - "text": "Cross-posted from Carpentries, Engaging with a Cross-NASA Subcommunity\nIn a recent Carpentries Community Session a set of three programs with Carpentries memberships within the US National Aeronautics and Space Administration (NASA) shared a bit about how they currently engage with The Carpentries. The purpose of the session was to explore opportunities to support the activities of these programs through formation of a Carpentries subcommunity. A Carpentries subcommunity is defined as “a subset of our global community that can be local, regional, domain-specific, or a group of community members sharing a common language or interests.” Anyone interested in developing an engaged network of Instructors was invited to attend the session, resulting in 56 community members representing multiple US government agencies, state governments, universities, and non-profits.\nThe session began with three short presentations by representatives from each of the three NASA programs, which are summarised and with the presentation slides below." + "text": "Welcome to Openscapes’ sixth newsletter! If you’re interested in seeing these infrequent updates in your inbox, please sign up here (linked from our get involved page).\n\nHello! As we continue into 2023, we at Openscapes continue to come back to the core of what we do: we engage, empower, and amplify. Whether it is with tech like Quarto and JupyterHubs or communities like R-Ladies, Ladies of Landsat, Black in Marine Science, and NASA Earthdata, it’s about welcoming folks to better ways of working and open science.\nIn 2023, we’re committed to being braver in connecting the impact of our work to the environment and the climate movement; to culture and mindset change for individuals, for teams, and for institutions; and as always, to kinder science.\nIn the last year, what emerged was a clear sense of movement building towards better science for future us. The Openscapes community grew as Champions and Mentors prioritized time for learning, sharing, teaching with each other, and also advocated for themselves and their colleagues to have time to do so.\n\nNASA Openscapes Mentors continued co-creating and reusing teaching resources to support colleagues and researchers using NASA Earthdata to migrate workflows to the Cloud. Mentors also taught workshops, gave talks, participated and created in public forums, and built software and conceptual infrastructure to support users and practice open science, and are also investing their knowledge and lessons back into the Earthdata Cloud Cookbook. Co-lead Erin Robinson led a publication now under review about The Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices (preprint).\nNOAA Fisheries Mentors supported their colleagues through six Champions Cohorts. Read about the experiences and impacts of Fall 2022 Openscapes training nationwide, with additional posts from NOAA Fisheries Alaska, and Southwest, Summer Southeast, and Winter Alaska Fisheries Science Centers. Additional resources include the NMFS Openscapes site and NMFS Open Science Resource Book.\nCalifornia Water Boards / CalEPA Mentors forked the Champions program and co-led the first Cohort for the California Water Boards (blog post) and fully documented it in a Quarto book, Openscapes at the Water Boards.\n240 Champions participated in Openscapes this year; their work and energy has been awesome! It’s so wonderful to see teams of Champions come back to guest-teach their peers and share their ongoing journeys toward more open, kinder science. See their stories above with NASA, NOAA Fisheries, and CalEPA.\nIleana Fenwick and Stefanie Butland joined the Openscapes team (tweet)! They both do incredibly valuable work and we are so grateful to work together.\nWe hosted 3 Community Calls: A Qualitative Data Analysis Chat with Dr. Beth Duckles; Hello Quarto! A Quarto Chat with NASA Openscapes, co-hosted with R-Ladies Santa Barbara; Reimagining open science as part of the climate movement, a chat with Dr. Monica Granados (summary posts of Community Calls).\nJulie gave a co-keynote at rstudio::conf(2022) with Mine Cetinkaya-Rundel, titled Hello Quarto: share, collaborate, teach, reimagine. This was the official launch of Quarto (blog post) and it was such an honor to share about the Openscapes community on this big stage!\nOne of the things we hear often from researchers is that they feel like they can’t take vacation - too much rests solely on their shoulders, solely on their laptops. In the shared-joy and sustainability-through-open-science departments, Julie wrote about how our open science process made it possible for her to unplug for a 2-week vacation (blog post).\nShoutout to all the Champions and Mentors and community who have shared their successes - big and small - with us. You keep us energized!\n\nThis year, we’re continuing our work with NASA, NOAA, and the California Water Boards and have started new relationships and programs. We’re excited to continue to grow the Open Science movement as part of the Year of Open Science (Biden Harris administration announcement).\n\nAlready we’ve launched Pathways to Open Science for Black environmental & marine researchers, led by Ileana Fenwick in partnership with Black in Marine Science (BIMS) and Black Women in Ecology, Evolution, and Marine Science (BWEEMS). 80 people attended the first session(!) and we are committing to offer this annually.\nAt the ESIP Winter meeting in January we coordinated a panel discussion. Mentors from NASA, NOAA Fisheries, CalEPA, and Pathways to Open Science programs shared their stories of open science movement building through Openscapes. Look for a summary blog post in March!\nFebruary through May, five research teams from the U.S Environmental Protection Agency (EPA) Center for Environmental Measurement and Modeling (CEMM) are participating in an Openscapes Champions Cohort with help from new Mentors Gayle Hagler and Jeff Hollister.\nThirty Openscapes Mentors across all of our programs and the Openscapes core team are coming together in their own six-session Cohort to practice Mentoring with a Coach Approach, led by Tara Robertson, professional coach and Openscapes advisor and collaborator.\n\nComing up\n\nNominations open for our 2023 NASA Champions Cohort that will run April - June. Please spread the word for teams using NASA Earthdata and interested in migrating workflows to the Cloud.\nCommunity Calls with Ileana Fenwick, Aneese Williams and Alex Davis about their experiences leading the Pathways to Open Science program, and with Sean Kross describing the workflow creating kyber.\nIn June we’ll launch a brand new program, Openscapes Reflections! This will be a 3-week program, modeled after leadership coaching in a mostly self-paced format. It will offer structure and accountability for participants to reflect and plan on analytical and reporting workflows to improve daily habits and fuel institutional culture change.\n\nThanks for reading, and here’s to kinder science and the Year of Open Science 2023!" }, { - "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-openscapes-presented-by-chris-battisto", - "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-openscapes-presented-by-chris-battisto", - "title": "Engaging with a Cross-NASA Subcommunity", - "section": "NASA Openscapes presented by Chris Battisto", - "text": "NASA Openscapes presented by Chris Battisto\nPresentation slides\nChris Battisto, a scientist at Goddard Earth Sciences Data and Information Services Center (GES DISC) Distributed Active Archive Center, introduced the NASA Openscapes project and the approach that the community uses to collaborate together to support researchers using NASA Earthdata to migrate their analytical workflows to the cloud. Openscapes is, generally, an approach and a movement that helps researchers and those supporting research find each other and feel empowered to conduct data-intensive science. Through a Carpentries membership, all mentors in the NASA Openscapes community participate in Instructor Training. In addition, NASA Openscapes uses the Carpentries modular style teaching approach and many of the pedagogical tools like live coding to teach learners using NASA Earthdata to access and analyze data in the AWS Cloud." + "objectID": "news/2024-08-30-esip-summer-2024/index.html", + "href": "news/2024-08-30-esip-summer-2024/index.html", + "title": "Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud", + "section": "", + "text": "This is a brief summary of the session we led at the 2024 ESIP summer conference, focused primarily on the breakout group feedback from the session! We define Onboarding as a friendly first experience in the Cloud, framed via technical infrastructure, lessons on open science and cloud concepts, and social support. We define Fledging as a friendly set up for Cloud that works for me, including a plan, how to do it, how to pay for it. It means leaving the nest, soaring high and perhaps building your own nest.\nQuicklinks:\nThe theme of the 2024 ESIP Summer meeting was “grounded in trust”, with a focus on ethics and establishing relationships. This theme rooted us: we’ve spent the last 3 years introducing people to the cloud for scientific computing, motivated by the fact that NASA is moving Earthdata to the cloud. We focused on helping scientists using NASA Earthdata and what this migration means for them. But only in the past year have we focused on “offboarding”, to complement our onboarding process (focused on where they go after they leave our JupyterHub) – but that term felt harsh, like walking the plank. We wanted a friendlier way to talk about this, so we call it “fledging” since people are spreading their wings after being in the “nest” with their nestmates, learning together in the JupyterHub we provide for workshop participants, in collaboration with our partners at 2i2c.\nFirst, Alexis Hunzinger (GES DISC) shared Aronne Merrelli’s story (show-not-tell). Aronne was a participant in the 2023 NASA Openscapes Champions group, and found the Cloud to be a “superpower” - see this blog post summary and video of Aronne sharing with the 2024 Champions science teams.\nThen, Aaron Friesz (LP DAAC) and Danny Kaufman (ASDC) broke down all the components that helped build that nest. This includes a central focus on researcher/user needs and iterating through teaching; How we work – openly, with synchronous and asynchronous space and place; and all the onboarding support for how they learn and work.\nAnd then Julie Lowndes (Openscapes) and Eli Holmes (NOAA Fisheries) shared about fledging experiences so far - what we do and think about. This focused on where people fledge to and cost. Eli Holmes shared how she fledged in a different way, not only as a researcher but also as a facilitator who sets up infrastructure for others within her government agency. She shared how not all the participants leaving the nest are birds. Some are zebras and others are fish. Their needs when fledging are fundamentally different from those of the birds. And even among the birds, there is variety." }, { - "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-develop-presented-by-sean-mccartney", - "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-develop-presented-by-sean-mccartney", - "title": "Engaging with a Cross-NASA Subcommunity", - "section": "NASA DEVELOP presented by Sean McCartney", - "text": "NASA DEVELOP presented by Sean McCartney\nPresentation slides\nSean McCartney, Senior Scientific Analyst at NASA Goddard Space Flight Center, presented on NASA DEVELOP. NASA DEVELOP is a workforce training program that places staff in teams of four to five individuals to work on projects lasting ten weeks. Through this program, participants showed strong interest in gaining more technical training in coding and image processing skills. This resulted in a partnership with The Carpentries in 2018 to host Software Carpentry workshops at NASA centers across the United States. Since that partnership began, the program has trained 30 Instructors and hosts 3 workshops a year." + "objectID": "news/2024-08-30-esip-summer-2024/index.html#breakout-groups---participant-feedback", + "href": "news/2024-08-30-esip-summer-2024/index.html#breakout-groups---participant-feedback", + "title": "Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud", + "section": "Breakout groups - participant feedback", + "text": "Breakout groups - participant feedback\nParticipants in the room self-identified as Cloud enablers/facilitators (60%), as well as Cloud users (35%) and neither (27%).\n\nWe asked participants to share their experiences in breakout groups. We wanted to know from our audience of cloud facilitators/enablers and cloud users, what solutions and challenges they have found when it comes to onboarding to and fledging from the Cloud. Between the feedback received during this breakout session and responses from a survey sent to past program participants about their current cloud usage and challenges, here are some common challenges and new points we haven’t heard before.\nStand out:\n\nCreate easy wins early on to make onboarding more encouraging!\nInterest in learning how to set up environments via tutorials.\nHow does one find or qualify for these “onboarding” opportunities? It seems like there is a privilege based on who you know.\n\nCommon ones:\n\nFor onboarding, keep tutorials simple, but relevant to the discipline.\nPeople feel successful and supported through many, open channels of connection (e.g. Slack, hack/coworking times, anonymous questions, etc.).\nSome feedback from users: when I go to nasa.gov, I can’t find any cross-DAAC stuff, or earthaccess.\nNot all data is in the cloud, we are still operating in hybrid mode.\nIt’s a challenge to spend time and energy optimizing legacy code and data formats for the cloud - it’s tempting to just “lift and shift”.\nOrganizational silos and management priorities are a barrier to experimenting with cloud capabilities.\n\nThe following screenshots illustrate participants responses to several questions. We include them here for readers to consider where their own communities land.\n\n\n\n\nOne thing we noted was that more people had thoughts about onboarding rather than fledging. And that’s ok! Fledging is very new to us as an idea, having really started talking about it last summer at ESIP and more readily (and calling it fledging) at AGU and this spring, in conversations with Yuvi Panda, Carl Boettiger, and Eli Holmes." }, { - "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-tops-presented-by-katherine-blanchette", - "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#nasa-tops-presented-by-katherine-blanchette", - "title": "Engaging with a Cross-NASA Subcommunity", - "section": "NASA TOPS presented by Katherine Blanchette", - "text": "NASA TOPS presented by Katherine Blanchette\nPresentation slides\nKatherine Blanchette, STEM Engagement Specialist at NASA’s Ames Research Center & Armstrong Flight Research Center, presented on NASA TOPS. This program began in response to the White House’s Transform to Open Science Initiative and the identification of 2023 as the Year of Open Science. As part of this program, a curriculum has been developed that includes five modules on a range of open science topics where learners get badges for each module completed. Instructors are needed to teach these modules, and this has been facilitated through participation in Instructor Training. A modified version of Instructor Training was piloted on 27 October to support these Instructors teaching the curricula." + "objectID": "news/2024-08-30-esip-summer-2024/index.html#closing-thoughts", + "href": "news/2024-08-30-esip-summer-2024/index.html#closing-thoughts", + "title": "Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud", + "section": "Closing thoughts", + "text": "Closing thoughts\nJulie Lowndes - ESIP is a great conference - for me it feels like RStudio and rOpenSci conferences, which means it is welcoming and highly productive and filled with friends everywhere - even when you don’t know them yet. This is my 4th year of ESIP confs (starting in 2020 when Erin Robinson invited me to keynote and this kicked off our NASA Openscapes collaboration!), and my second in person. Last year, I took away how Aaron Friesz remarked that “I’ve been to many ESIP conferences representing my data center (LP DAAC), but this year I felt like people saw me as someone to collaborate with as an expert on supporting users in the cloud”. This year, I’m taking away how embraced and loved “earthaccess” is. “Earthaccess” is a python library that has vastly improved everyone’s experience accessing NASA Earthdata programmatically (both locally and in the cloud). It was first developed by Luis López through working closely with Champions science teams and is now awesomely co-developed by a NASA open source community with contributors extending across DAACs, other parts of NASA, and beyond. I heard “earthaccess” everywhere, in talks, in hallways. People used “earthaccess” used like “Zoom” or “ggplot” - it’s a tool you use, no need to discuss further, we all know it as a vital part of the picture. I also really felt how the word “Openscapes” was used by many as an “us” or “we”; “Openscapes does this” means a community with many many people involved – and people see and feel that. This was always the vision that Erin Robinson and I have had, and I really felt it here. It was amazing.\nCarl Boettiger, during a coworking debrief: Onboarding is a very visible thing, we can ensure there’s no sharp edges in the nest. But when you leave there are more edges - we can think of how to soften, where it works well, where there is a need. We can learn where there are training places and where it’s technical, what to develop to put in place." }, { - "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#opportunities-for-a-nasa-subcommunity", - "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#opportunities-for-a-nasa-subcommunity", - "title": "Engaging with a Cross-NASA Subcommunity", - "section": "Opportunities for a NASA Subcommunity", - "text": "Opportunities for a NASA Subcommunity\nFrom the three presentations it was clear that across NASA, these programs find real benefits leveraging The Carpentries to extend data science skills within NASA’s internal and external communities of practice. As new Instructors complete training in support of these programs, there exist opportunities to build a subcommunity through programming and resources available through The Carpentries Community Development Program.\nAttendees discussed this general interest in forming a cross-NASA Carpentries subcommunity. To kick-off the discussion, Elizabeth Joyner led attendees in two rounds of 3-2-1 silent reflection where she asked participants to list three data science and coding skills that researchers and practical data users need at NASA, two questions about Carpentries subcommunities, and one metaphor or simile about what you envision for a thriving subcommunity of Carpentries Instructors. As we closed out of this discussion, clear themes emerged; attendees are interested in increasing efficiency with data, working more openly and collaboratively with data, building and maintaining reproducible workflows and increasing data fluency and dexterity with NASA data (Figure 1).\n\n\n\n\nFig. 1 - Word cloud of 50 most common words across both 3-2-1 exercises.\n\n\n\nFrom the second part of the reflection, the questions generated by the group acted as a starting point for a lively discussion, which will hopefully continue to be good fodder for the subcommunity to develop its initial charge. There were questions about how to find additional Instructors across NASA and who might be missing from this discussion. There were also questions about how to engage NASA grantees and other stakeholders who use NASA data, as well as about how to extend the curriculum being taught and explicit pointers to Library Carpentries.\nThe third prompt was for a metaphor or simile of a thriving community. Some of our favourite imagery was that a thriving community is like a networked dream catcher, a bee hive, or three goats on each other’s shoulders in a trenchcoat trying to sneak in.\nFollowing the teaching model advocated by The Carpentries, the three NASA programs have all intentionally cultivated communities that support learners and support ongoing learning. Considering this, there is general excitement about the possibility of a NASA subcommunity with 20 attendees indicating interest in joining a follow-up conversation." + "objectID": "news/2024-04-04-nasa-earthdata-aaron-friesz/index.html", + "href": "news/2024-04-04-nasa-earthdata-aaron-friesz/index.html", + "title": "NASA Earthdata Data Chat with Aaron Friesz", + "section": "", + "text": "Aaron Friesz, science coordination lead at NASA’s Land Processes Distributed Active Archive Center (LP DAAC) and NASA Openscapes Mentor, helps promote open science principles to empower more diverse, inclusive, and effective data science communities.\nRead the NASA Earthdata Data Chat interview with Aaron where he discusses what being a NASA Openscapes Mentor entails, how he and his fellow mentors promote open science, and the resources available to help users develop their cloud computing skills.\n\n\n\n\nCitationBibTeX citation:@online{friesz2024,\n author = {Friesz, Aaron and M. Smith, Joseph},\n title = {NASA {Earthdata} {Data} {Chat} with {Aaron} {Friesz}},\n date = {2024-04-04},\n url = {https://nasa-openscapes.github.io/news/2024-04-04-nasa-earthdata-aaron-friesz/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nFriesz, Aaron, and Joseph M. Smith. 2024. “NASA Earthdata Data\nChat with Aaron Friesz.” April 4, 2024. https://nasa-openscapes.github.io/news/2024-04-04-nasa-earthdata-aaron-friesz/." }, { - "objectID": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#how-to-get-involved", - "href": "news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html#how-to-get-involved", - "title": "Engaging with a Cross-NASA Subcommunity", - "section": "How to Get Involved", - "text": "How to Get Involved\nIf you are a member of the Carpentries community, work at NASA, and would be interested in being involved in this effort, please email community@carpentries.org. We will reach out shortly to schedule a follow-up call to this discussion. If you have interest in forming a subcommunity or have general interest in the Community Development Program, please email community@carpentries.org. You can also find information about upcoming meetings on the Etherpad." + "objectID": "news/2024-07-18-openscapes-update/index.html", + "href": "news/2024-07-18-openscapes-update/index.html", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "", + "text": "Hi friends, this is a status update about Openscapes — all good things as we’ve evolved structurally this year while concurrently supporting open science via leading cohorts with partners, sharing via talks & writing, and maintaining stability for mentor learning communities. It has also been a lot. Like everyone, I have been consumed with the weight of everything going on in the world, local and global, including wildfires growing nearby my house right now. My theme this year is “default to open” as I grow as a leader in the same way I do as a scientist. This post feels like a long time in the making in that lens. But it has been great to share about different pieces of this with some of you, and it feels really good to document it all more here. I hope you’re all doing ok, and please get in touch - my best email is julia at openscapes.org. Cheers, Julie Lowndes." }, { - "objectID": "news/2023-05-17-mentor-coach/index.html", - "href": "news/2023-05-17-mentor-coach/index.html", - "title": "How coaching skills have made us better open data science mentors", + "objectID": "news/2024-07-18-openscapes-update/index.html#openscapes-ethos", + "href": "news/2024-07-18-openscapes-update/index.html#openscapes-ethos", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "OPENSCAPES ETHOS", + "text": "OPENSCAPES ETHOS\nOpenscapes is an approach and community that helps researchers and those supporting research find each other and feel empowered to conduct data-intensive science. We support open science as “kinder science for future us”: the vision is a scientific culture that is more efficient, more kind, and more collaborative, and that can uncover solutions faster together to the most pressing climate and social challenges. Our main activity is mentorship to build open source technical and collaborative leadership skills within and across teams and organizations, connecting groups and role-modeling open practices that are critical elements to helping shift towards open science. All our lessons, curriculum, writing (blog posts, peer reviewed publications, slides, etc) are open source and shared publicly online – using the same tools we teach for data analysis and reproducible reports (GitHub, Quarto/RMarkdown, R, Python, Jupyter, Google Drive). We believe role-modeling open practices is critical to helping teams shift towards open science.\nOpenscapes is motivated by a question: What if we connected our skills & values in our daily work, for solutions to our most pressing climate and justice challenges? We work with actionable science teams at agencies like NASA Earth Science, NOAA Fisheries, EPA, California Water Boards, academic and non-profit groups like the Fred Hutch Cancer Center, Black Women in Ecology, Evolution, and Marine Science and Black in Marine Science. In our work we think that combining data science with open science with teamwork & community, is a way for us all to help address our climate emergency. As Ayana Elizabeth Johnson and Katharine Wilkinson say in the book All We Can Save: “To address our climate emergency, we must rapidly, radically reshape society. We need every solution and every solver”." + }, + { + "objectID": "news/2024-07-18-openscapes-update/index.html#igniting-real-culture-change-across-science", + "href": "news/2024-07-18-openscapes-update/index.html#igniting-real-culture-change-across-science", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "IGNITING REAL CULTURE CHANGE ACROSS SCIENCE", + "text": "IGNITING REAL CULTURE CHANGE ACROSS SCIENCE\nWe are seeing real culture change across science through the Openscapes approach. This is a big deal and something I am really proud of. Change shows up as real improvements in how individuals, teams, and organizations operate. We see researchers’ daily efficiency and wellbeing benefit whole organizations since there is less time wasted, errors are identified and fixed earlier, and staff have less burnout and turnover. Through the Champions Program, we’ve seen a senior administrator who had participated for weeks on mute suddenly unmute, lean forward, and say “I need that, can you teach me?” when a colleague was screensharing their workflow for automating data-intensive reports. Through NASA Openscapes co-led with Erin Robinson, we have changed the way NASA teaches how to access Earthdata in the cloud. With NASA, NOAA, and the California Water Boards, we are supporting within-government open source community development that flourishes across historical institutional silos: examples include the earthaccess python library, Dr. Eli Holmes’s new 3-year position as NOAA Fisheries Open Science Lead, and the California Environmental Protection Agency’s (CalEPA) open data strategy (see the upcoming July Executive Director Report: https://www.waterboards.ca.gov/board_info/exec_dir_rpts).\n2023 marked 5 years of Openscapes! We have done and learned a lot – look out for an upcoming blog post with more details. But to share some – in early 2024, Openscapes was mentioned in the White House Fact Sheet as the Biden-⁠Harris Administration Marks the Anniversary of OSTP’s Year of Open Science! We’ve led 155 science teams through our flagship Champions program, upskilled 90 Mentors across several government organizations, and welcomed 120 Black marine and environmental scientists to Open Science through the Pathways Program. We’ve also led two years of the Reflections program, a lower-commitment way for people to participate in Openscapes and build open science skills. But real culture change is less about us leading events and more about the Openscapes approach and Flywheel spinning around the world as people practice, reuse, and teach it themselves. Openscapes has been successful because we are small, independent, and outside the organizations we work with, and teaching approaches that can be incorporated within organizations (for example with the CalEPA). We are keeping that going." + }, + { + "objectID": "news/2024-07-18-openscapes-update/index.html#an-open-source-community", + "href": "news/2024-07-18-openscapes-update/index.html#an-open-source-community", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "AN OPEN SOURCE COMMUNITY", + "text": "AN OPEN SOURCE COMMUNITY\nI’ve come to think of Openscapes itself as an open source community, which yes, might be obvious, and was the goal all along. But I realize it actually is. We as a community — and linked to many other communities all along the open spectrum — are all role modeling open, living open science as a process and daily activity (not only a product at the end), and bringing reuse and extension as a value of open. It’s happening!\nPart of the community being open source is that all our resources are open source; you’re welcome to them. We think of the Flywheel as an open source tool — I reach for the Flywheel when we are planning, designing programs, communicating impact, just as I reach for R and Quarto and JupyterHubs when I am doing data analysis. We also invest heavily in open documentation: through the Champions Lesson Series resources and the Approach Guide that document how we work and facilitate – these are other open source resources to reuse and extend, the way you would an R or Python package. It takes real work and time to make things open – that means posting on YouTube and formatting for GitHub rather than a PDF sitting in a corner of our laptops. Funding supports our time working with partners, and also invests in this work to keep the Flywheel going.\n“Forking” is a concept from GitHub and software programming where you can copy someone’s work into your own space to reuse/remix/extend it. It is still attached to the original source so that you can be connected, give credit, and also contribute back, if your changes might be useful to the original project. We are thrilled to see people “forking Openscapes” like teaching from each other’s slide decks, copying live notes and agenda structure, and reusing Champions cohorts and event structure to better suit audiences, like the CalEPA has done." + }, + { + "objectID": "news/2024-07-18-openscapes-update/index.html#our-core-team", + "href": "news/2024-07-18-openscapes-update/index.html#our-core-team", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "OUR CORE TEAM", + "text": "OUR CORE TEAM\nOpenscapes has an intentionally small core team. As we have grown, we have tried to keep a deliberately flattened organizational structure that works effectively and has the impact of a much bigger team. We define the core team right now as people who are paid directly from Openscapes funds (grants & contracts). Sustainability of people’s workload and financing is front of mind. Outside of me (aiming for 90% time), team members work up to 50% time, with everyone working as much as they want to. Our core team has shifted this year, and you’ll see these changes reflected in our website too.\nFirst, a huge thank you to Erin Robinson, who was instrumental in growing Openscapes into a sustainable initiative via her expertise in strategic sustainability planning and her leadership with the NASA Earthdata community. Erin Robinson has shifted off the core team: she is currently finishing her PhD in Information Science focused on knowledge infrastructures for Earth and environmental science applications and consulting with her company Metadata Game Changers. I have learned so much working together with Erin, it could be a whole book in itself. I’m so proud of the Openscapes Flywheel we developed together and that Jim Collins responded to us saying he was excited about our work when we shared our 2023 Earth Science Data Systems Working Group (ESDSWG) slides! Erin, I can’t wait to see what you do and where you take this all next, and continue to stay connected with us all.\nGrowing our team, we’ve welcomed two new team members: Liz Neeley and Andy Teucher! Both Liz and Andy have backgrounds as environmental scientists, so they are closely connected with researchers and understand deeply the challenges and opportunities as we work with teams, and are huge wonderful additions to the Openscapes Community.\nLiz Neeley brings a deep background of science communication and sense making, and is supporting me as well as NASA Mentors. The first thing we did together is Liz helped design a hiring rubric and interview conversation guides for our cloud position with 26 applicants earlier this year — this is something I had never done before and I learned a lot (blog post upcoming!) Liz is also a founding partner of the new initiative Liminal, which is a science communication collective. I am proud to say that I am part of the collective, alongside some amazing leaders. Liz and I have already co-chaired a workshop with the NIH National Libraries of Medicine, and I shared some of Openscapes’ work in environmental and Earth science communities. I am excited to contribute, learn, connect, and bring back what I learn to the Openscapes community.\nAndy Teucher is a data scientist and open source developer and teacher, and has been focused on cloud infrastructure with NASA Openscapes. In just a few short months already he has identified ways to lower costs for cloud computing and storage. And, making this immediately actionable, he has taught tutorials on technical and policy approaches to reduce costs for scientists and JupyterHub managers, which is so awesome. Andy is continuing to document this and identify other ways to contribute to reduce friction for users learning to access and use NASA Earthdata in the cloud. A current focus is on “fledging” — where do researchers go to do their real science once they have tested whether the Cloud is right for them through our 2i2c JupyterHub? (Look out for a blog post following our July ESIP session!)\nStefanie Butland and Ileana Fenwick and I continue to work closely together, across Openscapes activities. Ileana led the second annual Pathways to Open Science program with co-leads Aneese Williams and Alex Davis earlier this year, reusing what worked and extending the program activities. Ileana, Stef and I led the second year of the Reflections Program as well, and are excited to continue to have new channels and sponsorship so people have friendly entryways to engage with open science. Stefanie has led more and more core activities, doing all setup for Champions Cohorts, teaching lessons, supporting NASA mentors and coworking, and designing and leading the new Quarto + GitHub Contributing Clinic. Look out for Stef’s talk at posit::conf next month about how we use Sean Kross’s Kyber R package to save time and reduce manual errors in Champions Cohorts setup!\nAll of us work closely with Mentors and Champions and others in the greater Openscapes and open science community, and we appreciate you!" + }, + { + "objectID": "news/2024-07-18-openscapes-update/index.html#structure", + "href": "news/2024-07-18-openscapes-update/index.html#structure", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "STRUCTURE", + "text": "STRUCTURE\nIn 2022 I started Openscapes LLC as a mechanism to administer funds to support the Openscapes open source community. In my mind, the LLC is not synonymous with all the Openscapes community work described above, it is one piece supporting the community. Openscapes LLC is a value-driven vehicle to try to support open science as a career – a sustainable and lasting career — for myself and for others. An LLC was a mechanism that was possible for me. I do sometimes feel like I have to justify this choice, and I push back on the idea that companies are inherently bad or that non-profits uniquely embody the values of open science (see Chris Hartgerink’s eloquent post about this (Not-)for-profit in research). I see many people wondering how to make open science a sustainable job and we need more pathways – it’s important to be able to explore and discuss mechanisms together as an open community. So how is Openscapes LLC value-driven? We are not motivated by profit. We pay people for their time, we pay quickly, and aim to pay them well. We can work pro-bono at times to collaborate with partners, as we do with the Pathways for Open Science Program and the Tribal Exchange Network Group. We can also donate to causes aligned with our values. Since we believe that open science plays a critical role in climate solutions and justice, we joined 1% for the Planet and starting later in 2024 will donate at least 1% of revenue each year to environmental non-profits. This will be small, but small numbers matter, as does visibly connecting our values with how we work.\nAnd, I am now full time at Openscapes LLC! In May 2024 I shifted to an affiliate position at NCEAS/UC Santa Barbara, after working as a Project Scientist there for 11 years (2013-2024). I love the community and teams at NCEAS - the Ocean Health Index in particular as my open science origins (see 2021 SORTEE slides) along with the admin staff. From undergrad to PhD to NCEAS, I have been at universities since 1999, and this is a big shift for me. And I also feel prepared as I continue developing as a scientist, open science champion, feminist, anti-racist, and human, throughout all these years with all the people I have learned from and worked with along the way. So some underlying structure of my situation has changed, but Openscapes’ momentum is unchanged. \nBeing a small women-owned business owner and designing Openscapes values into the business structure is something I am really proud of. It feels different in some ways compared to being a scientist, but in fact I am solidly both. It has been a lot of work to build and manage a company and I continue to learn really important skills to support the work — and I have not done it alone! I so greatly value my accounting & contracts team, as well as my leadership coach and advisors. And so many practical conversations from people I admire in this community. And, I think that Openscapes LLC is a step. I would like the mechanism to administer funds on the back end to match the community approach on the front end. I am eyeing a collaborative structure in a not-too-distant future, and have talked with some of you about this already (and I am learning from Liminal this way as well). However, we’ll take it one step at a time. We are dedicated and in this for the long-haul: Openscapes LLC is a “keepgoing”, not a startup, to borrow language from open source community lead Greg Wilson." + }, + { + "objectID": "news/2024-07-18-openscapes-update/index.html#questions-were-pondering", + "href": "news/2024-07-18-openscapes-update/index.html#questions-were-pondering", + "title": "Openscapes update from Julie Lowndes, summer 2024", + "section": "QUESTIONS WE’RE PONDERING", + "text": "QUESTIONS WE’RE PONDERING\nWe are deeply interested in the “so what” of open science. So teams are more efficient and morale is higher, science is more reproducible, data are more FAIR. So what – is response to wildfires faster, with partners and residents better informed due to open data and sharing? Are communities developing equitable solutions to water management also working on the other side of the world due to trust built and amplified? In my own neighborhood, I see wildfire communications vastly improved because of open data, and groups sharing information and visualizations openly. Fewer neighbors message to ask “where/how big”? And the conversations shift to what to do and how to help each other. This is because they can see the data easily themselves and are informed. I am ready for Openscapes to contribute to stories like these, for the Flywheel to spin for climate and social justice solutions. We’re in a moment where open science is still “new”, shifting from its early adopter moment to the early majority, so it feels early and energizing and new. And, at the same time, people have been working on this for decades, and there is an impatience for us to really gain traction and identify and tell these stories to connect us and unite us in hope and action due to all that we’ve done with open science. It’s about people, and we’re ready.\nI’ll end here for now, thank you for reading. There is so much more learned and on my mind and plate and I look forward to continue collaborating and making a difference with you all. I’m nothing but excited for going forward together.\n\n\n\nLlanwrst, Wales, photo by Julie Lowndes" + }, + { + "objectID": "news/2024-07-09-2i2c-shared-password/index.html", + "href": "news/2024-07-09-2i2c-shared-password/index.html", + "title": "2i2c develops shared password access with LP DAAC for NASA Surface Biology and Geology Workshop", "section": "", - "text": "February through May 2023, Openscapes Mentors from across governments and academia came together for some hands-on learning and practice that had a profound effect on the way we will teach and lead going forward. We learned coaching skills that can help us as professionals – skills like listening rather than solutioneering, asking open-ended questions that empower people to find their own agency and meet their needs. This is a program designed and facilitated by Tara Robertson, a Certified Professional Co-Active and International Coaching Federation Associate Certified Coach. Openscapes has been developing a professional collaborative relationship with Tara since 2021. It was also impactful because it brought together Openscapes Mentors from across government groups (NASA Earthdata, NOAA Fisheries, EPA, California Waterboard) so they can learn together and support each other in the 2023 Year of Open Science.\nThis program had a profound impact on the three of us too, as participants as well as program designers and facilitators. We are still trying to define what it was about the program, the process, and everyone involved that led to such a profound sense of trust among us so that we were able to be vulnerable and do courageous things. While these Openscapes Mentors have been collaborating as colleagues together within their organizations (e.g. as NASA Earthdata Mentors or Pathways to Open Science Mentors), this was the first time most of these folks met as a cross-Openscapes mentor community (besides brief encounters at virtual ESIP conference sessions in 2023 and 2022).\nThis truly was a cohort of early adopter “bright spots” - folks who wanted to be better mentors and grow as leaders, even if we didn’t know what that meant yet. Not only were folks working across organizations with other mentors they didn’t know, they were expert scientists being asked to step way outside their comfort zone and be novices. In this setting, they were enthusiastic and fearless learners. There was a really high rate of participation and very few people dropped off over the six sessions. We saw individual growth and impacts feeding back and forth: something introduced gently here that we can practice together makes us comfortable, and now we can take this to other spaces and introduce it gently to others too." + "text": "Read the blog post Openscapes Host a Surface Biology and Geology Workshop with Shared Password Feature by 2i2c Team members Yuvi Panda and Jenny Wong!\nBackground from Julie Lowndes: Recently Yuvi Panda and colleagues at 2i2c collaborated with NASA Openscapes Mentors Bri Lind and Erik Bolch and colleagues at the NASA Land Processes Distributed Activate Archive Center (LP DAAC) to setup a frictionless shared password access to the Openscapes JupyterHub for the Surface Biology and Geology: VITALS Workshop. This workshop had 250 participants, and this frictionless approach involved sharing a link for access (like you would with Zoom/Teams) rather than requiring participants to create and share GitHub usernames in advance (and workshop hosts to manage and add them to the Hub).\nWe will be continuing to use this approach for large workshops going forward, and have added instructions for workshop leads to the NASA Earthdata Cloud Cookbook - Policies & Admin section.\n \n\nOur partners 2i2c host our NASA Openscapes JupyterHub as part of their mission to support open science and building communities in the cloud using interactive computing. Learn more about their approach and other community impact stories!" }, { - "objectID": "news/2023-05-17-mentor-coach/index.html#designing-a-courageous-space", - "href": "news/2023-05-17-mentor-coach/index.html#designing-a-courageous-space", - "title": "How coaching skills have made us better open data science mentors", - "section": "Designing a courageous space", - "text": "Designing a courageous space\nWe connected these bright spots by creating space and place. We met every 2 weeks for 6 remote sessions for a total of 12 hours. Twenty-eight people participated as part of their paid jobs, supported by their organizations rather than doing it “off the side of their desk”. We used a practice already familiar to all Openscapes Mentors: collaborative note-taking Agendas all in one Google doc where we had a shared responsibility to take notes, clarify explanations, add links to resources, and add shared joy and encouragement via emojis, +1’s and comments. We co-designed and helped each other when facilitating, which was instrumental when Tara got sick and lost her voice and Julie stepped in to facilitate the session based on Tara’s prep ahead of time.\nThe 6 sessions focused on specific topics: powerful questions, 3 levels of listening, identifying values, leader within, saboteurs and then taking these coaching skills into mentoring, supervising and sponsoring. For each of the topics, Tara briefly described the topic or skill, did a live demo with one of the participants, and the group described what they observed. Then, Tara gave us a topic to coach on, or some guardrails, and participants went into breakout rooms in pairs to practice coaching and being coached.\nThere was a lot of hands-on doing. Most of the participants said this was the best part of the course and also the most uncomfortable bit. In these pairs, the coaches were learning how to ask questions that help people open up…and this also challenged the coachees, who really dived into their needs and blockers for how to better support open science. It was also a testament to Tara’s own willingness to be vulnerable, demonstrating as a coachee and giving us her own real-life examples.\nThoughts from Tara: Something really special happened with this cohort. There were three main ingredients to this magic:\n\nThe participants were enthusiastic and fearless learners who were willing to step outside their comfort zones and learn new things together. This group of expert scientists from different organizations were willing to be beginner learners with each other. This group embodied courage.\nWe were intentional in the design to maximize psychological safety. At the start of Week 1 we designed an alliance together on how we wanted to be and learn together. I ordered the topics to start with the lower stakes topics and we were intentional about mixing people up across organizations. In the week 5 coaching demo one of the coaching demos the coachee chose to be quite vulnerable and bring a real challenge. This was a turning point where we saw that we can use these skills to surface challenging topics and have honest conversations about barriers in science.\nOpenscapes investment in coaching skills was a unique way to collectively learn some new skills AND build connections between open science leaders across different organizations and Openscapes initiatives: Mentors at NOAA Fisheries, NASA and from the growing Mentor community from CalEPA and Pathways to Open Science." + "objectID": "news/2024-02-15-nasa-openscapes-talking-points/index.html", + "href": "news/2024-02-15-nasa-openscapes-talking-points/index.html", + "title": "NASA Openscapes: Talking points for 3-year recap & vision for next two years", + "section": "", + "text": "This week we joined a standing meeting with NASA DAAC and ESDIS managers (DMC-ESDIS Telecon). We had 30 minutes to present the goals for the upcoming year, and describe why the increase in roles and responsibilities for the NASA Openscapes Mentors. We were introduced by Justin Rice ESDIS Deputy Project Manager, and were thrilled to have the opportunity to reconnect with this group and share the joy of what the Mentors have done and continue to do together. This blog post outlines our talking points that we covered in the meeting. There was a lot of support for the NASA Openscapes Mentors overall, and for the earthaccess python library. Someone even showed the contributors list, highlighting that contributors came from across DAACs and the broader open science community.\nThis post is addressed to the audience of NASA DAAC and ESDIS managers.\n\n\nSupporting users transitioning to the Cloud across different timelines\nOver the last several years, NASA has been making a transition from on-prem hosted data at each of the DAACs to migrating that data to the cloud. Each of the DAACs has been on its own transition path, with some DAACs nearing (or completely) migrating like PO.DAAC, and others just starting to explore, like the CDDIS DAAC. This shift has had ripple effects on how each of the DAACs supports their users accessing NASA Earthdata in the cloud.\nFortunately, the different timelines of each DAAC mean that we can learn from each other and there are a lot of common elements that can be shared across the DAACs in this transition. That is where our project, the NASA Openscapes project, sits - supporting a community of practice for staff that are charged with helping NASA Earthdata users migrate to the cloud. We want to pause here and underline that all the work that NASA Openscapes Mentors and team do, is in support of NASA Earthdata users.\n\n\nNASA Openscapes goals\nNASA Openscapes has three primary goals set in our initial proposal, that still stand going forward.\nFirst, to develop a NASA Earthdata Mentor community of collaborative cloud data instructors, that co-create, curate, and use shared resources (“make once, use often”).\n\nFrom there, we have connected DAAC staff with similar roles across 11 DAACs and provided space for them to learn from each other, and reuse material (like the cheatsheets).\n\nSecond, to support the Mentors as they empower science teams to migrate their download-intensive data analysis workflows to the cloud to continue to do the premier science that each of you supports.\n\nTo date we’ve supported 17 Champions teams, 285 users active within last 6 months; many of these folks are DAAC staff and from your UWGs (User Working Groups). 480 users logged in ever.\nThe transition takes time, but we are starting to see some initial science success stories! (Aronne Merrelli with PI Nadia Smith - developing CLIMCLAPS data product archived at GES DISC; used the Champions program as proposal planning for NASA ROSES. Aronne developed workflows in 2i2c, learned to parallelize workflows with Coiled, and swapped to his University credit card once he had a functional workflow. Aronne will present to a 2024 Champions Cohort to show what’s possible for better science in less time.\n\nThird, to scale Cloud workshop infrastructure, so that each DAAC can leverage it easily and efficiently.\n\nOur first workshop was the Nov 2021 hackathon led by PO.DAAC and supported by NSIDC, LP DAAC and many other mentors. This hackathon helped the mentors develop the seed material for new-to-cloud audiences. Collectively they have developed a curriculum in the Cloud Cookbook that helps a majority of NASA Earthdata users access data in the cloud. Just at the 2023 AGU Fall Meeting, there were 4 workshops using these common materials, two used the 2i2c JupyterHub, and we had 12 talks and posters that described different elements of the transition to the cloud. And in every slide deck the participating DAACs are recognized and acknowledged. This is a stunning amount of presented work from any group, and we hope that you all feel very proud.\n\nThe NASA Mentors group has rapidly identified user needs and developed resources. Two examples of that are:\nFirst, earthaccess, a Python library being developed openly on GitHub. The initial mechanism to access NASA data in the cloud required 30 lines of bash code that created a netrc file and adding earthdata login credentials to that file to get the AWS Secret keys. This as a first step for a new user to the cloud is a high barrier to entry. Luis Lopez from the NSIDC DAAC led the development of this package and we are grateful for the flexibility and support from NSDIC DAAC to meet this emergent need. Earthaccess now obscures those steps for the user with a single line of Python, and it works across DAACs easily accessing data from NSIDC, LP DAAC, PO.DAAC, and others. It is one of the things that most users comment about being a highlight. Also this early intervention means that just dozens of users experienced the clunky initial approach, but thousands of users moving forward will just know the easy earthaccess approach. We’ve worked directly with R and MATLAB developers from our networks who have developed R and MATLAB libraries as complements to earthaccess, which further enable a large swath of Earthdata users.\nSecond, cheatsheets. We know that Cloud jargon is intense. Cassie Nickles and Catalina Taglialatela from PO.DAAC spearheaded a set of cheat sheets that new users can refer to as they navigate planning and executing their transition to the cloud. They intentionally created them to meet PO.DAAC’s needs but in a way that was generalized so that all DAACs could use them so they are heavily reused in presentations and workshops.\nThere are so many other examples that we could provide of ways creating this space for these folks to work together has led to increased efficiency, overall better support for new users moving to the cloud and has avoided significant friction and frustration that users might have had if each DAAC was working alone. In the last three years, we have seen significant, exciting scientific advances in NASA Earthdata users’ ability to work in the cloud and this is in part thanks to your teams and your investment. Mindsets as leaders across DAACs and in the broader Open Science community\nToday, most DAACs have at least one mentor who is a Carpentries Instructor (many have undergone certification). This is something that our grant paid for and the benefits to each DAAC we hope will pay dividends for better teaching of many topics. All of the mentors are more comfortable teaching the Cloud Cookbook material and live coding in the 2i2c Hub than they were at the beginning. Each DAAC is able to leverage the collective resources for DAAC-specific workshops (a lot of value for a fraction of the cost). Many DAAC staff beyond the named mentors access the 2i2c Hub for DAAC-specific tutorial development, so they also have seen an increase in efficiency utilizing services that our grant and now contract provide.\nI hope that you can see that all of this work is aligned with the mission you are all supporting and not extra. Each mentor gives about .2WYE (work year equivalents) and we estimate that last year we had between 4 and 5 WYE total across the DAACs, in addition to the staff support that our NASA Openscapes team (Erin, Julie, Stefanie) provides ~ 1-2 WYE.\n\n\nGoing forward: the next two years\nWe started this project three years ago. Our hope was to connect with all the DAACs by the end of the award, to build instructor capacity and common tutorial material, and to leave the DAACs in a place where they would continue to sustain the work we started together transitioning users to the cloud.\nIn the next two years the Openscapes team (Erin, Julie and Stefanie) will phase out our involvement in the DAAC support, starting with Erin in July. The user support tasks will not go away at that point. We have been in discussions with Justin over the last eight months about this and have begun to set up scaffolding that documents the process and allows the systems to continue. Likely, when we step fully away it will require 5-6 WYE’s across the DAAC\nWe’d like to use this time to answer any questions you might have, discuss alignment across the DAACs, identify better ways we can support you all and how each of you see your DAACs contributing to this investment. Thank you, we appreciate you and continue to be so grateful for all the time that DAACs have put towards this work.\n\n\n\nSome NASA Openscapes Mentors and colleagues holding puppies at the AGU 2023 conference #NASAPuppyPorters\n\n\n\n\n\n\nCitationBibTeX citation:@online{robinson2024,\n author = {Robinson, Erin and Lowndes (Openscapes), Julie and\n Openscapes Team, NASA},\n title = {NASA {Openscapes:} {Talking} Points for 3-Year Recap \\&\n Vision for Next Two Years},\n date = {2024-02-15},\n url = {https://openscapes.org/blog/2024-02-15-nasa-openscapes-talking-points/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nRobinson, Erin, Julie Lowndes (Openscapes), and NASA Openscapes Team.\n2024. “NASA Openscapes: Talking Points for 3-Year Recap &\nVision for Next Two Years.” February 15, 2024. https://openscapes.org/blog/2024-02-15-nasa-openscapes-talking-points/." }, { - "objectID": "news/2023-05-17-mentor-coach/index.html#building-skills-for-listening-not-solutioneering", - "href": "news/2023-05-17-mentor-coach/index.html#building-skills-for-listening-not-solutioneering", - "title": "How coaching skills have made us better open data science mentors", - "section": "Building skills for listening not solutioneering", - "text": "Building skills for listening not solutioneering\nSo called “soft skills” are anything but. This was hard. Learning to ask open ended questions was hard, and what was harder still was listening to be able to ask the next powerful question. How we listen differs whether we are in mentor-mode or coach-mode:\n\nWhen we listen as mentors, we’re trying to understand where our expertise can help someone solve a problem.\nWhen we’re listening as coaches, we’re trying to help the other person define their problem, and tap into their own wisdom to find their solution, likely outside of our domain expertise.\n\nWhat do we mean by a “powerful question”? It’s a short question that can open up a really powerful conversation. It’s open-ended, usually starts with the word “What”, ideally is 5 words or less, and can’t be answered by yes or no. What feels like success to you? What’s in the way? What, if anything, is going unsaid? Which of your core values is being messed with?\nDistinguishing when we’re listening as mentors and when we’re listening as coaches is important, because it determines how we will respond as early adopters who may not know the answer to the question – think cloud computing, how to store increasingly large data, how to give hard feedback to a superior, and how to ask for help in a culture built on competition and the myth of the lone genius. Developing these coach listening skills, including what questions to ask, has helped us help others better (and notice and avoid solutioneering!). It’s also helped us feel less overwhelmed as we learn that it’s okay to not always have the answer!\n\n\n“We need these coaching skills to do powerful work and inspire meaningful connections; this program is a safe space to learn, to challenge our preconceptions, to practice, and to grow. I found it to be so invaluable because it’s a chance to acknowledge and learn about skills that are often unspoken in their ability to improve mentorship and collaboration.” — Ileana Fenwick\n\n\nThoughts from Stef. During the first two sessions, in the breakout rooms to practice coaching in pairs, I defaulted to talking more about the process and how we felt about it because actually practicing coaching, even with specific prompts, felt really really hard. But somehow over time, it got easier. Now I find myself trying out “powerful questions” with my peers in one-to-one conversations or coworking, rather than my usual behavior of suggesting solutions to people’s challenges. And people seem to respond!\nBut what really made this work?\n\nPeople were primed for this based on their prior experiences as Openscapes Mentors. They came expecting a familiar set of norms and psychological safety that allowed them first to get comfortable and then to take risks. With this foundation, together we were able to build trust early on. This is key to developing healthy teams and communities. We all knew it would be worth it even if we didn’t know what we were getting into.\nOften, to offer a program like this, an organization might contract an external professional to deliver it. We took it a step further. Openscapes contracted Tara, with whom we’ve collaborated before, and who is highly respected for her tell-it-like-it-is approach to diversity and inclusion. The core team of Tara, Julie, and me, worked to onboard ourselves and each other to this process using an open facilitation approach rather than working behind a curtain. We met frequently and defined our roles together, agreeing to role-model transparency and vulnerability and to name these things. Julie and I took turns managing breakout rooms each week so we could also take turns practicing coaching.\nThe mentors were not our students; they’re our peers and collaborators. Once people opted in, there was no judgment or “sorries” if someone was late or had to miss a session because of life’s responsibilities.\nPractice! We moved away from analyzing and into the doing. It was uncomfortable and people still came and showed up as leaders" + "objectID": "news/2023-11-07-coiled-openscapes/index.html", + "href": "news/2023-11-07-coiled-openscapes/index.html", + "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "section": "", + "text": "Cross-posted from the Coiled blog. James Bourbeau is Lead OSS Engineer at Coiled, a company providing software and expertise for scalable Cloud computing built on Dask. Through the NASA Openscapes community, we support researchers using NASA Earthdata as they migrate their data analysis workflows to the Cloud. This Fall, Openscapes is partnering with Coiled to support us experimenting with another approach to Cloud access.\nAmy Steiker, Luis Lopez, and Andy Barrett from NSIDC and Aronne Merrelli from the University of Michigan shared their scientific use cases which motivated this post.\nWe show how to run existing NASA data workflows on the cloud, in parallel, with minimal code changes using Coiled. We also discuss cost optimization.\nPeople often run the same function over many files in cloud storage. This looks something like the following:\nThis straightforward but important pattern occurs frequently in groups working with NASA Earthdata and NASA Distributed Active Archive Centers (DAACs) to move scientific workloads to the cloud. Here are some examples:\nIn this post we’ll show how to run this same “function on many files” analysis pattern on the cloud with Coiled, which you can copy and modify for your own use case. We’ll also highlight cost optimization strategies for processing terabyte-scale data for fractions of a dollar." }, { - "objectID": "news/2023-05-17-mentor-coach/index.html#building-mindsets-as-leaders", - "href": "news/2023-05-17-mentor-coach/index.html#building-mindsets-as-leaders", - "title": "How coaching skills have made us better open data science mentors", - "section": "Building mindsets as leaders", - "text": "Building mindsets as leaders\nDeveloping coaching skills also helped us build new mindsets. There was a braveness that grew throughout our time together that showed up in different ways. One person shared that they are more brave with whom/when/where they might interact as a coach and mentor. They had recently found themselves in-person with someone senior and rather than making nervous small talk found themselves asking powerful questions and really connecting with the senior person more, and felt that they both learned something in this short moment together.\nWe grew these new mindsets with our peers and built trust and community in a really profound way. The topics people surfaced and shared were so vulnerable – navigating racism, personal and structural saboteurs, and the integrations of personal and work life. We had never experienced such vulnerability in our work, and knew we could not shy away from difficult topics but needed to dig further and out based on the courage and trust in the room.\nThoughts from Julie. I’ve talked a lot about the impact of open data science on my career and my life. My science thinking was transformed when I realized I could do an analysis just as easily 100 times with a for-loop as doing it twice, and that I could publish my work via RMarkdown and GitHub to the open web and share via a single URL instead of sending followup emails with different versions of the same PDF or Word doc. Now, I am realizing that the impact of coaching on my thinking might be at this same level. I am still processing it all, but I am feeling more confident in places I have been struggling to show up as my full self. It is somehow helping me bring confidence into a room with me, knowing that I have new skills and a strengthened sense of shared braveness together with this cohort. When we first planned this cohort with Tara, this was new terrain. We asked ourselves, “If this is wildly successful what are the outcomes? What’s possible?“ Here are some ideas we laid out, and I think the Mentors are meeting each one:\n\nPeople model inclusive behavior in work, life, Openscapes, and our home organizations, to influence culture change\nPeople are braver, share stories and energy at work and other places\nSomeone speaks up in a meeting\nEveryone learns something new! (me too!)\nWe listen better/differently\nWe scale participation - use coaching strategies to empower others sooner, so that existing mentors don’t burn out\nMore people feel safe in Openscapes and open science, and in turn, inspire others to be braver" + "objectID": "news/2023-11-07-coiled-openscapes/index.html#processing-locally", + "href": "news/2023-11-07-coiled-openscapes/index.html#processing-locally", + "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "section": "Processing Locally", + "text": "Processing Locally\nIn this example we process many NetCDF files stored on S3 from the MUR Global Sea Surface Temperature NASA dataset to look at surface temperature variation over the US Great Lakes region:\nimport os\nimport tempfile\nimport earthaccess\nimport numpy as np\nimport xarray as xr\n\n# Step 1: Get a list of all files.\n# Use earthacess to authenticate and find data files (total of 500 GB).\ngranules = earthaccess.search_data(\n short_name=\"MUR-JPL-L4-GLOB-v4.1\",\n temporal=(\"2020-01-01\", \"2021-12-31\"),\n)\n\n\n# Step 2: Create a function to process each file.\n# Load and subset each data granule / file.\ndef process(granule):\n results = []\n with tempfile.TemporaryDirectory() as tmpdir:\n files = earthaccess.download(granule, tmpdir)\n for file in files:\n ds = xr.open_dataset(os.path.join(tmpdir, file))\n ds = ds.sel(lon=slice(-93, -76), lat=slice(41, 49))\n cond = (ds.sea_ice_fraction < 0.15) | np.isnan(ds.sea_ice_fraction)\n result = ds.analysed_sst.where(cond)\n results.append(result)\n return xr.concat(results, dim=\"time\")\n\n\n# Step 3: Run function on each file in a loop\nresults = []\nfor granule in granules:\n result = process(granule)\n results.append(result)\n\n\n# Step 4: Combine and plot results\nds = xr.concat(results, dim=\"time\")\nds.std(\"time\").plot(figsize=(14, 6), x=\"lon\", y=\"lat\")\nThis specific example uses earthacess to authenticate with NASA Earthdata and download our dataset (~500 GB of NetCDF files) and Xarray to load and select the region of the data we’re interested in, but we’ve seen many different approaches here, including file formats like HDF, Zarr, and GeoTIFF, as well as libraries like Xarray, rasterio, and pandas. In each case though the underlying pattern is the same.\nWe then combine the results from processing each data file and plot the results.\n\n\n\n\nStandard deviation of sea surface temperature over the Great Lakes region in the US.\n\n\n\nRunning this locally on my laptop takes ~6.4 hours and costs NASA ~$25 in data egress costs (based on a $0.05/GB egress charge rate – normal is $0.10/GB, but presumably NASA gets a good deal)." }, { - "objectID": "news/2023-05-17-mentor-coach/index.html#fearless-in-service-of-something", - "href": "news/2023-05-17-mentor-coach/index.html#fearless-in-service-of-something", - "title": "How coaching skills have made us better open data science mentors", - "section": "Fearless in service of something", - "text": "Fearless in service of something\nWorking with Tara and bringing Openscapes Mentors across different organizations and initiatives is part of movement building with our Flywheel. This is a concept developed by Jim Collins that we adapted for Openscapes with Erin Robinson (Erin first brought coaching into Openscapes strategy and practices too!). Transformations occur from relentlessly pushing a giant, heavy flywheel that builds momentum over time. Using this model, we welcomed folks to opt in, created space and place so we could invest in learning and trust, and then worked openly together as we practiced as coaches and coachees, leveraging common experiences and skills. This turn of the flywheel is part of building the momentum of kinder and open science, building from past, parallel, and collaborative work from many places. Mentors are already inspiring others with their leadership, pushing the next turn of the flywheel.\nBravery has come up throughout this cohort and this post, and this braveness and fearlessness is in service of something. We’re wanting to connect our daily work with the global moment at hand, so we can better address issues stemming from climate change and social justice. As one participant said, “I don’t want to be scared to ask questions anymore”. We want to ask questions with no ego, in rooms with our science peers. We want to break the silences, opening up the rooms so that the next person who has a question but was not sure they would voice it is empowered to speak up.\nIn our final session we paired up to coach each other through developing our own statement of purpose in open science.\n\n\n“I am an elevator to a better tomorrow”\n\n\n\n\n\n“I am a pollinator who connects people to each other and ideas so everyone flourishes”\n\n\n\n\n\n“I am the momentum that answers to my peers”\n\n\n\nWe are all the momentum that answers to our peers. To make meaningful change, we must work across all levels and elevate those who will be the change along with us.\n\n ::: {.caption-text .center-text} Photo by Elliot Lowndes :::" + "objectID": "news/2023-11-07-coiled-openscapes/index.html#processing-on-the-cloud-with-coiled", + "href": "news/2023-11-07-coiled-openscapes/index.html#processing-on-the-cloud-with-coiled", + "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "section": "Processing on the Cloud with Coiled", + "text": "Processing on the Cloud with Coiled\nLet’s run the exact same analysis on the cloud. Running on the cloud helps in a couple of ways:\n\nData Proximate Computing: Running computations closer to where the data is stored increases performance and avoids data transfer costs.\nScale: Distributing the processing over many machines in parallel lets us tackle larger volumes.\n\nUsing Coiled to run the same workflow on the cloud involves lightly annotating our process function with the @coiled.function decorator:\nimport coiled\n\n@coiled.function(\n region=\"us-west-2\", # Run in the same region as data\n environ=earthaccess.auth_environ(), # Forward Earthdata auth to cloud VMs\n)\ndef process(granule):\n # Keep everything inside the function the same\n ...\nThis tells Coiled to run our processing function on a VM in AWS and then return the result back to our local machine.\nAdditionally, we switch to using the Coiled Function .map() method (similar to Python’s builtin map function) to run our process function across all the input files in parallel:\n# Step 3: Run function on each file in a loop\n# results = []\n# for granule in granules:\n# result = process(granule)\n# results.append(result)\nresults = process.map(granules) # This runs on the cloud in parallel\nWith these two small code changes, the same data processing runs in parallel across many VMs on AWS. The runtime drops to ~9 minutes (a factor of ~42x speedup) and costs ~$1.52 (a factor ~16x less)." + }, + { + "objectID": "news/2023-11-07-coiled-openscapes/index.html#optimizing-costs", + "href": "news/2023-11-07-coiled-openscapes/index.html#optimizing-costs", + "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "section": "Optimizing Costs", + "text": "Optimizing Costs\nProcessing 500 GB of data costs us $1.52. This is cheap.\nWe bring this cost down further to $0.36 with the following techniques:\n\nSpot: Use spot instances, which are excess capacity offered at a discount.\nARM: Use ARM-based instances, which are less expensive than their Intel-based equivalents, often with similar, or better, performance.\nInstance Type Selection: Use single-core instances (only available when using ARM), because this particular computation doesn’t require large computing resources.\n\nWith this additional configuration made to the Coiled Functions decorator, our full cost-optimized cloud workflow looks like the following:\nimport os\nimport tempfile\nimport coiled\nimport earthaccess\nimport numpy as np\nimport xarray as xr\n\n# Step 1: Get a list of all files.\n# Use earthacess to authenticate and find data files (total of 500 GB).\ngranules = earthaccess.search_data(\n short_name=\"MUR-JPL-L4-GLOB-v4.1\",\n temporal=(\"2020-01-01\", \"2021-12-31\"),\n)\n\n\n# Step 2: Create a function to process each file.\n# Load and subset each data granule / file.\n@coiled.function(\n region=\"us-west-2\", # Run in the same region as data\n environ=earthaccess.auth_environ(), # Forward Earthdata auth to cloud VMs\n spot_policy=\"spot_with_fallback\", # Use spot instances when available\n arm=True, # Use ARM-based instances\n cpu=1, # Use Single-core instances\n)\ndef process(granule):\n results = []\n with tempfile.TemporaryDirectory() as tmpdir:\n files = earthaccess.download(granule, tmpdir)\n for file in files:\n ds = xr.open_dataset(os.path.join(tmpdir, file))\n ds = ds.sel(lon=slice(-93, -76), lat=slice(41, 49))\n cond = (ds.sea_ice_fraction < 0.15) | np.isnan(ds.sea_ice_fraction)\n result = ds.analysed_sst.where(cond)\n results.append(result)\n return xr.concat(results, dim=\"time\")\n\n\n# Step 3: Run function on each file in parallel\nresults = process.map(granules) # This runs on the cloud in parallel\n\n\n# Step 4: Combine and plot results\nds = xr.concat(results, dim=\"time\")\nds.std(\"time\").plot(figsize=(14, 6), x=\"lon\", y=\"lat\")\nand, while code runtime stays the same at ~9 minutes, cost drops to ~$0.36 (a factor of ~70x less than running locally)." + }, + { + "objectID": "news/2023-11-07-coiled-openscapes/index.html#summary", + "href": "news/2023-11-07-coiled-openscapes/index.html#summary", + "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "section": "Summary", + "text": "Summary\nWe ran a common data subsetting-style workflow on NASA data in the cloud with Coiled. This demonstrated the following:\n\nEasy: Minimal code changes to migrate existing code to run on the cloud.\nFast: Acceleration of the workflow runtime by ~42x.\nCheap: Cost reduction of ~70x.\n\nWe hope this post shows that with just a handful of lines of code you can migrate your data workflow to the cloud in a straightforward manner. We also hope it provides a template you can copy and adapt for your own analysis use case.\n\n\n\n\nComparing cost and duration between running the same workflow locally on a laptop (data egress costs), running on AWS, and running with cost optimizations on AWS.\n\n\n\nWant to run this example yourself?\n\nGet started with Coiled for free at coiled.io/start. This example runs comfortably within the free tier.\nCopy and paste the code snippet above.\n\nGoing to AGU 2023? Come by the Coiled booth and say hi (right by the entrance next to Google)." + }, + { + "objectID": "news/2023-11-07-coiled-openscapes/index.html#acknowledgements", + "href": "news/2023-11-07-coiled-openscapes/index.html#acknowledgements", + "title": "Processing Terabyte-Scale NASA Cloud Datasets with Coiled", + "section": "Acknowledgements", + "text": "Acknowledgements\nThis work was done in collaboration with NASA Openscapes, a community supporting research teams’ cloud migration with different Cloud environments and technologies, including Coiled.\nWe’d also like to thank Amy Steiker, Luis Lopez, and Andy Barrett from NSIDC and Aronne Merrelli from the University of Michigan for sharing their scientific use cases which motivated this post." }, { - "objectID": "news/2024-06-06-editorial-published/index.html", - "href": "news/2024-06-06-editorial-published/index.html", - "title": "Shifting institutional culture to develop climate solutions with Open Science", + "objectID": "news/2024-07-16-swot-workshop/index.html", + "href": "news/2024-07-16-swot-workshop/index.html", + "title": "Learn about and use Surface Water and Ocean Topography (SWOT) Data!", "section": "", - "text": "We are so happy to share that a paper co-authored by Openscapes mentors across organizations – including NASA Earthdata, NOAA Fisheries, EPA, California Water Boards, Pathways to Open Science, Fred Hutch Cancer Center – was just published: Shifting institutional culture to develop climate solutions with Open Science. From co-author Anna Holder, Cal EPA / Water Boards: “It’s a short read and quite uplifting and inspirational and provides some more insight and what we’re learning as we implement Openscapes across organizations.”\n\n\n“Our best advice to start shifting culture is to have regularly scheduled learning meetings—with structure and intention to make them different from other work meetings.”\n\n\nPlease let us know what you think, and share with colleagues!\nWe deeply appreciate the contributions made by all Openscapes Mentors and community members who are not listed here.\nCitation: Julia Stewart Lowndes, Anna M. Holder, Emily H. Markowitz, Corey Clatterbuck, Amanda L. Bradford, Kathryn Doering, Molly H. Stevens, Stefanie Butland, Devan Burke, Sean Kross, Jeffrey W. Hollister, Christine Stawitz, Margaret C. Siple, Adyan Rios, Jessica Nicole Welch, Bai Li, Farnaz Nojavan, Alexandra Davis, Erin Steiner, Josh M. London, Ileana Fenwick, Alexis Hunzinger, Juliette Verstaen, Elizabeth Holmes, Makhan Virdi, Andrew P. Barrett, Erin Robinson (2024). Shifting institutional culture to develop climate solutions with Open Science. Ecology and Evolution, 14, e11341. https://doi.org/10.1002/ece3.11341\n\n\n\nSimilar to how plants use the resources available to them to develop fruits and seeds for future plants, values, culture, and technical infrastructure continually influence the generation and reproduction of relevant, rigorous, and insightful science. Illustration by Adyan Rios and Su Kim, NOAA Fisheries.\n\n\n\n\n\nCitationBibTeX citation:@online{2024,\n author = {, Openscapes},\n title = {Shifting Institutional Culture to Develop Climate Solutions\n with {Open} {Science}},\n date = {2024-06-06},\n url = {https://https://nasa-openscapes.github.io/blog/2024-06-06-editorial-published},\n langid = {en}\n}\nFor attribution, please cite this work as:\nOpenscapes. 2024. “Shifting Institutional Culture to Develop\nClimate Solutions with Open Science.” June 6, 2024. https://https://nasa-openscapes.github.io/blog/2024-06-06-editorial-published." + "text": "We have an upcoming free hands-on virtual workshop led by NASA PO.DAAC on data access for the Surface Water Ocean Topography (SWOT) satellite. The SWOT session will be held July 16, 2024, as part of the Hacking Limnology Virtual Summit, a week-long series of talks and workshops broadly focused on open data science and modeling by early career scientists and researchers. This remote sensing SWOT session will be introduced by Merritt Harlan from the USGS and feature an exciting talk from Craig Brinkerhoff on SWOT-related research, followed by a 2-hour hands on demonstration by Cassie Nickles with support from NASA Openscapes Mentors.\nTo find out more about SWOT, visit the SWOT PO.DAAC Website and explore other SWOT tutorials and resources in our PO.DAAC Cookbook: SWOT Chapter ahead of time.\nRegistration is free and open to all career stages: https://aquaticdatasciopensci.github.io/registration/\nThe hands-on demonstration will be using this GitHub Repository with Binder: https://github.com/podaac/2024-SWOT-ECR-Workshop." }, { - "objectID": "news/2024-01-18-agu-talk-2023/index.html", - "href": "news/2024-01-18-agu-talk-2023/index.html", - "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", + "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html", + "href": "news/2024-03-12-nasa-earthdata-webinar/index.html", + "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", "section": "", - "text": "In December at the AGU Fall Meeting in San Francisco, we were so grateful to connect with so many colleagues in person. We supported NASA Mentors Cloud Workshops on Sunday and organized a Happy Hour with colleagues from across NASA and the Open Science world. We attended and gave talks thoughout the week in addition to making many great connections in the Exhibition Hall, Poster Hall, and outside in the sun. This is a brief summary of our Friday 8-minute talk titled NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud.\nQuick links:" + "text": "On Wednesday, February 28, NASA Openscapes Mentors from 4 data centers shared how to use the Openscapes Earthdata Cloud Cookbook—a compilation of open-source tutorials, workflows, libraries, and cheatsheets that help users find, access, and work with Earth science data. This was really exciting to have the opportunity for the Mentors to share about this work on a big stage! There were 106 attendees, and recordings of these webinars are often watched by many more! Presenters were Bri Lind from the Land Processes Data Active Archive Center(LP DAAC); Luis Alberto Lopez Espinosa, from the National Snow and Ice Data Center (NSIDC); Cassie Nickles from the Physical Oceanography Data Active Archive Center (PO.DAAC); and Alexis Hunzinger from the Goddard Earth Sciences Data and Information Services Center (GES DISC).\nQuicklinks:" }, { - "objectID": "news/2024-01-18-agu-talk-2023/index.html#why-we-work-motivated-by-climate-and-social-change", - "href": "news/2024-01-18-agu-talk-2023/index.html#why-we-work-motivated-by-climate-and-social-change", - "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", - "section": "Why we work: motivated by climate and social change", - "text": "Why we work: motivated by climate and social change\n\n\n“What if we connected our skills & values as a daily practice, for climate?”\n\n\nWe kicked off our talk with this question to center the motivation for the work we do. As the NASA Openscapes Mentors had given many talks, workshops, and posters throughout the week showcasing and teaching their shared work, we summarized their efforts with a quote from Cassie Nickles:\n\n\n“NASA Openscapes is a collaborative environment for data center [DAAC] staff to collectively support open science initiatives for NASA Earthdata users. We’ve developed awesome material to help Earthdata users (cheatsheets, a python package (earthaccess), NASA Earthdata Cloud Cookbook).\nPerhaps just as important as what we’ve done however, are mindsets we’ve grown into along the way. It’s okay to share imperfect works in progress. Ideas are not too big or too small to share. We are better at dreaming and implementing the future together.” – Cassie Nickles (PO.DAAC)\n\n\nThen we centered our talk on a layer above: how we work to support these amazing user support staff to collaborate across data centers and as early adopters, co-develop teaching resources and infrastructure to support researchers in the Cloud." + "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#community-developed-resourcesexplore-the-openscapes-earthdata-cloud-cookbook", + "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#community-developed-resourcesexplore-the-openscapes-earthdata-cloud-cookbook", + "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", + "section": "Community Developed Resources—Explore the Openscapes Earthdata Cloud Cookbook", + "text": "Community Developed Resources—Explore the Openscapes Earthdata Cloud Cookbook\nBri Lind kicked things off by describing data stewardship at NASA. NASA has many discipline specific data centers that archive and manage data from all of the Earth observation missions. She then shifted to NASA Openscapes - a mentor community across those NASA Earth science data centers that helps support users though co-creating common tutorials, hosting cloud training events, and practicing open science ourselves! Bri shared how open science is something we do in our daily work - we write open source code using tools like python, R, Quarto, and GitHub, and interact with open communities like leafmap, Pangeo, and rOpenSci.\n\n\n“We really like to be active in other open source communities” - Bri Lind, Land Processes data center (LP DAAC)\n\n\n\n\n\nLike a spiralling shell, we co-developed across different teams of people that work with NASA Earthdata\n\n\nBri showed an illustration we refer to as the “shell” that shows how like a spiraling shell we co-developed across different teams of people that work with NASA Earthdata. The way this plays out for us: We as a small mentor community (in gray at the top) are able bring our deep expertise about NASA Earthdata from our data centers together to co-develop and learn across the data centers. Then we share back and incorporate with our colleagues at each of our data centers (blue). This means more people and time focussing real-life users (yellow). And we incorporate what we learn back into the open science community (orange). She emphasized that our resources are built with consistent feedback and iteration has shaped development of migration tools and support mechanisms (purple)\nBri also shared that in addition to everything we’ve accomplished together, we’ve all learned new skills and developed new friendships. This trust and ability to work together helps all of the data centers: we can help diverse users and also address the common needs across all users." }, { - "objectID": "news/2024-01-18-agu-talk-2023/index.html#how-we-work-openscapes-flywheel", - "href": "news/2024-01-18-agu-talk-2023/index.html#how-we-work-openscapes-flywheel", - "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", - "section": "How we work: Openscapes Flywheel", - "text": "How we work: Openscapes Flywheel\nThe Openscapes Flywheel is a tool for movement building (Robinson & Lowndes 2022). We developed this from the early days collaborating with the NASA Mentors and it is open source: available for you to reuse and fork as other groups are starting to do. We reach for the Flywheel as a tool for planning, implementation and communication, just as we reach for R, Quarto, and JupyterHubs for analysis, documentation, and cloud computing.\nThe Flywheel is a concept developed by Jim Collins, where transformations occur from consistently doing key activities that add up over time. The Openscapes Flywheel at its simplest form has six steps that we repeat daily, monthly, and over years. Starting from the bottom and going clockwise: Leverage common workflows, skills, and tools; Inspire; Welcome; Create space & place; Invest in learning and trust; Work openly.\n\n\n\n\nThe Openscapes Flywheel\n\n\n\nWe talked through what this looked like for the NASA Openscapes project in Year 1, and then again in Years 2-3 as the Flywheel gained momentum as the Mentor community grew and supported researchers on the Cloud." + "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#when-to-cloud", + "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#when-to-cloud", + "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", + "section": "When to Cloud?", + "text": "When to Cloud?\nAlexis Hunzinger started the “When to Cloud” portion by reminding us that “Cloud” can mean multiple things at once - we also work with data from clouds in the sky!\nWhat is the Cloud? An analogy is helpful: we can compare to how we shifted from renting physical movie DVDs from a store to how we now stream them online. When we think about scientific analysis in the Cloud, we can also think about streaming data. Like streaming a movie, we have to create an account with a provider, choose files from the provider’s archive, and then using your own device (computer), view and analyze with the provider’s resources (remote computers).\n\n\n“What is the Cloud? Any internet-accessible system providing on-demand computing and distributed mass storage” - Alexis Hunzinger, Goddard Earth Sciences Data and Information Services Center (GES DISC)\n\n\n\n\n\nSlide from Alexis showing “What is the Cloud” for NASA Earthdata Cloud\n\n\nNow that we have a shared understanding of what is the Cloud, we can ask ourselves these questions to consider when to Cloud:\n\nWhat is the data volume?\nHow long will it take to download?\nCan you store all that data (cost and space)?\nDo you have the computing power for processing?\nDoes your team need a common computing environment?\nDo you need to share data at each step or just an end product?\n\nThe Cookbook chapter When To ‘Cloud’ section shares more!" }, { - "objectID": "news/2024-01-18-agu-talk-2023/index.html#turning-hundreds-thousands-of-times-in-ways-big-and-small", - "href": "news/2024-01-18-agu-talk-2023/index.html#turning-hundreds-thousands-of-times-in-ways-big-and-small", - "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", - "section": "Turning hundreds, thousands of times in ways big and small", - "text": "Turning hundreds, thousands of times in ways big and small\nWhat’s so exciting is that following these initial turns of the Flywheel, it is now turning hundreds, thousands of times in ways big and small: like when a researcher uses GitHub for the first time and then turns around to teach their supervisor, and when staff have the confidence to speak up in meetings with what they know from the broader open science community. We’ve shared these stories in several manuscripts and blog posts, including a cross-government collaboration:\n\nThe Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices (Robinson & Lowndes 2022)\nShifting institutional culture to develop climate solutions with Open Science (Lowndes et al 2023)\nhttps://openscapes.org" + "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#openscapes-cloud-infrastructure", + "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#openscapes-cloud-infrastructure", + "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", + "section": "Openscapes Cloud Infrastructure", + "text": "Openscapes Cloud Infrastructure\nLuis Lopez said that once we have decided we will work in the Cloud, there are infrastructure considerations.\n\n\n“We are working to bridge the technological gap as well as the knowledge gap to make it easer for everyone to get started in the Cloud” - Luis Lopez, National Snow and Ice Data Center (NSIDC)\n\n\nLuis shared that working in the Cloud in a curated environment supports new learners by lowering technical barriers. In our NASA Openscapes JupyterHub managed by 2i2c, we’re able to support Python, RStudio, MATLAB users, and users can also bring their own base image. AND, the ecosystem of packages like matplotlib and ggplot2 are available from any of those images! This is important since many researchers use a combination of tools.\n\n\n\nA slide from Luis: infrastructure like Jupyter, RStudio, and MATLAB that the user selects will work with the whole ecosytem of R and Python tools" }, { - "objectID": "news/2024-01-18-agu-talk-2023/index.html#technical-social-infrastructure-together", - "href": "news/2024-01-18-agu-talk-2023/index.html#technical-social-infrastructure-together", - "title": "NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud", - "section": "Technical & social infrastructure together", - "text": "Technical & social infrastructure together\nWhat’s key here is that technical & social infrastructure have been prioritized together consistently from the start. We focus on developing a kinder, open science mindset together: Mentorship is a skill we can all develop, just as we can all learn coding or data management as a skill, no matter where we’re starting from. In the open science world, there are many places to learn from & we can all join existing efforts with humility and a growth mindset to learn.\n\n\n\n\nDeveloping a kinder, open science mindset. Slide from AGU talk" + "objectID": "news/2024-03-12-nasa-earthdata-webinar/index.html#earthdata-cloud-cookbook-walk-through", + "href": "news/2024-03-12-nasa-earthdata-webinar/index.html#earthdata-cloud-cookbook-walk-through", + "title": "NASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook", + "section": "Earthdata Cloud Cookbook Walk-through", + "text": "Earthdata Cloud Cookbook Walk-through\nCassie screenshared a live walk-through of the NASA Earthdata Cloud Cookbook. She pointed out the When to Cloud chapter, as well as a glossary and cheatsheets, Cloud environment setup (under active development), a ‘How do I …’ chapter to do things like find and subset data, or use APIs, a Tutorials chapter with notebooks, and a chapter of workshops and hackathon materials developed by the Mentors.\n\n\n“We would love for anyone to be able to contribute to this. If you’re thinking, ‘I have a workflow that I would love share’, please send it our way”! - Cassie Nickles, Physical Oceanography Data Active Archive Center (PO.DAAC)\n\n\nCassie welcomed people to contribute - the Cookbook is built on Quarto and GitHub - and showed how to cite the Cookbook.\n\n\n\nSlide from Cassie showing the NASA Earthdata Cloud Cookbook\n\n\nIn closing, on behalf of the NASA Openscapes Mentors, Cassie shared her joy of working with this open community of people who are united around shared interests and needs." }, { - "objectID": "news/2024-07-23-esip-summer-2024/index.html", - "href": "news/2024-07-23-esip-summer-2024/index.html", - "title": "Supporting NASA Earthdata users in the Cloud: NASA Openscapes onboarding and ‘fledging’", + "objectID": "news/2024-02-26-esds-tech-spotlight/index.html", + "href": "news/2024-02-26-esds-tech-spotlight/index.html", + "title": "NASA Earth Science Data Systems Technology Spotlight", "section": "", - "text": "NASA Openscapes Mentors Aaron Friesz, Andy Barrett, Danny Kaufman, Rhys Leahy, Alexis Hunzinger, with Julia Lowndes are co-leading this session at the ESIP Summer 2024 meeting.\nESIP Meeting theme: Grounded in Trust: Data Ethics Empower Collaboration\nDetails on the ESIP site.\nPurpose of our session: Facilitate a space to find common challenges & solutions for “moving to the cloud”, which includes onboarding people to a shared compute space and fledging them to their own space. We will share stories of how people go from 0 to Hub and then fledge to other clouds. Have mechanisms to hear many voices and come up with creative solutions. We will also invite people to contribute (earthaccess, Cookbook) and how we onboard. Share stories of how people go from 0 to Hub and then fledge to other cloud. \nOutcomes from our session: Learn from participants: what are challenges encountered from onboarding & fledging? Co-design solutions. Blog post - summary posted on ESIP/NASA-Openscapes blog. We’ll include authors from Roll Call unless you’d prefer to opt out; we’ll share a draft beforehand. \nProcess: Stories from NASA Openscapes (30 min); Breakout groups (25 min); Discussion (25 min)\n\n\nNASA Openscapes is a community where staff with similar roles supporting users across 12 NASA Earth Science Data Centers (DAACs) – through building trust – have been able to learn, develop common tutorials, and teach together to support users migrating workflows using NASA Earthdata to the Cloud. NASA Openscapes Mentors co-create and maintain an open Earthdata Cloud Cookbook of common reusable open source tutorials that they have co-developed for specific audiences and tested and refined through frequent workshops, hackathons, and Openscapes Champions Cohorts. We also created the earthaccess Python library which made users’ first experience with NASA Earthdata Cloud be two lines of Python code rather than 30 lines of bash code (that also required clicking and managing hidden files for authentication). The work we do together as a small community has enormous cascading effects, particularly as they visibly practice open science daily via contributions to open source code and documentation. We have supported hundreds of users to have their first hands-on experience with NASA Earthdata in the Cloud in a 2i2c JupyterHub configured for Jupyter, RStudio, MATLAB, and QGIS using our tutorials and docker base images (set up for libraries/environments, Quarto, etc). As the purpose of our JupyterHub is initial learning and exploration, we are now focused on “fledging” – answering the question “where do researchers go when they leave the Openscapes 2i2c JupyterHub?” We will share first stories of researchers shifting to their own cloud spaces, attaching their university credit cards in order to do science at scale in the cloud. We will share stories and challenges, and how approaches fit and can be leveraged by the ESIP community." + "text": "Date: Monday, February 26, 2024\nTime: 11:00 - 12:00 MT / 1:00 - 2:00 ET Presenter: Luis Lopez, National Snow and Ice Data Center\nThe monthly Earth Science Data Systems (ESDS) Technology Spotlight webinars provide a platform for ESDIS, the DAACs (NASA Data Centers), IMPACT, and other ESDS initiatives and competitive programs to showcase technology innovations to an ESDS-wide audience and to discuss how these technologies might be adapted and used throughout ESDS. The webinars are open to everyone in the greater ESDS community." }, { - "objectID": "news/2024-04-03-nasa-champions/index.html", - "href": "news/2024-04-03-nasa-champions/index.html", - "title": "NASA Openscapes Champions Cohort", + "objectID": "news/2022-12-31-previous-news/index.html", + "href": "news/2022-12-31-previous-news/index.html", + "title": "Previous News 2021-2022", "section": "", - "text": "This is a mentorship and professional development opportunity for research teams using NASA Earthdata to learn open science practices and spend time experimenting and planning what their analytical workflows with NASA Earthdata look like in the Cloud.\nFor details, please see the 2024 NASA Openscapes Champions Cohort webpage and summary blog post about the 2023 Champions: Exciting Progress for Research Teams using NASA Earthdata in the Cloud: 2023 NASA Openscapes Champions Wrap-up" + "text": "As we migrate posts from 2021-2022, please find them here on the main openscapes.org website:\nhttps://openscapes.org/events#category=nasa-framework" }, { - "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html", - "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html", - "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", + "objectID": "news/2022-12-31-previous-news/index.html#were-migrating-previous-posts", + "href": "news/2022-12-31-previous-news/index.html#were-migrating-previous-posts", + "title": "Previous News 2021-2022", "section": "", - "text": "From April-May 2024, the NASA Mentors who span eleven Distributed Active Archive Centers (DAACs) co-led the third Champions Cohort with the NASA Openscapes project team, this year focusing on, teaching lessons they adapted for geospatial and cloud analysis. The Cohort included nine international research teams from academia and government that were curious about working with NASA Earthdata in the Cloud. Many teams were interested in using data from multiple DAACs. User cloud adaption takes time, given the new conceptual mindsets and technical skillsets it requires. During the ten weeks we worked together, NASA Mentors refined and extended previous lessons to focus on thinking through and planning the transition to using the Cloud for science research and applications, and initial experiments using the Cloud through our 2i2c JupyterHub. Below are these updates and YouTube clips!\nThere were also recurring themes/questions that we have heard before, some of which remain as open questions and continue to remain a challenge. Importantly, Amazon Web Services (AWS) Cloud onboarding, when to use what resources, how to set them up, and how to discuss needs with organizational leadership and IT staff, which often falls outside the scope of NASA DAACs, yet it’s a key element of helping users adopt the Cloud and use NASA data in the Cloud. It is encouraging to hear some of the champions starting to have conversations with their institutions, IT departments, and making their needs known, which is likely a big part of the solution, too. We are thankful to NASA Openscapes Champions for informing and nudging these conversations! All of this work is underpinned by Openscapes and NASA’s commitment to open science practices and a kinder collaborative culture. This cohort is funded by NASA and is part of our NASA Openscapes Framework project.\nQuick links:" - }, - { - "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#nasa-champions-cohort-overview", - "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#nasa-champions-cohort-overview", - "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", - "section": "NASA Champions Cohort Overview", - "text": "NASA Champions Cohort Overview\nNASA Openscapes is a multi-year project to develop a cohesive approach to building cloud migration capacity across NASA Earthdata from NASA’s Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs) and the research teams supported by the DAACs. We do this through supporting a community of NASA DAAC mentors, who are primarily dedicated to user support. This community has learned together how to use NASA Earthdata in the Cloud. They have translated that experience into a series of hackathons, workshops, self-paced tutorial material in the NASA Earthdata Cloud Cookbook, and through an intensive, 10-week NASA Openscapes Champions program.\nUser cloud adaption can often have a steep learning curve and feel overwhelming. The NASA Openscapes Champions Cohort brings together research teams that are interested in migrating their existing NASA Earthdata workflows to the Cloud with NASA DAAC Mentors who are extremely knowledgeable about the data they serve and the initial pathways to using that data in the Cloud. This Cohort provides a common, welcoming place for teams to learn together, ask questions about using the Cloud, plan their transition, and do initial experimentation using the NASA Openscapes 2i2c JupyterHub. Because this is a more intensive experience, the teams build collaborative partnerships with DAAC mentors, and the mentors can more quickly identify and work on solving issues that will make cloud migration easier for many more users. We led the first NASA Openscapes Champions Cohort in 2022.\nThe third NASA Openscapes Champions Cohort ran during April-May 2024 with nine research teams interested in a wide variety of NASA Earthdata and various stages of cloud technology familiarity. You can learn more about their research below.\n\n\n\nVideo conference screen shot (♥) of some researchers in the 2024 NASA Openscapes Champions Cohort.\n\n\nTogether as a Champions Cohort, these teams discussed what worked and didn’t work as they migrated workflows to the Cloud, focusing on collaboration and Open Science. We met as a cohort five times over two months on alternating Wednesdays. Each cohort call included a welcome and code of conduct reminder and two teaching sessions with time for reflection in small groups or silent journaling and group discussion before closing with suggestions for future team meeting topics (“Seaside Chats”), Efficiency Tips, and Inclusion Tips. All topics and the slides presented are shared on the 2024 Cohort page. Additional coworking sessions were scheduled on alternate weeks, where researchers could work quietly, screenshare to ask questions, or meet with their team to discuss further. In addition, the teams have access to Openscapes’ 2i2c Jupyter Hub, which will continue for the next year. \nThe NASA Openscapes Mentors supported the Champions and contributed to the curriculum (all available at https://openscapes.github.io/series). In particular, the NASA Openscapes Champions Curriculum had important additions. \n\nAronne Merrelli (University of Michigan, 2023 Champion) shared his experiences of First Forays into the Cloud, and how it’s possible to go from cloud novice to feeling like it’s a superpower and doing real analyses for his American Geophysical Union (AGU) poster (and beyond!). YouTube clip \nCatalina Taglialatela (PO.DAAC) led the Earthdata Cloud Clinic with datasets from several DAACs and using the earthaccess Python library for NASA Earthdata search & access in the Cloud. \nMatt Fisher (NSIDC) updated psychological safety examples - this lesson particularly resonated with the Champions teams who reflected together about how this is important for learning new things. YouTube clip.\nAlexis Hunzinger (GES DISC) extended the Data strategies in the Cloud lesson with considerations of environmental impact /climate change and streaming data in the same way you stream video on a streaming service such as Netflix, without downloading to a local computer or server.\nCassie Nickles (PO.DAAC) walked through and welcomed contributions to NASA Earthdata Cloud Cookbook, a learning-oriented resources hub to support scientific researchers who use NASA Earthdata as NASA migrates data and workflows to the cloud.- YouTube clip.\nBrianna Lind (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey)’s Open Communities lesson solicited many additional examples including Cloud Native Computing Foundation (CNCF), US Research Software Engineering (US-RSE), Research Data Alliance (RDA), Earth Science Information Partners (ESIP), CryoCloud, Project Pythia.\nMahsa Jami (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey) shared coding strategies for parallelizing code and dove into parallel processing from a scientist perspective. “Pleasingly parallel” is a term for tasks that are completely independent from each other - for example, to validate whether each value in a dataset is within a threshold. YouTube clip.\nLuis Lopez (NSIDC) demonstrated new interactive features of the earthaccess Python library: earthaccess.explore()which provides interactivity without having to download data. This feature only streams metadata (of the dataset’s spatial coverage, volume size) and not the data itself. earthaccess.explore() enables previewing the data and helps narrow down what you may eventually want to stream to memory or download. Additional features enable you to identify different satellite swath overlaps in a selected area and save egress costs because it works more efficiently. YouTube clip.\nAndy Teucher demoed data storage strategies in the Cloud, first via a notebook tutorial about How to store data in the Cloud (including where to store and how to delete your intermediate & test files) and then about storage strategies & costs. YouTube clip.\n\n\n\n\nLuis López demonstrates new interactive features of the earthaccess Python library that enable users to identify different satellite swath overlaps in a selected area.\n\n\n\n\n\nFigure by Andy Teucher showing costs of compute (purple) and storage (blue and green) in the Cloud. HOME directory (Amazon calls this EFS on the backend) is far more expensive than the other options (Amazon calls these S3 buckets).\n\n\nTeams also heard a NASA Earthdata Cloud Update (slides) from Special Guest Justin Rice, NASA Goddard Space Flight Center, ESDIS Project Office, Deputy Project Manager/Data Systems." + "text": "As we migrate posts from 2021-2022, please find them here on the main openscapes.org website:\nhttps://openscapes.org/events#category=nasa-framework" }, { - "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#what-we-learned-and-challenges", - "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#what-we-learned-and-challenges", - "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", - "section": "What we learned and challenges", - "text": "What we learned and challenges\nThe Openscapes Champions provides a space for teams to come together to learn from each other and across teams. It is a way to collaborate and distribute leadership roles across the various teams, helping to reduce the burden team leaders often feel of needing to learn everything first before teaching it to the rest of the team. \nHere are the highlights of the third Champions Cohort:\n\nScience teams were using data across DAACs - more this year than ever! It felt great to demonstrate the same earthaccess workflows with datasets from different DAACs.\nEveryone had less capacity to engage this year - both from the Mentors’ side and Champions side. We saw less activity between sessions on Slack and in Coworking. This could in part be video conferencing fatigue, but also might highlight the benefit of people (Mentors + Champions) having additional time outside of the normal five calls to experiment, ask questions, and develop. This kind of engagement has led to useful development in the past (refer to next bullet).\nPast Champions Cohorts have resulted in useful developments, including the earthaccess Python library and MATLAB integration in the Hub. This year, emerging development is around “how to talk to your institution’s IT about your cloud needs” and NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) data access. More to come!\nWe had a lot of “new” content added from what we learned in the last year (Hub storage in S3 buckets, computing concepts, psychological safety!). This meant that we spent less time on core open science skills & practices that we do in the Core Champions Lesson Series (https://openscapes.github.io/series). These core open science skills & practices can help people feel confident and willing to share needs.\nFeedback from participants was valuable:\n\n“Openscapes has allowed me to see that working in Python and in the Cloud is not as scary as I once thought it was. I hope to collaborate more with others that are already using cloud computing so I can get my feet wet in some publishable research using S3 buckets. Where before I would not have thought that I could be a viable contributor.”\n“I used to think that cloud computing was for parallelizing processes and when you needed a really fast computer. I never thought about its ability to store data in a format that is easily accessed for VERY large data sets. I wish that more people in fisheries would start thinking about how their data could be stored in multidimensional arrays rather than flat data frames.”\n“Many people have great ideas but facilitators often have to work to get those ideas out into the open and the same method of getting those ideas out will NOT work on everyone. So, if you care about progress you should care about using multiple avenues to allow people to express themselves.”\n\n\nSeveral challenges working with NASA Earthdata in the Cloud are still unresolved, many which apply more broadly than just NASA data and rather to user adoption of the cloud computing technology in general. These include: \n\nWhile Aronne Merrelli’s story was inspiring, Champions reflected that they find it hard to think about projects that would be good for the Cloud when they have no experience using the Cloud – so how can you find a project to move to the Cloud when your brain won’t let you go there in the first place?\nCost - we still need to have and communicate a better sense of this. We intentionally do not have the “how much does it cost” conversation early on because our intention is to help people experience what it involves and first think about “when to cloud.” However, we do have cost numbers from previous years and plan to gather more cost statistics for the upcoming ESIP summer meeting.\nWe need to think about storage differently in the Cloud because users pay daily to store data in the Cloud. Champions commented that they often “over-produce” files because storage is cheap and access is easy on local machines. How do we learn what is really important and what we can “toss”?\nFolks had interest in learning more about working with confidential data in the Cloud, as researchers often combine non-NASA data for their analyses and this is expected to be an increasing need.\nSeveral themes/questions recurred that we have heard before and for which remain as open questions. Importantly, Amazon Web Services (AWS) Cloud onboarding, when to use what resources, how to set them up, and how to discuss needs with organizational leadership and IT staff, often falls outside the scope of NASA DAACs, yet it’s a key element of helping users adopt the Cloud and use NASA data in the Cloud. It is encouraging to hear some of the champions starting to have conversations with their institutions, IT departments, and making their needs known, which is likely a big part of the solution, too.\n\n\n\n\n\n\nFigure by Alexis Hunzinger showing the focus of cloud for data storage and compute. This figure was also used to frame the EDMW-EarthData-Workshop-2024 taught by the NOAA Coastwatch Champions team." + "objectID": "news/2023-10-17-matlab-on-openscapes/index.html", + "href": "news/2023-10-17-matlab-on-openscapes/index.html", + "title": "MATLAB on Openscapes", + "section": "", + "text": "Lisa Kempler works at MathWorks as a Research and Geoscience Strategist. She supports research and educator communities seeking to integrate their platforms with software tools and resources that enable effective data access, computing, and results sharing and publishing. She regularly meets with research communities, including site developers and users of data and compute services, developing programs and working with teams to provide implementation and user support. Lisa attended Brown University, Boston University, and Northeastern University.\nQuick links:\nMore and more data is being made available for users on NASA’s Earthdata Cloud platform. NASA Openscapes collaborates with a community of user-support staff across ten of the NASA Earth science Distributed Active Archives (DAACs), with the aim to help researchers transition their computational workflows to the Cloud using NASA Earthdata.\nThrough the NASA Openscapes Champions, an annual program that supports cohorts of science teams, a number of researchers expressed interest in using the data hosted on NASA Earthdata with MATLAB. The initial NASA Openscapes’ JupyterHub platform hosted by 2i2c, and tutorials, were Python-based. However, to make this transition, users need to be able to use software tools that are familiar to them that enable access to the data and can process it. The NASA Openscapes team reached out to MathWorks, developers of MATLAB, to support the effort to integrate MATLAB into NASA Openscapes JupyterHub and tutorials. The goal was to enable direct Cloud data access from MATLAB.\nTogether, our two teams have successfully installed MATLAB on NASA Openscapes JupyterHub, visible in the screenshot below. It is now available for researchers participating in NASA Openscapes affiliated learning events to try out with Earthdata data. Researchers will “bring their own license” (BYOL) and will be prompted to input that information to access MATLAB.\nThe MATLAB implementation on Openscapes JupyterHub consists of\nIn addition, we’ve written a detailed tutorial to help users learn the system and process the data. The MATLAB tutorial from NASA Openscapes includes code examples, that cover:\nIt’s new to work with NASA Earthdata on the NASA Openscapes JupyterHub, and even newer with MATLAB! We are excited that teams participating in the 2022 and 2023 NASA Openscapes Champions program are already logging into Openscapes and using MATLAB on the platform and continuing to push forward NASA Earthdata Cloud access through MATLAB. We will share more results on this work at the upcoming American Geophysical Union Fall Meeting on Tuesday, December 12. If you are interested in this work, please get in touch (lisak@mathworks.com).\nTo learn more about using MATLAB with data on NASA Openscapes, watch the video presentation to the NASA Openscapes Mentors or read the MATLAB Tutorial.\nAcknowledgements: A special thanks to Erin Robinson of NASA Openscapes and Luis Lopez Espinosa of the National Snow and Ice Data Center (NSIDC) for their collaboration on the NASA Openscapes MATLAB implementation and their contributions to this blog post." }, { - "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#team-pathways-and-cloud-momentum", - "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#team-pathways-and-cloud-momentum", - "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", - "section": "Team Pathways and Cloud Momentum", - "text": "Team Pathways and Cloud Momentum\nPart of the Openscapes Champions approach is that teams decide what to work on. The teams devoted at least 8 hours a month to focus on their workflows, learning, and collaborating within and across their teams. During this time, they thought through and discussed their current NASA Earthdata workflows and planned and experimented with transitioning their workflows to the Cloud using Openscapes’ 2i2c-hosted Jupyter Hub as a first step. As in other Openscapes Champions cohorts, teams also realized the power of Open Science and that open is a spectrum that includes considering future us - potentially just you or your group in 3 months. \n“Fledging” was a big theme this year, especially following Aronne Merrelli’s talk. We think of this as where do researchers go to do their real science, when they leave the Openscapes 2i2c Hub for experimental purposes? What do they need to know in terms of cost estimates, docker images, administrative personnel (potentially both technical and policy)? We saw teams and the NASA DAAC mentors make substantial progress in migrating workflows to the Cloud. A few highlights from teams that participated in the cohort included:\n\n\nThe Ocean Science Analytics team experimented with and found ‎earthaccess to be insightful and useful! This was valuable as a hands-on activity. The team members have questions about setting up AWS on their own and would like to understand what tools are needed for a specific task. For example, when could dask, an open-source Python library for parallel computing, be used for a task or would another tool be more appropriate?\nThe NOAA IEA (Integrated Ecosystem Assessment) team benefitted from having an improved conceptual understanding of what is involved with cloud workflows – they would like to work with NOAA IT to understand what’s available and possible with JupyterHubs and find workable solutions, now that we understand more of the possibilities.\nThe PACE Hackweek team found Hubs ‎very instrumental in learning cloud computing and helping to create hackweek tutorials. They have used their seaside chats for tutorial development, using GitHub, and have included people outside their team. They have gained more understanding about AWS EC2/storage service by having conversations with Science Managed Cloud Environment (SMCE) for gaining access to Open Science Studio (OSS).\nThe NOAA Coastwatch team took what they learned from the Earthdata Cloud Clinic and reused it to teach 70 colleagues from across NOAA at the NOAA Enterprise Data Management Workshop in their EDMW-EarthData-Workshop-2024. They taught the same tutorials twice, first in Python using earthaccess and then in R using earthdatalogin.\nThe Wimberly Lab Team shared their pathway with a bridge metaphor and how they are tackling challenges through talking about this in lab meetings and learning new tools together. \nAsynchronously, Lucas Barbedo from the Liu-Zhang team shared about using NASA PACE data [comment + thread] in the 2i2c JupyterHub following the Earthdata Cloud Clinic, and shared progress through a GitHub discussion: What’s happening on the NASA Openscapes Hub!? . \n\n\n\n\nFigure by Wimberly Lab (Yusuf Jamal) showing the teams’ pathway with a bridge metaphor. \n\n\nAdditional Cloud resources shared from the NOAA Enterprise Data Management Workshop\n\nhttps://guide.cloudnativegeo.org/\nhttps://abarciauskas-bgse.github.io/presentations/noaa-edmw-intro-2024‎\nhttps://projectpythia.org/dask-cookbook/" + "objectID": "news/2023-10-17-matlab-on-openscapes/index.html#footnotes", + "href": "news/2023-10-17-matlab-on-openscapes/index.html#footnotes", + "title": "MATLAB on Openscapes", + "section": "Footnotes", + "text": "Footnotes\n\n\nMany universities and research institutes have site-wide licenses for MATLAB – called “Campus-Wide Licenses” and “Institute-Wide Licenses”, respectively. Most universities in the U.S. and Canada have CWLs. In those cases, all researchers, faculty and students have access to a MATLAB license via their institutions that work in this BYOL setup. Check with your university system administrators to find out if you have access to a MATLAB license at your institution.↩︎" }, { - "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#onward", - "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#onward", - "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", - "section": "Onward!", - "text": "Onward!\nIf the 2024 NASA Openscapes Champions Cohort is any indication, the NASA Earthdata community is making substantial strides in building capacity to use cloud resources, and the transition is successfully happening. Although the cohort is officially over, these teams are just at their beginning, and we are excited to follow their results as they experiment with parallelizing code and incorporating storage considerations in their workflows. We plan to continue to work with them in the next year, as their 2i2c managed cloud Hub access continues. As we did last year, we are planning to offer the Carpentries Instructor Training for interested Champions this summer. The Carpentries is a nonprofit that teaches introductory coding skills around the world. Instructor Training is not coding-specific, but it is an educational approach to teaching technical topics. As part of our NASA grant, we have partnered with The Carpentries and are excited to extend this opportunity to Champions because many of them mentioned wanting to contribute more to open science efforts going forward.\nWe are grateful to this Champion Cohort for their early adopter spirit, their time and effort to make this migration, and all the feedback and input they provided. They all participated in this cohort, knowing that while this was the third Cohort, they were among the first research teams to use NASA Earthdata in the Cloud. What they learned and shared will make it easier for subsequent teams to make this same shift. Many teams articulated this spirit of open leadership, explicitly asking how they could help other teams. We also learned so much from this cohort, which will help us refine the NASA Openscapes Champions program, as we plan for our next cohort and our work with the DAAC mentors in the future years of our project." + "objectID": "news/2024-02-20-github-calendaring/index.html", + "href": "news/2024-02-20-github-calendaring/index.html", + "title": "Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "", + "text": "Date: Tuesday, February 20, 2024\nTime: 10:00 - 11:00 am PT (find your local time)\nWhere: Zoom\nRegister (free) via Zoom to get the meeting link\nNASA Openscapes Mentors develop, teach, and support many workshops, events, conversations, and each other with their main goal to support scientists using NASA Earthdata as they migrate workflows to the cloud. We all want (need!) to be able to see ongoing NASA Openscapes events and relevant events across 11 NASA data centers, their planning status, and where they fit in our calendars. We need something that is lightweight with a low barrier to entry. Sure, there are many add-ons to make it more “functional” (GitHub templates, Actions), but for whom? These might be barriers to people less familiar with GitHub.\nWe embrace working in the open and sharing how-we-work early before trying to make something “perfect” that doesn’t suit people’s needs. Join us for a screenshare-and-tell of how we’re using GitHub Issues, Projects, and Roadmap to have an open, dynamic way for many people to use and contribute to this “calendar”. It’s not just about the tools though. We’ll talk about how it started, how it’s going, the mindset, skills, and how we document as we go.\nBring your questions and your experiences. We’re keen to hear about how others have done this and how we can improve our setup. We always save time for audience discussion!\nSpeakers will include Bri Lind, a Geospatial Data Scientist at NASA’s Land Processes Distributed Active Archive Center (LP DAAC) and a NASA Openscapes Mentor, Stefanie Butland from the Openscapes team, and staff from other NASA data centers who are trying out this approach." }, { - "objectID": "news/2024-07-24-2024-nasa-champions-cohort/index.html#about-the-nasa-openscapes-champions-teams", - "href": "news/2024-07-24-2024-nasa-champions-cohort/index.html#about-the-nasa-openscapes-champions-teams", - "title": "NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud", - "section": "About the NASA Openscapes Champions Teams", - "text": "About the NASA Openscapes Champions Teams\nThe Liu-Zhang (University of Louisiana at Lafayette & University of Southern Mississippi) team primarily uses NASA Earthdata Search to access datasets from Earth Surface Mineral Dust Source Investigation (EMIT) and The ECOsystem Spaceborne Thermal Radiometer Experiment on Space Station (ECOSTRESS) missions, which we then use to create algorithms for ecosystem analysis. We have a particular interest in using hyperspectral data, such as the upcoming PACE data to study vegetation and algae in water bodies. Our work involves developing deep learning models for habitat classification and analyzing water quality. Transitioning to hyperspectral imaging and deep learning greatly increases computational demands, making it challenging to execute code locally compared to leveraging cloud computing resources. Additionally, this transition enhances the accessibility of our algorithm to the public. Currently funded by EMIT and serving as early adopters of PACE, we are eager to contribute to the NASA Cookbook by offering new algorithms that apply to NASA’s latest satellite data, such as EMIT and PACE.\nThe Ocean Science Analytics team incorporates NASA data in our studies of coastal and offshore marine regions, specifically as it pertains to marine mammals. Combining in situ data from hydrophones to determine the vocal occurrence of marine mammals with remotely sensed ocean color data, we use chlorophyll, net primary productivity, sea surface temperature, etc. to characterize the associated habitat and document changes over time. As a PACE early adopter, we are incorporating PACE data in our studies through large scale observations of photosynthesizing organisms, which will allow us to incorporate direct measurements of the presence and distributions of plankton species. This in connection with feeding behavior will provide a better understanding of the spatial use of these habitats.\nThe PACE Hackweek team supports the NASA PACE mission, which launched in February 2024 and is collecting unprecedented data from our global oceans, atmosphere, and land. PACE data will be hosted in the Cloud; therefore, we are interested in learning more about cloud-based workflows to access and analyze PACE data and contribute our efforts and outcomes to our community of end-users.\nThe NOAA CoastWatch team is motivated by how rising ocean temperatures, higher sea levels, melting ice, and increasing ocean acidity are changing the way marine life and ecosystems function in our world’s oceans. This affects everything from how we manage fisheries and protect communities that depend on fishing to how we protect important habitats and species. The ocean is expected to continue changing and changes are expected to become more extreme. A lot is at stake. Improving how we use Earth data in our workflows is essential. We have much we can learn about migrating to the Cloud by connecting with other earth science teams at NASA and with the NASA Openscapes mentors.\nThe Wimberly Lab (University of Oklahoma) team explores the impacts of changing climate and landscapes on ecosystems and human health, with an emphasis on developing spatial decision support tools to support public health decisions, land use planning, and natural resource management. We address these topics through landscape, regional, and global analyses using satellite remote sensing and other sources of environmental monitoring data. Specific research areas include the effects of environmental change on vector-borne disease outbreaks, the influences of human land use and wildfires on forest landscape dynamics, the impacts of agricultural expansion and intensification on native ecosystems, and the development of computer software for disease outbreak forecasting and landscape change modeling. We conduct our research in locations throughout the world including North America, West Africa, Ethiopia, and India.\nThe NOAA IEA team’s approach provides cross-disciplinary science to support ecosystem-based management in the Gulf of Mexico. For example, we conduct research on climate-fisheries interactions, changes in species ranges and distributions, and environmental impacts on fisheries such as those driven by harmful algal blooms. We use data from earth system modeling and remotely sensed data, including sea surface temperature, sea surface height, ocean currents, wind, ocean color, salinity, dissolved oxygen, and primary production indices. We are particularly interested in integrating modern open-science techniques to automate our core deliverables, called Ecosystem Status Reports, and other data products related to NOAA surveys. We’re beginning to test some of these approaches in ongoing projects. For example, the ongoing IEA-Wind project aims to develop data baselines to track the impacts of forthcoming offshore wind energy infrastructure development. The project has been conceptualized and executed thus far with an open-data approach. We believe that a deeper understanding of the concepts and approaches offered by this Cohort would allow for a more holistic application across Gulf of Mexico IEA efforts. \nThe NASA SERVIR Central America team are representatives of Costa Rica’s National System of Conservation Areas (SINAC, in Spanish), the Forest Research and Services Institute of the National University of Costa Rica, and the Central America Aerospace Network (RAC, in Spanish). The NASA / USAID SERVIR program is helping to connect the Costa Rican researchers with Openscapes. The team is responsible for generating Costa Rica’s official national forest cover maps, in the context of its national forest monitoring system. Therefore, involving the team will have a notable national impact in terms of their reporting to international commitments (e.g., the United Nations Convention on Biological Diversity (CBD), the United Nations Convention to Combat Desertification (UNCCD), the United Nations Framework Convention on Climate Change (UNFCCC), and Sustainable Development Goals (SDG) 15.2). The team is currently using Google Earth Engine (GEE) to access and process data from Sentinel-1 (SAR) and Sentinel-2 (optical). They combine these datasets and perform a supervised classification to generate land cover maps. While the team’s workflow is already in the Cloud (via GEE), they are interested in exploring additional computational capabilities that may be available via AWS for processing big data, including the inclusion of other datasets like that of the Landsat archive.\nThe POSTECH (University South Korea) team is actively engaged in climate modeling research, utilizing both Python and NCAR Command Language (NCL) scripts to analyze climate data. We are eager to expand our knowledge and skills by collaborating with experts in the field, and we are keen to explore new methodologies and insights. Joining your team presents an exciting opportunity for us to enhance our expertise and broaden our exposure to cutting-edge techniques in climate science.\nDisclaimer: Any use of trade, firm, or product names is for descriptive purposes only and does not imply endorsement by the U.S. Government.\nReference herein to any specific commercial product, process, or service by trade name, trademark, manufacturer, or otherwise, does not constitute or imply its endorsement by the United States Government or the Jet Propulsion Laboratory, California Institute of Technology." + "objectID": "news/2024-02-20-github-calendaring/index.html#background-and-resources", + "href": "news/2024-02-20-github-calendaring/index.html#background-and-resources", + "title": "Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "Background and Resources", + "text": "Background and Resources\nStarter documentation in our NASA Earthdata Cloud Cookbook: GitHub for Calendaring and Project Management\nRead more on our blog about how we work with NASA Openscapes Mentors to support scientists using data from NASA Earthdata as they migrate workflows to the cloud.\nRelated CSCCE Open Source Tools Trials:\n\nUsing GitHub to facilitate community activities\nGitHub and Bitergia to support research and developer communities\nUsing GitHub and HedgeDoc to organize and support community events\n\n\n\n\n\n\nMainPlanning GitHub Project - Roadmap Schedule view" }, { - "objectID": "news/2023-12-08-coiled-community-call/index.html", - "href": "news/2023-12-08-coiled-community-call/index.html", - "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", + "objectID": "news/2024-02-28-github-community-call/index.html", + "href": "news/2024-02-28-github-community-call/index.html", + "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", "section": "", - "text": "Quicklinks\nOur 9th Openscapes Community Call featured NASA Openscapes Mentors and the Coiled team demoing approaches to supporting researchers using NASA Earthdata in the Cloud. This built from a previous demo at the National Snow and Ice Data Center User Working Group that presented different Cloud Environment Opportunities to meet users where they are (blog post).\nGoing to AGU 2023? Come say hi to the Coiled team at their booth (right at the entrance next to Google)" - }, - { - "objectID": "news/2023-12-08-coiled-community-call/index.html#background", - "href": "news/2023-12-08-coiled-community-call/index.html#background", - "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", - "section": "Background", - "text": "Background\nNASA Openscapes is a project and community supporting researchers using NASA Earthdata in the Cloud. This community call welcomed our speakers Amy Steiker, Luis Lopez, and Andy Barrett from the National Snow and Ice Data Center (NSIDC) who are NASA Openscapes Mentors, and James Bourbeau from Coiled who is collaborating with NASA Openscapes Mentors and Champions science teams. \nWe followed the Liberating Structures What? So What? Now What? format, with silent journal prompts for reflections and 15 mins of Q&A from questions in chat." + "text": "Quicklinks\nOur 10th Openscapes Community Call was a screenshare-and-tell of how we’re using GitHub Issues, Projects, and the new Roadmap feature to have an open, dynamic way for many people to use and contribute to a “calendar”. We embrace working in the open and sharing how-we-work early before trying to make something “perfect” that doesn’t suit people’s needs so we were grateful for questions and suggestions from participants! Presented by Bri Lind, a Geospatial Data Scientist at NASA’s Land Processes Distributed Active Archive Center (LP DAAC) and a NASA Openscapes Mentor and Stefanie Butland Openscapes team member." }, { - "objectID": "news/2023-12-08-coiled-community-call/index.html#easy-scalable-cloud-computing-with-coiled", - "href": "news/2023-12-08-coiled-community-call/index.html#easy-scalable-cloud-computing-with-coiled", - "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", - "section": "Easy Scalable Cloud Computing with Coiled", - "text": "Easy Scalable Cloud Computing with Coiled\nThe call started with a few demos, first from Andy Barrett and Amy Steiker from NSIDC. Andy shared a science use case based on translating photons measurements from ICESAT-2 to sea ice thickness. These data were first accessed with the earthaccess Python library, then needed to be regridded over geographic areas, which Amy demoed in this Jupyter notebook. Amy ran this code on her laptop and used Coiled to spin up remote virtual machines (VMs) in the cloud to run her computations.\n\n\n\nThen, James ran through two common workflows that process terabyte-scale cloud datasets. In the first example, we saw how to churn through many cloud-hosted NASA Earthdata files (~500 GB of NetCDF files) in parallel on the cloud. This involved lightly decorating an existing Python function with the Coiled Function decorator. The entire workflow ran in <10 minutes and cost ~$0.36.\nIn the next example, we used Xarray to process 6 TB of the cloud-hosted NOAA water model where we computed the average water table depth for each county in the US for the year 2020. We parallelized and distributed the work across 50 VMs using a Coiled cluster. The workflow ran in < 5 minutes and cost ~$1.\n\n\n\nLuis commented on how cloud computing is a barrier for many teams, but tools like Coiled provide options for working in the cloud easily. In fact, Coiled is just half the magic (provisioning cloud resources); the rest is the open source packages, which together help science move faster." + "objectID": "news/2024-02-28-github-community-call/index.html#how-do-we-know-what-were-doing-together-and-when-were-doing-it", + "href": "news/2024-02-28-github-community-call/index.html#how-do-we-know-what-were-doing-together-and-when-were-doing-it", + "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "How do we know what we’re doing together and when we’re doing it?", + "text": "How do we know what we’re doing together and when we’re doing it?\nNASA Openscapes Mentors develop, teach, and support many conference workshops, webinars, and participate in project hackdays with their main goal being to support scientists using NASA Earthdata as they migrate their workflows to the cloud. Bri set the stage with our motivation. People working across 11 NASA data centers (DAACs) need a way to see a year’s worth of “who’s here; what are we doing; when are we doing it; where can we find overlap with each other?” The work requires advance planning, and we’d love to avoid having everyone need to separately look up the registration deadlines for conferences. That can all be on a community calendar. We need a solution that is lightweight, with a low barrier to entry, and agnostic to specific calendaring software like Google Calendar vs Microsoft Outlook." }, { - "objectID": "news/2023-12-08-coiled-community-call/index.html#closing", - "href": "news/2023-12-08-coiled-community-call/index.html#closing", - "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", - "section": "Closing", - "text": "Closing\nDiscussion topics included questions about egress costs, compute time, community standards, and more. See the meeting notes for full details." + "objectID": "news/2024-02-28-github-community-call/index.html#how-were-using-github-for-calendaring-and-management", + "href": "news/2024-02-28-github-community-call/index.html#how-were-using-github-for-calendaring-and-management", + "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "How we’re using GitHub for calendaring and management", + "text": "How we’re using GitHub for calendaring and management\n\n\n“I’ve been waiting for something like this for… probably a year” - Bri Lind, NASA Land Processes data center.\n\n\nFor the past three years, we have been using GitHub as a community to collaborate around code, tutorials, and documentation, taking advantage of its features for version control, code review, and workshop book publishing. This is important not only because it helps us develop collaboratively as a team, but it’s also the same technology that Earth science researchers use, so we are able to develop practical experience to help them every day as we work. It made sense to explore using GitHub more deeply for our planning and calendaring. \nWe started using GitHub as a centralized place where any of the ~40 NASA Openscapes Mentors can post dates and information for a conference workshop they are leading, for example. Everyone else can see it, and someone might comment “I’m speaking at the same conference. I can give some hands-on help.”, or “Here’s a python notebook I created for a similar workshop last month.” During the Community Call, Stef screenshared our MainPlanning GitHub Project, the Roadmap view (screenshot below) that gives a calendar perspective and the Table view for details on each item. She demo’d creating a GitHub Issue, associating it with the Project, adding topic labels, and a Start date to have it appear in the Roadmap. She showed how we’re also documenting this as we go with screenshots in NASA Earthdata Cloud Cookbook - GitHub for Calendaring and Project Management.\n\n\n\nRoadmap view of a GitHub Project for NASA Openscapes Mentors and collaborators" }, { - "objectID": "news/2023-12-08-coiled-community-call/index.html#resources", - "href": "news/2023-12-08-coiled-community-call/index.html#resources", - "title": "Openscapes Community Call: NASA Earthdata Cloud with Coiled", - "section": "Resources", - "text": "Resources\n\nGeospatial Cloud Resources from Coiled\nProcessing Terabyte-Scale NASA Cloud Datasets with Coiled \nProcessing a 250 TB dataset with Coiled, Dask, and Xarray \nCloud Environment Opportunities. Managed JupyterHub options for Cryosphere and NASA Earthdata user communities." + "objectID": "news/2024-02-28-github-community-call/index.html#how-nasas-lp-daac-and-emit-science-teams-are-expanding-this-approach", + "href": "news/2024-02-28-github-community-call/index.html#how-nasas-lp-daac-and-emit-science-teams-are-expanding-this-approach", + "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "How NASA’s LP DAAC and EMIT science teams are expanding this approach", + "text": "How NASA’s LP DAAC and EMIT science teams are expanding this approach\nNASA JPL’s Earth Surface Mineral Dust Source Investigation (EMIT) instrument aboard the International Space Station (ISS) uses imaging spectroscopy to detect surface mineralogy, methane gas plumes and ground surface characteristics from space. The NASA Land Processes data center works closely with the EMIT science team to distribute data and develop tutorial resources and they wanted a way to do that more fluidly. A place to strategically link meeting agendas/ notes/ tasks/ progress in a single ‘open’ location that allows individuals on both teams to be aware of progress and decisions as they are being made. The teams are using this space to do more things in the open and having fewer reasons to say “Where’s that doc? Can you email it to me?”\n\n\n\nTable view of a GitHub Project for NASA Land Processes data center and EMIT science team" }, { - "objectID": "news/2023-12-10-agu-fall-meeting/index.html", - "href": "news/2023-12-10-agu-fall-meeting/index.html", - "title": "Activities at the AGU Fall Meeting", - "section": "", - "text": "At this year’s AGU Fall Meeting Dec 11 - 15, 2023, NASA Openscapes Mentors and collaborators will be giving learning workshops, talks, posters, demos, and more. We’ll also have a Sunday Happy Hour and invite you to join us!\nOur NASA-Openscapes Planning page has up-to-date information of our activities.\nSee also the AGU Searchable Schedule.\nHave a great Fall Meeting and we hope to connect with you there.\n\n\n\nCitationBibTeX citation:@online{openscapes2023,\n author = {Openscapes, NASA},\n title = {Activities at the {AGU} {Fall} {Meeting}},\n date = {2023-12-10},\n url = {https://openscapes.org/blog/2023-12-10-agu-fall-meeting},\n langid = {en}\n}\nFor attribution, please cite this work as:\nOpenscapes, NASA. 2023. “Activities at the AGU Fall\nMeeting.” December 10, 2023. https://openscapes.org/blog/2023-12-10-agu-fall-meeting." + "objectID": "news/2024-02-28-github-community-call/index.html#dig-into-the-discussion", + "href": "news/2024-02-28-github-community-call/index.html#dig-into-the-discussion", + "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "Dig into the discussion", + "text": "Dig into the discussion\nFollowing the presentations, we had a rich discussion driven by participants’ questions. Topics included:\n\nhow to get different teams and people to ‘buy into’ a system like this; \nhow readily government agencies adopt this sort of approach with this level of transparency; \nthe importance of having something like this to support collaborations with groups that cannot access an organization’s internal Jira project management system;\nquirks people encounter while GitHub continually improves the Projects system;\n\nWe all agreed on the need to start small to build comfort for people who aren’t yet familiar with GitHub. See our shared notes doc for details of questions and tips from participants" }, { - "objectID": "news/2023-05-31-zenodo-community/index.html", - "href": "news/2023-05-31-zenodo-community/index.html", - "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", - "section": "", - "text": "We want to share our work in a way that people can find it, use it, improve it, and cite it, or get credit for their contributions. For people who have participated in our programs like Openscapes Champions1, or Pathways to Open Science2, we want a robust way to add these to their CV as professional development. For contributors to our open educational resources, like the NASA Earthdata Cloud Cookbook3, we want them to get credit and visibility. For people who want to reuse or remix a slide from a presentation, we want them to feel great about it by providing an easy way to cite the presentation. To enable all of this, we created a Zenodo Openscapes Community as a semantically meaningful group of selected research products. NASA’s Transform to Open Science (TOPS) and the Center for Scientific Collaboration and Community Engagement’s (CSCCE) Zenodo Communities were inspirations for ours.\nZenodo is a general-purpose open repository that allows researchers to deposit research related digital artefacts like research papers, data sets, research software, reports, lesson materials, and presentations. For each submission, a persistent digital object identifier (DOI) is minted, which makes the stored items easily citable (adapted from Wikipedia). Zenodo allows for versioning and we can preserve GitHub repositories in Zenodo too (GitHub itself is not a repository!).\n\n\n\n\n\n\n\n\nThe Openscapes Approach Guide gives instructions for our use cases, with pointers for things that might not be obvious to a first-time user.\n\nWhat do we curate in our Zenodo Openscapes Community?\nHow to add your existing Zenodo record to the Zenodo Openscapes Community\nHow to publish a new record in Zenodo to get a DOI\nHow to get a DOI for materials on GitHub\nHow to cite Openscapes publications\n\n\n\n\nOf course I want credit for my contributions! When we add an author’s ORCID ID to a Zenodo record, their ORCID profile is automatically updated. I learned of this bonus when I uploaded a post on which I’m a co-author, and then received email notification that this record had been added to my ORCID profile. Why is this so cool? An ORCID ID is a unique, open digital identifier that distinguishes you from every other researcher with the same or a similar name to you. My ORCID profile is a bit like a CV. I use it to collect my research publications (not limited to peer reviewed papers) along with things like education and service on boards. Having it automatically updated is great.\n\n\n\n\n\n\n\nAssociating a Zenodo record with an author’s ORCID ID results in that record being automatically listed in their ORCID profile.\n\n\nWant to create a Zenodo Community? Play in the Sandbox first, where anyone can create and refine a draft Community before publishing it in Zenodo. Creating a Sandbox version forced me to recognize decisions to make before creating the real thing, like: needing to create it from an account that looks professional like “curator”, rather than my personal email username; or deciding what types of research products to include or exclude. This webinar section “How to create a community” screenshares a walk-through that makes things crystal clear." + "objectID": "news/2024-02-28-github-community-call/index.html#related-resources", + "href": "news/2024-02-28-github-community-call/index.html#related-resources", + "title": "Openscapes Community Call: GitHub for NASA Openscapes community calendaring & project management", + "section": "Related Resources", + "text": "Related Resources\n\nNASA Earthdata Cloud Cookbook developed by NASA Openscapes Mentors\nOpenscapes GitHub Clinics \nCSCCE Open Source Tools Trials:\n\nUsing GitHub to facilitate community activities\nGitHub and Bitergia to support research and developer communities\nUsing GitHub and HedgeDoc to organize and support community events" }, { - "objectID": "news/2023-05-31-zenodo-community/index.html#our-use-cases", - "href": "news/2023-05-31-zenodo-community/index.html#our-use-cases", - "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", + "objectID": "news/2022-05-12-nasa-2022-champions/index.html", + "href": "news/2022-05-12-nasa-2022-champions/index.html", + "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", "section": "", - "text": "The Openscapes Approach Guide gives instructions for our use cases, with pointers for things that might not be obvious to a first-time user.\n\nWhat do we curate in our Zenodo Openscapes Community?\nHow to add your existing Zenodo record to the Zenodo Openscapes Community\nHow to publish a new record in Zenodo to get a DOI\nHow to get a DOI for materials on GitHub\nHow to cite Openscapes publications" + "text": "In Spring 2022 we led our first NASA Openscapes Champions Cohort for research teams that work with NASA EarthData. This cohort is funded by NASA and part of our NASA Openscapes Framework project. For this Cohort, we co-led the cohort with the NASA DAAC mentors and we focused on shifting toward Open science, collaborative, reproducible practices to support research teams as they transition from the download model to the Cloud. We also actively experimented with cloud data access through the Openscapes 2i2c-hosted JupyterHub.\nQuick links:" }, { - "objectID": "news/2023-05-31-zenodo-community/index.html#bonus-things-i-learned", - "href": "news/2023-05-31-zenodo-community/index.html#bonus-things-i-learned", - "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", - "section": "", - "text": "Of course I want credit for my contributions! When we add an author’s ORCID ID to a Zenodo record, their ORCID profile is automatically updated. I learned of this bonus when I uploaded a post on which I’m a co-author, and then received email notification that this record had been added to my ORCID profile. Why is this so cool? An ORCID ID is a unique, open digital identifier that distinguishes you from every other researcher with the same or a similar name to you. My ORCID profile is a bit like a CV. I use it to collect my research publications (not limited to peer reviewed papers) along with things like education and service on boards. Having it automatically updated is great.\n\n\n\n\n\n\n\nAssociating a Zenodo record with an author’s ORCID ID results in that record being automatically listed in their ORCID profile.\n\n\nWant to create a Zenodo Community? Play in the Sandbox first, where anyone can create and refine a draft Community before publishing it in Zenodo. Creating a Sandbox version forced me to recognize decisions to make before creating the real thing, like: needing to create it from an account that looks professional like “curator”, rather than my personal email username; or deciding what types of research products to include or exclude. This webinar section “How to create a community” screenshares a walk-through that makes things crystal clear." + "objectID": "news/2022-05-12-nasa-2022-champions/index.html#nasa-champions-cohort-overview", + "href": "news/2022-05-12-nasa-2022-champions/index.html#nasa-champions-cohort-overview", + "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", + "section": "NASA Champions Cohort overview", + "text": "NASA Champions Cohort overview\nThe NASA Openscapes Framework project is a 3-year project to support scientists using NASA Earthdata from NASA’s Earth Observing System Data and Information System (EOSDIS) Distributed Active Archive Centers (DAACs), as they migrate workflows to the cloud. We are just wrapping up Year 1 and amazed at how much we have collectively accomplished this year with the DAAC mentors and participating DAACs as well as all the researchers and research teams we have worked with. You can read more about our first year in our 2021 annual report. \nAs part of this work, with the DAAC mentors, we co-led our first NASA Openscapes Champions cohort. Based on Openscapes’ flagship program, Openscapes Champions, theNASA Openscapes Champions Cohort was a professional development and mentorship opportunity for early adopter, science teams that use NASA Earthdata and were interested in migrating their existing workflows to the cloud through collaborative open data science practices. The Openscapes Champions Cohort ran formally in March - April 2022. \nThe ten research teams who participated were interested in a wide variety of NASA Earthdata and various stages of cloud technology familiarity. You can learn more about their research below. Together as a Champions cohort they discussed what worked and didn’t work as they migrated workflows to the cloud, with a focus on collaboration and open science. We met as a cohort five times over two months, on alternating Fridays. Each cohort call included a welcome and code of conduct reminder, two teaching sessions with time for reflection in small groups or silent journaling and group discussion, before closing with suggestions for future team meeting topics (“Seaside Chats”), Efficiency Tips, and Inclusion Tips. Additional hands-on clinics and coworking sessions were scheduled within this period and will extend for the next two months to support these teams as they continue to work on the cloud workflow migration. In addition, the teams were supported by the Openscapes DAAC mentors and staff and Element84 and had access to Openscapes’ 2i2c Jupyter Hub, which will continue for the next year.\n\n\n\nZoomie class photo of NASA Champions" }, { - "objectID": "news/2023-05-31-zenodo-community/index.html#footnotes", - "href": "news/2023-05-31-zenodo-community/index.html#footnotes", - "title": "New Zenodo Openscapes Community helps you Find and Cite Openscapes things", - "section": "Footnotes", - "text": "Footnotes\n\n\nJulia Stewart Lowndes & Erin Robinson. (2022). Openscapes Champions Lesson Series (2022.12). Zenodo. https://doi.org/10.5281/zenodo.7407247↩︎\nIleana Fenwick & Julia Stewart Lowndes. (2023). Pathways to Open Science (2023.02). Zenodo. https://doi.org/10.5281/zenodo.7662700↩︎\nAndy Barrett, Chris Battisto, Brandon Bottomley, Aaron Friesz, Alexis Hunzinger, Mahsa Jami, Alex Lewandowski, Bri Lind, Luis López, Jack McNelis, Cassie Nickles, Catalina Oaida Taglialatela, Celia Ou, Brianna Pagán, Sargent Shriver, Amy Steiker, Michele Thornton, Makhan Virdi, Jessica Nicole Welch, Erin Robinson, Julia Stewart Lowndes. (2023). NASA EarthData Cloud Cookbook (2023.03). Zenodo. https://doi.org/10.5281/zenodo.7786711↩︎" + "objectID": "news/2022-05-12-nasa-2022-champions/index.html#what-did-participants-achieve", + "href": "news/2022-05-12-nasa-2022-champions/index.html#what-did-participants-achieve", + "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", + "section": "What did participants achieve?", + "text": "What did participants achieve?\nJust like our DAAC mentors have built collaborative bridges across the distributed data centers to identify the common parts of cloud data access over the first year of our project, this cohort was an opportunity to connect NASA Earthdata users, building a community that is eager to use data in the cloud and provides a forum to discuss common techniques and challenges. The teams devoted at least 8 hours a month to focus on their workflows. In this time, they thought through and discussed their current NASA Earthdata workflows and planned and experimented with transitioning their workflows to the cloud using Openscapes’ 2i2c-hosted Jupyter Hub as a first step. As in other Openscapes Champions cohorts, teams also realized the power of onboarding to create more resilient labs and they explored creating collaborative spaces for their teams through Google Drive, Slack, and GitHub. \nThemes we revisited throughout the cohort included: \nThe Open science underpinnings of the Openscapes Champions program are important. During our last Champions session when the teams presented their pathways, it was amazing to hear how many times that teams were trying to use Github, Gitlab, or taking away other Open science practices in addition to the cloud-specific. It wasn’t all or nothing, they were taking small steps. It was also great to hear that a takeaway from this cohort is, working more openly and reproducibly provides for a more resilient workflow and team. \nWe intentionally focus on providing a kind welcome to technical topics. The kind space that we co-created with the teams and DAAC mentors provided an opportunity to collaborate as teams and ask questions that may in other settings go unasked because of fear that everyone else already knows. (Note: everyone else doesn’t know and will be glad you asked!)   \nThis also led to several challenges that consistently surfaced and still need more focused effort to resolve. The vocabulary to understand the Cloud needs to be clearly explained. For example, what is an S3 bucket or a “requester pays bucket” and why does a user need to know about AWS West-2? Cloud cost is another challenge. We lower the barrier by providing the 2i2c Jupyterhub, but teams don’t want to depend on our hub. They want their own workspace and want to be able to predict costs more effectively. Finally, our work has been focused on Python because that was the language of choice for DAAC mentors and it is a widely used open-source language in the broader Earth science community. In the Champions Cohort we had three teams using Matlab and one team using R; we need to think about how to expand our support and tutorial materials for these other languages." }, { - "objectID": "news/2023-05-11-pathway-cloud-computing/index.html", - "href": "news/2023-05-11-pathway-cloud-computing/index.html", - "title": "Introducing pathway of cloud computing to the NASA user community", - "section": "", - "text": "This post is by Xiaohua Pan, from NASA GSFC/Goddard Earth Sciences Data and Information Services Center (GES DISC). Pan participated in the 2021 Cloud Hackathon, led by NASA Data Center (DAAC) staff who are part of the NASA Openscapes Mentor community. Following this first hands-on introduction to NASA Earthdata in the cloud, Pan continued to experiment with transitioning her workflow to the cloud. Sharing her experience through posters, talks, and here in this blog post, she is a research scientist, a data curator, and a bridge-builder between data centers and the user community.\nQuick links" + "objectID": "news/2022-05-12-nasa-2022-champions/index.html#closing-thoughts", + "href": "news/2022-05-12-nasa-2022-champions/index.html#closing-thoughts", + "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", + "section": "Closing thoughts", + "text": "Closing thoughts\nAs we indicated at the beginning of this blog, this transition isn’t one that is completed in 2.5 months and so this is not the end for this Cohort. We are moving from the structured sessions of the Champions program into two additional months of coworking time and 1-1 interactions with DAAC mentors and staff and Element84 in order to make lasting changes with cloud data access. \nWe will focus on specific topics like: \n\nPracticing GitHub workflows and teaching others on your team \nCloud spatial subsetting \nEnvironment management for creating cloud computing space that is reproducible and scalable (e.g. docker images) \nDask/Pangeo software stack to enable scalable processing \nCloud costs and setup \nNetCDF to Zarr\nDocker containers \n\nFinally, we are grateful to this Champion Cohort’s early adopter spirit, their time and effort to make this migration, and all of the feedback and input they provided. They all participated in this cohort knowing that they were some of the first research teams to use NASA Earthdata in the cloud and that they were the first NASA Openscapes Champions cohort. This meant that there would be technical challenges as we work out migrating to the cloud, yet what they learn will make it easier for subsequent teams making this same shift. It also exhibited the reciprocal learning that happens; we will refine the NASA Openscapes Champions as we plan for our next cohort and our work with the DAAC mentors in year 2." }, { - "objectID": "news/2023-05-11-pathway-cloud-computing/index.html#introducing-pathway-of-cloud-computing-to-the-nasa-user-community", - "href": "news/2023-05-11-pathway-cloud-computing/index.html#introducing-pathway-of-cloud-computing-to-the-nasa-user-community", - "title": "Introducing pathway of cloud computing to the NASA user community", - "section": "Introducing Pathway of Cloud Computing to the NASA user community", - "text": "Introducing Pathway of Cloud Computing to the NASA user community\nOn May 4, 2023, Xiaohua Pan, Christopher Battisto, and Nicholas Lenssen (GES DISC) gave a presentation titled “Pathway Finder of Cloud Computing using NASA Resources: A Case Study of Characterizing Wildfires in Western U.S.,“ hosted by the NASA GSFC Ocean Ecology Lab.\nIn brief, the main purpose of this presentation will be to share with the broad NASA user communities what cloud computing looks like and what the benefits of cloud computing are for an interdisciplinary study. We also share the lessons and challenges learned from this case study. By the way, this talk IS for cloud novices, NOT for cloud gurus.\n\n\n\nTitle slide from the presentation by Pan et al.\n\n\nThis presentation aims to inform and educate the NASA user community on cloud data and cloud computing. They shared the pathways, benefits, and roadblocks to cloud computing using an interdisciplinary case study and live demos of various cloud-accessing scenarios done in a JupyterHub that is part of the NASA Openscapes project managed by 2i2c.\n\n\n\nOutline of the presentation by Pan et al.\n\n\nXiaohua also shared her journal from a scientist doing her research with all on-premises data to a pathfinder conducting her wildfire research in the cloud to shed some light on others to find their journeys to the cloud. Finally, she emphasized the importance of cloud training gained through openscapes as a DAAC staff. This presentation reached about 70 people from NASA earth science divisions and universities. It was well received, with many questions and positive feedback, reflecting the interest and puzzlement of the NASA user community on cloud data and cloud computing.\n\n\n\nInterdisciplinary case study of characterizing wildfires in the western US, from the presentation by Pan et al.\n\n\nXiaohua Pan:\nDr. Pan joined Goddard Earth Sciences Data and Information Services Center (GES DISC) at NASA GSFC in 2020 as a senior scientific software developer, working on data services including curating NASA’s earth data (e.g., MERRA-2) and user support. She also actively writes scientific articles and data recipes, and interacts with data user communities. She had worked on understanding the interaction of air pollution with climate using models and satellite observations in the NASA GSFC Atmospheric Chemistry and Dynamics Laboratory as a research scientist during 2009-2020, and as a NASA NPP postdoc fellow during 2013-2015. Dr. Pan received her Ph.D. majoring in Climate Dynamics in 2009 from George Mason University.\nChris Battisto:\nChris Battisto is an AWS Certified Solutions Architect and Scientific Software Developer at GES DISC since 2021. Chris is part of the User Needs team, and assists in creating tutorials and resources for users who wish to access GES DISC data using programming tools, such as Python, or for training staff and users on cloud resources. Chris has a background in atmospheric science, and received his M.S. in Geography from Northern Illinois University in 2021.\nNick Lenssen:\nNick has been a Scientific Developer at GES DISC since 2021. Nick is responsible for Level 2 subsetting services using Harmony in the cloud and is currently working on onboarding more datasets to the subsetting service. Nick has a background in Meteorology and received his B.S in Meteorology at Florida Institute of Technology." + "objectID": "news/2022-05-12-nasa-2022-champions/index.html#nasa-openscapes-champions-teams", + "href": "news/2022-05-12-nasa-2022-champions/index.html#nasa-openscapes-champions-teams", + "title": "From downloading data to Cloud access: NASA Openscapes Champions Wrap-up", + "section": "NASA Openscapes Champions Teams", + "text": "NASA Openscapes Champions Teams\nThe Cryosphere Geophysics and Remote Sensing (CryoGARS) Glaciology Team at Boise State University analyzes modern changes to the Earth’s cryosphere, with a focus on rapid changes in glacier flow, glacier-ocean interactions, iceberg melting, and seasonal snow accumulation and melt. Nearly all of our projects use Landsat imagery to map changes in glacier, iceberg, and/or snow extent. Several projects also use Landsat data to map glacier velocities or rely on NASA-produced glacier velocities computed from Landsat and Sentinel-2 data. We also use ICESat-2 data to map glacier volume change and seasonal snow in mountain regions. We look forward to using more cloud resources so that we can expand our analyses in space and time in order to advance our understanding of Cryosphere change!\nThe Mapes Team at the University of Miami studies atmospheric dynamics through multi-source data synthesis, with global grids as the glue. The global grids are huge, so downloading is out of the question. Fetching from aggregations (THREDDS, GDS) works for case studies, but sometimes we need to process it all (simplest example: make a multi-year climatology, to give context to actual fields as “anomalies”). So the data lake in the cloud will be a nice resource, and open new vistas like machine learning which always benefits from more data.\nThe Cornillon Team at the University of Rhode Island has several projects making use of MODIS and VIIRS sea surface temperature (SST). The project of focus for this cohort has been the statistical description of the location, strength, and temporal evolution of SST fronts. As part of this project, we developed an algorithm to unmask pixels improperly flagged as cloud contaminated in the standard MODIS SST products. The improved masks will be made available to the community at large as will the fronts identified by our edge detection algorithm. \nThe Ladies of Landsat Team has members from USGS, UCSB, and the University of Arizona. Kate uses dense time series of Landsat data to build harmonic models to predict land use cover and land use change and its links to climatological signals. Crista and Sarah research the human dimensions of earth observation data, such as Landsat. Nikki uses NASA drought models to map climate hazards in her Navajo Nation community. The research project “Power of the Pixel: Connecting Indigenous Communities through Remote Sensing in the United States” combines the power of all three foci to use NASA/USGS Landsat data to build earth observation capacity in Indigenous communities across the United States.\nThe SASSIE Team has members from the University of Washington, JPL, and APL. They are part of the NASA salinity and SWOT science teams, and regularly use satellite salinity, temperature, altimetry and sea ice data, as well as in situ holdings (SPURS-2, upcoming SASSIE experiment).\nThe Tandon Team at the University of Massachusetts Dartmouth uses remotely sensed data to setup the larger scale perspectives for our more in depth analysis and cruise based work for in-situ experimental data from initiatives in the Indian Ocean such as ASIRI and MISOBOB.\nThe Palter Team at the University of Rhode Island uses NASA data to compare with in-situ observations taken from ships and Uncrewed Surface Vehicles. NASA data provides additional parameters (like ocean surface topography) that are useful in the understanding of in-situ data (for example identifying fronts in the ACC). We have also used ocean color data from MODIS-Aqua to map distributions of ocean surface properties, such as chlorophyll concentration & sea surface salinity (region-specific algorithm), to analyze seasonal, annual, and decadal trends of key biogeochemical processes in the ocean.\nThe Just Team at the Icahn School of Medicine at Mount Sinai uses earth observations to reconstruct ground-level environmental exposures to fine particulate matter, air temperature, and humidity which we use in epidemiologic health studies with cohorts and large registries in the US and Mexico. In a project that started out by seeking to understand the pattern of error in Aerosol Optical Depth (AOD) retrievals, we have developed an R-based reproducible workflow using the targets package for collocating and correcting AOD from the MAIAC algorithm (product MCD19A2 for Aqua and Terra) versus ground stations using gradient-boosted machine learning. This workflow adds reproducibility and extensibility for further development and new applications, building on results we have published for AOD (https://doi.org/10.3390/rs10050803) and for column water vapor (https://doi.org/10.5194/amt-13-4669-2020; data/code in Zenodo: 10.5281/zenodo.3568449).\nThe Hain/SPoRT Team is a directly funded NASA activity and engages with operational stakeholders to transition unique NASA observations and capabilities to improve decision-making.\nThe Roberts Team supports evaluation of global energy and water budgets, develops retrieval algorithms and climate data records (e.g. SeaFlux V1), evaluates air-sea interaction and ocean winds, and downscales and bias corrects models for use in hydrologic and agricultural modeling)." }, { - "objectID": "news/2024-03-04-earthaccess-tech-spotlight/index.html", - "href": "news/2024-03-04-earthaccess-tech-spotlight/index.html", - "title": "earthaccess: Accelerating NASA Earthdata access through open, collaborative development", + "objectID": "news/2024-09-17-news-sep-2024/index.html", + "href": "news/2024-09-17-news-sep-2024/index.html", + "title": "Openscapes Newsletter #10: Fall 2024", "section": "", - "text": "earthaccess is Python library that simplifies data discovery and access to NASA Earthdata. On February 26, the authors co-presented at the NASA Earth Science Data Systems (ESDS) Tech Spotlight meeting — to a crowd of 88 people! The author list is testament to this open community of developers: Luis López, Matt Fisher and Amy Steiker are at the National Snow and Ice Data Center (NSIDC), Aaron Friesz is at the Land Processes Distributed Active Archive Center (LP DAAC), and Qiusheng Wu is at University of Tennessee and an active open science community leader. This is a brief post to share resources and a few highlights - we encourage you to review the slides, recording, repos, and notebooks below. Additionally, please join this open science community effort via regular remote hackdays!\nQuicklinks:\n\nslides - slides co-presented by the authors\nrecording\nearthaccess and the cloud: the force awakens notebook - from Luis’ demo\nOpenGeos: NASA-Earth-Data GitHub repository - from Qiusheng’s demo\nleafmap: nasa earth data notebook - from Qiusheng’s demo\nBi-weekly hackdays, Announcement and ongoing discussions for more info.\n\n\nAmy Steiker began the presentation framing the problems that earthaccess addresses: data accessibility, API fragmentation, and authentication in the cloud.\n\n\n\nearthaccess eliminates the need to know the intricacies of NASA’s Application Programming Interfaces (APIs) and cloud data storage systems.\n\n\nShe described earthaccess as a community, with roots in the NASA Openscapes community where staff with similar roles supporting users across the DAACs (NASA data centers) have been able to learn, develop common tutorials, and teach together.\n\n\n\nThe earthaccess design came from learning/responding to researcher pain points from cross-DAAC Hackathons and Champions Cohorts\n\n\n\n\n\nThis community strategy is a theme and enabler of earthaccess growth and utilization.\n\n\nAaron Friesz then shared about Earthdata Authentication - Old vs New. The old approach was 30 lines of code, where the user also had to interface with the Earthdata login site. earthaccess now replaces this with 1 line of code. Plus, earthaccess also takes care of AWS credentials.\nLP DAAC uses earthaccess in all of its tutorials and teaching events, including ECOSTRESS and EMIT workshops and hackathons. It has changed the way they work, develop, and teach.\nLuis López, earthaccess lead developer, then shared about scaling in the cloud using earthaccess from a earthaccess and the cloud: the force awakens notebook. He shared how earthaccess interfaces between DAACs-AWS and open science community resources.\n\n\n\nearthaccess interfaces between DAACs-AWS and open science community resources.\n\n\nLuis demo’ed many parts of earthaccess:\n\nAccess remote files, automatically handling authentication and serialization.\nGenerate an on-the-fly Zarr compatible cache with Kerchunk!\nSmart Access - Sneak peak today, more details at SciPy 2024!\nScale out workflows with Dask - Processing Terabyte-Scale NASA Cloud Datasets with Coiled\n\nLuis demo’d upcoming features in development for earthaccess that reduce egress sizes (saves NASA $$) and time to science! This is incredibly exciting!\nEgress:\n without earthaccess: 3199.29 MB \n with earthaccess : 112.0 MB\n\nTime to science:\n without earthaccess: 15.9 minutes \n with earthaccess : 0.52 minutes\nQiusheng Wu then shared earthaccess in action with leafmap. Qiusheng built the NASA Earth Data Catalog on top of earthaccess, which uses GitHub Actions to pull the most recent metadata records for NASA Earthdata. Then, using leafmap — Python package for geospatial analysis and interactive mapping in a Jupyter environment that Qiusheng developed — users can interact and view the metadata on a map, exploring and selecting to find the data they want.\nThis is so exciting to have earthaccess involved as the 88th notebook example in the leafmap resource list! You can click to launch the notebook in different coding environments, including Google Colab.\nearthaccess has a lot of momentum moving forward as an open science community, and we welcome you to join our bi-weekly hackdays: fostering new contributions through small group work aligning around specific topics or features. Please reach out if you are interested in joining! See our Announcement and ongoing discussions for more info.\n\n\n\nCitationBibTeX citation:@online{lópez2024,\n author = {López, Luis and Fisher, Matt and Friesz, Aaron and Wu,\n Qiusheng and Steiker, Amy and community, earthaccess},\n title = {Earthaccess: {Accelerating} {NASA} {Earthdata} Access Through\n Open, Collaborative Development},\n date = {2024-03-04},\n url = {https://nasa-openscapes.github.io/news/2024-03-04-earthaccess-tech-spotlight/},\n langid = {en}\n}\nFor attribution, please cite this work as:\nLópez, Luis, Matt Fisher, Aaron Friesz, Qiusheng Wu, Amy Steiker, and\nearthaccess community. 2024. “Earthaccess: Accelerating NASA\nEarthdata Access Through Open, Collaborative Development.” March\n4, 2024. https://nasa-openscapes.github.io/news/2024-03-04-earthaccess-tech-spotlight/." + "text": "Welcome to Openscapes’ tenth newsletter! If you’re interested in seeing these infrequent updates in your inbox, please sign up here (linked from our connect with us page). And! If you have signed up but did not see this in your inbox, please check your spam folder!\nCross-posted at openscapes.org/blog, nmfs-openscapes.github.io/blog, nasa-openscapes.github.io/news, openscapes.github.io/pathways-to-open-science/blog\nHello all,\nWe are feeling rejuvenated momentum and hope going into Fall 2024, and we hope this newsletter finds you well. We have had some recent big inflection points.\nOpenscapes is going to the White House! Openscapes is being recognized at the “Celebration of the OSTP Year of Open Science Recognition Challenge Winners” on September 19. This is a BIG DEAL and we are excited to share the joy with our community. Our September 26 Community Call debriefing The White House trip – which also includes presenting at the Dynamic Convergence Workshop - will continue the celebration as Ileana Fenwick and Julie Lowndes interview each other about their experiences. Please sign up here!\nNOAA Fisheries announced a 3-year commitment to open science as part of the Biden-Harris Administration Inflation Reduction Act. Openscapes is thrilled to be part of this work. We have been scaffolding with NOAA Fisheries for the past few years – through 10 Champions Cohorts and developing a cross-agency grassroots mentor community (read next paragraph about a recent publication!). This is such a celebration for the open science community as a whole, a high-profile example of what open science can look like in the government. It means open science directly helping meet the needs of changing oceans by supporting the NOAA workforce focused on climate resilience for fishing communities. It is also a huge celebration for NASA, whom NOAA has been watching and inspired by for their efforts in open science.\nRead our peer-reviewed paper co-authored by Openscapes mentors across organizations – including NASA Earthdata, NOAA Fisheries, U.S. EPA, California Water Boards, Pathways to Open Science, and the Fred Hutch Cancer Center - recently published in Ecology & Evolution. From co-author Anna Holder, Cal EPA / Water Boards: “It’s a short read and quite uplifting and inspirational and provides some more insight and what we’re learning as we implement Openscapes across organizations.” https://doi.org/10.1002/ece3.11341; Blog post\nOpenscapes update from Julie Lowndes, summer 2024 is another big deal. Julie talks about and codifies the Opencapes ethos, the organization’s structure, shares updates on new core team members Liz Neeley and Andy Teucher, how we all work together, and how we are igniting real culture change across science.\n2023 marked 5 years of Openscapes! We’ve been reflecting on our momentum and impact, and invite you to share what stands out to you in our Openscapes Survey. We’ve been sharing insights via talks and our submission to the Challenge.gov (the catalyst for The White House visit). We plan to share more at a submitted talk at the AGU Fall Meeting in Washington DC in December." }, { - "objectID": "news/2024-03-14-emit-methane/index.html", - "href": "news/2024-03-14-emit-methane/index.html", - "title": "Learn about and use methane plume data from EMIT!", - "section": "", - "text": "Please join NASA’s JPL EMIT Science Team and the LP DAAC for a 2-hour virtual workshop demonstrating how to use methane data products (EMITL2BCH4ENH v001 and EMITL2BCH4PLM v001) from the Earth Surface Mineral Dust Source Investigation (EMIT) mission at 12:00 pm PST on March 14, 2024. You can find out more about the EMIT mission, see the contributions these data are making to the US GHG Center, watch the EMIT tutorial series 1-3, and explore EMIT python resources before attending. Please fill out this form to help us better estimate workshop resources. \nDuring the workshop we will use a learning platform that requires a GitHub account to login. Please make an account here if you do not already have one. We will contact you prior to the workshop with more details." + "objectID": "news/2024-09-17-news-sep-2024/index.html#more-highlights", + "href": "news/2024-09-17-news-sep-2024/index.html#more-highlights", + "title": "Openscapes Newsletter #10: Fall 2024", + "section": "More highlights", + "text": "More highlights\n\nPlease read our report on our second annual Pathways to Open Science Program and A letter to researchers that want to make the world a better place, by Dr Antoinette Foster. These were supported in part by a Mozilla Alumni Grant to Openscapes and PREreview \nWe completed our second annual Reflections program; we will continue to grow and offer this as another entryway to open science.\nNASA Openscapes Mentors recently led an ESIP session on Fledging, the culmination of a lot of work, and their work has been featured in many blog posts, webinars, and workshops.\n\nESIP Summer 2024 conference session, “Onboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud”, by Alexis Hunzinger, Danny Kaufman, Aaron Friesz, Michele Thornton, Andy Barrett, Rhys Leahy, Eli Holmes, Julie Lowndes\nNASA Earthdata blog, From Onboarding to Fledging and Beyond—An Openscapes Journey, by Josh Blumenfeld featuring stories from Aronne Merrelli, University of Michigan and Eli Holmes, NOAA Fisheries\nFirst Forays into the Cloud - first “fledging” story from NASA Openscapes!, by Aronne Merrelli, 2023 NASA Champion\n2i2c develops shared password access with LP DAAC for NASA Surface Biology and Geology Workshop, by 2i2c Team members Yuvi Panda and Jenny Wong\nLearn about and use Surface Water and Ocean Topography (SWOT) Data!, led by Cassie Nickles at the Hacking Limnology Virtual Summit\n\n\n\n\nWe developed our first hands-on Quarto + GitHub Contributing Clinic to help Openscapes Mentors upskill; we’ll iterate based on what we learned. \nWe’ve led 24 Champions Cohorts to date! So exciting to see new cross-agency connections developing and amplifying expert voices as more and more past Champions become Mentors and Instructors and share their open science stories more broadly. \n\n2nd U.S. EPA Cohort.\n3rd NASA Cohort. Summary post, NASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud, by NASA Openscapes Mentors.\nCalifornia Water Boards forking Openscapes is building momentum. They led their 3rd & 4th Cohorts in 2024, reusing & remixing lessons, and using and contributing back to the Kyber R package we use to create our infrastructure for delivering Champions Cohorts." }, { - "objectID": "news/2024-05-14-noaa-edmw/index.html", - "href": "news/2024-05-14-noaa-edmw/index.html", - "title": "How the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud", - "section": "", - "text": "The NOAA Enterprise Data Management Workshop (EDMW) is an annual workshop organized by NOAA staff and affiliates. The purpose of the workshop is to build on past work in enterprise data management at NOAA by highlighting progress, identifying issues, fostering discussions, and determining where new technologies can be applied. This year’s theme is “Bridging the Gap: Ensuring Seamless Data Flow from Acquisition to Access”\nNASA Openscapes was invited to present via Bri Lind (NASA Land Processes data center, LP DAAC). Julie Lowndes (Openscapes) & Ian Carroll (NASA Ocean Biology data center, OB.DAAC) will co-present.\nHow the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud\nAbstract: NASA Openscapes is a community where staff with similar roles supporting users across 12 NASA Earth Science Data Centers (DAACs) have been able to learn, develop common tutorials, and teach together to support users migrating workflows to the Cloud. NASA Openscapes Mentors co-create and maintain an open Earthdata Cloud Cookbook of common reusable open source tutorials that they have co-developed for specific audiences and tested and refined through frequent workshops, hackathons, and Openscapes Champions Cohorts. They also created the earthaccess Python library which made users’ first experience with NASA Earthdata Cloud be two lines of Python code rather than 30 lines of bash code (that also required clicking and managing hidden files for authentication). The work these Mentors do together as a small community has enormous cascading effects, particularly as they visibly practice open science daily via contributions to open source code and documentation. Further, they are connected to other open communities to enable further innovation: like when a conversation at the Ecological Society of America conference led to building the earthdatalogin R library to support researchers R as well as Python and create portable docker containers cloud users. We will share stories and how we work, and how approaches fit and can be leveraged by the NOAA Enterprise Data Management community." + "objectID": "news/2024-09-17-news-sep-2024/index.html#talks-workshops-conferences-see-events", + "href": "news/2024-09-17-news-sep-2024/index.html#talks-workshops-conferences-see-events", + "title": "Openscapes Newsletter #10: Fall 2024", + "section": "Talks, workshops, conferences (see Events)", + "text": "Talks, workshops, conferences (see Events)\nRecordings and slides are linked from the posts below.\n\nMay 14: How the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud, at NOAA Enterprise Data Management (EDMW) Workshop \nJune 3: Community Call: Sharing Climate Data. A Conversation with Creative Commons and Openscapes, with recording & collaborative notes doc\nJuly 23, 2024: ESIP - highlight above\nAugust 7: Invited virtual talk for the NIH Biomedical Informatics Coordinating Committee (BMIC), “How Openscapes supports teams in open science: stories of how we work”, by Julie Lowndes\nAugust 13: posit::conf talks and strengthening community connections. Stefanie Butland talked about how we use the Kyber R package to connect Google Sheets, RMarkdown, GitHub, and Agenda docs for open education and Luis Lopez talked about earthaccess: Simplifying Earth Science in The Cloud. The conference was a wonderful opportunity to lay down more in-person connections among Mentors from NMFS Openscapes and NASA Openscapes and this wonderful Posit community. \nAugust 22: Openscapes at California Department of Water Resources Environmental Coordination Committee Open Forum, Openscapes: Kinder science for future us, by  Julie Lowndes, Devan Burke, Anna Holder.\nSeptember 10: Forking as a Worldview: A big idea that frames Openscapes thinking. Julie Lowndes gave a plenary talk at NASA’s internal PI Planning meeting and talked about forking as reusing what works in new places, with examples of earthaccess package development forking the open source software dev approach into government, and NASA Openscapes and then NOAA Fisheries Openscapes forking open source frameworks to tackle big challenges (cloud migration, data modernization). And it turns out, forking is the first step of the Openscapes Flywheel :)\n\nThank you for reading, and for all that you do. Read more about what this amazing community has been up to via blog posts, talks on our media page and events page.\n\n\n\nPhoto by Elliot Lowndes" }, { "objectID": "news/2023-03-16-esip-winter-2023/index.html", @@ -1054,7 +1075,7 @@ "href": "news.html", "title": "NEWS", "section": "", - "text": "Community Call: Openscapes Goes to The White House!\n\n\n\n\n\n\nevent\n\n\ncommunity-call\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\npathways\n\n\n\nJulie Lowndes & Ileana Fenwick will debrief their White House trip and share the celebration of Openscapes being recognized at the ’Celebration of the OSTP Year of Open…\n\n\n\n\n\nSep 26, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nPlenary at internal NASA meeting: Together We Innovate\n\n\n\n\n\n\nevent\n\n\nnasa-framework\n\n\n\nPI Planning, Fall 2024 \n\n\n\n\n\nSep 10, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nOnboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\n\nA session at ESIP Summer 2024 conference\n\n\n\n\n\nAug 30, 2024\n\n\nAlexis Hunzinger, Danny Kaufman, Aaron Friesz, Michele Thornton, Andy Barrett, Rhys Leahy, Eli Holmes, Julie Lowndes\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\nchampions\n\n\n\n\n\n\n\n\n\nJul 24, 2024\n\n\nMichele Thornton (ORNL), Catalina Taglialatela (PO.DAAC, Jet Propulsion Laboratory, California Institute of Technology), Luis Lopez (NSIDC), Matt Fisher (NSIDC), Alexis Hunzinger (GES DISC), Bri Lind (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey), Mahsa Jami (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey), Cassie Nickles (PO.DAAC, Jet Propulsion Laboratory, California Institute of Technology), Andy Teucher (NASA Openscapes), Aronne Merrelli (University of Michigan & 2023 Champion), Erin Robinson, Julie Lowndes, NASA Openscapes Mentors\n\n\n\n\n\n\n\n\n\n\n\n\nSupporting NASA Earthdata users in the Cloud: NASA Openscapes onboarding and ‘fledging’\n\n\n\n\n\n\nconference\n\n\nnasa-framework\n\n\nevent\n\n\n\nA facilitated session at ESIP summer 2024\n\n\n\n\n\nJul 23, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nFirst Forays into the Cloud - first “fledging” story from NASA Openscapes!\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\nchampions\n\n\n\nAronne Merrelli describes developing cloud workflows with 2i2c, parallelizing workflows with Coiled, and attaching his university credit card to do real science in the cloud.\n\n\n\n\n\nJul 22, 2024\n\n\nAronne Merrelli, University of Michigan\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes update from Julie Lowndes, summer 2024\n\n\n\n\n\n\nblog\n\n\nhow-we-work\n\n\n\n\n\n\n\n\n\nJul 18, 2024\n\n\nJulie Lowndes\n\n\n\n\n\n\n\n\n\n\n\n\nLearn about and use Surface Water and Ocean Topography (SWOT) Data!\n\n\n\n\n\n\nevent\n\n\n\nSWOT workshop at Hacking Limnology Virtual Summit\n\n\n\n\n\nJul 16, 2024\n\n\nHacking Limnology Virtual Summit, NASA PO.DAAC & Openscapes\n\n\n\n\n\n\n\n\n\n\n\n\n2i2c develops shared password access with LP DAAC for NASA Surface Biology and Geology Workshop\n\n\n\n\n\n\nblog\n\n\nhow-we-work\n\n\n\nNASA Openscapes Mentors collaborated to develop a frictionless login workflow for 250 participants\n\n\n\n\n\nJul 9, 2024\n\n\n2i2c Team members Yuvi Panda and Jenny Wong\n\n\n\n\n\n\n\n\n\n\n\n\nShifting institutional culture to develop climate solutions with Open Science\n\n\n\n\n\n\nblog\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\nwater-boards\n\n\npathways\n\n\nhow-we-work\n\n\n\nAn Open Access Editorial written collaboratively by mentors across the Openscapes community\n\n\n\n\n\nJun 6, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nHow the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud\n\n\n\n\n\n\nevent\n\n\ntalk\n\n\nnasa-framework\n\n\n\nA presentation for the NOAA Enterprise Data Management (EDMW) Workshop\n\n\n\n\n\nMay 14, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earthdata Data Chat with Aaron Friesz\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nApr 4, 2024\n\n\nAaron Friesz, Joseph M. Smith\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Openscapes Champions Cohort\n\n\n\n\n\n\nevent\n\n\nchampions\n\n\nnasa-framework\n\n\n\nOpenscapes Champions Cohort for research teams using data from NASA Distributed Active Archive Centers (DAACs) and interested in open science and migrating their analytical…\n\n\n\n\n\nApr 3, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nLearn about and use methane plume data from EMIT!\n\n\n\n\n\n\nevent\n\n\nnasa-framework\n\n\n\nEMIT Data Tutorial Series virtual workshop\n\n\n\n\n\nMar 14, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMar 12, 2024\n\n\nBri Lind, Alexis Hunzinger, Luis Lopez, Cassandra Nickles, NASA Openscapes Community\n\n\n\n\n\n\n\n\n\n\n\n\nearthaccess: Accelerating NASA Earthdata access through open, collaborative development\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMar 4, 2024\n\n\nLuis López, Matt Fisher, Aaron Friesz, Qiusheng Wu, Amy Steiker, earthaccess community\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earthdata Webinar. Community Developed Cloud Computing Resources: the Cloud Cookbook from NASA Openscapes\n\n\n\n\n\n\nevent\n\n\ntalk\n\n\nnasa-framework\n\n\n\nSpeakers, Bri Lind, LP DAAC; Cassie Nickles, PO.DAAC; Luis Lopez, NSIDC; Alexis Hunzinger, GES DISC\n\n\n\n\n\nFeb 28, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Community Call: GitHub for NASA Openscapes community calendaring & project management\n\n\n\n\n\n\ncommunity-call\n\n\nblog\n\n\nnasa-framework\n\n\n\nAn open work in progress\n\n\n\n\n\nFeb 28, 2024\n\n\nBri Lind, Stefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earth Science Data Systems Technology Spotlight\n\n\n\n\n\n\nevent\n\n\nnasa-framework\n\n\n\nwith Luis Lopez from the National Snow and Ice Data Center\n\n\n\n\n\nFeb 26, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nCommunity Call: GitHub for NASA Openscapes community calendaring & project management\n\n\n\n\n\n\nevent\n\n\ncommunity-call\n\n\nnasa-framework\n\n\n\nAn open work in progress \n\n\n\n\n\nFeb 20, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Openscapes: Talking points for 3-year recap & vision for next two years\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nFeb 15, 2024\n\n\nErin Robinson, Julie Lowndes (Openscapes), NASA Openscapes Team\n\n\n\n\n\n\n\n\n\n\n\n\nWhite House Fact Sheet Mentions Openscapes!\n\n\n\n\n\n\nblog\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\nwater-boards\n\n\npathways\n\n\n\n\n\n\n\n\n\nFeb 9, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud\n\n\n\n\n\n\nnasa-framework\n\n\nconference\n\n\nblog\n\n\n\nHighlights from our talk at the AGU Fall Meeting\n\n\n\n\n\nJan 18, 2024\n\n\nJulie Lowndes, Erin Robinson, NASA Openscapes Mentors\n\n\n\n\n\n\n\n\n\n\n\n\nActivities at the AGU Fall Meeting\n\n\n\n\n\n\nnasa-framework\n\n\nconference\n\n\nblog\n\n\n\nWorkshops, Talks, Posters, Demos, and more\n\n\n\n\n\nDec 10, 2023\n\n\nNASA Openscapes\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Community Call: NASA Earthdata Cloud with Coiled\n\n\n\n\n\n\ncommunity-call\n\n\nblog\n\n\nnasa-framework\n\n\n\nPanel discussion and demos with NSIDC and Coiled\n\n\n\n\n\nDec 8, 2023\n\n\nAmy Steiker, Luis Lopez, Andrew Barrett, Julie Lowndes, Erin Robinson, James Bourbeau\n\n\n\n\n\n\n\n\n\n\n\n\nEngaging with a Cross-NASA Subcommunity\n\n\n\n\n\n\ncommunity-call\n\n\nblog\n\n\nnasa-framework\n\n\n\nRecap of a Carpentries Community Session with NASA and Openscapes\n\n\n\n\n\nDec 6, 2023\n\n\nChris Battisto, Katherine Blanchette, Alycia Crall, Elizabeth Joyner, Julie Lowndes, Sean McCartney, Erin Robinson, Kenton Ross\n\n\n\n\n\n\n\n\n\n\n\n\nProcessing Terabyte-Scale NASA Cloud Datasets with Coiled\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\n\nGuide for NASA Cloud computing at scale. How to run existing NASA data workflows on the cloud, in parallel, with minimal code changes using Coiled.\n\n\n\n\n\nNov 7, 2023\n\n\nJames Bourbeau of Coiled\n\n\n\n\n\n\n\n\n\n\n\n\nMATLAB on Openscapes\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\n\nAccessing and Analyzing NASA Earthdata in the Cloud with MATLAB\n\n\n\n\n\nOct 17, 2023\n\n\nLisa Kempler\n\n\n\n\n\n\n\n\n\n\n\n\nCloud Environment Opportunities\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\n\nManaged JupyterHub options for Cryosphere and NASA Earthdata user communities\n\n\n\n\n\nOct 13, 2023\n\n\nAmy Steiker, Luis Lopez, Andy Barrett, the NASA Openscapes Mentors, James Bourbeau of Coiled\n\n\n\n\n\n\n\n\n\n\n\n\nExciting Progress for Research Teams using NASA Earthdata in the Cloud: 2023 NASA Openscapes Champions Wrap-up\n\n\n\n\n\n\nblog\n\n\nchampions\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nAug 1, 2023\n\n\nErin Robinson, Julie Lowndes, Amy Steiker, Alexis Hunzinger, Luis Lopez, Andy Barrett, Cassie Nickles, and NASA DAAC Mentors\n\n\n\n\n\n\n\n\n\n\n\n\nNew Zenodo Openscapes Community helps you Find and Cite Openscapes things\n\n\n\n\n\n\nblog\n\n\nhow-we-work\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 31, 2023\n\n\nStefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nHow coaching skills have made us better open data science mentors\n\n\n\n\n\n\nblog\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 17, 2023\n\n\nTara Robertson, Stefanie Butland, Julie Lowndes\n\n\n\n\n\n\n\n\n\n\n\n\nIntroducing pathway of cloud computing to the NASA user community\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 11, 2023\n\n\nXiaohua Pan\n\n\n\n\n\n\n\n\n\n\n\n\n3 approaches for the year of open science\n\n\n\n\n\n\nblog\n\n\nconference\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMar 16, 2023\n\n\nCorey Clatterbuck, Ileana Fenwick, Josh London, Luis Lopez, Cassie Nickles, Adyan Rios, Stefanie Butland, Julie Lowndes, Erin Robinson\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Newsletter #6: Winter 2023\n\n\n\n\n\n\nblog\n\n\nnewsletter\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\n\n\n\n\n\n\n\nFeb 21, 2023\n\n\nJulie Lowndes and Stefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nPrevious News 2021-2022\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\nhow-we-work\n\n\n\n\n\n\n\n\n\nDec 31, 2022\n\n\nJulie Lowndes and Erin Robinson\n\n\n\n\n\n\n\n\n\n\n\n\nFrom downloading data to Cloud access: NASA Openscapes Champions Wrap-up\n\n\n\n\n\n\nblog\n\n\nchampions\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 12, 2022\n\n\nNASA Openscapes Mentors, Erin Robinson, Julie Lowndes, Andy Barrett, Aaron Friesz, Alexis Hunzinger, Luis Lopez, Catalina Oaida, Jack McNelis, Christine Smit, Amy Steiker, Makhan Virdi\n\n\n\n\n\n\nNo matching items" + "text": "Community Call: Openscapes Goes to The White House!\n\n\n\n\n\n\nevent\n\n\ncommunity-call\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\npathways\n\n\n\nJulie Lowndes & Ileana Fenwick will debrief their White House trip and share the celebration of Openscapes being recognized at the ’Celebration of the OSTP Year of Open…\n\n\n\n\n\nSep 26, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Newsletter #10: Fall 2024\n\n\n\n\n\n\nblog\n\n\nnewsletter\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\npathways\n\n\nreflections\n\n\n\n\n\n\n\n\n\nSep 17, 2024\n\n\nJulie Lowndes, Stefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nPlenary at internal NASA meeting: Together We Innovate\n\n\n\n\n\n\nevent\n\n\nnasa-framework\n\n\n\nPI Planning, Fall 2024 \n\n\n\n\n\nSep 10, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nOnboarding and “fledging”: How NASA Openscapes supports NASA Earthdata users in the Cloud\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\n\nA session at ESIP Summer 2024 conference\n\n\n\n\n\nAug 30, 2024\n\n\nAlexis Hunzinger, Danny Kaufman, Aaron Friesz, Michele Thornton, Andy Barrett, Rhys Leahy, Eli Holmes, Julie Lowndes\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Champions 2024: Data strategies for when to use cloud, coding strategies for parallelization, & first examples of big science in the Cloud\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\nchampions\n\n\n\n\n\n\n\n\n\nJul 24, 2024\n\n\nMichele Thornton (ORNL), Catalina Taglialatela (PO.DAAC, Jet Propulsion Laboratory, California Institute of Technology), Luis Lopez (NSIDC), Matt Fisher (NSIDC), Alexis Hunzinger (GES DISC), Bri Lind (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey), Mahsa Jami (LP DAAC, KBR Inc., under contract to the U.S. Geological Survey), Cassie Nickles (PO.DAAC, Jet Propulsion Laboratory, California Institute of Technology), Andy Teucher (NASA Openscapes), Aronne Merrelli (University of Michigan & 2023 Champion), Erin Robinson, Julie Lowndes, NASA Openscapes Mentors\n\n\n\n\n\n\n\n\n\n\n\n\nSupporting NASA Earthdata users in the Cloud: NASA Openscapes onboarding and ‘fledging’\n\n\n\n\n\n\nconference\n\n\nnasa-framework\n\n\nevent\n\n\n\nA facilitated session at ESIP summer 2024\n\n\n\n\n\nJul 23, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nFirst Forays into the Cloud - first “fledging” story from NASA Openscapes!\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\nchampions\n\n\n\nAronne Merrelli describes developing cloud workflows with 2i2c, parallelizing workflows with Coiled, and attaching his university credit card to do real science in the cloud.\n\n\n\n\n\nJul 22, 2024\n\n\nAronne Merrelli, University of Michigan\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes update from Julie Lowndes, summer 2024\n\n\n\n\n\n\nblog\n\n\nhow-we-work\n\n\n\n\n\n\n\n\n\nJul 18, 2024\n\n\nJulie Lowndes\n\n\n\n\n\n\n\n\n\n\n\n\nLearn about and use Surface Water and Ocean Topography (SWOT) Data!\n\n\n\n\n\n\nevent\n\n\n\nSWOT workshop at Hacking Limnology Virtual Summit\n\n\n\n\n\nJul 16, 2024\n\n\nHacking Limnology Virtual Summit, NASA PO.DAAC & Openscapes\n\n\n\n\n\n\n\n\n\n\n\n\n2i2c develops shared password access with LP DAAC for NASA Surface Biology and Geology Workshop\n\n\n\n\n\n\nblog\n\n\nhow-we-work\n\n\n\nNASA Openscapes Mentors collaborated to develop a frictionless login workflow for 250 participants\n\n\n\n\n\nJul 9, 2024\n\n\n2i2c Team members Yuvi Panda and Jenny Wong\n\n\n\n\n\n\n\n\n\n\n\n\nShifting institutional culture to develop climate solutions with Open Science\n\n\n\n\n\n\nblog\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\nwater-boards\n\n\npathways\n\n\nhow-we-work\n\n\n\nAn Open Access Editorial written collaboratively by mentors across the Openscapes community\n\n\n\n\n\nJun 6, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nHow the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud\n\n\n\n\n\n\nevent\n\n\ntalk\n\n\nnasa-framework\n\n\n\nA presentation for the NOAA Enterprise Data Management (EDMW) Workshop\n\n\n\n\n\nMay 14, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earthdata Data Chat with Aaron Friesz\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nApr 4, 2024\n\n\nAaron Friesz, Joseph M. Smith\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Openscapes Champions Cohort\n\n\n\n\n\n\nevent\n\n\nchampions\n\n\nnasa-framework\n\n\n\nOpenscapes Champions Cohort for research teams using data from NASA Distributed Active Archive Centers (DAACs) and interested in open science and migrating their analytical…\n\n\n\n\n\nApr 3, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nLearn about and use methane plume data from EMIT!\n\n\n\n\n\n\nevent\n\n\nnasa-framework\n\n\n\nEMIT Data Tutorial Series virtual workshop\n\n\n\n\n\nMar 14, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earthdata Webinar: NASA Openscapes Mentors from 4 data centers present the Earthdata Cloud Cookbook\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMar 12, 2024\n\n\nBri Lind, Alexis Hunzinger, Luis Lopez, Cassandra Nickles, NASA Openscapes Community\n\n\n\n\n\n\n\n\n\n\n\n\nearthaccess: Accelerating NASA Earthdata access through open, collaborative development\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMar 4, 2024\n\n\nLuis López, Matt Fisher, Aaron Friesz, Qiusheng Wu, Amy Steiker, earthaccess community\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earthdata Webinar. Community Developed Cloud Computing Resources: the Cloud Cookbook from NASA Openscapes\n\n\n\n\n\n\nevent\n\n\ntalk\n\n\nnasa-framework\n\n\n\nSpeakers, Bri Lind, LP DAAC; Cassie Nickles, PO.DAAC; Luis Lopez, NSIDC; Alexis Hunzinger, GES DISC\n\n\n\n\n\nFeb 28, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Community Call: GitHub for NASA Openscapes community calendaring & project management\n\n\n\n\n\n\ncommunity-call\n\n\nblog\n\n\nnasa-framework\n\n\n\nAn open work in progress\n\n\n\n\n\nFeb 28, 2024\n\n\nBri Lind, Stefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Earth Science Data Systems Technology Spotlight\n\n\n\n\n\n\nevent\n\n\nnasa-framework\n\n\n\nwith Luis Lopez from the National Snow and Ice Data Center\n\n\n\n\n\nFeb 26, 2024\n\n\nOpenscapes and NASA\n\n\n\n\n\n\n\n\n\n\n\n\nCommunity Call: GitHub for NASA Openscapes community calendaring & project management\n\n\n\n\n\n\nevent\n\n\ncommunity-call\n\n\nnasa-framework\n\n\n\nAn open work in progress \n\n\n\n\n\nFeb 20, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Openscapes: Talking points for 3-year recap & vision for next two years\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nFeb 15, 2024\n\n\nErin Robinson, Julie Lowndes (Openscapes), NASA Openscapes Team\n\n\n\n\n\n\n\n\n\n\n\n\nWhite House Fact Sheet Mentions Openscapes!\n\n\n\n\n\n\nblog\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\nwater-boards\n\n\npathways\n\n\n\n\n\n\n\n\n\nFeb 9, 2024\n\n\nOpenscapes\n\n\n\n\n\n\n\n\n\n\n\n\nNASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud\n\n\n\n\n\n\nnasa-framework\n\n\nconference\n\n\nblog\n\n\n\nHighlights from our talk at the AGU Fall Meeting\n\n\n\n\n\nJan 18, 2024\n\n\nJulie Lowndes, Erin Robinson, NASA Openscapes Mentors\n\n\n\n\n\n\n\n\n\n\n\n\nActivities at the AGU Fall Meeting\n\n\n\n\n\n\nnasa-framework\n\n\nconference\n\n\nblog\n\n\n\nWorkshops, Talks, Posters, Demos, and more\n\n\n\n\n\nDec 10, 2023\n\n\nNASA Openscapes\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Community Call: NASA Earthdata Cloud with Coiled\n\n\n\n\n\n\ncommunity-call\n\n\nblog\n\n\nnasa-framework\n\n\n\nPanel discussion and demos with NSIDC and Coiled\n\n\n\n\n\nDec 8, 2023\n\n\nAmy Steiker, Luis Lopez, Andrew Barrett, Julie Lowndes, Erin Robinson, James Bourbeau\n\n\n\n\n\n\n\n\n\n\n\n\nEngaging with a Cross-NASA Subcommunity\n\n\n\n\n\n\ncommunity-call\n\n\nblog\n\n\nnasa-framework\n\n\n\nRecap of a Carpentries Community Session with NASA and Openscapes\n\n\n\n\n\nDec 6, 2023\n\n\nChris Battisto, Katherine Blanchette, Alycia Crall, Elizabeth Joyner, Julie Lowndes, Sean McCartney, Erin Robinson, Kenton Ross\n\n\n\n\n\n\n\n\n\n\n\n\nProcessing Terabyte-Scale NASA Cloud Datasets with Coiled\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\n\nGuide for NASA Cloud computing at scale. How to run existing NASA data workflows on the cloud, in parallel, with minimal code changes using Coiled.\n\n\n\n\n\nNov 7, 2023\n\n\nJames Bourbeau of Coiled\n\n\n\n\n\n\n\n\n\n\n\n\nMATLAB on Openscapes\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\n\nAccessing and Analyzing NASA Earthdata in the Cloud with MATLAB\n\n\n\n\n\nOct 17, 2023\n\n\nLisa Kempler\n\n\n\n\n\n\n\n\n\n\n\n\nCloud Environment Opportunities\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\n\nManaged JupyterHub options for Cryosphere and NASA Earthdata user communities\n\n\n\n\n\nOct 13, 2023\n\n\nAmy Steiker, Luis Lopez, Andy Barrett, the NASA Openscapes Mentors, James Bourbeau of Coiled\n\n\n\n\n\n\n\n\n\n\n\n\nExciting Progress for Research Teams using NASA Earthdata in the Cloud: 2023 NASA Openscapes Champions Wrap-up\n\n\n\n\n\n\nblog\n\n\nchampions\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nAug 1, 2023\n\n\nErin Robinson, Julie Lowndes, Amy Steiker, Alexis Hunzinger, Luis Lopez, Andy Barrett, Cassie Nickles, and NASA DAAC Mentors\n\n\n\n\n\n\n\n\n\n\n\n\nNew Zenodo Openscapes Community helps you Find and Cite Openscapes things\n\n\n\n\n\n\nblog\n\n\nhow-we-work\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 31, 2023\n\n\nStefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nHow coaching skills have made us better open data science mentors\n\n\n\n\n\n\nblog\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 17, 2023\n\n\nTara Robertson, Stefanie Butland, Julie Lowndes\n\n\n\n\n\n\n\n\n\n\n\n\nIntroducing pathway of cloud computing to the NASA user community\n\n\n\n\n\n\nblog\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 11, 2023\n\n\nXiaohua Pan\n\n\n\n\n\n\n\n\n\n\n\n\n3 approaches for the year of open science\n\n\n\n\n\n\nblog\n\n\nconference\n\n\nnoaa-fisheries\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMar 16, 2023\n\n\nCorey Clatterbuck, Ileana Fenwick, Josh London, Luis Lopez, Cassie Nickles, Adyan Rios, Stefanie Butland, Julie Lowndes, Erin Robinson\n\n\n\n\n\n\n\n\n\n\n\n\nOpenscapes Newsletter #6: Winter 2023\n\n\n\n\n\n\nblog\n\n\nnewsletter\n\n\nnasa-framework\n\n\nnoaa-fisheries\n\n\n\n\n\n\n\n\n\nFeb 21, 2023\n\n\nJulie Lowndes and Stefanie Butland\n\n\n\n\n\n\n\n\n\n\n\n\nPrevious News 2021-2022\n\n\n\n\n\n\nnasa-framework\n\n\nblog\n\n\nhow-we-work\n\n\n\n\n\n\n\n\n\nDec 31, 2022\n\n\nJulie Lowndes and Erin Robinson\n\n\n\n\n\n\n\n\n\n\n\n\nFrom downloading data to Cloud access: NASA Openscapes Champions Wrap-up\n\n\n\n\n\n\nblog\n\n\nchampions\n\n\nnasa-framework\n\n\n\n\n\n\n\n\n\nMay 12, 2022\n\n\nNASA Openscapes Mentors, Erin Robinson, Julie Lowndes, Andy Barrett, Aaron Friesz, Alexis Hunzinger, Luis Lopez, Catalina Oaida, Jack McNelis, Christine Smit, Amy Steiker, Makhan Virdi\n\n\n\n\n\n\nNo matching items" }, { "objectID": "index.html", diff --git a/sitemap.xml b/sitemap.xml index cd1bddc..cd50b2f 100644 --- a/sitemap.xml +++ b/sitemap.xml @@ -2,178 +2,182 @@ https://nasa-openscapes.github.io/about.html - 2024-09-16T19:52:40.092Z + 2024-09-17T23:18:59.179Z https://nasa-openscapes.github.io/champions.html - 2024-09-16T19:52:40.092Z + 2024-09-17T23:18:59.179Z https://nasa-openscapes.github.io/cookbook-navbar-page.html - 2024-09-16T19:52:40.092Z + 2024-09-17T23:18:59.179Z https://nasa-openscapes.github.io/mentors.html - 2024-09-16T19:52:40.108Z + 2024-09-17T23:18:59.195Z https://nasa-openscapes.github.io/news/2024-09-26-openscapes-whitehouse/index.html - 2024-09-16T19:52:40.232Z + 2024-09-17T23:18:59.319Z https://nasa-openscapes.github.io/news/2023-10-13-nasa-jupyterhub-coiled/index.html - 2024-09-16T19:52:40.144Z + 2024-09-17T23:18:59.231Z https://nasa-openscapes.github.io/news/2024-02-09-white-house-factsheet-openscapes/index.html - 2024-09-16T19:52:40.164Z + 2024-09-17T23:18:59.251Z - https://nasa-openscapes.github.io/news/2022-05-12-nasa-2022-champions/index.html - 2024-09-16T19:52:40.108Z + https://nasa-openscapes.github.io/news/2024-05-14-noaa-edmw/index.html + 2024-09-17T23:18:59.279Z - https://nasa-openscapes.github.io/news/2024-02-28-github-community-call/index.html - 2024-09-16T19:52:40.172Z + https://nasa-openscapes.github.io/news/2024-03-14-emit-methane/index.html + 2024-09-17T23:18:59.275Z - https://nasa-openscapes.github.io/news/2024-02-20-github-calendaring/index.html - 2024-09-16T19:52:40.168Z + https://nasa-openscapes.github.io/news/2024-03-04-earthaccess-tech-spotlight/index.html + 2024-09-17T23:18:59.267Z - https://nasa-openscapes.github.io/news/2023-10-17-matlab-on-openscapes/index.html - 2024-09-16T19:52:40.144Z + https://nasa-openscapes.github.io/news/2023-05-11-pathway-cloud-computing/index.html + 2024-09-17T23:18:59.203Z - https://nasa-openscapes.github.io/news/2022-12-31-previous-news/index.html - 2024-09-16T19:52:40.116Z + https://nasa-openscapes.github.io/news/2023-05-31-zenodo-community/index.html + 2024-09-17T23:18:59.211Z - https://nasa-openscapes.github.io/news/2024-02-26-esds-tech-spotlight/index.html - 2024-09-16T19:52:40.168Z + https://nasa-openscapes.github.io/news/2023-12-10-agu-fall-meeting/index.html + 2024-09-17T23:18:59.243Z - https://nasa-openscapes.github.io/news/2024-03-12-nasa-earthdata-webinar/index.html - 2024-09-16T19:52:40.184Z + https://nasa-openscapes.github.io/news/2023-12-08-coiled-community-call/index.html + 2024-09-17T23:18:59.239Z - https://nasa-openscapes.github.io/news/2024-07-16-swot-workshop/index.html - 2024-09-16T19:52:40.204Z + https://nasa-openscapes.github.io/news/2024-07-24-2024-nasa-champions-cohort/index.html + 2024-09-17T23:18:59.303Z - https://nasa-openscapes.github.io/news/2023-11-07-coiled-openscapes/index.html - 2024-09-16T19:52:40.148Z + https://nasa-openscapes.github.io/news/2024-04-03-nasa-champions/index.html + 2024-09-17T23:18:59.275Z - https://nasa-openscapes.github.io/news/2024-02-15-nasa-openscapes-talking-points/index.html - 2024-09-16T19:52:40.164Z + https://nasa-openscapes.github.io/news/2024-07-23-esip-summer-2024/index.html + 2024-09-17T23:18:59.299Z - https://nasa-openscapes.github.io/news/2024-07-09-2i2c-shared-password/index.html - 2024-09-16T19:52:40.196Z + https://nasa-openscapes.github.io/news/2024-01-18-agu-talk-2023/index.html + 2024-09-17T23:18:59.247Z - https://nasa-openscapes.github.io/news/2024-07-18-openscapes-update/index.html - 2024-09-16T19:52:40.204Z + https://nasa-openscapes.github.io/news/2024-06-06-editorial-published/index.html + 2024-09-17T23:18:59.283Z - https://nasa-openscapes.github.io/news/2024-04-04-nasa-earthdata-aaron-friesz/index.html - 2024-09-16T19:52:40.192Z + https://nasa-openscapes.github.io/news/2023-05-17-mentor-coach/index.html + 2024-09-17T23:18:59.207Z - https://nasa-openscapes.github.io/news/2024-08-30-esip-summer-2024/index.html - 2024-09-16T19:52:40.224Z + https://nasa-openscapes.github.io/news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html + 2024-09-17T23:18:59.235Z - https://nasa-openscapes.github.io/news/2023-02-21-news-february-2023/index.html - 2024-09-16T19:52:40.116Z + https://nasa-openscapes.github.io/news/2024-02-28-earthdata-webinar/index.html + 2024-09-17T23:18:59.255Z https://nasa-openscapes.github.io/news/2023-08-01-nasa-champions/index.html - 2024-09-16T19:52:40.128Z + 2024-09-17T23:18:59.215Z - https://nasa-openscapes.github.io/news/2024-02-28-earthdata-webinar/index.html - 2024-09-16T19:52:40.168Z + https://nasa-openscapes.github.io/news/2023-02-21-news-february-2023/index.html + 2024-09-17T23:18:59.203Z - https://nasa-openscapes.github.io/news/2023-12-07-engaging-with-a-cross-nasa-subcommunity/index.html - 2024-09-16T19:52:40.148Z + https://nasa-openscapes.github.io/news/2024-08-30-esip-summer-2024/index.html + 2024-09-17T23:18:59.311Z - https://nasa-openscapes.github.io/news/2023-05-17-mentor-coach/index.html - 2024-09-16T19:52:40.120Z + https://nasa-openscapes.github.io/news/2024-04-04-nasa-earthdata-aaron-friesz/index.html + 2024-09-17T23:18:59.279Z - https://nasa-openscapes.github.io/news/2024-06-06-editorial-published/index.html - 2024-09-16T19:52:40.196Z + https://nasa-openscapes.github.io/news/2024-07-18-openscapes-update/index.html + 2024-09-17T23:18:59.291Z - https://nasa-openscapes.github.io/news/2024-01-18-agu-talk-2023/index.html - 2024-09-16T19:52:40.160Z + https://nasa-openscapes.github.io/news/2024-07-09-2i2c-shared-password/index.html + 2024-09-17T23:18:59.283Z - https://nasa-openscapes.github.io/news/2024-07-23-esip-summer-2024/index.html - 2024-09-16T19:52:40.212Z + https://nasa-openscapes.github.io/news/2024-02-15-nasa-openscapes-talking-points/index.html + 2024-09-17T23:18:59.251Z - https://nasa-openscapes.github.io/news/2024-04-03-nasa-champions/index.html - 2024-09-16T19:52:40.188Z + https://nasa-openscapes.github.io/news/2023-11-07-coiled-openscapes/index.html + 2024-09-17T23:18:59.235Z - https://nasa-openscapes.github.io/news/2024-07-24-2024-nasa-champions-cohort/index.html - 2024-09-16T19:52:40.216Z + https://nasa-openscapes.github.io/news/2024-07-16-swot-workshop/index.html + 2024-09-17T23:18:59.291Z - https://nasa-openscapes.github.io/news/2023-12-08-coiled-community-call/index.html - 2024-09-16T19:52:40.152Z + https://nasa-openscapes.github.io/news/2024-03-12-nasa-earthdata-webinar/index.html + 2024-09-17T23:18:59.271Z - https://nasa-openscapes.github.io/news/2023-12-10-agu-fall-meeting/index.html - 2024-09-16T19:52:40.156Z + https://nasa-openscapes.github.io/news/2024-02-26-esds-tech-spotlight/index.html + 2024-09-17T23:18:59.255Z - https://nasa-openscapes.github.io/news/2023-05-31-zenodo-community/index.html - 2024-09-16T19:52:40.124Z + https://nasa-openscapes.github.io/news/2022-12-31-previous-news/index.html + 2024-09-17T23:18:59.203Z - https://nasa-openscapes.github.io/news/2023-05-11-pathway-cloud-computing/index.html - 2024-09-16T19:52:40.116Z + https://nasa-openscapes.github.io/news/2023-10-17-matlab-on-openscapes/index.html + 2024-09-17T23:18:59.231Z - https://nasa-openscapes.github.io/news/2024-03-04-earthaccess-tech-spotlight/index.html - 2024-09-16T19:52:40.180Z + https://nasa-openscapes.github.io/news/2024-02-20-github-calendaring/index.html + 2024-09-17T23:18:59.255Z - https://nasa-openscapes.github.io/news/2024-03-14-emit-methane/index.html - 2024-09-16T19:52:40.188Z + https://nasa-openscapes.github.io/news/2024-02-28-github-community-call/index.html + 2024-09-17T23:18:59.259Z - https://nasa-openscapes.github.io/news/2024-05-14-noaa-edmw/index.html - 2024-09-16T19:52:40.192Z + https://nasa-openscapes.github.io/news/2022-05-12-nasa-2022-champions/index.html + 2024-09-17T23:18:59.195Z + + + https://nasa-openscapes.github.io/news/2024-09-17-news-sep-2024/index.html + 2024-09-17T23:18:59.319Z https://nasa-openscapes.github.io/news/2023-03-16-esip-winter-2023/index.html - 2024-09-16T19:52:40.116Z + 2024-09-17T23:18:59.203Z https://nasa-openscapes.github.io/news/2024-07-22-aronne-merrelli-fledging-parallelized-science-in-the-cloud/index.html - 2024-09-16T19:52:40.208Z + 2024-09-17T23:18:59.295Z https://nasa-openscapes.github.io/news/2024-09-10-nasa-pi-plenary/index.html - 2024-09-16T19:52:40.232Z + 2024-09-17T23:18:59.319Z https://nasa-openscapes.github.io/events.html - 2024-09-16T19:52:40.092Z + 2024-09-17T23:18:59.179Z https://nasa-openscapes.github.io/news.html - 2024-09-16T19:52:40.108Z + 2024-09-17T23:18:59.195Z https://nasa-openscapes.github.io/index.html - 2024-09-16T19:52:40.108Z + 2024-09-17T23:18:59.195Z