Skip to content

Commit

Permalink
Built site for gh-pages
Browse files Browse the repository at this point in the history
  • Loading branch information
Quarto GHA Workflow Runner committed Jun 5, 2024
1 parent 4f2ff96 commit d747f2b
Show file tree
Hide file tree
Showing 4 changed files with 103 additions and 91 deletions.
2 changes: 1 addition & 1 deletion .nojekyll
Original file line number Diff line number Diff line change
@@ -1 +1 @@
f10095fc
9120d8eb
26 changes: 19 additions & 7 deletions how-tos/access-data/access-command-line.html
Original file line number Diff line number Diff line change
Expand Up @@ -570,13 +570,25 @@ <h1 class="title">How do I access data stored in Earthdata Cloud with cURL and W
</header>

<p><a href="https://urs.earthdata.nasa.gov/documentation/for_users/data_access/curl_and_wget">How To Access Data With cURL And Wget</a> provides an step-by-step instruction on how to bulk download data from NASA EOSDIS DAACs using <a href="https://www.gnu.org/software/wget/">wget</a> and <a href="https://curl.se/">cURL</a> from the command line.</p>
<p>This section provides additional recommendations relevant to bulk downloading data using wget/cURL. The existing documentation will be updated with these additional notes in future. - You need to <a href="https://ftp.gnu.org/gnu/wget/">install wget</a> or <a href="https://curl.se/download.html">install cURL</a> before diving into this documentation. - View <a href="https://developer.zendesk.com/documentation/api-basics/getting-started/installing-and-using-curl/#installing-curl">installing curl instructions</a> and <a href="http://wget.addictivecode.org/FrequentlyAskedQuestions.html#download">Frequently Asked Questions About Downloading GNU Wget</a> for more details. - You also need to save download link(s) for your data as a text file using <a href="https://search.earthdata.nasa.gov/search">Nasa Earthdata Search</a> or <a href="https://www.earthdata.nasa.gov/eosdis/science-system-description/eosdis-components/cmr">Common Metadata Repository (CMR)</a> API. - Navigate to the directory you want to save the data using <code>cd Insert_Your_Directory</code>. - To bulk download multiple files using cURL try: <code>text xargs -n 1 curl -O -b ~/.urs_cookies -c ~/.urs_cookies -L -n &lt; Insert_Text_File</code> - If you experience authentication issues working with wget, try creating .wgetrc file in your home directory/user profile as suggested in <a href="https://urs.earthdata.nasa.gov/documentation/for_users/data_access/troubleshooting_wget">Troubleshooting wget</a>.</p>
<p>To Create a .wgetrc file in the command line, enter the following in Terminal.<br>
- Windows<br>
<code>text NUL &gt;&gt; .wgetrc</code> - MacOS or Linux<br>
<code>text touch .wgetrc | chmod og-rw .wgetrc</code> To insert your NASA Earthdata Login username and password into the file, enter the following in the Command Prompt and replace your username and password.</p>
<pre class="text"><code>echo http-user=Insert_Your_Username &gt;&gt; .wgetrc | echo http-password=Insert_Your_Password &gt;&gt; .wgetrc</code></pre>
<p>After creating .wgetrc file in your home directory/user profile, for downloading a single file try: <code>text wget Insert_the_Download_Link</code> For downloading multiple files try: <code>text wget -i Insert_Text_File</code></p>
<p>This section provides additional recommendations relevant to bulk downloading data using wget/cURL. The existing documentation will be updated with these additional notes in future.</p>
<p>You need to <a href="https://ftp.gnu.org/gnu/wget/">install wget</a> or <a href="https://curl.se/download.html">install cURL</a> before diving into this documentation. View <a href="https://developer.zendesk.com/documentation/api-basics/getting-started/installing-and-using-curl/#installing-curl">installing curl instructions</a> and <a href="http://wget.addictivecode.org/FrequentlyAskedQuestions.html#download">Frequently Asked Questions About Downloading GNU Wget</a> for more details.</p>
<p>You also need to save download link(s) for your data as a text file using <a href="https://search.earthdata.nasa.gov/search">Nasa Earthdata Search</a> or <a href="https://www.earthdata.nasa.gov/eosdis/science-system-description/eosdis-components/cmr">Common Metadata Repository (CMR)</a> API.</p>
<p>Navigate to the directory you want to save the data using <code>cd YOUR_DIRECTORY_NAME</code>.</p>
<p>To bulk download multiple files using cURL try:</p>
<pre><code>xargs -n 1 curl -O -b ~/.urs_cookies -c ~/.urs_cookies -L -n &lt; YOUR_FILENAME</code></pre>
<p>If you experience authentication issues working with wget, try creating .wgetrc file in your home directory/user profile as suggested in <a href="https://urs.earthdata.nasa.gov/documentation/for_users/data_access/troubleshooting_wget">Troubleshooting wget</a>.</p>
<p>To create a .wgetrc file in the command line, enter the following in Terminal.</p>
<p>Windows</p>
<pre><code>NUL &gt;&gt; .wgetrc </code></pre>
<p>MacOS or Linux</p>
<pre><code>touch .wgetrc | chmod og-rw .wgetrc</code></pre>
<p>To insert your NASA Earthdata Login username and password into the file, enter the following in the Command Prompt and replace your username and password.</p>
<pre><code>echo http-user=YOUR_USERNAME &gt;&gt; .wgetrc | echo
http-password=YOUR_PASSWORD &gt;&gt; .wgetrc</code></pre>
<p>After creating .wgetrc file in your home directory/user profile, for downloading a single file try:</p>
<pre><code>wget YOUR_DOWNLOAD_LINK</code></pre>
<p>For downloading multiple files try:</p>
<pre><code>wget -i YOUR_FILENAME</code></pre>



Expand Down
2 changes: 1 addition & 1 deletion search.json
Original file line number Diff line number Diff line change
Expand Up @@ -2741,7 +2741,7 @@
"href": "how-tos/access-data/access-command-line.html",
"title": "How do I access data stored in Earthdata Cloud with cURL and Wget?",
"section": "",
"text": "How To Access Data With cURL And Wget provides an step-by-step instruction on how to bulk download data from NASA EOSDIS DAACs using wget and cURL from the command line.\nThis section provides additional recommendations relevant to bulk downloading data using wget/cURL. The existing documentation will be updated with these additional notes in future. - You need to install wget or install cURL before diving into this documentation. - View installing curl instructions and Frequently Asked Questions About Downloading GNU Wget for more details. - You also need to save download link(s) for your data as a text file using Nasa Earthdata Search or Common Metadata Repository (CMR) API. - Navigate to the directory you want to save the data using cd Insert_Your_Directory. - To bulk download multiple files using cURL try: text xargs -n 1 curl -O -b ~/.urs_cookies -c ~/.urs_cookies -L -n &lt; Insert_Text_File - If you experience authentication issues working with wget, try creating .wgetrc file in your home directory/user profile as suggested in Troubleshooting wget.\nTo Create a .wgetrc file in the command line, enter the following in Terminal.\n- Windows\ntext NUL &gt;&gt; .wgetrc - MacOS or Linux\ntext touch .wgetrc | chmod og-rw .wgetrc To insert your NASA Earthdata Login username and password into the file, enter the following in the Command Prompt and replace your username and password.\necho http-user=Insert_Your_Username &gt;&gt; .wgetrc | echo http-password=Insert_Your_Password &gt;&gt; .wgetrc\nAfter creating .wgetrc file in your home directory/user profile, for downloading a single file try: text wget Insert_the_Download_Link For downloading multiple files try: text wget -i Insert_Text_File"
"text": "How To Access Data With cURL And Wget provides an step-by-step instruction on how to bulk download data from NASA EOSDIS DAACs using wget and cURL from the command line.\nThis section provides additional recommendations relevant to bulk downloading data using wget/cURL. The existing documentation will be updated with these additional notes in future.\nYou need to install wget or install cURL before diving into this documentation. View installing curl instructions and Frequently Asked Questions About Downloading GNU Wget for more details.\nYou also need to save download link(s) for your data as a text file using Nasa Earthdata Search or Common Metadata Repository (CMR) API.\nNavigate to the directory you want to save the data using cd YOUR_DIRECTORY_NAME.\nTo bulk download multiple files using cURL try:\nxargs -n 1 curl -O -b ~/.urs_cookies -c ~/.urs_cookies -L -n &lt; YOUR_FILENAME\nIf you experience authentication issues working with wget, try creating .wgetrc file in your home directory/user profile as suggested in Troubleshooting wget.\nTo create a .wgetrc file in the command line, enter the following in Terminal.\nWindows\nNUL &gt;&gt; .wgetrc \nMacOS or Linux\ntouch .wgetrc | chmod og-rw .wgetrc\nTo insert your NASA Earthdata Login username and password into the file, enter the following in the Command Prompt and replace your username and password.\necho http-user=YOUR_USERNAME &gt;&gt; .wgetrc | echo\nhttp-password=YOUR_PASSWORD &gt;&gt; .wgetrc\nAfter creating .wgetrc file in your home directory/user profile, for downloading a single file try:\nwget YOUR_DOWNLOAD_LINK\nFor downloading multiple files try:\nwget -i YOUR_FILENAME"
},
{
"objectID": "how-tos/find-data/earthdata_search.html",
Expand Down
Loading

0 comments on commit d747f2b

Please sign in to comment.