data-exploration/notebooks/usda-data-exploration.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# USDA Data Exploration\n",
    "USDA’s Foreign Agricultural Service data API portal provides users the ability to obtain programmatic access to publicly available agricultural commodity data from the Export Sales Report (ESR), Global Agricultural Trade System (GATS), and Production, Supply & Distribution (PSD) databases. This notebook explores ESR and PSD data. More information about these data sources [can be found here.](https://apps.fas.usda.gov/opendataweb/about)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "# general imports\n",
    "import cmath\n",
    "import numpy as np\n",
    "import pandas as pd\n",
    "import streamlit as st\n",
    "import requests\n",
    "import geopandas as gpd\n",
    "from datetime import date"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## USDA Export Sales Report (ESR) Data\n",
    "USDA's Export Sales Reporting Program monitors U.S. agricultural export sales on a daily and weekly basis. Export sales reporting provides a constant stream of up-to-date market information for 40 U.S. agricultural commodities sold abroad.\n",
    "\n",
    "A single statistic reveals the significance of the program: in a typical year, the program monitors more than 40 percent of total U.S. agricultural exports. The program also serves as an early alert on the possible impact foreign sales have on U.S. supplies and prices.\n",
    "\n",
    "The weekly U.S. Export Sales report is the most currently available source of U.S. export sales data. The data is used to analyze the overall level of export demand, determine where markets exist, and assess the relative position of U.S. commodities in foreign markets."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "from requests.auth import HTTPBasicAuth\n",
    "# function that gets data from USDA endpoint and converts response to pandas dataframe\n",
    "def get_usda_data(endpoint_url):\n",
    "    # USDA API Key\n",
    "    key = {\"API_KEY\": \"aefd68b9-cfdc-4c9e-a800-b457ff5adade\"}\n",
    "    request = requests.get(url=endpoint_url, headers=key)\n",
    "    # convert response to pandas dataframe\n",
    "    return (pd.read_json(request.text))\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "# Basic endpoints. See below for endpoints that return data commodity and country specific data\n",
    "regions_url = \"https://apps.fas.usda.gov/OpenData/api/esr/regions\"\n",
    "country_url = \"https://apps.fas.usda.gov/OpenData/api/esr/countries\"\n",
    "data_release_url = \"https://apps.fas.usda.gov/OpenData/api/esr/datareleasedates\"\n",
    "commodity_url = \"https://apps.fas.usda.gov/OpenData/api/esr/commodities\"\n",
    "units_url = \"https://apps.fas.usda.gov/OpenData/api/esr/unitsOfMeasure\"\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>regionId</th>\n",
       "      <th>regionName</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>EUROPEAN UNION - 27</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>OTHER EUROPE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>EASTERN EUROPE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>FORMER SOVIET UNION-12</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>JAPAN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>6</td>\n",
       "      <td>TAIWAN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>7</td>\n",
       "      <td>CHINA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8</td>\n",
       "      <td>INDIA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>9</td>\n",
       "      <td>OTHER ASIA AND OCEANIA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>10</td>\n",
       "      <td>AFRICA</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>11</td>\n",
       "      <td>WESTERN HEMISPHERE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>99</td>\n",
       "      <td>UNKNOWN</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    regionId                      regionName\n",
       "0          1  EUROPEAN UNION - 27           \n",
       "1          2  OTHER EUROPE                  \n",
       "2          3  EASTERN EUROPE                \n",
       "3          4  FORMER SOVIET UNION-12        \n",
       "4          5  JAPAN                         \n",
       "5          6  TAIWAN                        \n",
       "6          7  CHINA                         \n",
       "7          8  INDIA                         \n",
       "8          9  OTHER ASIA AND OCEANIA        \n",
       "9         10  AFRICA                        \n",
       "10        11  WESTERN HEMISPHERE            \n",
       "11        99  UNKNOWN                       "
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Regions with Region ID's\n",
    "get_usda_data(regions_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 60,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>countryCode</th>\n",
       "      <th>countryName</th>\n",
       "      <th>countryDescription</th>\n",
       "      <th>regionId</th>\n",
       "      <th>gencCode</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>EUROPEAN</td>\n",
       "      <td>EUROPEAN UNION - 27</td>\n",
       "      <td>1</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>UNKNOWN</td>\n",
       "      <td>UNKNOWN</td>\n",
       "      <td>99</td>\n",
       "      <td>AX1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>1010</td>\n",
       "      <td>GREENLD</td>\n",
       "      <td>GREENLAND</td>\n",
       "      <td>11</td>\n",
       "      <td>GRL</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>1220</td>\n",
       "      <td>CANADA</td>\n",
       "      <td>CANADA</td>\n",
       "      <td>11</td>\n",
       "      <td>CAN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>1610</td>\n",
       "      <td>MIGUEL</td>\n",
       "      <td>ST. PIERRE AND MIQUELON</td>\n",
       "      <td>11</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>205</th>\n",
       "      <td>9350</td>\n",
       "      <td>GUAM</td>\n",
       "      <td>GUAM</td>\n",
       "      <td>9</td>\n",
       "      <td>GUM</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>206</th>\n",
       "      <td>9410</td>\n",
       "      <td>CAN EN I</td>\n",
       "      <td>CANTON AND ENDERBURY ISLANDS</td>\n",
       "      <td>9</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>207</th>\n",
       "      <td>9510</td>\n",
       "      <td>AM SAMOA</td>\n",
       "      <td>AMERICAN SAMOA</td>\n",
       "      <td>9</td>\n",
       "      <td>ASM</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>208</th>\n",
       "      <td>9610</td>\n",
       "      <td>NMARIANA</td>\n",
       "      <td>NORTHERN MARIANA ISLANDS</td>\n",
       "      <td>9</td>\n",
       "      <td>MNP</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>209</th>\n",
       "      <td>9800</td>\n",
       "      <td>US O IS</td>\n",
       "      <td>US MINOR OUTLYING ISLAND</td>\n",
       "      <td>9</td>\n",
       "      <td>None</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>210 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "     countryCode countryName               countryDescription  regionId  \\\n",
       "0              1    EUROPEAN   EUROPEAN UNION - 27                    1   \n",
       "1              2     UNKNOWN                          UNKNOWN        99   \n",
       "2           1010    GREENLD   GREENLAND                              11   \n",
       "3           1220    CANADA    CANADA                                 11   \n",
       "4           1610    MIGUEL    ST. PIERRE AND MIQUELON                11   \n",
       "..           ...         ...                              ...       ...   \n",
       "205         9350    GUAM      GUAM                                    9   \n",
       "206         9410    CAN EN I  CANTON AND ENDERBURY ISLANDS            9   \n",
       "207         9510    AM SAMOA  AMERICAN SAMOA                          9   \n",
       "208         9610    NMARIANA  NORTHERN MARIANA ISLANDS                9   \n",
       "209         9800    US O IS   US MINOR OUTLYING ISLAND                9   \n",
       "\n",
       "    gencCode  \n",
       "0       None  \n",
       "1        AX1  \n",
       "2        GRL  \n",
       "3        CAN  \n",
       "4       None  \n",
       "..       ...  \n",
       "205      GUM  \n",
       "206     None  \n",
       "207      ASM  \n",
       "208      MNP  \n",
       "209     None  \n",
       "\n",
       "[210 rows x 5 columns]"
      ]
     },
     "execution_count": 60,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "get_usda_data(country_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>commodityName</th>\n",
       "      <th>unitId</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>101</td>\n",
       "      <td>Wheat - HRW</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>102</td>\n",
       "      <td>Wheat - SRW</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>103</td>\n",
       "      <td>Wheat - HRS</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>104</td>\n",
       "      <td>Wheat - White</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>105</td>\n",
       "      <td>Wheat - Durum</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>106</td>\n",
       "      <td>Wheat - Mixed</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>107</td>\n",
       "      <td>All Wheat</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>201</td>\n",
       "      <td>Wheat Products</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>301</td>\n",
       "      <td>Barley</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>401</td>\n",
       "      <td>Corn</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>501</td>\n",
       "      <td>Rye</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>601</td>\n",
       "      <td>Oats</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>701</td>\n",
       "      <td>Sorghum</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>801</td>\n",
       "      <td>Soybeans</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>901</td>\n",
       "      <td>Soybean cake &amp; meal</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>902</td>\n",
       "      <td>Soybean Oil</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>1001</td>\n",
       "      <td>Flaxseed</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>1101</td>\n",
       "      <td>Linseed Oil</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>1110</td>\n",
       "      <td>Sunflowerseed Oil</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>1201</td>\n",
       "      <td>Cottonseed</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>1202</td>\n",
       "      <td>Cottonseed cake &amp; meal</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>1203</td>\n",
       "      <td>Cottonseed Oil</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>1301</td>\n",
       "      <td>Cotton- Am Pima</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>1401</td>\n",
       "      <td>Cotton- Upland 1 1/16\" &amp; over</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>1402</td>\n",
       "      <td>Cotton- Upland 1\"-1 1/16\" &amp; over</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>1403</td>\n",
       "      <td>Cotton- Upland under 1\"</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>1404</td>\n",
       "      <td>All Upland Cotton</td>\n",
       "      <td>2</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>1498</td>\n",
       "      <td>Rice - LG Rough</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>1499</td>\n",
       "      <td>Rice- Med, Short,Other Rough</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>1501</td>\n",
       "      <td>Rice- LG Brown</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>1502</td>\n",
       "      <td>Rice- Med,Short, Other Brown</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>1503</td>\n",
       "      <td>Rice - Long Grain, Milled</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>1504</td>\n",
       "      <td>Rice- Med,Short,Other Milled</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>1505</td>\n",
       "      <td>All Rice</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>1601</td>\n",
       "      <td>Cattle Hides - Whole - Excluding Wet Blues</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>1602</td>\n",
       "      <td>Calf Skins - Whole - Excluding Wet Blues</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>1603</td>\n",
       "      <td>Kip Skins - Whole - Excluding Wet Blues</td>\n",
       "      <td>3</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>1604</td>\n",
       "      <td>Cattle Hides-Cut into Croupons, etc-excl Wet B...</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>1605</td>\n",
       "      <td>Cattle Hides and Skins-other-excluding Wet Blues</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>1606</td>\n",
       "      <td>Cattle Wet Blues-Unsplit (Whole or Sided)</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>1607</td>\n",
       "      <td>Cattle Wet Blues-Grain Splits (Whole or Sided)</td>\n",
       "      <td>4</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>1608</td>\n",
       "      <td>Cattle Wet Blues-Splits-Excluding Grain Splits</td>\n",
       "      <td>5</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>1701</td>\n",
       "      <td>Fresh, Chilled, or Frozen Muscle Cuts of Beef</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>1702</td>\n",
       "      <td>Fresh, Chilled, or Frozen Muscle Cuts of Pork</td>\n",
       "      <td>1</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    commodityCode                                      commodityName  unitId\n",
       "0             101                                        Wheat - HRW       1\n",
       "1             102                                        Wheat - SRW       1\n",
       "2             103                                        Wheat - HRS       1\n",
       "3             104                                      Wheat - White       1\n",
       "4             105                                      Wheat - Durum       1\n",
       "5             106                                      Wheat - Mixed       1\n",
       "6             107                                          All Wheat       1\n",
       "7             201                                     Wheat Products       1\n",
       "8             301                                             Barley       1\n",
       "9             401                                               Corn       1\n",
       "10            501                                                Rye       1\n",
       "11            601                                               Oats       1\n",
       "12            701                                            Sorghum       1\n",
       "13            801                                           Soybeans       1\n",
       "14            901                                Soybean cake & meal       1\n",
       "15            902                                        Soybean Oil       1\n",
       "16           1001                                           Flaxseed       1\n",
       "17           1101                                        Linseed Oil       1\n",
       "18           1110                                  Sunflowerseed Oil       1\n",
       "19           1201                                         Cottonseed       1\n",
       "20           1202                             Cottonseed cake & meal       1\n",
       "21           1203                                     Cottonseed Oil       1\n",
       "22           1301                                    Cotton- Am Pima       2\n",
       "23           1401                      Cotton- Upland 1 1/16\" & over       2\n",
       "24           1402                   Cotton- Upland 1\"-1 1/16\" & over       2\n",
       "25           1403                            Cotton- Upland under 1\"       2\n",
       "26           1404                                  All Upland Cotton       2\n",
       "27           1498                                    Rice - LG Rough       1\n",
       "28           1499                       Rice- Med, Short,Other Rough       1\n",
       "29           1501                                     Rice- LG Brown       1\n",
       "30           1502                       Rice- Med,Short, Other Brown       1\n",
       "31           1503                          Rice - Long Grain, Milled       1\n",
       "32           1504                       Rice- Med,Short,Other Milled       1\n",
       "33           1505                                           All Rice       1\n",
       "34           1601         Cattle Hides - Whole - Excluding Wet Blues       3\n",
       "35           1602           Calf Skins - Whole - Excluding Wet Blues       3\n",
       "36           1603            Kip Skins - Whole - Excluding Wet Blues       3\n",
       "37           1604  Cattle Hides-Cut into Croupons, etc-excl Wet B...       4\n",
       "38           1605   Cattle Hides and Skins-other-excluding Wet Blues       5\n",
       "39           1606          Cattle Wet Blues-Unsplit (Whole or Sided)       4\n",
       "40           1607     Cattle Wet Blues-Grain Splits (Whole or Sided)       4\n",
       "41           1608     Cattle Wet Blues-Splits-Excluding Grain Splits       5\n",
       "42           1701      Fresh, Chilled, or Frozen Muscle Cuts of Beef       1\n",
       "43           1702      Fresh, Chilled, or Frozen Muscle Cuts of Pork       1"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "get_usda_data(commodity_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 75,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>marketYearStart</th>\n",
       "      <th>marketYearEnd</th>\n",
       "      <th>marketYear</th>\n",
       "      <th>releaseTimeStamp</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>101</td>\n",
       "      <td>2022-06-01T00:00:00</td>\n",
       "      <td>2023-05-31T00:00:00</td>\n",
       "      <td>2023</td>\n",
       "      <td>2022-07-28T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>102</td>\n",
       "      <td>2022-06-01T00:00:00</td>\n",
       "      <td>2023-05-31T00:00:00</td>\n",
       "      <td>2023</td>\n",
       "      <td>2022-07-28T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>103</td>\n",
       "      <td>2022-06-01T00:00:00</td>\n",
       "      <td>2023-05-31T00:00:00</td>\n",
       "      <td>2023</td>\n",
       "      <td>2022-07-28T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>104</td>\n",
       "      <td>2022-06-01T00:00:00</td>\n",
       "      <td>2023-05-31T00:00:00</td>\n",
       "      <td>2023</td>\n",
       "      <td>2022-07-28T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>105</td>\n",
       "      <td>2022-06-01T00:00:00</td>\n",
       "      <td>2023-05-31T00:00:00</td>\n",
       "      <td>2023</td>\n",
       "      <td>2022-07-28T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>999</th>\n",
       "      <td>1602</td>\n",
       "      <td>1998-01-01T00:00:00</td>\n",
       "      <td>1998-12-31T00:00:00</td>\n",
       "      <td>1998</td>\n",
       "      <td>1999-01-07T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1000</th>\n",
       "      <td>1603</td>\n",
       "      <td>1998-01-01T00:00:00</td>\n",
       "      <td>1998-12-31T00:00:00</td>\n",
       "      <td>1998</td>\n",
       "      <td>1999-01-07T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1001</th>\n",
       "      <td>1606</td>\n",
       "      <td>1998-01-01T00:00:00</td>\n",
       "      <td>1998-12-31T00:00:00</td>\n",
       "      <td>1998</td>\n",
       "      <td>1999-01-07T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1002</th>\n",
       "      <td>1607</td>\n",
       "      <td>1998-01-01T00:00:00</td>\n",
       "      <td>1998-12-31T00:00:00</td>\n",
       "      <td>1998</td>\n",
       "      <td>1999-01-07T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1003</th>\n",
       "      <td>1608</td>\n",
       "      <td>1998-01-01T00:00:00</td>\n",
       "      <td>1998-12-31T00:00:00</td>\n",
       "      <td>1998</td>\n",
       "      <td>1999-01-07T00:00:00</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1004 rows × 5 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      commodityCode      marketYearStart        marketYearEnd  marketYear  \\\n",
       "0               101  2022-06-01T00:00:00  2023-05-31T00:00:00        2023   \n",
       "1               102  2022-06-01T00:00:00  2023-05-31T00:00:00        2023   \n",
       "2               103  2022-06-01T00:00:00  2023-05-31T00:00:00        2023   \n",
       "3               104  2022-06-01T00:00:00  2023-05-31T00:00:00        2023   \n",
       "4               105  2022-06-01T00:00:00  2023-05-31T00:00:00        2023   \n",
       "...             ...                  ...                  ...         ...   \n",
       "999            1602  1998-01-01T00:00:00  1998-12-31T00:00:00        1998   \n",
       "1000           1603  1998-01-01T00:00:00  1998-12-31T00:00:00        1998   \n",
       "1001           1606  1998-01-01T00:00:00  1998-12-31T00:00:00        1998   \n",
       "1002           1607  1998-01-01T00:00:00  1998-12-31T00:00:00        1998   \n",
       "1003           1608  1998-01-01T00:00:00  1998-12-31T00:00:00        1998   \n",
       "\n",
       "         releaseTimeStamp  \n",
       "0     2022-07-28T00:00:00  \n",
       "1     2022-07-28T00:00:00  \n",
       "2     2022-07-28T00:00:00  \n",
       "3     2022-07-28T00:00:00  \n",
       "4     2022-07-28T00:00:00  \n",
       "...                   ...  \n",
       "999   1999-01-07T00:00:00  \n",
       "1000  1999-01-07T00:00:00  \n",
       "1001  1999-01-07T00:00:00  \n",
       "1002  1999-01-07T00:00:00  \n",
       "1003  1999-01-07T00:00:00  \n",
       "\n",
       "[1004 rows x 5 columns]"
      ]
     },
     "execution_count": 75,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "get_usda_data(data_release_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 63,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>unitId</th>\n",
       "      <th>unitNames</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>Metric Tons</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>Running Bales</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>Pieces</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>NUMBER</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>Pounds</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   unitId      unitNames\n",
       "0       1    Metric Tons\n",
       "1       2  Running Bales\n",
       "2       3         Pieces\n",
       "3       4         NUMBER\n",
       "4       5         Pounds"
      ]
     },
     "execution_count": 63,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# Units of commodities referenced in chart above.\n",
    "get_usda_data(units_url)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Given Commodity Code (Ex: 107 for \"All Wheat\") and MarketYear (Ex: 2021) this API End point will return a list of US Export records of White Wheat to all applicable countries from USA for the given Market Year. See DataReleaseDates end point to get a list of all Commodities and the corresponding Market Year data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 70,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>countryCode</th>\n",
       "      <th>weeklyExports</th>\n",
       "      <th>accumulatedExports</th>\n",
       "      <th>outstandingSales</th>\n",
       "      <th>grossNewSales</th>\n",
       "      <th>currentMYNetSales</th>\n",
       "      <th>currentMYTotalCommitment</th>\n",
       "      <th>nextMYOutstandingSales</th>\n",
       "      <th>nextMYNetSales</th>\n",
       "      <th>unitId</th>\n",
       "      <th>weekEndingDate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>107</td>\n",
       "      <td>1220</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>9266</td>\n",
       "      <td>9266</td>\n",
       "      <td>0</td>\n",
       "      <td>9266</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>107</td>\n",
       "      <td>2010</td>\n",
       "      <td>13506</td>\n",
       "      <td>13506</td>\n",
       "      <td>352846</td>\n",
       "      <td>224335</td>\n",
       "      <td>25376</td>\n",
       "      <td>366352</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>107</td>\n",
       "      <td>2050</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>95999</td>\n",
       "      <td>95999</td>\n",
       "      <td>95999</td>\n",
       "      <td>95999</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>107</td>\n",
       "      <td>2080</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>107</td>\n",
       "      <td>2110</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>10000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>10000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   commodityCode  countryCode  weeklyExports  accumulatedExports  \\\n",
       "0            107         1220              0                   0   \n",
       "1            107         2010          13506               13506   \n",
       "2            107         2050              0                   0   \n",
       "3            107         2080              0                   0   \n",
       "4            107         2110              0                   0   \n",
       "\n",
       "   outstandingSales  grossNewSales  currentMYNetSales  \\\n",
       "0              9266           9266                  0   \n",
       "1            352846         224335              25376   \n",
       "2             95999          95999              95999   \n",
       "3              4000              0                  0   \n",
       "4             10000              0                  0   \n",
       "\n",
       "   currentMYTotalCommitment  nextMYOutstandingSales  nextMYNetSales  unitId  \\\n",
       "0                      9266                       0               0       1   \n",
       "1                    366352                       0               0       1   \n",
       "2                     95999                       0               0       1   \n",
       "3                      4000                       0               0       1   \n",
       "4                     10000                       0               0       1   \n",
       "\n",
       "        weekEndingDate  \n",
       "0  2020-06-04T00:00:00  \n",
       "1  2020-06-04T00:00:00  \n",
       "2  2020-06-04T00:00:00  \n",
       "3  2020-06-04T00:00:00  \n",
       "4  2020-06-04T00:00:00  "
      ]
     },
     "execution_count": 70,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# return first 5 rows for \"All Wheat\" in 2021\n",
    "wheat_url = \"https://apps.fas.usda.gov/OpenData/api/esr/exports/commodityCode/107/allCountries/marketYear/2021\"\n",
    "get_usda_data(wheat_url).head(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Given Commodity Code (Ex: 107 for \"All Wheat\"), Country Code (Ex:1220 for Canada) and MarketYear (Ex: 2021) this API End point will return a list of US Export records of White Wheat to Canada from USA for the give Market Year. Please see DataReleaseDates end point to get a list of all Commodities and the corresponding Market Year data."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 73,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>countryCode</th>\n",
       "      <th>weeklyExports</th>\n",
       "      <th>accumulatedExports</th>\n",
       "      <th>outstandingSales</th>\n",
       "      <th>grossNewSales</th>\n",
       "      <th>currentMYNetSales</th>\n",
       "      <th>currentMYTotalCommitment</th>\n",
       "      <th>nextMYOutstandingSales</th>\n",
       "      <th>nextMYNetSales</th>\n",
       "      <th>unitId</th>\n",
       "      <th>weekEndingDate</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>107</td>\n",
       "      <td>1220</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>9266</td>\n",
       "      <td>9266</td>\n",
       "      <td>0</td>\n",
       "      <td>9266</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>107</td>\n",
       "      <td>2010</td>\n",
       "      <td>13506</td>\n",
       "      <td>13506</td>\n",
       "      <td>352846</td>\n",
       "      <td>224335</td>\n",
       "      <td>25376</td>\n",
       "      <td>366352</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>107</td>\n",
       "      <td>2050</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>95999</td>\n",
       "      <td>95999</td>\n",
       "      <td>95999</td>\n",
       "      <td>95999</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>107</td>\n",
       "      <td>2080</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>4000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>107</td>\n",
       "      <td>2110</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>10000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>10000</td>\n",
       "      <td>0</td>\n",
       "      <td>0</td>\n",
       "      <td>1</td>\n",
       "      <td>2020-06-04T00:00:00</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "   commodityCode  countryCode  weeklyExports  accumulatedExports  \\\n",
       "0            107         1220              0                   0   \n",
       "1            107         2010          13506               13506   \n",
       "2            107         2050              0                   0   \n",
       "3            107         2080              0                   0   \n",
       "4            107         2110              0                   0   \n",
       "\n",
       "   outstandingSales  grossNewSales  currentMYNetSales  \\\n",
       "0              9266           9266                  0   \n",
       "1            352846         224335              25376   \n",
       "2             95999          95999              95999   \n",
       "3              4000              0                  0   \n",
       "4             10000              0                  0   \n",
       "\n",
       "   currentMYTotalCommitment  nextMYOutstandingSales  nextMYNetSales  unitId  \\\n",
       "0                      9266                       0               0       1   \n",
       "1                    366352                       0               0       1   \n",
       "2                     95999                       0               0       1   \n",
       "3                      4000                       0               0       1   \n",
       "4                     10000                       0               0       1   \n",
       "\n",
       "        weekEndingDate  \n",
       "0  2020-06-04T00:00:00  \n",
       "1  2020-06-04T00:00:00  \n",
       "2  2020-06-04T00:00:00  \n",
       "3  2020-06-04T00:00:00  \n",
       "4  2020-06-04T00:00:00  "
      ]
     },
     "execution_count": 73,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# return first 5 rows for \"All Wheat\" in 2021\n",
    "canada_wheat_url = \"https://apps.fas.usda.gov/OpenData/api/esr/exports/commodityCode/107/countryCode/2021/marketYear/1220\"\n",
    "get_usda_data(wheat_url).head(5)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Production, Supply & Distribution (PSD) Data\n",
    "PSD Online is the public repository for USDA’s Official Production, Supply and Distribution forecast data, reports and circulars for key agricultural commodities.\n",
    "\n",
    "FAS's PSD Online data are reviewed and updated monthly by an interagency committee chaired by USDA's World Agricultural Outlook Board (WAOB),and consisting of: the Foreign Agricultural Service (FAS), the Economic Research Service (ERS),the Farm Service Agency (FSA), and the Agricultural Marketing Service (AMS).\n",
    "\n",
    "The international portion of the data is updated with input from agricultural attachés stationed at U.S. embassies around the world, FAS commodity analysts, and country and commodity analysts with ERS. The U.S. domestic component is updated with input from analysts in FAS, ERS, the National Agricultural Statistical Service, and FSA.\n",
    "\n",
    "*Note, country and commodity codes are differen that ESR data*"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 105,
   "metadata": {},
   "outputs": [],
   "source": [
    "psd_com_attributes_url = \"https://apps.fas.usda.gov/OpenData/api/psd/commodityAttributes\"\n",
    "psd_units_url = \"https://apps.fas.usda.gov/OpenData/api/psd/unitsOfMeasure\"\n",
    "psd_com_url = \"https://apps.fas.usda.gov/OpenData/api/psd/commodities\"\n",
    "psd_countries_url = \"https://apps.fas.usda.gov/OpenData/api/psd/countries\"\n",
    "psd_regions_url = \"https://apps.fas.usda.gov/OpenData/api/psd/regions\"\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "ename": "NameError",
     "evalue": "name 'psd_com_attributes_url' is not defined",
     "output_type": "error",
     "traceback": [
      "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m",
      "\u001b[0;31mNameError\u001b[0m                                 Traceback (most recent call last)",
      "\u001b[1;32m/Users/cameronkruse/development/github/food-security/usda-data-exploration.ipynb Cell 17\u001b[0m in \u001b[0;36m<cell line: 1>\u001b[0;34m()\u001b[0m\n\u001b[0;32m----> <a href='vscode-notebook-cell:/Users/cameronkruse/development/github/food-security/usda-data-exploration.ipynb#ch0000016?line=0'>1</a>\u001b[0m get_usda_data(psd_com_attributes_url)\n",
      "\u001b[0;31mNameError\u001b[0m: name 'psd_com_attributes_url' is not defined"
     ]
    }
   ],
   "source": [
    "get_usda_data(psd_com_attributes_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 102,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>unitId</th>\n",
       "      <th>unitDescription</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>1</td>\n",
       "      <td>(1000 BUSHES)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>2</td>\n",
       "      <td>(1000 60 KG BAGS)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>3</td>\n",
       "      <td>(1000 COLONIES)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>4</td>\n",
       "      <td>(1000 HA)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>5</td>\n",
       "      <td>(1000 HEAD)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>6</td>\n",
       "      <td>(1000 HL)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>7</td>\n",
       "      <td>(1000 MT CWE)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>8</td>\n",
       "      <td>(1000 MT)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>9</td>\n",
       "      <td>(1000 PCS)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>10</td>\n",
       "      <td>(1000 TREES)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>11</td>\n",
       "      <td>(Dec. Fraction)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>12</td>\n",
       "      <td>(HA)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>13</td>\n",
       "      <td>(HECTARES)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>14</td>\n",
       "      <td>(KG)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>15</td>\n",
       "      <td>(MIL HEAD)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>16</td>\n",
       "      <td>(MIL PCS)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>17</td>\n",
       "      <td>(MILLION TREES)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>18</td>\n",
       "      <td>(MT RAW EQ)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>19</td>\n",
       "      <td>(MT RAW EW)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>20</td>\n",
       "      <td>(MT RE)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>21</td>\n",
       "      <td>(MT)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>22</td>\n",
       "      <td>(MT, Net Weight)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>23</td>\n",
       "      <td>(PERCENT)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>24</td>\n",
       "      <td>(RATIO)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>25</td>\n",
       "      <td>(1000 CUBIC METERS)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>26</td>\n",
       "      <td>(MT/HA)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>27</td>\n",
       "      <td>1000 480 lb. Bales</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>28</td>\n",
       "      <td>(Bales/HA)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>29</td>\n",
       "      <td>(KG/HA)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>30</td>\n",
       "      <td>ACRES</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>31</td>\n",
       "      <td>BUSHELS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>32</td>\n",
       "      <td>HUNDREDWEIGHT</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>33</td>\n",
       "      <td>MILLING RATE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>34</td>\n",
       "      <td>BUSHELS/TON</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>35</td>\n",
       "      <td>IMPORT MILLING RATE</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>36</td>\n",
       "      <td>Bushels</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>37</td>\n",
       "      <td>SHORT TONS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>38</td>\n",
       "      <td>MILLION LBS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>39</td>\n",
       "      <td>BILLION LBS</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>40</td>\n",
       "      <td>(HEAD)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>41</td>\n",
       "      <td>(PEOPLE)</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    unitId       unitDescription\n",
       "0        1  (1000 BUSHES)       \n",
       "1        2  (1000 60 KG BAGS)   \n",
       "2        3  (1000 COLONIES)     \n",
       "3        4  (1000 HA)           \n",
       "4        5  (1000 HEAD)         \n",
       "5        6  (1000 HL)           \n",
       "6        7  (1000 MT CWE)       \n",
       "7        8  (1000 MT)           \n",
       "8        9  (1000 PCS)          \n",
       "9       10  (1000 TREES)        \n",
       "10      11  (Dec. Fraction)     \n",
       "11      12  (HA)                \n",
       "12      13  (HECTARES)          \n",
       "13      14  (KG)                \n",
       "14      15  (MIL HEAD)          \n",
       "15      16  (MIL PCS)           \n",
       "16      17  (MILLION TREES)     \n",
       "17      18  (MT RAW EQ)         \n",
       "18      19  (MT RAW EW)         \n",
       "19      20  (MT RE)             \n",
       "20      21  (MT)                \n",
       "21      22  (MT, Net Weight)    \n",
       "22      23  (PERCENT)           \n",
       "23      24  (RATIO)             \n",
       "24      25  (1000 CUBIC METERS) \n",
       "25      26  (MT/HA)             \n",
       "26      27  1000 480 lb. Bales  \n",
       "27      28  (Bales/HA)          \n",
       "28      29  (KG/HA)             \n",
       "29      30  ACRES               \n",
       "30      31  BUSHELS             \n",
       "31      32  HUNDREDWEIGHT       \n",
       "32      33  MILLING RATE        \n",
       "33      34  BUSHELS/TON         \n",
       "34      35  IMPORT MILLING RATE \n",
       "35      36  Bushels             \n",
       "36      37  SHORT TONS          \n",
       "37      38  MILLION LBS         \n",
       "38      39  BILLION LBS         \n",
       "39      40  (HEAD)              \n",
       "40      41  (PEOPLE)            "
      ]
     },
     "execution_count": 102,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "get_usda_data(psd_units_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 104,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>commodityName</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>577400</td>\n",
       "      <td>Almonds, Shelled Basis</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>11000</td>\n",
       "      <td>Animal Numbers, Cattle</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>13000</td>\n",
       "      <td>Animal Numbers, Swine</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>574000</td>\n",
       "      <td>Apples, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>430000</td>\n",
       "      <td>Barley</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>579305</td>\n",
       "      <td>Cherries (Sweet&amp;Sour), Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>711100</td>\n",
       "      <td>Coffee, Green</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>440000</td>\n",
       "      <td>Corn</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>2631000</td>\n",
       "      <td>Cotton</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>230000</td>\n",
       "      <td>Dairy, Butter</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>240000</td>\n",
       "      <td>Dairy, Cheese</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>224400</td>\n",
       "      <td>Dairy, Dry Whole Milk Powder</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>223000</td>\n",
       "      <td>Dairy, Milk, Fluid</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>224200</td>\n",
       "      <td>Dairy, Milk, Nonfat Dry</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>572220</td>\n",
       "      <td>Grapefruit, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>15</th>\n",
       "      <td>575100</td>\n",
       "      <td>Grapes, Fresh Table</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>16</th>\n",
       "      <td>572120</td>\n",
       "      <td>Lemons/Limes, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>17</th>\n",
       "      <td>813700</td>\n",
       "      <td>Meal, Copra</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>18</th>\n",
       "      <td>813300</td>\n",
       "      <td>Meal, Cottonseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>19</th>\n",
       "      <td>814200</td>\n",
       "      <td>Meal, Fish</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>20</th>\n",
       "      <td>813800</td>\n",
       "      <td>Meal, Palm Kernel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>21</th>\n",
       "      <td>813200</td>\n",
       "      <td>Meal, Peanut</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>22</th>\n",
       "      <td>813600</td>\n",
       "      <td>Meal, Rapeseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>23</th>\n",
       "      <td>813100</td>\n",
       "      <td>Meal, Soybean</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>24</th>\n",
       "      <td>813101</td>\n",
       "      <td>Meal, Soybean (Local)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>25</th>\n",
       "      <td>813500</td>\n",
       "      <td>Meal, Sunflowerseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>26</th>\n",
       "      <td>111000</td>\n",
       "      <td>Meat, Beef and Veal</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>27</th>\n",
       "      <td>115000</td>\n",
       "      <td>Meat, Chicken</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>28</th>\n",
       "      <td>113000</td>\n",
       "      <td>Meat, Swine</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>29</th>\n",
       "      <td>459100</td>\n",
       "      <td>Millet</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>30</th>\n",
       "      <td>459900</td>\n",
       "      <td>Mixed Grain</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>31</th>\n",
       "      <td>452000</td>\n",
       "      <td>Oats</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>32</th>\n",
       "      <td>4242000</td>\n",
       "      <td>Oil, Coconut</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>33</th>\n",
       "      <td>4233000</td>\n",
       "      <td>Oil, Cottonseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>34</th>\n",
       "      <td>4235000</td>\n",
       "      <td>Oil, Olive</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>35</th>\n",
       "      <td>4243000</td>\n",
       "      <td>Oil, Palm</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>36</th>\n",
       "      <td>4244000</td>\n",
       "      <td>Oil, Palm Kernel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>37</th>\n",
       "      <td>4234000</td>\n",
       "      <td>Oil, Peanut</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>38</th>\n",
       "      <td>4239100</td>\n",
       "      <td>Oil, Rapeseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>39</th>\n",
       "      <td>4232000</td>\n",
       "      <td>Oil, Soybean</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>40</th>\n",
       "      <td>4232001</td>\n",
       "      <td>Oil, Soybean (Local)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>41</th>\n",
       "      <td>4236000</td>\n",
       "      <td>Oil, Sunflowerseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>42</th>\n",
       "      <td>2231000</td>\n",
       "      <td>Oilseed, Copra</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>43</th>\n",
       "      <td>2223000</td>\n",
       "      <td>Oilseed, Cottonseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>44</th>\n",
       "      <td>2232000</td>\n",
       "      <td>Oilseed, Palm Kernel</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>45</th>\n",
       "      <td>2221000</td>\n",
       "      <td>Oilseed, Peanut</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>46</th>\n",
       "      <td>2226000</td>\n",
       "      <td>Oilseed, Rapeseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>47</th>\n",
       "      <td>2222000</td>\n",
       "      <td>Oilseed, Soybean</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>48</th>\n",
       "      <td>2222001</td>\n",
       "      <td>Oilseed, Soybean (Local)</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>49</th>\n",
       "      <td>2224000</td>\n",
       "      <td>Oilseed, Sunflowerseed</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>50</th>\n",
       "      <td>585100</td>\n",
       "      <td>Orange Juice</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>51</th>\n",
       "      <td>571120</td>\n",
       "      <td>Oranges, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>52</th>\n",
       "      <td>579309</td>\n",
       "      <td>Peaches &amp; Nectarines, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>53</th>\n",
       "      <td>579220</td>\n",
       "      <td>Pears, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>54</th>\n",
       "      <td>577907</td>\n",
       "      <td>Pistachios, Inshell Basis</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>55</th>\n",
       "      <td>114200</td>\n",
       "      <td>Poultry, Meat, Broiler</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>56</th>\n",
       "      <td>575200</td>\n",
       "      <td>Raisins</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>57</th>\n",
       "      <td>422110</td>\n",
       "      <td>Rice, Milled</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>58</th>\n",
       "      <td>451000</td>\n",
       "      <td>Rye</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>59</th>\n",
       "      <td>459200</td>\n",
       "      <td>Sorghum</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>60</th>\n",
       "      <td>612000</td>\n",
       "      <td>Sugar, Centrifugal</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>61</th>\n",
       "      <td>571220</td>\n",
       "      <td>Tangerines/Mandarins, Fresh</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>62</th>\n",
       "      <td>577901</td>\n",
       "      <td>Walnuts, Inshell Basis</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>63</th>\n",
       "      <td>410000</td>\n",
       "      <td>Wheat</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    commodityCode                 commodityName\n",
       "0          577400        Almonds, Shelled Basis\n",
       "1           11000        Animal Numbers, Cattle\n",
       "2           13000         Animal Numbers, Swine\n",
       "3          574000                 Apples, Fresh\n",
       "4          430000                        Barley\n",
       "5          579305  Cherries (Sweet&Sour), Fresh\n",
       "6          711100                 Coffee, Green\n",
       "7          440000                          Corn\n",
       "8         2631000                        Cotton\n",
       "9          230000                 Dairy, Butter\n",
       "10         240000                 Dairy, Cheese\n",
       "11         224400  Dairy, Dry Whole Milk Powder\n",
       "12         223000            Dairy, Milk, Fluid\n",
       "13         224200       Dairy, Milk, Nonfat Dry\n",
       "14         572220             Grapefruit, Fresh\n",
       "15         575100           Grapes, Fresh Table\n",
       "16         572120           Lemons/Limes, Fresh\n",
       "17         813700                   Meal, Copra\n",
       "18         813300              Meal, Cottonseed\n",
       "19         814200                    Meal, Fish\n",
       "20         813800             Meal, Palm Kernel\n",
       "21         813200                  Meal, Peanut\n",
       "22         813600                Meal, Rapeseed\n",
       "23         813100                 Meal, Soybean\n",
       "24         813101         Meal, Soybean (Local)\n",
       "25         813500           Meal, Sunflowerseed\n",
       "26         111000           Meat, Beef and Veal\n",
       "27         115000                 Meat, Chicken\n",
       "28         113000                   Meat, Swine\n",
       "29         459100                        Millet\n",
       "30         459900                   Mixed Grain\n",
       "31         452000                          Oats\n",
       "32        4242000                  Oil, Coconut\n",
       "33        4233000               Oil, Cottonseed\n",
       "34        4235000                    Oil, Olive\n",
       "35        4243000                     Oil, Palm\n",
       "36        4244000              Oil, Palm Kernel\n",
       "37        4234000                   Oil, Peanut\n",
       "38        4239100                 Oil, Rapeseed\n",
       "39        4232000                  Oil, Soybean\n",
       "40        4232001          Oil, Soybean (Local)\n",
       "41        4236000            Oil, Sunflowerseed\n",
       "42        2231000                Oilseed, Copra\n",
       "43        2223000           Oilseed, Cottonseed\n",
       "44        2232000          Oilseed, Palm Kernel\n",
       "45        2221000               Oilseed, Peanut\n",
       "46        2226000             Oilseed, Rapeseed\n",
       "47        2222000              Oilseed, Soybean\n",
       "48        2222001      Oilseed, Soybean (Local)\n",
       "49        2224000        Oilseed, Sunflowerseed\n",
       "50         585100                  Orange Juice\n",
       "51         571120                Oranges, Fresh\n",
       "52         579309   Peaches & Nectarines, Fresh\n",
       "53         579220                  Pears, Fresh\n",
       "54         577907     Pistachios, Inshell Basis\n",
       "55         114200        Poultry, Meat, Broiler\n",
       "56         575200                       Raisins\n",
       "57         422110                  Rice, Milled\n",
       "58         451000                           Rye\n",
       "59         459200                       Sorghum\n",
       "60         612000            Sugar, Centrifugal\n",
       "61         571220   Tangerines/Mandarins, Fresh\n",
       "62         577901        Walnuts, Inshell Basis\n",
       "63         410000                         Wheat"
      ]
     },
     "execution_count": 104,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "get_usda_data(psd_com_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "get_usda_data(psd_regions_url)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "get_usda_data(psd_countries_url)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Returns a set of records with Forecast number for a given Commodity Code (Ex, 0440000 for Corn) and a given Market Year (Ex, 2017) for all applicable countries. PSD Database has data for most commodities since year 1960. Please see Commodities end point to get a list of all PSD Commodities with corresponding Commodity Code."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 129,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>countryCode</th>\n",
       "      <th>marketYear</th>\n",
       "      <th>calendarYear</th>\n",
       "      <th>month</th>\n",
       "      <th>attributeId</th>\n",
       "      <th>unitId</th>\n",
       "      <th>value</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>440000</td>\n",
       "      <td>AF</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>5</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>130.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>440000</td>\n",
       "      <td>AF</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>5</td>\n",
       "      <td>20</td>\n",
       "      <td>8</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>440000</td>\n",
       "      <td>AF</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>5</td>\n",
       "      <td>28</td>\n",
       "      <td>8</td>\n",
       "      <td>220.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>440000</td>\n",
       "      <td>AF</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>5</td>\n",
       "      <td>57</td>\n",
       "      <td>8</td>\n",
       "      <td>5.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>440000</td>\n",
       "      <td>AF</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>5</td>\n",
       "      <td>81</td>\n",
       "      <td>8</td>\n",
       "      <td>5.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>...</th>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "      <td>...</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1870</th>\n",
       "      <td>440000</td>\n",
       "      <td>ZA</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>192</td>\n",
       "      <td>8</td>\n",
       "      <td>2100.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1871</th>\n",
       "      <td>440000</td>\n",
       "      <td>ZA</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>125</td>\n",
       "      <td>8</td>\n",
       "      <td>2800.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1872</th>\n",
       "      <td>440000</td>\n",
       "      <td>ZA</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>176</td>\n",
       "      <td>8</td>\n",
       "      <td>971.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1873</th>\n",
       "      <td>440000</td>\n",
       "      <td>ZA</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>178</td>\n",
       "      <td>8</td>\n",
       "      <td>4471.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1874</th>\n",
       "      <td>440000</td>\n",
       "      <td>ZA</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>184</td>\n",
       "      <td>26</td>\n",
       "      <td>2.5674</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "<p>1875 rows × 8 columns</p>\n",
       "</div>"
      ],
      "text/plain": [
       "      commodityCode countryCode  marketYear  calendarYear  month  attributeId  \\\n",
       "0            440000          AF        2021          2022      5            4   \n",
       "1            440000          AF        2021          2022      5           20   \n",
       "2            440000          AF        2021          2022      5           28   \n",
       "3            440000          AF        2021          2022      5           57   \n",
       "4            440000          AF        2021          2022      5           81   \n",
       "...             ...         ...         ...           ...    ...          ...   \n",
       "1870         440000          ZA        2021          2022      7          192   \n",
       "1871         440000          ZA        2021          2022      7          125   \n",
       "1872         440000          ZA        2021          2022      7          176   \n",
       "1873         440000          ZA        2021          2022      7          178   \n",
       "1874         440000          ZA        2021          2022      7          184   \n",
       "\n",
       "      unitId      value  \n",
       "0          4   130.0000  \n",
       "1          8     0.0000  \n",
       "2          8   220.0000  \n",
       "3          8     5.0000  \n",
       "4          8     5.0000  \n",
       "...      ...        ...  \n",
       "1870       8  2100.0000  \n",
       "1871       8  2800.0000  \n",
       "1872       8   971.0000  \n",
       "1873       8  4471.0000  \n",
       "1874      26     2.5674  \n",
       "\n",
       "[1875 rows x 8 columns]"
      ]
     },
     "execution_count": 129,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "psd_comyear_url = \"https://apps.fas.usda.gov/OpenData/api/psd/commodity/{commodityCode}/country/all/year/{marketYear}\"\n",
    "get_usda_data(psd_comyear_url.format(commodityCode = \"0440000\", marketYear = \"2021\"))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Returns a set of records with Forecast number for a given Commodity Code (Ex, 0440000 for Corn) and a given Market Year (Ex, 2017) for a given Country (Ex, BR for Brazil). PSD Database has data for most commodities since year 1960. Please see Commodities end point to get a list of all PSD Commodities with corresponding Commodity Code, and Countries end point for a list of all countries with corresponding Country Code"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 128,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>countryCode</th>\n",
       "      <th>marketYear</th>\n",
       "      <th>calendarYear</th>\n",
       "      <th>month</th>\n",
       "      <th>attributeId</th>\n",
       "      <th>unitId</th>\n",
       "      <th>value</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>21800.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>20</td>\n",
       "      <td>8</td>\n",
       "      <td>4153.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>28</td>\n",
       "      <td>8</td>\n",
       "      <td>116000.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>57</td>\n",
       "      <td>8</td>\n",
       "      <td>2000.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>81</td>\n",
       "      <td>8</td>\n",
       "      <td>2500.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>84</td>\n",
       "      <td>8</td>\n",
       "      <td>0.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>86</td>\n",
       "      <td>8</td>\n",
       "      <td>122153.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>88</td>\n",
       "      <td>8</td>\n",
       "      <td>44500.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>113</td>\n",
       "      <td>8</td>\n",
       "      <td>34000.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>130</td>\n",
       "      <td>8</td>\n",
       "      <td>62000.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>192</td>\n",
       "      <td>8</td>\n",
       "      <td>11000.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>125</td>\n",
       "      <td>8</td>\n",
       "      <td>73000.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>176</td>\n",
       "      <td>8</td>\n",
       "      <td>4653.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>178</td>\n",
       "      <td>8</td>\n",
       "      <td>122153.0000</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>440000</td>\n",
       "      <td>BR</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>6</td>\n",
       "      <td>184</td>\n",
       "      <td>26</td>\n",
       "      <td>5.3211</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    commodityCode countryCode  marketYear  calendarYear  month  attributeId  \\\n",
       "0          440000          BR        2021          2022      6            4   \n",
       "1          440000          BR        2021          2022      6           20   \n",
       "2          440000          BR        2021          2022      6           28   \n",
       "3          440000          BR        2021          2022      6           57   \n",
       "4          440000          BR        2021          2022      6           81   \n",
       "5          440000          BR        2021          2022      6           84   \n",
       "6          440000          BR        2021          2022      6           86   \n",
       "7          440000          BR        2021          2022      6           88   \n",
       "8          440000          BR        2021          2022      6          113   \n",
       "9          440000          BR        2021          2022      6          130   \n",
       "10         440000          BR        2021          2022      6          192   \n",
       "11         440000          BR        2021          2022      6          125   \n",
       "12         440000          BR        2021          2022      6          176   \n",
       "13         440000          BR        2021          2022      6          178   \n",
       "14         440000          BR        2021          2022      6          184   \n",
       "\n",
       "    unitId        value  \n",
       "0        4   21800.0000  \n",
       "1        8    4153.0000  \n",
       "2        8  116000.0000  \n",
       "3        8    2000.0000  \n",
       "4        8    2500.0000  \n",
       "5        8       0.0000  \n",
       "6        8  122153.0000  \n",
       "7        8   44500.0000  \n",
       "8        8   34000.0000  \n",
       "9        8   62000.0000  \n",
       "10       8   11000.0000  \n",
       "11       8   73000.0000  \n",
       "12       8    4653.0000  \n",
       "13       8  122153.0000  \n",
       "14      26       5.3211  "
      ]
     },
     "execution_count": 128,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "psd_comcountryyear_url = \"https://apps.fas.usda.gov/OpenData/api/psd/commodity/{commodityCode}/country/{countryCode}/year/{marketYear}\"\n",
    "get_usda_data(psd_comcountryyear_url.format(commodityCode = \"0440000\", countryCode = \"BR\", marketYear = \"2021\"))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Returns a set of records with Forecast number for a given Commodity Code (Ex, 0440000 for Corn) and a given Market Year (Ex, 2017) for the world.Data from all applicable countries are aggregated together for reporting it at the World Level. PSD Database has data for most commodities since year 1960. Please see Commodities end point to get a list of all PSD Commodities with corresponding Commodity Code."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 127,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>commodityCode</th>\n",
       "      <th>countryCode</th>\n",
       "      <th>marketYear</th>\n",
       "      <th>calendarYear</th>\n",
       "      <th>month</th>\n",
       "      <th>attributeId</th>\n",
       "      <th>unitId</th>\n",
       "      <th>value</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>4</td>\n",
       "      <td>4</td>\n",
       "      <td>2.067390e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>20</td>\n",
       "      <td>8</td>\n",
       "      <td>2.932910e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>28</td>\n",
       "      <td>8</td>\n",
       "      <td>1.217866e+06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>3</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>57</td>\n",
       "      <td>8</td>\n",
       "      <td>1.791450e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>4</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>81</td>\n",
       "      <td>8</td>\n",
       "      <td>1.813980e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>5</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>84</td>\n",
       "      <td>8</td>\n",
       "      <td>0.000000e+00</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>6</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>86</td>\n",
       "      <td>8</td>\n",
       "      <td>1.690302e+06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>7</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>88</td>\n",
       "      <td>8</td>\n",
       "      <td>1.992330e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>8</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>113</td>\n",
       "      <td>8</td>\n",
       "      <td>1.899280e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>9</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>130</td>\n",
       "      <td>8</td>\n",
       "      <td>7.462700e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>10</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>192</td>\n",
       "      <td>8</td>\n",
       "      <td>4.325210e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>11</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>125</td>\n",
       "      <td>8</td>\n",
       "      <td>1.178791e+06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>12</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>176</td>\n",
       "      <td>8</td>\n",
       "      <td>3.122780e+05</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>13</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>178</td>\n",
       "      <td>8</td>\n",
       "      <td>1.690302e+06</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>14</th>\n",
       "      <td>440000</td>\n",
       "      <td>0</td>\n",
       "      <td>2021</td>\n",
       "      <td>2022</td>\n",
       "      <td>7</td>\n",
       "      <td>184</td>\n",
       "      <td>26</td>\n",
       "      <td>5.890800e+00</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "    commodityCode  countryCode  marketYear  calendarYear  month  attributeId  \\\n",
       "0          440000            0        2021          2022      7            4   \n",
       "1          440000            0        2021          2022      7           20   \n",
       "2          440000            0        2021          2022      7           28   \n",
       "3          440000            0        2021          2022      7           57   \n",
       "4          440000            0        2021          2022      7           81   \n",
       "5          440000            0        2021          2022      7           84   \n",
       "6          440000            0        2021          2022      7           86   \n",
       "7          440000            0        2021          2022      7           88   \n",
       "8          440000            0        2021          2022      7          113   \n",
       "9          440000            0        2021          2022      7          130   \n",
       "10         440000            0        2021          2022      7          192   \n",
       "11         440000            0        2021          2022      7          125   \n",
       "12         440000            0        2021          2022      7          176   \n",
       "13         440000            0        2021          2022      7          178   \n",
       "14         440000            0        2021          2022      7          184   \n",
       "\n",
       "    unitId         value  \n",
       "0        4  2.067390e+05  \n",
       "1        8  2.932910e+05  \n",
       "2        8  1.217866e+06  \n",
       "3        8  1.791450e+05  \n",
       "4        8  1.813980e+05  \n",
       "5        8  0.000000e+00  \n",
       "6        8  1.690302e+06  \n",
       "7        8  1.992330e+05  \n",
       "8        8  1.899280e+05  \n",
       "9        8  7.462700e+05  \n",
       "10       8  4.325210e+05  \n",
       "11       8  1.178791e+06  \n",
       "12       8  3.122780e+05  \n",
       "13       8  1.690302e+06  \n",
       "14      26  5.890800e+00  "
      ]
     },
     "execution_count": 127,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "psd_comworldyear_url = \"https://apps.fas.usda.gov/OpenData/api/psd/commodity/{commodityCode}/world/year/{marketYear}\"\n",
    "get_usda_data(psd_comworldyear_url.format(commodityCode = \"0440000\", marketYear = \"2021\"))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th></th>\n",
       "      <th>Production Quantity</th>\n",
       "      <th>Domestic Consumption</th>\n",
       "      <th>USDA Stocks to Use Ratio</th>\n",
       "      <th>Gro Implied Stocks to Use Ratio</th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>2013/14</th>\n",
       "      <td>265</td>\n",
       "      <td>2825</td>\n",
       "      <td>17.391304</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2014/15</th>\n",
       "      <td>473</td>\n",
       "      <td>3125</td>\n",
       "      <td>15.104000</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2015/16</th>\n",
       "      <td>779</td>\n",
       "      <td>2950</td>\n",
       "      <td>10.949153</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2016/17</th>\n",
       "      <td>516</td>\n",
       "      <td>3000</td>\n",
       "      <td>9.900000</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2017/18</th>\n",
       "      <td>463</td>\n",
       "      <td>3050</td>\n",
       "      <td>9.508197</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2018/19</th>\n",
       "      <td>702</td>\n",
       "      <td>3000</td>\n",
       "      <td>7.120076</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2019/20</th>\n",
       "      <td>726</td>\n",
       "      <td>3100</td>\n",
       "      <td>16.903226</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2020/21</th>\n",
       "      <td>751</td>\n",
       "      <td>2900</td>\n",
       "      <td>14.939759</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2021/22</th>\n",
       "      <td>600</td>\n",
       "      <td>2850</td>\n",
       "      <td>10.508475</td>\n",
       "      <td>NaN</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>2022/23</th>\n",
       "      <td>700</td>\n",
       "      <td>2600</td>\n",
       "      <td>10.518234</td>\n",
       "      <td>11.529111</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "         Production Quantity  Domestic Consumption  USDA Stocks to Use Ratio  \\\n",
       "2013/14                  265                  2825                 17.391304   \n",
       "2014/15                  473                  3125                 15.104000   \n",
       "2015/16                  779                  2950                 10.949153   \n",
       "2016/17                  516                  3000                  9.900000   \n",
       "2017/18                  463                  3050                  9.508197   \n",
       "2018/19                  702                  3000                  7.120076   \n",
       "2019/20                  726                  3100                 16.903226   \n",
       "2020/21                  751                  2900                 14.939759   \n",
       "2021/22                  600                  2850                 10.508475   \n",
       "2022/23                  700                  2600                 10.518234   \n",
       "\n",
       "         Gro Implied Stocks to Use Ratio  \n",
       "2013/14                              NaN  \n",
       "2014/15                              NaN  \n",
       "2015/16                              NaN  \n",
       "2016/17                              NaN  \n",
       "2017/18                              NaN  \n",
       "2018/19                              NaN  \n",
       "2019/20                              NaN  \n",
       "2020/21                              NaN  \n",
       "2021/22                              NaN  \n",
       "2022/23                        11.529111  "
      ]
     },
     "execution_count": 10,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "gro_url = \"https://community.gro-intelligence.com/food-security-tracker-africa/data/Sudan_Wheat_supply_demand.json\"\n",
    "get_usda_data(gro_url)\n",
    "# See chart of data on website here: https://community.gro-intelligence.com/food-security-tracker-africa/details?country=Sudan&crop=Wheat"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "https://community.gro-intelligence.com/food-security-tracker-africa/details?country=Sudan&crop=Wheat\n",
    "\n",
    "/Users/cameronkruse/Desktop/Screen Shot 2022-07-31 at 6.57.33 PM.png\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3.10.4 ('food-security')",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.10.4"
  },
  "orig_nbformat": 4,
  "vscode": {
   "interpreter": {
    "hash": "80d14d1fb741077bd42a5b4187c7db14fd15f042564cfa5e7db6942dfa41f05d"
   }
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}