Catalog_queries.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Accessing  astronomical catalogs\n",
    "\n",
    "There are two ways to access astronomical data catalogs that are provided as table data with a VO API.\n",
    "\n",
    "Firstly, there is a __[Simple Cone Search (SCS) protocol](http://www.ivoa.net/documents/latest/ConeSearch.html)__  used to search a given table with a given position and radius, getting back a table of results.  The interface requires only a position and search radius.   \n",
    "\n",
    "For more complicated searches, the __[Table Access Protocol](http://www.ivoa.net/documents/TAP/)__ (TAP) protocol is  a powerful tool to search any VO table.  Here, we expand on its usage and that of the __[Astronomical Data Query Language](http://www.ivoa.net/documents/latest/ADQL.html)__ (ADQL) that it uses.  \n",
    "\n",
    "\n",
    "* [1. Simple cone search](#cone)queries\n",
    "* [2. Basic Table Access Protocol](#basic) queries\n",
    "* [3 Expressing queries in ADQL](#adql)\n",
    "* [4. Cross-correlating](#cc) our own catalog with a HEASARC catalog\n",
    "* [5. Combining](#combo) data from multiple catalogs and cross-correlating\n",
    "\n",
    "#### Throughout this notebook, we will step through using TAP for the following science goal: we want to select a sample of bright, nearby spiral galaxies. \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import numpy as np\n",
    "import astropy.units as u\n",
    "## There are a number of relatively unimportant warnings that \n",
    "## show up, so for now, suppress them:\n",
    "import warnings\n",
    "warnings.filterwarnings(\"ignore\", module=\"astropy.io.votable.*\")\n",
    "\n",
    "## For simple astropy tables\n",
    "import astropy, io\n",
    "\n",
    "## For handling ordinary astropy Tables\n",
    "from astropy.table import Table\n",
    "\n",
    "## For handling VO table type objects\n",
    "from astropy.io import votable as apvot\n",
    "\n",
    "## Use NAVO utility for Registry and Cone searches\n",
    "import sys\n",
    "from navo_utils.registry import Registry\n",
    "from navo_utils.cone import Cone\n",
    "from navo_utils.tap import Tap\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"scs1\"></a>\n",
    "\n",
    "# 1. Simple cone search\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Starting with a single simple source first: "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<SkyCoord (ICRS): (ra, dec) in deg\n",
      "    (202.469575, 47.1952583)>\n"
     ]
    }
   ],
   "source": [
    "import astropy.coordinates as coord\n",
    "coord=coord.SkyCoord.from_name(\"m51\")\n",
    "print(coord)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Below, we go through the exercise of how we can figure out the most relevant table. But for now, let's assume that we know that we want the \"zcat\" catalog. VO services are listed in a central Registry that can be searched through a [web interface](http://vao.stsci.edu/keyword-search/) or the python Registry class.  We use the registry to find the corresponding cone service and then submit our cone search. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=3</i>\n",
       "<table id=\"table34798712704\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>waveband</th><th>short_name</th><th>ivoid</th><th>res_description</th><th>access_url</th><th>reference_url</th><th>publisher</th><th>service_type</th></tr></thead>\n",
       "<thead><tr><th>str23</th><th>str9</th><th>str28</th><th>str24</th><th>str77</th><th>str57</th><th>str17</th><th>str10</th></tr></thead>\n",
       "<tr><td>optical</td><td>CFAZ</td><td>ivo://nasa.heasarc/zcat</td><td>No Description Available</td><td>https://heasarc.gsfc.nasa.gov/cgi-bin/vo/cone/coneGet.pl?table=zcat&amp;amp;</td><td>https://heasarc.gsfc.nasa.gov/W3Browse/all/zcat.html</td><td>NASA/GSFC HEASARC</td><td>conesearch</td></tr>\n",
       "<tr><td>optical</td><td>ABELLZCAT</td><td>ivo://nasa.heasarc/abellzcat</td><td>No Description Available</td><td>https://heasarc.gsfc.nasa.gov/cgi-bin/vo/cone/coneGet.pl?table=abellzcat&amp;amp;</td><td>https://heasarc.gsfc.nasa.gov/W3Browse/all/abellzcat.html</td><td>NASA/GSFC HEASARC</td><td>conesearch</td></tr>\n",
       "<tr><td>gamma-ray#optical#x-ray</td><td>ROMABZCAT</td><td>ivo://nasa.heasarc/romabzcat</td><td>No Description Available</td><td>https://heasarc.gsfc.nasa.gov/cgi-bin/vo/cone/coneGet.pl?table=romabzcat&amp;amp;</td><td>https://heasarc.gsfc.nasa.gov/W3Browse/all/romabzcat.html</td><td>NASA/GSFC HEASARC</td><td>conesearch</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=3>\n",
       "        waveband        short_name ...     publisher     service_type\n",
       "         str23             str9    ...       str17          str10    \n",
       "----------------------- ---------- ... ----------------- ------------\n",
       "                optical       CFAZ ... NASA/GSFC HEASARC   conesearch\n",
       "                optical  ABELLZCAT ... NASA/GSFC HEASARC   conesearch\n",
       "gamma-ray#optical#x-ray  ROMABZCAT ... NASA/GSFC HEASARC   conesearch"
      ]
     },
     "execution_count": 3,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "services=Registry.query(service_type='cone',source='zcat')\n",
    "services"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here, the results of the Registry query for cone services show that the HEASARC lists every catalog as a separate cone service. Note: We could also find it with a search for source='heasarc%zcat', where the \"%\" is a wildcard within radius (given in degrees). \n",
    "\n",
    "Supposing that we want the table with the short_name CFAZ, and we want to retrieve the data for all sources within an arcminute of our specified location:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=1</i>\n",
       "<table id=\"table34798691440\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>name</th><th>ra</th><th>dec</th><th>bmag</th><th>radial_velocity</th><th>radial_velocity_error</th><th>redshift</th><th>class</th><th>Search_Offset</th></tr></thead>\n",
       "<thead><tr><th></th><th>deg</th><th>deg</th><th></th><th>km / s</th><th>km / s</th><th></th><th></th><th></th></tr></thead>\n",
       "<thead><tr><th>str5</th><th>float64</th><th>float64</th><th>float32</th><th>int32</th><th>int32</th><th>float64</th><th>int32</th><th>float64</th></tr></thead>\n",
       "<tr><td>N5194</td><td>202.46823</td><td>47.19815</td><td>9.03</td><td>474</td><td>23</td><td>--</td><td>6200</td><td>0.1819</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=1>\n",
       " name     ra      dec      bmag  ... redshift class Search_Offset\n",
       "         deg      deg            ...                             \n",
       " str5  float64  float64  float32 ... float64  int32    float64   \n",
       "----- --------- -------- ------- ... -------- ----- -------------\n",
       "N5194 202.46823 47.19815    9.03 ...       --  6200        0.1819"
      ]
     },
     "execution_count": 4,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "## Different tries may come back in different order, so find the one that's CFAZ. \n",
    "cfaz_service=services[np.isin(services['short_name'],['CFAZ'])][0]\n",
    "## We are searching for sources within 1 arcminute of M51. \n",
    "table=Cone.query(service=cfaz_service,coords=coord,radius=1./60.)\n",
    "table[0]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The SCS is quite straightforward and returns all of the columns of the given table (which can be anything) for the sources in the region queried."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"basic\"></a>\n",
    "\n",
    "# 2. Basic Table Access Protocol queries\n",
    "\n",
    "A TAP query is the most powerful way to search a catalog. A Simple Cone Search only allows you to ask for a position and radius, but TAP allows you to do much more, since the available tables contain much more information. \n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Many services list a single TAP service in the Registry that can access many catalogs, boosting your efficiency. This is the power of the TAP! \n",
    "With the TAP, you can refine the search based on any other attribute in the given catalog. Suppose for our example, we want to select bright galaxy candidates but don't know the coordinates. Therefore, we start from figuring out the best table to query.   "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As before, we use the Registry query, but for TAP service, the service_type='table'. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "https://heasarc.gsfc.nasa.gov/xamin/vo/tap\n"
     ]
    }
   ],
   "source": [
    "tap_services=Registry.query(service_type='table',source='heasarc')\n",
    "url=str(tap_services[0]['access_url'])\n",
    "print(url)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This url will contain the list of all available tables, which we can see by using the Tap.list_tables() function:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Retrieving tables...\n",
      "Parsing tables...\n",
      "Done.\n",
      "TAP_SCHEMA.TAP_SCHEMA.columns\n",
      "TAP_SCHEMA.TAP_SCHEMA.key_columns\n",
      "TAP_SCHEMA.TAP_SCHEMA.keys\n",
      "TAP_SCHEMA.TAP_SCHEMA.schemas\n",
      "TAP_SCHEMA.TAP_SCHEMA.tables\n",
      "public.a1\n",
      "public.a1point\n",
      "public.a2lcpoint\n",
      "public.a2lcscan\n",
      "public.a2led\n",
      "public.a2pic\n",
      "public.a2point\n",
      "public.a2rtraw\n",
      "public.a2specback\n",
      "public.a2spectra\n",
      "public.a3\n",
      "public.a4\n",
      "public.a4spectra\n",
      "public.aavsovsx\n",
      "public.abell\n",
      "public.abellzcat\n",
      "public.acceptcat\n",
      "public.acrs\n",
      "public.actegsrcat\n",
      "public.actssrcat\n",
      "public.aegis20\n",
      "public.aegis20id\n",
      "public.aegisx\n",
      "public.aegisxdcxo\n",
      "public.agilecat\n",
      "public.agileupvar\n",
      "public.agnsdssxm2\n",
      "public.agnsdssxmm\n",
      "public.akaribsc\n",
      "public.akaripsc\n",
      "public.aknepdfcxo\n",
      "public.alfperxmm\n",
      "public.allwiseagn\n",
      "public.ami10c15gz\n",
      "public.amigps16gh\n",
      "public.ansuvpscat\n",
      "public.arcquincxo\n",
      "public.ariel3a\n",
      "public.ariel5\n",
      "public.arxa\n",
      "public.ascaegclus\n",
      "public.ascagis\n",
      "public.ascagps\n",
      "public.ascalss\n",
      "public.ascamaster\n",
      "public.ascao\n",
      "public.ascaprspec\n",
      "public.ascasis\n",
      "public.asiagosn\n",
      "public.askapbeta\n",
      "public.at20g\n",
      "public.at20g1fgl\n",
      "public.at20gbspol\n",
      "public.at20gbss\n",
      "public.at20gharc\n",
      "public.at2fglus\n",
      "public.atats\n",
      "public.atcaadfs20\n",
      "public.atcdfsss82\n",
      "public.atesp1p4gh\n",
      "public.athdfs1p4g\n",
      "public.athdfs3frq\n",
      "public.athdfsccat\n",
      "public.athdfsoid\n",
      "public.atlas2p3gh\n",
      "public.atlas5p5gh\n",
      "public.atlascscpt\n",
      "public.atlascsid\n",
      "public.atlasd2cpt\n",
      "public.atlasescpt\n",
      "public.atlasesid\n",
      "public.atlasspecz\n",
      "public.atlbs1p4gh\n",
      "public.atlgds2p1g\n",
      "public.atnfpulsar\n",
      "public.atpmncat\n",
      "public.axis\n",
      "public.bat5bgrbsp\n",
      "public.batse4b\n",
      "public.batsedaily\n",
      "public.batseeocat\n",
      "public.batsegrb\n",
      "public.batsegrbsp\n",
      "public.batsepulsr\n",
      "public.batsetrigs\n",
      "public.baxgalclus\n",
      "public.bbxrt\n",
      "public.bestars\n",
      "public.bhrfscid\n",
      "public.bmwchancat\n",
      "public.bmwhricat\n",
      "public.bnmdspecat\n",
      "public.boof153mhz\n",
      "public.bootesdf\n",
      "public.bsc5p\n",
      "public.caixa\n",
      "public.candelscxo\n",
      "public.cargm31cxo\n",
      "public.carinaclas\n",
      "public.carinacxo\n",
      "public.carinaxmm\n",
      "public.cbatpicagn\n",
      "public.cbfgrxecxo\n",
      "public.ccosmoscat\n",
      "public.ccosmosoid\n",
      "public.ccosmphotz\n",
      "public.ccosrssfag\n",
      "public.cdfn2msnew\n",
      "public.cdfn2msoi2\n",
      "public.cdfn2msoid\n",
      "public.cdfsagncxo\n",
      "public.cenacxo\n",
      "public.cepaxmm\n",
      "public.cepbob3cxo\n",
      "public.cepbob3oid\n",
      "public.cfa2s\n",
      "public.cfhtlsgxmm\n",
      "public.cg12cxo\n",
      "public.cgmw\n",
      "public.cgpsngpcat\n",
      "public.cgrabs\n",
      "public.cgroprspec\n",
      "public.cgrotl\n",
      "public.chainthcxo\n",
      "public.champhxagn\n",
      "public.champlane\n",
      "public.champlanex\n",
      "public.champpsc\n",
      "public.champsdssa\n",
      "public.chandfn1ms\n",
      "public.chandfn2ms\n",
      "public.chandfs1ms\n",
      "public.chandfs2ms\n",
      "public.chandfs4ms\n",
      "public.chandfs7ms\n",
      "public.chanextdfs\n",
      "public.changbscat\n",
      "public.chanmaster\n",
      "public.channsgpsc\n",
      "public.chansexagn\n",
      "public.chansexoid\n",
      "public.chansexsi\n",
      "public.chansngcat\n",
      "public.chantypgpr\n",
      "public.chanulxcat\n",
      "public.chanvguide\n",
      "public.chasfrxray\n",
      "public.chesscat\n",
      "public.chicagocxo\n",
      "public.chngpscliu\n",
      "public.chpngptsrc\n",
      "public.clans\n",
      "public.clansoid\n",
      "public.class\n",
      "public.clasxs\n",
      "public.clasxsoid\n",
      "public.clscat\n",
      "public.cmaimage\n",
      "public.cmaob1nir\n",
      "public.cmaob1xmm\n",
      "public.cmar1xray\n",
      "public.cmbmaster\n",
      "public.cns3\n",
      "public.cocd\n",
      "public.cocdext1\n",
      "public.coll69oid\n",
      "public.coll69xmm\n",
      "public.comptel\n",
      "public.corotexlog\n",
      "public.cosbmaps\n",
      "public.cosbraw\n",
      "public.cosmosvlba\n",
      "public.cosxfirmwc\n",
      "public.coup\n",
      "public.cpstars\n",
      "public.cr261cxo\n",
      "public.crabtime\n",
      "public.crates\n",
      "public.cratesocrap\n",
      "public.cvcat\n",
      "public.cxogsgsrc\n",
      "public.cxoxassist\n",
      "public.cyder\n",
      "public.cygob2cxo\n",
      "public.cygob2cxo2\n",
      "public.cygob2xmm\n",
      "public.cygtevcxo\n",
      "public.denisigal\n",
      "public.dirbepsc\n",
      "public.dixon\n",
      "public.dncvobcat\n",
      "public.duerbeck\n",
      "public.dxrbs\n",
      "public.ecdfscxo\n",
      "public.ecdfsnew\n",
      "public.ecdfsoid\n",
      "public.ecdfsoid2\n",
      "public.ecdfsrssam\n",
      "public.egrcat\n",
      "public.egret3\n",
      "public.egretdata\n",
      "public.eingalcat\n",
      "public.eingalclus\n",
      "public.einopslgal\n",
      "public.einstein2e\n",
      "public.elaiscxo\n",
      "public.elaisfbmc\n",
      "public.elaiss1oid\n",
      "public.elaiss1xmm\n",
      "public.emss\n",
      "public.erosxmm\n",
      "public.esouppsala\n",
      "public.etgalcxo\n",
      "public.etgalxray\n",
      "public.euv\n",
      "public.euvebsl\n",
      "public.euvecat2\n",
      "public.euvemaster\n",
      "public.euverap1\n",
      "public.euverap2\n",
      "public.euverap3\n",
      "public.euvexrtcat\n",
      "public.exgalemobj\n",
      "public.exms\n",
      "public.exofot\n",
      "public.exogps\n",
      "public.exohgls\n",
      "public.exolog\n",
      "public.exomaster\n",
      "public.exoplanets\n",
      "public.exoplanodb\n",
      "public.exopubs\n",
      "public.exss\n",
      "public.faust\n",
      "public.fbsbsocat\n",
      "public.feedback\n",
      "public.fer2fusrid\n",
      "public.fermi2favs\n",
      "public.fermi3fhl\n",
      "public.fermifhl\n",
      "public.fermigbrst\n",
      "public.fermigdays\n",
      "public.fermigsol\n",
      "public.fermigtrig\n",
      "public.fermil2psr\n",
      "public.fermilac\n",
      "public.fermilasp\n",
      "public.fermilatra\n",
      "public.fermilbsl\n",
      "public.fermilgrb\n",
      "public.fermilhesc\n",
      "public.fermille\n",
      "public.fermilpsc\n",
      "public.fermilweek\n",
      "public.first\n",
      "public.flarestars\n",
      "public.fornaxacxo\n",
      "public.fornaxxmm\n",
      "public.fpcsfits\n",
      "public.fricat\n",
      "public.friicat\n",
      "public.fsvsclustr\n",
      "public.fuselog\n",
      "public.galccxonid\n",
      "public.galcencxo\n",
      "public.galcenpspc\n",
      "public.galexlog\n",
      "public.galextdsc\n",
      "public.galobstars\n",
      "public.gb6\n",
      "public.gbt31ghz\n",
      "public.gc47tuccxo\n",
      "public.gcps\n",
      "public.gcptsrccxo\n",
      "public.gcscat\n",
      "public.gcvs\n",
      "public.gcvsegvars\n",
      "public.gcvsnsvars\n",
      "public.gingaasmlc\n",
      "public.gingabgd\n",
      "public.gingalac\n",
      "public.gingalog\n",
      "public.gingamode\n",
      "public.gingaraw\n",
      "public.gleamegcat\n",
      "public.gliese2mas\n",
      "public.globclust\n",
      "public.glxsdssqs2\n",
      "public.glxsdssqso\n",
      "public.gmrt1hxcsf\n",
      "public.gmrt4f150m\n",
      "public.gmrtas150m\n",
      "public.gmrtelain1\n",
      "public.gmrtelain2\n",
      "public.gmrtha325m\n",
      "public.gmrtj0916\n",
      "public.gmrtk2f1lf\n",
      "public.gmrtlbdsly\n",
      "public.gmrtlhcat\n",
      "public.gmrtlhcat2\n",
      "public.gmrtlhcat3\n",
      "public.gmrtspxfls\n",
      "public.gmrtvvdsvl\n",
      "public.gmrtxl240m\n",
      "public.gmrtxl610m\n",
      "public.goscat\n",
      "public.gp7c151mhz\n",
      "public.gpa\n",
      "public.grbcat\n",
      "public.grbcatag\n",
      "public.grbcatann\n",
      "public.grbcatbox\n",
      "public.grbcatcirc\n",
      "public.grbcatdual\n",
      "public.grbcatflux\n",
      "public.grbcatint\n",
      "public.grbcatinta\n",
      "public.grbcatirr\n",
      "public.gs\n",
      "public.gusbad\n",
      "public.gwsstrpcxo\n",
      "public.hbc\n",
      "public.hcg\n",
      "public.hcggalaxy\n",
      "public.hdec\n",
      "public.heabib\n",
      "public.hers82cat\n",
      "public.herschllog\n",
      "public.hesscat\n",
      "public.hete2gcn\n",
      "public.hete2grb\n",
      "public.hete2tl\n",
      "public.hic\n",
      "public.hiiregion\n",
      "public.hipnewcat\n",
      "public.hipparcos\n",
      "public.hitomaster\n",
      "public.hmxbcat\n",
      "public.hperseicxo\n",
      "public.hrasscat\n",
      "public.hrassoptid\n",
      "public.hricfa\n",
      "public.hrideep\n",
      "public.hriexo\n",
      "public.hriimage\n",
      "public.hriphot\n",
      "public.hstpaec\n",
      "public.hubbleudf\n",
      "public.hyadesxray\n",
      "public.ibiscat\n",
      "public.ic10cxo\n",
      "public.ic10xmmcxo\n",
      "public.ic1396acxo\n",
      "public.ic1396ncxo\n",
      "public.ic1805xmm\n",
      "public.ic2944xmm\n",
      "public.ic348cxo\n",
      "public.ic348cxo2\n",
      "public.infrared\n",
      "public.intagncat\n",
      "public.intbsc\n",
      "public.integralao\n",
      "public.intgccat\n",
      "public.intibisag2\n",
      "public.intibisagn\n",
      "public.intibisass\n",
      "public.intibisgal\n",
      "public.intibisvhd\n",
      "public.intomcvs\n",
      "public.intpublic\n",
      "public.intrefcat\n",
      "public.intscw\n",
      "public.intscwpub\n",
      "public.intspiagrb\n",
      "public.intvarcat\n",
      "public.ipc\n",
      "public.ipcdeep\n",
      "public.ipcimage\n",
      "public.ipclxlbol\n",
      "public.ipcostars\n",
      "public.ipcphot\n",
      "public.ipcslew\n",
      "public.ipcultsoft\n",
      "public.ipcunscrnd\n",
      "public.ipngrb\n",
      "public.ir20126cxo\n",
      "public.iram30mlog\n",
      "public.iramnoelog\n",
      "public.irampdblog\n",
      "public.irasfsc\n",
      "public.iraspsc\n",
      "public.iraspscz\n",
      "public.irasssc\n",
      "public.iraszsurv\n",
      "public.isgri4yrct\n",
      "public.isolog\n",
      "public.iuelog\n",
      "public.kaporixmm\n",
      "public.kommersgrb\n",
      "public.konus\n",
      "public.kuehr\n",
      "public.kvttmcomis\n",
      "public.l1641ioxmm\n",
      "public.lalaboocxo\n",
      "public.lalacetcxo\n",
      "public.lamorixmm\n",
      "public.lbn\n",
      "public.lbqs\n",
      "public.lcrscat\n",
      "public.ld7c151mhz\n",
      "public.ldn\n",
      "public.le\n",
      "public.lkha101cxo\n",
      "public.lmc30drcxo\n",
      "public.lmcclustrs\n",
      "public.lmcextobj\n",
      "public.lmchrixray\n",
      "public.lmcn11cxo\n",
      "public.lmcrosxray\n",
      "public.lmcxray\n",
      "public.lmxbcat\n",
      "public.lockmanoir\n",
      "public.lockmanxm2\n",
      "public.lockmanxmm\n",
      "public.lof3c29534\n",
      "public.lof3c29546\n",
      "public.lof3c29562\n",
      "public.lofarbf62m\n",
      "public.lofhatlas\n",
      "public.lorcat\n",
      "public.lotssprcat\n",
      "public.lowzvlqvla\n",
      "public.lpffiles\n",
      "public.lqac\n",
      "public.lspmnorth\n",
      "public.lupus3xmm\n",
      "public.lyngaclust\n",
      "public.m101cxo\n",
      "public.m101xmm\n",
      "public.m108cxo\n",
      "public.m16cxo\n",
      "public.m17cxo\n",
      "public.m31cfcxo\n",
      "public.m31clustrs\n",
      "public.m31cxo2\n",
      "public.m31cxohrc2\n",
      "public.m31cxoxray\n",
      "public.m31deepxmm\n",
      "public.m31rbcgc\n",
      "public.m31rosxray\n",
      "public.m31stars\n",
      "public.m31stars2\n",
      "public.m31xmm2\n",
      "public.m31xmmxray\n",
      "public.m33chase\n",
      "public.m33cxoxray\n",
      "public.m33deepxmm\n",
      "public.m33xmm2\n",
      "public.m33xmmxray\n",
      "public.m37cxo\n",
      "public.m51cxo\n",
      "public.m51cxo2\n",
      "public.m67cxo\n",
      "public.m71cxo\n",
      "public.m81cxo\n",
      "public.m81cxo2\n",
      "public.m83cxo\n",
      "public.m83xmm\n",
      "public.m87cxo\n",
      "public.macs\n",
      "public.maghmxbcat\n",
      "public.magpis\n",
      "public.maranoxmm\n",
      "public.markarian\n",
      "public.markarian2\n",
      "public.mashpncat\n",
      "public.maxigschgl\n",
      "public.maximaster\n",
      "public.maxissccat\n",
      "public.mcg\n",
      "public.mcksion\n",
      "public.mcxc\n",
      "public.mdwarfasc\n",
      "public.mdwf10pcux\n",
      "public.me\n",
      "public.messier\n",
      "public.metainfo\n",
      "public.mggammacat\n",
      "public.mggammadet\n",
      "public.mgps2\n",
      "public.milliquas\n",
      "public.mitgb6cm\n",
      "public.monr2cxo\n",
      "public.morbbincat\n",
      "public.morx\n",
      "public.mostatlas\n",
      "public.mostsnrcat\n",
      "public.moxc\n",
      "public.mpcraw\n",
      "public.mrc\n",
      "public.msxpsc\n",
      "public.msxuvpsc\n",
      "public.mwa32thgl\n",
      "public.mwacs\n",
      "public.mwak2f1lfc\n",
      "public.mwp1bubble\n",
      "public.mwsc\n",
      "public.mystixires\n",
      "public.mystixmidi\n",
      "public.mystixmpcm\n",
      "public.mystixxray\n",
      "public.napexmmcxo\n",
      "public.narcscat\n",
      "public.ncp21cma\n",
      "public.neargalcat\n",
      "public.newmdwarfs\n",
      "public.ngc1068cxo\n",
      "public.ngc1291cxo\n",
      "public.ngc1332cxo\n",
      "public.ngc1333cxo\n",
      "public.ngc1399cxo\n",
      "public.ngc1512xmm\n",
      "public.ngc1600cxo\n",
      "public.ngc1893cxo\n",
      "public.ngc2000\n",
      "public.ngc2024cxo\n",
      "public.ngc2237cxo\n",
      "public.ngc2244cxo\n",
      "public.ngc2264cx2\n",
      "public.ngc2264cxo\n",
      "public.ngc2264xmm\n",
      "public.ngc2362cxo\n",
      "public.ngc2403cx2\n",
      "public.ngc2403cxo\n",
      "public.ngc2516cxo\n",
      "public.ngc2516xmm\n",
      "public.ngc253xmm\n",
      "public.ngc2547xmm\n",
      "public.ngc2808cxo\n",
      "public.ngc2808xmm\n",
      "public.ngc2903cxo\n",
      "public.ngc300cxo\n",
      "public.ngc3115cxo\n",
      "public.ngc3293cxo\n",
      "public.ngc404cxo\n",
      "public.ngc4214cxo\n",
      "public.ngc4278cxo\n",
      "public.ngc4365cxo\n",
      "public.ngc4382cxo\n",
      "public.ngc4472cxo\n",
      "public.ngc4636cxo\n",
      "public.ngc4649cx2\n",
      "public.ngc4649cxo\n",
      "public.ngc55cxo\n",
      "public.ngc5866cxo\n",
      "public.ngc6231cxo\n",
      "public.ngc6231xmm\n",
      "public.ngc6334cxo\n",
      "public.ngc6357cxo\n",
      "public.ngc6357oid\n",
      "public.ngc6530cxo\n",
      "public.ngc6530oid\n",
      "public.ngc6530xmm\n",
      "public.ngc6791cxo\n",
      "public.ngc752cxo\n",
      "public.ngc752xmm\n",
      "public.nicermastr\n",
      "public.nltt\n",
      "public.noras\n",
      "public.north20cm\n",
      "public.north6cm\n",
      "public.nuaftl\n",
      "public.nucosmosfc\n",
      "public.nuecdfscat\n",
      "public.nugalcen\n",
      "public.numaster\n",
      "public.nustarssc\n",
      "public.nustarssc2\n",
      "public.nuvbemdcat\n",
      "public.nvss\n",
      "public.nwayawgros\n",
      "public.nwayawgxmm\n",
      "public.omc2p3cxo\n",
      "public.omegcencxo\n",
      "public.omegcenxmm\n",
      "public.onccxoopt\n",
      "public.onccxoxray\n",
      "public.openclust\n",
      "public.orionffcxo\n",
      "public.orionxray\n",
      "public.orionxstar\n",
      "public.oriysoir\n",
      "public.oso8alc\n",
      "public.oso8bclc\n",
      "public.oso8pharaw\n",
      "public.oso8rtraw\n",
      "public.osqsonvss\n",
      "public.osrilqxray\n",
      "public.osse\n",
      "public.ostars\n",
      "public.ovro31ghz\n",
      "public.pacobscat\n",
      "public.pacofscat\n",
      "public.pccs030ghz\n",
      "public.pccs044ghz\n",
      "public.pccs070ghz\n",
      "public.pccs100ghz\n",
      "public.pccs143ghz\n",
      "public.pccs217ghz\n",
      "public.pccs353ghz\n",
      "public.pccs545ghz\n",
      "public.pccs857ghz\n",
      "public.pds1p4ghz\n",
      "public.pdsoid\n",
      "public.pdsoid2\n",
      "public.pg\n",
      "public.pgc2003\n",
      "public.phebus\n",
      "public.pigssboofd\n",
      "public.pigsselcnf\n",
      "public.pkscat90\n",
      "public.planckeszc\n",
      "public.planckhzsc\n",
      "public.plancksz\n",
      "public.plancksz2\n",
      "public.pleiadxray\n",
      "public.plnebulae\n",
      "public.pmn\n",
      "public.pmpulsar\n",
      "public.pmsucat\n",
      "public.ppm\n",
      "public.ppmxlbmd\n",
      "public.pulsar\n",
      "public.pvogrb\n",
      "public.qorgcat\n",
      "public.qso\n",
      "public.radio\n",
      "public.rass2foid\n",
      "public.rass2fxray\n",
      "public.rass2mass\n",
      "public.rass2rxs\n",
      "public.rass6dfgs\n",
      "public.rassaeqso\n",
      "public.rassasaseb\n",
      "public.rassasaspv\n",
      "public.rassbsc\n",
      "public.rassbscpgc\n",
      "public.rasscals\n",
      "public.rasscndins\n",
      "public.rasscns3\n",
      "public.rassdssagn\n",
      "public.rassdsstar\n",
      "public.rassdwarf\n",
      "public.rassebcs\n",
      "public.rassfirst\n",
      "public.rassfsc\n",
      "public.rassgb\n",
      "public.rassgiant\n",
      "public.rasshgsft2\n",
      "public.rasshgsoft\n",
      "public.rassmaster\n",
      "public.rassnorsam\n",
      "public.rassob\n",
      "public.rasssdssgc\n",
      "public.rassusnoid\n",
      "public.rassvars\n",
      "public.rasswd\n",
      "public.rbs\n",
      "public.rbscnvss\n",
      "public.rc3\n",
      "public.rcw108cxo\n",
      "public.rcw38cxo\n",
      "public.rcw38cxo2\n",
      "public.rcw38yso\n",
      "public.rcw49cxo\n",
      "public.reflex\n",
      "public.refnebulae\n",
      "public.revisedlhs\n",
      "public.rhessigrb\n",
      "public.rhoophcxo\n",
      "public.rittercv\n",
      "public.ritterlmxb\n",
      "public.ritterrbin\n",
      "public.rixos\n",
      "public.romabzcat\n",
      "public.ros13hrcxo\n",
      "public.ros13hrvla\n",
      "public.ros13hrxmm\n",
      "public.ros400gcls\n",
      "public.rosathard\n",
      "public.rosatlog\n",
      "public.rosatrlq\n",
      "public.rosatrqq\n",
      "public.rosatxuv\n",
      "public.rosettecxo\n",
      "public.rosgalclus\n",
      "public.roshri\n",
      "public.roshritotal\n",
      "public.rosmaster\n",
      "public.rosnepagn\n",
      "public.rosnepoid\n",
      "public.rosnepxray\n",
      "public.rosprspec\n",
      "public.rospspc\n",
      "public.rospspcf\n",
      "public.rospspcftot\n",
      "public.rospspctotal\n",
      "public.roswfc2re\n",
      "public.rotxraycat\n",
      "public.roxa\n",
      "public.rrs8c38mhz\n",
      "public.rssgrbag\n",
      "public.rt9cc15ghz\n",
      "public.rtv9c15ghz\n",
      "public.s254258cxo\n",
      "public.sa57xmm\n",
      "public.sacshpscat\n",
      "public.sacssescat\n",
      "public.sacsspscat\n",
      "public.sacstpscat\n",
      "public.sacy\n",
      "public.saisncat\n",
      "public.sao\n",
      "public.sas2maps\n",
      "public.sas2raw\n",
      "public.sas3ylog\n",
      "public.sax2to10\n",
      "public.saxao\n",
      "public.saxgrbmgrb\n",
      "public.saxhellas\n",
      "public.saxhellasr\n",
      "public.saxnfilog\n",
      "public.saxwfccat\n",
      "public.saxwfccat2\n",
      "public.saxwfclog\n",
      "public.sborbitcat\n",
      "public.sbsggencat\n",
      "public.scubafemoc\n",
      "public.sdssbalqs2\n",
      "public.sdssbalqso\n",
      "public.sdsscvcat\n",
      "public.sdsscxoqso\n",
      "public.sdssdr10wd\n",
      "public.sdssdr7wd\n",
      "public.sdsslasqso\n",
      "public.sdssnbckde\n",
      "public.sdssnbcqsc\n",
      "public.sdssquasar\n",
      "public.sdsss82cxo\n",
      "public.sdsss82xmm\n",
      "public.sdssunuqsr\n",
      "public.sdsswdsd\n",
      "public.sdsswhlgc\n",
      "public.sdssxmmqso\n",
      "public.selhcgcxo\n",
      "public.sfgalhmxb\n",
      "public.sfincspcm\n",
      "public.sfincsxray\n",
      "public.sgraregcsc\n",
      "public.shk\n",
      "public.shkgalaxy\n",
      "public.sigorixmm\n",
      "public.sixdfgs\n",
      "public.sixsrvycat\n",
      "public.smc1400mhz\n",
      "public.smc4800mhz\n",
      "public.smc843mhz\n",
      "public.smc8640mhz\n",
      "public.smcclustrs\n",
      "public.smcdfscxo\n",
      "public.smcpscxmm\n",
      "public.smcradio\n",
      "public.smcrosxray\n",
      "public.smcrosxry2\n",
      "public.smcstars\n",
      "public.smcstars2\n",
      "public.smcwingcxo\n",
      "public.smcxray\n",
      "public.smmgrs\n",
      "public.snrgreen\n",
      "public.spass2p3gh\n",
      "public.spicescxo\n",
      "public.spitzmastr\n",
      "public.sporiabyso\n",
      "public.sptmm87sd\n",
      "public.sptszgalcl\n",
      "public.sptszspsc\n",
      "public.ssa22cxo\n",
      "public.sss\n",
      "public.sssraw\n",
      "public.sterngrb\n",
      "public.subpfclog\n",
      "public.subtab\n",
      "public.sumss\n",
      "public.suzamaster\n",
      "public.suzaxislog\n",
      "public.swbatagn60\n",
      "public.swbatsfxt\n",
      "public.swiftbalog\n",
      "public.swiftgrb\n",
      "public.swiftmastr\n",
      "public.swifttdrss\n",
      "public.swiftuvlog\n",
      "public.swiftxrlog\n",
      "public.swirecxo\n",
      "public.swirelhcxo\n",
      "public.swsdssqso\n",
      "public.swuvotssc\n",
      "public.swuvotssob\n",
      "public.swxcscat\n",
      "public.swxcsoxid\n",
      "public.swxrt1fgl\n",
      "public.sxdscat\n",
      "public.symbiotics\n",
      "public.sza31ghz\n",
      "public.table_classes\n",
      "public.tabledocs\n",
      "public.tartarus\n",
      "public.taurusxmm\n",
      "public.td1\n",
      "public.tevcat\n",
      "public.texas\n",
      "public.tgs\n",
      "public.tgs2\n",
      "public.tramisuboo\n",
      "public.trifidcxo\n",
      "public.twodfqsoz\n",
      "public.twomassrsc\n",
      "public.twosigma\n",
      "public.tycho2\n",
      "public.uc7c151mhz\n",
      "public.ugc\n",
      "public.uhuru4\n",
      "public.uit\n",
      "public.uitmaster\n",
      "public.ulxngcat\n",
      "public.ulxrbcat\n",
      "public.upprscoxmm\n",
      "public.uvotbscat\n",
      "public.uvqs\n",
      "public.uzc\n",
      "public.vela5b\n",
      "public.veroncat\n",
      "public.vla23901p4\n",
      "public.vla3701p4\n",
      "public.vla74mhzdp\n",
      "public.vlacdfscat\n",
      "public.vlacomacat\n",
      "public.vlacos324m\n",
      "public.vlacos3ghz\n",
      "public.vlacosmjsc\n",
      "public.vlacosmos\n",
      "public.vlacosxoid\n",
      "public.vlaecdfs1p4\n",
      "public.vlaecdfscls\n",
      "public.vlaecdfsoi\n",
      "public.vlaen20cm\n",
      "public.vlagbsoph\n",
      "public.vlagbsori\n",
      "public.vlagbsper\n",
      "public.vlagbsser\n",
      "public.vlagbstau\n",
      "public.vlagoodsn\n",
      "public.vlahdf20cm\n",
      "public.vlalh1400m\n",
      "public.vlalhn3ghz\n",
      "public.vlam311p4g\n",
      "public.vlam31325m\n",
      "public.vlanep\n",
      "public.vlaonccat\n",
      "public.vlasdf20cm\n",
      "public.vlasdf90cm\n",
      "public.vlass821p4\n",
      "public.vlasxdf1p4\n",
      "public.vlasxdfoid\n",
      "public.vlaxl325mh\n",
      "public.vlaxl74mhz\n",
      "public.vlssr\n",
      "public.vlulxcat\n",
      "public.vvds20cm\n",
      "public.w2ragncat\n",
      "public.w40sfrcxo\n",
      "public.wackerling\n",
      "public.warps\n",
      "public.warps2\n",
      "public.wbhgp20cm\n",
      "public.wbhgp6cm\n",
      "public.wbl\n",
      "public.wblgalaxy\n",
      "public.wd1cxo\n",
      "public.wds\n",
      "public.wenss\n",
      "public.wfcpoint\n",
      "public.wgacat\n",
      "public.wibrals\n",
      "public.wisehspcat\n",
      "public.wish\n",
      "public.wmapcmbfps\n",
      "public.wmapitnpts\n",
      "public.wmapptsrc\n",
      "public.woodebcat\n",
      "public.woolley\n",
      "public.wrcat\n",
      "public.wsrt20anep\n",
      "public.wsrtgp\n",
      "public.xbootes\n",
      "public.xbootesoid\n",
      "public.xcopraw\n",
      "public.xcs\n",
      "public.xdeep2\n",
      "public.xmdsvvds4s\n",
      "public.xmmao\n",
      "public.xmmatlas\n",
      "public.xmmbss\n",
      "public.xmmbssagn\n",
      "public.xmmcdfs210\n",
      "public.xmmcdfs510\n",
      "public.xmmcfrscat\n",
      "public.xmmcfrsoid\n",
      "public.xmmcosmagn\n",
      "public.xmmcosmoid\n",
      "public.xmmcosmos\n",
      "public.xmmcphotz\n",
      "public.xmmcty2agn\n",
      "public.xmmgps\n",
      "public.xmmlss\n",
      "public.xmmlss10ks\n",
      "public.xmmlssclas\n",
      "public.xmmlssdeep\n",
      "public.xmmlssoid\n",
      "public.xmmmaster\n",
      "public.xmmobstars\n",
      "public.xmmomcat\n",
      "public.xmmomcdfs\n",
      "public.xmmomobj\n",
      "public.xmmomsuob\n",
      "public.xmmomsuss\n",
      "public.xmmsdssgce\n",
      "public.xmmsdssgcs\n",
      "public.xmmslewcln\n",
      "public.xmmslewegs\n",
      "public.xmmslewful\n",
      "public.xmmssc\n",
      "public.xmmsscgps\n",
      "public.xmmssclwbd\n",
      "public.xmmssclwbs\n",
      "public.xmmstack\n",
      "public.xmmstackob\n",
      "public.xmmt2flare\n",
      "public.xmmvaragn\n",
      "public.xmmxassist\n",
      "public.xms\n",
      "public.xray\n",
      "public.xrayselbll\n",
      "public.xrbcat\n",
      "public.xshzagncxo\n",
      "public.xteao\n",
      "public.xteasmlong\n",
      "public.xteassagn\n",
      "public.xteasscat\n",
      "public.xteindex\n",
      "public.xtemaster\n",
      "public.xtemlcat\n",
      "public.xteslew\n",
      "public.xwas\n",
      "public.zcat\n",
      "public.zwclusters\n",
      "public.zzbib\n",
      "MASTER_TABLE.master_table.indexview\n",
      "MASTER_TABLE.master_table.pos_big\n",
      "MASTER_TABLE.master_table.pos_small\n",
      "MASTER_TABLE.master_table.pos_time_big\n",
      "MASTER_TABLE.master_table.pos_time_small\n",
      "MASTER_TABLE.master_table.time\n"
     ]
    },
    {
     "data": {
      "text/plain": [
       "['TAP_SCHEMA.TAP_SCHEMA.columns',\n",
       " 'TAP_SCHEMA.TAP_SCHEMA.key_columns',\n",
       " 'TAP_SCHEMA.TAP_SCHEMA.keys',\n",
       " 'TAP_SCHEMA.TAP_SCHEMA.schemas',\n",
       " 'TAP_SCHEMA.TAP_SCHEMA.tables',\n",
       " 'public.a1',\n",
       " 'public.a1point',\n",
       " 'public.a2lcpoint',\n",
       " 'public.a2lcscan',\n",
       " 'public.a2led',\n",
       " 'public.a2pic',\n",
       " 'public.a2point',\n",
       " 'public.a2rtraw',\n",
       " 'public.a2specback',\n",
       " 'public.a2spectra',\n",
       " 'public.a3',\n",
       " 'public.a4',\n",
       " 'public.a4spectra',\n",
       " 'public.aavsovsx',\n",
       " 'public.abell',\n",
       " 'public.abellzcat',\n",
       " 'public.acceptcat',\n",
       " 'public.acrs',\n",
       " 'public.actegsrcat',\n",
       " 'public.actssrcat',\n",
       " 'public.aegis20',\n",
       " 'public.aegis20id',\n",
       " 'public.aegisx',\n",
       " 'public.aegisxdcxo',\n",
       " 'public.agilecat',\n",
       " 'public.agileupvar',\n",
       " 'public.agnsdssxm2',\n",
       " 'public.agnsdssxmm',\n",
       " 'public.akaribsc',\n",
       " 'public.akaripsc',\n",
       " 'public.aknepdfcxo',\n",
       " 'public.alfperxmm',\n",
       " 'public.allwiseagn',\n",
       " 'public.ami10c15gz',\n",
       " 'public.amigps16gh',\n",
       " 'public.ansuvpscat',\n",
       " 'public.arcquincxo',\n",
       " 'public.ariel3a',\n",
       " 'public.ariel5',\n",
       " 'public.arxa',\n",
       " 'public.ascaegclus',\n",
       " 'public.ascagis',\n",
       " 'public.ascagps',\n",
       " 'public.ascalss',\n",
       " 'public.ascamaster',\n",
       " 'public.ascao',\n",
       " 'public.ascaprspec',\n",
       " 'public.ascasis',\n",
       " 'public.asiagosn',\n",
       " 'public.askapbeta',\n",
       " 'public.at20g',\n",
       " 'public.at20g1fgl',\n",
       " 'public.at20gbspol',\n",
       " 'public.at20gbss',\n",
       " 'public.at20gharc',\n",
       " 'public.at2fglus',\n",
       " 'public.atats',\n",
       " 'public.atcaadfs20',\n",
       " 'public.atcdfsss82',\n",
       " 'public.atesp1p4gh',\n",
       " 'public.athdfs1p4g',\n",
       " 'public.athdfs3frq',\n",
       " 'public.athdfsccat',\n",
       " 'public.athdfsoid',\n",
       " 'public.atlas2p3gh',\n",
       " 'public.atlas5p5gh',\n",
       " 'public.atlascscpt',\n",
       " 'public.atlascsid',\n",
       " 'public.atlasd2cpt',\n",
       " 'public.atlasescpt',\n",
       " 'public.atlasesid',\n",
       " 'public.atlasspecz',\n",
       " 'public.atlbs1p4gh',\n",
       " 'public.atlgds2p1g',\n",
       " 'public.atnfpulsar',\n",
       " 'public.atpmncat',\n",
       " 'public.axis',\n",
       " 'public.bat5bgrbsp',\n",
       " 'public.batse4b',\n",
       " 'public.batsedaily',\n",
       " 'public.batseeocat',\n",
       " 'public.batsegrb',\n",
       " 'public.batsegrbsp',\n",
       " 'public.batsepulsr',\n",
       " 'public.batsetrigs',\n",
       " 'public.baxgalclus',\n",
       " 'public.bbxrt',\n",
       " 'public.bestars',\n",
       " 'public.bhrfscid',\n",
       " 'public.bmwchancat',\n",
       " 'public.bmwhricat',\n",
       " 'public.bnmdspecat',\n",
       " 'public.boof153mhz',\n",
       " 'public.bootesdf',\n",
       " 'public.bsc5p',\n",
       " 'public.caixa',\n",
       " 'public.candelscxo',\n",
       " 'public.cargm31cxo',\n",
       " 'public.carinaclas',\n",
       " 'public.carinacxo',\n",
       " 'public.carinaxmm',\n",
       " 'public.cbatpicagn',\n",
       " 'public.cbfgrxecxo',\n",
       " 'public.ccosmoscat',\n",
       " 'public.ccosmosoid',\n",
       " 'public.ccosmphotz',\n",
       " 'public.ccosrssfag',\n",
       " 'public.cdfn2msnew',\n",
       " 'public.cdfn2msoi2',\n",
       " 'public.cdfn2msoid',\n",
       " 'public.cdfsagncxo',\n",
       " 'public.cenacxo',\n",
       " 'public.cepaxmm',\n",
       " 'public.cepbob3cxo',\n",
       " 'public.cepbob3oid',\n",
       " 'public.cfa2s',\n",
       " 'public.cfhtlsgxmm',\n",
       " 'public.cg12cxo',\n",
       " 'public.cgmw',\n",
       " 'public.cgpsngpcat',\n",
       " 'public.cgrabs',\n",
       " 'public.cgroprspec',\n",
       " 'public.cgrotl',\n",
       " 'public.chainthcxo',\n",
       " 'public.champhxagn',\n",
       " 'public.champlane',\n",
       " 'public.champlanex',\n",
       " 'public.champpsc',\n",
       " 'public.champsdssa',\n",
       " 'public.chandfn1ms',\n",
       " 'public.chandfn2ms',\n",
       " 'public.chandfs1ms',\n",
       " 'public.chandfs2ms',\n",
       " 'public.chandfs4ms',\n",
       " 'public.chandfs7ms',\n",
       " 'public.chanextdfs',\n",
       " 'public.changbscat',\n",
       " 'public.chanmaster',\n",
       " 'public.channsgpsc',\n",
       " 'public.chansexagn',\n",
       " 'public.chansexoid',\n",
       " 'public.chansexsi',\n",
       " 'public.chansngcat',\n",
       " 'public.chantypgpr',\n",
       " 'public.chanulxcat',\n",
       " 'public.chanvguide',\n",
       " 'public.chasfrxray',\n",
       " 'public.chesscat',\n",
       " 'public.chicagocxo',\n",
       " 'public.chngpscliu',\n",
       " 'public.chpngptsrc',\n",
       " 'public.clans',\n",
       " 'public.clansoid',\n",
       " 'public.class',\n",
       " 'public.clasxs',\n",
       " 'public.clasxsoid',\n",
       " 'public.clscat',\n",
       " 'public.cmaimage',\n",
       " 'public.cmaob1nir',\n",
       " 'public.cmaob1xmm',\n",
       " 'public.cmar1xray',\n",
       " 'public.cmbmaster',\n",
       " 'public.cns3',\n",
       " 'public.cocd',\n",
       " 'public.cocdext1',\n",
       " 'public.coll69oid',\n",
       " 'public.coll69xmm',\n",
       " 'public.comptel',\n",
       " 'public.corotexlog',\n",
       " 'public.cosbmaps',\n",
       " 'public.cosbraw',\n",
       " 'public.cosmosvlba',\n",
       " 'public.cosxfirmwc',\n",
       " 'public.coup',\n",
       " 'public.cpstars',\n",
       " 'public.cr261cxo',\n",
       " 'public.crabtime',\n",
       " 'public.crates',\n",
       " 'public.cratesocrap',\n",
       " 'public.cvcat',\n",
       " 'public.cxogsgsrc',\n",
       " 'public.cxoxassist',\n",
       " 'public.cyder',\n",
       " 'public.cygob2cxo',\n",
       " 'public.cygob2cxo2',\n",
       " 'public.cygob2xmm',\n",
       " 'public.cygtevcxo',\n",
       " 'public.denisigal',\n",
       " 'public.dirbepsc',\n",
       " 'public.dixon',\n",
       " 'public.dncvobcat',\n",
       " 'public.duerbeck',\n",
       " 'public.dxrbs',\n",
       " 'public.ecdfscxo',\n",
       " 'public.ecdfsnew',\n",
       " 'public.ecdfsoid',\n",
       " 'public.ecdfsoid2',\n",
       " 'public.ecdfsrssam',\n",
       " 'public.egrcat',\n",
       " 'public.egret3',\n",
       " 'public.egretdata',\n",
       " 'public.eingalcat',\n",
       " 'public.eingalclus',\n",
       " 'public.einopslgal',\n",
       " 'public.einstein2e',\n",
       " 'public.elaiscxo',\n",
       " 'public.elaisfbmc',\n",
       " 'public.elaiss1oid',\n",
       " 'public.elaiss1xmm',\n",
       " 'public.emss',\n",
       " 'public.erosxmm',\n",
       " 'public.esouppsala',\n",
       " 'public.etgalcxo',\n",
       " 'public.etgalxray',\n",
       " 'public.euv',\n",
       " 'public.euvebsl',\n",
       " 'public.euvecat2',\n",
       " 'public.euvemaster',\n",
       " 'public.euverap1',\n",
       " 'public.euverap2',\n",
       " 'public.euverap3',\n",
       " 'public.euvexrtcat',\n",
       " 'public.exgalemobj',\n",
       " 'public.exms',\n",
       " 'public.exofot',\n",
       " 'public.exogps',\n",
       " 'public.exohgls',\n",
       " 'public.exolog',\n",
       " 'public.exomaster',\n",
       " 'public.exoplanets',\n",
       " 'public.exoplanodb',\n",
       " 'public.exopubs',\n",
       " 'public.exss',\n",
       " 'public.faust',\n",
       " 'public.fbsbsocat',\n",
       " 'public.feedback',\n",
       " 'public.fer2fusrid',\n",
       " 'public.fermi2favs',\n",
       " 'public.fermi3fhl',\n",
       " 'public.fermifhl',\n",
       " 'public.fermigbrst',\n",
       " 'public.fermigdays',\n",
       " 'public.fermigsol',\n",
       " 'public.fermigtrig',\n",
       " 'public.fermil2psr',\n",
       " 'public.fermilac',\n",
       " 'public.fermilasp',\n",
       " 'public.fermilatra',\n",
       " 'public.fermilbsl',\n",
       " 'public.fermilgrb',\n",
       " 'public.fermilhesc',\n",
       " 'public.fermille',\n",
       " 'public.fermilpsc',\n",
       " 'public.fermilweek',\n",
       " 'public.first',\n",
       " 'public.flarestars',\n",
       " 'public.fornaxacxo',\n",
       " 'public.fornaxxmm',\n",
       " 'public.fpcsfits',\n",
       " 'public.fricat',\n",
       " 'public.friicat',\n",
       " 'public.fsvsclustr',\n",
       " 'public.fuselog',\n",
       " 'public.galccxonid',\n",
       " 'public.galcencxo',\n",
       " 'public.galcenpspc',\n",
       " 'public.galexlog',\n",
       " 'public.galextdsc',\n",
       " 'public.galobstars',\n",
       " 'public.gb6',\n",
       " 'public.gbt31ghz',\n",
       " 'public.gc47tuccxo',\n",
       " 'public.gcps',\n",
       " 'public.gcptsrccxo',\n",
       " 'public.gcscat',\n",
       " 'public.gcvs',\n",
       " 'public.gcvsegvars',\n",
       " 'public.gcvsnsvars',\n",
       " 'public.gingaasmlc',\n",
       " 'public.gingabgd',\n",
       " 'public.gingalac',\n",
       " 'public.gingalog',\n",
       " 'public.gingamode',\n",
       " 'public.gingaraw',\n",
       " 'public.gleamegcat',\n",
       " 'public.gliese2mas',\n",
       " 'public.globclust',\n",
       " 'public.glxsdssqs2',\n",
       " 'public.glxsdssqso',\n",
       " 'public.gmrt1hxcsf',\n",
       " 'public.gmrt4f150m',\n",
       " 'public.gmrtas150m',\n",
       " 'public.gmrtelain1',\n",
       " 'public.gmrtelain2',\n",
       " 'public.gmrtha325m',\n",
       " 'public.gmrtj0916',\n",
       " 'public.gmrtk2f1lf',\n",
       " 'public.gmrtlbdsly',\n",
       " 'public.gmrtlhcat',\n",
       " 'public.gmrtlhcat2',\n",
       " 'public.gmrtlhcat3',\n",
       " 'public.gmrtspxfls',\n",
       " 'public.gmrtvvdsvl',\n",
       " 'public.gmrtxl240m',\n",
       " 'public.gmrtxl610m',\n",
       " 'public.goscat',\n",
       " 'public.gp7c151mhz',\n",
       " 'public.gpa',\n",
       " 'public.grbcat',\n",
       " 'public.grbcatag',\n",
       " 'public.grbcatann',\n",
       " 'public.grbcatbox',\n",
       " 'public.grbcatcirc',\n",
       " 'public.grbcatdual',\n",
       " 'public.grbcatflux',\n",
       " 'public.grbcatint',\n",
       " 'public.grbcatinta',\n",
       " 'public.grbcatirr',\n",
       " 'public.gs',\n",
       " 'public.gusbad',\n",
       " 'public.gwsstrpcxo',\n",
       " 'public.hbc',\n",
       " 'public.hcg',\n",
       " 'public.hcggalaxy',\n",
       " 'public.hdec',\n",
       " 'public.heabib',\n",
       " 'public.hers82cat',\n",
       " 'public.herschllog',\n",
       " 'public.hesscat',\n",
       " 'public.hete2gcn',\n",
       " 'public.hete2grb',\n",
       " 'public.hete2tl',\n",
       " 'public.hic',\n",
       " 'public.hiiregion',\n",
       " 'public.hipnewcat',\n",
       " 'public.hipparcos',\n",
       " 'public.hitomaster',\n",
       " 'public.hmxbcat',\n",
       " 'public.hperseicxo',\n",
       " 'public.hrasscat',\n",
       " 'public.hrassoptid',\n",
       " 'public.hricfa',\n",
       " 'public.hrideep',\n",
       " 'public.hriexo',\n",
       " 'public.hriimage',\n",
       " 'public.hriphot',\n",
       " 'public.hstpaec',\n",
       " 'public.hubbleudf',\n",
       " 'public.hyadesxray',\n",
       " 'public.ibiscat',\n",
       " 'public.ic10cxo',\n",
       " 'public.ic10xmmcxo',\n",
       " 'public.ic1396acxo',\n",
       " 'public.ic1396ncxo',\n",
       " 'public.ic1805xmm',\n",
       " 'public.ic2944xmm',\n",
       " 'public.ic348cxo',\n",
       " 'public.ic348cxo2',\n",
       " 'public.infrared',\n",
       " 'public.intagncat',\n",
       " 'public.intbsc',\n",
       " 'public.integralao',\n",
       " 'public.intgccat',\n",
       " 'public.intibisag2',\n",
       " 'public.intibisagn',\n",
       " 'public.intibisass',\n",
       " 'public.intibisgal',\n",
       " 'public.intibisvhd',\n",
       " 'public.intomcvs',\n",
       " 'public.intpublic',\n",
       " 'public.intrefcat',\n",
       " 'public.intscw',\n",
       " 'public.intscwpub',\n",
       " 'public.intspiagrb',\n",
       " 'public.intvarcat',\n",
       " 'public.ipc',\n",
       " 'public.ipcdeep',\n",
       " 'public.ipcimage',\n",
       " 'public.ipclxlbol',\n",
       " 'public.ipcostars',\n",
       " 'public.ipcphot',\n",
       " 'public.ipcslew',\n",
       " 'public.ipcultsoft',\n",
       " 'public.ipcunscrnd',\n",
       " 'public.ipngrb',\n",
       " 'public.ir20126cxo',\n",
       " 'public.iram30mlog',\n",
       " 'public.iramnoelog',\n",
       " 'public.irampdblog',\n",
       " 'public.irasfsc',\n",
       " 'public.iraspsc',\n",
       " 'public.iraspscz',\n",
       " 'public.irasssc',\n",
       " 'public.iraszsurv',\n",
       " 'public.isgri4yrct',\n",
       " 'public.isolog',\n",
       " 'public.iuelog',\n",
       " 'public.kaporixmm',\n",
       " 'public.kommersgrb',\n",
       " 'public.konus',\n",
       " 'public.kuehr',\n",
       " 'public.kvttmcomis',\n",
       " 'public.l1641ioxmm',\n",
       " 'public.lalaboocxo',\n",
       " 'public.lalacetcxo',\n",
       " 'public.lamorixmm',\n",
       " 'public.lbn',\n",
       " 'public.lbqs',\n",
       " 'public.lcrscat',\n",
       " 'public.ld7c151mhz',\n",
       " 'public.ldn',\n",
       " 'public.le',\n",
       " 'public.lkha101cxo',\n",
       " 'public.lmc30drcxo',\n",
       " 'public.lmcclustrs',\n",
       " 'public.lmcextobj',\n",
       " 'public.lmchrixray',\n",
       " 'public.lmcn11cxo',\n",
       " 'public.lmcrosxray',\n",
       " 'public.lmcxray',\n",
       " 'public.lmxbcat',\n",
       " 'public.lockmanoir',\n",
       " 'public.lockmanxm2',\n",
       " 'public.lockmanxmm',\n",
       " 'public.lof3c29534',\n",
       " 'public.lof3c29546',\n",
       " 'public.lof3c29562',\n",
       " 'public.lofarbf62m',\n",
       " 'public.lofhatlas',\n",
       " 'public.lorcat',\n",
       " 'public.lotssprcat',\n",
       " 'public.lowzvlqvla',\n",
       " 'public.lpffiles',\n",
       " 'public.lqac',\n",
       " 'public.lspmnorth',\n",
       " 'public.lupus3xmm',\n",
       " 'public.lyngaclust',\n",
       " 'public.m101cxo',\n",
       " 'public.m101xmm',\n",
       " 'public.m108cxo',\n",
       " 'public.m16cxo',\n",
       " 'public.m17cxo',\n",
       " 'public.m31cfcxo',\n",
       " 'public.m31clustrs',\n",
       " 'public.m31cxo2',\n",
       " 'public.m31cxohrc2',\n",
       " 'public.m31cxoxray',\n",
       " 'public.m31deepxmm',\n",
       " 'public.m31rbcgc',\n",
       " 'public.m31rosxray',\n",
       " 'public.m31stars',\n",
       " 'public.m31stars2',\n",
       " 'public.m31xmm2',\n",
       " 'public.m31xmmxray',\n",
       " 'public.m33chase',\n",
       " 'public.m33cxoxray',\n",
       " 'public.m33deepxmm',\n",
       " 'public.m33xmm2',\n",
       " 'public.m33xmmxray',\n",
       " 'public.m37cxo',\n",
       " 'public.m51cxo',\n",
       " 'public.m51cxo2',\n",
       " 'public.m67cxo',\n",
       " 'public.m71cxo',\n",
       " 'public.m81cxo',\n",
       " 'public.m81cxo2',\n",
       " 'public.m83cxo',\n",
       " 'public.m83xmm',\n",
       " 'public.m87cxo',\n",
       " 'public.macs',\n",
       " 'public.maghmxbcat',\n",
       " 'public.magpis',\n",
       " 'public.maranoxmm',\n",
       " 'public.markarian',\n",
       " 'public.markarian2',\n",
       " 'public.mashpncat',\n",
       " 'public.maxigschgl',\n",
       " 'public.maximaster',\n",
       " 'public.maxissccat',\n",
       " 'public.mcg',\n",
       " 'public.mcksion',\n",
       " 'public.mcxc',\n",
       " 'public.mdwarfasc',\n",
       " 'public.mdwf10pcux',\n",
       " 'public.me',\n",
       " 'public.messier',\n",
       " 'public.metainfo',\n",
       " 'public.mggammacat',\n",
       " 'public.mggammadet',\n",
       " 'public.mgps2',\n",
       " 'public.milliquas',\n",
       " 'public.mitgb6cm',\n",
       " 'public.monr2cxo',\n",
       " 'public.morbbincat',\n",
       " 'public.morx',\n",
       " 'public.mostatlas',\n",
       " 'public.mostsnrcat',\n",
       " 'public.moxc',\n",
       " 'public.mpcraw',\n",
       " 'public.mrc',\n",
       " 'public.msxpsc',\n",
       " 'public.msxuvpsc',\n",
       " 'public.mwa32thgl',\n",
       " 'public.mwacs',\n",
       " 'public.mwak2f1lfc',\n",
       " 'public.mwp1bubble',\n",
       " 'public.mwsc',\n",
       " 'public.mystixires',\n",
       " 'public.mystixmidi',\n",
       " 'public.mystixmpcm',\n",
       " 'public.mystixxray',\n",
       " 'public.napexmmcxo',\n",
       " 'public.narcscat',\n",
       " 'public.ncp21cma',\n",
       " 'public.neargalcat',\n",
       " 'public.newmdwarfs',\n",
       " 'public.ngc1068cxo',\n",
       " 'public.ngc1291cxo',\n",
       " 'public.ngc1332cxo',\n",
       " 'public.ngc1333cxo',\n",
       " 'public.ngc1399cxo',\n",
       " 'public.ngc1512xmm',\n",
       " 'public.ngc1600cxo',\n",
       " 'public.ngc1893cxo',\n",
       " 'public.ngc2000',\n",
       " 'public.ngc2024cxo',\n",
       " 'public.ngc2237cxo',\n",
       " 'public.ngc2244cxo',\n",
       " 'public.ngc2264cx2',\n",
       " 'public.ngc2264cxo',\n",
       " 'public.ngc2264xmm',\n",
       " 'public.ngc2362cxo',\n",
       " 'public.ngc2403cx2',\n",
       " 'public.ngc2403cxo',\n",
       " 'public.ngc2516cxo',\n",
       " 'public.ngc2516xmm',\n",
       " 'public.ngc253xmm',\n",
       " 'public.ngc2547xmm',\n",
       " 'public.ngc2808cxo',\n",
       " 'public.ngc2808xmm',\n",
       " 'public.ngc2903cxo',\n",
       " 'public.ngc300cxo',\n",
       " 'public.ngc3115cxo',\n",
       " 'public.ngc3293cxo',\n",
       " 'public.ngc404cxo',\n",
       " 'public.ngc4214cxo',\n",
       " 'public.ngc4278cxo',\n",
       " 'public.ngc4365cxo',\n",
       " 'public.ngc4382cxo',\n",
       " 'public.ngc4472cxo',\n",
       " 'public.ngc4636cxo',\n",
       " 'public.ngc4649cx2',\n",
       " 'public.ngc4649cxo',\n",
       " 'public.ngc55cxo',\n",
       " 'public.ngc5866cxo',\n",
       " 'public.ngc6231cxo',\n",
       " 'public.ngc6231xmm',\n",
       " 'public.ngc6334cxo',\n",
       " 'public.ngc6357cxo',\n",
       " 'public.ngc6357oid',\n",
       " 'public.ngc6530cxo',\n",
       " 'public.ngc6530oid',\n",
       " 'public.ngc6530xmm',\n",
       " 'public.ngc6791cxo',\n",
       " 'public.ngc752cxo',\n",
       " 'public.ngc752xmm',\n",
       " 'public.nicermastr',\n",
       " 'public.nltt',\n",
       " 'public.noras',\n",
       " 'public.north20cm',\n",
       " 'public.north6cm',\n",
       " 'public.nuaftl',\n",
       " 'public.nucosmosfc',\n",
       " 'public.nuecdfscat',\n",
       " 'public.nugalcen',\n",
       " 'public.numaster',\n",
       " 'public.nustarssc',\n",
       " 'public.nustarssc2',\n",
       " 'public.nuvbemdcat',\n",
       " 'public.nvss',\n",
       " 'public.nwayawgros',\n",
       " 'public.nwayawgxmm',\n",
       " 'public.omc2p3cxo',\n",
       " 'public.omegcencxo',\n",
       " 'public.omegcenxmm',\n",
       " 'public.onccxoopt',\n",
       " 'public.onccxoxray',\n",
       " 'public.openclust',\n",
       " 'public.orionffcxo',\n",
       " 'public.orionxray',\n",
       " 'public.orionxstar',\n",
       " 'public.oriysoir',\n",
       " 'public.oso8alc',\n",
       " 'public.oso8bclc',\n",
       " 'public.oso8pharaw',\n",
       " 'public.oso8rtraw',\n",
       " 'public.osqsonvss',\n",
       " 'public.osrilqxray',\n",
       " 'public.osse',\n",
       " 'public.ostars',\n",
       " 'public.ovro31ghz',\n",
       " 'public.pacobscat',\n",
       " 'public.pacofscat',\n",
       " 'public.pccs030ghz',\n",
       " 'public.pccs044ghz',\n",
       " 'public.pccs070ghz',\n",
       " 'public.pccs100ghz',\n",
       " 'public.pccs143ghz',\n",
       " 'public.pccs217ghz',\n",
       " 'public.pccs353ghz',\n",
       " 'public.pccs545ghz',\n",
       " 'public.pccs857ghz',\n",
       " 'public.pds1p4ghz',\n",
       " 'public.pdsoid',\n",
       " 'public.pdsoid2',\n",
       " 'public.pg',\n",
       " 'public.pgc2003',\n",
       " 'public.phebus',\n",
       " 'public.pigssboofd',\n",
       " 'public.pigsselcnf',\n",
       " 'public.pkscat90',\n",
       " 'public.planckeszc',\n",
       " 'public.planckhzsc',\n",
       " 'public.plancksz',\n",
       " 'public.plancksz2',\n",
       " 'public.pleiadxray',\n",
       " 'public.plnebulae',\n",
       " 'public.pmn',\n",
       " 'public.pmpulsar',\n",
       " 'public.pmsucat',\n",
       " 'public.ppm',\n",
       " 'public.ppmxlbmd',\n",
       " 'public.pulsar',\n",
       " 'public.pvogrb',\n",
       " 'public.qorgcat',\n",
       " 'public.qso',\n",
       " 'public.radio',\n",
       " 'public.rass2foid',\n",
       " 'public.rass2fxray',\n",
       " 'public.rass2mass',\n",
       " 'public.rass2rxs',\n",
       " 'public.rass6dfgs',\n",
       " 'public.rassaeqso',\n",
       " 'public.rassasaseb',\n",
       " 'public.rassasaspv',\n",
       " 'public.rassbsc',\n",
       " 'public.rassbscpgc',\n",
       " 'public.rasscals',\n",
       " 'public.rasscndins',\n",
       " 'public.rasscns3',\n",
       " 'public.rassdssagn',\n",
       " 'public.rassdsstar',\n",
       " 'public.rassdwarf',\n",
       " 'public.rassebcs',\n",
       " 'public.rassfirst',\n",
       " 'public.rassfsc',\n",
       " 'public.rassgb',\n",
       " 'public.rassgiant',\n",
       " 'public.rasshgsft2',\n",
       " 'public.rasshgsoft',\n",
       " 'public.rassmaster',\n",
       " 'public.rassnorsam',\n",
       " 'public.rassob',\n",
       " 'public.rasssdssgc',\n",
       " 'public.rassusnoid',\n",
       " 'public.rassvars',\n",
       " 'public.rasswd',\n",
       " 'public.rbs',\n",
       " 'public.rbscnvss',\n",
       " 'public.rc3',\n",
       " 'public.rcw108cxo',\n",
       " 'public.rcw38cxo',\n",
       " 'public.rcw38cxo2',\n",
       " 'public.rcw38yso',\n",
       " 'public.rcw49cxo',\n",
       " 'public.reflex',\n",
       " 'public.refnebulae',\n",
       " 'public.revisedlhs',\n",
       " 'public.rhessigrb',\n",
       " 'public.rhoophcxo',\n",
       " 'public.rittercv',\n",
       " 'public.ritterlmxb',\n",
       " 'public.ritterrbin',\n",
       " 'public.rixos',\n",
       " 'public.romabzcat',\n",
       " 'public.ros13hrcxo',\n",
       " 'public.ros13hrvla',\n",
       " 'public.ros13hrxmm',\n",
       " 'public.ros400gcls',\n",
       " 'public.rosathard',\n",
       " 'public.rosatlog',\n",
       " 'public.rosatrlq',\n",
       " 'public.rosatrqq',\n",
       " 'public.rosatxuv',\n",
       " 'public.rosettecxo',\n",
       " 'public.rosgalclus',\n",
       " 'public.roshri',\n",
       " 'public.roshritotal',\n",
       " 'public.rosmaster',\n",
       " 'public.rosnepagn',\n",
       " 'public.rosnepoid',\n",
       " 'public.rosnepxray',\n",
       " 'public.rosprspec',\n",
       " 'public.rospspc',\n",
       " 'public.rospspcf',\n",
       " 'public.rospspcftot',\n",
       " 'public.rospspctotal',\n",
       " 'public.roswfc2re',\n",
       " 'public.rotxraycat',\n",
       " 'public.roxa',\n",
       " 'public.rrs8c38mhz',\n",
       " 'public.rssgrbag',\n",
       " 'public.rt9cc15ghz',\n",
       " 'public.rtv9c15ghz',\n",
       " 'public.s254258cxo',\n",
       " 'public.sa57xmm',\n",
       " 'public.sacshpscat',\n",
       " 'public.sacssescat',\n",
       " 'public.sacsspscat',\n",
       " 'public.sacstpscat',\n",
       " 'public.sacy',\n",
       " 'public.saisncat',\n",
       " 'public.sao',\n",
       " 'public.sas2maps',\n",
       " 'public.sas2raw',\n",
       " 'public.sas3ylog',\n",
       " 'public.sax2to10',\n",
       " 'public.saxao',\n",
       " 'public.saxgrbmgrb',\n",
       " 'public.saxhellas',\n",
       " 'public.saxhellasr',\n",
       " 'public.saxnfilog',\n",
       " 'public.saxwfccat',\n",
       " 'public.saxwfccat2',\n",
       " 'public.saxwfclog',\n",
       " 'public.sborbitcat',\n",
       " 'public.sbsggencat',\n",
       " 'public.scubafemoc',\n",
       " 'public.sdssbalqs2',\n",
       " 'public.sdssbalqso',\n",
       " 'public.sdsscvcat',\n",
       " 'public.sdsscxoqso',\n",
       " 'public.sdssdr10wd',\n",
       " 'public.sdssdr7wd',\n",
       " 'public.sdsslasqso',\n",
       " 'public.sdssnbckde',\n",
       " 'public.sdssnbcqsc',\n",
       " 'public.sdssquasar',\n",
       " 'public.sdsss82cxo',\n",
       " 'public.sdsss82xmm',\n",
       " 'public.sdssunuqsr',\n",
       " 'public.sdsswdsd',\n",
       " 'public.sdsswhlgc',\n",
       " 'public.sdssxmmqso',\n",
       " 'public.selhcgcxo',\n",
       " 'public.sfgalhmxb',\n",
       " 'public.sfincspcm',\n",
       " 'public.sfincsxray',\n",
       " 'public.sgraregcsc',\n",
       " 'public.shk',\n",
       " 'public.shkgalaxy',\n",
       " 'public.sigorixmm',\n",
       " 'public.sixdfgs',\n",
       " 'public.sixsrvycat',\n",
       " 'public.smc1400mhz',\n",
       " 'public.smc4800mhz',\n",
       " 'public.smc843mhz',\n",
       " 'public.smc8640mhz',\n",
       " 'public.smcclustrs',\n",
       " 'public.smcdfscxo',\n",
       " 'public.smcpscxmm',\n",
       " 'public.smcradio',\n",
       " 'public.smcrosxray',\n",
       " 'public.smcrosxry2',\n",
       " 'public.smcstars',\n",
       " 'public.smcstars2',\n",
       " 'public.smcwingcxo',\n",
       " 'public.smcxray',\n",
       " 'public.smmgrs',\n",
       " 'public.snrgreen',\n",
       " 'public.spass2p3gh',\n",
       " 'public.spicescxo',\n",
       " 'public.spitzmastr',\n",
       " 'public.sporiabyso',\n",
       " 'public.sptmm87sd',\n",
       " 'public.sptszgalcl',\n",
       " 'public.sptszspsc',\n",
       " 'public.ssa22cxo',\n",
       " 'public.sss',\n",
       " 'public.sssraw',\n",
       " 'public.sterngrb',\n",
       " 'public.subpfclog',\n",
       " 'public.subtab',\n",
       " 'public.sumss',\n",
       " 'public.suzamaster',\n",
       " 'public.suzaxislog',\n",
       " 'public.swbatagn60',\n",
       " 'public.swbatsfxt',\n",
       " 'public.swiftbalog',\n",
       " 'public.swiftgrb',\n",
       " 'public.swiftmastr',\n",
       " 'public.swifttdrss',\n",
       " 'public.swiftuvlog',\n",
       " 'public.swiftxrlog',\n",
       " 'public.swirecxo',\n",
       " 'public.swirelhcxo',\n",
       " 'public.swsdssqso',\n",
       " 'public.swuvotssc',\n",
       " 'public.swuvotssob',\n",
       " 'public.swxcscat',\n",
       " 'public.swxcsoxid',\n",
       " 'public.swxrt1fgl',\n",
       " 'public.sxdscat',\n",
       " 'public.symbiotics',\n",
       " 'public.sza31ghz',\n",
       " 'public.table_classes',\n",
       " 'public.tabledocs',\n",
       " 'public.tartarus',\n",
       " 'public.taurusxmm',\n",
       " 'public.td1',\n",
       " 'public.tevcat',\n",
       " 'public.texas',\n",
       " 'public.tgs',\n",
       " 'public.tgs2',\n",
       " 'public.tramisuboo',\n",
       " 'public.trifidcxo',\n",
       " 'public.twodfqsoz',\n",
       " 'public.twomassrsc',\n",
       " 'public.twosigma',\n",
       " 'public.tycho2',\n",
       " 'public.uc7c151mhz',\n",
       " 'public.ugc',\n",
       " 'public.uhuru4',\n",
       " 'public.uit',\n",
       " 'public.uitmaster',\n",
       " 'public.ulxngcat',\n",
       " 'public.ulxrbcat',\n",
       " 'public.upprscoxmm',\n",
       " 'public.uvotbscat',\n",
       " 'public.uvqs',\n",
       " 'public.uzc',\n",
       " 'public.vela5b',\n",
       " 'public.veroncat',\n",
       " 'public.vla23901p4',\n",
       " 'public.vla3701p4',\n",
       " 'public.vla74mhzdp',\n",
       " 'public.vlacdfscat',\n",
       " 'public.vlacomacat',\n",
       " 'public.vlacos324m',\n",
       " 'public.vlacos3ghz',\n",
       " 'public.vlacosmjsc',\n",
       " 'public.vlacosmos',\n",
       " 'public.vlacosxoid',\n",
       " 'public.vlaecdfs1p4',\n",
       " 'public.vlaecdfscls',\n",
       " 'public.vlaecdfsoi',\n",
       " 'public.vlaen20cm',\n",
       " 'public.vlagbsoph',\n",
       " 'public.vlagbsori',\n",
       " 'public.vlagbsper',\n",
       " 'public.vlagbsser',\n",
       " 'public.vlagbstau',\n",
       " 'public.vlagoodsn',\n",
       " 'public.vlahdf20cm',\n",
       " 'public.vlalh1400m',\n",
       " 'public.vlalhn3ghz',\n",
       " 'public.vlam311p4g',\n",
       " 'public.vlam31325m',\n",
       " 'public.vlanep',\n",
       " 'public.vlaonccat',\n",
       " 'public.vlasdf20cm',\n",
       " 'public.vlasdf90cm',\n",
       " 'public.vlass821p4',\n",
       " 'public.vlasxdf1p4',\n",
       " 'public.vlasxdfoid',\n",
       " 'public.vlaxl325mh',\n",
       " 'public.vlaxl74mhz',\n",
       " 'public.vlssr',\n",
       " 'public.vlulxcat',\n",
       " 'public.vvds20cm',\n",
       " 'public.w2ragncat',\n",
       " 'public.w40sfrcxo',\n",
       " 'public.wackerling',\n",
       " 'public.warps',\n",
       " 'public.warps2',\n",
       " 'public.wbhgp20cm',\n",
       " 'public.wbhgp6cm',\n",
       " 'public.wbl',\n",
       " 'public.wblgalaxy',\n",
       " 'public.wd1cxo',\n",
       " 'public.wds',\n",
       " 'public.wenss',\n",
       " 'public.wfcpoint',\n",
       " 'public.wgacat',\n",
       " 'public.wibrals',\n",
       " 'public.wisehspcat',\n",
       " 'public.wish',\n",
       " 'public.wmapcmbfps',\n",
       " 'public.wmapitnpts',\n",
       " 'public.wmapptsrc',\n",
       " 'public.woodebcat',\n",
       " 'public.woolley',\n",
       " 'public.wrcat',\n",
       " 'public.wsrt20anep',\n",
       " 'public.wsrtgp',\n",
       " 'public.xbootes',\n",
       " 'public.xbootesoid',\n",
       " 'public.xcopraw',\n",
       " 'public.xcs',\n",
       " 'public.xdeep2',\n",
       " 'public.xmdsvvds4s',\n",
       " 'public.xmmao',\n",
       " 'public.xmmatlas',\n",
       " 'public.xmmbss',\n",
       " 'public.xmmbssagn',\n",
       " 'public.xmmcdfs210',\n",
       " 'public.xmmcdfs510',\n",
       " 'public.xmmcfrscat',\n",
       " 'public.xmmcfrsoid',\n",
       " 'public.xmmcosmagn',\n",
       " 'public.xmmcosmoid',\n",
       " 'public.xmmcosmos',\n",
       " 'public.xmmcphotz',\n",
       " 'public.xmmcty2agn',\n",
       " 'public.xmmgps',\n",
       " 'public.xmmlss',\n",
       " 'public.xmmlss10ks',\n",
       " 'public.xmmlssclas',\n",
       " 'public.xmmlssdeep',\n",
       " 'public.xmmlssoid',\n",
       " 'public.xmmmaster',\n",
       " 'public.xmmobstars',\n",
       " 'public.xmmomcat',\n",
       " 'public.xmmomcdfs',\n",
       " 'public.xmmomobj',\n",
       " 'public.xmmomsuob',\n",
       " 'public.xmmomsuss',\n",
       " 'public.xmmsdssgce',\n",
       " 'public.xmmsdssgcs',\n",
       " 'public.xmmslewcln',\n",
       " 'public.xmmslewegs',\n",
       " 'public.xmmslewful',\n",
       " 'public.xmmssc',\n",
       " 'public.xmmsscgps',\n",
       " 'public.xmmssclwbd',\n",
       " 'public.xmmssclwbs',\n",
       " 'public.xmmstack',\n",
       " 'public.xmmstackob',\n",
       " 'public.xmmt2flare',\n",
       " 'public.xmmvaragn',\n",
       " 'public.xmmxassist',\n",
       " 'public.xms',\n",
       " 'public.xray',\n",
       " 'public.xrayselbll',\n",
       " 'public.xrbcat',\n",
       " 'public.xshzagncxo',\n",
       " 'public.xteao',\n",
       " 'public.xteasmlong',\n",
       " 'public.xteassagn',\n",
       " 'public.xteasscat',\n",
       " 'public.xteindex',\n",
       " 'public.xtemaster',\n",
       " 'public.xtemlcat',\n",
       " 'public.xteslew',\n",
       " 'public.xwas',\n",
       " 'public.zcat',\n",
       " 'public.zwclusters',\n",
       " 'public.zzbib',\n",
       " 'MASTER_TABLE.master_table.indexview',\n",
       " 'MASTER_TABLE.master_table.pos_big',\n",
       " 'MASTER_TABLE.master_table.pos_small',\n",
       " 'MASTER_TABLE.master_table.pos_time_big',\n",
       " 'MASTER_TABLE.master_table.pos_time_small',\n",
       " 'MASTER_TABLE.master_table.time']"
      ]
     },
     "execution_count": 6,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Tap.list_tables(url)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Here we find the *public.zcat* table. If we want to know what columns this table contains, we can query:  "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<TableColumns names=('__row','name','ra','dec','lii','bii','bmag','radial_velocity','radial_velocity_error','ref_bmag','ref_radial_velocity','morph_type','bar_type','luminosity_class','structure','diameter_1','diameter_2','bt_mag','ugc_or_eso','distance','rfn_number','comments','redshift','ref_redshift','notes','class','__x_ra_dec','__y_ra_dec','__z_ra_dec')>"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "Tap.list_columns(url,tablename=\"public.zcat\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Success! This appears to be useful table for our goal since it contains columns with the information that we need to select a sample of the brightest nearby spiral galaxy candidates. \n",
    "\n",
    "Now that we know all the possible column information in the zcat catalog, we can do more than query on position (as in a cone search) but also on any other column (e.g., redshift, bmag, morph_type).  The query has to be expressed in a language called __[ADQL](http://www.ivoa.net/documents/latest/ADQL.html)__.  \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"adql\"></a>\n",
    "\n",
    "# 3. Expressing queries in ADQL"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "\n",
    "The basics of ADQL:\n",
    "\n",
    "* *SELECT &#42; FROM my.interesting.catalog as cat...* \n",
    "\n",
    "says you want all (\"&#42;\") columns from the catalog called \"my.interesting.catalog\", which you will refer to in the rest of the query by the more compact name of \"cat\".  \n",
    "\n",
    "Instead of returning all columns, you can \n",
    "\n",
    "* *SELECT cat.RA, cat.DEC, cat.bmag from catalog as cat...* \n",
    "\n",
    "to only return the columns you're interested in. To use multiple catalogs, your query could start, e.g.,\n",
    "\n",
    "* *SELECT c1.RA,c1.DEC,c2.BMAG FROM catalog1 as c1 natural join catalog2 as c2...* \n",
    "\n",
    "says that you want to query two catalogs zipped together the \"natural\" way, i.e., by looking for a common column.\n",
    "\n",
    "To select only some rows of the catalog based on the value in a column, you can add:  \n",
    "\n",
    "* *WHERE cat.bmag < 14* \n",
    "\n",
    "says that you want to retrieve only those entries in the catalog whose bmag column has a value less than 14.\n",
    "\n",
    "You can also append \n",
    "\n",
    "* *ORDER by cat.bmag* \n",
    "\n",
    "to return the result sorted ascending by one of the columns, adding *DESC* to the end for descending. \n",
    "\n",
    "A few special functions in the ADQL allow you to query regions:\n",
    "\n",
    "* *WHERE contains( point('ICRS', cat.ra, cat.dec), circle('ICRS', 210.5, -6.5, 0.5))=1*\n",
    "\n",
    "is how you would ask for any catalog entries whose RA,DEC lie within a circular region defined by RA,DEC 210.5,-6.5 and a radius of 0.5 (all in degrees).  The 'ICRS' specifies the coordinate system.  \n",
    "\n",
    "See the ADQL documentation for more.\n",
    "\n",
    "Here is a simple ADQL query where we print out the relevant columns for the bright (Bmag <14) sources found within 1 degree of M51 (we will discuss how to define the table and column names below):"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [],
   "source": [
    "##  Inside the format call, the {} are replaced by the given variables in order.\n",
    "##  So this asks for \n",
    "##  rows of public.zcat where that row's ra and dec (cat.ra and cat.dec from the catalog) \n",
    "##  are within radius 1deg of the given RA and DEC we got above for M51 \n",
    "##  (coord.ra.deg and coord.dec.deg from our variables defined above), and where \n",
    "##  the bmag column is less than 14.  \n",
    "query=\"\"\"SELECT ra, dec, Radial_Velocity, radial_velocity_error, bmag, morph_type FROM public.zcat as cat where \n",
    "    contains(point('ICRS',cat.ra,cat.dec),circle('ICRS',{},{},1.0))=1 and\n",
    "    cat.bmag < 14\n",
    "    order by cat.radial_velocity_error \n",
    "    \"\"\".format(coord.ra.deg, coord.dec.deg)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {
    "scrolled": true
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=3</i>\n",
       "<table id=\"table34792881960\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>ra</th><th>dec</th><th>radial_velocity</th><th>radial_velocity_error</th><th>bmag</th><th>morph_type</th></tr></thead>\n",
       "<thead><tr><th>float64</th><th>float64</th><th>int32</th><th>int32</th><th>float32</th><th>int32</th></tr></thead>\n",
       "<tr><td>202.46823227</td><td>47.19814872</td><td>474</td><td>23</td><td>9.03</td><td>4</td></tr>\n",
       "<tr><td>202.49490508</td><td>47.2679204</td><td>558</td><td>23</td><td>10.94</td><td>0</td></tr>\n",
       "<tr><td>202.54744757</td><td>46.66995898</td><td>2569</td><td>25</td><td>13.3</td><td>-5</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=3>\n",
       "     ra          dec     radial_velocity ...   bmag  morph_type\n",
       "  float64      float64        int32      ... float32   int32   \n",
       "------------ ----------- --------------- ... ------- ----------\n",
       "202.46823227 47.19814872             474 ...    9.03          4\n",
       "202.49490508  47.2679204             558 ...   10.94          0\n",
       "202.54744757 46.66995898            2569 ...    13.3         -5"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "results=Tap.query(url,query)\n",
    "results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "See the __[information on the zcat](https://heasarc.gsfc.nasa.gov/W3Browse/galaxy-catalog/zcat.html)__ for column information. (We will use the 'radial_velocity' column rather than the 'redshift' column.) We note that spiral galaxies have morph_type between 1 - 9. "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Therefore, we can generalize the query above to complete our exercise and select the brightest (bmag < 14), nearby (radial velocity < 3000), spiral ( morph_type = 1 - 9) galaxies as follows: "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "query=\"\"\"SELECT ra, dec, Radial_Velocity, radial_velocity_error, bmag, morph_type FROM public.zcat as cat where \n",
    "    cat.bmag < 14 and cat.morph_type between 1 and 9 and cat.Radial_Velocity < 3000 \n",
    "    order by cat.Radial_velocity \n",
    "    \"\"\".format(coord.ra.deg, coord.dec.deg)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=1120</i>\n",
       "<table id=\"table34818997664\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>ra</th><th>dec</th><th>radial_velocity</th><th>radial_velocity_error</th><th>bmag</th><th>morph_type</th></tr></thead>\n",
       "<thead><tr><th>float64</th><th>float64</th><th>int32</th><th>int32</th><th>float32</th><th>int32</th></tr></thead>\n",
       "<tr><td>10.6847407</td><td>41.26882595</td><td>-297</td><td>1</td><td>4.3</td><td>3</td></tr>\n",
       "<tr><td>189.20757439</td><td>13.16274802</td><td>-223</td><td>18</td><td>10.58</td><td>2</td></tr>\n",
       "<tr><td>186.73679277</td><td>15.04781754</td><td>-182</td><td>12</td><td>12.23</td><td>1</td></tr>\n",
       "<tr><td>23.46217921</td><td>30.6601917</td><td>-180</td><td>1</td><td>6.5</td><td>5</td></tr>\n",
       "<tr><td>186.49550755</td><td>15.67102319</td><td>-155</td><td>26</td><td>13.7</td><td>7</td></tr>\n",
       "<tr><td>183.45114982</td><td>14.90009805</td><td>-98</td><td>15</td><td>11.0</td><td>2</td></tr>\n",
       "<tr><td>183.91295676</td><td>13.90133935</td><td>-84</td><td>27</td><td>12.08</td><td>4</td></tr>\n",
       "<tr><td>148.89928698</td><td>69.06297291</td><td>-40</td><td>5</td><td>7.75</td><td>2</td></tr>\n",
       "<tr><td>68.21187756</td><td>71.88871924</td><td>-28</td><td>10</td><td>12.1</td><td>7</td></tr>\n",
       "<tr><td>184.18072097</td><td>69.46565852</td><td>-7</td><td>4</td><td>10.4</td><td>8</td></tr>\n",
       "<tr><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td><td>...</td></tr>\n",
       "<tr><td>25.54104856</td><td>12.60243687</td><td>2964</td><td>27</td><td>13.6</td><td>3</td></tr>\n",
       "<tr><td>160.76076224</td><td>-36.36215965</td><td>2965</td><td>36</td><td>13.8</td><td>5</td></tr>\n",
       "<tr><td>186.92023525</td><td>-8.27656738</td><td>2978</td><td>20</td><td>13.13</td><td>2</td></tr>\n",
       "<tr><td>327.32061503</td><td>-60.6095822</td><td>2981</td><td>2</td><td>13.23</td><td>5</td></tr>\n",
       "<tr><td>85.81306116</td><td>-30.07849161</td><td>2982</td><td>32</td><td>13.67</td><td>1</td></tr>\n",
       "<tr><td>199.74246364</td><td>-47.9127092</td><td>2982</td><td>10</td><td>13.1</td><td>3</td></tr>\n",
       "<tr><td>268.99556371</td><td>18.34046888</td><td>2986</td><td>20</td><td>13.4</td><td>2</td></tr>\n",
       "<tr><td>234.99207988</td><td>58.08229864</td><td>2987</td><td>22</td><td>13.3</td><td>3</td></tr>\n",
       "<tr><td>165.35109482</td><td>57.67702323</td><td>2994</td><td>20</td><td>13.7</td><td>5</td></tr>\n",
       "<tr><td>149.05804536</td><td>59.30739142</td><td>2996</td><td>20</td><td>13.3</td><td>3</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=1120>\n",
       "     ra          dec      radial_velocity ...   bmag  morph_type\n",
       "  float64      float64         int32      ... float32   int32   \n",
       "------------ ------------ --------------- ... ------- ----------\n",
       "  10.6847407  41.26882595            -297 ...     4.3          3\n",
       "189.20757439  13.16274802            -223 ...   10.58          2\n",
       "186.73679277  15.04781754            -182 ...   12.23          1\n",
       " 23.46217921   30.6601917            -180 ...     6.5          5\n",
       "186.49550755  15.67102319            -155 ...    13.7          7\n",
       "183.45114982  14.90009805             -98 ...    11.0          2\n",
       "183.91295676  13.90133935             -84 ...   12.08          4\n",
       "148.89928698  69.06297291             -40 ...    7.75          2\n",
       " 68.21187756  71.88871924             -28 ...    12.1          7\n",
       "184.18072097  69.46565852              -7 ...    10.4          8\n",
       "         ...          ...             ... ...     ...        ...\n",
       " 25.54104856  12.60243687            2964 ...    13.6          3\n",
       "160.76076224 -36.36215965            2965 ...    13.8          5\n",
       "186.92023525  -8.27656738            2978 ...   13.13          2\n",
       "327.32061503  -60.6095822            2981 ...   13.23          5\n",
       " 85.81306116 -30.07849161            2982 ...   13.67          1\n",
       "199.74246364  -47.9127092            2982 ...    13.1          3\n",
       "268.99556371  18.34046888            2986 ...    13.4          2\n",
       "234.99207988  58.08229864            2987 ...    13.3          3\n",
       "165.35109482  57.67702323            2994 ...    13.7          5\n",
       "149.05804536  59.30739142            2996 ...    13.3          3"
      ]
     },
     "execution_count": 11,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "results=Tap.query(url,query)\n",
    "results"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"cc\"></a>\n",
    "# 4. TAP:  Using the TAP to cross-correlate our objects with a catalog"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "TAP can also be a powerful way to collect a lot of useful information from existing catalogs in one quick step. For this exercise, we will start with a list of sources, uploaded from our own table, and do a 'cross-correlation' with the *zcat* table. \n",
    "\n",
    "For more on creating and working with VO tables, see that [notebook](VO_Tables.ipynb).  Here, we just read one in that's already prepared:  \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "(These take a while, i.e. half a minute.)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=14</i>\n",
       "<table id=\"table34798700920\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>ra</th><th>dec</th><th>radial_velocity</th><th>bmag</th><th>morph_type</th></tr></thead>\n",
       "<thead><tr><th>float64</th><th>float64</th><th>int32</th><th>float32</th><th>int32</th></tr></thead>\n",
       "<tr><td>136.00074371</td><td>21.96791867</td><td>3093</td><td>13.8</td><td>20</td></tr>\n",
       "<tr><td>146.70334308</td><td>22.01827217</td><td>7446</td><td>14.6</td><td>-1</td></tr>\n",
       "<tr><td>146.70334308</td><td>22.01827217</td><td>7597</td><td>15.0</td><td>-2</td></tr>\n",
       "<tr><td>148.77805631</td><td>14.29613296</td><td>7194</td><td>15.1</td><td>2</td></tr>\n",
       "<tr><td>175.03940162</td><td>15.32725392</td><td>3325</td><td>14.4</td><td>3</td></tr>\n",
       "<tr><td>191.54198643</td><td>30.73226569</td><td>6651</td><td>15.0</td><td>20</td></tr>\n",
       "<tr><td>191.54739911</td><td>30.72338192</td><td>6517</td><td>14.7</td><td>-2</td></tr>\n",
       "<tr><td>194.91294475</td><td>28.89537435</td><td>6093</td><td>15.0</td><td>0</td></tr>\n",
       "<tr><td>206.57163823</td><td>43.85050581</td><td>2229</td><td>15.0</td><td>-1</td></tr>\n",
       "<tr><td>206.57996426</td><td>43.84385707</td><td>25864</td><td>18.5</td><td>-1</td></tr>\n",
       "<tr><td>209.96260244</td><td>38.18183343</td><td>2759</td><td>14.9</td><td>3</td></tr>\n",
       "<tr><td>213.55601199</td><td>15.62222407</td><td>4644</td><td>14.0</td><td>3</td></tr>\n",
       "<tr><td>219.96649997</td><td>42.74233535</td><td>2517</td><td>14.7</td><td>20</td></tr>\n",
       "<tr><td>333.82169725</td><td>37.29922141</td><td>5207</td><td>15.3</td><td>1</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=14>\n",
       "     ra          dec     radial_velocity   bmag  morph_type\n",
       "  float64      float64        int32      float32   int32   \n",
       "------------ ----------- --------------- ------- ----------\n",
       "136.00074371 21.96791867            3093    13.8         20\n",
       "146.70334308 22.01827217            7446    14.6         -1\n",
       "146.70334308 22.01827217            7597    15.0         -2\n",
       "148.77805631 14.29613296            7194    15.1          2\n",
       "175.03940162 15.32725392            3325    14.4          3\n",
       "191.54198643 30.73226569            6651    15.0         20\n",
       "191.54739911 30.72338192            6517    14.7         -2\n",
       "194.91294475 28.89537435            6093    15.0          0\n",
       "206.57163823 43.85050581            2229    15.0         -1\n",
       "206.57996426 43.84385707           25864    18.5         -1\n",
       "209.96260244 38.18183343            2759    14.9          3\n",
       "213.55601199 15.62222407            4644    14.0          3\n",
       "219.96649997 42.74233535            2517    14.7         20\n",
       "333.82169725 37.29922141            5207    15.3          1"
      ]
     },
     "execution_count": 12,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "query=\"\"\"\n",
    "    SELECT cat.ra, cat.dec, Radial_Velocity, bmag, morph_type\n",
    "    FROM zcat cat, tap_upload.mysources mt \n",
    "    WHERE\n",
    "    contains(point('ICRS',cat.ra,cat.dec),circle('ICRS',mt.ra,mt.dec,0.01))=1\n",
    "    and Radial_Velocity > 0\n",
    "    ORDER by cat.ra\"\"\"\n",
    "zcattable=Tap.query(url,query,upload_file=\"data/my_sources.xml\",upload_name='mysources')\n",
    "zcattable"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Therefore we now have the Bmag, morphological type and radial velocities for all the sources in our list with a single TAP query. \n",
    "\n",
    "FYI, this is what the same query looks like with the __[TapPlus library developed by ESDC](https://astroquery.readthedocs.io/en/latest/utils/tap.html)__.  A note about that library:  the \"Plus\" part refers to functions that are beyond the defined VO protocol and developed to work with extensions to the Gaia services.  Not all TapPlus functions will then work on all VO-compliant TAP services.  This function, however, is generic:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "#from astroquery.utils.tap.core import TapPlus\n",
    "#xamin=TapPlus(url=tap_services[0]['access_url'])\n",
    "#job=xamin.launch_job(query=query, upload_resource='data/my_sources.xml', upload_table_name=\"mysources\", verbose=True)\n",
    "#result = job.get_results()\n",
    "#result.pprint()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "<a id=\"combo\"></a>\n",
    "\n",
    "# 5.  Combining data from different catalogs and cross-correlating\n",
    "\n",
    "Our input list of sources contains galaxy pair candidates that may be interacting with each other. Therefore it would be interesting to know what the morphological type and the Bmagnitude are for the potential companions. \n",
    "\n",
    "In this advanced example, we want our search to be physically motivated since the criterion for galaxy interaction depends on the physical separation of the galaxies. Unlike the previous case, the search radius is not a constant, but varies for each candidate by the distance to the source. Specifically, we want to search for companions that are within 50 kpc of the candidate and therefore first need to find the angular diameter distance that corresponds to galaxy's distance (in our case the radial velocity).\n",
    "\n",
    "Therefore, we begin by taking our table of objects and adding an angDdeg column:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=14</i>\n",
       "<table id=\"table34798700920\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>ra</th><th>dec</th><th>radial_velocity</th><th>bmag</th><th>morph_type</th><th>redshift</th><th>angDdeg</th></tr></thead>\n",
       "<thead><tr><th></th><th></th><th></th><th></th><th></th><th></th><th>deg</th></tr></thead>\n",
       "<thead><tr><th>float64</th><th>float64</th><th>int32</th><th>float32</th><th>int32</th><th>float64</th><th>float64</th></tr></thead>\n",
       "<tr><td>136.00074371</td><td>21.96791867</td><td>3093</td><td>13.8</td><td>20</td><td>0.01031</td><td>0.0011097660332591386</td></tr>\n",
       "<tr><td>146.70334308</td><td>22.01827217</td><td>7446</td><td>14.6</td><td>-1</td><td>0.02482</td><td>0.0004691999680834195</td></tr>\n",
       "<tr><td>146.70334308</td><td>22.01827217</td><td>7597</td><td>15.0</td><td>-2</td><td>0.025323333333333333</td><td>0.0004601544041704519</td></tr>\n",
       "<tr><td>148.77805631</td><td>14.29613296</td><td>7194</td><td>15.1</td><td>2</td><td>0.02398</td><td>0.00048514171179516753</td></tr>\n",
       "<tr><td>175.03940162</td><td>15.32725392</td><td>3325</td><td>14.4</td><td>3</td><td>0.011083333333333334</td><td>0.001033309415720354</td></tr>\n",
       "<tr><td>191.54198643</td><td>30.73226569</td><td>6651</td><td>15.0</td><td>20</td><td>0.02217</td><td>0.0005235991638639783</td></tr>\n",
       "<tr><td>191.54739911</td><td>30.72338192</td><td>6517</td><td>14.7</td><td>-2</td><td>0.021723333333333334</td><td>0.0005340756468748453</td></tr>\n",
       "<tr><td>194.91294475</td><td>28.89537435</td><td>6093</td><td>15.0</td><td>0</td><td>0.02031</td><td>0.0005702614527842385</td></tr>\n",
       "<tr><td>206.57163823</td><td>43.85050581</td><td>2229</td><td>15.0</td><td>-1</td><td>0.00743</td><td>0.0015345104005632876</td></tr>\n",
       "<tr><td>206.57996426</td><td>43.84385707</td><td>25864</td><td>18.5</td><td>-1</td><td>0.08621333333333334</td><td>0.00014529104363823325</td></tr>\n",
       "<tr><td>209.96260244</td><td>38.18183343</td><td>2759</td><td>14.9</td><td>3</td><td>0.009196666666666667</td><td>0.0012424187773018348</td></tr>\n",
       "<tr><td>213.55601199</td><td>15.62222407</td><td>4644</td><td>14.0</td><td>3</td><td>0.01548</td><td>0.0007438075221524036</td></tr>\n",
       "<tr><td>219.96649997</td><td>42.74233535</td><td>2517</td><td>14.7</td><td>20</td><td>0.00839</td><td>0.0013605281256629975</td></tr>\n",
       "<tr><td>333.82169725</td><td>37.29922141</td><td>5207</td><td>15.3</td><td>1</td><td>0.017356666666666666</td><td>0.0006649024273307263</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=14>\n",
       "     ra          dec     ...       redshift              angDdeg        \n",
       "                         ...                               deg          \n",
       "  float64      float64   ...       float64               float64        \n",
       "------------ ----------- ... -------------------- ----------------------\n",
       "136.00074371 21.96791867 ...              0.01031  0.0011097660332591386\n",
       "146.70334308 22.01827217 ...              0.02482  0.0004691999680834195\n",
       "146.70334308 22.01827217 ... 0.025323333333333333  0.0004601544041704519\n",
       "148.77805631 14.29613296 ...              0.02398 0.00048514171179516753\n",
       "175.03940162 15.32725392 ... 0.011083333333333334   0.001033309415720354\n",
       "191.54198643 30.73226569 ...              0.02217  0.0005235991638639783\n",
       "191.54739911 30.72338192 ... 0.021723333333333334  0.0005340756468748453\n",
       "194.91294475 28.89537435 ...              0.02031  0.0005702614527842385\n",
       "206.57163823 43.85050581 ...              0.00743  0.0015345104005632876\n",
       "206.57996426 43.84385707 ...  0.08621333333333334 0.00014529104363823325\n",
       "209.96260244 38.18183343 ... 0.009196666666666667  0.0012424187773018348\n",
       "213.55601199 15.62222407 ...              0.01548  0.0007438075221524036\n",
       "219.96649997 42.74233535 ...              0.00839  0.0013605281256629975\n",
       "333.82169725 37.29922141 ... 0.017356666666666666  0.0006649024273307263"
      ]
     },
     "execution_count": 14,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "mytable = zcattable\n",
    "## The radial_velocity is in km/s, and this is just c*z, so\n",
    "c=3.0e5 # km/s\n",
    "redshifts=mytable['radial_velocity'].filled(0.)/c  # Filling masked values with zero\n",
    "mytable['redshift']=redshifts\n",
    "from astropy import units\n",
    "physdist=0.05*units.Mpc # 50 kpc physical distance\n",
    "\n",
    "## This needs scipy.  \n",
    "from astropy.cosmology import Planck15\n",
    "angDdist=Planck15.angular_diameter_distance(mytable['redshift'])\n",
    "## angDdist is returned from the astropy.cosmology module as a Quantity object, \n",
    "##  i.e. a value and a unit.  Arctan is smart enough not to operate on quantities\n",
    "##  that aren't unitless.  So angDdist.value to just get the value.\n",
    "angDrad=np.arctan(physdist/angDdist)\n",
    "angDdeg=angDrad*units.deg/units.rad\n",
    "mytable['angDdeg']=angDdeg\n",
    "mytable"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "This time, rather than write the table to disk, we'll keep it in memory and give Tap.query() a \"file-like\" object using io.BytesIO():"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "<TableColumns names=('ra','dec','radial_velocity','bmag','morph_type','redshift','angDdeg')>\n"
     ]
    }
   ],
   "source": [
    "## In memory only, use an IO stream. \n",
    "vot_obj=io.BytesIO()\n",
    "print(mytable.columns)\n",
    "apvot.writeto(apvot.from_table(mytable),vot_obj)\n",
    "## (Reset the \"file-like\" object to the beginning.)\n",
    "vot_obj.seek(0)\n",
    "## 'uplt' is what we'll call it (for 'upload table') \n",
    "##   in the requests parameters below, or what you will:\n",
    "files={'uplt':vot_obj}\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we construct and run a query that uses the new angDdeg column in every row search. Note, we also don't want to list the original candidates since we know these are in the catalog and we want rather to find any companions. Therefore, we exclude the match if the radial velocities match exactly.\n",
    "\n",
    "This takes half a minute:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<i>Table masked=True length=2</i>\n",
       "<table id=\"table34819223280\" class=\"table-striped table-bordered table-condensed\">\n",
       "<thead><tr><th>ra</th><th>dec</th><th>ra_2</th><th>dec_2</th><th>radial_velocity</th><th>morph_type</th><th>bmag</th></tr></thead>\n",
       "<thead><tr><th>float64</th><th>float64</th><th>float64</th><th>float64</th><th>int32</th><th>int32</th><th>float32</th></tr></thead>\n",
       "<tr><td>146.70334308</td><td>22.01827217</td><td>146.70334308</td><td>22.01827217</td><td>7446</td><td>-1</td><td>14.6</td></tr>\n",
       "<tr><td>146.70334308</td><td>22.01827217</td><td>146.70334308</td><td>22.01827217</td><td>7597</td><td>-2</td><td>15.0</td></tr>\n",
       "</table>"
      ],
      "text/plain": [
       "<Table masked=True length=2>\n",
       "     ra          dec         ra_2     ... radial_velocity morph_type   bmag \n",
       "  float64      float64     float64    ...      int32        int32    float32\n",
       "------------ ----------- ------------ ... --------------- ---------- -------\n",
       "146.70334308 22.01827217 146.70334308 ...            7446         -1    14.6\n",
       "146.70334308 22.01827217 146.70334308 ...            7597         -2    15.0"
      ]
     },
     "execution_count": 16,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "query=\"\"\"SELECT mt.ra, mt.dec, cat.ra, cat.dec, cat.Radial_Velocity, cat.morph_type, cat.bmag \n",
    "    FROM zcat cat, tap_upload.mytable mt \n",
    "    WHERE\n",
    "    contains(point('ICRS',cat.ra,cat.dec),circle('ICRS',mt.ra,mt.dec,mt.angDdeg))=1\n",
    "    and cat.Radial_Velocity > 0 and cat.radial_velocity != mt.radial_velocity\n",
    "    ORDER by cat.ra\"\"\"\n",
    "\n",
    "mytable2=Tap.query(url,query,upload_file=vot_obj,upload_name='mytable')\n",
    "mytable2"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "#### Therefore, by adding new information to our original data table, we could cross-correlate with the TAP.  We find that, in our candidate list, there is one true pair of galaxies!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "anaconda-cloud": {},
  "kernelspec": {
   "display_name": "Python [conda env:navo-py3]",
   "language": "python",
   "name": "conda-env-navo-py3-py"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}