Skip to content

Commit

Permalink
deploy: 14422d2
Browse files Browse the repository at this point in the history
  • Loading branch information
@adamtwo
adamtwo committed Sep 13, 2023
1 parent f9a97fb commit b5d85f0
Show file tree
Hide file tree
Showing 3 changed files with 65 additions and 65 deletions.
18 changes: 9 additions & 9 deletions elt/transforming-external-data-loaded-via-airbyte-in-teradata-vantage-using-dbt.html
View file
Original file line number Diff line number Diff line change
Expand Up @@ -1803,7 +1803,7 @@ <h2 id="_configure_dbt"><a class="anchor" href="#_configure_dbt"></a>Configure d
</div>
</div>
<div class="sect1">
<h2 id="_the_jaffle_shop_dbt_project"><a class="anchor" href="#_the_jaffle_shop_dbt_project"></a>The Jaffle Shop dbt Project</h2>
<h2 id="_the_jaffle_shop_dbt_project"><a class="anchor" href="#_the_jaffle_shop_dbt_project"></a>The Jaffle Shop dbt project</h2>
<div class="sectionbody">
<div class="paragraph">
<p><code>jaffle_shop</code> is a fictional restaurant that takes orders online. The data of this business consists of tables for <code>customers</code>, <code>orders</code> and `payments`that follow the entity relations diagram below:</p>
Expand All @@ -1824,7 +1824,7 @@ <h2 id="_the_jaffle_shop_dbt_project"><a class="anchor" href="#_the_jaffle_shop_
</div>
</div>
<div class="sect1">
<h2 id="_dbt_transformations"><a class="anchor" href="#_dbt_transformations"></a>dbt Transformations</h2>
<h2 id="_dbt_transformations"><a class="anchor" href="#_dbt_transformations"></a>dbt transformations</h2>
<div class="sectionbody">
<div class="admonitionblock note">
<table>
Expand Down Expand Up @@ -1868,7 +1868,7 @@ <h2 id="_dbt_transformations"><a class="anchor" href="#_dbt_transformations"></a
<p>The models can be organized into different folders according to their purpose in the organization of the data warehouse/lake. Common folder layouts include a folder for <code>staging</code>, a folder for <code>core</code>, and a folder for <code>marts</code>. This structure can be simplified without affecting the workings of dbt.</p>
</div>
<div class="sect2">
<h3 id="_staging_models"><a class="anchor" href="#_staging_models"></a>Staging Models</h3>
<h3 id="_staging_models"><a class="anchor" href="#_staging_models"></a>Staging models</h3>
<div class="paragraph">
<p>In the original <a href="https://github.com/dbt-labs/jaffle_shop-dev" target="_blank" rel="noopener">dbt Jaffle Shop tutorial</a> the project&#8217;s data is loaded from csv files located in the <code>./data</code> folder through dbt&#8217;s <code>seed</code> command. The <code>seed</code> command is commonly used to load data from tables, however, this command is not designed to perform data loading.</p>
</div>
Expand Down Expand Up @@ -1943,9 +1943,9 @@ <h3 id="_staging_models"><a class="anchor" href="#_staging_models"></a>Staging M
</div>
</div>
<div class="sect2">
<h3 id="_dimensional_models_marts"><a class="anchor" href="#_dimensional_models_marts"></a>Dimensional Models (Marts)</h3>
<h3 id="_dimensional_models_marts"><a class="anchor" href="#_dimensional_models_marts"></a>Dimensional models (marts)</h3>
<div class="paragraph">
<p>Building a Dimensional Model is a two step process:</p>
<p>Building a Dimensional Model is a two-step process:</p>
</div>
<div class="ulist">
<ul>
Expand All @@ -1959,7 +1959,7 @@ <h3 id="_dimensional_models_marts"><a class="anchor" href="#_dimensional_models_
</div>
</div>
<div class="sect2">
<h3 id="_executing_transformations"><a class="anchor" href="#_executing_transformations"></a>Executing Transformations</h3>
<h3 id="_executing_transformations"><a class="anchor" href="#_executing_transformations"></a>Executing transformations</h3>
<div class="paragraph">
<p>For executing the transformations defined in the dbt project we run:</p>
</div>
Expand All @@ -1978,7 +1978,7 @@ <h3 id="_executing_transformations"><a class="anchor" href="#_executing_transfor
</div>
</div>
<div class="sect2">
<h3 id="_model_testing"><a class="anchor" href="#_model_testing"></a>Model Testing</h3>
<h3 id="_test_data"><a class="anchor" href="#_test_data"></a>Test data</h3>
<div class="paragraph">
<p>To ensure that the data in the dimensional model is correct, dbt allows us to define and execute tests against the data.</p>
</div>
Expand Down Expand Up @@ -2010,7 +2010,7 @@ <h3 id="_model_testing"><a class="anchor" href="#_model_testing"></a>Model Testi
</div>
</div>
<div class="sect2">
<h3 id="_generate_documentation"><a class="anchor" href="#_generate_documentation"></a>Generate Documentation</h3>
<h3 id="_generate_documentation"><a class="anchor" href="#_generate_documentation"></a>Generate documentation</h3>
<div class="paragraph">
<p>Our model consists of just a few tables. In a scenario with more sources of data, and a more complex dimensional model, documenting the data lineage and what is the purpose of each of the intermediate models is very important.</p>
</div>
Expand All @@ -2034,7 +2034,7 @@ <h3 id="_generate_documentation"><a class="anchor" href="#_generate_documentatio
</div>
</div>
<div class="sect3">
<h4 id="_lineage_graph"><a class="anchor" href="#_lineage_graph"></a>Lineage Graph</h4>
<h4 id="_lineage_graph"><a class="anchor" href="#_lineage_graph"></a>Lineage graph</h4>
<div class="imageblock">
<div class="content">
<img src="_images/getting-started-with-airbyte-dbt/dbt_docs_serve.png" alt="dbt lineage graph" width="75%">
Expand Down
2 changes: 1 addition & 1 deletion search-index.js
View file

Large diffs are not rendered by default.

110 changes: 55 additions & 55 deletions sitemap.xml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -2,222 +2,222 @@
<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
<url>
<loc>https://quickstarts.teradata.com/advanced-dbt.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/business-intelligence/create-stunning-visualizations-in-power-bi-using-data-from-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/connect-azure-data-share-to-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/integrate-teradata-jupyter-extensions-with-google-vertex-ai.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/integrate-teradata-jupyter-extensions-with-sagemaker.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/integrate-teradata-vantage-to-salesforce-using-amazon-appflow.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/integrate-teradata-vantage-with-google-cloud-data-catalog.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/sagemaker-with-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/cloud-guides/use-teradata-vantage-with-azure-machine-learning-studio.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/create-parquet-files-in-object-storage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/dbt.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/elt/transforming-external-data-loaded-via-airbyte-in-teradata-vantage-using-dbt.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/elt/use-airbyte-to-load-data-from-external-sources-to-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/fastload.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/geojson-to-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/getting.started.utm.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/getting.started.vbox.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/getting.started.vmware.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/index.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/install-teradata-studio-on-mac-m1-m2.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/jdbc.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/jupyter-demos/gcp-vertex-ai-pipelines-vantage-byom-housing-example.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/jupyter-demos/index.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/jupyter.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/local.jupyter.hub.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/ml.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/modelops/deploy-and-monitor-machine-learning-models-with-teradata-modelops-and-byom.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/modelops/deploy-and-monitor-machine-learning-models-with-teradata-modelops-and-git.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/modelops/using-feast-feature-store-with-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/mule-teradata-connector/examples-configuration.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/mule-teradata-connector/index.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/mule-teradata-connector/reference.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/mule-teradata-connector/release-notes.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/mule.jdbc.example.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/nos.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/odbc.ubuntu.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/other-integrations/configure-a-teradata-vantage-connection-in-dbeaver.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/other-integrations/execute-airflow-workflows-that-use-dbt-with-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/other-integrations/getting.started.dbt-feast-teradata-pipeline.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/other-integrations/integrate-teradata-vantage-with-knime.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/perform-time-series-analysis-using-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/query-service/send-queries-using-rest-api.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/regulus/getting-started-with-regulus.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/regulus/install-regulus-docker-image.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/regulus/regulus-magic-reference.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/regulus/using-regulus-workspace-cli.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/run-vantage-express-on-aws.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/run-vantage-express-on-microsoft-azure.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/segment.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/select-the-right-data-ingestion-tools-for-teradata-vantage.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/sto.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/teradata-vantage-engine-architecture-and-concepts.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/teradatasql.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/tools-and-utilities/run-bulkloads-efficiently-with-teradata-parallel-transporter.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
<url>
<loc>https://quickstarts.teradata.com/vantage.express.gcp.html</loc>
<lastmod>2023-09-13T09:29:30.725Z</lastmod>
<lastmod>2023-09-13T10:41:08.801Z</lastmod>
</url>
</urlset>

0 comments on commit b5d85f0

Please sign in to comment.