Release 1.8.0

[tatiana]

New Features

• Support customizing Airflow operator arguments per dbt node by @wornjs in Configure Airflow tasks using dbt model meta #1339. More information.
• Support uploading dbt artifacts to remote cloud storages via callback by @pankajkoti in Add helper functions for uploading target directory artifacts to remote cloud storages #1389. Read more.
• Add support to TestBehavior.BUILD by @tatiana in Add support to TestBehavior.BUILD #1377. Documentation.
• Add support for the "at" operator when using LoadMode.DBT_MANIFEST or CUSTOM by @benjy44 in Add support for the "at" operator #1372
• Add dbt clone operator by @pankajastro in Add dbt clone operator #1326, as documented in here.
• Support rendering tasks with non-ASCII characters by @t0momi219 in Support rendering tasks with non-ASCII characters #1278 Read more
• Add warning callback on source freshness by @pankajastro in Add warning callback on source freshness #1400 Read more
• Add Oracle Profile mapping by @slords and @pankajkoti in Add Oracle to airflow->cosmos profile map #1190 and Add Oracle Profile mapping #1404
• Emit telemetry to Scarf during DAG run by @tatiana in Emit telemetry to Scarf during DAG run #1397
• Save tasks map as DbtToAirflowConverter property by @internetcoffeephone and @hheemskerk in Save tasks map as DbtToAirflowConverter property #1362

Bug Fixes

• Fix the mock value of port in TrinoBaseProfileMapping to be an integer by @dwolfeu Change the mock value of port in TrinoBaseProfileMapping to an integer #1322
• Fix access to the dbt docs menu item outside of Astro cloud by @tatiana in Fix access to the dbt docs menu item outside of Astro cloud #1312
• Add missing DbtSourceGcpCloudRunJobOperator in module cosmos.operators.gcp_cloud_run_job by @anai-s in Add missing DbtSourceGcpCloudRunJobOperator in module cosmos.operators.gcp_cloud_run_job #1290
• Support building DbtDag without setting paths in ProjectConfig by @tatiana in Support building DbtDag without setting paths in ProjectConfig #1307
• Fix parsing dbt ls outputs that contain JSONs that are not dbt nodes by @tatiana in Fix parsing dbt ls outputs that contain JSONs that are not dbt nodes #1296
• Fix Snowflake Profile mapping when using AWS default region by @tatiana in Fix Snowflake Profile mapping when using AWS default region #1406
• Fix dag rendering for taskflow + DbtTaskGroup combo by @pankajastro in Fix dag randering for taskflow + DbtTaskGroup combo #1360

Enhancements

• Improve dbt command execution logs to troubleshoot None values by @tatiana in Improve dbt command execution logs to troubleshoot None values #1392
• Add logging of stdout to dbt graph run_command by @KarolGongola in Add logging of stdout to dbt graph run_command. #1390
• Save tasks map as DbtToAirflowConverter property by @internetcoffeephone and @hheemskerk in Save tasks map as DbtToAirflowConverter property #1362
• Support rendering build operator task-id with non-ASCII characters by @pankajastro in Support rendering build operator task-id with non-ASCII characters #1415

Docs

• Remove extra ` char from docs by @pankajastro in [Docs] Remove extra ` char from docs #1345
• Add limitation about copying target dir files to remote by @pankajkoti in [Docs] Add limitation about copying target dir files to remote #1305
• Generalise example from README by @ReadytoRocc in Getting started dag adding variable and imports #1311
• Add security policy by @tatiana, @chaosmaw and @lzdanski in # 1385
• Mention in documentation that the callback functionality is supported in ExecutionMode.VIRTUALENV by @pankajkoti in Mention in documentation that the callback functionality is supported in ExecutionMode.VIRTUALENV #1401

Others

• Restore Jaffle Shop so that basic_cosmos_dag works as documented by @tatiana in Restore Jaffle Shop so that basic_cosmos_dag works as documented #1374
• Remove Pytest durations from tests scripts by @tatiana in Remove Pytest durations from tests scripts #1383
• Remove typing-extensions as dependency by @pankajastro in Remove typing-extensions as dependency #1381
• Pin dbt-databricks version to < 1.9 by @pankajastro in Pin dbt-databricks version to < 1.9 #1376
• Refactor dbt-sqlite tests to use dbt-postgres by @pankajastro in Refactor dbt-sqlite tests to use dbt-postgres #1366
• Remove 'dbt-core<1.8.9' pin by @tatiana in Remove 'dbt-core<1.8.9' pin #1371
• Remove dependency eval_type_backport by @tatiana in Remove dependency eval_type_backport #1370
• Enable kubernetes tests for dbt>=1.8 by @pankajastro Enable kubernetes tests for dbt>=1.8 #1364
• CI Workaround: Pin dbt-core, Disable SQLite Tests, and Correctly Ignore Clone Test to Pass CI by @pankajastro in CI Workaround: Pin dbt-core, Disable SQLite Tests, and Correctly Ignore Clone Test to Pass CI #1337
• Enable Azure task in the remote store manifest example DAG by @pankajkoti in Enable Azure task in the remote store manifest example DAG #1333
• Enable GCP remote manifest task by @pankajastro in Enable GCP remote manifest task #1332
• Add exempt label option in GH action stale job by @pankajastro in Add exempt label option in GH action stale job #1328
• Add integration test for source node rendering by @pankajastro in Add integration test for source node rendering #1327
• Fix vulnerability issue on docs dependency by @tatiana in Fix vulnerability issue on docs dependency #1313
• Add postgres pod status check for k8s tests in CI by @pankajkoti in Add postgres pod status check for k8s tests in CI #1320
• [CI] Reduce the amount taking to run tests in the CI from 5h to 11min by @tatiana in [CI] Reduce the amount taking to run tests in the CI from 5h to 11min #1297
• Enable secret detection precommit check by @pankajastro in Enable secrect detection precommit check #1302
• Fix security vulnerability, by not pinning Airflow 2.10.0 by @tatiana in Fix security vulnerability, by not pinning Airflow 2.10.0 #1298
• Fix Netlify build timeouts by @tatiana in Fix Netlify build timeouts #1294
• Add stalebot to label/close stale PRs and issues by @tatiana in Add stalebot to label/close stale PRs and issues #1288
• Unpin dbt-databricks version by @pankajastro in Unpin dbt-databricks version #1409
• Fix source resource type tests by @pankajastro in Fix source resource type tests #1405
• Increase performance tests models by @tatiana in Increase performance tests models #1403
• Drop running 1000 models in the CI by @pankajkoti in Drop running 1000 models in the CI #1411
• Fix releasing package to PyPI by @tatiana in Fix releasing package to PyPI #1396
• Pre-commit hook updates in ⬆ [pre-commit.ci] pre-commit autoupdate #1394, ⬆ [pre-commit.ci] pre-commit autoupdate #1373, ⬆ [pre-commit.ci] pre-commit autoupdate #1358, ⬆ [pre-commit.ci] pre-commit autoupdate #1340, ⬆ [pre-commit.ci] pre-commit autoupdate #1331, ⬆ [pre-commit.ci] pre-commit autoupdate #1314, ⬆ [pre-commit.ci] pre-commit autoupdate #1301

Co-authored-by: Pankaj Koti [email protected]
Co-authored-by: Pankaj Singh [email protected]

Closes: #1193

[cloudflare-workers-and-pages]

Deploying astronomer-cosmos with    Cloudflare Pages

Latest commit:	2e9b8a5
Status:	✅  Deploy successful!
Preview URL:	https://16a812be.astronomer-cosmos.pages.dev
Branch Preview URL:	https://release-1-8-0.astronomer-cosmos.pages.dev

View logs

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.52%. Comparing base (103c2ae) to head (2e9b8a5).
Report is 1 commits behind head on main.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1395   +/-   ##
=======================================
  Coverage   96.52%   96.52%           
=======================================
  Files          73       73           
  Lines        4320     4320           
=======================================
  Hits         4170     4170           
  Misses        150      150           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.