dbt-core v1.0.7

dbt-core 1.0.7 - May 20, 2022

Dependencies

• Lowering networkx dependency range due to new version's breaking change (#5254, #5280)

dbt-core v1.1.0

dbt Core 1.1.0 - Gloria Casarez (April 28, 2022)

📖 Docs: "Upgrading to v1.1"

Breaking Changes

There are no breaking changes to code in dbt projects or packages.

Relevant to consumers of dbt metadata:

• The manifest schema version has updated to v5. The only change is to the default value of config for parsed nodes (#5033, #5032)
• The structured logging interface has updated to v2. The node_info dictionary has moved underneath data, on events where it is available. Previously, it was a top-level key. (#4505)

Relevant to maintainers of adapter plugins:

• The abstractmethods get_response and execute now only return a connection.AdapterReponse in type hints. (Previously, they could return a string.) We encourage you to update your methods to return an object of class AdapterResponse, or implement a subclass specific to your adapter
  (#4499, #4869)
• Internal adapter methods set_relations_cache + _relations_cache_for_schemas each take an additional argument, for use with experimental CACHE_SELECTED_ONLY config (#4688, #4860)
• We have a new framework for testing dbt adapters. Docs: "Testing a new adapter"

Features

• Change behaviour of non_null test so that it only selects all columns if --store-failures is enabled. (#4769, #4777)
• Testing framework for dbt adapter testing (#4730, #4846)
• Allow unique key to take a list implementation for postgres/redshift (#4738, #4858)
• Add --cache_selected_only flag to cache schema object of selected models only. (#4688, #4860)
• Support custom names for generic tests (#3348, #4898)
• Added Support for Semantic Versioning (#4453, #4644)
• New Dockerfile to support specific db adapters and platforms. See docker/README.md for details (#4495, #4487)
• Allow unique_key to take a list (#2479, #4618)
• Add --quiet global flag and print Jinja function (#3451, #4701)
• Add space before justification periods (#4737, #4744)
• Enable dbt jobs to run downstream models based on fresher sources. Compare the source freshness results between previous and current state. If any source is fresher and/or new in current vs. previous state, dbt will run and test the downstream models in scope. Example command: dbt build --select source_status:fresher+ (#4050, #4256)
• converting unique key as list tests to new pytest format (#4882, #4958)
• Add a variable called selected_resources in the Jinja context containing a list of all the resources matching the nodes for the --select, --exclude and/or --selector parameters. (#3471, #5001)
• Support the DO_NOT_TRACK environment variable from the consoledonottrack.com initiative (#3540, #5000)
• Add --no-print global flag (#4710, #4854)
• add enabled as a source config (#3662, #5008)

Fixes

• Fix bug causing empty node level meta, snapshot config errors (#4459, #4726)
• Inconsistent timestamps between inserted/updated and deleted rows in snapshots (#4347, #4513)
• Catch all Requests Exceptions on deps install to attempt retries. Also log the exceptions hit. (#4849, #4865)
• Use cli_vars instead of context to create package and selector renderers (#4876, #4878)
• depend on new dbt-extractor version with fixed github links (#4891, #4890)
• Update bumpervsion config to stop looking for missing setup.py (#-1, #4896)
• Corrected permissions settings for docker release workflow (#4902, #4903)
• User wasn't asked for permission to overwite a profile entry when running init inside an existing project (#4375, #4447)
• Add project name validation to dbt init (#4490, #4536)
• Allow override of string and numeric types for adapters. (#4603, #4604)
• A change in secret environment variables won't trigger a full reparse (#4650, #4665)
• Fix misspellings and typos in docstrings (#4904, #4545)
• Catch more cases to retry package retrieval for deps pointing to the hub. Also start to cache the package requests. (#4849, #4982)
• Make the warning message for a full event deque more descriptive (#4962, #5011)
• Fix hard delete snapshot test (#4916, #5020)
• Restore ability to utilize updated_at for check_cols snapshots (#5076, #5077)
• Use yaml renderer (with target context) for rendering selectors (#5131, #5136)
• Fix retry logic to return values after initial try (#5023, #5137)
• Scrub secret env vars from CommandError in exception stacktrace (#5151, #5152)

Docs

• Resolve errors related to operations preventing DAG from generating in the docs. Also patch a spark issue to allow search to filter accurately past the missing columns. (#4578, #4763)
• Fixed capitalization in UI for exposures of type: ml (#4984, #4995)
• List packages and tags in alphabetical order (#4984, #4995)
• Bump jekyll from 3.8.7 to 3.9.0 (#4984, #4995)
• Updated docker README to reflect necessity of using BuildKit (#4990, #5018)

Under the Hood

• Automate changelog generation with changie (#4652, #4743)
• add performance regression testing runner without orchestration (#4021, #4602)
• Fix broken links for changelog generation and tweak GHA to only post a comment once when changelog entry is missing. (#4848, [#4857](https:/...

dbt-core v1.0.6

Fixes

• Use yaml renderer (with target context) for rendering selectors (#5131, #5136)
• Fix retry logic to return values after initial try (#5023, #5137)
• Scrub secret env vars from CommandError in exception stacktrace (#5151, #5152)

Under the Hood

• Move package deprecation check outside of package cache (#5068, #5069)

dbt-core v1.1.0rc3

dbt-core 1.1.0-rc3 - April 26, 2022

Fixes

• Use yaml renderer (with target context) for rendering selectors (#5131, #5136)
• Fix retry logic to return values after initial try (#5023, #5137)
• Scrub secret env vars from CommandError in exception stacktrace (#5151, #5152)

dbt-core v1.0.6rc1

dbt-core 1.0.6-rc1 - April 26, 2022

Fixes

• Use yaml renderer (with target context) for rendering selectors (#5131, #5136)
• Fix retry logic to return values after initial try (#5023, #5137)
• Scrub secret env vars from CommandError in exception stacktrace (#5151, #5152)

Under the Hood

• Move package deprecation check outside of package cache (#5068, #5069)

dbt-core v1.1.0rc2

dbt-core 1.1.0-rc2 - April 21, 2022

Fixes

• Restore ability to utilize updated_at for check_cols snapshots (#5076, #5077)

Contributors

• @dbeatty10 (#5077)

dbt-core v1.0.5

Fixes

• Fix bug causing empty node level meta, snapshot config errors (#4459, #4726)
• Support click versions in the v7.x series (#4566, #4681)
• Fixed a bug where nodes that depend on multiple macros couldn't be selected using -s state:modified (#4678, #4820)
• Catch all Requests Exceptions on deps install to attempt retries. Also log the exceptions hit. (#4849, #4865)
• Fix partial parsing bug with multiple snapshot blocks (#4771, #4773)
• Use cli_vars instead of context to create package and selector renderers (#4876, #4878)
• Catch more cases to retry package retrieval for deps pointing to the hub. Also start to cache the package requests. (#4849, #4982)
• Relax minimum supported version of MarkupSafe (#4745, #5039)

Under the Hood

• Automate changelog generation with changie (#4652, #4743)
• Fix broken links for changelog generation and tweak GHA to only post a comment once when changelog entry is missing (#4848, #4857)

Docs

• Resolve errors related to operations preventing DAG from generating in the docs. Also patch a spark issue to allow search to filter accurately past the missing columns. (#4578, #4763)
• backporting performance regression testing readme (#4904, #5042)

Contributors

• @adamantike (#5039)
• @twilly (#4681)

dbt-core v1.1.0rc1

dbt-core 1.1.0-rc1 - April 12, 2022

Breaking Changes

• For adapter plugin maintainers only: Internal adapter methods set_relations_cache + _relations_cache_for_schemas each take an additional argument, for use with experimental CACHE_SELECTED_ONLY config (#4688, #4860)

Features

• Add --cache_selected_only flag to cache schema object of selected models only. (#4688, #4860)
• Support custom names for generic tests (#3348, #4898)
• Enable dbt jobs to run downstream models based on fresher sources. Compare the source freshness results between previous and current state. If any source is fresher and/or new in current vs. previous state, dbt will run and test the downstream models in scope. Example command: dbt build --select source_status:fresher+ (#4050, #4256)
• converting unique key as list tests to new pytest format (#4882, #4958)
• Add a variable called selected_resources in the Jinja context containing a list of all the resources matching the nodes for the --select, --exclude and/or --selector parameters. (#3471, #5001)
• Support the DO_NOT_TRACK environment variable from the consoledonottrack.com initiative (#3540, #5000)
• Add --no-print global flag (#4710, #4854)
• add enabled as a source config (#3662, #5008)

Fixes

• Inconsistent timestamps between inserted/updated and deleted rows in snapshots (#4347, #4513)
• Catch more cases to retry package retrieval for deps pointing to the hub. Also start to cache the package requests. (#4849, #4982)
• Make the warning message for a full event deque more descriptive (#4962, #5011)
• Fix hard delete snapshot test (#4916, #5020)

Docs

• Fixed capitalization in UI for exposures of type: ml (#4984, #4995)
• List packages and tags in alphabetical order (#4984, #4995)
• Bump jekyll from 3.8.7 to 3.9.0 (#4984, #4995)
• Updated docker README to reflect necessity of using BuildKit (#4990, #5018)

Under the Hood

• add performance regression testing runner without orchestration (#4021, #4602)
• Add Graph Compilation and Adapter Cache tracking (#4625, #4912)
• Create a dbt.tests.adapter release when releasing dbt and postgres (#4812, #4948)
• update docker image to use python 3.10.3 (#4904, #4963)
• updates black to 22.3.0 which fixes dependency incompatibility when running with precommit. (#4904, #4972)
• Adds config util for ad-hoc creation of project objs or dicts (#4808, #4981)
• Remove TableComparison and convert existing calls to use dbt.tests.util (#4778, #4986)
• Remove unneeded create_schema in snapshot materialization (#4742, #4993)
• Added .git-blame-ignore-revs file to mask re-formmating commits from git blame (#5004, #5019)
• Convert version tests to pytest (#5024, #5026)
• Updating tests and docs to show that we now support Python 3.10 (#4974, #5025)
• Update --version output and logic (#4724, #5029)
• (#5033, #5032)

Contributors

• @agoblet (#5000)
• @anaisvaillant (#4256)
• @b-per (#5001)
• @jonstacks (#4995)
• @kadero (#4513)
• @karunpoudel (#4860, #4860)
• @matt-winkler (#4256)
• @pgoslatara (#4995)
• @poloaraujo (#4854)
• @sungchun12 (#4256)

dbt-core v1.0.5rc3

Release notes

dbt-core v1.0.5rc2

dbt-core 1.0.5-rc2 - April 08, 2022

Fixes

• Catch more cases to retry package retrieval for deps pointing to the hub. Also start to cache the package requests. (#4849, #4982)