dbt-core v1.7.0b2

dbt-core 1.7.0-b2 - September 01, 2023

Features

• Add node attributes related to compilation to run_results.json (#7519)
• Support configuration of semantic models with the addition of enable/disable and group enablement. (#7968)

Fixes

• Add support for swapping materialized views with tables/views and vice versa (#8449)
• Turn breaking changes to contracted models into warnings for unversioned models (#8384, #8282)
• Ensure parsing does not break when window_groupings is not specified for non_additive_dimension (#8453)
• fix ambiguous reference error for tests and versions when model name is duplicated across packages (#8327, #8493)
• Fix "Internal Error: Expected node not found in manifest" when depends_on set on ModelNodeArgs (#8506)
• Fix snapshot success message (#7583)

Docs

• Fix newline escapes and improve formatting in docker README (dbt-docs/#8211)

Under the Hood

• Switch from hologram to mashumaro jsonschema (#8426)
• Re-organize jinja macros: relation-specific in /macros/adapters/relations/, relation agnostic in /macros/relations (#8449)
• Update typing to meet mypy standards (#8396)
• Mypy errors - adapters/factory.py (#8387)

Contributors

• @jamezrin (#8211)

dbt-core v1.6.1

dbt-core 1.6.1 - August 23, 2023

Fixes

• Add status to Parse Inline Error (#8173)
• Fix retry not working with log-file-max-bytes (#8297)
• Detect changes to model access, version, or latest_version in state:modified (#8189)
• fix fqn-selection for external versioned models (#8374)
• Fix: DbtInternalError after model that previously ref'd external model is deleted (#8375)
• Fix using list command with path selector and project-dir (#8385)
• Remedy performance regression by only writing run_results.json once. (#8360)
• Ensure parsing does not break when window_groupings is not specified for non_additive_dimension (#8453)

Docs

• Display contract and column constraints on the model page (dbt-docs/#433)
• Display semantic model details in docs (dbt-docs/#431)

Under the Hood

• Refactor flaky test pp_versioned_models (#7781)
• format exception from dbtPlugin.initialize (#8152)
• Update manifest v10 (#8333)
• add tracking for plugin.get_nodes calls (#8344)
• add internal flag: --no-partial-parse-file-diff to inform whether to compute a file diff during partial parsing (#8363)
• Use python version 3.10.7 in Docker image. (#8444)
• Check for existing_relation immediately prior to renaming (#7781)

dbt-core v1.5.6

dbt-core 1.5.6 - August 21, 2023

Under the Hood

• Use python version 3.10.7 in Docker image. (#8444)

dbt-core v1.6.1rc1

dbt-core 1.6.1-rc1 - August 18, 2023

Fixes

• Add status to Parse Inline Error (#8173)
• Fix retry not working with log-file-max-bytes (#8297)
• Detect changes to model access, version, or latest_version in state:modified (#8189)
• fix fqn-selection for external versioned models (#8374)
• Fix: DbtInternalError after model that previously ref'd external model is deleted (#8375)
• Fix using list command with path selector and project-dir (#8385)
• Remedy performance regression by only writing run_results.json once. (#8360)

Docs

• Display contract and column constraints on the model page (dbt-docs/#433)
• Display semantic model details in docs (dbt-docs/#431)

Under the Hood

• Refactor flaky test pp_versioned_models (#7781)
• format exception from dbtPlugin.initialize (#8152)
• Update manifest v10 (#8333)
• add tracking for plugin.get_nodes calls (#8344)
• add internal flag: --no-partial-parse-file-diff to inform whether to compute a file diff during partial parsing (#8363)
• Use python version 3.10.7 in Docker image. (#8444)

dbt-core v1.7.0b1

dbt-core 1.7.0-b1 - August 17, 2023

Breaking Changes

• Removed the FirstRunResultError and AfterFirstRunResultError event types, using the existing RunResultError in their place. (#7963)

Features

• Enable re-population of metadata vars post-environment change during programmatic invocation (#8010)
• Added support to configure a delimiter for a seed file, defaults to comma (#3990)
• Allow specification of create_metric: true on measures (#8125)

Fixes

• Copy dir during dbt deps if symlink fails (#7428, #8223)
• Fixed double-underline (#5301)
• Copy target_schema from config into snapshot node (#6745)
• Enable converting deprecation warnings to errors (#8130)
• Add status to Parse Inline Error (#8173)
• Ensure warn_error_options get serialized in invocation_args_dict (#7694)
• Stop detecting materialization macros based on macro name (#6231)
• Update dbt deps download retry logic to handle EOFError exceptions (#6653)
• Improve handling of CTE injection with ephemeral models (#8213)
• Fix unbound local variable error in checked_agg_time_dimension_for_measure (#8230)
• Ensure runtime errors are raised for graph runnable tasks (compile, show, run, etc) (#8166)
• Fix retry not working with log-file-max-bytes (#8297)
• Detect changes to model access, version, or latest_version in state:modified (#8189)
• Add connection status into list of statuses for dbt debug (#8350)
• fix fqn-selection for external versioned models (#8374)
• Fix: DbtInternalError after model that previously ref'd external model is deleted (#8375)
• Fix using list command with path selector and project-dir (#8385)
• Remedy performance regression by only writing run_results.json once. (#8360)

Docs

• Corrected spelling of "Partiton" (dbt-docs/#8100)
• Remove static SQL codeblock for metrics (dbt-docs/#436)
• fixed comment util.py (dbt-docs/#None)
• Display contract and column constraints on the model page (dbt-docs/#433)
• Display semantic model details in docs (dbt-docs/#431)

Under the Hood

• Refactor flaky test pp_versioned_models (#7781)
• format exception from dbtPlugin.initialize (#8152)
• A way to control maxBytes for a single dbt.log file (#8199)
• Ref expressions with version can now be processed by the latest version of the high-performance dbt-extractor library. (#7688)
• Bump manifest schema version to v11, freeze manifest v10 (#8333)
• add tracking for plugin.get_nodes calls (#8344)
• add internal flag: --no-partial-parse-file-diff to inform whether to compute a file diff during partial parsing (#8363)
• Add return values to a number of functions for mypy (#8389)
• Fix mypy warnings for ManifestLoader.load() (#8401)
• Use python version 3.10.7 in Docker image. (#8444)

Dependencies

• Bump mypy from 1.3.0 to 1.4.0 (#7912)
• Bump mypy from 1.4.0 to 1.4.1 (#8219)
• Update pin for click<9 (#8232)
• Add upper bound to sqlparse pin of <0.5 (#8236)
• Support dbt-semantic-interfaces 0.2.0 (#8250)

Contributors

• @anjutiwari (#7428, #8223)
• @d-kaneshiro (#None)
• @gem7318 (#8010)
• @lllong33 (#5301)
• @marcodamore (#436)
• @pgoslatara (#8100)
• @ramonvermeulen (#3990)

dbt-core v1.5.5

dbt-core 1.5.5 - August 17, 2023

Fixes

• Copy target_schema from config into snapshot node (#6745)
• Add status to Parse Inline Error (#8173)
• Fix using list command with path selector and project-dir (#8385)

Under the Hood

• A way to control maxBytes for a single dbt.log file (#8199)

Dependencies

• Update pin for click<9 (#8232)
• Add upper bound to sqlparse pin of <0.5 (#8236)

dbt-core v1.4.7

dbt-core 1.4.7 - August 04, 2023

Dependencies

• Pin click>=7.0,<8.1.4 (#8050)

dbt-core v1.3.5

dbt-core 1.3.5 - August 04, 2023

Fixes

• Fix producing non json log when log format is json (#7972)

Dependencies

• Pin click>=7.0,<8.1.4 (#8050)

dbt-core v1.6.0

dbt-core 1.6.0 - Quiara Alegría Hudes (July 31, 2023)

Breaking Changes

• Dropped support for Python 3.7 (#7082)
• Switch from dbt-metrics to dbt-semantic-interfaces for MetricNode definitions (#7500, #7404)

Features

• Add merge as valid incremental strategy for postgres (#1880)
• Skip catalog generation (#6980)
• Add support for materialized views (#6911)
• Publication artifacts and cross-project ref (#7227)
• Optimize template rendering for common parse scenarios (#7449)
• Add graph structure summaries to target path output (#7357)
• Allow duplicate manifest node (models, seeds, analyses, snapshots) names across packages (#7446)
• Detect breaking changes to enforced constraints (#7065)
• Check for project dependency cycles (#7468)
• nodes in packages respect custom generate_alias_name, generate_schema_name, generate_database_name macro overrides defined in packages (#7444)
• Added warnings for model and ref deprecations (#7433)
• Update drop_relation macro to allow for configuration of drop statement separately from object name (#7625)
• accept publications in dbt.invoke (#7372)
• Enable state for deferral to be separate from state for selectors (#7300)
• add access selection syntax (#7738)
• add project_name to manifest metadata (#7752)
• dbt retry (#7299)
• This change adds new selector methods to the state selector. Namely, state:unmodified and state:old. (#7564)
• Revamp debug, add --connection flag. Prepare for future refactors/interface changes. (#7104)
• Validate public models are not materialized as ephemeral (#7226)
• Added support for parsing and serializaing semantic models (#7499, #7503)
• Enable setting packages in dependencies.yml (#7372, #7736)
• Add AdapterRegistered event log message (#7038)
• dbt clone (#7258)
• Further integrate semantic models into the DAG and partial parsing module (#7800)
• Handle external model nodes in state:modified (#7563)
• Add invocation_command to flags (#6051)
• Add thread_id context var (#7941)
• Add partial parsing support for semantic models (#7897)
• Add restrict-access to dbt_project.yml (#7713)
• allow setting enabled and depends_on_nodes from ModelNodeArgs (#7506)
• Support '_'-delimited fqn matching for versioned models and matching on Path.stem for path selection (#7639)
• Store time_spline table configuration in semantic manifest (#7938)
• Add validate_sql method to BaseAdapter with implementation for SQLAdapter (#7839)
• Support validation of metrics and semantic models. (#7969)
• Begin populating depends_on of metric nodes (#7854)
• Enumerate supported materialized view features for dbt-postgres (#6911)

Fixes

• Raise better error message when dispatching a package that is not installed (#5801)
• add negative part_number arg for split part macro (#7915)
• Persist timing info in run results for failed nodes (#5476)
• fix typo in unpacking statically parsed ref (#7364)
• safe version attribute access in _check_resource_uniqueness (#7375)
• Fix dbt command missing target-path param ([# 7411](https://github.com/dbt-labs/dbt-core/issues/ 7411))
• Fix CTE insertion position when the model uses WITH RECURSIVE (#7350)
• Fix v0 ref resolution (#7408)
• Add --target-path to dbt snapshot command. (#7418)
• dbt build selection of tests' descendants (#7289)
• fix groupable node partial parsing, raise DbtReferenceError at runtime for safety (#7437)
• Fix partial parsing of latest_version changes for downstream references (#7369)
• Use "add_node" to update depends_on.nodes (#7453)
• Fix var precedence in configs: root vars override package vars (#6705)
• Constraint rendering fixes: wrap check expression in parentheses, foreign key 'references', support expression in all constraint types (#7417, #7480, #7416)
• Fix inverted --print/--no-print flag (#7517)
• Back-compat for previous return type of 'collect_freshness' macro (#7489)
• Fix warning messages for deprecated dbt_project.yml configs (#7424)
• Respect column 'quote' config in model contracts (#7370)
• print model version in dbt show if specified (#7407)
• enable dbt show for seeds (#7273)
• push down limit filtering to adapter (#7390)
• Allow missing profiles.yml for dbt deps and dbt init (#7511)
• run_results.json is now written after every node completes. (#7302)
• Do not rewrite manifest.json during 'docs serve' command (#7553)
• Pin protobuf to greater than 4.0.0 (#7565)
• inject sql header in query for show (#7413)
• Pin urllib3 to ~=1.0 (#7573)
• Throw error for duplicated versioned and unversioned models (#7487)
• Honor --skip-profile-setup parameter when inside an existing project (#7594)
• Fix: Relative project paths weren't working with deps (#7491)
• Exclude password fields from Jinja rendering. (#7629)
• Add --target-path to more CLI subcommands (#7646)
• Stringify flag paths for Jinja context (#7495)
• write run_results.json for run operation (#7502)
• Add % to adapter suite test cases for persist_docs (#7698)
• Unified to UTC (#7664)
• Improve warnings for constraints and materialization types (#7335)
• Incorrect paths used for "target" and "state" directories (#7465)
• fix StopIteration error when publication for project not found (#7711)
• Using version 0 works when resolving single model (#7372)
• Fix empty --warn-error-options error message (#7730)
• send sql header on contract enforcement (#7714)
• Fixed doc link in selector.py ([#7533](https://github.com/dbt-labs/dbt-core/i...

dbt-core v1.6.0rc2

dbt-core 1.6.0-rc2 - July 28, 2023

Fixes

• Copy target_schema from config into snapshot node (#6745)
• Enable converting deprecation warnings to errors (#8130)
• Ensure warn_error_options get serialized in invocation_args_dict (#7694)
• Stop detecting materialization macros based on macro name (#6231)
• Improve handling of CTE injection with ephemeral models (#8213)
• Fix unbound local variable error in checked_agg_time_dimension_for_measure (#8230)
• Ensure runtime errors are raised for graph runnable tasks (compile, show, run, etc) (#8166)

Docs

• Remove static SQL codeblock for metrics (dbt-docs/#436)

Under the Hood

• A way to control maxBytes for a single dbt.log file (#8199)

Dependencies

• Update pin for click<9 (#8232)
• Add upper bound to sqlparse pin of <0.5 (#8236)
• Support dbt-semantic-interfaces 0.2.0 (#8250)

Contributors

• @marcodamore (#436)