Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update the 1.7 migration guide #4123

Closed
1 task done
graciegoheen opened this issue Sep 25, 2023 · 7 comments · Fixed by #4233
Closed
1 task done

Update the 1.7 migration guide #4123

graciegoheen opened this issue Sep 25, 2023 · 7 comments · Fixed by #4233
Assignees
Labels
content Improvements or additions to content dbt Core The changes proposed in this issue relate to dbt Core improvement Use this when an area of the docs needs improvement as it's currently unclear

Comments

@graciegoheen
Copy link
Collaborator

Contributions

  • I have read the contribution docs, and understand what's expected of me.

Link to the page on docs.getdbt.com requiring updates

https://docs.getdbt.com/guides/migration/versions/upgrading-to-v1.7

What part(s) of the page would you like to see updated?

We need to update this for what's going to be released in 1.7

Additional information

@graciegoheen -> to add what content needs to go onto this page

@graciegoheen graciegoheen added content Improvements or additions to content improvement Use this when an area of the docs needs improvement as it's currently unclear labels Sep 25, 2023
@dataders
Copy link
Contributor

dataders commented Oct 5, 2023

Hi Grace, when you do this, do you mind linking to dbt-labs/dbt-core#8307? as we have done in previous upgrade guides? Something like the below?

For maintainers of adapter plugins

For more detailed information and to ask questions, please read and comment on the GH discussion: dbt-labs/dbt-core#8307.

@graciegoheen
Copy link
Collaborator Author

graciegoheen commented Oct 6, 2023

For consumers of dbt artifacts (metadata)

The manifest schema version has been updated to v11. Specific changes:

  • ???

@dbeatty10 do you know what the manifest schema changes were? The PR that bumped the version didn't seem to make any other changes.

The run_results schema version has been updated to v5. Specific changes:

  • Add node attributes related to compilation (compiled, compiled_code, relation_name)

The nodes dictionary in the catalog.json can now be "partial" if dbt docs generate is run with a selector.

@graciegoheen
Copy link
Collaborator Author

graciegoheen commented Oct 6, 2023

New and changed documentation

dbt docs generate now supports --select to generate documentation for a subset of your project

  • currently snowflake and postgres only, but other adapters on their way

source freshness can now be generated from warehouse metadata tables

  • currently snowflake only, but other adapters that have metadata tables on their way
  • if you configure source freshness without a loaded_at_field, dbt will try to determine freshness from warehouse metadata tables
  • expands the amount of sources folks can configure freshness for; previously, limited to sources that had a loaded_at_field

MetricFlow enhancements

  • automatically create metrics on measures, create_metric: true
  • optional label in semantic_models, measures, dimensions and
    entities
  • new configurations for semantic models - enable/disable, group, meta
  • support fill_nulls_with and join_to_timespine for metric nodes
  • saved_queries extend governance beyond the semantic objects to their consumption

Quick hits

  • configure a delimiter for a seed file
  • allow setting access as a config
  • support packages with same git repo and unique subdirectory
  • move date_spine macro from dbt-utils to dbt-core

@graciegoheen
Copy link
Collaborator Author

graciegoheen commented Oct 6, 2023

Outstanding:

  • What are the known "Behavior changes"?
  • Anything else to highlight for "Multi-project collaboration" initiative? @jtcohen6
  • What are manifest changes to highlight?

@matthewshaver matthewshaver linked a pull request Oct 9, 2023 that will close this issue
2 tasks
@graciegoheen
Copy link
Collaborator Author

Behavior change:

Full information here -> dbt-labs/dbt-core#8704 (comment)

Previously -> "the loaded_at_field is required to calculate freshness for a table. If a loaded_at_field is not provided, then dbt will not calculate freshness for the table."

In 1.7 -> when you add a freshness: config to a source (and no loaded_at_field is provided), we will calculate freshness for that source via warehouse metadata tables when the warehouse supports it

@dataders
Copy link
Contributor

dataders commented Oct 11, 2023

@graciegoheen here's a 1.7 adapter upgrade guide snippet about dbt show. My brain feels as though it's something worth calling out in the end user 1.7 guide, but perhaps not because this change just happened for all users of 1.5 and 1.6 as well? Do we this new behavior called out? Ok for the answer to be no, provided that we only ever rever to the new behavior. That said, I don't see any reference in the doc for dbt show that mentions this new behavior

@runleonarun runleonarun added the dbt Core The changes proposed in this issue relate to dbt Core label Oct 11, 2023
@dbeatty10
Copy link
Contributor

That said, I don't see any reference in the doc for dbt show that mentions this new behavior

@dataders I just opened an issue for this here: #4256

I don't know the way you want to update the docs for show, so I'm relying on you to update this docs issue as-needed.

matthewshaver added a commit that referenced this issue Oct 11, 2023
## What are you changing in this pull request and why?

addresses issue #4123

## Checklist

- [x] Review the [Content style
guide](https://github.com/dbt-labs/docs.getdbt.com/blob/current/contributing/content-style-guide.md)
and [About
versioning](https://github.com/dbt-labs/docs.getdbt.com/blob/current/contributing/single-sourcing-content.md#adding-a-new-version)
so my content adheres to these guidelines.
- [x] Add a checklist item for anything that needs to happen before this
PR is merged, such as "needs technical review" or "change base branch."
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
content Improvements or additions to content dbt Core The changes proposed in this issue relate to dbt Core improvement Use this when an area of the docs needs improvement as it's currently unclear
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants