Merge branch 'current' into feat_defer_clone

.github/labeler.yml

@@ -3,6 +3,7 @@ developer blog:
 
 guides:
 - website/docs/guides/**/*
+- website/docs/quickstarts/**/*
 
 content:
 - website/docs/**/*

website/dbt-versions.js

@@ -174,6 +174,10 @@ exports.versionedPages = [
   {
     "page": "reference/resource-configs/grants",
     "firstVersion": "1.2",
+  },
+  {
+    "page": "docs/build/saved-queries",
+    "firstVersion": "1.7",
   }
 ]
 

website/docs/community/resources/viewpoint.md

@@ -7,7 +7,7 @@ id: "viewpoint"
 
 In 2015-2016, a team of folks at RJMetrics had the opportunity to observe, and participate in, a significant evolution of the analytics ecosystem. The seeds of dbt were conceived in this environment, and the viewpoint below was written to reflect what we had learned and how we believed the world should be different. **dbt is our attempt to address the workflow challenges we observed, and as such, this viewpoint is the most foundational statement of the dbt project's goals.**
 
-The remainder of this document is largely unedited from [the original post](https://blog.getdbt.com/building-a-mature-analytics-workflow/).
+The remainder of this document is largely unedited from [the original post](https://getdbt.com/blog/building-a-mature-analytics-workflow).
 
 :::
 

website/docs/docs/about-setup.md

@@ -3,11 +3,13 @@ title: About dbt setup
 id: about-setup
 description: "About setup of dbt Core and Cloud"
 sidebar_label: "About dbt setup"
+pagination_next: "docs/environments-in-dbt"
+pagination_prev: null
 ---
 
 dbt compiles and runs your analytics code against your data platform, enabling you and your team to collaborate on a single source of truth for metrics, insights, and business definitions. There are two options for deploying dbt:
 
-**dbt Cloud** runs dbt Core in a hosted (single or multi-tenant) environment with a browser-based interface. The intuitive UI will aid you in setting up the various components. dbt Cloud comes equipped with turnkey support for scheduling jobs, CI/CD, hosting documentation, monitoring & alerting, and an integrated developer environment (IDE).
+**dbt Cloud** runs dbt Core in a hosted (single or multi-tenant) environment with a browser-based interface. The intuitive user interface aids you in setting up the various components. dbt Cloud comes equipped with turnkey support for scheduling jobs, CI/CD, hosting documentation, monitoring, and alerting. It also offers an integrated development environment (IDE) and allows you to develop and run dbt commands from your local command line (CLI) or code editor.
 
 **dbt Core** is an open-source command line tool that can be installed locally in your environment, and communication with databases is facilitated through adapters.
 
@@ -19,7 +21,7 @@ To begin configuring dbt now, select the option that is right for you.
 
 <Card
     title="dbt Cloud setup"
-    body="Learn how to connect to a data platform, integrate with secure authentication methods, configure a sync with a git repo, and how to use the IDE."
+    body="Learn how to connect to a data platform, integrate with secure authentication methods, configure a sync with a git repo, how to use the IDE, and how to install the dbt Cloud CLI."
     link="/docs/cloud/about-cloud-setup"
     icon="dbt-bit"/>
 

website/docs/docs/build/about-metricflow.md

@@ -4,38 +4,38 @@ id: about-metricflow
 description: "Learn more about MetricFlow and its key concepts"
 sidebar_label: About MetricFlow
 tags: [Metrics, Semantic Layer]
+pagination_next: "docs/build/join-logic"
+pagination_prev: null
 ---
 
-This guide introduces MetricFlow's fundamental ideas for new users. MetricFlow, which powers the dbt Semantic Layer, helps you define and manage the logic for your company's metrics. It's an opinionated set of abstractions and helps data consumers retrieve metric datasets from a data platform quickly and efficiently.
+This guide introduces MetricFlow's fundamental ideas for people new to this feature. MetricFlow, which powers the dbt Semantic Layer, helps you define and manage the logic for your company's metrics. It's an opinionated set of abstractions and helps data consumers retrieve metric datasets from a data platform quickly and efficiently. 
 
-:::info
+MetricFlow handles SQL query construction and defines the specification for dbt semantic models and metrics. It allows you to define metrics in your dbt project and query them with [MetricFlow commands](/docs/build/metricflow-commands) whether in dbt Cloud or dbt Core.
 
-MetricFlow is a new way to define metrics and one of the key components of the [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl). It handles SQL query construction and defines the specification for dbt semantic models and metrics. 
+Before you start, consider the following guidelines:
 
-MetricFlow is currently available on dbt v1.6 or higher for all users. dbt Core users can use the MetricFlow CLI to define metrics in their local dbt Core project. However, to experience the power of the universal [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl) and query those metrics in downstream tools, you'll need a dbt Cloud [Team or Enterprise](https://www.getdbt.com/pricing/) account. 
-
-:::
-
-There are a few key principles:
-
-- **Flexible, but complete** —  Ability to create any metric on any data model by defining logic in flexible abstractions.
-- **Don't Repeat Yourself (DRY)** — Avoid repetition by allowing metric definitions to be enabled whenever possible.
-- **Simple with progressive complexity** — Make MetricFlow approachable by relying on known concepts and structures in data modeling. 
-- **Performant and efficient** — Allow for performance optimizations in centralized data engineering while still enabling distributed definition and ownership of logic.
+- Define metrics in YAML and query them using these [new metric specifications](https://github.com/dbt-labs/dbt-core/discussions/7456).
+- You must be on [dbt version](/docs/dbt-versions/upgrade-core-in-cloud) 1.6 or higher to use MetricFlow. 
+- Use MetricFlow with Snowflake, BigQuery, Databricks, Postgres (dbt Core only), or Redshift. 
+- Discover insights and query your metrics using the [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl) and its diverse range of [available integrations](/docs/use-dbt-semantic-layer/avail-sl-integrations).  You must have a dbt Cloud account on the [Team or Enterprise plan](https://www.getdbt.com/pricing/). 
 
 ## MetricFlow
 
-- MetricFlow is a SQL query generation engine that helps you create metrics by constructing appropriate queries for different granularities and dimensions that are useful for various business applications. 
+MetricFlow is a SQL query generation tool designed to streamline metric creation across different data dimensions for diverse business needs. 
+- It operates through YAML files, where a semantic graph links language to data. This graph comprises [semantic models](/docs/build/semantic-models) (data entry points) and [metrics](/docs/build/metrics-overview) (functions for creating quantitative indicators).
+- MetricFlow is a [BSL package](https://github.com/dbt-labs/metricflow) with code source available, and compatible with dbt version 1.6 and higher. Data practitioners and enthusiasts are highly encouraged to contribute.
+- As a part of the dbt Semantic Layer, MetricFlow empowers organizations to define metrics using YAML abstractions.
+- To query metric dimensions, dimension values, and validate configurations, use [MetricFlow commands](/docs/build/metricflow-commands).
 
-- It uses YAML files to define a semantic graph, which maps language to data. This graph consists of [semantic models](/docs/build/semantic-models), which serve as data entry points, and [metrics](/docs/build/metrics-overview), which are functions used to create new quantitative indicators.
 
-- MetricFlow is a [BSL package](https://github.com/dbt-labs/metricflow) (code is source available) and available on dbt versions 1.6 and higher. Data practitioners and enthusiasts are highly encouraged to contribute. 
+**Note** — MetricFlow doesn't support dbt [builtin functions or packages](/reference/dbt-jinja-functions/builtins) at this time, however, support is planned for the future.
 
-- MetricFlow, as a part of the dbt Semantic Layer, allows organizations to define company metrics logic through YAML abstractions, as described in the following sections.
+MetricFlow abides by these principles:
 
-- You can install MetricFlow using PyPI as an extension of your [dbt adapter](/docs/supported-data-platforms) in the CLI. To install the adapter, run `pip install "dbt-metricflow[your_adapter_name]"` and add the adapter name at the end of the command. For example, for a Snowflake adapter run `pip install "dbt-metricflow[snowflake]"`.
-
-- To query metrics dimensions, dimension values, and validate your configurations; install the [MetricFlow CLI](/docs/build/metricflow-cli).
+- **Flexibility with completeness**: Define metric logic using flexible abstractions on any data model.
+- **DRY (Don't Repeat Yourself)**: Minimize redundancy by enabling metric definitions whenever possible.
+- **Simplicity with gradual complexity:** Approach MetricFlow using familiar data modeling concepts.
+- **Performance and efficiency**: Optimize performance while supporting centralized data engineering and distributed logic ownership.
 
 ### Semantic graph 
 
@@ -55,6 +55,8 @@ For a semantic model, there are three main pieces of metadata:
 * [Dimensions](/docs/build/dimensions) — These are the ways you want to group or slice/dice your metrics.
 * [Measures](/docs/build/measures) — The aggregation functions that give you a numeric result and can be used to create your metrics.
 
+<Lightbox src="/img/docs/dbt-cloud/semantic-layer/semantic_foundation.jpg" width="70%" title="A semantic model is made up of different components: Entities, Measures, and Dimensions."/>
+
 ### Metrics 
 
 Metrics, which is a key concept, are functions that combine measures, constraints, or other mathematical functions to define new quantitative indicators. MetricFlow uses measures and various aggregation types, such as average, sum, and count distinct, to create metrics.  Dimensions add context to metrics and without them, a metric is simply a number for all time. You can define metrics in the same YAML files as your semantic models, or create a new file.
@@ -112,8 +114,6 @@ group by 1, 2
 </TabItem>
 <TabItem value="metricflow" label="Calculate with MetricFlow">
 
-> Introducing MetricFlow, a key component of the dbt Semantic Layer 🤩 - simplifying data collaboration and governance.
-
 In the following three example tabs, use MetricFlow to define a semantic model that uses order_total as a metric and a sample schema to create consistent and accurate results &mdash; eliminating confusion, code duplication, and streamlining your workflow.
 
 <Tabs>

website/docs/docs/build/analyses.md

@@ -2,6 +2,7 @@
 title: "Analyses"
 description: "Read this tutorial to learn how to use custom analyses when building in dbt."
 id: "analyses"
+pagination_next: null
 ---
 
 ## Overview

website/docs/docs/build/build-metrics-intro.md

@@ -5,27 +5,28 @@ description: "Learn about MetricFlow and build your metrics with semantic models
 sidebar_label: Build your metrics
 tags: [Metrics, Semantic Layer, Governance]
 hide_table_of_contents: true
+pagination_next: "docs/build/sl-getting-started"
+pagination_prev: null
 ---
 
-Use MetricFlow in dbt to centrally define your metrics. As a key component of the [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl), MetricFlow is responsible for SQL query construction and defining specifications for dbt semantic models and metrics.
+Use MetricFlow in dbt to centrally define your metrics. As a key component of the [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl), MetricFlow is responsible for SQL query construction and defining specifications for dbt semantic models and metrics. It uses familiar constructs like semantic models and metrics to avoid duplicative coding, optimize your development workflow, ensure data governance for company metrics, and guarantee consistency for data consumers.
 
-Use familiar constructs like semantic models and metrics to avoid duplicative coding, optimize your development workflow, ensure data governance for company metrics, and guarantee consistency for data consumers.
 
-:::info
-MetricFlow is currently available on dbt v1.6 or higher and allows users to define metrics in their dbt project whether in dbt Cloud or dbt Core. dbt Core users can use the MetricFlow CLI to define metrics in their local dbt Core project. However, to experience the power of the universal [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl) and query those metrics in downstream tools, you'll need a dbt Cloud [Team or Enterprise](https://www.getdbt.com/pricing/) account. 
-
-:::
-
-Before you start, consider the following guidelines:
-
-- Define metrics in YAML and query them using these [new metric specifications](https://github.com/dbt-labs/dbt-core/discussions/7456).
-- You must be on dbt v1.6 or higher to use MetricFlow. [Upgrade your dbt version](/docs/dbt-versions/upgrade-core-in-cloud) to get started.
-- Use MetricFlow with Snowflake, BigQuery, Databricks, Postgres (CLI only), or Redshift. (dbt Cloud Postgres support coming soon)
-- Unlock insights and query your metrics using the [dbt Semantic Layer](/docs/use-dbt-semantic-layer/dbt-sl) and its diverse range of [available integrations](/docs/use-dbt-semantic-layer/avail-sl-integrations).
+MetricFlow allows you to:
+- Intuitively define metrics in your dbt project
+- Develop from your preferred environment, whether that's the [dbt Cloud CLI](/docs/cloud/cloud-cli-installation), [dbt Cloud IDE](/docs/cloud/dbt-cloud-ide/develop-in-the-cloud), or [dbt Core](/docs/core/installation)
+- Use [MetricFlow commands](/docs/build/metricflow-commands) to query and test those metrics in your development environment 
+- Harness the true magic of the universal dbt Semantic Layer and dynamically query these metrics in downstream tools (Available for dbt Cloud [Team or Enterprise](https://www.getdbt.com/pricing/) accounts only).
 
 
 <div className="grid--3-col">
 
+ <Card
+    title="Get started with the dbt Semantic Layer"
+    body="Use this guide to build and define metrics with MetricFlow, set up the dbt Semantic Layer, and query them using downstream tools."
+    link="/docs/build/sl-getting-started"
+    icon="dbt-bit"/>
+
 <Card
     title="About MetricFlow"
     body="Understand MetricFlow's core concepts, key principles, and how to use this powerful tool."
@@ -50,12 +51,6 @@ Before you start, consider the following guidelines:
     link="/docs/use-dbt-semantic-layer/dbt-sl"
     icon="dbt-bit"/>
 
- <Card
-    title="Get started with the dbt Semantic Layer"
-    body="Use this guide to build and define metrics, set up the dbt Semantic Layer, and query them using the Semantic Layer API"
-    link="/docs/use-dbt-semantic-layer/quickstart-sl"
-    icon="dbt-bit"/>
-
   <Card
     title="Available integrations"
     body="Discover the diverse range of partners that seamlessly integrate with the powerful dbt Semantic Layer, allowing you to query and unlock valuable insights from your data ecosystem."

website/docs/docs/build/custom-schemas.md

@@ -1,6 +1,7 @@
 ---
 title: "Custom schemas"
 id: "custom-schemas"
+pagination_next: "docs/build/custom-databases"
 ---
 
 By default, all dbt models are built in the schema specified in your target. In dbt projects with lots of models, it may be useful to instead build some models in schemas other than your target schema – this can help logically group models together.

website/docs/docs/build/custom-target-names.md

@@ -2,7 +2,7 @@
 title: "Custom target names"
 id: "custom-target-names"
 description: "You can define a custom target name for any dbt Cloud job to correspond to settings in your dbt project."
-
+pagination_next: null
 ---
 
 ## dbt Cloud Scheduler

website/docs/docs/build/derived-metrics.md

@@ -124,7 +124,7 @@ You can query any granularity and offset window combination. The following examp
         alias: bookings_7_days_ago
 ```
 
-When you run the query  `mf query --metrics d7_booking_change --group-by metric_time__month` for the metric, here's how it's calculated:
+When you run the query  `dbt sl query --metrics d7_booking_change --group-by metric_time__month` for the metric, here's how it's calculated. For dbt Core, you can use the `mf query` prefix. 
 
 1. We retrieve the raw, unaggregated dataset with the specified measures and dimensions at the smallest level of detail, which is currently 'day'.
 2. Then, we perform an offset join on the daily dataset, followed by performing a date trunc and aggregation to the requested granularity.

website/docs/docs/build/dimensions.md

@@ -81,8 +81,10 @@ semantic_model:
 
 Dimensions have 2 types. This section further explains the definitions and provides examples.
 
-1. [Categorical](#categorical)
-1. [Time](#time)
+- [Dimensions types](#dimensions-types)
+  - [Categorical](#categorical)
+  - [Time](#time)
+  - [SCD Type II](#scd-type-ii)
 
 ### Categorical
 
@@ -108,9 +110,14 @@ You can use multiple time groups in separate metrics. For example, the `users_cr
 
 
 ```bash
-mf query --metrics users_created,users_deleted --dimensions metric_time --order metric_time 
+# dbt Cloud users
+dbt sl query --metrics users_created,users_deleted --dimensions metric_time --order metric_time  
+
+# dbt Core users
+mf query --metrics users_created,users_deleted --dimensions metric_time --order metric_time  
 ```
 
+
 You can set `is_partition` for time or categorical dimensions to define specific time spans. Additionally, use the `type_params` section to set `time_granularity` to adjust aggregation detail (like daily, weekly, and so on):
 
 <Tabs>
@@ -121,9 +128,13 @@ Use `is_partition: True` to show that a dimension exists over a specific time wi
 
 You can also use `is_partition` for [categorical](#categorical) dimensions as well.
 
-MetricFlow enables metric aggregation during query time. For example, you can aggregate the `messages_per_month` measure. If you originally had a `time_granularity` for the time dimensions `metric_time`, you can specify a yearly granularity for aggregation in your CLI query:
+MetricFlow enables metric aggregation during query time. For example, you can aggregate the `messages_per_month` measure. If you originally had a `time_granularity` for the time dimensions `metric_time`, you can specify a yearly granularity for aggregation in your query:
 
 ```bash
+# dbt Cloud users
+dbt sl query --metrics messages_per_month --dimensions metric_time --order metric_time --time-granularity year  
+
+# dbt Core users
 mf query --metrics messages_per_month --dimensions metric_time --order metric_time --time-granularity year  
 ```
 
@@ -344,7 +355,11 @@ In the sales tier example, if sales_person_id 456 is Tier 2 from 2022-03-08 onwa
 
 The following command or code represents how to return the count of transactions generated by each sales tier per month:
 
-```
+```bash
+# dbt Cloud users
+dbt sl query --metrics transactions --dimensions metric_time__month,sales_person__tier --order metric_time__month --order sales_person__tier
+
+# dbt Core users
 mf query --metrics transactions --dimensions metric_time__month,sales_person__tier --order metric_time__month --order sales_person__tier
 
 ```

website/docs/docs/build/enhance-your-code.md

@@ -0,0 +1,38 @@
+---
+title: "Enhance your code"
+description: "Learn how you can enhance your code"
+pagination_next: "docs/build/project-variables"
+pagination_prev: null
+---
+
+<div className="grid--2-col">
+
+<Card
+    title="Project variables"
+    body="Learn how to use project variables to provide data to models for compilation."
+    link="/docs/build/project-variables"
+    icon="dbt-bit"/>
+
+<Card
+    title="Environment variables"
+    body="Learn how you can use environment variables to customize the behavior of a dbt project."
+    link="/docs/build/environment-variables"
+    icon="dbt-bit"/>
+
+</div>
+<br />
+<div className="grid--2-col">
+
+<Card
+    title="Packages"
+    body="Learn how you can leverage code reuse through packages (libraries)."
+    link="/docs/build/packages"
+    icon="dbt-bit"/>
+
+<Card
+    title="Hooks and operations"
+    body="Learn how to use hooks to trigger actions and operations to invoke macros."
+    link="/docs/build/hooks-operations"
+    icon="dbt-bit"/>
+
+</div>