Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add event _time to sources/snapshots/models/seeds #6384

Merged
merged 17 commits into from
Nov 19, 2024
Merged

add event _time to sources/snapshots/models/seeds #6384

Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
6ebf5eb
update source/snapshots
mirnawong1 Oct 30, 2024
501d948
add to model
mirnawong1 Oct 30, 2024
451fc46
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Oct 30, 2024
0c68f62
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Oct 30, 2024
12cdffa
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 4, 2024
9c49664
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 4, 2024
5ba059e
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 4, 2024
cc34575
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 5, 2024
bdc037e
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 6, 2024
aad3987
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 6, 2024
e92c9db
Update website/docs/reference/source-configs.md
mirnawong1 Nov 6, 2024
3ad1bb6
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 11, 2024
d6a309b
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 14, 2024
5851c2b
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 14, 2024
8cf073b
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 18, 2024
d2bf5af
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 18, 2024
4b28bbc
Merge branch 'add-event-time' into update-sources-snapshots
mirnawong1 Nov 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
78 changes: 76 additions & 2 deletions website/docs/reference/model-configs.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -104,6 +104,8 @@ models:

<File name='dbt_project.yml'>

<VersionBlock lastVersion="1.8">

```yaml
models:
[<resource-path>](/reference/resource-configs/resource-path):
Expand All @@ -121,7 +123,29 @@ models:
[+](/reference/resource-configs/plus-prefix)[contract](/reference/resource-configs/contract): {<dictionary>}

```
</VersionBlock>

<VersionBlock firstVersion="1.9">

```yaml
models:
[<resource-path>](/reference/resource-configs/resource-path):
[+](/reference/resource-configs/plus-prefix)[enabled](/reference/resource-configs/enabled): true | false
[+](/reference/resource-configs/plus-prefix)[tags](/reference/resource-configs/tags): <string> | [<string>]
[+](/reference/resource-configs/plus-prefix)[pre-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[+](/reference/resource-configs/plus-prefix)[post-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[+](/reference/resource-configs/plus-prefix)[database](/reference/resource-configs/database): <string>
[+](/reference/resource-configs/plus-prefix)[schema](/reference/resource-properties/schema): <string>
[+](/reference/resource-configs/plus-prefix)[alias](/reference/resource-configs/alias): <string>
[+](/reference/resource-configs/plus-prefix)[persist_docs](/reference/resource-configs/persist_docs): <dict>
[+](/reference/resource-configs/plus-prefix)[full_refresh](/reference/resource-configs/full_refresh): <boolean>
[+](/reference/resource-configs/plus-prefix)[meta](/reference/resource-configs/meta): {<dictionary>}
[+](/reference/resource-configs/plus-prefix)[grants](/reference/resource-configs/grants): {<dictionary>}
[+](/reference/resource-configs/plus-prefix)[contract](/reference/resource-configs/contract): {<dictionary>}
[+](/reference/resource-configs/plus-prefix)[event_time](/reference/resource-configs/event-time): my_time_field

```
</VersionBlock>
</File>

</TabItem>
Expand All @@ -131,6 +155,8 @@ models:

<File name='models/properties.yml'>

<VersionBlock lastVersion="1.8">

```yaml
version: 2

Expand All @@ -150,17 +176,63 @@ models:
[grants](/reference/resource-configs/grants): {<dictionary>}
[contract](/reference/resource-configs/contract): {<dictionary>}
```
</VersionBlock>

</File>
<VersionBlock firstVersion="1.9">

</TabItem>
```yaml
version: 2

models:
- name: [<model-name>]
config:
[enabled](/reference/resource-configs/enabled): true | false
[tags](/reference/resource-configs/tags): <string> | [<string>]
[pre_hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[post_hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[database](/reference/resource-configs/database): <string>
[schema](/reference/resource-properties/schema): <string>
[alias](/reference/resource-configs/alias): <string>
[persist_docs](/reference/resource-configs/persist_docs): <dict>
[full_refresh](/reference/resource-configs/full_refresh): <boolean>
[meta](/reference/resource-configs/meta): {<dictionary>}
[grants](/reference/resource-configs/grants): {<dictionary>}
[contract](/reference/resource-configs/contract): {<dictionary>}
[event_time](/reference/resource-configs/event-time): my_time_field
```

</VersionBlock>
</File>

</TabItem>

<TabItem value="config">

<File name='models/<model_name>.sql'>

<VersionBlock lastVersion="1.8">

```jinja

{{ config(
[enabled](/reference/resource-configs/enabled)=true | false,
[tags](/reference/resource-configs/tags)="<string>" | ["<string>"],
[pre_hook](/reference/resource-configs/pre-hook-post-hook)="<sql-statement>" | ["<sql-statement>"],
[post_hook](/reference/resource-configs/pre-hook-post-hook)="<sql-statement>" | ["<sql-statement>"],
[database](/reference/resource-configs/database)="<string>",
[schema](/reference/resource-properties/schema)="<string>",
[alias](/reference/resource-configs/alias)="<string>",
[persist_docs](/reference/resource-configs/persist_docs)={<dict>},
[meta](/reference/resource-configs/meta)={<dict>},
[grants](/reference/resource-configs/grants)={<dict>},
[contract](/reference/resource-configs/contract)={<dictionary>}
) }}

```
</VersionBlock>

<VersionBlock firstVersion="1.9">

```jinja

{{ config(
Expand All @@ -175,9 +247,11 @@ models:
[meta](/reference/resource-configs/meta)={<dict>},
[grants](/reference/resource-configs/grants)={<dict>},
[contract](/reference/resource-configs/contract)={<dictionary>}
[event_time](/reference/resource-configs/event-time): my_time_field
) }}

```
</VersionBlock>

</File>

Expand Down
2 changes: 1 addition & 1 deletion website/docs/reference/resource-configs/event-time.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,7 @@ sources:

## Definition

Set the `event_time` to the name of the field that represents the timestamp of the event, as opposed to a date-like data loading date. You can configure `event_time` for a [model](/docs/build/models), [seed](/docs/build/seeds), or [source](/docs/build/sources) in your `dbt_project.yml` file, property YAML file, or config block.
Set the `event_time` to the name of the field that represents the timestamp of the event, as opposed to a date-like data loading date. You can configure `event_time` for a [model](/docs/build/models), [seed](/docs/build/seeds), or [source](/docs/build/sources) in your `dbt_project.yml` file, property YAML file, or config block.

Here are some examples of good and bad `event_time` columns:
✅ Good:
Expand Down
50 changes: 49 additions & 1 deletion website/docs/reference/seed-configs.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,8 @@ seeds:

<File name='dbt_project.yml'>

<VersionBlock lastVersion="1.8">

```yaml
seeds:
[<resource-path>](/reference/resource-configs/resource-path):
Expand All @@ -95,7 +97,28 @@ seeds:
[+](/reference/resource-configs/plus-prefix)[grants](/reference/resource-configs/grants): {<dictionary>}

```
</VersionBlock>

<VersionBlock firstVersion="1.9">

```yaml
seeds:
[<resource-path>](/reference/resource-configs/resource-path):
[+](/reference/resource-configs/plus-prefix)[enabled](/reference/resource-configs/enabled): true | false
[+](/reference/resource-configs/plus-prefix)[tags](/reference/resource-configs/tags): <string> | [<string>]
[+](/reference/resource-configs/plus-prefix)[pre-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[+](/reference/resource-configs/plus-prefix)[post-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[+](/reference/resource-configs/plus-prefix)[database](/reference/resource-configs/database): <string>
[+](/reference/resource-configs/plus-prefix)[schema](/reference/resource-properties/schema): <string>
[+](/reference/resource-configs/plus-prefix)[alias](/reference/resource-configs/alias): <string>
[+](/reference/resource-configs/plus-prefix)[persist_docs](/reference/resource-configs/persist_docs): <dict>
[+](/reference/resource-configs/plus-prefix)[full_refresh](/reference/resource-configs/full_refresh): <boolean>
[+](/reference/resource-configs/plus-prefix)[meta](/reference/resource-configs/meta): {<dictionary>}
[+](/reference/resource-configs/plus-prefix)[grants](/reference/resource-configs/grants): {<dictionary>}
[+](/reference/resource-configs/plus-prefix)[event_time](/reference/resource-configs/event-time): my_time_field

```
</VersionBlock>
</File>

</TabItem>
Expand All @@ -105,6 +128,8 @@ seeds:

<File name='seeds/properties.yml'>

<VersionBlock firstVersion="1.9">

```yaml
version: 2

Expand All @@ -122,13 +147,36 @@ seeds:
[full_refresh](/reference/resource-configs/full_refresh): <boolean>
[meta](/reference/resource-configs/meta): {<dictionary>}
[grants](/reference/resource-configs/grants): {<dictionary>}
[event_time](/reference/resource-configs/event-time): my_time_field

```
</VersionBlock>

<VersionBlock lastVersion="1.8">

```yaml
version: 2

seeds:
- name: [<seed-name>]
config:
[enabled](/reference/resource-configs/enabled): true | false
[tags](/reference/resource-configs/tags): <string> | [<string>]
[pre_hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[post_hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[database](/reference/resource-configs/database): <string>
[schema](/reference/resource-properties/schema): <string>
[alias](/reference/resource-configs/alias): <string>
[persist_docs](/reference/resource-configs/persist_docs): <dict>
[full_refresh](/reference/resource-configs/full_refresh): <boolean>
[meta](/reference/resource-configs/meta): {<dictionary>}
[grants](/reference/resource-configs/grants): {<dictionary>}
```

</VersionBlock>
</File>

</TabItem>

</Tabs>

## Configuring seeds
Expand Down
22 changes: 20 additions & 2 deletions website/docs/reference/snapshot-configs.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -168,6 +168,24 @@ Configurations can be applied to snapshots using the [YAML syntax](/docs/build/s

<File name='dbt_project.yml'>

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

grace mentioned event_time is supported for anythign that is ref-able. since snapshot is, i added event_time to it

<VersionBlock firstVersion="1.9">

```yaml
snapshots:
[<resource-path>](/reference/resource-configs/resource-path):
[+](/reference/resource-configs/plus-prefix)[enabled](/reference/resource-configs/enabled): true | false
[+](/reference/resource-configs/plus-prefix)[tags](/reference/resource-configs/tags): <string> | [<string>]
[+](/reference/resource-configs/plus-prefix)[alias](/reference/resource-configs/alias): <string>
[+](/reference/resource-configs/plus-prefix)[pre-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[+](/reference/resource-configs/plus-prefix)[post-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[+](/reference/resource-configs/plus-prefix)[persist_docs](/reference/resource-configs/persist_docs): {<dict>}
[+](/reference/resource-configs/plus-prefix)[grants](/reference/resource-configs/grants): {<dict>}
[+](/reference/resource-configs/plus-prefix)[event_time](/reference/resource-configs/event-time): my_time_field
```
</VersionBlock>

<VersionBlock lastVersion="1.8">

```yaml
snapshots:
[<resource-path>](/reference/resource-configs/resource-path):
Expand All @@ -179,6 +197,7 @@ snapshots:
[+](/reference/resource-configs/plus-prefix)[persist_docs](/reference/resource-configs/persist_docs): {<dict>}
[+](/reference/resource-configs/plus-prefix)[grants](/reference/resource-configs/grants): {<dict>}
```
</VersionBlock>
</File>

</TabItem>
Expand Down Expand Up @@ -225,6 +244,7 @@ snapshots:
[post-hook](/reference/resource-configs/pre-hook-post-hook): <sql-statement> | [<sql-statement>]
[persist_docs](/reference/resource-configs/persist_docs): {<dict>}
[grants](/reference/resource-configs/grants): {<dictionary>}
[event_time](/reference/resource-configs/event-time): my_time_field
```

</File>
Expand Down Expand Up @@ -292,7 +312,6 @@ The following examples demonstrate how to configure snapshots using the `dbt_pro
<File name='dbt_project.yml'>

```yml

snapshots:
+unique_key: id
```
Expand All @@ -307,7 +326,6 @@ The following examples demonstrate how to configure snapshots using the `dbt_pro
<File name='dbt_project.yml'>

```yml

snapshots:
jaffle_shop:
+unique_key: id
Expand Down
Loading
Loading