From 889dfeddced1138fcd68fdd412af11ee68cda62d Mon Sep 17 00:00:00 2001 From: anouardbt <164202027+anouardbt@users.noreply.github.com> Date: Wed, 9 Oct 2024 10:38:09 +0100 Subject: [PATCH 1/3] Update incremental-microbatch.md batch size seem to be required when I'm not doing it it gives me a compliation error error --- website/docs/docs/build/incremental-microbatch.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/docs/docs/build/incremental-microbatch.md b/website/docs/docs/build/incremental-microbatch.md index 2bfc07d8e2e..676141d83d6 100644 --- a/website/docs/docs/build/incremental-microbatch.md +++ b/website/docs/docs/build/incremental-microbatch.md @@ -152,7 +152,7 @@ Several configurations are relevant to microbatch models, and some are required: |----------|------|---------------|---------| | `event_time` | Column (required) | The column indicating "at what time did the row occur." Required for your microbatch model and any direct parents that should be filtered. | N/A | | `begin` | Date (required) | The "beginning of time" for the microbatch model. This is the starting point for any initial or full-refresh builds. For example, a daily-grain microbatch model run on `2024-10-01` with `begin = '2023-10-01` will process 366 batches (it's a leap year!) plus the batch for "today." | N/A | -| `batch_size` | String (optional) | The granularity of your batches. The default is `day` (and currently this is the only granularity supported). | `day` | +| `batch_size` | String (required) | The granularity of your batches. The default is `day` (and currently this is the only granularity supported). | `day` | | `lookback` | Integer (optional) | Process X batches prior to the latest bookmark to capture late-arriving records. | `0` | From 5b1bd7b9114e9f24e57c884f59fbabede7741aa1 Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Wed, 9 Oct 2024 16:13:36 +0100 Subject: [PATCH 2/3] Update incremental-microbatch.md --- website/docs/docs/build/incremental-microbatch.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/website/docs/docs/build/incremental-microbatch.md b/website/docs/docs/build/incremental-microbatch.md index 676141d83d6..1f86c859dc3 100644 --- a/website/docs/docs/build/incremental-microbatch.md +++ b/website/docs/docs/build/incremental-microbatch.md @@ -52,7 +52,8 @@ We run the `sessions` model on October 1, 2024, and then again on October 2. It materialized='incremental', incremental_strategy='microbatch', event_time='session_start', - begin='2020-01-01' + begin='2020-01-01', + batch_size='day' ) }} with page_views as ( From b8f4746964e6f49905599541d831705336054573 Mon Sep 17 00:00:00 2001 From: Mirna Wong <89008547+mirnawong1@users.noreply.github.com> Date: Wed, 9 Oct 2024 16:14:19 +0100 Subject: [PATCH 3/3] Update incremental-microbatch.md --- website/docs/docs/build/incremental-microbatch.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/website/docs/docs/build/incremental-microbatch.md b/website/docs/docs/build/incremental-microbatch.md index 1f86c859dc3..d200dd6e4b6 100644 --- a/website/docs/docs/build/incremental-microbatch.md +++ b/website/docs/docs/build/incremental-microbatch.md @@ -35,8 +35,8 @@ The `page_view_start` column in `page_views` is configured as that model's `even ```yaml models: - name: page_views - config: - event_time: page_view_start + config: + event_time: page_view_start ``` We run the `sessions` model on October 1, 2024, and then again on October 2. It produces the following queries: @@ -268,8 +268,8 @@ Where you’ve also set an `event_time` for the model’s direct parents - in th ```yaml models: - name: stg_events - config: - event_time: my_time_field + config: + event_time: my_time_field ```