Feat/dau reporting/add active users #6483

gkatre · 2024-11-13T17:50:29Z

Description

Adding templates for active_users and active_users_aggregates ETL for dau_reporting ping.

This has dependencies on the feat/add_dau_reporting-to-glean_usage branch (#6399)

Tables:

[app_name]_derived.dau_reporting_active_users_aggregates_v1 - A daily aggregate table of the dau_reporting ping.

Views:

[app_name].dau_reporting_active_users - A view that merges the computations for client first seen
and last seen metrics with the daily client aggregations from clients_daily for the dau_reporting ping.
[app_name].dau_reporting_active_users_aggregates

┆Issue is synchronized with this Jira Task

…b.com/mozilla/bigquery-etl into feat/add_dau_reporting-to-glean_usage # Conflicts: # sql_generators/glean_usage/templates/dau_reporting_clients_daily.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.schema.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen_v1.query.sql

…ented out at the moment.

…it does not existing in the source ping table

…ad of country which does not exist in the result

…ented out at the moment.

…it does not existing in the source ping table

…ad of country which does not exist in the result

…b.com/mozilla/bigquery-etl into feat/add_dau_reporting-to-glean_usage # Conflicts: # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.schema.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.schema.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen_v1.schema.yaml

…b.com/mozilla/bigquery-etl into feat/add_dau_reporting-to-glean_usage # Conflicts: # sql_generators/glean_usage/templates/dau_reporting_clients_daily.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_daily_v1.schema.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_first_seen_v1.schema.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen_v1.metadata.yaml # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen_v1.query.sql # sql_generators/glean_usage/templates/dau_reporting_clients_last_seen_v1.schema.yaml

…ented out at the moment.

…it does not existing in the source ping table

…ad of country which does not exist in the result

… source table

…schema.yaml

dataops-ci-bot · 2024-11-14T01:24:32Z

Integration report for "Creating active_users and active_users_aggregates for dau_reporting ping"

`sql.diff`

Click to expand!

diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/dags/bqetl_glean_usage.py /tmp/workspace/generated-sql/dags/bqetl_glean_usage.py
--- /tmp/workspace/main-generated-sql/dags/bqetl_glean_usage.py	2024-11-14 01:11:07.000000000 +0000
+++ /tmp/workspace/generated-sql/dags/bqetl_glean_usage.py	2024-11-14 01:23:51.000000000 +0000
@@ -1465,6 +1465,70 @@
         task_group=task_group_firefox_desktop_background_update,
     )
 
+    firefox_desktop_background_update_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_background_update_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="firefox_desktop_background_update_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop_background_update,
+    )
+
+    firefox_desktop_background_update_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_background_update_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="firefox_desktop_background_update_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop_background_update,
+    )
+
+    firefox_desktop_background_update_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_background_update_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="firefox_desktop_background_update_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop_background_update,
+    )
+
+    firefox_desktop_background_update_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_background_update_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="firefox_desktop_background_update_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop_background_update,
+    )
+
     firefox_desktop_background_update_derived__events_stream__v1 = bigquery_etl_query(
         task_id="firefox_desktop_background_update_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -1556,6 +1620,70 @@
         task_group=task_group_firefox_desktop,
     )
 
+    firefox_desktop_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="firefox_desktop_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop,
+    )
+
+    firefox_desktop_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="firefox_desktop_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop,
+    )
+
+    firefox_desktop_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="firefox_desktop_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop,
+    )
+
+    firefox_desktop_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="firefox_desktop_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="firefox_desktop_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_desktop,
+    )
+
     firefox_desktop_derived__events_stream__v1 = bigquery_etl_query(
         task_id="firefox_desktop_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -2863,6 +2991,72 @@
         task_group=task_group_fenix,
     )
 
+    org_mozilla_fenix_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_fenix_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fenix_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_fenix_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fenix_derived__dau_reporting_clients_first_seen__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_fenix_derived__dau_reporting_clients_first_seen__v1",
+            destination_table="dau_reporting_clients_first_seen_v1",
+            dataset_id="org_mozilla_fenix_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_fenix,
+        )
+    )
+
+    org_mozilla_fenix_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_fenix_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
     org_mozilla_fenix_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_fenix_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -2920,6 +3114,70 @@
         )
     )
 
+    org_mozilla_fenix_nightly_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_nightly_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_fenix_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fenix_nightly_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_nightly_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_fenix_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fenix_nightly_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_nightly_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_fenix_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fenix_nightly_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fenix_nightly_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_fenix_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
     org_mozilla_fenix_nightly_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_fenix_nightly_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -2977,6 +3235,70 @@
         )
     )
 
+    org_mozilla_fennec_aurora_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fennec_aurora_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_fennec_aurora_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fennec_aurora_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fennec_aurora_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_fennec_aurora_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fennec_aurora_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fennec_aurora_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_fennec_aurora_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_fennec_aurora_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_fennec_aurora_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_fennec_aurora_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
     org_mozilla_fennec_aurora_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_fennec_aurora_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3036,6 +3358,72 @@
         )
     )
 
+    org_mozilla_firefox_beta_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_firefox_beta_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_firefox_beta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_firefox_beta_derived__dau_reporting_clients_daily__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_firefox_beta_derived__dau_reporting_clients_daily__v1",
+            destination_table="dau_reporting_clients_daily_v1",
+            dataset_id="org_mozilla_firefox_beta_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_fenix,
+        )
+    )
+
+    org_mozilla_firefox_beta_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_firefox_beta_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_firefox_beta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_firefox_beta_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_firefox_beta_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_firefox_beta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
     org_mozilla_firefox_beta_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_firefox_beta_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3091,6 +3479,74 @@
         task_group=task_group_fenix,
     )
 
+    org_mozilla_firefox_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_firefox_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_firefox_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_firefox_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_firefox_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_firefox_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_fenix,
+    )
+
+    org_mozilla_firefox_derived__dau_reporting_clients_first_seen__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_firefox_derived__dau_reporting_clients_first_seen__v1",
+            destination_table="dau_reporting_clients_first_seen_v1",
+            dataset_id="org_mozilla_firefox_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_fenix,
+        )
+    )
+
+    org_mozilla_firefox_derived__dau_reporting_clients_last_seen__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_firefox_derived__dau_reporting_clients_last_seen__v1",
+            destination_table="dau_reporting_clients_last_seen_v1",
+            dataset_id="org_mozilla_firefox_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_fenix,
+        )
+    )
+
     org_mozilla_firefox_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_firefox_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3262,6 +3718,72 @@
         task_group=task_group_focus_android,
     )
 
+    org_mozilla_focus_beta_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_beta_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_focus_beta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_beta_derived__dau_reporting_clients_daily__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_focus_beta_derived__dau_reporting_clients_daily__v1",
+            destination_table="dau_reporting_clients_daily_v1",
+            dataset_id="org_mozilla_focus_beta_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_focus_android,
+        )
+    )
+
+    org_mozilla_focus_beta_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_beta_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_focus_beta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_beta_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_beta_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_focus_beta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
     org_mozilla_focus_beta_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_focus_beta_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3317,6 +3839,72 @@
         task_group=task_group_focus_android,
     )
 
+    org_mozilla_focus_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_focus_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_focus_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_derived__dau_reporting_clients_first_seen__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_focus_derived__dau_reporting_clients_first_seen__v1",
+            destination_table="dau_reporting_clients_first_seen_v1",
+            dataset_id="org_mozilla_focus_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_focus_android,
+        )
+    )
+
+    org_mozilla_focus_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_focus_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
     org_mozilla_focus_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_focus_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3374,6 +3962,70 @@
         )
     )
 
+    org_mozilla_focus_nightly_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_nightly_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_focus_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_nightly_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_nightly_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_focus_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_nightly_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_nightly_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_focus_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
+    org_mozilla_focus_nightly_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_focus_nightly_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_focus_nightly_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_focus_android,
+    )
+
     org_mozilla_focus_nightly_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_focus_nightly_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3431,6 +4083,72 @@
         task_group=task_group_firefox_ios,
     )
 
+    org_mozilla_ios_fennec_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_fennec_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_ios_fennec_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_fennec_derived__dau_reporting_clients_daily__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_ios_fennec_derived__dau_reporting_clients_daily__v1",
+            destination_table="dau_reporting_clients_daily_v1",
+            dataset_id="org_mozilla_ios_fennec_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_firefox_ios,
+        )
+    )
+
+    org_mozilla_ios_fennec_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_fennec_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_ios_fennec_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_fennec_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_fennec_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_ios_fennec_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
     org_mozilla_ios_fennec_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_ios_fennec_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3490,6 +4208,72 @@
         )
     )
 
+    org_mozilla_ios_firefox_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefox_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_ios_firefox_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_firefox_derived__dau_reporting_clients_daily__v1 = (
+        bigquery_etl_query(
+            task_id="org_mozilla_ios_firefox_derived__dau_reporting_clients_daily__v1",
+            destination_table="dau_reporting_clients_daily_v1",
+            dataset_id="org_mozilla_ios_firefox_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_firefox_ios,
+        )
+    )
+
+    org_mozilla_ios_firefox_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefox_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_ios_firefox_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_firefox_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefox_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_ios_firefox_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
     org_mozilla_ios_firefox_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_ios_firefox_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3547,6 +4331,70 @@
         task_group=task_group_firefox_ios,
     )
 
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefoxbeta_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_ios_firefoxbeta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_ios_firefoxbeta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_ios_firefoxbeta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_ios_firefoxbeta_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_firefox_ios,
+    )
+
     org_mozilla_ios_firefoxbeta_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_ios_firefoxbeta_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -3881,6 +4729,70 @@
         task_group=task_group_klar_android,
     )
 
+    org_mozilla_klar_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="org_mozilla_klar_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="org_mozilla_klar_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_klar_android,
+    )
+
+    org_mozilla_klar_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="org_mozilla_klar_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="org_mozilla_klar_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_klar_android,
+    )
+
+    org_mozilla_klar_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_klar_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="org_mozilla_klar_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_klar_android,
+    )
+
+    org_mozilla_klar_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="org_mozilla_klar_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="org_mozilla_klar_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_klar_android,
+    )
+
     org_mozilla_klar_derived__events_stream__v1 = bigquery_etl_query(
         task_id="org_mozilla_klar_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -4217,6 +5129,70 @@
         task_group=task_group_pine,
     )
 
+    pine_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="pine_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="pine_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_pine,
+    )
+
+    pine_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="pine_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="pine_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_pine,
+    )
+
+    pine_derived__dau_reporting_clients_first_seen__v1 = bigquery_etl_query(
+        task_id="pine_derived__dau_reporting_clients_first_seen__v1",
+        destination_table="dau_reporting_clients_first_seen_v1",
+        dataset_id="pine_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_pine,
+    )
+
+    pine_derived__dau_reporting_clients_last_seen__v1 = bigquery_etl_query(
+        task_id="pine_derived__dau_reporting_clients_last_seen__v1",
+        destination_table="dau_reporting_clients_last_seen_v1",
+        dataset_id="pine_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_pine,
+    )
+
     pine_derived__events_stream__v1 = bigquery_etl_query(
         task_id="pine_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -4350,6 +5326,74 @@
         task_group=task_group_thunderbird_desktop,
     )
 
+    thunderbird_desktop_derived__dau_reporting_active_users_aggregates__v1 = bigquery_etl_query(
+        task_id="thunderbird_desktop_derived__dau_reporting_active_users_aggregates__v1",
+        destination_table="dau_reporting_active_users_aggregates_v1",
+        dataset_id="thunderbird_desktop_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_thunderbird_desktop,
+    )
+
+    thunderbird_desktop_derived__dau_reporting_clients_daily__v1 = bigquery_etl_query(
+        task_id="thunderbird_desktop_derived__dau_reporting_clients_daily__v1",
+        destination_table="dau_reporting_clients_daily_v1",
+        dataset_id="thunderbird_desktop_derived",
+        project_id="moz-fx-data-shared-prod",
+        owner="[email protected]",
+        email=[
+            "[email protected]",
+            "[email protected]",
+            "[email protected]",
+        ],
+        date_partition_parameter="submission_date",
+        depends_on_past=False,
+        task_group=task_group_thunderbird_desktop,
+    )
+
+    thunderbird_desktop_derived__dau_reporting_clients_first_seen__v1 = (
+        bigquery_etl_query(
+            task_id="thunderbird_desktop_derived__dau_reporting_clients_first_seen__v1",
+            destination_table="dau_reporting_clients_first_seen_v1",
+            dataset_id="thunderbird_desktop_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_thunderbird_desktop,
+        )
+    )
+
+    thunderbird_desktop_derived__dau_reporting_clients_last_seen__v1 = (
+        bigquery_etl_query(
+            task_id="thunderbird_desktop_derived__dau_reporting_clients_last_seen__v1",
+            destination_table="dau_reporting_clients_last_seen_v1",
+            dataset_id="thunderbird_desktop_derived",
+            project_id="moz-fx-data-shared-prod",
+            owner="[email protected]",
+            email=[
+                "[email protected]",
+                "[email protected]",
+                "[email protected]",
+            ],
+            date_partition_parameter="submission_date",
+            depends_on_past=False,
+            task_group=task_group_thunderbird_desktop,
+        )
+    )
+
     thunderbird_desktop_derived__events_stream__v1 = bigquery_etl_query(
         task_id="thunderbird_desktop_derived__events_stream__v1",
         destination_table="events_stream_v1",
@@ -5248,6 +6292,18 @@
         firefox_desktop_background_update_derived__metrics_clients_last_seen__v1
     )
 
+    firefox_desktop_background_update_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    firefox_desktop_background_update_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        firefox_desktop_background_update_derived__dau_reporting_clients_daily__v1
+    )
+
+    firefox_desktop_background_update_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        firefox_desktop_background_update_derived__dau_reporting_clients_daily__v1
+    )
+
     firefox_desktop_background_update_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5288,6 +6344,18 @@
         firefox_desktop_derived__metrics_clients_last_seen__v1
     )
 
+    firefox_desktop_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    firefox_desktop_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        firefox_desktop_derived__dau_reporting_clients_daily__v1
+    )
+
+    firefox_desktop_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        firefox_desktop_derived__dau_reporting_clients_daily__v1
+    )
+
     firefox_desktop_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5828,6 +6896,18 @@
         org_mozilla_fenix_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_fenix_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_fenix_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_fenix_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_fenix_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_fenix_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_fenix_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5852,6 +6932,18 @@
         org_mozilla_fenix_nightly_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_fenix_nightly_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_fenix_nightly_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_fenix_nightly_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_fenix_nightly_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_fenix_nightly_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_fenix_nightly_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5876,6 +6968,18 @@
         org_mozilla_fennec_aurora_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_fennec_aurora_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_fennec_aurora_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_fennec_aurora_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_fennec_aurora_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_fennec_aurora_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_fennec_aurora_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5900,6 +7004,18 @@
         org_mozilla_firefox_beta_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_firefox_beta_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_firefox_beta_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_firefox_beta_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_firefox_beta_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_firefox_beta_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_firefox_beta_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5924,6 +7040,18 @@
         org_mozilla_firefox_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_firefox_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_firefox_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_firefox_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_firefox_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_firefox_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_firefox_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -5996,6 +7124,18 @@
         org_mozilla_focus_beta_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_focus_beta_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_focus_beta_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_focus_beta_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_focus_beta_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_focus_beta_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_focus_beta_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6020,6 +7160,18 @@
         org_mozilla_focus_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_focus_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_focus_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_focus_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_focus_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_focus_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_focus_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6044,6 +7196,18 @@
         org_mozilla_focus_nightly_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_focus_nightly_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_focus_nightly_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_focus_nightly_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_focus_nightly_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_focus_nightly_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_focus_nightly_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6068,6 +7232,18 @@
         org_mozilla_ios_fennec_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_ios_fennec_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_ios_fennec_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_ios_fennec_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_ios_fennec_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_ios_fennec_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_ios_fennec_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6092,6 +7268,18 @@
         org_mozilla_ios_firefox_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_ios_firefox_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_ios_firefox_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_ios_firefox_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_ios_firefox_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_ios_firefox_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_ios_firefox_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6116,6 +7304,18 @@
         org_mozilla_ios_firefoxbeta_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_ios_firefoxbeta_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_ios_firefoxbeta_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6260,6 +7460,18 @@
         org_mozilla_klar_derived__baseline_clients_daily__v1
     )
 
+    org_mozilla_klar_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    org_mozilla_klar_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        org_mozilla_klar_derived__dau_reporting_clients_daily__v1
+    )
+
+    org_mozilla_klar_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        org_mozilla_klar_derived__dau_reporting_clients_daily__v1
+    )
+
     org_mozilla_klar_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
@@ -6402,6 +7614,18 @@
         pine_derived__baseline_clients_daily__v1
     )
 
+    pine_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    pine_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        pine_derived__dau_reporting_clients_daily__v1
+    )
+
+    pine_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        pine_derived__dau_reporting_clients_daily__v1
+    )
+
     pine_derived__events_stream__v1.set_upstream(wait_for_copy_deduplicate_all)
 
     pine_derived__metrics_clients_daily__v1.set_upstream(wait_for_copy_deduplicate_all)
@@ -6448,6 +7672,18 @@
         thunderbird_desktop_derived__baseline_clients_daily__v1
     )
 
+    thunderbird_desktop_derived__dau_reporting_clients_daily__v1.set_upstream(
+        wait_for_copy_deduplicate_all
+    )
+
+    thunderbird_desktop_derived__dau_reporting_clients_first_seen__v1.set_upstream(
+        thunderbird_desktop_derived__dau_reporting_clients_daily__v1
+    )
+
+    thunderbird_desktop_derived__dau_reporting_clients_last_seen__v1.set_upstream(
+        thunderbird_desktop_derived__dau_reporting_clients_daily__v1
+    )
+
     thunderbird_desktop_derived__events_stream__v1.set_upstream(
         wait_for_copy_deduplicate_all
     )
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update_derived: dau_reporting_active_users_aggregates_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update_derived: dau_reporting_clients_daily_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update_derived: dau_reporting_clients_first_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_background_update_derived: dau_reporting_clients_last_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived: dau_reporting_active_users_aggregates_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived: dau_reporting_clients_daily_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived: dau_reporting_clients_first_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/firefox_desktop_derived: dau_reporting_clients_last_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_derived: dau_reporting_active_users_aggregates_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_derived: dau_reporting_clients_daily_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_derived: dau_reporting_clients_first_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_derived: dau_reporting_clients_last_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly_derived: dau_reporting_active_users_aggregates_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly_derived: dau_reporting_clients_daily_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly_derived: dau_reporting_clients_first_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix_nightly_derived: dau_reporting_clients_last_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora_derived: dau_reporting_active_users_aggregates_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora_derived: dau_reporting_clients_daily_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora_derived: dau_reporting_clients_first_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fennec_aurora_derived: dau_reporting_clients_last_seen_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox_beta: dau_reporting_active_users_aggregates
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox_beta: dau_reporting_clients_daily
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox_beta: dau_reporting_clients_first_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox_beta: dau_reporting_clients_last_seen
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox_beta_derived: dau_reporting_active_users_aggregates_v1
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_firefox_beta_derived: dau_

⚠️ Only part of the diff is displayed.

Link to full diff

kik-kik and others added 24 commits November 1, 2024 16:12

feat: add dau_reporting template

aadd4a6

feat: add dau_reporting template

e18106e

feat: remove submission_date from the dau_reporting_first_seen template

f17379b

chore: final code cleanup

0d6869c

bigeye

ca0ac4c

feat: add dau_reporting template

3e7f3c1

feat: remove submission_date from the dau_reporting_first_seen template

ae6198f

chore: final code cleanup

fcb75fd

feat: improve comments documenting why duration based fields are comm…

f078dd1

…ented out at the moment.

feat: add field descriptions to schema.yaml, and remove sample_id as …

8329101

…it does not existing in the source ping table

fix: correct clusting for the dau_reporting_daily to use locale inste…

bd53007

…ad of country which does not exist in the result

fix: invalid query dau_reporting_clients_daily_v1

94a7459

feat: add dau_reporting template

7d2157d

feat: remove submission_date from the dau_reporting_first_seen template

0060528

chore: final code cleanup

da5431b

feat: improve comments documenting why duration based fields are comm…

81cacee

…ented out at the moment.

feat: add field descriptions to schema.yaml, and remove sample_id as …

4a1ee6c

…it does not existing in the source ping table

fix: correct clusting for the dau_reporting_daily to use locale inste…

1818cf6

…ad of country which does not exist in the result

fix: invalid query dau_reporting_clients_daily_v1

4e6f7fa

feat: final tweaks based on the PR reviews

2dfd57a

feat: remove client_id from the templates

b2a29ba

gkatre requested a review from kik-kik November 13, 2024 17:50

kik-kik added 5 commits November 13, 2024 18:59

feat: add dau_reporting template

db8c455

feat: remove submission_date from the dau_reporting_first_seen template

9a53962

chore: final code cleanup

c0186c9

feat: improve comments documenting why duration based fields are comm…

a81abb5

…ented out at the moment.

feat: add field descriptions to schema.yaml, and remove sample_id as …

209c6b7

…it does not existing in the source ping table

kik-kik and others added 10 commits November 13, 2024 18:59

fix: correct clusting for the dau_reporting_daily to use locale inste…

6226bdc

…ad of country which does not exist in the result

fix: invalid query dau_reporting_clients_daily_v1

9040b07

feat: final tweaks based on the PR reviews

ce6b038

feat: remove client_id from the templates

35e13c4

feat: update usage_profile_id reference as now the field existsin the…

ea87ed8

… source table

no message

25e8ada

feat: remove unused code from dau_reporting_clients_daily_v1.query.sql

24f16d7

Merge branch 'main' into feat/add_dau_reporting-to-glean_usage

97fca04

feat: remove unused definition inside dau_reporting_clients_daily_v1.…

b102ae5

…schema.yaml

Creating active_users and active_users_aggregates for dau_reporting ping

4808a07

gkatre force-pushed the feat/dau_reporting/add_active_users branch from 2e4df12 to 4808a07 Compare November 14, 2024 01:03

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Feat/dau reporting/add active users #6483

Feat/dau reporting/add active users #6483

gkatre commented Nov 13, 2024 •

edited by data-sync-user

Loading

dataops-ci-bot commented Nov 14, 2024

Feat/dau reporting/add active users #6483

Are you sure you want to change the base?

Feat/dau reporting/add active users #6483

Conversation

gkatre commented Nov 13, 2024 • edited by data-sync-user Loading

Description

dataops-ci-bot commented Nov 14, 2024

Integration report for "Creating active_users and active_users_aggregates for dau_reporting ping"

sql.diff

gkatre commented Nov 13, 2024 •

edited by data-sync-user

Loading

`sql.diff`