Skip to content

Commit

Permalink
fix(benefits): filter health probe events
Browse files Browse the repository at this point in the history
between Aug 2022 - Feb 2023 we unnecessarily captured events from health probes
resulting in a massive spike of nearly 26 million useless events

this change filters out events generated from the health probes from the final
model table
  • Loading branch information
thekaveman committed Nov 13, 2024
1 parent 1f20b4e commit 7916191
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions warehouse/models/mart/benefits/fct_benefits_events.sql
Original file line number Diff line number Diff line change
Expand Up @@ -250,6 +250,10 @@ fct_benefits_events AS (
ELSE version_name
END AS version_name
FROM fct_benefits_events_raw
-- Filter out events from the Azure healthprobe feature
-- captured before we stopped sending events for this feature
-- https://github.com/cal-itp/benefits/issues/1276
WHERE user_properties_user_agent NOT IN ('Edge Health Probe', 'AlwaysOn')
),
fct_benefits_historic_enrollments AS (
-- fct_benefits_historic_enrollments transforms old enrollment events
Expand Down

0 comments on commit 7916191

Please sign in to comment.