- Fix surrogate key creation for
stg_ef3__grading_periods
to properly hanlde lowering of alphanumeric column (grading_period_name) that is part of natural key
- Fix surrogate key creation for
stg_ef3__student_contact_associations
to properly hanlde lowering of alphanumeric columns that are part of natural keys
- Add
stg_ef3__stu_ed_org__cohort_years
tracking student cohort designations (flattens Ed-Fi collectioncohort_years
for easier downstream use) - Add base/stage models for
contacts
andstudent_contact_associations
, added due to the rename from parent to contact in Ed-Fi data standard v5.0. - Rename
k_parent
tok_contact
instg_ef3__survey_responses
. - Add
gender_identity
,preferred_first_name
,preferred_last_name
columns tostaffs
(Ed-Fi Data Standard v5.0 additions) - Add
section_type
descriptor column tosections
(Ed-Fi Data Standard v5.0 addition) - Add
responsible_teacher_staff_reference
,v_programs
,v_sections
columns tocourse_transcripts
(Ed-Fi Data Standard v5.0 additions) - Add
v_programs
column tocourse_transcripts
(Ed-Fi Data Standard v5.0 addition)
- Add columns to
base_ef3__parents
to allow data to be unioned into newstg_ef3__contacts
model - Update package dependency
dbt_utils
to 1.3.0, including alignment to renamedgenerate_surrogate_key()
macro. Note, this change now treats nulls and empty strings as distinct values in surrogate key generation. - Make package macro calls to
extract_descriptor
explicit soflatten_arrays
can be used by outer packages
- Fix typo in column name
courses.maxCompletionsForCredit
- Fix surrogate key creation for
stg_ef3__student_academic_records
,stg_ef3__student_objective_assessments
, andstg_ef3__students
to properly handle lowering of alphanumeric columns that are part of natural keys - Rename
stg_ef3__staff__races
tostg_ef3__staffs__races
for consistency with EDU naming conventions
- Fix data type on base_ef3__student_special_education_program_associations.student_unique_id
- Remove records deleted from Ed-Fi in
student_education_organization_associations
andstudent_parent_associations
- Add
v_ext
handling indiscipline
andstudent_academic_record
flattened models - Add missing references/surrogate key generation for ed_orgs in
graduation_plans
andcourses
- Add base/stage models for student_education_organization_responsibility_associations
- Add column
last_modified_timestamp
to every base table (viasource_edfi3
macro). This includes timestamps of Ed-Fi deletes, which is helpful for tracking down when deletes occurred.
- Improve performance of
stg_ef3__student_assessments
by fixing a join inint_ef3__student_assessments__identify_subject
. Also fixes edge case bug (only applicable where assessments were loaded incorrectly).
- Add explicit namespacing for macro call:
edu_edfi_source.extract_descriptor()
withingen_skey()
sogen_skey()
can be used outside this package
- Force staff_unique_id and student_unique_id to lower in construction of
k_staff
andk_student
. This is needed for keys to match foreign keys generated usinggen_skey()
macro.
- Add
base_ef3__staff_education_organization_employment_associations
- Add
stg_ef3__staff_education_organization_employment_associations
- Add `stg
- Add
base_ef3__staff_education_organization_employment_associations
- Add
stg_ef3__staff_education_organization_employment_associations
- Add
stg_ef3__staff__races
- Fix to
stg_ef3__student_assessments
: remove deleted records
- Bring SEA and ESC in line with LEA by using abbreviated names and keys
- Fix spelling of
stg_ef3__stu_ed_org__disabilities.disability_designation
- Fix unique key of
stg_ef3__student_school_attendance_events
andstg_ef3__student_section_attendance_events
to correctly align with Ed-Fi key. This creates new records that are handled in edu_wh v0.3.0
- add k_student_xyear to student assessment models
- Fix deduplication ordering in student academic records
- Add models for SEAs
- Tag cohort models for easy disabling when not in use
- Fix typo on attendance durations
- Add base & stage models for learning standards, and stg_ef3__grades__learning_standards for student-learning standard-grades
- Fix a rare edge case in the grain of the discipline model against multi-year ODSes
- Add studentAcademicRecord diplomas model
- On Assessment records, use timestamps without timezones for better compatibility
- Fix discipline-behavior grain
- Add missing model config for disabilities
- Handle single quotes in Descriptors when swapping from codeValue to shortDescription
- Allow for swapping descriptor codeValues for shortDescriptions or Descriptions
- Fix attribution of Objective Assessments to the correct Academic Subject
- Add models for the main components of the Survey domain
- Add model for disabilities on studentSpecialEducationProgramAssociation
- Change the way foreign key generation works: optional references that are Null will now produce a Null key rather than a valid hash that doesn't join to anything
- Bugfix release: address inconsistent casing in deletes IDs in Ed-Fi deployments
- Bugfix release: correct typo
- Bugfix release: correct typo
- Add to default non-offender codes
- Add models for education service centers
- Add additional discipline/behavior models
- Update
extract_extension
macro to handle multiple models - Add school_year to staff ed org assignments
- Standardize naming conventions across program models
- Add minimum dbt version requirement
- Add optional domain disabling to all non-core models, using vars in dbt_project.yml.
- Add a single model properties file under each subdirectory, as per DBT recommendation.
- Remove unnecessary deduplication keys for program association staging models
- Add simplified
full_address
field to models containing addresses
- Simplify
do_not_publish_indicator
todo_not_publish
- Fix incorrect indentation on cohort test
- Add models for studentLanguageInstructionProgramAssociations, studentHomelessProgramAssociations, and studentTitleIPartAProgramAssociations
- Add model for Special Education Program Services
- Add models for cohorts
- Add model for graduation plans
- Remove unnecessary deduplication keys for program association staging models
- Add models for descriptors
- Add model for student languages
- Add model for student telephone numbers
- Add model for Parents
- Add model for studentParentAssociations
- Factor out handling of common sub-objects like addresses and phone numbers to macros
Initial release