Skip to content

Latest commit

 

History

History
203 lines (166 loc) · 7.95 KB

CHANGELOG.md

File metadata and controls

203 lines (166 loc) · 7.95 KB

Unreleased

New features

Under the hood

Fixes

edu_edfi_source v0.4.2

Fixes

  • Fix surrogate key creation for stg_ef3__grading_periods to properly hanlde lowering of alphanumeric column (grading_period_name) that is part of natural key

edu_edfi_source v0.4.1

Fixes

  • Fix surrogate key creation for stg_ef3__student_contact_associations to properly hanlde lowering of alphanumeric columns that are part of natural keys

edu_edfi_source v0.4.0

New features

  • Add stg_ef3__stu_ed_org__cohort_years tracking student cohort designations (flattens Ed-Fi collection cohort_years for easier downstream use)
  • Add base/stage models for contacts and student_contact_associations, added due to the rename from parent to contact in Ed-Fi data standard v5.0.
  • Rename k_parent to k_contact in stg_ef3__survey_responses.
  • Add gender_identity, preferred_first_name, preferred_last_name columns to staffs (Ed-Fi Data Standard v5.0 additions)
  • Add section_type descriptor column to sections (Ed-Fi Data Standard v5.0 addition)
  • Add responsible_teacher_staff_reference, v_programs, v_sections columns to course_transcripts (Ed-Fi Data Standard v5.0 additions)
  • Add v_programs column to course_transcripts (Ed-Fi Data Standard v5.0 addition)

Under the hood

  • Add columns to base_ef3__parents to allow data to be unioned into new stg_ef3__contacts model
  • Update package dependency dbt_utils to 1.3.0, including alignment to renamed generate_surrogate_key() macro. Note, this change now treats nulls and empty strings as distinct values in surrogate key generation.
  • Make package macro calls to extract_descriptor explicit so flatten_arrays can be used by outer packages

Fixes

  • Fix typo in column name courses.maxCompletionsForCredit
  • Fix surrogate key creation for stg_ef3__student_academic_records, stg_ef3__student_objective_assessments, and stg_ef3__students to properly handle lowering of alphanumeric columns that are part of natural keys
  • Rename stg_ef3__staff__races to stg_ef3__staffs__races for consistency with EDU naming conventions

edu_edfi_source v0.3.6

Fixes

  • Fix data type on base_ef3__student_special_education_program_associations.student_unique_id

edu_edfi_source v0.3.5

Fixes

  • Remove records deleted from Ed-Fi in student_education_organization_associations and student_parent_associations

Under the hood

  • Add v_ext handling in discipline and student_academic_record flattened models
  • Add missing references/surrogate key generation for ed_orgs in graduation_plans and courses

edu_edfi_source v0.3.4

New features

  • Add base/stage models for student_education_organization_responsibility_associations
  • Add column last_modified_timestamp to every base table (via source_edfi3 macro). This includes timestamps of Ed-Fi deletes, which is helpful for tracking down when deletes occurred.

Under the hood

Fixes

  • Improve performance of stg_ef3__student_assessments by fixing a join in int_ef3__student_assessments__identify_subject. Also fixes edge case bug (only applicable where assessments were loaded incorrectly).

edu_edfi_source v0.3.3

New features

Under the hood

  • Add explicit namespacing for macro call: edu_edfi_source.extract_descriptor() within gen_skey() so gen_skey() can be used outside this package

Fixes

  • Force staff_unique_id and student_unique_id to lower in construction of k_staff and k_student. This is needed for keys to match foreign keys generated using gen_skey() macro.

edu_edfi_source v0.3.2

New features

  • Add base_ef3__staff_education_organization_employment_associations
  • Add stg_ef3__staff_education_organization_employment_associations
  • Add `stg

edu_edfi_source v0.3.2

New features

  • Add base_ef3__staff_education_organization_employment_associations
  • Add stg_ef3__staff_education_organization_employment_associations
  • Add stg_ef3__staff__races

edu_edfi_source v0.3.1

Fixes

  • Fix to stg_ef3__student_assessments: remove deleted records

edu_edfi_source v0.3.0

New features

  • Bring SEA and ESC in line with LEA by using abbreviated names and keys

Fixes

  • Fix spelling of stg_ef3__stu_ed_org__disabilities.disability_designation
  • Fix unique key of stg_ef3__student_school_attendance_events and stg_ef3__student_section_attendance_events to correctly align with Ed-Fi key. This creates new records that are handled in edu_wh v0.3.0

edu_edfi_source v0.2.15

Under the hood

  • add k_student_xyear to student assessment models

Fixes

  • Fix deduplication ordering in student academic records

edu_edfi_source v0.2.14

New features

  • Add models for SEAs

Under the hood

  • Tag cohort models for easy disabling when not in use

Fixes

  • Fix typo on attendance durations

edu_edfi_source v0.2.13

New features

  • Add base & stage models for learning standards, and stg_ef3__grades__learning_standards for student-learning standard-grades

edu_edfi_source v0.2.12

Fixes

  • Fix a rare edge case in the grain of the discipline model against multi-year ODSes

edu_edfi_source v0.2.11

New features

  • Add studentAcademicRecord diplomas model

edu_edfi_source v0.2.10

Under the hood

  • On Assessment records, use timestamps without timezones for better compatibility

edu_edfi_source v0.2.9

Fixes

  • Fix discipline-behavior grain
  • Add missing model config for disabilities

edu_edfi_source v0.2.8

Fixes

  • Handle single quotes in Descriptors when swapping from codeValue to shortDescription

edu_edfi_source v0.2.7

New features

  • Allow for swapping descriptor codeValues for shortDescriptions or Descriptions

Fixes

  • Fix attribution of Objective Assessments to the correct Academic Subject

edu_edfi_source v0.2.6

New features

  • Add models for the main components of the Survey domain
  • Add model for disabilities on studentSpecialEducationProgramAssociation

Under the hood

  • Change the way foreign key generation works: optional references that are Null will now produce a Null key rather than a valid hash that doesn't join to anything

edu_edfi_source v0.2.5

Fixes

  • Bugfix release: address inconsistent casing in deletes IDs in Ed-Fi deployments

edu_edfi_source v0.2.4

Fixes

  • Bugfix release: correct typo

edu_edfi_source v0.2.3

Fixes

  • Bugfix release: correct typo
  • Add to default non-offender codes

edu_edfi_source v0.2.2

New features

  • Add models for education service centers
  • Add additional discipline/behavior models

Under the hood

  • Update extract_extension macro to handle multiple models
  • Add school_year to staff ed org assignments

edu_edfi_source v0.2.1

Under the hood

  • Standardize naming conventions across program models
  • Add minimum dbt version requirement

edu_edfi_source v0.2.0

New features

  • Add optional domain disabling to all non-core models, using vars in dbt_project.yml.

Under the hood

  • Add a single model properties file under each subdirectory, as per DBT recommendation.

Fixes

  • Remove unnecessary deduplication keys for program association staging models

edu_edfi_source v0.1.3

New features

  • Add simplified full_address field to models containing addresses

Under the hood

  • Simplify do_not_publish_indicator to do_not_publish

Fixes

  • Fix incorrect indentation on cohort test

edu_edfi_source v0.1.2

New features

  • Add models for studentLanguageInstructionProgramAssociations, studentHomelessProgramAssociations, and studentTitleIPartAProgramAssociations
  • Add model for Special Education Program Services
  • Add models for cohorts
  • Add model for graduation plans

Fixes

  • Remove unnecessary deduplication keys for program association staging models

edu_edfi_source v0.1.1

New features

  • Add models for descriptors
  • Add model for student languages
  • Add model for student telephone numbers
  • Add model for Parents
  • Add model for studentParentAssociations

Under the hood

  • Factor out handling of common sub-objects like addresses and phone numbers to macros

Fixes

edu_edfi_source v0.1.0

Initial release