Releases: dbt-labs/dbt-spark
Releases · dbt-labs/dbt-spark
dbt-spark v1.7.0
dbt-spark 1.7.0 - November 02, 2023
Features
- Support server side parameters in thrift connection (#387)
- Support server_side_parameters for Spark session connection method (#690)
- Add server_side_parameters to HTTP connection method (#824)
- Enforce server side parameters keys and values to be strings (#826)
- Add SessionConnectionWrapper (#829)
- Persist Column level comments when creating views (#372)
- Support storing test failures as views (#6914)
- Create temporary views with 'or replace' (#350)
Fixes
- Wrap AnalysisException into DbtRuntimeError (#782)
- include tblproperties macro in adapters.sql create table (#865)
Under the Hood
Dependencies
- Update tox requirement from ~=3.0 to ~=4.5 (#741)
- Update pyodbc requirement from ~=4.0.30 to ~=4.0.39 (#742)
- Update pre-commit requirement from ~=2.21 to ~=3.3 (#748)
- Update types-requests requirement from ~=2.28 to ~=2.29 (#749)
- Bump mypy from 1.2.0 to 1.3.0 (#768)
- Replace sasl with pure-sasl for PyHive (#818)
- Update flake8 requirement from ~=6.0 to ~=6.1 (#849)
- Update types-requests requirement from ~=2.29 to ~=2.31 (#850)
- Update pytest-xdist requirement from ~=3.2 to ~=3.3 (#851)
- Update pytest requirement from ~=7.3 to ~=7.4 (#852)
- Update pip-tools requirement from ~=6.13 to ~=7.2 (#856)
- Update black requirement from ~=23.3 to ~=23.7 (#857)
- Update wheel requirement from ~=0.40 to ~=0.41 (#858)
- Update mock requirement from ~=5.0 to ~=5.1 (#859)
- Bump mypy from 1.3.0 to 1.4.1 (#860)
- Update tox requirement from ~=4.5 to ~=4.6 (#861)
- Update pip-tools requirement from ~=7.2 to ~=7.3 (#863)
- Update tox requirement from ~=4.6 to ~=4.7 (#867)
- Update tox requirement from ~=4.7 to ~=4.8 (#871)
- Bump mypy from 1.4.1 to 1.5.0 (#872)
- Update tox requirement from ~=4.8 to ~=4.9 (#874)
- Bump mypy from 1.5.0 to 1.5.1 (#875)
- Update tox requirement from ~=4.9 to ~=4.10 (#879)
- Update pre-commit requirement from ~=3.3 to ~=3.4 (#884)
- Update black requirement from ~=23.7 to ~=23.9 (#886)
- Update tox requirement from ~=4.10 to ~=4.11 (#887)
Security
- Add docker image to the repo (#876)
Contributors
- @Fokko (#829, #782, #876)
- @Fokko,JCZuurmond (#824, #826)
- @alarocca-apixio (#690)
- @annazizian (#350)
- @etheleon (#865)
- @hanna-liashchuk (#387)
- @jurasan (#372)
dbt-spark v1.7.0rc1
dbt-spark 1.7.0-rc1 - October 12, 2023
Features
Contributors
dbt-spark v1.7.0b2
dbt-spark 1.7.0-b2 - October 02, 2023
Features
- Persist Column level comments when creating views (#372)
Under the Hood
- Remove dependency on hologram (#881)
Dependencies
- Replace sasl with pure-sasl for PyHive (#818)
- Update tox requirement from ~=4.8 to ~=4.9 (#874)
- Bump mypy from 1.5.0 to 1.5.1 (#875)
- Update tox requirement from ~=4.9 to ~=4.10 (#879)
- Update pre-commit requirement from ~=3.3 to ~=3.4 (#884)
- Update black requirement from ~=23.7 to ~=23.9 (#886)
- Update tox requirement from ~=4.10 to ~=4.11 (#887)
Security
- Add docker image to the repo (#876)
Contributors
dbt-spark v1.7.0b1
dbt-spark 1.7.0-b1 - August 17, 2023
Features
- Support server side parameters in thrift connection (#387)
- Support server_side_parameters for Spark session connection method (#690)
- Add server_side_parameters to HTTP connection method (#824)
- Enforce server side parameters keys and values to be strings (#826)
- Add SessionConnectionWrapper (#829)
Fixes
- Wrap AnalysisException into DbtRuntimeError (#782)
- include tblproperties macro in adapters.sql create table (#865)
Under the Hood
- Update stale workflow to use centralized version (#842)
Dependencies
- Update tox requirement from ~=3.0 to ~=4.5 (#741)
- Update pyodbc requirement from ~=4.0.30 to ~=4.0.39 (#742)
- Update pre-commit requirement from ~=2.21 to ~=3.3 (#748)
- Update types-requests requirement from ~=2.28 to ~=2.29 (#749)
- Bump mypy from 1.2.0 to 1.3.0 (#768)
- Update flake8 requirement from ~=6.0 to ~=6.1 (#849)
- Update types-requests requirement from ~=2.29 to ~=2.31 (#850)
- Update pytest-xdist requirement from ~=3.2 to ~=3.3 (#851)
- Update pytest requirement from ~=7.3 to ~=7.4 (#852)
- Update pip-tools requirement from ~=6.13 to ~=7.2 (#856)
- Update black requirement from ~=23.3 to ~=23.7 (#857)
- Update wheel requirement from ~=0.40 to ~=0.41 (#858)
- Update mock requirement from ~=5.0 to ~=5.1 (#859)
- Bump mypy from 1.3.0 to 1.4.1 (#860)
- Update tox requirement from ~=4.5 to ~=4.6 (#861)
- Update pip-tools requirement from ~=7.2 to ~=7.3 (#863)
- Update tox requirement from ~=4.6 to ~=4.7 (#867)
- Update tox requirement from ~=4.7 to ~=4.8 (#871)
- Bump mypy from 1.4.1 to 1.5.0 (#872)
Contributors
- @Fokko (#829, #782)
- @Fokko,JCZuurmond (#824, #826)
- @alarocca-apixio (#690)
- @etheleon (#865)
- @hanna-liashchuk (#387)
dbt-spark v1.5.2
dbt-spark 1.5.2 - August 04, 2023
dbt-spark v1.4.3
dbt-spark 1.4.3 - August 04, 2023
dbt-spark v1.3.3
dbt-spark 1.3.3 - August 04, 2023
dbt-spark v1.5.1
dbt-spark v1.6.0
dbt-spark 1.6.0 - July 31, 2023
Features
- Support insert_overwrite strategy with delta (#1013)
- All constraint types are supported, but not enforced. (#656, #657)
- Standardize the _connection_keys and debug_query for
dbt debug. (#PR754) - add dbt-spark portion of dbt_clone functionality (#815)
Fixes
- allow negative args for spark split part (#688)
- Fixed issue where table materialization was not always properly refreshing for non-admin users on Databricks (#725)
- Remove dead code 💀 (#758)
- Disallow untyped
def's (#760) - wrap expression for check constraints in parentheses (#7480)
- Allow hostname to be provided with or without trailing slash (#302)
- Remove dependent_projects argument from PartialProject call in unit tests (#7955)
Under the Hood
Dependencies
- Update black requirement from ~=23.1 to ~=23.3 (#701)
- Bump mypy from 1.1.1 to 1.2.0 (#708)
- Update pytest requirement from ~=7.2 to ~=7.3 (#726)
- Update types-pytz requirement from ~=2023.2 to ~=2023.3 (#704)
- Update pip-tools requirement from ~=6.12 to ~=6.13 (#737)
- Update pytz requirement from ~=2023.2 to ~=2023.3 (#702)
Dependency
- Bump pyodbc from 4.0.34 to 4.0.35 (#417)
Contributors
- @Fokko (#758, #760, #753)
- @dave-connors-3 (#688)
- @flvndh (#1013)
- @tim-steinkuhler (#302)
dbt-spark v1.6.0rc1
dbt-spark 1.6.0-rc1 - July 17, 2023
Features
- add dbt-spark portion of dbt_clone functionality (#815)
Fixes
- allow negative args for spark split part (#688)
- Disallow untyped
def's (#760) - Allow hostname to be provided with or without trailing slash (#302)
- Remove dependent_projects argument from PartialProject call in unit tests (#7955)