dbt-spark 1.0.1rc1

dbt-spark 1.0.1rc1 (April 6, 2022)

Fixes

• Closes the connection properly (#280, #285)
• Make internal macros use macro dispatch to be overridable in child adapters (#319, #320)

Under the hood

• Configure insert_overwrite models to use parquet (#301)

Contributors

• @ueshin (#285, #320)

dbt-spark 1.1.0b1

dbt-spark 1.1.0b1 (March 23, 2022)

Features

• Adds new integration test to check against new ability to allow unique_key to be a list. (#282), #291)

Fixes

• Closes the connection properly (#280, #285)

Under the hood

• get_response -> AdapterResponse (#265)
• Adding stale Actions workflow (#275)
• Update plugin author name (fishtown-analytics → dbt-labs) in ODBC user agent (#288)
• Configure insert_overwrite models to use parquet (#301)

Contributors

• @amychen1776 (#288)
• @ueshin (#285)

dbt-spark v1.0.0

Tracking dbt-core v1.0.0.

$ pip install dbt-spark==1.0.0
# or
$ pip install "dbt-spark[ODBC]==1.0.0"
# or
$ pip install "dbt-spark[PyHive]==1.0.0"

dbt-spark v0.21.1

Tracking dbt-core v0.21.1.

$ pip install dbt-spark==0.21.1
# or
$ pip install "dbt-spark[ODBC]==0.21.1"
# or
$ pip install "dbt-spark[PyHive]==0.21.1"

dbt-spark v1.0.0rc2

A second release candidate of dbt-spark v1.0.0. Changes since rc1:

Features

• Add support for Apache Hudi (hudi file format) which supports incremental merge strategies (#187, #210)

Under the hood

• Refactor seed macros: remove duplicated code from dbt-core, and provide clearer logging of SQL parameters that differ by connection method (#249, #250)
• Replace sample_profiles.yml with profile_template.yml, for use with new dbt init (#247)

Contributors

• @vingov (#210)

dbt-spark v0.21.1rc2

Tracking dbt-core v0.21.1rc2.

$ pip install dbt-spark==0.21.1rc2
# or
$ pip install "dbt-spark[ODBC]==0.21.1rc2"
# or
$ pip install "dbt-spark[PyHive]==0.21.1rc2"

dbt-spark v1.0.0rc1

Tracking dbt-core v1.0.0rc1.

$ pip install "dbt-spark[all]==1.0.0rc1"
# or
$ pip install "dbt-spark[ODBC]==1.0.0rc1"
# or
$ pip install "dbt-spark[PyHive]==1.0.0rc1"

Under the hood

• Remove official support for python 3.6, which is reaching end of life on December 23, 2021 (dbt-core#4134, #253)
• Add support for structured logging (#251)

dbt-spark v0.21.1rc1

Tracking dbt-core v0.21.1rc1.

$ pip install dbt-spark==0.21.1rc1
# or
$ pip install "dbt-spark[ODBC]==0.21.1rc1"
# or
$ pip install "dbt-spark[PyHive]==0.21.1rc1"

dbt-spark v0.21.0

Tracking dbt-core v0.21.0.

$ pip install dbt-spark==0.21.0
# or
$ pip install "dbt-spark[ODBC]==0.21.0"
# or
$ pip install "dbt-spark[PyHive]==0.21.0"

dbt-spark v0.21.0rc2

Tracking dbt-core v0.21.0rc2.

$ pip install dbt-spark==0.21.0rc2
# or
$ pip install "dbt-spark[ODBC]==0.21.0rc2"
# or
$ pip install "dbt-spark[PyHive]==0.21.0rc2"