Skip to content

Commit

Permalink
Changes for dbtvault to AutomateDV rebrand
Browse files Browse the repository at this point in the history
  • Loading branch information
DVAlexHiggs committed May 14, 2023
2 parents 4ce2cfb + 6a20bba commit ff44c51
Show file tree
Hide file tree
Showing 101 changed files with 876 additions and 856 deletions.
2 changes: 1 addition & 1 deletion .github/ISSUE_TEMPLATE/bug_report.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,7 @@ A clear and concise description of what the bug is.
**Environment**

dbt version:
dbtvault version:
automate_dv version:
Database/Platform:

**To Reproduce**
Expand Down
2 changes: 2 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,4 @@

.idea/

invoke.yml
4 changes: 2 additions & 2 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ Please refer to our contribution guidelines over on our [development repository]

## We'd love to hear from you

dbtvault is very much a work in progress – we’re constantly adding quality of life improvements and will be adding
AutomateDV is very much a work in progress – we’re constantly adding quality of life improvements and will be adding
new table types regularly.

Rest assured we’re working on future releases – [our roadmap contains information on what’s coming](https://dbtvault.readthedocs.io/en/latest/roadmap/).
Expand All @@ -23,7 +23,7 @@ We've tested the package rigorously, but if you think you've found a bug please
at a minimum (or use the issue templates) so we can fix it as quickly as possible:

- The version of dbt being used
- The version of dbtvault being used.
- The version of automate_dv being used.
- Steps to reproduce the issue
- Any error messages or dbt log files which can give more detail of the problem

Expand Down
3 changes: 2 additions & 1 deletion NOTICE
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
dbtvault
AutomateDV
(f.k.a dbtvault)
Copyright 2019-2023 Business Thinking Ltd.

This software includes code created and developed by Business Thinking Ltd. trading as Datavault
26 changes: 13 additions & 13 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,23 +1,23 @@
<div align="center">
<img src="https://user-images.githubusercontent.com/25080503/65772647-89525700-e132-11e9-80ff-12ad30a25466.png" alt="dbtvault">
<img src="https://user-images.githubusercontent.com/25080503/237990810-ab2e14cf-a449-47ac-8c72-6f0857816194.png#gh-light-mode-only" alt="AutomateDV">
<img src="https://user-images.githubusercontent.com/25080503/237990915-6afbeba8-9e80-44cb-a57b-5b5966ab5c02.png#gh-dark-mode-only" alt="AutomateDV">

[![Documentation Status](https://img.shields.io/badge/docs-stable-blue)](https://dbtvault.readthedocs.io/en/stable/?badge=stable)
[![Documentation Status](https://img.shields.io/badge/docs-stable-blue)](https://automate-dv.readthedocs.io/en/stable/?badge=stable)
[![Slack](https://img.shields.io/badge/Slack-Join-yellow?style=flat&logo=slack)](https://join.slack.com/t/dbtvault/shared_invite/enQtODY5MTY3OTIyMzg2LWJlZDMyNzM4YzAzYjgzYTY0MTMzNTNjN2EyZDRjOTljYjY0NDYyYzEwMTlhODMzNGY3MmU2ODNhYWUxYmM2NjA)
</div>
<div align="center">

[![dbt Versions](https://img.shields.io/badge/compatible%20dbt%20versions-%3E=1.3%20%3C=1.4.x-orange?logo=dbt)](https://dbtvault.readthedocs.io/en/latest/versions/)
[![dbt Versions](https://img.shields.io/badge/compatible%20dbt%20versions-%3E=1.3%20%3C=1.4.x-orange?logo=dbt)](https://automate-dv.readthedocs.io/en/latest/versions/)

</div>

[Changelog and past doc versions](https://automate-dv.readthedocs.io/en/latest/changelog/)

[Changelog and past doc versions](https://dbtvault.readthedocs.io/en/latest/changelog/stable)
# AutomateDV by [Datavault](https://www.data-vault.co.uk)

# dbtvault by [Datavault](https://www.data-vault.co.uk)
Build your own Data Vault data warehouse! AutomateDV is a free to use dbt package that generates & executes the ETL you need to run a Data Vault 2.0 Data Warehouse on your data platform.

Build your own Data Vault data warehouse! dbtvault is a free to use dbt package that generates & executes the ETL you need to run a Data Vault 2.0 Data Warehouse on your data platform.

What does dbtvault offer?
What does AutomateDV offer?
- productivity gains, fewer errors
- multi-threaded execution of the generated SQL
- your data modeller can generate most of the ETL code directly from their mapping metadata
Expand All @@ -30,13 +30,13 @@ powered by [dbt](https://www.getdbt.com/), a registered trademark of [dbt Labs](

Learn quickly with our worked example:

- [Read the docs](https://dbtvault.readthedocs.io/en/latest/worked_example/we_worked_example/)
- [Read the docs](https://automate-dv.readthedocs.io/en/latest/worked_example/we_worked_example/)

- [Project Repository](https://github.com/Datavault-UK/snowflakeDemo)

## Supported platforms:

[Platform support matrix](https://dbtvault.readthedocs.io/en/latest/macros/#platform-support)
[Platform support matrix](https://automate-dv.readthedocs.io/en/latest/macros/#platform-support)

## Installation

Expand All @@ -58,13 +58,13 @@ or [read the docs](https://docs.getdbt.com/docs/building-a-dbt-project/package-m
...

# Call the macro
{{ dbtvault.hub(src_pk, src_nk, src_ldts,
src_source, source_model) }}
{{ automate_dv.hub(src_pk, src_nk, src_ldts,
src_source, source_model) }}
```

## Join our Slack Channel

Talk to our developers and other members of our growing community, get support and discuss anything related to dbtvault or Data Vault 2.0
Talk to our developers and other members of our growing community, get support and discuss anything related to AutomateDV or Data Vault 2.0

[![Join our Slack](https://img.shields.io/badge/Slack-Join-yellow?style=flat&logo=slack)](https://join.slack.com/t/dbtvault/shared_invite/enQtODY5MTY3OTIyMzg2LWJlZDMyNzM4YzAzYjgzYTY0MTMzNTNjN2EyZDRjOTljYjY0NDYyYzEwMTlhODMzNGY3MmU2ODNhYWUxYmM2NjA)

Expand Down
2 changes: 1 addition & 1 deletion dbt_project.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: dbtvault
name: automate_dv
version: 0.9.5
require-dbt-version: [">=1.0.0", "<2.0.0"]
config-version: 2
Expand Down
4 changes: 2 additions & 2 deletions macros/internal/helpers/dateadd.sql
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{% macro dateadd(datepart, interval, from_date_or_timestamp) %}
{{ return(adapter.dispatch('dateadd', 'dbtvault')(datepart=datepart,
{{ return(adapter.dispatch('dateadd', 'automate_dv')(datepart=datepart,
interval=interval,
from_date_or_timestamp=from_date_or_timestamp)) }}
{%- endmacro -%}
Expand Down
6 changes: 3 additions & 3 deletions macros/internal/helpers/is_checks.sql
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{%- macro is_list(obj, empty_is_false=false) -%}
Expand All @@ -21,7 +21,7 @@

{%- macro is_nothing(obj) -%}

{%- if obj is none or obj is undefined or not obj or dbtvault.is_list(obj, empty_is_false=true) -%}
{%- if obj is none or obj is undefined or not obj or automate_dv.is_list(obj, empty_is_false=true) -%}
{%- do return(true) -%}
{%- else -%}
{%- do return(false) -%}
Expand All @@ -35,7 +35,7 @@

{%- if obj is not none and obj is defined and obj -%}
{#- if an empty list, do not consider the object something -#}
{% if dbtvault.is_list(empty_is_false=true) %}
{% if automate_dv.is_list(empty_is_false=true) %}
{%- do return(true) -%}
{%- else -%}
{%- do return(false) -%}
Expand Down
4 changes: 2 additions & 2 deletions macros/internal/helpers/logging/log_relation_sources.sql
Original file line number Diff line number Diff line change
@@ -1,10 +1,10 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{% macro log_relation_sources(relation, source_count) %}
{{ return(adapter.dispatch('log_relation_sources', 'dbtvault')(relation=relation, source_count=source_count)) }}
{{ return(adapter.dispatch('log_relation_sources', 'automate_dv')(relation=relation, source_count=source_count)) }}
{%- endmacro -%}

{% macro default__log_relation_sources(relation, source_count) %}
Expand Down
4 changes: 2 additions & 2 deletions macros/internal/helpers/prepend_generated_by.sql
Original file line number Diff line number Diff line change
@@ -1,8 +1,8 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{%- macro prepend_generated_by() -%}
-- Generated by dbtvault.
-- Generated by AutomateDV (formerly known as dbtvault)
{%- endmacro -%}
Original file line number Diff line number Diff line change
@@ -1,8 +1,10 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

AutomateDV (f.k.a automate_dv)

{%- macro extract_column_names(columns_dict=none) -%}

{%- set extracted_column_names = [] -%}
Expand Down
Original file line number Diff line number Diff line change
@@ -1,16 +1,18 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

AutomateDV (f.k.a automate_dv)

{%- macro extract_null_column_names(columns_dict=none) -%}

{%- set extracted_column_names = [] -%}

{%- if columns_dict is mapping -%}
{%- for key, value in columns_dict.items() -%}
{%- if dbtvault.is_something(value) -%}
{% if dbtvault.is_list(value) %}
{%- if automate_dv.is_something(value) -%}
{% if automate_dv.is_list(value) %}
{% for col_name in value %}
{%- do extracted_column_names.append(col_name) -%}
{%- do extracted_column_names.append(col_name ~ "_ORIGINAL") -%}
Expand Down
Original file line number Diff line number Diff line change
@@ -1,13 +1,15 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

AutomateDV (f.k.a automate_dv)

{%- macro print_list(list_to_print=none, indent=4, columns_to_escape=none) -%}

{%- for col_name in list_to_print -%}
{%- if col_name | lower in columns_to_escape | map('lower') | list -%}
{{- dbtvault.escape_column_name(col_name) | indent(indent) -}}{{ ",\n " if not loop.last }}
{{- automate_dv.escape_column_name(col_name) | indent(indent) -}}{{ ",\n " if not loop.last }}
{%- else -%}
{{- col_name | indent(indent) -}}{{ ",\n " if not loop.last }}
{%- endif -%}
Expand Down
Original file line number Diff line number Diff line change
@@ -1,22 +1,24 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

AutomateDV (f.k.a automate_dv)

{%- macro process_columns_to_escape(derived_columns_list=none) -%}

{%- if derived_columns_list -%}

{%- set ns = namespace(columns_to_escape=[]) -%}
{%- set escape_char_left, escape_char_right = dbtvault.get_escape_characters() -%}
{%- set escape_char_left, escape_char_right = automate_dv.get_escape_characters() -%}
{%- set quote_pattern = '\{}([a-zA-Z\s]+)\{}'.format(escape_char_left, escape_char_right) -%}
{%- set re = modules.re -%}

{%- for col_name, col_def in derived_columns_list.items() -%}

{%- if col_def is mapping -%}
{%- if col_def['escape'] == true -%}
{%- if dbtvault.is_list(col_def['source_column']) -%}
{%- if automate_dv.is_list(col_def['source_column']) -%}
{%- set ns.columns_to_escape = ns.columns_to_escape + col_def['source_column'] -%}
{%- else -%}
{%- set ns.columns_to_escape = ns.columns_to_escape + [col_def['source_column']] -%}
Expand Down
Original file line number Diff line number Diff line change
@@ -1,22 +1,24 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

AutomateDV (f.k.a automate_dv)

{%- macro process_columns_to_select(columns_list=none, exclude_columns_list=none) -%}

{% set columns_list = columns_list | list %}
{% set exclude_columns_list = exclude_columns_list | list %}

{% set columns_to_select = [] %}

{% if not dbtvault.is_list(columns_list) or not dbtvault.is_list(exclude_columns_list) %}
{% if not automate_dv.is_list(columns_list) or not automate_dv.is_list(exclude_columns_list) %}

{{- exceptions.raise_compiler_error("One or both arguments are not of list type.") -}}

{%- endif -%}

{%- if dbtvault.is_something(columns_list) and dbtvault.is_something(exclude_columns_list) -%}
{%- if automate_dv.is_something(columns_list) and automate_dv.is_something(exclude_columns_list) -%}

{%- for col in columns_list -%}

Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,10 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

AutomateDV (f.k.a automate_dv)

{%- macro process_hash_column_excludes(hash_columns=none, source_columns=none) -%}

{%- set processed_hash_columns = {} -%}
Expand All @@ -14,7 +16,7 @@

{%- if col_mapping.columns -%}

{%- set columns_to_hash = dbtvault.process_columns_to_select(source_columns, col_mapping.columns) -%}
{%- set columns_to_hash = automate_dv.process_columns_to_select(source_columns, col_mapping.columns) -%}

{%- do hash_columns[col].pop('exclude_columns') -%}
{%- do hash_columns[col].update({'columns': columns_to_hash}) -%}
Expand Down
6 changes: 3 additions & 3 deletions macros/internal/metadata_processing/alias.sql
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{%- macro alias(alias_config=none, prefix=none) -%}

{{- adapter.dispatch('alias', 'dbtvault')(alias_config=alias_config, prefix=prefix) -}}
{{- adapter.dispatch('alias', 'automate_dv')(alias_config=alias_config, prefix=prefix) -}}

{%- endmacro %}

Expand All @@ -29,7 +29,7 @@

{%- if prefix -%}

{{- dbtvault.prefix([alias_config], prefix) -}}
{{- automate_dv.prefix([alias_config], prefix) -}}

{%- else -%}

Expand Down
10 changes: 5 additions & 5 deletions macros/internal/metadata_processing/alias_all.sql
Original file line number Diff line number Diff line change
@@ -1,24 +1,24 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{%- macro alias_all(columns=none, prefix=none) -%}

{{- adapter.dispatch('alias_all', 'dbtvault')(columns=columns, prefix=prefix) -}}
{{- adapter.dispatch('alias_all', 'automate_dv')(columns=columns, prefix=prefix) -}}

{%- endmacro %}

{%- macro default__alias_all(columns, prefix) -%}

{%- if dbtvault.is_list(columns) -%}
{%- if automate_dv.is_list(columns) -%}

{%- set processed_columns = [] -%}

{%- for col in columns -%}
{%- if col | lower not in processed_columns | map('lower') | list -%}

{{ dbtvault.alias(alias_config=col, prefix=prefix) }}
{{ automate_dv.alias(alias_config=col, prefix=prefix) }}
{%- if not loop.last -%} , {% endif -%}

{%- if col is mapping -%}
Expand All @@ -33,7 +33,7 @@

{%- elif columns is string -%}

{{ dbtvault.alias(alias_config=columns, prefix=prefix) }}
{{ automate_dv.alias(alias_config=columns, prefix=prefix) }}

{%- else -%}

Expand Down
4 changes: 2 additions & 2 deletions macros/internal/metadata_processing/as_constant.sql
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{%- macro as_constant(column_str=none) -%}

{{- adapter.dispatch('as_constant', 'dbtvault')(column_str=column_str) -}}
{{- adapter.dispatch('as_constant', 'automate_dv')(column_str=column_str) -}}

{%- endmacro %}

Expand Down
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
/*
* Copyright (c) Business Thinking Ltd. 2019-2023
* This software includes code developed by the dbtvault Team at Business Thinking Ltd. Trading as Datavault
* This software includes code developed by the AutomateDV (f.k.a dbtvault) Team at Business Thinking Ltd. Trading as Datavault
*/

{%- macro check_required_parameters() -%}
Expand Down
Loading

0 comments on commit ff44c51

Please sign in to comment.