Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow file format change for Glue adapter #1711

Open
Jeremynadal33 opened this issue Oct 1, 2024 · 1 comment
Open

Allow file format change for Glue adapter #1711

Jeremynadal33 opened this issue Oct 1, 2024 · 1 comment

Comments

@Jeremynadal33
Copy link

Jeremynadal33 commented Oct 1, 2024

Is your feature request related to a problem? Please describe.
This is to complete issue #177 . I added PRs dbt-data-reliability and elementary for allowing Glue adapter with Delta file format. It then requires a configuration that allow Delta tables from the Glue session. We should add the possibility to use other file formats.

Describe the solution you'd like
I think we should add a macro that allow a new configuration to be passed to choose the file format with a verification that the file format allows incremental loads.

Describe alternatives you've considered
N/A

Additional context
Not sure if that is relevant or possible but I feel like we should check if the Glue session is able to use the file format.

Would you be willing to contribute this feature?
I would like to but I don't have time for now...

@haritamar
Copy link
Collaborator

Hi @Jeremynadal33 !
Thanks a lot for your contribution of the Glue adapter, and for this issue.
Will look at the contribution when I can, in any case makes sense this is a separate issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants