Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support reading/writing add and remove action tags field #3108

Open
b-phi opened this issue Jan 8, 2025 · 2 comments
Open

Support reading/writing add and remove action tags field #3108

b-phi opened this issue Jan 8, 2025 · 2 comments
Labels
enhancement New feature or request

Comments

@b-phi
Copy link

b-phi commented Jan 8, 2025

Description

The written log files contain the tags field for add and remove operations, but the value is always null. Although some of the Python-Rust API allows providing a PyAddAction struct, it also doesn't include tags which is set to none when converting to an Add object. Ideally when writing data from Python I could provide a tags value and read this information back with DeltaTable.get_add_actions.

@b-phi b-phi added the enhancement New feature or request label Jan 8, 2025
@b-phi
Copy link
Author

b-phi commented Jan 8, 2025

It seems like all references to tags close to Python are related to the soon-to-be-deprecated arrow writer. To support in the rust writer, we'd need to propagate the info all the way down to create_add.

@thorfour
Copy link

I am also looking to be able to set custom tags and read them back. Would be nice to have this ability.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants