Replies: 1 comment
-
|
We won't support fsspec filesystems since we use object store. You can create a custom object store which does caching and make a PR to add this store that can be enabled with a storage option |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Description
Make Python filesystem spec (fsspec) optional available in delta-rs.
Use Case
One could easily cache metadata files/delta log using fsspecs
SimpleCacheFileSystemwith s3fs, gcsfs or adlfs. This might improve read performance.Beta Was this translation helpful? Give feedback.
All reactions