Skip to content

Releases: datafusion-contrib/datafusion-table-providers

v0.2.3

23 Oct 03:09
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v0.2.2...v0.2.3

v0.2.2

11 Oct 18:24
Compare
Choose a tag to compare

What's Changed

  • use datafusion plan_to_sql function instead of expr_to_sql by @hozan23 in #106

Full Changelog: v0.2.1...v0.2.2

v0.2.1

11 Oct 15:58
Compare
Choose a tag to compare

What's Changed

Full Changelog: v0.2.0...v0.2.1

v0.2.0

10 Oct 07:14
Compare
Choose a tag to compare

What's Changed

  • Initial TableProviders for DuckDB, PostgreSQL, Sqlite and MySQL by @phillipleblanc in #2
  • Allow consumers to distinguish retriable errors on write by @phillipleblanc in #3
  • Downgrade url crate to 2.5.1 for compatibility by @phillipleblanc in #4
  • Make connect() and postgres_conn() public by @phillipleblanc in #5
  • Streaming write for DuckDB TableProvider by @sgrebnov in #6
  • Mysql streaming by @y-f-u in #7
  • Fix MySQL build and add basic CI checks by @phillipleblanc in #8
  • Refine postgres data connector get_schema method by @Sevenannn in #10
  • Upgrade to DataFusion 40 by @phillipleblanc in #11
  • Upgrade to DuckDB version 1 by @phillipleblanc in #12
  • update spiceai datafusion-federation sha by @y-f-u in #14
  • Use datafusion postgres dialect for postgres table provider by @Sevenannn in #15
  • Simplify connection parameters for MySQL & Postgres tables by @phillipleblanc in #16
  • Add LIKE expr support for Postgres, DuckDB and SQLite by @sgrebnov in #17
  • Add support for Decimal128 literals by @sgrebnov in #19
  • Fix Date32 and Date64 literals unparsing for SQLite by @sgrebnov in #20
  • Fix schema extraction for MySql tables by @sgrebnov in #21
  • Add InList and ScalarFunction expr support by @sgrebnov in #23
  • More types support for MySQL schema extraction by @sgrebnov in #22
  • feat: Stream SQLite writes by @peasee in #24
  • feat: Use SQLite WAL transaction mode by @peasee in #25
  • Fix plan unparsing for filters with subqueries involved type coercion by @sgrebnov in #26
  • fix: Reuse write pool for in-memory SQLite by @peasee in #27
  • Improve MySQL auth error message by @sgrebnov in #29
  • Support mysql BINARY, VARBINARY and Postgres Type::BYTEA by @Sevenannn in #28
  • Postgres Type::TIME support by @Sevenannn in #30
  • allow db path params for sqlite table factory by @y-f-u in #31
  • Proper cast for arrow binary, largebinary, varbinary types by @Sevenannn in #32
  • feat: Add database base path for SQLite files by @peasee in #33
  • Fix the wrong conversion of arrow date 64 by @Sevenannn in #36
  • Add connection pool size parameter for Postgres by @phillipleblanc in #37
  • Support Json type in postgres row -> arrow conversion by @Sevenannn in #40
  • Integration test for arrow record batch <-> postgres row round trip conversion by @Sevenannn in #38
  • Upgrade to DataFusion 41 by @phillipleblanc in #43
  • Arrow time32 time64 types precision support by @Sevenannn in #35
  • Support interval type in arrow and postgres by @Sevenannn in #39
  • feat: Add support for ATTACHing SQLite databases together by @peasee in #42
  • test: Add SQLite-Arrow roundtrip integration test by @peasee in #45
  • federated read provider in write table provider by @y-f-u in #44
  • Support arrow fixed size list and large list in arrow -> row conversion by @Sevenannn in #46
  • expose read provider from the write provider (postgres, sqlite) by @y-f-u in #47
  • Support decimal 256 in building insert table statement by @Sevenannn in #48
  • Support Money Type in Postgres -> Arrow Conversion by @Sevenannn in #50
  • Support postgres point type in pg row -> arrow conversion by @Sevenannn in #49
  • refactor: Change db_path_param to file by @peasee in #51
  • fix: Don't attach empty SQLite attachments by @peasee in #52
  • Properly support decimal types in mysql row -> arrow conversion by @Sevenannn in #53
  • Fix postgres test structure by @phillipleblanc in #55
  • add postgres dialect in write provider by @y-f-u in #57
  • add integration test for duckdb, starts with arrow type roundtrip by @y-f-u in #60
  • feat: Add support for DuckDB ATTACH databases together by @peasee in #58
  • Enable arrow time types in arrow - pg row round trip integration test by @Sevenannn in #56
  • feat: support postgres geometry & BYTEA_ARRAY by @xhwhis in #54
  • feat: Add DuckDB data directory by @peasee in #61
  • Use GHCR for postgres/mysql images by @phillipleblanc in #62
  • feat: Compute DuckDB JoinPushDown compute context for cross-db actions by @peasee in #63
  • Add support for arrow <-> pg/sqlite row conversion for Duration type by @Sevenannn in #64
  • Preserve timezone information in arrow type - pg type conversion by @Sevenannn in #59
  • Support arrow time32 & time64 correctly by @Sevenannn in #65
  • Custom decimal test case for sqlite by @Sevenannn in #69
  • Add support for writing Lists/Arrays to SQLite via JSON conversion by @sgrebnov in #67
  • Bump datafusion-federation version by @phillipleblanc in #66
  • fix: Use SQLite dialect for SQLite by @peasee in #71
  • Add Structs support for SQLite by @sgrebnov in #70
  • fix: Use feature flag to disable DuckDB and SQLite federation by @peasee in #74
  • Bump datafusion-federation version by @sgrebnov in #73
  • fix: CHECKPOINT DuckDB after finishing writing by @peasee in #72
  • Arrow interval casting support given original arrow schema by @Sevenannn in #68
  • Don't open the DuckDB file twice by @phillipleblanc in #75
  • Table provider factory for Arrow Flight and Flight SQL by @ccciudatu in #76
  • [cosmetic] doctest formatting by @ccciudatu in #78
  • Correctly covert time...
Read more