Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP(iox-10893): patched df upgrade 2024-06-26 #30

Closed
wants to merge 5 commits into from

Conversation

appletreeisyellow
Copy link

@appletreeisyellow appletreeisyellow commented Jun 26, 2024

⚠️ This will not be merged. ⚠️

  1. Bringing us up to datafusion to 2024-06-26, apache@2d1e850

  2. This PR is based on 2024-06-22 apache@ea46e82

    git co -b chunchun/update-df-june-week-4 ea46e82088ceb27f85de5a994495649ef0bd4747
    
  3. Cherry-picked the following commits:

    1. Support dictionary data type in array_to_string apache/datafusion#10908 / apache@8d8dd90

      commit 8d8dd9075d4fb54c0d3467916bb66459d7a26b2f
      Author: Eduardo Vega <edvegavalerio@gmail.com>
      Date:   Sun Jun 23 04:14:40 2024 -0600
      
          Support dictionary data type in array_to_string (#10908)
    2. Update ListingTable to use StatisticsConverter apache/datafusion#11068 / apache@459afbb

      commit 459afbb3a180d31e7cdefffb46f033069aa47408
      Author: Xin Li <33629085+xinlifoobar@users.noreply.github.com>
      Date:   Tue Jun 25 05:45:14 2024 +0800
      
          Update ListingTable to use StatisticsConverter (#11068)

EduardoVega and others added 2 commits June 26, 2024 14:41
* Support dictionary data type in array_to_string

* Fix import

* Some tests

* Update datafusion/functions-array/src/string.rs

Co-authored-by: Alex Huang <huangweijun1001@gmail.com>

* Add some tests showing incorrect results

* Get logical array

* apply rust fmt

* Simplify implementation, avoid panics

---------

Co-authored-by: Alex Huang <huangweijun1001@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
* Update ListingTable to use StatisticsConverter

* complete support for all types parquet

* Fix misc

* Fix misc

* fix test

* fix misc

* fix none
@appletreeisyellow appletreeisyellow changed the title WIP(iox-10893): patched df upgrade 202-06-TBD WIP(iox-10893): patched df upgrade 202-06-26 Jun 27, 2024
@appletreeisyellow appletreeisyellow changed the title WIP(iox-10893): patched df upgrade 202-06-26 WIP(iox-10893): patched df upgrade 2024-06-26 Jul 11, 2024
@appletreeisyellow
Copy link
Author

Closing since the upgrade is done

@appletreeisyellow appletreeisyellow deleted the chunchun/update-df-june-week-4 branch July 12, 2024 20:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants