CHANGELOG.md

Changelog

32.0.0 (2023-01-27)

Full Changelog

Breaking changes:

• Allow StringArray construction with Vec<Option<String>> #3602 [arrow] (sinistersnare)
• Use native types in PageIndex (#3575) #3578 [parquet] (tustvold)
• Add external variant to ParquetError (#3285) #3574 [parquet] (tustvold)
• Return reference from ListArray::values #3561 [arrow] (tustvold)
• feat: Add RunEndEncodedArray #3553 [parquet] [arrow] (askoa)

Implemented enhancements:

• There should be a From<Vec<Option<String>>> impl for GenericStringArray<OffsetSize> #3599 [arrow]
• FlightDataEncoder Optionally send Schema even when no record batches #3591 [arrow-flight]
• Use Native Types in PageIndex #3575 [parquet]
• Packing array into dictionary of generic byte array #3571 [arrow]
• Implement Error::Source for ArrowError and FlightError #3566 [arrow] [arrow-flight]
• [FlightSQL] Allow access to underlying FlightClient #3551 [arrow-flight]
• Arrow CSV writer should not fail when cannot cast the value #3547 [arrow]
• Write Deprecated Min Max Statistics When ColumnOrder Signed #3526 [parquet]
• Improve Performance of JSON Reader #3441
• Support footer kv metadata for IPC file #3432
• Add External variant to ParquetError #3285 [parquet]

Fixed bugs:

• Nullif of NULL Predicate is not NULL #3589
• BooleanBufferBuilder Fails to Clear Set Bits On Truncate #3587 [arrow]
• nullif incorrectly calculates null_count, sometimes panics with substraction overflow error #3579 [arrow]
• Meet warning when use pyarrow #3543 [arrow]
• Incorrect row group total_byte_size written to parquet file #3530 [parquet]
• Overflow when casting timestamps prior to the epoch #3512 [arrow]

Closed issues:

• Panic on Key Overflow in Dictionary Builders #3562 [parquet] [arrow]
• Bumping version gives compilation error (arrow-array) #3525

Merged pull requests:

• Add Push-Based CSV Decoder #3604 [arrow] (tustvold)
• Update to flatbuffers 23.1.21 #3597 [arrow] (tustvold)
• Faster BooleanBufferBuilder::append_n for true values #3596 [arrow] (tustvold)
• Support sending schemas for empty streams #3594 [arrow-flight] (alamb)
• Faster ListArray to StringArray conversion #3593 [arrow] (tustvold)
• Add conversion from StringArray to BinaryArray #3592 [arrow] (tustvold)
• Fix nullif null count (#3579) #3590 [arrow] (tustvold)
• Clear bits in BooleanBufferBuilder (#3587) #3588 [arrow] (tustvold)
• Iterate all dictionary key types in cast test #3585 [arrow] (viirya)
• Propagate EOF Error from AsyncRead #3576 [parquet] (Sach1nAgarwal)
• Show row_counts also for (FixedLen)ByteArray #3573 [parquet] (bmmeijers)
• Packing array into dictionary of generic byte array #3572 [arrow] (viirya)
• Remove unwrap on datetime cast for CSV writer #3570 [arrow] (comphead)
• Implement std::error::Error::source for ArrowError and FlightError #3567 [arrow] [arrow-flight] (alamb)
• Improve GenericBytesBuilder offset overflow panic message (#139) #3564 [arrow] (tustvold)
• Implement Extend for ArrayBuilder (#1841) #3563 [arrow] (tustvold)
• Update pyarrow method call with kwargs #3560 [arrow] (Frankonly)
• Update pyo3 requirement from 0.17 to 0.18 #3557 [arrow] (viirya)
• Expose Inner FlightServiceClient on FlightSqlServiceClient (#3551) #3556 [arrow-flight] (tustvold)
• Fix final page row count in parquet-index binary #3554 [parquet] (tustvold)
• Parquet Avoid Reading 8 Byte Footer Twice from AsyncRead #3550 [parquet] (Sach1nAgarwal)
• Improve concat kernel capacity estimation #3546 [arrow] (tustvold)
• Update proc-macro2 requirement from =1.0.49 to =1.0.50 #3545 [arrow-flight] (dependabot[bot])
• Update pyarrow method call to avoid warning #3544 [arrow] (Frankonly)
• Enable casting between Utf8/LargeUtf8 and Binary/LargeBinary #3542 [arrow] (viirya)
• Use GHA concurrency groups (#3495) #3538 (tustvold)
• set sum of uncompressed column size as row group size for parquet files #3531 [parquet] (sidred)
• Minor: Add documentation about memory use for ArrayData #3529 [arrow] (alamb)
• Upgrade to clap 4.1 + fix test #3528 [parquet] (tustvold)
• Write backwards compatible row group statistics (#3526) #3527 [parquet] (tustvold)
• No panic on timestamp buffer overflow #3519 [arrow] (comphead)
• Support casting from binary to dictionary of binary #3482 [arrow] (viirya)
• Add Raw JSON Reader (~2.5x faster) #3479 [arrow] (tustvold)

* This Changelog was automatically generated by github_changelog_generator