arrow::compute::concat
should merge dictionary type when concatenating list of dictionaries
#6888
Labels
enhancement
Any new improvement worthy of a entry in the changelog
Describe the bug
When concatenating lists of dictionary, the new dictionary type contains duplicate
To Reproduce
Expected behavior
when concatenating lists of dictionary, it should merge the dictionary rather than blindly concat them as well
Additional context
this happened to me when creating aggregate expression in DataFusion which calls
ScalarValue::iter_to_array(results);
which use concat underneathAccording to the spec duplicate values are valid:
The text was updated successfully, but these errors were encountered: