Code

POC: Add ParquetMetaDataReader#6392

Code

Closed

etseidl wants to merge 27 commits intoapache:masterapache/arrow-rs:masterfrom etseidl:metadata_readeretseidl/arrow-rs:metadata_readerCopy head branch name to clipboard

+1,009-102

Commits

Commits on Sep 12, 2024

• add ParquetMetaDataReader

  etseidl

  committed
  0c5087f

• add todo

  etseidl

  committed
  d5b60ab

• add more todos

  etseidl

  committed
  d462fda

• take a stab at reading metadata without file size provided

  etseidl

  committed
  6b9dd1c

Commits on Sep 13, 2024

• temporarily comment out MetadataLoader

  etseidl

  committed
  0a2c4b2

• remove debug print

  etseidl

  committed
  58f2463

• clippy

  etseidl

  committed
  08b985a

Commits on Sep 16, 2024

• Merge remote-tracking branch 'origin/master' into metadata_reader

  etseidl

  committed
  96062e1

• add more todos

  etseidl

  committed
  cdf6ac5

• uncomment MetadataLoader

  etseidl

  committed
  25e23d7

• silence doc warnings

  etseidl

  committed
  03bc663

Commits on Sep 17, 2024

• fix size check

  etseidl

  committed
  51a5a72

• add try_parse_range

  etseidl

  committed
  8a3f496

• start on documentation

  etseidl

  committed
  f8450e2

• make sure docs compile

  etseidl

  committed
  180e3e6

• attempt recovery in test

  etseidl

  committed
  9d1147d

Commits on Sep 18, 2024

• implement some suggestions from review

  etseidl

  committed
  1a1d3aa

• remove suffix reading for now

  etseidl

  committed
  d450ab8

• add new error types to aid recovery

  etseidl

  committed
  3c340b7

Commits on Sep 19, 2024

• remove parquet_metadata_from_file and add ParquetMetaDataReader::parse

  etseidl

  committed
  0d13599

• remove todo

  etseidl

  committed
  d300cf3

• point to with_prefetch_hint from try_load docstring

  etseidl

  committed
  4ee162f

• refactor the retry logic

  Show description for 2d65c3f
  etseidl

  committed
  2d65c3f

• Merge remote-tracking branch 'origin/master' into metadata_reader

  etseidl

  committed
  2a2cf81

• add some more tests

  etseidl

  committed
  faff575

Commits on Sep 20, 2024

• add load() and bring over tests from async_reader/metadata.rs

  etseidl

  committed
  c9e5ea6

• only run new tests if async is enabled

  etseidl

  committed
  4214909