Code

Parquet Modular Encryption support#6637

Code

Draft

rok wants to merge 28 commits intoapache:mainapache/arrow-rs:mainfrom rok:decryption-basics-forkrok/arrow-rs:decryption-basics-forkCopy head branch name to clipboard

+1,298-82

Commits

Commits on Jan 9, 2025

• first commit

  

  ggershinsky

  authored and

  rok

  committed
  5a65c1b

  Copy full SHA for 5a65c1b

• Use ParquetMetaDataReader

  rok

  committed
  50baaa1

  Copy full SHA for 50baaa1

• Fix CI

  rok

  committed
  a0546a7

  Copy full SHA for a0546a7

• test

  rok

  committed
  0a69f45

  Copy full SHA for 0a69f45

• save progress

  rok

  committed
  18f479c

  Copy full SHA for 18f479c

• work

  rok

  committed
  412e306

  Copy full SHA for 412e306

• Review feedback

  rok

  committed
  92b47c5

  Copy full SHA for 92b47c5

• page decompression issue

  rok

  committed
  173f2f2

  Copy full SHA for 173f2f2

• add update_aad

  rok

  committed
  f7ec53b

  Copy full SHA for f7ec53b

• Change encrypt and decrypt to return Results

  

  adamreeve

  authored and

  rok

  committed
  6fe4dec

  Copy full SHA for 6fe4dec

• Use correct page ordinal and module type in AADs

  

  adamreeve

  authored and

  rok

  committed
  648219e

  Copy full SHA for 648219e

• Tidy up ordinal types

  

  adamreeve

  authored and

  rok

  committed
  b360ba1

  Copy full SHA for b360ba1

• Lint

  rok

  committed
  c62bbb1

  Copy full SHA for c62bbb1

• Fix regular deserialization path

  rok

  committed
  e62767f

  Copy full SHA for e62767f

• cleaning

  rok

  committed
  7cc0836

  Copy full SHA for 7cc0836

• Update data checks in test

  

  adamreeve

  authored and

  rok

  committed
  bb2ab75

  Copy full SHA for bb2ab75

• start non-uniform decryption

  rok

  committed
  6019a4d

  Copy full SHA for 6019a4d

• Add missing doc comments

  

  adamreeve

  authored and

  rok

  committed
  95ddeb3

  Copy full SHA for 95ddeb3

• Make encryption an optional feature

  

  adamreeve

  authored and

  rok

  committed
  af46948

  Copy full SHA for af46948

• Handle when a file is encrypted but encryption is disabled or no decryption properties are provided

  

  adamreeve

  authored and

  rok

  committed
  0244f64

  Copy full SHA for 0244f64

• Allow for plaintext footer

  rok

  committed
  fc88058

  Copy full SHA for fc88058

• work

  rok

  committed
  d6aab9a

  Copy full SHA for d6aab9a

• Fix method name

  

  adamreeve

  authored and

  rok

  committed
  58ffa89

  Copy full SHA for 58ffa89

• Update parquet-testing to use encrypted files with correct repetition levels

  

  adamreeve

  authored and

  rok

  committed
  5a92492

  Copy full SHA for 5a92492

• work

  rok

  committed
  8ba0026

  Copy full SHA for 8ba0026

• Minor

  rok

  committed
  db8543c

  Copy full SHA for db8543c

• work

  rok

  committed
  e9d79c8

  Copy full SHA for e9d79c8

• work

  rok

  committed
  3e7646d

  Copy full SHA for 3e7646d