Code

feat(nimtable): merge main #18527

Code

Closed

xxhZs wants to merge 62 commits intonimtable_devrisingwavelabs/risingwave:nimtable_devfrom mainrisingwavelabs/risingwave:mainCopy head branch name to clipboard

+12,095-4,453

Commits

Commits on Sep 3, 2024

• fix: DROP DATABASE doesn't clean up the source stream job (in v1) (#18033)

  Show description for 51d3c63
  xxchan

  authored
  51d3c63

  Copy full SHA for 51d3c63

• feat(telemetry): add telemetry data point when checking license (#18371)

  Show description for c519f0d
  tabVersion

  authored
  c519f0d

  Copy full SHA for c519f0d

• feat(sink): support async for bigquery sink (#17488)

  xxhZs

  authored
  c0ce8a8

  Copy full SHA for c0ce8a8

• feat: support arrow map -> rw map (#18375)

  Show description for c843edc
  xxchan

  authored
  c843edc

  Copy full SHA for c843edc

• feat(streaming): add must_output_per_barrier flag for stream simple agg (#18374)

  Show description for e9d77a4
  

  st1page

  and

  fuyufjh

  authored
  e9d77a4

  Copy full SHA for e9d77a4

Commits on Sep 4, 2024

• refactor: use high watermark to finish backfill faster (#18342)

  xxchan

  authored
  847610a

  Copy full SHA for 847610a

• feat(risedev): attempt to kill existing session when launching risedev-dev (#18370)

  Show description for a7480e1
  BugenZhao

  authored
  a7480e1

  Copy full SHA for a7480e1

• fix(sqlparser): display create items with comma properly (#18393)

  xiangjinwu

  authored
  0a4ccde

  Copy full SHA for 0a4ccde

• feat(expr): support jsonb_populate_map (#18378)

  Show description for c4b1dd4
  xxchan

  authored
  c4b1dd4

  Copy full SHA for c4b1dd4

• refactor: add some comments for source splits (#18034)

  xxchan

  authored
  6402328

  Copy full SHA for 6402328

• fix: parquet test missing comma (#18397)

  Show description for ee33271
  tabVersion

  authored
  ee33271

  Copy full SHA for ee33271

• feat(risedev): support providing env var in yaml config (#18396)

  Show description for 9923c3a
  xxchan

  authored
  9923c3a

  Copy full SHA for 9923c3a

• feat(snapshot-backfill): only receive mutation from barrier worker for snapshot backfill (#18210)

  wenym1

  authored
  0dd06ff

  Copy full SHA for 0dd06ff

Commits on Sep 5, 2024

• feat: variable vnode count support in table distribution (#18373)

  Show description for 670a94f
  BugenZhao

  authored
  670a94f

  Copy full SHA for 670a94f

• fix(source): Protobuf Any as canonical JSON (#18380)

  xiangjinwu

  authored
  3b98b71

  Copy full SHA for 3b98b71

• fix(storage): fix assertion (#18413)

  zwang28

  authored
  f2f5827

  Copy full SHA for f2f5827

• feat: support more SSL related configurations in Kafka connector (#18361)

  lmatz

  authored
  cb29fe0

  Copy full SHA for cb29fe0

• feat: variable vnode count support in vnode structure (#18381)

  Show description for 8a32a9b
  BugenZhao

  authored
  8a32a9b

  Copy full SHA for 8a32a9b

• fix(error): fix sinkError and connector error (#18425)

  xxhZs

  authored
  1d220ee

  Copy full SHA for 1d220ee

• fix(storage): fix correct_commit_ssts with sst table_ids (#18414)

  Li0k

  authored
  0134191

  Copy full SHA for 0134191

• fix(backup): fix restore order (#18423)

  zwang28

  authored
  79ba869

  Copy full SHA for 79ba869

• fix(meta): fix catalog ref count (#18427)

  zwang28

  authored
  df7f54f

  Copy full SHA for df7f54f

Commits on Sep 6, 2024

• feat: track progress for SourceBackfill (blocking DDL) (#18112)

  Show description for 6489e9a
  xxchan

  authored
  6489e9a

  Copy full SHA for 6489e9a

• fix(sink): set query timeout for jdbc sink to avoid stuck (#18430)

  StrikeW

  authored
  5311069

  Copy full SHA for 5311069

• fix(storage): fix duplicated sst_id generated by split_sst function (#18431)

  Li0k

  authored
  b00d750

  Copy full SHA for b00d750

• feat: introduce cluster limit (#18383)

  hzxa21

  authored
  4accc4a

  Copy full SHA for 4accc4a

• refactor: remove drop_actors rpc and simplify barrier worker state (#18354)

  wenym1

  authored
  7d3f285

  Copy full SHA for 7d3f285

• fix(storage): fix commit_epoch new_sst_id_number (#18438)

  Li0k

  authored
  3762877

  Copy full SHA for 3762877

• feat: support scale SourceBackfill executor (#16825)

  Show description for e2c89f4
  xxchan

  authored
  e2c89f4

  Copy full SHA for e2c89f4

• fix(meta): correctly update serving parallelism mapping (#18439)

  zwang28

  authored
  71753f1

  Copy full SHA for 71753f1

Commits on Sep 7, 2024

• fix(iceberg): fix select empty iceberg table (#18449)

  Li0k

  authored
  becb896

  Copy full SHA for becb896

Commits on Sep 9, 2024

• doc(readme): update architecture image (#18418)

  Show description for 9a03718
  

  st1page

  and

  WanYixian

  authored
  9a03718

  Copy full SHA for 9a03718

• feat: variable vnode count support in batch/streaming scheduler (#18407)

  Show description for 8d5b62b
  BugenZhao

  authored
  8d5b62b

  Copy full SHA for 8d5b62b

• chore: update image version to 2.0.0-rc.1 (#18460)

  lmatz

  authored
  462253e

  Copy full SHA for 462253e

• refactor: track progress minor refactor (#18446)

  Show description for 29d2e1e
  xxchan

  authored
  29d2e1e

  Copy full SHA for 29d2e1e

Commits on Sep 10, 2024

• refactor(frontend): extract filling fields in fragment graph (#18466)

  Show description for 8c7a364
  BugenZhao

  authored
  8c7a364

  Copy full SHA for 8c7a364

• fix: empty string as license key stuck docker compose (#18421)

  Show description for 2679396
  tabVersion

  authored
  2679396

  Copy full SHA for 2679396

• refactor: replace RdKafkaStats with Guarded metrics (#18462)

  Show description for 952962c
  tabVersion

  authored
  952962c

  Copy full SHA for 952962c

• feat(compaction): support merge compaction group (#18188)

  Li0k

  authored
  99d6121

  Copy full SHA for 99d6121

• fix(metric): include table_change_log when calculating object size (#18452)

  zwang28

  authored
  f970372

  Copy full SHA for f970372

• feat(meta): support time travel query on a per-table basis (part1) (#18459)

  zwang28

  authored
  dc07da0

  Copy full SHA for dc07da0

• feat(source): configure whether to recursively scan file source (#18324)

  wcy-fdu

  authored
  596138e

  Copy full SHA for 596138e

Commits on Sep 11, 2024

• feat(expr): support map keys/values/entries (#18480)

  Show description for 829bef3
  xxchan

  authored
  829bef3

  Copy full SHA for 829bef3

• feat(sink): reimplement sink coordinator worker and support scale (#18467)

  wenym1

  authored
  7833509

  Copy full SHA for 7833509

• fix(iceberg): fix map - arrow convert & fix sink nested types to iceberg (#18463)

  Show description for 00150a3
  xxchan

  authored
  00150a3

  Copy full SHA for 00150a3

• perf: optimize memory allocation on building object path (#18465)

  Show description for 084bc6d
  MrCroxx

  authored
  084bc6d

  Copy full SHA for 084bc6d

• refactor: bump toolchain to 2024-07-19 (#18470)

  Show description for 6038298
  

  MrCroxx

  and

  wenym1

  authored
  6038298

  Copy full SHA for 6038298

• fix(source): parse protobuf into expected struct/array (#18419)

  xiangjinwu

  authored
  8e7b099

  Copy full SHA for 8e7b099

• feat: allow customize pulsar subscription name (#18379)

  Show description for 23410f0
  tabVersion

  authored
  23410f0

  Copy full SHA for 23410f0

• fix(sink): fix sink_decouple = false and commit_checkpoint_interval defalut = 1; (#18348)

  xxhZs

  authored
  5065bb4

  Copy full SHA for 5065bb4

• refactor(storage): cache recent versions and unify batch query and time travel (#18477)

  wenym1

  authored
  c882bda

  Copy full SHA for c882bda

Commits on Sep 12, 2024

• feat: schemaless ingestion for encode json (INCLUDE payload) (#18437)

  Show description for a9b1de3
  

  tabVersion

  and

  xxchan

  authored
  a9b1de3

  Copy full SHA for a9b1de3

• refactor(storage): make HummockVersion a generic struct (#18478)

  zwang28

  authored
  4afcd4d

  Copy full SHA for 4afcd4d

• refactor(batch): schedule with streaming mapping if serving is temporarily unavailable (#18505)

  Show description for 317641f
  BugenZhao

  authored
  317641f

  Copy full SHA for 317641f

• feat(iceberg): support create iceberg table w/ one layer nested type & scan table w/ nested type (#18498)

  Show description for 34a2ad4
  

  chenzl25

  and

  xxchan

  authored
  34a2ad4

  Copy full SHA for 34a2ad4

• chore(deps): bump send and express in /dashboard (#18489)

  Show description for 3627131
  dependabot[bot]

  authored
  3627131

  Copy full SHA for 3627131

• chore: make file sink publicly accessible (#18508)

  lmatz

  authored
  6c3b68f

  Copy full SHA for 6c3b68f

• fix(iceberg): fix decimal overflow for iceberg arrow (#18511)

  chenzl25

  authored
  b9ac1ac

  Copy full SHA for b9ac1ac

• feat(cdc): support for verify-ca and verify-full of Postgres SSL (#18015)

  StrikeW

  authored
  9533cd9

  Copy full SHA for 9533cd9

Commits on Sep 13, 2024

• feat(streaming): introduce streaming AsOf JOIN executor (#18242)

  yuhao-su

  authored
  bc9c2ad

  Copy full SHA for bc9c2ad

• fix(udf): use a dedicated runtime to create udf flight client (#18461)

  chenzl25

  authored
  f226e21

  Copy full SHA for f226e21

• feat(iceberg): support eq delete merge on read for iceberg (#18448)

  Show description for 870bcde
  

  xxhZs

  and

  chenzl25

  authored
  870bcde

  Copy full SHA for 870bcde