Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(nimtable): merge main #18527

Closed
wants to merge 62 commits into from
Closed

feat(nimtable): merge main #18527

wants to merge 62 commits into from

Conversation

xxhZs
Copy link
Contributor

@xxhZs xxhZs commented Sep 13, 2024

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • I have added test labels as necessary. See details.
  • I have added fuzzing tests or opened an issue to track them. (Optional, recommended for new SQL features Sqlsmith: Sql feature generation #7934).
  • My PR contains breaking changes. (If it deprecates some features, please create a tracking issue to remove them in the future).
  • All checks passed in ./risedev check (or alias, ./risedev c)
  • My PR changes performance-critical code. (Please run macro/micro-benchmarks and show the results.)
  • My PR contains critical fixes that are necessary to be merged into the latest release. (Please check out the details)

Documentation

  • My PR needs documentation updates. (Please use the Release note section below to summarize the impact on users)

Release note

If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

xxchan and others added 30 commits September 3, 2024 08:03
@xxchan
fix: DROP DATABASE doesn't clean up the source stream job (in v1) (#…
51d3c63 
…18033)

Signed-off-by: xxchan <[email protected]>
@tabVersion
feat(telemetry): add telemetry data point when checking license (#18371)
c519f0d 
Signed-off-by: tabVersion <[email protected]>
@xxhZs
feat(sink): support async for bigquery sink (#17488)
c0ce8a8
@xxchan
feat: support arrow map -> rw map (#18375)
c843edc 
Signed-off-by: xxchan <[email protected]>
@st1page @fuyufjh
feat(streaming): add must_output_per_barrier flag for stream simple…
e9d77a4 
… agg (#18374)

Co-authored-by: Eric Fu <[email protected]>
@xxchan
refactor: use high watermark to finish backfill faster (#18342)
847610a
@BugenZhao
feat(risedev): attempt to kill existing session when launching `rised…
a7480e1 
…ev-dev` (#18370)

Signed-off-by: Bugen Zhao <[email protected]>
@xiangjinwu
fix(sqlparser): display create items with comma properly (#18393)
0a4ccde
@xxchan
feat(expr): support jsonb_populate_map (#18378)
c4b1dd4 
Signed-off-by: xxchan <[email protected]>
@xxchan
refactor: add some comments for source splits (#18034)
6402328
@tabVersion
fix: parquet test missing comma (#18397)
ee33271 
Signed-off-by: tabVersion <[email protected]>
@xxchan
feat(risedev): support providing env var in yaml config (#18396)
9923c3a 
Signed-off-by: xxchan <[email protected]>
@wenym1
feat(snapshot-backfill): only receive mutation from barrier worker fo…
0dd06ff 
…r snapshot backfill (#18210)
@BugenZhao
feat: variable vnode count support in table distribution (#18373)
670a94f 
Signed-off-by: Bugen Zhao <[email protected]>
@xiangjinwu
fix(source): Protobuf Any as canonical JSON (#18380)
3b98b71
@zwang28
fix(storage): fix assertion (#18413)
f2f5827
@lmatz
feat: support more SSL related configurations in Kafka connector (#18361
cb29fe0 
)
@BugenZhao
feat: variable vnode count support in vnode structure (#18381)
8a32a9b 
Signed-off-by: Bugen Zhao <[email protected]>
@xxhZs
fix(error): fix sinkError and connector error (#18425)
1d220ee
@Li0k
fix(storage): fix correct_commit_ssts with sst table_ids (#18414)
0134191
@zwang28
fix(backup): fix restore order (#18423)
79ba869
@zwang28
fix(meta): fix catalog ref count (#18427)
df7f54f
@xxchan
feat: track progress for SourceBackfill (blocking DDL) (#18112)
6489e9a 
Signed-off-by: xxchan <[email protected]>
@StrikeW
fix(sink): set query timeout for jdbc sink to avoid stuck (#18430)
5311069
@Li0k
fix(storage): fix duplicated sst_id generated by split_sst function (#…
b00d750 
…18431)
@hzxa21
feat: introduce cluster limit (#18383)
4accc4a
@wenym1
refactor: remove drop_actors rpc and simplify barrier worker state (#…
7d3f285 
…18354)
@Li0k
fix(storage): fix commit_epoch new_sst_id_number (#18438)
3762877
@xxchan
feat: support scale SourceBackfill executor (#16825)
e2c89f4 
Signed-off-by: xxchan <[email protected]>
@zwang28
fix(meta): correctly update serving parallelism mapping (#18439)
71753f1
tabVersion and others added 26 commits September 10, 2024 06:00
@tabVersion
fix: empty string as license key stuck docker compose (#18421)
2679396 
Signed-off-by: tabVersion <[email protected]>
@tabVersion
refactor: replace RdKafkaStats with Guarded metrics (#18462)
952962c 
Signed-off-by: tabVersion <[email protected]>
@Li0k
feat(compaction): support merge compaction group (#18188)
99d6121
@zwang28
fix(metric): include table_change_log when calculating object size (#…
f970372 
…18452)
@zwang28
feat(meta): support time travel query on a per-table basis (part1) (#…
dc07da0 
…18459)
@wcy-fdu
feat(source): configure whether to recursively scan file source (#18324)
596138e
@xxchan
feat(expr): support map keys/values/entries (#18480)
829bef3 
Signed-off-by: xxchan <[email protected]>
@wenym1
feat(sink): reimplement sink coordinator worker and support scale (#1…
7833509 
…8467)
@xxchan
fix(iceberg): fix map - arrow convert & fix sink nested types to iceb…
00150a3 
…erg (#18463)

Signed-off-by: xxchan <[email protected]>
@MrCroxx
perf: optimize memory allocation on building object path (#18465)
084bc6d 
Signed-off-by: MrCroxx <[email protected]>
@MrCroxx @wenym1
refactor: bump toolchain to 2024-07-19 (#18470)
6038298 
Signed-off-by: MrCroxx <[email protected]>
Co-authored-by: William Wen <[email protected]>
@xiangjinwu
fix(source): parse protobuf into expected struct/array (#18419)
8e7b099
@tabVersion
feat: allow customize pulsar subscription name (#18379)
23410f0 
Signed-off-by: tabVersion <[email protected]>
@xxhZs
fix(sink): fix sink_decouple = false and commit_checkpoint_interval d…
5065bb4 
…efalut = 1; (#18348)
@wenym1
refactor(storage): cache recent versions and unify batch query and ti…
c882bda 
…me travel (#18477)
@tabVersion @xxchan
feat: schemaless ingestion for encode json (INCLUDE payload) (#18437
a9b1de3 
)

Signed-off-by: tabVersion <[email protected]>
Co-authored-by: xxchan <[email protected]>
@zwang28
refactor(storage): make HummockVersion a generic struct (#18478)
4afcd4d
@BugenZhao
refactor(batch): schedule with streaming mapping if serving is tempor…
317641f 
…arily unavailable (#18505)

Signed-off-by: Bugen Zhao <[email protected]>
@chenzl25 @xxchan
feat(iceberg): support create iceberg table w/ one layer nested type …
34a2ad4 
…& scan table w/ nested type (#18498)

Co-authored-by: xxchan <[email protected]>
@dependabot
chore(deps): bump send and express in /dashboard (#18489)
3627131 
Signed-off-by: dependabot[bot] <[email protected]>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@lmatz
chore: make file sink publicly accessible (#18508)
6c3b68f
@chenzl25
fix(iceberg): fix decimal overflow for iceberg arrow (#18511)
b9ac1ac
@StrikeW
feat(cdc): support for verify-ca and verify-full of Postgres SSL (#18015
9533cd9 
)
@yuhao-su
feat(streaming): introduce streaming AsOf JOIN executor (#18242)
bc9c2ad
@chenzl25
fix(udf): use a dedicated runtime to create udf flight client (#18461)
f226e21
@xxhZs @chenzl25
feat(iceberg): support eq delete merge on read for iceberg (#18448)
870bcde 
Co-authored-by: Dylan Chen <[email protected]>
@xxhZs xxhZs requested a review from a team as a code owner September 13, 2024 08:28
@xxhZs xxhZs requested review from xxchan and removed request for a team September 13, 2024 08:28
@xxhZs xxhZs closed this Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@xxchan xxchan Awaiting requested review from xxchan xxchan is a code owner automatically assigned from risingwavelabs/cargo-lock

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.