Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The number of rows of UDF input chunk is too small #14605

Closed
StrikeW opened this issue Jan 16, 2024 · 5 comments
Closed

The number of rows of UDF input chunk is too small #14605

StrikeW opened this issue Jan 16, 2024 · 5 comments
Assignees
Labels
no-issue-activity type/bug Something isn't working

Comments

@StrikeW
Copy link
Contributor

StrikeW commented Jan 16, 2024

Describe the bug

image

https://grafana.prod.risingwave.cloud/d/EpkBw5W4k/risingwave-dev-dashboard?from=1705143551000&orgId=1&to=1705159885000&var-component=All&var-datasource=P7AEF1E9BD6C1839A&var-instance=risingwave&var-namespace=rwc-g1hhgcv4t0f0k8cr19qbl8coqk-test&var-pod=All&var-table=All

Error message/log

No response

To Reproduce

No response

Expected behavior

No response

How did you deploy RisingWave?

No response

The version of RisingWave

v1.6-da175e8

Additional context

https://risingwave-labs.slack.com/archives/C0606NNR74P/p1705155772714269?thread_ts=1705135558.026809&cid=C0606NNR74P

@StrikeW StrikeW added the type/bug Something isn't working label Jan 16, 2024
@github-actions github-actions bot added this to the release-1.7 milestone Jan 16, 2024
@StrikeW
Copy link
Contributor Author

StrikeW commented Jan 16, 2024

cc @TennyZhuang @wangrunji0408

@BugenZhao
Copy link
Member

I suppose this issue is not exclusive to UDF. It actually depends on the chunk size from the upstream executor. For instance, if there's an aggregation with few groups in the upstream, then small chunks for evaluation is inevitable.

May I ask about the throughput of the UDF?

@StrikeW
Copy link
Contributor Author

StrikeW commented Jan 18, 2024

You can check the grafana link to see the udf throughput and other metrics.

@wangrunji0408
Copy link
Contributor

wangrunji0408 commented Jan 19, 2024

Is it worthy to merge small chunks into bigger ones at the entry of ProjectionExecutor? or do it in a new executor that can be connected before the projection?

@fuyufjh fuyufjh removed this from the release-1.7 milestone Mar 6, 2024
Copy link
Contributor

This issue has been open for 60 days with no activity. Could you please update the status? Feel free to continue discussion or close as not planned.

@wangrunji0408 wangrunji0408 closed this as not planned Won't fix, can't repro, duplicate, stale Jun 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
no-issue-activity type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants