Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

compactor OOM in the longevity test #15903

Closed
lmatz opened this issue Mar 26, 2024 · 6 comments
Closed

compactor OOM in the longevity test #15903

lmatz opened this issue Mar 26, 2024 · 6 comments
Assignees
@Li0k @Little-Wallace
Labels
found-by-longevity-test out-of-memory type/bug Something isn't working
Milestone
release-1.9

Comments

@lmatz
Copy link
Contributor

lmatz commented Mar 26, 2024

sqlite OOM after 8 hours, the longevity test with PostgreSQL and MySQL finishes successfully.

metric:
https://grafana.test.risingwave-cloud.xyz/d/EpkBw5W4k/risingwave-dev-dashboard?orgId=1&var-da[…]ll&var-table=All&from=1711360245686&to=1711409754716
@github-actions github-actions bot added this to the release-1.8 milestone Mar 26, 2024
@lmatz
Copy link
Contributor Author

lmatz commented Mar 26, 2024

slack: https://risingwave-labs.slack.com/archives/C06P9GXLQCS/p1711418115035389?thread_ts=1711362514.817799&cid=C06P9GXLQCS

@huangjw806 huangjw806 changed the title compactor OOM in the longevity test with sqlite as the metadata backend compactor OOM in the longevity test Apr 2, 2024
@huangjw806
Copy link
Contributor

This problem is related to opendal and has nothing to do with metastore
https://risingwave-labs.slack.com/archives/C0423G2NUF8/p1711682237083649

@Li0k Li0k modified the milestones: release-1.8, release-1.9 Apr 8, 2024
@Li0k
Copy link
Contributor

Li0k commented Apr 8, 2024

switch the default s3 backend to aws-sdk #16017

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 9, 2024

This issue has been open for 60 days with no activity. Could you please update the status? Feel free to continue discussion or close as not planned.

@Li0k
Copy link
Contributor

Li0k commented Jun 11, 2024

@hzxa21

@hzxa21
Copy link
Collaborator

hzxa21 commented Oct 8, 2024

This issue is related to a buggy opendal version (0.45) and should be resolved now in main because we already upgraded to 0.49.

@hzxa21 hzxa21 closed this as completed Oct 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@Li0k Li0k

@Little-Wallace Little-Wallace

Labels
found-by-longevity-test out-of-memory type/bug Something isn't working
Projects
None yet
Milestone
release-1.9
Development

No branches or pull requests
5 participants
@hzxa21 @lmatz @Li0k @Little-Wallace @huangjw806