Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Use ClickHouse database for new label queries #1648

Open
frank-zsy opened this issue Nov 27, 2024 · 0 comments
Open

[Feature] Use ClickHouse database for new label queries #1648

frank-zsy opened this issue Nov 27, 2024 · 0 comments
Labels
waiting for repliers need other's feedback

Comments

@frank-zsy
Copy link
Contributor

Description

Right now, all the label data in OpenDigger is stored directly in git repo under the labeled_data folder. And for queries with labels involved, we construct the query SQL in text mode and pass into the SQL directly. But with more and more labels come into OpenDigger, this may lead to multiple problems like the SQL text will be quite long or even exceed the requirement.

For future use, I would like to refactor the label module and store all the label data structure into ClickHouse table and then we can use SQL with label table to inject label filter functions.

But this also requires the ClickHouse version to be 22.4+ to support recursive CTEs since the label system supports multi-layer with sub labels. So just open this issue for recording now.

@github-actions github-actions bot added the waiting for repliers need other's feedback label Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
waiting for repliers need other's feedback
Projects
None yet
Development

No branches or pull requests

1 participant