Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

read metadata in SimpleQueryableIndex if available to compute segment ordering #17181

Merged
merged 1 commit into from
Sep 28, 2024

Conversation

clintropolis
Copy link
Member

@clintropolis clintropolis commented Sep 28, 2024

#16700 made QueryableIndex.getMetadata be 'lazy', which is kind of nice in some ways since we don't have to hang on to the segment metadata object unless we need it, however changes in #16533, #16849, and #16985 made it so that we read the segment "ordering" every time we make a cursor, which comes from the metadata, and seems pretty unchill with the lazy metadata reading.

This PR makes it so that we precompute the ordering in SimpleQueryableIndex constructor so that getOrdering is a cheap call.

@clintropolis clintropolis merged commit f8a72b9 into apache:master Sep 28, 2024
90 checks passed
@clintropolis clintropolis deleted the metadata-lazy-problems branch September 28, 2024 02:39
clintropolis added a commit to clintropolis/druid that referenced this pull request Sep 30, 2024
kfaraz pushed a commit that referenced this pull request Oct 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants