Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pull] main from elastic:main #556

Merged
merged 17 commits into from
Dec 2, 2024
Merged

[pull] main from elastic:main #556

merged 17 commits into from
Dec 2, 2024

Conversation

pull[bot]
Copy link

@pull pull bot commented Dec 2, 2024

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.1)

Can you help keep this open source service alive? 💖 Please sponsor : )

alex-spies and others added 17 commits November 30, 2024 03:34
LookupJoinExec should not assume its output but instead compute it from
- Its input fields from the left - The fields added from the lookup
index

Currently, LookupJoinExec's output is determined when the logical plan
is mapped to a physical one, and thereafter the output cannot be changed
anymore. This makes it impossible to have late materialization of fields
from the left hand side via field extractions, because we are forced to
extract *all* fields before the LookupJoinExec, otherwise we do not
achieve the prescribed output.

Avoid that by tracking only which fields the LookupJoinExec will add
from the lookup index instead of tracking the whole output (that was
only correct for the logical plan).

**Note:** While this PR is a refactoring for the current functionality,
it should unblock @craigtaverner 's ongoing work related to field
extractions and getting multiple LOOKUP JOIN queries to work correctly
without adding hacks.
Following up
#117332 (comment),
I refactored `InstrumenterImpl` tests, splitting them into 2 suites:  -
`SyntheticInstrumenterImplTests`, which tests the mechanics of
instrumentation using ad-hoc test cases. This should see little change
now that we have our Instrumenter working as intended -
`InstrumenterImplTests`, which is back to its original intent to make
sure (1) the right arguments make it all the way to the check methods,
and (2) if the check method throws, that exception correctly bubbles up
through the instrumented method.

The PR also includes a little change to `InstrumenterImpl`  construction
to clean it up a bit and make it more testable.
We should have checked that all drivers were canceled, not cancellable 
(which is always true), before unblocking the compute tasks.

Closes #117568
These can at times be quite long strings, no need to materialize
unless requested. This is showing up as allocating needless heap of
O(GB) in some benchmarks during indexing needlessly.
…p0=search.highlight/50_synthetic_source/text multi unified from vectors} #117815
The version of the AWS Java SDK we use already magically switches to
IMDSv2 if available, but today we cannot claim to support IMDSv2 in
Elasticsearch since we have no tests demonstrating that the magic really
works for us. In particular, this sort of thing often risks falling foul
of some restrictions imposed by the security manager (if not now then
maybe in some future release).

This commit adds proper support for IMDSv2 by enhancing the test suite
to add the missing coverage to avoid any risk of breaking this magical
SDK behaviour in future.

Closes #105135 Closes ES-9984
Update IT tests grouping assertResponses
This commit removes the need of having a bucketOrd in InternalGeoGridBucket that is only used to build the 
InternalAggregation from the aggregator.
There are two clear code paths depending if a h3 bin belongs to even resolutions (class II) or 
uneven resolutions (class III). especializing the code paths for each type leads to an improvement in performance.
@pull pull bot added the ⤵️ pull label Dec 2, 2024
@pull pull bot merged commit 79ce6e3 into Samboski1:main Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.