Skip to content

Commit

Permalink
Add PredicatePushdownOptimizer in tracking-only mode (#1262)
Browse files Browse the repository at this point in the history
In order to run predicate pushdown in a more robust manner we would
be better served applying it as a post-plan-building optimizer rather
than a build-time injection of additional where constraints.

This PR adds the optimizer class with full tracking of predicate
pushdown state, but it simply returns all nodes in the input
DataflowPlan without modifying anything, since the predicate pushdown
is already applied in the DataflowPlanBuilder.

Future updates will move both the where constraint and time range constraint
pushdown operations into this optimizer class. For now we simply evaluate
the output from console logs to get a basis for future implementation changes.
  • Loading branch information
tlento authored Jun 25, 2024
1 parent 7f1e1ca commit 7758362
Show file tree
Hide file tree
Showing 3 changed files with 462 additions and 1 deletion.
6 changes: 6 additions & 0 deletions .changes/unreleased/Under the Hood-20240611-162735.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
kind: Under the Hood
body: Add dataflow plan optimizer to replace build-time predicate pushdown
time: 2024-06-11T16:27:35.410726-07:00
custom:
Author: tlento
Issue: "1011"
Loading

0 comments on commit 7758362

Please sign in to comment.