Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include expression parsers for HashAggregate and ObjectHashAggregate #1432

Merged
merged 2 commits into from
Nov 25, 2024

Conversation

nartal1
Copy link
Collaborator

@nartal1 nartal1 commented Nov 21, 2024

This is a bug fix. This was missed while refactoring Exec Parser PR - #1396
Changes in this PR :

  1. Updates the expressionParses for ObjectHashAggregate and HashAggregate.
  2. Handle whitespace after the ExecNames. While getting the expressions string, we remove the ExecName to parse only the expressions. In eventlogs, some ExecNames have "whitespace" after the Exec name and don't. So we handle that case in this PR.

@nartal1 nartal1 added bug Something isn't working core_tools Scope the core module (scala) labels Nov 21, 2024
@nartal1 nartal1 requested a review from amahussein November 21, 2024 22:28
@nartal1 nartal1 self-assigned this Nov 21, 2024
Copy link
Collaborator

@amahussein amahussein left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IS this an old bug or a bug introduced during the last refactor? I wonder we did not notice that from the tests.

@@ -59,7 +59,7 @@ class GenericExecParser(
}

protected def getExprString: String = {
node.desc.replaceFirst(s"${node.name} ", "")
node.desc.replaceFirst(s"${node.name}\\s*", "")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah I remember seeing HashAggregate( in the description
QQ: Is it possible that the node.name may not come at the beginning of the node description?
In that case we better use a regex ^(node_name)\\s* to guarantee that we replace node_name when it is at the beginning of the description.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @amahussein ! Updated it. Adding of expression parsers was missed during refactoring. Since we are getting the expressions in #1431, we should be able to update some of the tests to capture these kinds of bugs.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @nartal1 !

Copy link
Collaborator

@parthosa parthosa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @nartal1. LGTME.

Copy link
Collaborator

@amahussein amahussein left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @nartal1 !

@nartal1 nartal1 merged commit 3cd1fe7 into NVIDIA:dev Nov 25, 2024
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working core_tools Scope the core module (scala)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants