Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[AUDIT] SPARK-43393 Sequence expression can overflow #9875

Closed
jlowe opened this issue Nov 28, 2023 · 0 comments · Fixed by #9962
Closed

[AUDIT] SPARK-43393 Sequence expression can overflow #9875

jlowe opened this issue Nov 28, 2023 · 0 comments · Fixed by #9962
Assignees
@razajafri
Labels
audit_3.4.2 Audit related tasks for 3.4.2 audit_3.5.1 Audit related tasks for 3.5.1 audit_4.0.0 Audit related tasks for 4.0.0

Comments

@jlowe
Copy link
Member

jlowe commented Nov 28, 2023

SPARK-43393 updated the calculation of the sequence length to detect overflows at apache/spark@b7bc127340c. We have translated the original approach to a GPU algorithm and may need to update it in a similar way to detect the overflow case.
@jlowe jlowe added ? - Needs Triage Need team to review and classify audit_3.4.2 Audit related tasks for 3.4.2 audit_3.5.1 Audit related tasks for 3.5.1 audit_4.0.0 Audit related tasks for 4.0.0 labels Nov 28, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Nov 28, 2023
This was referenced Dec 7, 2023
Closed
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@razajafri razajafri

Labels
audit_3.4.2 Audit related tasks for 3.4.2 audit_3.5.1 Audit related tasks for 3.5.1 audit_4.0.0 Audit related tasks for 4.0.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add 3.5.1-SNAPSHOT Shim razajafri/spark-rapids
3 participants
@jlowe @mattahrens @razajafri