Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stop double closing in json scan + skip test #8413

Merged

Conversation

abellina
Copy link
Collaborator

@abellina abellina commented May 26, 2023

Closes: #8411

Stops a double close on exception in GpuJsonScan.

Skips test_read_case_col_names due to #8403, while we investigate further.

@abellina abellina added the bug Something isn't working label May 26, 2023
@abellina
Copy link
Collaborator Author

build

1 similar comment
@abellina
Copy link
Collaborator Author

build

jlowe
jlowe previously approved these changes May 26, 2023
Copy link
Member

@jlowe jlowe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Small nit, lgtm.

revans2
revans2 previously approved these changes May 26, 2023
Copy link
Collaborator

@revans2 revans2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same nit.

@abellina abellina dismissed stale reviews from revans2 and jlowe via 13d08ca May 30, 2023 13:51
@abellina
Copy link
Collaborator Author

build

abellina added 2 commits May 30, 2023 14:15
…a/spark-rapids into stop_double_closing_in_json_scan
@abellina
Copy link
Collaborator Author

build

Copy link
Collaborator

@gerashegalov gerashegalov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -436,6 +436,7 @@ def test_json_datetime_parsing_fallback_no_datetime(std_input_path, filename, sc
lambda spark : spark.read.schema(schema).option('enableDateTimeParsingFallback', "true").json(data_path),
conf=_enable_all_types_conf)

@pytest.mark.skip(reason=str("https://github.com/NVIDIA/spark-rapids/issues/8403"))
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Other usages in our repo do not require str() conversion for a literal reason

@abellina abellina merged commit 50f5f25 into NVIDIA:branch-23.06 May 30, 2023
@abellina abellina deleted the stop_double_closing_in_json_scan branch May 30, 2023 22:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[BUG] Close called too many times in Gpu json reader
4 participants