Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add parquet support to write_to_file_stage.py #1937

Merged
merged 11 commits into from
Nov 22, 2024
Merged

Add parquet support to write_to_file_stage.py #1937

merged 11 commits into from
Nov 22, 2024

Conversation

yczhang-nv
Copy link
Contributor

Description

Add support for writing DataFrames to parquet files in write_to_file_stage.py.

Closes #980

By Submitting this PR I confirm:

  • I am familiar with the Contributing Guidelines.
  • When the PR is ready for review, new or existing tests cover these changes.
  • When the PR is ready for review, the documentation is up to date with these changes.

@yczhang-nv yczhang-nv added non-breaking Non-breaking change improvement Improvement to existing functionality labels Oct 9, 2024
@yczhang-nv yczhang-nv self-assigned this Oct 9, 2024
@yczhang-nv yczhang-nv requested a review from a team as a code owner October 9, 2024 22:29
@yczhang-nv yczhang-nv marked this pull request as draft October 16, 2024 19:30
mdemoret-nv
mdemoret-nv requested changes Oct 21, 2024
View reviewed changes
Copy link
Contributor

@mdemoret-nv mdemoret-nv left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need tests to confirm functionality is working correctly.

@dagardner-nv dagardner-nv changed the base branch from branch-24.10 to branch-25.02 October 31, 2024 16:20
@dagardner-nv
Copy link
Contributor

re-targeting to branch-25.02

@copy-pr-bot copy-pr-bot
Copy link

copy-pr-bot bot commented Nov 6, 2024

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv yczhang-nv marked this pull request as ready for review November 6, 2024 21:04
@yczhang-nv yczhang-nv requested a review from a team as a code owner November 6, 2024 21:04
@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/ok to test

@yczhang-nv
Copy link
Contributor Author

/merge

@rapids-bot rapids-bot bot merged commit d8041ba into nv-morpheus:branch-25.02 Nov 22, 2024
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@mdemoret-nv mdemoret-nv mdemoret-nv approved these changes

Assignees

@yczhang-nv yczhang-nv

Labels
improvement Improvement to existing functionality non-breaking Non-breaking change
Projects
Morpheus Boards
Status: Done
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[FEA]: Add parquet support to write_to_file_stage.py
3 participants
@yczhang-nv @dagardner-nv @mdemoret-nv