Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(python): WIP: Add GPU engine to sink_csv #20940

Draft
wants to merge 6 commits into
base: main
Choose a base branch
from
Draft

feat(python): WIP: Add GPU engine to sink_csv #20940

wants to merge 6 commits into from
+117 −2

Conversation

mroeschke
Copy link

xref #20259

Takes a similar approach with the collect API and adds an engine keyword to sink_csv to allow writing to CSV.

Internally, took a similar approach to collect by passing through a Python callback, that will be a cudf_polars method, though LazyFrame.sink that will execute the the operations including the CSV writing on the GPU.

@mroeschke mroeschke changed the title WIP: Add GPU engine to sink_csv feat(python): WIP: Add GPU engine to sink_csv Jan 29, 2025
@github-actions github-actions bot added enhancement New feature or an improvement of an existing feature python Related to Python Polars and removed title needs formatting labels Jan 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ritchie46 ritchie46 Awaiting requested review from ritchie46 ritchie46 will be requested when the pull request is marked ready for review ritchie46 is a code owner

@c-peters c-peters Awaiting requested review from c-peters c-peters will be requested when the pull request is marked ready for review c-peters is a code owner

@alexander-beedie alexander-beedie Awaiting requested review from alexander-beedie alexander-beedie will be requested when the pull request is marked ready for review alexander-beedie is a code owner

@MarcoGorelli MarcoGorelli Awaiting requested review from MarcoGorelli MarcoGorelli will be requested when the pull request is marked ready for review MarcoGorelli is a code owner

@reswqa reswqa Awaiting requested review from reswqa reswqa will be requested when the pull request is marked ready for review reswqa is a code owner

@orlp orlp Awaiting requested review from orlp orlp will be requested when the pull request is marked ready for review orlp is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
enhancement New feature or an improvement of an existing feature python Related to Python Polars
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@mroeschke