Skip to content

Preserve partitioning metadata after simple Select operations#21547

Merged
rapids-bot[bot] merged 22 commits intorapidsai:mainfrom
rjzamora:select_preserves_partitioning
Mar 4, 2026
Merged

Preserve partitioning metadata after simple Select operations#21547
rapids-bot[bot] merged 22 commits intorapidsai:mainfrom
rjzamora:select_preserves_partitioning

Conversation

@rjzamora
Copy link
Member

@rjzamora rjzamora commented Feb 24, 2026

Description

Some projection operations show up in the Polars plan as Select with simple Col expressions. We can preserve partitioning metadata when this is the case.

Part of #20482

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@rjzamora rjzamora self-assigned this Feb 24, 2026
@rjzamora rjzamora added the 2 - In Progress Currently a work in progress label Feb 24, 2026
@rjzamora rjzamora requested a review from a team as a code owner February 24, 2026 23:44
@rjzamora rjzamora added the improvement Improvement / enhancement to an existing function label Feb 24, 2026
@rjzamora rjzamora added the non-breaking Non-breaking change label Feb 24, 2026
@github-actions github-actions bot added Python Affects Python cuDF API. cudf-polars Issues specific to cudf-polars labels Feb 24, 2026
@GPUtester GPUtester moved this to In Progress in cuDF Python Feb 24, 2026
@rjzamora rjzamora added 3 - Ready for Review Ready for review by team and removed 2 - In Progress Currently a work in progress labels Feb 25, 2026
Copy link
Contributor

@TomAugspurger TomAugspurger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Tests all look good. I think you covered all the cases I was wondering about (e.g. reordering). Just a couple questions on the implementation.

@rjzamora rjzamora added 5 - Ready to Merge Testing and reviews complete, ready to merge and removed 3 - Ready for Review Ready for review by team labels Mar 4, 2026
@rjzamora
Copy link
Member Author

rjzamora commented Mar 4, 2026

/merge

@rapids-bot rapids-bot bot merged commit 4cd7466 into rapidsai:main Mar 4, 2026
91 checks passed
@github-project-automation github-project-automation bot moved this from In Progress to Done in cuDF Python Mar 4, 2026
@rjzamora rjzamora deleted the select_preserves_partitioning branch March 4, 2026 17:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

5 - Ready to Merge Testing and reviews complete, ready to merge cudf-polars Issues specific to cudf-polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

3 participants