Skip to content

[Multi-GPU Polars] Introduce Ray mode for multi-GPU cudf-polars execution#21746

Open
madsbk wants to merge 22 commits intorapidsai:mainfrom
madsbk:rapidsmpf-ray
Open

[Multi-GPU Polars] Introduce Ray mode for multi-GPU cudf-polars execution#21746
madsbk wants to merge 22 commits intorapidsai:mainfrom
madsbk:rapidsmpf-ray

Conversation

@madsbk
Copy link
Member

@madsbk madsbk commented Mar 11, 2026

Introduces a Ray-based execution frontend for cudf-polars backed by the RapidsMPF streaming engine, complementing the existing SPMD mode.

@madsbk madsbk self-assigned this Mar 11, 2026
@madsbk madsbk added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Mar 11, 2026
@github-actions github-actions bot added Python Affects Python cuDF API. cudf-polars Issues specific to cudf-polars labels Mar 11, 2026
@GPUtester GPUtester moved this to In Progress in cuDF Python Mar 11, 2026
@madsbk madsbk force-pushed the rapidsmpf-ray branch 3 times, most recently from 2d3e98f to 69eea3c Compare March 12, 2026 12:14
@madsbk madsbk marked this pull request as ready for review March 12, 2026 17:55
@madsbk madsbk requested a review from a team as a code owner March 12, 2026 17:55
@madsbk madsbk requested review from Matt711 and mroeschke March 12, 2026 17:55
@rapidsai rapidsai deleted a comment from copy-pr-bot bot Mar 12, 2026
@madsbk madsbk changed the title [cudf-polars-mp] Introduce Ray mode for multi-GPU cudf-polars execution [Multi-GPU Polars] Introduce Ray mode for multi-GPU cudf-polars execution Mar 13, 2026
@madsbk madsbk requested a review from wence- March 13, 2026 14:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cudf-polars Issues specific to cudf-polars improvement Improvement / enhancement to an existing function non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

Status: In Progress

Development

Successfully merging this pull request may close these issues.

2 participants