-
Notifications
You must be signed in to change notification settings - Fork 278
Closed
Labels
Description
Description
Spark 4.1.0 introduced a new OneRowRelationExec physical plan node via SPARK-52060 (commit f423885f65d).
Changes in Spark 4.1.x
-
New
OneRowRelationExecclass - A dedicated physical plan node for single-row relations (e.g.,SELECT 1,SELECT version()) -
Replaces
RDDScanExec- Previously, one-row relations usedRDDScanExecwith a hard-coded "OneRowRelation" string -
User-facing change - The plan now shows
OneRowRelationExecrather thanRDDScanExec
Implementation
Added GpuOneRowRelationExec in spark-rapids that:
- Produces a single
ColumnarBatchwith 1 row and 0 columns - Uses no GPU memory since there are no actual data columns
- Overrides
makeCopyanddoCanonicalizeto handle Spark's TreeNode reflection
Status
✅ Completed - GPU support for OneRowRelationExec has been implemented in the spark411 shim.
Reactions are currently unavailable