Skip to content

[GLUTEN-6887][VL] Daily Update Velox Version (2026_03_03)#11688

Merged
zhouyuan merged 10 commits intoapache:mainfrom
GlutenPerfBot:tagging-2026_03_03
Mar 4, 2026
Merged

[GLUTEN-6887][VL] Daily Update Velox Version (2026_03_03)#11688
zhouyuan merged 10 commits intoapache:mainfrom
GlutenPerfBot:tagging-2026_03_03

Conversation

@GlutenPerfBot
Copy link
Contributor

@GlutenPerfBot GlutenPerfBot commented Mar 3, 2026

Upstream Velox's New Commits:

f7906fbbc by Kent Yao, feat(spark): Add assert_not_null function (16562)
7d3072c85 by Anass Al-Wohoush, Revert D94871321: feat: Add cache lookup and zero-copy APIs to BufferedInput
54eed172a by Xiaoxuan Meng, feat: Add cache lookup and zero-copy APIs to BufferedInput (16587)
283626a64 by Simon Eves, feat: Support Arrow Decimal64 type via Bridge (16474)
2d8cec59c by Karthikeyan, fix(cudf): Replace default memory resource and stream with explicit output MR and data stream in Cudf operators (16454)
9a8e535ee by Wei He, feat(aggregate): Support variadic arguments in simple aggregation function interface (16475)
236424117 by Krishna Pai, feat: Update to Opus 4.6 and make model configurable (16594)
f90730ce5 by Jimmy Lu, feat: Add table_scan_output_batch_rows_override (16571)
0d8ca0ce8 by Shang Ma, build: Explicitly enable folly coroutines when compiler supports them (16581)
11b64f0ca by Xiao Du, feat: Impl memory compact in Aggregate and GroupingSet (16476)
b38f9dc6f by Masha Basmanova, feat: Add kindName() API to IExpr (16576)
68b2f34ce by Ke Wang, feat: Add option to collect decompression time for drwf reader (16523)
7b2e58464 by Raymond Lin, fix: Handle empty keyNodes in SelectiveFlatMapAsStructReader (16570)
76d10eb4c by Ke Wang, feat: Add totalRemainingFilterCpuNanos metric for table scan (16564)
421c6fc0e by Devavret Makkar, fix(cuDF): Fix stream ordering issue in CudfHashAggregation Distinct (16525)
70e9b784d by Krishna Pai, feat(ci): Add /claude-query command for asking questions about PRs (16567)
c3f4ec311 by Rui Mo, feat: Add Spark TIMESTAMP_NTZ type (16344)
e6358b677 by Pramod Satya, refactor(cuDF): Consolidate cuDF configurations into single config file (16528)
085e6f9c5 by Rui Mo, fix(fuzzer): Disable file handle cache in Aggregate fuzzer test (16548)
bf2a4107a by Shrinidhi Joshi, docs: Add hash-table-caching documentation (16554)
f760d54f9 by Shakyan Kushwaha, feat: Add localtimestamp Presto function (15605)
ecd5a60cc by Allen Shen, refactor: Extract apply lambda utility function (16315)
6de3b6ddb by Xiaoxuan Meng, feat: Add FileLayout API for optimized reader IO and writer state tracking (16561)
600b0ba8a by Eric Jia, refactor: Optimize HiveConnectorUtil: deduplicate and endWith functions (16508)
01c114921 by Jimmy Lu, perf: Optimize deduplicated readers when all nested rows are selected (16550)
493517d19 by Xiaoxuan Meng, fix: Clear barrier flag when task terminates (16539)
090d01368 by Krishna Pai, feat(ci): Use Opus 4.1 model with stricter review guidelines (16552)
54b03a289 by Simon Eves, misc(cudf): Disable test AggregationTest.countStarGlobal pending a fix for global COUNT(*) (16493)
c14f6e380 by Charlie Arnold, Add Rust code generation for RemoteFunction.thrift (16458)
4e5fb428f by Krishna Pai, fix(ci): Fix comment author field and PR permissions in claude-review (16540)
caad670d0 by Natasha Sehgal, feat: Use emplace_back instead of push_back in Parquet writer Schema (16392)
9046fe2b3 by Krishna Pai, fix: Update review bot to use results response (16536)
53dcda01e by Xiaoxuan Meng, fix: Clear AsyncDataCache in test SetUp to fix flakiness (16533)
3591d31dc by Krishna Pai, fix(ci): Enable posting of claude reviews (16534)
cfc3353a2 by Abhinav Mukherjee, Add TRANSFORM_WITH_INDEX UDF (15978)
b6e5220f9 by Abhinav Mukherjee, Fix PartitionedOutput crash after flush (16496)
8693d331e by Abhinav Mukherjee, Add map_trim_values UDF (15973)
15c37e98a by Ankita Victor-Levi, perf: Fix redundant filter evaluation in null-aware joins (16460)
335ac2faa by Bradley Dice, fix(cuda): Scope -G debug flag to Velox targets only (16470)
360c2d8c7 by Joy Haldar, feat: Skip iceberg positional delete files by position bounds (16268)

velox_branch: https://github.com/IBM/velox/commits/dft-2026_03_03

Related issue: #6887
fixes: #11630

Upstream Velox's New Commits:
f7906fbbc by Kent Yao, feat(spark): Add assert_not_null function (#16562)
7d3072c85 by Anass Al-Wohoush, Revert D94871321: feat: Add cache lookup and zero-copy APIs to BufferedInput
54eed172a by Xiaoxuan Meng, feat: Add cache lookup and zero-copy APIs to BufferedInput (#16587)
283626a64 by Simon Eves, feat: Support Arrow Decimal64 type via Bridge (#16474)
2d8cec59c by Karthikeyan, fix(cudf): Replace default memory resource and stream with explicit output MR and data stream in Cudf operators (#16454)
9a8e535ee by Wei He, feat(aggregate): Support variadic arguments in simple aggregation function interface (#16475)
236424117 by Krishna Pai, feat: Update to Opus 4.6 and make model configurable (#16594)
f90730ce5 by Jimmy Lu, feat: Add table_scan_output_batch_rows_override (#16571)
0d8ca0ce8 by Shang Ma, build: Explicitly enable folly coroutines when compiler supports them (#16581)
11b64f0ca by Xiao Du, feat: Impl memory compact in Aggregate and GroupingSet (#16476)
b38f9dc6f by Masha Basmanova, feat: Add kindName() API to IExpr (#16576)
68b2f34ce by Ke Wang, feat: Add option to collect decompression time for drwf reader (#16523)
7b2e58464 by Raymond Lin, fix: Handle empty keyNodes in SelectiveFlatMapAsStructReader (#16570)
76d10eb4c by Ke Wang, feat: Add totalRemainingFilterCpuNanos metric for table scan (#16564)
421c6fc0e by Devavret Makkar, fix(cuDF): Fix stream ordering issue in CudfHashAggregation Distinct (#16525)
70e9b784d by Krishna Pai, feat(ci): Add /claude-query command for asking questions about PRs (#16567)
c3f4ec311 by Rui Mo, feat: Add Spark TIMESTAMP_NTZ type (#16344)
e6358b677 by Pramod Satya, refactor(cuDF): Consolidate cuDF configurations into single config file (#16528)
085e6f9c5 by Rui Mo, fix(fuzzer): Disable file handle cache in Aggregate fuzzer test (#16548)
bf2a4107a by Shrinidhi Joshi, docs: Add hash-table-caching documentation (#16554)
f760d54f9 by Shakyan Kushwaha, feat: Add localtimestamp Presto function (#15605)
ecd5a60cc by Allen Shen, refactor: Extract apply lambda utility function (#16315)
6de3b6ddb by Xiaoxuan Meng, feat: Add FileLayout API for optimized reader IO and writer state tracking (#16561)
600b0ba8a by Eric Jia, refactor: Optimize HiveConnectorUtil: deduplicate and endWith functions (#16508)
01c114921 by Jimmy Lu, perf: Optimize deduplicated readers when all nested rows are selected (#16550)
493517d19 by Xiaoxuan Meng, fix: Clear barrier flag when task terminates (#16539)
090d01368 by Krishna Pai, feat(ci): Use Opus 4.1 model with stricter review guidelines (#16552)
54b03a289 by Simon Eves, misc(cudf): Disable test AggregationTest.countStarGlobal pending a fix for global COUNT(*) (#16493)
c14f6e380 by Charlie Arnold, Add Rust code generation for RemoteFunction.thrift (#16458)
4e5fb428f by Krishna Pai, fix(ci): Fix comment author field and PR permissions in claude-review (#16540)
caad670d0 by Natasha Sehgal, feat: Use emplace_back instead of push_back in Parquet writer Schema (#16392)
9046fe2b3 by Krishna Pai, fix: Update review bot to use results response (#16536)
53dcda01e by Xiaoxuan Meng, fix: Clear AsyncDataCache in test SetUp to fix flakiness (#16533)
3591d31dc by Krishna Pai, fix(ci): Enable posting of claude reviews (#16534)
cfc3353a2 by Abhinav Mukherjee, Add TRANSFORM_WITH_INDEX UDF (#15978)
b6e5220f9 by Abhinav Mukherjee, Fix PartitionedOutput crash after flush (#16496)
8693d331e by Abhinav Mukherjee, Add map_trim_values UDF (#15973)
15c37e98a by Ankita Victor-Levi, perf: Fix redundant filter evaluation in null-aware joins (#16460)
335ac2faa by Bradley Dice, fix(cuda): Scope -G debug flag to Velox targets only (#16470)
360c2d8c7 by Joy Haldar, feat: Skip iceberg positional delete files by position bounds (#16268)

Signed-off-by: glutenperfbot <glutenperfbot@glutenproject-internal.com>
zhouyuan and others added 4 commits March 3, 2026 13:22
Signed-off-by: Yuan <yuanzhou@apache.org>
Signed-off-by: Yuan <yuanzhou@apache.org>
Signed-off-by: Yuan <yuanzhou@apache.org>
@zhouyuan
Copy link
Member

zhouyuan commented Mar 4, 2026

Note: the iceberg test is added in this rebase (#11630)
the issue is on dft branch the iceberg connector is not enabled by default:
IBM/velox@5ae7dc8

Cc: @rui-mo @jinchengchenghh

@jinchengchenghh
Copy link
Contributor

After we switch to meta velox branch, we should enable Iceberg Connector by this way.
#11641, will temporarily close it after we fix it in enhanced feature branch.

jinchengchenghh and others added 2 commits March 4, 2026 15:26
Signed-off-by: Yuan <yuanzhou@apache.org>
@zhouyuan zhouyuan force-pushed the tagging-2026_03_03 branch from 5606e47 to 81ec1aa Compare March 4, 2026 21:38
Signed-off-by: Yuan <yuanzhou@apache.org>
@zhouyuan zhouyuan force-pushed the tagging-2026_03_03 branch from 81ec1aa to 366b432 Compare March 4, 2026 21:45
@zhouyuan zhouyuan merged commit fbcd3e7 into apache:main Mar 4, 2026
11 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[VL] Iceberg tests failed and were skipped

4 participants