Skip to content

Unify download management#7490

Merged
connortsui20 merged 3 commits intodevelopfrom
ct/unify-download
Apr 16, 2026
Merged

Unify download management#7490
connortsui20 merged 3 commits intodevelopfrom
ct/unify-download

Conversation

@connortsui20
Copy link
Copy Markdown
Contributor

@connortsui20 connortsui20 commented Apr 16, 2026

Summary

Unifies the download management for benchmarks. Also makes the downloads smarter with AIMD and nicer progress bars.

Testing

I just ran it in my terminal and it works well enough.

Let me know if we want a video for this and I can figure that out.

Screen.Recording.2026-04-16.at.1.33.27.PM.mov

@connortsui20 connortsui20 added changelog/feature A new feature action/benchmark Trigger full benchmarks to run on this PR labels Apr 16, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 16, 2026

Merging this PR will degrade performance by 18.91%

❌ 1 regressed benchmark
✅ 1162 untouched benchmarks
⏩ 1457 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation old_alp_prim_test_between[f64, 32768] 283.9 µs 350.2 µs -18.91%

Comparing ct/unify-download (61ea8c7) with develop (c69957f)

Open in CodSpeed

Footnotes

  1. 1457 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Vortex (geomean): 1.017x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.3%


duckdb / vortex-file-compressed (1.030x ➖, 0↑ 1↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10755308 10893702 0.99
statpopgen_q01/duckdb:vortex-file-compressed 🚨 28271873 22039590 1.28
statpopgen_q02/duckdb:vortex-file-compressed 1360000213 1375865631 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3131563817 3095141273 1.01
statpopgen_q04/duckdb:vortex-file-compressed 3163282937 3064831742 1.03
statpopgen_q05/duckdb:vortex-file-compressed 1462219462 1475323384 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2144446152 2141666250 1.00
statpopgen_q07/duckdb:vortex-file-compressed 244035523 235451764 1.04
statpopgen_q08/duckdb:vortex-file-compressed 272544202 274016917 0.99
statpopgen_q09/duckdb:vortex-file-compressed 2977954514 2898497725 1.03
statpopgen_q10/duckdb:vortex-file-compressed 4702491838 4689146173 1.00
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10752479 10746905 1.00
statpopgen_q01/duckdb:vortex-compact 173094865 166647635 1.04
statpopgen_q02/duckdb:vortex-compact 1825066937 1799056914 1.01
statpopgen_q03/duckdb:vortex-compact 3449014395 3464070026 1.00
statpopgen_q04/duckdb:vortex-compact 3487700918 3483611052 1.00
statpopgen_q05/duckdb:vortex-compact 1851983735 1792770264 1.03
statpopgen_q06/duckdb:vortex-compact 2703409859 2650017914 1.02
statpopgen_q07/duckdb:vortex-compact 881097341 887077660 0.99
statpopgen_q08/duckdb:vortex-compact 921938419 939406915 0.98
statpopgen_q09/duckdb:vortex-compact 3292256507 3305305622 1.00
statpopgen_q10/duckdb:vortex-compact 5367479464 5429954957 0.99
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 319364870 328721366 0.97
statpopgen_q01/duckdb:parquet 415986435 407433452 1.02
statpopgen_q02/duckdb:parquet 998926466 1023716031 0.98
statpopgen_q03/duckdb:parquet 1507295862 1513800792 1.00
statpopgen_q04/duckdb:parquet 1524419193 1560433263 0.98
statpopgen_q05/duckdb:parquet 1008189445 1011978539 1.00
statpopgen_q06/duckdb:parquet 1489578930 1489503892 1.00
statpopgen_q07/duckdb:parquet 1306904495 1327904720 0.98
statpopgen_q08/duckdb:parquet 1307356397 1316339048 0.99
statpopgen_q09/duckdb:parquet 1412831279 1373706610 1.03
statpopgen_q10/duckdb:parquet 2682352840 2677570344 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +0.1% -2.8% +3.0% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -1.3% -2.8% +1.6% +10.0% ➖ noise
1 duckdb:vortex-compact +3.9% +2.1% +1.7% +45.7% ➖ noise
1 duckdb:vortex-file-compressed +28.3% +2.1% +25.6% +257.1% ➖ noise
2 duckdb:vortex-compact +1.4% -2.4% +4.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.2% -2.4% +1.3% +10.0% ➖ noise
3 duckdb:vortex-compact -0.4% -0.4% -0.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.2% -0.4% +1.6% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% -2.3% +2.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.2% -2.3% +5.7% +10.0% ➖ noise
5 duckdb:vortex-compact +3.3% -0.4% +3.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.9% -0.4% -0.5% +10.0% ➖ noise
6 duckdb:vortex-compact +2.0% +0.0% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.1% +0.0% +0.1% +10.0% ➖ noise
7 duckdb:vortex-compact -0.7% -1.6% +0.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.6% -1.6% +5.3% +15.0% ➖ noise
8 duckdb:vortex-compact -1.9% -0.7% -1.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.5% -0.7% +0.1% +10.0% ➖ noise
9 duckdb:vortex-compact -0.4% +2.8% -3.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.7% +2.8% -0.1% +10.0% ➖ noise
10 duckdb:vortex-compact -1.2% +0.2% -1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.3% +0.2% +0.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.037x ➖
Shifts: Parquet (control) +3.7% · Median polish +0.6%


datafusion / vortex-file-compressed (1.011x ➖, 1↑ 2↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 5021172 5794150 0.87
fineweb_q01/datafusion:vortex-file-compressed 30163843 27501920 1.10
fineweb_q02/datafusion:vortex-file-compressed 29273715 31316030 0.93
fineweb_q03/datafusion:vortex-file-compressed 81987110 87787134 0.93
fineweb_q04/datafusion:vortex-file-compressed 255082041 255404264 1.00
fineweb_q05/datafusion:vortex-file-compressed 222284720 223064112 1.00
fineweb_q06/datafusion:vortex-file-compressed 🚨 77194811 61279887 1.26
fineweb_q07/datafusion:vortex-file-compressed 71969699 74344834 0.97
fineweb_q08/datafusion:vortex-file-compressed 🚨 26104420 23720021 1.10
datafusion / vortex-compact (1.025x ➖, 0↑ 1↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5339354 4514478 1.18
fineweb_q01/datafusion:vortex-compact 162904959 160359420 1.02
fineweb_q02/datafusion:vortex-compact 164868686 166394316 0.99
fineweb_q03/datafusion:vortex-compact 1491638957 1453735731 1.03
fineweb_q04/datafusion:vortex-compact 1602495982 1583426714 1.01
fineweb_q05/datafusion:vortex-compact 1271060609 1254664235 1.01
fineweb_q06/datafusion:vortex-compact 705069069 691760289 1.02
fineweb_q07/datafusion:vortex-compact 744257563 730358412 1.02
fineweb_q08/datafusion:vortex-compact 20638138 21522992 0.96
datafusion / parquet (1.045x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6410970 6247179 1.03
fineweb_q01/datafusion:parquet 293684793 286378820 1.03
fineweb_q02/datafusion:parquet 295413215 286289030 1.03
fineweb_q03/datafusion:parquet 302555448 278155953 1.09
fineweb_q04/datafusion:parquet 308637051 296345442 1.04
fineweb_q05/datafusion:parquet 306238916 289064530 1.06
fineweb_q06/datafusion:parquet 298104663 289780400 1.03
fineweb_q07/datafusion:parquet 294154482 280328919 1.05
fineweb_q08/datafusion:parquet 292336856 276236890 1.06
duckdb / vortex-file-compressed (0.992x ➖, 1↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3419234 3226179 1.06
fineweb_q01/duckdb:vortex-file-compressed 25508894 26722621 0.95
fineweb_q02/duckdb:vortex-file-compressed 26439252 26423801 1.00
fineweb_q03/duckdb:vortex-file-compressed 🚀 157581807 175108417 0.90
fineweb_q04/duckdb:vortex-file-compressed 233956436 225910603 1.04
fineweb_q05/duckdb:vortex-file-compressed 218195246 221293528 0.99
fineweb_q06/duckdb:vortex-file-compressed 62819414 64795845 0.97
fineweb_q07/duckdb:vortex-file-compressed 64779301 66528181 0.97
fineweb_q08/duckdb:vortex-file-compressed 25507380 24154843 1.06
duckdb / vortex-compact (0.993x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4186360 4000986 1.05
fineweb_q01/duckdb:vortex-compact 98576833 106399164 0.93
fineweb_q02/duckdb:vortex-compact 115385254 118662963 0.97
fineweb_q03/duckdb:vortex-compact 854408630 864614949 0.99
fineweb_q04/duckdb:vortex-compact 897420671 914477160 0.98
fineweb_q05/duckdb:vortex-compact 812159551 819070688 0.99
fineweb_q06/duckdb:vortex-compact 464089868 465002158 1.00
fineweb_q07/duckdb:vortex-compact 476926967 477191604 1.00
fineweb_q08/duckdb:vortex-compact 22559689 21673438 1.04
duckdb / parquet (1.028x ➖, 0↑ 1↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 31115015 30429038 1.02
fineweb_q01/duckdb:parquet 82798328 81225137 1.02
fineweb_q02/duckdb:parquet 84031011 83224217 1.01
fineweb_q03/duckdb:parquet 324429737 307673995 1.05
fineweb_q04/duckdb:parquet 443967203 435347304 1.02
fineweb_q05/duckdb:parquet 409646843 407400666 1.01
fineweb_q06/duckdb:parquet 196839183 196222508 1.00
fineweb_q07/duckdb:parquet 207983343 206383491 1.01
fineweb_q08/duckdb:parquet 🚨 32078382 28723495 1.12
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +18.3% +2.4% +15.5% +40.6% ➖ noise
0 datafusion:vortex-file-compressed -13.3% +2.4% -15.4% +72.0% ➖ noise
0 duckdb:vortex-compact +4.6% +2.4% +2.1% +36.4% ➖ noise
0 duckdb:vortex-file-compressed +6.0% +2.4% +3.5% +46.9% ➖ noise
1 datafusion:vortex-compact +1.6% +2.2% -0.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +9.7% +2.2% +7.3% +18.0% ➖ noise
1 duckdb:vortex-compact -7.4% +2.2% -9.4% +13.8% ➖ noise
1 duckdb:vortex-file-compressed -4.5% +2.2% -6.6% +51.7% ➖ noise
2 datafusion:vortex-compact -0.9% +2.1% -2.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -6.5% +2.1% -8.4% +22.8% ➖ noise
2 duckdb:vortex-compact -2.8% +2.1% -4.7% +11.2% ➖ noise
2 duckdb:vortex-file-compressed +0.1% +2.1% -2.0% +22.4% ➖ noise
3 datafusion:vortex-compact +2.6% +7.1% -4.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -6.6% +7.1% -12.8% +17.7% ➖ noise
3 duckdb:vortex-compact -1.2% +7.1% -7.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -10.0% +7.1% -16.0% +24.8% ➖ noise
4 datafusion:vortex-compact +1.2% +3.1% -1.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -0.1% +3.1% -3.1% +10.0% ➖ noise
4 duckdb:vortex-compact -1.9% +3.1% -4.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.6% +3.1% +0.5% +10.0% ➖ noise
5 datafusion:vortex-compact +1.3% +3.2% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.3% +3.2% -3.4% +10.0% ➖ noise
5 duckdb:vortex-compact -0.8% +3.2% -3.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.4% +3.2% -4.5% +10.0% ➖ noise
6 datafusion:vortex-compact +1.9% +1.6% +0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +26.0% +1.6% +24.0% +11.9% 🚨 regression
6 duckdb:vortex-compact -0.2% +1.6% -1.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.1% +1.6% -4.6% +17.3% ➖ noise
7 datafusion:vortex-compact +1.9% +2.8% -0.9% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -3.2% +2.8% -5.9% +10.0% ➖ noise
7 duckdb:vortex-compact -0.1% +2.8% -2.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.6% +2.8% -5.3% +11.9% ➖ noise
8 datafusion:vortex-compact -4.1% +8.7% -11.8% +43.1% ➖ noise
8 datafusion:vortex-file-compressed +10.1% +8.7% +1.2% +19.9% ➖ noise
8 duckdb:vortex-compact +4.1% +8.7% -4.3% +17.2% ➖ noise
8 duckdb:vortex-file-compressed +5.6% +8.7% -2.9% +13.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.1%
Vortex (geomean): 0.947x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish -6.4%


datafusion / vortex-file-compressed (1.081x ➖, 0↑ 2↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 211745349 208704191 1.01
tpch_q02/datafusion:vortex-file-compressed 533957202 439157573 1.22
tpch_q03/datafusion:vortex-file-compressed 420337637 364057598 1.15
tpch_q04/datafusion:vortex-file-compressed 222715698 193513280 1.15
tpch_q05/datafusion:vortex-file-compressed 471112737 456828039 1.03
tpch_q06/datafusion:vortex-file-compressed 325798509 272536416 1.20
tpch_q07/datafusion:vortex-file-compressed 🚨 458797884 350386867 1.31
tpch_q08/datafusion:vortex-file-compressed 712038018 624195525 1.14
tpch_q09/datafusion:vortex-file-compressed 435101086 436569744 1.00
tpch_q10/datafusion:vortex-file-compressed 447137385 541794530 0.83
tpch_q11/datafusion:vortex-file-compressed 318207208 314134588 1.01
tpch_q12/datafusion:vortex-file-compressed 342842652 405820621 0.84
tpch_q13/datafusion:vortex-file-compressed 164522214 179286510 0.92
tpch_q14/datafusion:vortex-file-compressed 191823914 207405494 0.92
tpch_q15/datafusion:vortex-file-compressed 378306588 360526764 1.05
tpch_q16/datafusion:vortex-file-compressed 199912155 181536034 1.10
tpch_q17/datafusion:vortex-file-compressed 363441741 334535535 1.09
tpch_q18/datafusion:vortex-file-compressed 🚨 358584643 269487714 1.33
tpch_q19/datafusion:vortex-file-compressed 395150826 319062915 1.24
tpch_q20/datafusion:vortex-file-compressed 434319485 341881139 1.27
tpch_q21/datafusion:vortex-file-compressed 476232358 437954733 1.09
tpch_q22/datafusion:vortex-file-compressed 166991387 155742603 1.07
datafusion / vortex-compact (0.890x ➖, 3↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 265597636 288165177 0.92
tpch_q02/datafusion:vortex-compact 446919043 483451181 0.92
tpch_q03/datafusion:vortex-compact 364682004 417233386 0.87
tpch_q04/datafusion:vortex-compact 231251654 250875348 0.92
tpch_q05/datafusion:vortex-compact 385349468 417448400 0.92
tpch_q06/datafusion:vortex-compact 302902187 345450665 0.88
tpch_q07/datafusion:vortex-compact 436594333 458766451 0.95
tpch_q08/datafusion:vortex-compact 671335127 768110571 0.87
tpch_q09/datafusion:vortex-compact 462341306 590128141 0.78
tpch_q10/datafusion:vortex-compact 594106752 496166991 1.20
tpch_q11/datafusion:vortex-compact 312470128 276995828 1.13
tpch_q12/datafusion:vortex-compact 484113718 439357435 1.10
tpch_q13/datafusion:vortex-compact 127195946 159235139 0.80
tpch_q14/datafusion:vortex-compact 262165800 269811429 0.97
tpch_q15/datafusion:vortex-compact 510011681 475991606 1.07
tpch_q16/datafusion:vortex-compact 209847169 229878785 0.91
tpch_q17/datafusion:vortex-compact 🚀 372329586 635463214 0.59
tpch_q18/datafusion:vortex-compact 🚀 290435870 429094623 0.68
tpch_q19/datafusion:vortex-compact 509856260 621235207 0.82
tpch_q20/datafusion:vortex-compact 475881210 475830737 1.00
tpch_q21/datafusion:vortex-compact 525080730 594083142 0.88
tpch_q22/datafusion:vortex-compact 🚀 153718990 234715067 0.65
datafusion / parquet (1.070x ➖, 0↑ 2↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 230071078 232957110 0.99
tpch_q02/datafusion:parquet 475485516 437849793 1.09
tpch_q03/datafusion:parquet 🚨 493186854 328057004 1.50
tpch_q04/datafusion:parquet 🚨 224941523 161509118 1.39
tpch_q05/datafusion:parquet 557809854 532183782 1.05
tpch_q06/datafusion:parquet 159159806 138531607 1.15
tpch_q07/datafusion:parquet 476994608 496148606 0.96
tpch_q08/datafusion:parquet 611654085 585904350 1.04
tpch_q09/datafusion:parquet 475111073 471366713 1.01
tpch_q10/datafusion:parquet 511775203 534525645 0.96
tpch_q11/datafusion:parquet 348109160 323089631 1.08
tpch_q12/datafusion:parquet 253469244 224104599 1.13
tpch_q13/datafusion:parquet 448405420 433502473 1.03
tpch_q14/datafusion:parquet 175639305 169837898 1.03
tpch_q15/datafusion:parquet 304108169 294174479 1.03
tpch_q16/datafusion:parquet 189516166 187398642 1.01
tpch_q17/datafusion:parquet 383438678 372025054 1.03
tpch_q18/datafusion:parquet 494269521 450727345 1.10
tpch_q19/datafusion:parquet 417480681 379526708 1.10
tpch_q20/datafusion:parquet 399328339 324812343 1.23
tpch_q21/datafusion:parquet 638417267 620752500 1.03
tpch_q22/datafusion:parquet 133774578 170725753 0.78
duckdb / vortex-file-compressed (0.909x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 306593591 321253210 0.95
tpch_q02/duckdb:vortex-file-compressed 936013216 1090276611 0.86
tpch_q03/duckdb:vortex-file-compressed 601747651 665381367 0.90
tpch_q04/duckdb:vortex-file-compressed 418386531 422921576 0.99
tpch_q05/duckdb:vortex-file-compressed 829178885 926711590 0.89
tpch_q06/duckdb:vortex-file-compressed 400736408 433473826 0.92
tpch_q07/duckdb:vortex-file-compressed 757959524 825745972 0.92
tpch_q08/duckdb:vortex-file-compressed 913459066 973219765 0.94
tpch_q09/duckdb:vortex-file-compressed 860576278 1024873303 0.84
tpch_q10/duckdb:vortex-file-compressed 698488103 727528867 0.96
tpch_q11/duckdb:vortex-file-compressed 493672423 574504656 0.86
tpch_q12/duckdb:vortex-file-compressed 490508979 500261601 0.98
tpch_q13/duckdb:vortex-file-compressed 444859469 617639002 0.72
tpch_q14/duckdb:vortex-file-compressed 479107940 504511056 0.95
tpch_q15/duckdb:vortex-file-compressed 281657107 311856944 0.90
tpch_q16/duckdb:vortex-file-compressed 374262873 413786921 0.90
tpch_q17/duckdb:vortex-file-compressed 768109377 785423633 0.98
tpch_q18/duckdb:vortex-file-compressed 553195890 665952610 0.83
tpch_q19/duckdb:vortex-file-compressed 484582003 508194437 0.95
tpch_q20/duckdb:vortex-file-compressed 844263401 859672790 0.98
tpch_q21/duckdb:vortex-file-compressed 1052400909 1234889292 0.85
tpch_q22/duckdb:vortex-file-compressed 341084191 357771929 0.95
duckdb / vortex-compact (0.919x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 306347407 306160492 1.00
tpch_q02/duckdb:vortex-compact 863842842 1019971197 0.85
tpch_q03/duckdb:vortex-compact 701164632 646339098 1.08
tpch_q04/duckdb:vortex-compact 316345837 350519649 0.90
tpch_q05/duckdb:vortex-compact 792905697 933557142 0.85
tpch_q06/duckdb:vortex-compact 406797767 445512229 0.91
tpch_q07/duckdb:vortex-compact 772990797 858779441 0.90
tpch_q08/duckdb:vortex-compact 954537566 958300540 1.00
tpch_q09/duckdb:vortex-compact 843665568 949614144 0.89
tpch_q10/duckdb:vortex-compact 702888036 733227927 0.96
tpch_q11/duckdb:vortex-compact 499039867 561576169 0.89
tpch_q12/duckdb:vortex-compact 466349599 505984940 0.92
tpch_q13/duckdb:vortex-compact 453229080 494887975 0.92
tpch_q14/duckdb:vortex-compact 506622246 529798791 0.96
tpch_q15/duckdb:vortex-compact 275777637 347073909 0.79
tpch_q16/duckdb:vortex-compact 359120463 335874589 1.07
tpch_q17/duckdb:vortex-compact 592998515 688523113 0.86
tpch_q18/duckdb:vortex-compact 480694251 458835383 1.05
tpch_q19/duckdb:vortex-compact 435263458 518051760 0.84
tpch_q20/duckdb:vortex-compact 716728316 866866315 0.83
tpch_q21/duckdb:vortex-compact 1099876535 1113569784 0.99
tpch_q22/duckdb:vortex-compact 344862467 405875724 0.85
duckdb / parquet (0.952x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 432262553 453812521 0.95
tpch_q02/duckdb:parquet 1206500864 1249252345 0.97
tpch_q03/duckdb:parquet 1139126394 1043837324 1.09
tpch_q04/duckdb:parquet 667489439 657183625 1.02
tpch_q05/duckdb:parquet 1626710784 1487705338 1.09
tpch_q06/duckdb:parquet 466261963 409838335 1.14
tpch_q07/duckdb:parquet 1250079869 1350362423 0.93
tpch_q08/duckdb:parquet 1641890814 1712161024 0.96
tpch_q09/duckdb:parquet 1413674160 1556465510 0.91
tpch_q10/duckdb:parquet 1275764419 1279990175 1.00
tpch_q11/duckdb:parquet 874826173 898667172 0.97
tpch_q12/duckdb:parquet 647824917 681936061 0.95
tpch_q13/duckdb:parquet 886704466 871973458 1.02
tpch_q14/duckdb:parquet 648358201 685533657 0.95
tpch_q15/duckdb:parquet 468995999 556104816 0.84
tpch_q16/duckdb:parquet 612066368 652348897 0.94
tpch_q17/duckdb:parquet 740848671 897515641 0.83
tpch_q18/duckdb:parquet 851281351 873226188 0.97
tpch_q19/duckdb:parquet 703848637 941002228 0.75
tpch_q20/duckdb:parquet 1138598641 1205200821 0.94
tpch_q21/duckdb:parquet 1124944549 1241482871 0.91
tpch_q22/duckdb:parquet 545270676 599883614 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.8% -3.0% -5.0% +72.7% ➖ noise
1 datafusion:vortex-file-compressed +1.5% -3.0% +4.6% +82.9% ➖ noise
1 duckdb:vortex-compact +0.1% -3.0% +3.2% +40.0% ➖ noise
1 duckdb:vortex-file-compressed -4.6% -3.0% -1.6% +44.0% ➖ noise
2 datafusion:vortex-compact -7.6% +2.4% -9.7% +31.9% ➖ noise
2 datafusion:vortex-file-compressed +21.6% +2.4% +18.7% +33.9% ➖ noise
2 duckdb:vortex-compact -15.3% +2.4% -17.3% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -14.1% +2.4% -16.2% +30.0% ➖ noise
3 datafusion:vortex-compact -12.6% +28.1% -31.8% +47.2% ➖ noise
3 datafusion:vortex-file-compressed +15.5% +28.1% -9.9% +66.5% ➖ noise
3 duckdb:vortex-compact +8.5% +28.1% -15.3% +40.5% ➖ noise
3 duckdb:vortex-file-compressed -9.6% +28.1% -29.4% +41.3% ✅ faster
4 datafusion:vortex-compact -7.8% +18.9% -22.5% +31.4% ➖ noise
4 datafusion:vortex-file-compressed +15.1% +18.9% -3.2% +35.2% ➖ noise
4 duckdb:vortex-compact -9.7% +18.9% -24.1% +38.7% ➖ noise
4 duckdb:vortex-file-compressed -1.1% +18.9% -16.8% +30.0% ➖ noise
5 datafusion:vortex-compact -7.7% +7.1% -13.8% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +3.1% +7.1% -3.7% +30.0% ➖ noise
5 duckdb:vortex-compact -15.1% +7.1% -20.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -10.5% +7.1% -16.4% +30.0% ➖ noise
6 datafusion:vortex-compact -12.3% +14.3% -23.3% +30.0% ✅ faster
6 datafusion:vortex-file-compressed +19.5% +14.3% +4.6% +35.9% ➖ noise
6 duckdb:vortex-compact -8.7% +14.3% -20.1% +31.2% ➖ noise
6 duckdb:vortex-file-compressed -7.6% +14.3% -19.1% +31.0% ➖ noise
7 datafusion:vortex-compact -4.8% -5.7% +0.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +30.9% -5.7% +38.8% +30.0% 🚨 regression
7 duckdb:vortex-compact -10.0% -5.7% -4.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -8.2% -5.7% -2.7% +30.0% ➖ noise
8 datafusion:vortex-compact -12.6% +0.1% -12.6% +47.5% ➖ noise
8 datafusion:vortex-file-compressed +14.1% +0.1% +14.0% +30.0% ➖ noise
8 duckdb:vortex-compact -0.4% +0.1% -0.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.1% +0.1% -6.2% +30.0% ➖ noise
9 datafusion:vortex-compact -21.7% -4.3% -18.1% +38.1% ➖ noise
9 datafusion:vortex-file-compressed -0.3% -4.3% +4.2% +32.0% ➖ noise
9 duckdb:vortex-compact -11.2% -4.3% -7.1% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -16.0% -4.3% -12.2% +30.0% ➖ noise
10 datafusion:vortex-compact +19.7% -2.3% +22.6% +30.0% ➖ noise
10 datafusion:vortex-file-compressed -17.5% -2.3% -15.5% +30.0% ➖ noise
10 duckdb:vortex-compact -4.1% -2.3% -1.9% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -4.0% -2.3% -1.7% +30.0% ➖ noise
11 datafusion:vortex-compact +12.8% +2.4% +10.1% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +1.3% +2.4% -1.1% +30.0% ➖ noise
11 duckdb:vortex-compact -11.1% +2.4% -13.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -14.1% +2.4% -16.1% +30.0% ➖ noise
12 datafusion:vortex-compact +10.2% +3.7% +6.3% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -15.5% +3.7% -18.5% +30.0% ➖ noise
12 duckdb:vortex-compact -7.8% +3.7% -11.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -1.9% +3.7% -5.4% +30.0% ➖ noise
13 datafusion:vortex-compact -20.1% +2.6% -22.1% +60.1% ➖ noise
13 datafusion:vortex-file-compressed -8.2% +2.6% -10.5% +35.5% ➖ noise
13 duckdb:vortex-compact -8.4% +2.6% -10.7% +36.1% ➖ noise
13 duckdb:vortex-file-compressed -28.0% +2.6% -29.8% +36.9% ✅ faster
14 datafusion:vortex-compact -2.8% -1.1% -1.8% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -7.5% -1.1% -6.5% +30.0% ➖ noise
14 duckdb:vortex-compact -4.4% -1.1% -3.3% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -5.0% -1.1% -4.0% +30.0% ➖ noise
15 datafusion:vortex-compact +7.1% -6.6% +14.8% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +4.9% -6.6% +12.4% +30.0% ➖ noise
15 duckdb:vortex-compact -20.5% -6.6% -14.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -9.7% -6.6% -3.3% +30.0% ➖ noise
16 datafusion:vortex-compact -8.7% -2.6% -6.3% +60.7% ➖ noise
16 datafusion:vortex-file-compressed +10.1% -2.6% +13.1% +30.0% ➖ noise
16 duckdb:vortex-compact +6.9% -2.6% +9.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -9.6% -2.6% -7.1% +30.0% ➖ noise
17 datafusion:vortex-compact -41.4% -7.8% -36.5% +37.2% ✅ faster
17 datafusion:vortex-file-compressed +8.6% -7.8% +17.8% +30.0% ➖ noise
17 duckdb:vortex-compact -13.9% -7.8% -6.6% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.2% -7.8% +6.0% +30.0% ➖ noise
18 datafusion:vortex-compact -32.3% +3.4% -34.5% +45.6% ✅ faster
18 datafusion:vortex-file-compressed +33.1% +3.4% +28.7% +30.0% ➖ noise
18 duckdb:vortex-compact +4.8% +3.4% +1.3% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -16.9% +3.4% -19.7% +30.0% ➖ noise
19 datafusion:vortex-compact -17.9% -9.3% -9.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed +23.8% -9.3% +36.5% +30.0% 🚨 regression
19 duckdb:vortex-compact -16.0% -9.3% -7.4% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -4.6% -9.3% +5.1% +31.0% ➖ noise
20 datafusion:vortex-compact +0.0% +7.8% -7.2% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +27.0% +7.8% +17.9% +30.0% ➖ noise
20 duckdb:vortex-compact -17.3% +7.8% -23.3% +30.0% ✅ faster
20 duckdb:vortex-file-compressed -1.8% +7.8% -8.9% +30.0% ➖ noise
21 datafusion:vortex-compact -11.6% -3.5% -8.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +8.7% -3.5% +12.6% +30.0% ➖ noise
21 duckdb:vortex-compact -1.2% -3.5% +2.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -14.8% -3.5% -11.7% +30.0% ➖ noise
22 datafusion:vortex-compact -34.5% -15.6% -22.4% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +7.2% -15.6% +27.1% +30.0% ➖ noise
22 duckdb:vortex-compact -15.0% -15.6% +0.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.7% -15.6% +13.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 1.015x ➖
Parquet (geomean): 1.013x ➖
Shifts: Parquet (control) +1.3% · Median polish +0.9%


datafusion / vortex-file-compressed (1.019x ➖, 0↑ 4↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28596305 27960146 1.02
tpcds_q02/datafusion:vortex-file-compressed 52010270 51570709 1.01
tpcds_q03/datafusion:vortex-file-compressed 20203918 19563060 1.03
tpcds_q04/datafusion:vortex-file-compressed 300784828 291260093 1.03
tpcds_q05/datafusion:vortex-file-compressed 53622081 53130047 1.01
tpcds_q06/datafusion:vortex-file-compressed 51942104 49053911 1.06
tpcds_q07/datafusion:vortex-file-compressed 🚨 54661744 49533208 1.10
tpcds_q08/datafusion:vortex-file-compressed 36122633 35735031 1.01
tpcds_q09/datafusion:vortex-file-compressed 57376338 56669216 1.01
tpcds_q10/datafusion:vortex-file-compressed 46674711 44305197 1.05
tpcds_q11/datafusion:vortex-file-compressed 178592218 164280027 1.09
tpcds_q12/datafusion:vortex-file-compressed 23741800 22057021 1.08
tpcds_q13/datafusion:vortex-file-compressed 55783830 53621475 1.04
tpcds_q14/datafusion:vortex-file-compressed 195479793 195879135 1.00
tpcds_q15/datafusion:vortex-file-compressed 33326830 33823379 0.99
tpcds_q16/datafusion:vortex-file-compressed 28943390 29554916 0.98
tpcds_q17/datafusion:vortex-file-compressed 66707696 64955753 1.03
tpcds_q18/datafusion:vortex-file-compressed 78917071 77361329 1.02
tpcds_q19/datafusion:vortex-file-compressed 29412883 29361267 1.00
tpcds_q20/datafusion:vortex-file-compressed 26284259 25410696 1.03
tpcds_q21/datafusion:vortex-file-compressed 136997250 136042236 1.01
tpcds_q22/datafusion:vortex-file-compressed 56563925 58672713 0.96
tpcds_q23/datafusion:vortex-file-compressed 148039064 143353065 1.03
tpcds_q24/datafusion:vortex-file-compressed 111424834 108151603 1.03
tpcds_q25/datafusion:vortex-file-compressed 65188069 66907003 0.97
tpcds_q26/datafusion:vortex-file-compressed 36032257 37408444 0.96
tpcds_q27/datafusion:vortex-file-compressed 119880537 117057477 1.02
tpcds_q28/datafusion:vortex-file-compressed 49731538 48604674 1.02
tpcds_q29/datafusion:vortex-file-compressed 65893683 66224226 1.00
tpcds_q30/datafusion:vortex-file-compressed 29103326 31085602 0.94
tpcds_q31/datafusion:vortex-file-compressed 91424079 91371445 1.00
tpcds_q32/datafusion:vortex-file-compressed 21943775 21527546 1.02
tpcds_q33/datafusion:vortex-file-compressed 37655778 38291339 0.98
tpcds_q34/datafusion:vortex-file-compressed 29546704 30472844 0.97
tpcds_q35/datafusion:vortex-file-compressed 55248022 55142241 1.00
tpcds_q36/datafusion:vortex-file-compressed 74586003 74193786 1.01
tpcds_q37/datafusion:vortex-file-compressed 34959437 34411685 1.02
tpcds_q38/datafusion:vortex-file-compressed 50669792 51098472 0.99
tpcds_q39/datafusion:vortex-file-compressed 133662901 137855565 0.97
tpcds_q40/datafusion:vortex-file-compressed 53084897 51998410 1.02
tpcds_q41/datafusion:vortex-file-compressed 18432269 17604551 1.05
tpcds_q42/datafusion:vortex-file-compressed 18924920 17912351 1.06
tpcds_q43/datafusion:vortex-file-compressed 32422888 30973757 1.05
tpcds_q44/datafusion:vortex-file-compressed 41405321 40167081 1.03
tpcds_q45/datafusion:vortex-file-compressed 34057677 34335972 0.99
tpcds_q46/datafusion:vortex-file-compressed 45022255 44744243 1.01
tpcds_q47/datafusion:vortex-file-compressed 201829216 201116910 1.00
tpcds_q48/datafusion:vortex-file-compressed 43526668 43423935 1.00
tpcds_q49/datafusion:vortex-file-compressed 69478573 69274184 1.00
tpcds_q50/datafusion:vortex-file-compressed 43734928 46211095 0.95
tpcds_q51/datafusion:vortex-file-compressed 87224694 86760409 1.01
tpcds_q52/datafusion:vortex-file-compressed 19379465 18292044 1.06
tpcds_q53/datafusion:vortex-file-compressed 24358426 24690760 0.99
tpcds_q54/datafusion:vortex-file-compressed 44365336 41910971 1.06
tpcds_q55/datafusion:vortex-file-compressed 17891723 18074993 0.99
tpcds_q56/datafusion:vortex-file-compressed 39030431 39322425 0.99
tpcds_q57/datafusion:vortex-file-compressed 128717747 123013719 1.05
tpcds_q58/datafusion:vortex-file-compressed 68770257 68486588 1.00
tpcds_q59/datafusion:vortex-file-compressed 70720246 71001083 1.00
tpcds_q60/datafusion:vortex-file-compressed 39958749 38791956 1.03
tpcds_q61/datafusion:vortex-file-compressed 49126095 49071031 1.00
tpcds_q62/datafusion:vortex-file-compressed 30714794 30802835 1.00
tpcds_q63/datafusion:vortex-file-compressed 25435486 24745855 1.03
tpcds_q64/datafusion:vortex-file-compressed 457788297 464035804 0.99
tpcds_q65/datafusion:vortex-file-compressed 48407300 47679280 1.02
tpcds_q66/datafusion:vortex-file-compressed 89996396 89023743 1.01
tpcds_q67/datafusion:vortex-file-compressed 118488359 116507412 1.02
tpcds_q68/datafusion:vortex-file-compressed 43250841 43427998 1.00
tpcds_q69/datafusion:vortex-file-compressed 40853204 40643717 1.01
tpcds_q70/datafusion:vortex-file-compressed 115035647 114080746 1.01
tpcds_q71/datafusion:vortex-file-compressed 30082091 30046560 1.00
tpcds_q72/datafusion:vortex-file-compressed 2689579401 2565317165 1.05
tpcds_q73/datafusion:vortex-file-compressed 32300734 32994242 0.98
tpcds_q74/datafusion:vortex-file-compressed 118446974 112538762 1.05
tpcds_q75/datafusion:vortex-file-compressed 123646523 119488901 1.03
tpcds_q76/datafusion:vortex-file-compressed 34767886 33455455 1.04
tpcds_q77/datafusion:vortex-file-compressed 52006157 50061111 1.04
tpcds_q78/datafusion:vortex-file-compressed 128211097 124212597 1.03
tpcds_q79/datafusion:vortex-file-compressed 36640469 36421547 1.01
tpcds_q80/datafusion:vortex-file-compressed 117220070 113123849 1.04
tpcds_q81/datafusion:vortex-file-compressed 🚨 40194408 35757307 1.12
tpcds_q82/datafusion:vortex-file-compressed 38614562 35403153 1.09
tpcds_q83/datafusion:vortex-file-compressed 52688875 50460335 1.04
tpcds_q84/datafusion:vortex-file-compressed 🚨 16783674 15180630 1.11
tpcds_q85/datafusion:vortex-file-compressed 107280325 102637839 1.05
tpcds_q86/datafusion:vortex-file-compressed 20228770 19014659 1.06
tpcds_q87/datafusion:vortex-file-compressed 🚨 55663493 50493948 1.10
tpcds_q88/datafusion:vortex-file-compressed 69563677 67658682 1.03
tpcds_q89/datafusion:vortex-file-compressed 38783962 35491831 1.09
tpcds_q90/datafusion:vortex-file-compressed 18595792 17774481 1.05
tpcds_q91/datafusion:vortex-file-compressed 27716455 25930133 1.07
tpcds_q92/datafusion:vortex-file-compressed 18830018 18852172 1.00
tpcds_q93/datafusion:vortex-file-compressed 33881083 33580943 1.01
tpcds_q94/datafusion:vortex-file-compressed 24518470 24498269 1.00
tpcds_q95/datafusion:vortex-file-compressed 60247344 60337850 1.00
tpcds_q96/datafusion:vortex-file-compressed 14791347 14671737 1.01
tpcds_q97/datafusion:vortex-file-compressed 29390468 29497353 1.00
tpcds_q98/datafusion:vortex-file-compressed 31949636 31834594 1.00
tpcds_q99/datafusion:vortex-file-compressed 44606608 45229642 0.99
datafusion / vortex-compact (1.012x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 35472690 35874059 0.99
tpcds_q02/datafusion:vortex-compact 61223710 60943679 1.00
tpcds_q03/datafusion:vortex-compact 27239209 26271277 1.04
tpcds_q04/datafusion:vortex-compact 335290821 328412067 1.02
tpcds_q05/datafusion:vortex-compact 64985733 67865251 0.96
tpcds_q06/datafusion:vortex-compact 56307284 57173988 0.98
tpcds_q07/datafusion:vortex-compact 64655514 65625666 0.99
tpcds_q08/datafusion:vortex-compact 44521316 43737135 1.02
tpcds_q09/datafusion:vortex-compact 72257523 73022099 0.99
tpcds_q10/datafusion:vortex-compact 65901022 66790410 0.99
tpcds_q11/datafusion:vortex-compact 196582293 187701238 1.05
tpcds_q12/datafusion:vortex-compact 27390174 28121171 0.97
tpcds_q13/datafusion:vortex-compact 124762465 120880528 1.03
tpcds_q14/datafusion:vortex-compact 253845809 262258796 0.97
tpcds_q15/datafusion:vortex-compact 38629639 37690090 1.02
tpcds_q16/datafusion:vortex-compact 39324464 39007122 1.01
tpcds_q17/datafusion:vortex-compact 91986680 92549198 0.99
tpcds_q18/datafusion:vortex-compact 88809654 88037667 1.01
tpcds_q19/datafusion:vortex-compact 44486806 44195958 1.01
tpcds_q20/datafusion:vortex-compact 30220457 30242884 1.00
tpcds_q21/datafusion:vortex-compact 141384371 142913320 0.99
tpcds_q22/datafusion:vortex-compact 64908551 64438825 1.01
tpcds_q23/datafusion:vortex-compact 187275576 181197168 1.03
tpcds_q24/datafusion:vortex-compact 149262824 137204747 1.09
tpcds_q25/datafusion:vortex-compact 103570851 94436782 1.10
tpcds_q26/datafusion:vortex-compact 47215355 46466870 1.02
tpcds_q27/datafusion:vortex-compact 155021182 157778072 0.98
tpcds_q28/datafusion:vortex-compact 89038110 86651601 1.03
tpcds_q29/datafusion:vortex-compact 93053768 93211347 1.00
tpcds_q30/datafusion:vortex-compact 35051324 35313279 0.99
tpcds_q31/datafusion:vortex-compact 136361137 134688610 1.01
tpcds_q32/datafusion:vortex-compact 27261600 27373630 1.00
tpcds_q33/datafusion:vortex-compact 55407241 52367391 1.06
tpcds_q34/datafusion:vortex-compact 49707113 49822663 1.00
tpcds_q35/datafusion:vortex-compact 72801328 70219270 1.04
tpcds_q36/datafusion:vortex-compact 100707333 101540737 0.99
tpcds_q37/datafusion:vortex-compact 48231627 46223117 1.04
tpcds_q38/datafusion:vortex-compact 69152815 69985578 0.99
tpcds_q39/datafusion:vortex-compact 146114551 143779674 1.02
tpcds_q40/datafusion:vortex-compact 57682500 57778149 1.00
tpcds_q41/datafusion:vortex-compact 20535159 21116369 0.97
tpcds_q42/datafusion:vortex-compact 24148653 24693748 0.98
tpcds_q43/datafusion:vortex-compact 37957217 37929562 1.00
tpcds_q44/datafusion:vortex-compact 74986221 71132295 1.05
tpcds_q45/datafusion:vortex-compact 38801723 39676089 0.98
tpcds_q46/datafusion:vortex-compact 70665696 69904482 1.01
tpcds_q47/datafusion:vortex-compact 227393463 233722555 0.97
tpcds_q48/datafusion:vortex-compact 87101735 91811089 0.95
tpcds_q49/datafusion:vortex-compact 89725346 89145992 1.01
tpcds_q50/datafusion:vortex-compact 66358222 65361329 1.02
tpcds_q51/datafusion:vortex-compact 103669778 98838254 1.05
tpcds_q52/datafusion:vortex-compact 26500716 24515314 1.08
tpcds_q53/datafusion:vortex-compact 37831509 36023030 1.05
tpcds_q54/datafusion:vortex-compact 63641021 59744135 1.07
tpcds_q55/datafusion:vortex-compact 26387775 24482885 1.08
tpcds_q56/datafusion:vortex-compact 57374434 55737746 1.03
tpcds_q57/datafusion:vortex-compact 142843919 141170245 1.01
tpcds_q58/datafusion:vortex-compact 80824996 79251898 1.02
tpcds_q59/datafusion:vortex-compact 87633414 84544613 1.04
tpcds_q60/datafusion:vortex-compact 57241585 57186705 1.00
tpcds_q61/datafusion:vortex-compact 71466260 73742707 0.97
tpcds_q62/datafusion:vortex-compact 34693085 32888346 1.05
tpcds_q63/datafusion:vortex-compact 35444808 37353419 0.95
tpcds_q64/datafusion:vortex-compact 541897209 530022453 1.02
tpcds_q65/datafusion:vortex-compact 69626338 70320011 0.99
tpcds_q66/datafusion:vortex-compact 96036907 98690498 0.97
tpcds_q67/datafusion:vortex-compact 127828101 122050787 1.05
tpcds_q68/datafusion:vortex-compact 68494559 69661348 0.98
tpcds_q69/datafusion:vortex-compact 61757746 62849333 0.98
tpcds_q70/datafusion:vortex-compact 124454312 123659793 1.01
tpcds_q71/datafusion:vortex-compact 47169602 47013984 1.00
tpcds_q72/datafusion:vortex-compact 2584946553 2599386776 0.99
tpcds_q73/datafusion:vortex-compact 49878746 52070787 0.96
tpcds_q74/datafusion:vortex-compact 138009633 137829486 1.00
tpcds_q75/datafusion:vortex-compact 163585760 164374986 1.00
tpcds_q76/datafusion:vortex-compact 50836472 51617756 0.98
tpcds_q77/datafusion:vortex-compact 66199600 66315639 1.00
tpcds_q78/datafusion:vortex-compact 149936778 145738410 1.03
tpcds_q79/datafusion:vortex-compact 60436491 59782614 1.01
tpcds_q80/datafusion:vortex-compact 131620209 131248010 1.00
tpcds_q81/datafusion:vortex-compact 40273619 39692988 1.01
tpcds_q82/datafusion:vortex-compact 49215307 47646986 1.03
tpcds_q83/datafusion:vortex-compact 57748289 58117012 0.99
tpcds_q84/datafusion:vortex-compact 19226639 19360510 0.99
tpcds_q85/datafusion:vortex-compact 127005333 127359035 1.00
tpcds_q86/datafusion:vortex-compact 23861433 22320436 1.07
tpcds_q87/datafusion:vortex-compact 70838293 69588805 1.02
tpcds_q88/datafusion:vortex-compact 138966308 138006238 1.01
tpcds_q89/datafusion:vortex-compact 46369354 45854627 1.01
tpcds_q90/datafusion:vortex-compact 24851975 23847321 1.04
tpcds_q91/datafusion:vortex-compact 42667089 39961117 1.07
tpcds_q92/datafusion:vortex-compact 26436745 25922109 1.02
tpcds_q93/datafusion:vortex-compact 46765869 44582886 1.05
tpcds_q94/datafusion:vortex-compact 31886873 30364196 1.05
tpcds_q95/datafusion:vortex-compact 73424655 70650902 1.04
tpcds_q96/datafusion:vortex-compact 27448250 26870727 1.02
tpcds_q97/datafusion:vortex-compact 43011049 43212666 1.00
tpcds_q98/datafusion:vortex-compact 40193146 38818102 1.04
tpcds_q99/datafusion:vortex-compact 51117203 48365855 1.06
datafusion / parquet (1.015x ➖, 0↑ 3↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36026895 36115086 1.00
tpcds_q02/datafusion:parquet 46029214 47180429 0.98
tpcds_q03/datafusion:parquet 14905439 15938338 0.94
tpcds_q04/datafusion:parquet 311686983 338936122 0.92
tpcds_q05/datafusion:parquet 50963782 52496811 0.97
tpcds_q06/datafusion:parquet 67337290 64303447 1.05
tpcds_q07/datafusion:parquet 92098932 86191032 1.07
tpcds_q08/datafusion:parquet 🚨 35750404 31895059 1.12
tpcds_q09/datafusion:parquet 57361987 55379752 1.04
tpcds_q10/datafusion:parquet 84023872 81532618 1.03
tpcds_q11/datafusion:parquet 183192408 181099271 1.01
tpcds_q12/datafusion:parquet 22754663 21956582 1.04
tpcds_q13/datafusion:parquet 88224326 87124856 1.01
tpcds_q14/datafusion:parquet 195003310 194584689 1.00
tpcds_q15/datafusion:parquet 26321681 25255156 1.04
tpcds_q16/datafusion:parquet 28391776 28027310 1.01
tpcds_q17/datafusion:parquet 69830880 68462175 1.02
tpcds_q18/datafusion:parquet 134393765 130209786 1.03
tpcds_q19/datafusion:parquet 28235233 27309315 1.03
tpcds_q20/datafusion:parquet 21736837 21275890 1.02
tpcds_q21/datafusion:parquet 22189560 22331291 0.99
tpcds_q22/datafusion:parquet 156203063 148245010 1.05
tpcds_q23/datafusion:parquet 159312778 160194539 0.99
tpcds_q24/datafusion:parquet 104639780 108704051 0.96
tpcds_q25/datafusion:parquet 70307246 70617958 1.00
tpcds_q26/datafusion:parquet 74556161 74565080 1.00
tpcds_q27/datafusion:parquet 165220684 159965881 1.03
tpcds_q28/datafusion:parquet 49077447 48604671 1.01
tpcds_q29/datafusion:parquet 73749095 72327251 1.02
tpcds_q30/datafusion:parquet 46593267 45022570 1.03
tpcds_q31/datafusion:parquet 77677713 73810105 1.05
tpcds_q32/datafusion:parquet 🚨 25062960 22388582 1.12
tpcds_q33/datafusion:parquet 36467872 35445026 1.03
tpcds_q34/datafusion:parquet 27797113 27653837 1.01
tpcds_q35/datafusion:parquet 89454567 85088284 1.05
tpcds_q36/datafusion:parquet 67324200 63821877 1.05
tpcds_q37/datafusion:parquet 25362778 23366761 1.09
tpcds_q38/datafusion:parquet 53830225 51232123 1.05
tpcds_q39/datafusion:parquet 87944671 82689017 1.06
tpcds_q40/datafusion:parquet 28856006 27293353 1.06
tpcds_q41/datafusion:parquet 17687923 16595020 1.07
tpcds_q42/datafusion:parquet 15127359 13968890 1.08
tpcds_q43/datafusion:parquet 20154486 19060208 1.06
tpcds_q44/datafusion:parquet 42206899 41360094 1.02
tpcds_q45/datafusion:parquet 31859351 32592311 0.98
tpcds_q46/datafusion:parquet 38849033 39001542 1.00
tpcds_q47/datafusion:parquet 140058364 132975142 1.05
tpcds_q48/datafusion:parquet 79507201 79087130 1.01
tpcds_q49/datafusion:parquet 64523888 63772701 1.01
tpcds_q50/datafusion:parquet 47163371 49160637 0.96
tpcds_q51/datafusion:parquet 88863202 88725711 1.00
tpcds_q52/datafusion:parquet 14726773 14611306 1.01
tpcds_q53/datafusion:parquet 21867778 21255815 1.03
tpcds_q54/datafusion:parquet 42565206 42187753 1.01
tpcds_q55/datafusion:parquet 14120450 13633739 1.04
tpcds_q56/datafusion:parquet 34012774 34888795 0.97
tpcds_q57/datafusion:parquet 106144240 106255317 1.00
tpcds_q58/datafusion:parquet 56940351 56544072 1.01
tpcds_q59/datafusion:parquet 58691605 60096023 0.98
tpcds_q60/datafusion:parquet 36145559 35017754 1.03
tpcds_q61/datafusion:parquet 49885309 51567867 0.97
tpcds_q62/datafusion:parquet 28407914 28256372 1.01
tpcds_q63/datafusion:parquet 21940115 21333348 1.03
tpcds_q64/datafusion:parquet 547655052 544131042 1.01
tpcds_q65/datafusion:parquet 44473946 44145406 1.01
tpcds_q66/datafusion:parquet 73010797 76841154 0.95
tpcds_q67/datafusion:parquet 149595132 148011178 1.01
tpcds_q68/datafusion:parquet 39823638 38843411 1.03
tpcds_q69/datafusion:parquet 78560274 77138638 1.02
tpcds_q70/datafusion:parquet 97912261 95777836 1.02
tpcds_q71/datafusion:parquet 26845547 26115976 1.03
tpcds_q72/datafusion:parquet 638464615 635414894 1.00
tpcds_q73/datafusion:parquet 🚨 28683232 25889310 1.11
tpcds_q74/datafusion:parquet 105761134 99831311 1.06
tpcds_q75/datafusion:parquet 116909132 114846336 1.02
tpcds_q76/datafusion:parquet 35561652 34718661 1.02
tpcds_q77/datafusion:parquet 50762754 48616060 1.04
tpcds_q78/datafusion:parquet 124266994 120962049 1.03
tpcds_q79/datafusion:parquet 30747428 30750611 1.00
tpcds_q80/datafusion:parquet 93664379 90866180 1.03
tpcds_q81/datafusion:parquet 42179464 40966212 1.03
tpcds_q82/datafusion:parquet 23169421 23206143 1.00
tpcds_q83/datafusion:parquet 47092312 47579389 0.99
tpcds_q84/datafusion:parquet 46008276 47156423 0.98
tpcds_q85/datafusion:parquet 172012454 171146797 1.01
tpcds_q86/datafusion:parquet 17736359 18323073 0.97
tpcds_q87/datafusion:parquet 48893709 50092321 0.98
tpcds_q88/datafusion:parquet 69337348 68852162 1.01
tpcds_q89/datafusion:parquet 23920715 24161485 0.99
tpcds_q90/datafusion:parquet 18251308 18643844 0.98
tpcds_q91/datafusion:parquet 69843180 68556264 1.02
tpcds_q92/datafusion:parquet 21131899 21776026 0.97
tpcds_q93/datafusion:parquet 33969137 34367807 0.99
tpcds_q94/datafusion:parquet 24496519 25082545 0.98
tpcds_q95/datafusion:parquet 67023530 65362579 1.03
tpcds_q96/datafusion:parquet 14382678 15092756 0.95
tpcds_q97/datafusion:parquet 33123622 33249707 1.00
tpcds_q98/datafusion:parquet 26108373 26135220 1.00
tpcds_q99/datafusion:parquet 28264487 27844699 1.02
duckdb / vortex-file-compressed (1.017x ➖, 0↑ 4↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 22021064 21246104 1.04
tpcds_q02/duckdb:vortex-file-compressed 51473580 51743901 0.99
tpcds_q03/duckdb:vortex-file-compressed 32309498 30746947 1.05
tpcds_q04/duckdb:vortex-file-compressed 104513056 101803985 1.03
tpcds_q05/duckdb:vortex-file-compressed 35107166 34372799 1.02
tpcds_q06/duckdb:vortex-file-compressed 34874108 34737229 1.00
tpcds_q07/duckdb:vortex-file-compressed 22917926 22989333 1.00
tpcds_q08/duckdb:vortex-file-compressed 26138287 25147369 1.04
tpcds_q09/duckdb:vortex-file-compressed 39875851 39531759 1.01
tpcds_q10/duckdb:vortex-file-compressed 37202228 37231273 1.00
tpcds_q11/duckdb:vortex-file-compressed 54300666 55064921 0.99
tpcds_q12/duckdb:vortex-file-compressed 15816522 14500751 1.09
tpcds_q13/duckdb:vortex-file-compressed 32766378 32926264 1.00
tpcds_q14/duckdb:vortex-file-compressed 112690115 113420843 0.99
tpcds_q15/duckdb:vortex-file-compressed 41618249 40540884 1.03
tpcds_q16/duckdb:vortex-file-compressed 31857274 29478459 1.08
tpcds_q17/duckdb:vortex-file-compressed 38134664 35924626 1.06
tpcds_q18/duckdb:vortex-file-compressed 48045410 44106620 1.09
tpcds_q19/duckdb:vortex-file-compressed 🚨 36355193 31992990 1.14
tpcds_q20/duckdb:vortex-file-compressed 🚨 17788625 16116780 1.10
tpcds_q21/duckdb:vortex-file-compressed 20970161 19547018 1.07
tpcds_q22/duckdb:vortex-file-compressed 111282614 104068104 1.07
tpcds_q23/duckdb:vortex-file-compressed 108407218 104820187 1.03
tpcds_q24/duckdb:vortex-file-compressed 51817603 51212194 1.01
tpcds_q25/duckdb:vortex-file-compressed 🚨 38797940 35114629 1.10
tpcds_q26/duckdb:vortex-file-compressed 42003877 38558765 1.09
tpcds_q27/duckdb:vortex-file-compressed 56442154 53273046 1.06
tpcds_q28/duckdb:vortex-file-compressed 37017469 38354420 0.97
tpcds_q29/duckdb:vortex-file-compressed 35501461 32900593 1.08
tpcds_q30/duckdb:vortex-file-compressed 25241313 24926210 1.01
tpcds_q31/duckdb:vortex-file-compressed 32398121 31819259 1.02
tpcds_q32/duckdb:vortex-file-compressed 17155154 16599075 1.03
tpcds_q33/duckdb:vortex-file-compressed 24493244 23671747 1.03
tpcds_q34/duckdb:vortex-file-compressed 18667608 17950704 1.04
tpcds_q35/duckdb:vortex-file-compressed 63409686 59917025 1.06
tpcds_q36/duckdb:vortex-file-compressed 27967909 27136621 1.03
tpcds_q37/duckdb:vortex-file-compressed 22614539 21963832 1.03
tpcds_q38/duckdb:vortex-file-compressed 38157877 37394169 1.02
tpcds_q39/duckdb:vortex-file-compressed 49373649 45648145 1.08
tpcds_q40/duckdb:vortex-file-compressed 24527708 24114070 1.02
tpcds_q41/duckdb:vortex-file-compressed 14397782 14509473 0.99
tpcds_q42/duckdb:vortex-file-compressed 11457678 11394894 1.01
tpcds_q43/duckdb:vortex-file-compressed 29851820 29672991 1.01
tpcds_q44/duckdb:vortex-file-compressed 22550283 22833552 0.99
tpcds_q45/duckdb:vortex-file-compressed 27080201 27778518 0.97
tpcds_q46/duckdb:vortex-file-compressed 45883674 45701835 1.00
tpcds_q47/duckdb:vortex-file-compressed 49678362 50301630 0.99
tpcds_q48/duckdb:vortex-file-compressed 30291092 30444227 0.99
tpcds_q49/duckdb:vortex-file-compressed 30231346 29452970 1.03
tpcds_q50/duckdb:vortex-file-compressed 35064758 34152205 1.03
tpcds_q51/duckdb:vortex-file-compressed 🚨 124551004 98419994 1.27
tpcds_q52/duckdb:vortex-file-compressed 12093424 12610195 0.96
tpcds_q53/duckdb:vortex-file-compressed 19422428 19544236 0.99
tpcds_q54/duckdb:vortex-file-compressed 30307213 30453926 1.00
tpcds_q55/duckdb:vortex-file-compressed 11915177 12530160 0.95
tpcds_q56/duckdb:vortex-file-compressed 23091973 24171064 0.96
tpcds_q57/duckdb:vortex-file-compressed 45200654 44091186 1.03
tpcds_q58/duckdb:vortex-file-compressed 31099889 31573882 0.98
tpcds_q59/duckdb:vortex-file-compressed 78052464 77207399 1.01
tpcds_q60/duckdb:vortex-file-compressed 24506764 25683368 0.95
tpcds_q61/duckdb:vortex-file-compressed 37081160 37349281 0.99
tpcds_q62/duckdb:vortex-file-compressed 18467951 17064265 1.08
tpcds_q63/duckdb:vortex-file-compressed 20422711 20275181 1.01
tpcds_q64/duckdb:vortex-file-compressed 80923106 81355938 0.99
tpcds_q65/duckdb:vortex-file-compressed 23739055 23847126 1.00
tpcds_q66/duckdb:vortex-file-compressed 34316371 32790892 1.05
tpcds_q67/duckdb:vortex-file-compressed 142156442 143307798 0.99
tpcds_q68/duckdb:vortex-file-compressed 39546845 40038656 0.99
tpcds_q69/duckdb:vortex-file-compressed 37311668 38035960 0.98
tpcds_q70/duckdb:vortex-file-compressed 27416919 26794636 1.02
tpcds_q71/duckdb:vortex-file-compressed 20752431 21472030 0.97
tpcds_q72/duckdb:vortex-file-compressed 173951577 173950800 1.00
tpcds_q73/duckdb:vortex-file-compressed 19810304 18693079 1.06
tpcds_q74/duckdb:vortex-file-compressed 63556458 63141492 1.01
tpcds_q75/duckdb:vortex-file-compressed 58623517 60603026 0.97
tpcds_q76/duckdb:vortex-file-compressed 21498651 23180768 0.93
tpcds_q77/duckdb:vortex-file-compressed 26999472 26959369 1.00
tpcds_q78/duckdb:vortex-file-compressed 79237968 77627885 1.02
tpcds_q79/duckdb:vortex-file-compressed 33991005 33346983 1.02
tpcds_q80/duckdb:vortex-file-compressed 51945416 48240564 1.08
tpcds_q81/duckdb:vortex-file-compressed 29848323 30596149 0.98
tpcds_q82/duckdb:vortex-file-compressed 21718389 23244445 0.93
tpcds_q83/duckdb:vortex-file-compressed 30660453 28885103 1.06
tpcds_q84/duckdb:vortex-file-compressed 17272671 17714627 0.98
tpcds_q85/duckdb:vortex-file-compressed 47491415 46399547 1.02
tpcds_q86/duckdb:vortex-file-compressed 18064648 18008710 1.00
tpcds_q87/duckdb:vortex-file-compressed 39231064 37765517 1.04
tpcds_q88/duckdb:vortex-file-compressed 34697704 35494518 0.98
tpcds_q89/duckdb:vortex-file-compressed 20023623 19789209 1.01
tpcds_q90/duckdb:vortex-file-compressed 13919695 13355619 1.04
tpcds_q91/duckdb:vortex-file-compressed 31473326 30102754 1.05
tpcds_q92/duckdb:vortex-file-compressed 13934744 14575825 0.96
tpcds_q93/duckdb:vortex-file-compressed 29441641 29700607 0.99
tpcds_q94/duckdb:vortex-file-compressed 21806206 21870272 1.00
tpcds_q95/duckdb:vortex-file-compressed 149320460 146181989 1.02
tpcds_q96/duckdb:vortex-file-compressed 10580857 11106072 0.95
tpcds_q97/duckdb:vortex-file-compressed 38219916 37847677 1.01
tpcds_q98/duckdb:vortex-file-compressed 17790680 17524831 1.02
tpcds_q99/duckdb:vortex-file-compressed 30419709 33223634 0.92
duckdb / vortex-compact (1.011x ➖, 2↑ 4↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 26117057 26506229 0.99
tpcds_q02/duckdb:vortex-compact 57142047 58193473 0.98
tpcds_q03/duckdb:vortex-compact 56377172 55087159 1.02
tpcds_q04/duckdb:vortex-compact 113507375 119656119 0.95
tpcds_q05/duckdb:vortex-compact 36965723 38766395 0.95
tpcds_q06/duckdb:vortex-compact 39125036 37676149 1.04
tpcds_q07/duckdb:vortex-compact 36623654 35480936 1.03
tpcds_q08/duckdb:vortex-compact 35543976 35502250 1.00
tpcds_q09/duckdb:vortex-compact 57814718 57044588 1.01
tpcds_q10/duckdb:vortex-compact 47925270 48460966 0.99
tpcds_q11/duckdb:vortex-compact 61476124 61946447 0.99
tpcds_q12/duckdb:vortex-compact 🚀 18658401 20782875 0.90
tpcds_q13/duckdb:vortex-compact 51586447 48558716 1.06
tpcds_q14/duckdb:vortex-compact 123384596 125542004 0.98
tpcds_q15/duckdb:vortex-compact 44873543 43539163 1.03
tpcds_q16/duckdb:vortex-compact 33645598 34629577 0.97
tpcds_q17/duckdb:vortex-compact 46520568 49052129 0.95
tpcds_q18/duckdb:vortex-compact 56214498 57226991 0.98
tpcds_q19/duckdb:vortex-compact 40848019 41088031 0.99
tpcds_q20/duckdb:vortex-compact 20398176 19843665 1.03
tpcds_q21/duckdb:vortex-compact 28508933 27681622 1.03
tpcds_q22/duckdb:vortex-compact 111226310 110935317 1.00
tpcds_q23/duckdb:vortex-compact 106183599 108167165 0.98
tpcds_q24/duckdb:vortex-compact 69545091 66829492 1.04
tpcds_q25/duckdb:vortex-compact 50277092 49402302 1.02
tpcds_q26/duckdb:vortex-compact 🚨 54388333 47500435 1.15
tpcds_q27/duckdb:vortex-compact 66850531 66662560 1.00
tpcds_q28/duckdb:vortex-compact 85428181 84240758 1.01
tpcds_q29/duckdb:vortex-compact 47936248 48425254 0.99
tpcds_q30/duckdb:vortex-compact 30249407 28913451 1.05
tpcds_q31/duckdb:vortex-compact 36069153 35247800 1.02
tpcds_q32/duckdb:vortex-compact 23479679 22395011 1.05
tpcds_q33/duckdb:vortex-compact 32343417 29896838 1.08
tpcds_q34/duckdb:vortex-compact 25788595 25410927 1.01
tpcds_q35/duckdb:vortex-compact 🚨 74124928 66031288 1.12
tpcds_q36/duckdb:vortex-compact 36037749 35847390 1.01
tpcds_q37/duckdb:vortex-compact 31536477 32380255 0.97
tpcds_q38/duckdb:vortex-compact 39739671 38990152 1.02
tpcds_q39/duckdb:vortex-compact 52743093 51409913 1.03
tpcds_q40/duckdb:vortex-compact 28506167 29755921 0.96
tpcds_q41/duckdb:vortex-compact 16791792 16897217 0.99
tpcds_q42/duckdb:vortex-compact 16221119 15621258 1.04
tpcds_q43/duckdb:vortex-compact 37983115 38930184 0.98
tpcds_q44/duckdb:vortex-compact 32624656 31904765 1.02
tpcds_q45/duckdb:vortex-compact 31886973 31108400 1.03
tpcds_q46/duckdb:vortex-compact 57207394 56647561 1.01
tpcds_q47/duckdb:vortex-compact 56491578 56356208 1.00
tpcds_q48/duckdb:vortex-compact 40563382 40384675 1.00
tpcds_q49/duckdb:vortex-compact 43598147 44373830 0.98
tpcds_q50/duckdb:vortex-compact 48094233 47340912 1.02
tpcds_q51/duckdb:vortex-compact 105190062 105126060 1.00
tpcds_q52/duckdb:vortex-compact 18249601 17248933 1.06
tpcds_q53/duckdb:vortex-compact 28703735 27566304 1.04
tpcds_q54/duckdb:vortex-compact 36766840 37024227 0.99
tpcds_q55/duckdb:vortex-compact 17268503 17348836 1.00
tpcds_q56/duckdb:vortex-compact 32237851 30810143 1.05
tpcds_q57/duckdb:vortex-compact 49829427 46393102 1.07
tpcds_q58/duckdb:vortex-compact 45343805 41880441 1.08
tpcds_q59/duckdb:vortex-compact 100327043 99614290 1.01
tpcds_q60/duckdb:vortex-compact 31672016 30390808 1.04
tpcds_q61/duckdb:vortex-compact 🚨 55514619 48966053 1.13
tpcds_q62/duckdb:vortex-compact 🚀 20527120 24415987 0.84
tpcds_q63/duckdb:vortex-compact 27885028 27840423 1.00
tpcds_q64/duckdb:vortex-compact 101362003 103112053 0.98
tpcds_q65/duckdb:vortex-compact 30252139 29931609 1.01
tpcds_q66/duckdb:vortex-compact 36779998 37075027 0.99
tpcds_q67/duckdb:vortex-compact 151499277 151443260 1.00
tpcds_q68/duckdb:vortex-compact 51774848 51890553 1.00
tpcds_q69/duckdb:vortex-compact 48533728 47372445 1.02
tpcds_q70/duckdb:vortex-compact 35407419 35770995 0.99
tpcds_q71/duckdb:vortex-compact 25220355 25722632 0.98
tpcds_q72/duckdb:vortex-compact 193438116 192672488 1.00
tpcds_q73/duckdb:vortex-compact 25493791 25989846 0.98
tpcds_q74/duckdb:vortex-compact 68051929 67488542 1.01
tpcds_q75/duckdb:vortex-compact 66451743 70038226 0.95
tpcds_q76/duckdb:vortex-compact 38718690 38015028 1.02
tpcds_q77/duckdb:vortex-compact 36172737 38814470 0.93
tpcds_q78/duckdb:vortex-compact 82527317 86287633 0.96
tpcds_q79/duckdb:vortex-compact 57863188 57524602 1.01
tpcds_q80/duckdb:vortex-compact 66358502 67665163 0.98
tpcds_q81/duckdb:vortex-compact 33677797 34553438 0.97
tpcds_q82/duckdb:vortex-compact 31638270 31711740 1.00
tpcds_q83/duckdb:vortex-compact 45494414 45907553 0.99
tpcds_q84/duckdb:vortex-compact 22118028 22363613 0.99
tpcds_q85/duckdb:vortex-compact 62634528 59460672 1.05
tpcds_q86/duckdb:vortex-compact 19975754 19862971 1.01
tpcds_q87/duckdb:vortex-compact 43187170 44316100 0.97
tpcds_q88/duckdb:vortex-compact 39985515 39354016 1.02
tpcds_q89/duckdb:vortex-compact 27674123 26514714 1.04
tpcds_q90/duckdb:vortex-compact 15688078 15873527 0.99
tpcds_q91/duckdb:vortex-compact 49563307 50034389 0.99
tpcds_q92/duckdb:vortex-compact 21621558 21219106 1.02
tpcds_q93/duckdb:vortex-compact 32173045 31362189 1.03
tpcds_q94/duckdb:vortex-compact 27084406 25004335 1.08
tpcds_q95/duckdb:vortex-compact 🚨 158444460 139166516 1.14
tpcds_q96/duckdb:vortex-compact 14311769 13253138 1.08
tpcds_q97/duckdb:vortex-compact 42048146 39386657 1.07
tpcds_q98/duckdb:vortex-compact 25836467 24402268 1.06
tpcds_q99/duckdb:vortex-compact 37644477 35539771 1.06
duckdb / parquet (1.012x ➖, 0↑ 4↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 29129371 27852018 1.05
tpcds_q02/duckdb:parquet 24008812 23206030 1.03
tpcds_q03/duckdb:parquet 11731065 11171941 1.05
tpcds_q04/duckdb:parquet 169886345 166231209 1.02
tpcds_q05/duckdb:parquet 29572449 28695784 1.03
tpcds_q06/duckdb:parquet 27702206 28278808 0.98
tpcds_q07/duckdb:parquet 20587974 20560728 1.00
tpcds_q08/duckdb:parquet 27080966 26774774 1.01
tpcds_q09/duckdb:parquet 39526785 39384503 1.00
tpcds_q10/duckdb:parquet 32172708 32114135 1.00
tpcds_q11/duckdb:parquet 83597835 82025874 1.02
tpcds_q12/duckdb:parquet 14491800 14067344 1.03
tpcds_q13/duckdb:parquet 33454651 33282568 1.01
tpcds_q14/duckdb:parquet 101738145 98417516 1.03
tpcds_q15/duckdb:parquet 30541430 29947821 1.02
tpcds_q16/duckdb:parquet 21235663 20510180 1.04
tpcds_q17/duckdb:parquet 37755212 37703245 1.00
tpcds_q18/duckdb:parquet 45034202 44120582 1.02
tpcds_q19/duckdb:parquet 29723334 28830063 1.03
tpcds_q20/duckdb:parquet 🚨 16626395 14812286 1.12
tpcds_q21/duckdb:parquet 10623211 11232002 0.95
tpcds_q22/duckdb:parquet 74009972 69548709 1.06
tpcds_q23/duckdb:parquet 80807871 78114637 1.03
tpcds_q24/duckdb:parquet 44676344 44467050 1.00
tpcds_q25/duckdb:parquet 33821858 31793994 1.06
tpcds_q26/duckdb:parquet 37093102 35846311 1.03
tpcds_q27/duckdb:parquet 🚨 50927392 45460935 1.12
tpcds_q28/duckdb:parquet 36986790 37428685 0.99
tpcds_q29/duckdb:parquet 36151816 35109381 1.03
tpcds_q30/duckdb:parquet 33931417 34376533 0.99
tpcds_q31/duckdb:parquet 23391895 23603770 0.99
tpcds_q32/duckdb:parquet 10899980 10589270 1.03
tpcds_q33/duckdb:parquet 20733153 20164840 1.03
tpcds_q34/duckdb:parquet 20013716 20100183 1.00
tpcds_q35/duckdb:parquet 55607632 57816201 0.96
tpcds_q36/duckdb:parquet 19281741 19317845 1.00
tpcds_q37/duckdb:parquet 12272510 12156111 1.01
tpcds_q38/duckdb:parquet 33469420 33828277 0.99
tpcds_q39/duckdb:parquet 29019068 28639444 1.01
tpcds_q40/duckdb:parquet 17004735 17522178 0.97
tpcds_q41/duckdb:parquet 7492217 7552041 0.99
tpcds_q42/duckdb:parquet 9247763 9412797 0.98
tpcds_q43/duckdb:parquet 14978139 15107386 0.99
tpcds_q44/duckdb:parquet 21348537 21429715 1.00
tpcds_q45/duckdb:parquet 26012584 26392296 0.99
tpcds_q46/duckdb:parquet 43067586 44331169 0.97
tpcds_q47/duckdb:parquet 44517762 44355032 1.00
tpcds_q48/duckdb:parquet 29132007 28699088 1.02
tpcds_q49/duckdb:parquet 24722625 24873505 0.99
tpcds_q50/duckdb:parquet 24121703 24462485 0.99
tpcds_q51/duckdb:parquet 94486717 91933961 1.03
tpcds_q52/duckdb:parquet 10219181 10275101 0.99
tpcds_q53/duckdb:parquet 14818763 15236830 0.97
tpcds_q54/duckdb:parquet 25073507 26148479 0.96
tpcds_q55/duckdb:parquet 9654965 9887158 0.98
tpcds_q56/duckdb:parquet 20024485 19837465 1.01
tpcds_q57/duckdb:parquet 34155506 34297027 1.00
tpcds_q58/duckdb:parquet 23924391 23164107 1.03
tpcds_q59/duckdb:parquet 34243306 34150553 1.00
tpcds_q60/duckdb:parquet 21373413 21562447 0.99
tpcds_q61/duckdb:parquet 30703556 30332383 1.01
tpcds_q62/duckdb:parquet 11507284 11452553 1.00
tpcds_q63/duckdb:parquet 13297954 13594546 0.98
tpcds_q64/duckdb:parquet 74846767 75428709 0.99
tpcds_q65/duckdb:parquet 20593855 20637054 1.00
tpcds_q66/duckdb:parquet 28489038 28506411 1.00
tpcds_q67/duckdb:parquet 136735506 135864146 1.01
tpcds_q68/duckdb:parquet 35860590 35600562 1.01
tpcds_q69/duckdb:parquet 35607339 35926983 0.99
tpcds_q70/duckdb:parquet 19219092 18830190 1.02
tpcds_q71/duckdb:parquet 19327537 18387642 1.05
tpcds_q72/duckdb:parquet 163318372 163553366 1.00
tpcds_q73/duckdb:parquet 17879008 17279473 1.03
tpcds_q74/duckdb:parquet 130354289 127929129 1.02
tpcds_q75/duckdb:parquet 55726733 51823229 1.08
tpcds_q76/duckdb:parquet 20345091 18777317 1.08
tpcds_q77/duckdb:parquet 🚨 23300682 20876503 1.12
tpcds_q78/duckdb:parquet 75785191 73525914 1.03
tpcds_q79/duckdb:parquet 27253785 26703965 1.02
tpcds_q80/duckdb:parquet 40345777 40138979 1.01
tpcds_q81/duckdb:parquet 31723766 30978728 1.02
tpcds_q82/duckdb:parquet 13722335 13568133 1.01
tpcds_q83/duckdb:parquet 15972050 15679099 1.02
tpcds_q84/duckdb:parquet 19070152 19563449 0.97
tpcds_q85/duckdb:parquet 38622713 38266134 1.01
tpcds_q86/duckdb:parquet 12117689 12107991 1.00
tpcds_q87/duckdb:parquet 35354703 37301644 0.95
tpcds_q88/duckdb:parquet 48293621 48089799 1.00
tpcds_q89/duckdb:parquet 15898905 15593934 1.02
tpcds_q90/duckdb:parquet 7387495 7998125 0.92
tpcds_q91/duckdb:parquet 22402084 22037604 1.02
tpcds_q92/duckdb:parquet 11381199 10818276 1.05
tpcds_q93/duckdb:parquet 28653945 28819740 0.99
tpcds_q94/duckdb:parquet 16507185 15413485 1.07
tpcds_q95/duckdb:parquet 134892255 142333421 0.95
tpcds_q96/duckdb:parquet 8838325 8587537 1.03
tpcds_q97/duckdb:parquet 🚨 36722220 33013633 1.11
tpcds_q98/duckdb:parquet 17496827 17675031 0.99
tpcds_q99/duckdb:parquet 19527184 19258703 1.01
duckdb / duckdb (1.016x ➖, 0↑ 5↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20078190 20060050 1.00
tpcds_q02/duckdb:duckdb 18408386 17235206 1.07
tpcds_q03/duckdb:duckdb 9215042 8608125 1.07
tpcds_q04/duckdb:duckdb 174798708 173733310 1.01
tpcds_q05/duckdb:duckdb 17482508 18859317 0.93
tpcds_q06/duckdb:duckdb 22408401 21994744 1.02
tpcds_q07/duckdb:duckdb 38576587 37751494 1.02
tpcds_q08/duckdb:duckdb 119060502 120278608 0.99
tpcds_q09/duckdb:duckdb 19714204 19559310 1.01
tpcds_q10/duckdb:duckdb 22614291 23051633 0.98
tpcds_q11/duckdb:duckdb 84549328 89474753 0.94
tpcds_q12/duckdb:duckdb 11191775 11084728 1.01
tpcds_q13/duckdb:duckdb 23246623 23118914 1.01
tpcds_q14/duckdb:duckdb 92118474 89105426 1.03
tpcds_q15/duckdb:duckdb 🚨 25010687 21995862 1.14
tpcds_q16/duckdb:duckdb 17816745 16926729 1.05
tpcds_q17/duckdb:duckdb 21015602 20591762 1.02
tpcds_q18/duckdb:duckdb 42970041 44314728 0.97
tpcds_q19/duckdb:duckdb 16060670 16550673 0.97
tpcds_q20/duckdb:duckdb 11848142 11539973 1.03
tpcds_q21/duckdb:duckdb 🚨 7106183 6350001 1.12
tpcds_q22/duckdb:duckdb 62559791 61950969 1.01
tpcds_q23/duckdb:duckdb 74976385 75569786 0.99
tpcds_q24/duckdb:duckdb 🚨 26306947 22378678 1.18
tpcds_q25/duckdb:duckdb 17631955 17106754 1.03
tpcds_q26/duckdb:duckdb 27620745 25862077 1.07
tpcds_q27/duckdb:duckdb 🚨 42317706 36620907 1.16
tpcds_q28/duckdb:duckdb 21697533 21100233 1.03
tpcds_q29/duckdb:duckdb 20027758 19713597 1.02
tpcds_q30/duckdb:duckdb 26514334 28130645 0.94
tpcds_q31/duckdb:duckdb 46611719 45925027 1.01
tpcds_q32/duckdb:duckdb 6924483 6997437 0.99
tpcds_q33/duckdb:duckdb 12599957 12510824 1.01
tpcds_q34/duckdb:duckdb 14593966 14618232 1.00
tpcds_q35/duckdb:duckdb 33408327 30993969 1.08
tpcds_q36/duckdb:duckdb 68118451 67092447 1.02
tpcds_q37/duckdb:duckdb 7379632 7223980 1.02
tpcds_q38/duckdb:duckdb 30147298 30456459 0.99
tpcds_q39/duckdb:duckdb 25592192 24533630 1.04
tpcds_q40/duckdb:duckdb 13428231 12780693 1.05
tpcds_q41/duckdb:duckdb 7868815 7614043 1.03
tpcds_q42/duckdb:duckdb 6167850 6355344 0.97
tpcds_q43/duckdb:duckdb 10804105 10723293 1.01
tpcds_q44/duckdb:duckdb 14006096 12909804 1.08
tpcds_q45/duckdb:duckdb 16370970 16384276 1.00
tpcds_q46/duckdb:duckdb 35078638 36257484 0.97
tpcds_q47/duckdb:duckdb 40860820 39776389 1.03
tpcds_q48/duckdb:duckdb 20878324 21332222 0.98
tpcds_q49/duckdb:duckdb 17359808 16601707 1.05
tpcds_q50/duckdb:duckdb 13772455 13994816 0.98
tpcds_q51/duckdb:duckdb 88773417 87542308 1.01
tpcds_q52/duckdb:duckdb 7305987 7342846 0.99
tpcds_q53/duckdb:duckdb 12533449 12794014 0.98
tpcds_q54/duckdb:duckdb 16891625 16098026 1.05
tpcds_q55/duckdb:duckdb 6747155 6859747 0.98
tpcds_q56/duckdb:duckdb 12977712 12858535 1.01
tpcds_q57/duckdb:duckdb 30387871 30564027 0.99
tpcds_q58/duckdb:duckdb 13053454 12180922 1.07
tpcds_q59/duckdb:duckdb 34384738 34586016 0.99
tpcds_q60/duckdb:duckdb 14654398 14547044 1.01
tpcds_q61/duckdb:duckdb 14415016 14643251 0.98
tpcds_q62/duckdb:duckdb 9451570 9121304 1.04
tpcds_q63/duckdb:duckdb 12468453 12046078 1.04
tpcds_q64/duckdb:duckdb 51632216 51125255 1.01
tpcds_q65/duckdb:duckdb 35111741 32381263 1.08
tpcds_q66/duckdb:duckdb 24088571 24811343 0.97
tpcds_q67/duckdb:duckdb 128694129 126983244 1.01
tpcds_q68/duckdb:duckdb 25096313 24105346 1.04
tpcds_q69/duckdb:duckdb 24261056 23447930 1.03
tpcds_q70/duckdb:duckdb 13935037 14122671 0.99
tpcds_q71/duckdb:duckdb 11825911 12297675 0.96
tpcds_q72/duckdb:duckdb 42803583 41422724 1.03
tpcds_q73/duckdb:duckdb 10575320 10084156 1.05
tpcds_q74/duckdb:duckdb 145054319 143531715 1.01
tpcds_q75/duckdb:duckdb 42769491 40994771 1.04
tpcds_q76/duckdb:duckdb 11908205 12193022 0.98
tpcds_q77/duckdb:duckdb 11486713 11953453 0.96
tpcds_q78/duckdb:duckdb 62930707 60577609 1.04
tpcds_q79/duckdb:duckdb 17922215 18198435 0.98
tpcds_q80/duckdb:duckdb 25194540 27346427 0.92
tpcds_q81/duckdb:duckdb 37759048 37700558 1.00
tpcds_q82/duckdb:duckdb 8156122 7690591 1.06
tpcds_q83/duckdb:duckdb 9292268 8791622 1.06
tpcds_q84/duckdb:duckdb 14142600 13183685 1.07
tpcds_q85/duckdb:duckdb 23608413 23407652 1.01
tpcds_q86/duckdb:duckdb 10180936 10488048 0.97
tpcds_q87/duckdb:duckdb 33574242 32891337 1.02
tpcds_q88/duckdb:duckdb 24656030 24783968 0.99
tpcds_q89/duckdb:duckdb 14035487 14357503 0.98
tpcds_q90/duckdb:duckdb 5464902 5320803 1.03
tpcds_q91/duckdb:duckdb 12558584 13018281 0.96
tpcds_q92/duckdb:duckdb 8277600 9041099 0.92
tpcds_q93/duckdb:duckdb 21565071 20212284 1.07
tpcds_q94/duckdb:duckdb 11939621 12726422 0.94
tpcds_q95/duckdb:duckdb 🚨 123154591 106562317 1.16
tpcds_q96/duckdb:duckdb 4363381 4442085 0.98
tpcds_q97/duckdb:duckdb 30607986 28226150 1.08
tpcds_q98/duckdb:duckdb 12868530 13035499 0.99
tpcds_q99/duckdb:duckdb 16132147 16294398 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -1.1% +2.1% -3.2% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.3% +2.1% +0.1% +10.0% ➖ noise
1 duckdb:duckdb +0.1% +2.1% -2.0% +11.6% ➖ noise
1 duckdb:vortex-compact -1.5% +2.1% -3.5% +13.6% ➖ noise
1 duckdb:vortex-file-compressed +3.6% +2.1% +1.5% +10.0% ➖ noise
2 datafusion:vortex-compact +0.5% +0.5% -0.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.9% +0.5% +0.4% +10.0% ➖ noise
2 duckdb:duckdb +6.8% +0.5% +6.3% +12.4% ➖ noise
2 duckdb:vortex-compact -1.8% +0.5% -2.3% +32.1% ➖ noise
2 duckdb:vortex-file-compressed -0.5% +0.5% -1.0% +20.8% ➖ noise
3 datafusion:vortex-compact +3.7% -0.9% +4.6% +13.4% ➖ noise
3 datafusion:vortex-file-compressed +3.3% -0.9% +4.2% +12.1% ➖ noise
3 duckdb:duckdb +7.1% -0.9% +8.0% +14.6% ➖ noise
3 duckdb:vortex-compact +2.3% -0.9% +3.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.1% -0.9% +6.0% +10.0% ➖ noise
4 datafusion:vortex-compact +2.1% -3.1% +5.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.3% -3.1% +6.5% +10.0% ➖ noise
4 duckdb:duckdb +0.6% -3.1% +3.8% +10.0% ➖ noise
4 duckdb:vortex-compact -5.1% -3.1% -2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.7% -3.1% +5.9% +10.9% ➖ noise
5 datafusion:vortex-compact -4.2% +0.0% -4.3% +15.8% ➖ noise
5 datafusion:vortex-file-compressed +0.9% +0.0% +0.9% +11.0% ➖ noise
5 duckdb:duckdb -7.3% +0.0% -7.3% +17.2% ➖ noise
5 duckdb:vortex-compact -4.6% +0.0% -4.7% +10.9% ➖ noise
5 duckdb:vortex-file-compressed +2.1% +0.0% +2.1% +10.5% ➖ noise
6 datafusion:vortex-compact -1.5% +1.3% -2.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +5.9% +1.3% +4.5% +10.0% ➖ noise
6 duckdb:duckdb +1.9% +1.3% +0.6% +13.1% ➖ noise
6 duckdb:vortex-compact +3.8% +1.3% +2.5% +10.5% ➖ noise
6 duckdb:vortex-file-compressed +0.4% +1.3% -0.9% +10.0% ➖ noise
7 datafusion:vortex-compact -1.5% +3.4% -4.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +10.4% +3.4% +6.7% +10.0% ➖ noise
7 duckdb:duckdb +2.2% +3.4% -1.2% +23.8% ➖ noise
7 duckdb:vortex-compact +3.2% +3.4% -0.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.3% +3.4% -3.6% +10.0% ➖ noise
8 datafusion:vortex-compact +1.8% +6.5% -4.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.1% +6.5% -5.1% +10.0% ➖ noise
8 duckdb:duckdb -1.0% +6.5% -7.0% +10.0% ➖ noise
8 duckdb:vortex-compact +0.1% +6.5% -6.0% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.9% +6.5% -2.4% +12.3% ➖ noise
9 datafusion:vortex-compact -1.0% +2.0% -2.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +1.2% +2.0% -0.7% +11.0% ➖ noise
9 duckdb:duckdb +0.8% +2.0% -1.1% +10.0% ➖ noise
9 duckdb:vortex-compact +1.4% +2.0% -0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.9% +2.0% -1.1% +11.6% ➖ noise
10 datafusion:vortex-compact -1.3% +1.6% -2.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.3% +1.6% +3.7% +10.0% ➖ noise
10 duckdb:duckdb -1.9% +1.6% -3.5% +10.0% ➖ noise
10 duckdb:vortex-compact -1.1% +1.6% -2.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.1% +1.6% -1.7% +10.0% ➖ noise
11 datafusion:vortex-compact +4.7% +1.5% +3.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +8.7% +1.5% +7.1% +10.0% ➖ noise
11 duckdb:duckdb -5.5% +1.5% -6.9% +11.9% ➖ noise
11 duckdb:vortex-compact -0.8% +1.5% -2.3% +16.4% ➖ noise
11 duckdb:vortex-file-compressed -1.4% +1.5% -2.9% +11.9% ➖ noise
12 datafusion:vortex-compact -2.6% +3.3% -5.7% +15.6% ➖ noise
12 datafusion:vortex-file-compressed +7.6% +3.3% +4.2% +10.6% ➖ noise
12 duckdb:duckdb +1.0% +3.3% -2.3% +13.0% ➖ noise
12 duckdb:vortex-compact -10.2% +3.3% -13.1% +15.7% ➖ noise
12 duckdb:vortex-file-compressed +9.1% +3.3% +5.6% +10.9% ➖ noise
13 datafusion:vortex-compact +3.2% +0.9% +2.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +4.0% +0.9% +3.1% +10.0% ➖ noise
13 duckdb:duckdb +0.6% +0.9% -0.3% +10.0% ➖ noise
13 duckdb:vortex-compact +6.2% +0.9% +5.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.5% +0.9% -1.4% +13.9% ➖ noise
14 datafusion:vortex-compact -3.2% +1.8% -4.9% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -0.2% +1.8% -2.0% +10.0% ➖ noise
14 duckdb:duckdb +3.4% +1.8% +1.6% +10.0% ➖ noise
14 duckdb:vortex-compact -1.7% +1.8% -3.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.6% +1.8% -2.4% +10.0% ➖ noise
15 datafusion:vortex-compact +2.5% +3.1% -0.6% +15.9% ➖ noise
15 datafusion:vortex-file-compressed -1.5% +3.1% -4.4% +15.6% ➖ noise
15 duckdb:duckdb +13.7% +3.1% +10.3% +23.1% ➖ noise
15 duckdb:vortex-compact +3.1% +3.1% -0.0% +18.6% ➖ noise
15 duckdb:vortex-file-compressed +2.7% +3.1% -0.4% +15.8% ➖ noise
16 datafusion:vortex-compact +0.8% +2.4% -1.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.1% +2.4% -4.4% +12.1% ➖ noise
16 duckdb:duckdb +5.3% +2.4% +2.8% +12.0% ➖ noise
16 duckdb:vortex-compact -2.8% +2.4% -5.1% +12.8% ➖ noise
16 duckdb:vortex-file-compressed +8.1% +2.4% +5.5% +21.9% ➖ noise
17 datafusion:vortex-compact -0.6% +1.1% -1.7% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.7% +1.1% +1.6% +10.0% ➖ noise
17 duckdb:duckdb +2.1% +1.1% +1.0% +12.8% ➖ noise
17 duckdb:vortex-compact -5.2% +1.1% -6.2% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +6.2% +1.1% +5.0% +10.3% ➖ noise
18 datafusion:vortex-compact +0.9% +2.6% -1.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +2.0% +2.6% -0.6% +10.0% ➖ noise
18 duckdb:duckdb -3.0% +2.6% -5.5% +10.0% ➖ noise
18 duckdb:vortex-compact -1.8% +2.6% -4.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +8.9% +2.6% +6.1% +10.0% ➖ noise
19 datafusion:vortex-compact +0.7% +3.2% -2.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.2% +3.2% -3.0% +10.0% ➖ noise
19 duckdb:duckdb -3.0% +3.2% -6.0% +12.9% ➖ noise
19 duckdb:vortex-compact -0.6% +3.2% -3.7% +11.4% ➖ noise
19 duckdb:vortex-file-compressed +13.6% +3.2% +10.1% +10.0% 🚨 regression
20 datafusion:vortex-compact -0.1% +7.1% -6.7% +10.3% ➖ noise
20 datafusion:vortex-file-compressed +3.4% +7.1% -3.4% +11.1% ➖ noise
20 duckdb:duckdb +2.7% +7.1% -4.1% +14.8% ➖ noise
20 duckdb:vortex-compact +2.8% +7.1% -4.0% +13.6% ➖ noise
20 duckdb:vortex-file-compressed +10.4% +7.1% +3.1% +12.5% ➖ noise
21 datafusion:vortex-compact -1.1% -3.1% +2.0% +11.8% ➖ noise
21 datafusion:vortex-file-compressed +0.7% -3.1% +3.9% +11.9% ➖ noise
21 duckdb:duckdb +11.9% -3.1% +15.4% +15.4% 🚨 regression
21 duckdb:vortex-compact +3.0% -3.1% +6.2% +11.5% ➖ noise
21 duckdb:vortex-file-compressed +7.3% -3.1% +10.7% +15.9% ➖ noise
22 datafusion:vortex-compact +0.7% +5.9% -4.9% +12.0% ➖ noise
22 datafusion:vortex-file-compressed -3.6% +5.9% -9.0% +11.2% ➖ noise
22 duckdb:duckdb +1.0% +5.9% -4.6% +12.3% ➖ noise
22 duckdb:vortex-compact +0.3% +5.9% -5.3% +10.5% ➖ noise
22 duckdb:vortex-file-compressed +6.9% +5.9% +1.0% +13.9% ➖ noise
23 datafusion:vortex-compact +3.4% +1.4% +1.9% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.3% +1.4% +1.8% +10.0% ➖ noise
23 duckdb:duckdb -0.8% +1.4% -2.2% +10.0% ➖ noise
23 duckdb:vortex-compact -1.8% +1.4% -3.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +3.4% +1.4% +2.0% +10.0% ➖ noise
24 datafusion:vortex-compact +8.8% -1.7% +10.6% +10.0% 🚨 regression
24 datafusion:vortex-file-compressed +3.0% -1.7% +4.8% +10.0% ➖ noise
24 duckdb:duckdb +17.6% -1.7% +19.5% +14.2% 🚨 regression
24 duckdb:vortex-compact +4.1% -1.7% +5.8% +10.7% ➖ noise
24 duckdb:vortex-file-compressed +1.2% -1.7% +2.9% +11.7% ➖ noise
25 datafusion:vortex-compact +9.7% +2.9% +6.6% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -2.6% +2.9% -5.3% +10.0% ➖ noise
25 duckdb:duckdb +3.1% +2.9% +0.2% +11.9% ➖ noise
25 duckdb:vortex-compact +1.8% +2.9% -1.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +10.5% +2.9% +7.4% +10.0% ➖ noise
26 datafusion:vortex-compact +1.6% +1.7% -0.1% +10.0% ➖ noise
26 datafusion:vortex-file-compressed -3.7% +1.7% -5.3% +10.2% ➖ noise
26 duckdb:duckdb +6.8% +1.7% +5.0% +15.5% ➖ noise
26 duckdb:vortex-compact +14.5% +1.7% +12.6% +16.7% ➖ noise
26 duckdb:vortex-file-compressed +8.9% +1.7% +7.1% +15.4% ➖ noise
27 datafusion:vortex-compact -1.7% +7.6% -8.7% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +2.4% +7.6% -4.8% +10.0% ➖ noise
27 duckdb:duckdb +15.6% +7.6% +7.4% +19.2% ➖ noise
27 duckdb:vortex-compact +0.3% +7.6% -6.8% +13.0% ➖ noise
27 duckdb:vortex-file-compressed +5.9% +7.6% -1.5% +15.6% ➖ noise
28 datafusion:vortex-compact +2.8% -0.1% +2.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.3% -0.1% +2.4% +10.0% ➖ noise
28 duckdb:duckdb +2.8% -0.1% +2.9% +10.0% ➖ noise
28 duckdb:vortex-compact +1.4% -0.1% +1.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -3.5% -0.1% -3.4% +14.4% ➖ noise
29 datafusion:vortex-compact -0.2% +2.5% -2.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -0.5% +2.5% -2.9% +11.3% ➖ noise
29 duckdb:duckdb +1.6% +2.5% -0.9% +11.2% ➖ noise
29 duckdb:vortex-compact -1.0% +2.5% -3.4% +11.0% ➖ noise
29 duckdb:vortex-file-compressed +7.9% +2.5% +5.3% +12.2% ➖ noise
30 datafusion:vortex-compact -0.7% +1.1% -1.8% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -6.4% +1.1% -7.4% +10.0% ➖ noise
30 duckdb:duckdb -5.7% +1.1% -6.7% +10.0% ➖ noise
30 duckdb:vortex-compact +4.6% +1.1% +3.5% +12.0% ➖ noise
30 duckdb:vortex-file-compressed +1.3% +1.1% +0.2% +12.5% ➖ noise
31 datafusion:vortex-compact +1.2% +2.1% -0.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.1% +2.1% -2.0% +10.0% ➖ noise
31 duckdb:duckdb +1.5% +2.1% -0.6% +10.0% ➖ noise
31 duckdb:vortex-compact +2.3% +2.1% +0.2% +10.3% ➖ noise
31 duckdb:vortex-file-compressed +1.8% +2.1% -0.3% +10.0% ➖ noise
32 datafusion:vortex-compact -0.4% +7.3% -7.2% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.9% +7.3% -5.0% +10.0% ➖ noise
32 duckdb:duckdb -1.0% +7.3% -7.8% +13.2% ➖ noise
32 duckdb:vortex-compact +4.8% +7.3% -2.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +3.4% +7.3% -3.7% +13.1% ➖ noise
33 datafusion:vortex-compact +5.8% +2.9% +2.9% +11.0% ➖ noise
33 datafusion:vortex-file-compressed -1.7% +2.9% -4.4% +10.6% ➖ noise
33 duckdb:duckdb +0.7% +2.9% -2.1% +10.2% ➖ noise
33 duckdb:vortex-compact +8.2% +2.9% +5.2% +11.5% ➖ noise
33 duckdb:vortex-file-compressed +3.5% +2.9% +0.6% +12.7% ➖ noise
34 datafusion:vortex-compact -0.2% +0.0% -0.3% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -3.0% +0.0% -3.1% +10.0% ➖ noise
34 duckdb:duckdb -0.2% +0.0% -0.2% +10.9% ➖ noise
34 duckdb:vortex-compact +1.5% +0.0% +1.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +4.0% +0.0% +3.9% +10.0% ➖ noise
35 datafusion:vortex-compact +3.7% +0.6% +3.1% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.2% +0.6% -0.4% +11.7% ➖ noise
35 duckdb:duckdb +7.8% +0.6% +7.2% +11.4% ➖ noise
35 duckdb:vortex-compact +12.3% +0.6% +11.6% +12.1% ➖ noise
35 duckdb:vortex-file-compressed +5.8% +0.6% +5.2% +13.7% ➖ noise
36 datafusion:vortex-compact -0.8% +2.6% -3.3% +10.8% ➖ noise
36 datafusion:vortex-file-compressed +0.5% +2.6% -2.0% +10.0% ➖ noise
36 duckdb:duckdb +1.5% +2.6% -1.1% +12.0% ➖ noise
36 duckdb:vortex-compact +0.5% +2.6% -2.0% +16.6% ➖ noise
36 duckdb:vortex-file-compressed +3.1% +2.6% +0.4% +10.0% ➖ noise
37 datafusion:vortex-compact +4.3% +4.7% -0.3% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +1.6% +4.7% -3.0% +10.0% ➖ noise
37 duckdb:duckdb +2.2% +4.7% -2.4% +14.1% ➖ noise
37 duckdb:vortex-compact -2.6% +4.7% -7.0% +11.9% ➖ noise
37 duckdb:vortex-file-compressed +3.0% +4.7% -1.6% +15.4% ➖ noise
38 datafusion:vortex-compact -1.2% +2.0% -3.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -0.8% +2.0% -2.7% +12.7% ➖ noise
38 duckdb:duckdb -1.0% +2.0% -2.9% +19.8% ➖ noise
38 duckdb:vortex-compact +1.9% +2.0% -0.0% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +2.0% +2.0% +0.1% +11.2% ➖ noise
39 datafusion:vortex-compact +1.6% +3.8% -2.1% +12.6% ➖ noise
39 datafusion:vortex-file-compressed -3.0% +3.8% -6.6% +10.0% ➖ noise
39 duckdb:duckdb +4.3% +3.8% +0.5% +23.9% ➖ noise
39 duckdb:vortex-compact +2.6% +3.8% -1.2% +14.8% ➖ noise
39 duckdb:vortex-file-compressed +8.2% +3.8% +4.2% +21.3% ➖ noise
40 datafusion:vortex-compact -0.2% +1.3% -1.4% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.1% +1.3% +0.8% +10.0% ➖ noise
40 duckdb:duckdb +5.1% +1.3% +3.7% +15.2% ➖ noise
40 duckdb:vortex-compact -4.2% +1.3% -5.4% +10.6% ➖ noise
40 duckdb:vortex-file-compressed +1.7% +1.3% +0.4% +15.0% ➖ noise
41 datafusion:vortex-compact -2.8% +2.8% -5.4% +10.8% ➖ noise
41 datafusion:vortex-file-compressed +4.7% +2.8% +1.8% +12.2% ➖ noise
41 duckdb:duckdb +3.3% +2.8% +0.5% +10.0% ➖ noise
41 duckdb:vortex-compact -0.6% +2.8% -3.4% +11.4% ➖ noise
41 duckdb:vortex-file-compressed -0.8% +2.8% -3.5% +11.5% ➖ noise
42 datafusion:vortex-compact -2.2% +3.1% -5.2% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +5.7% +3.1% +2.4% +11.2% ➖ noise
42 duckdb:duckdb -3.0% +3.1% -5.9% +15.6% ➖ noise
42 duckdb:vortex-compact +3.8% +3.1% +0.7% +13.9% ➖ noise
42 duckdb:vortex-file-compressed +0.6% +3.1% -2.5% +17.6% ➖ noise
43 datafusion:vortex-compact +0.1% +2.4% -2.3% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +4.7% +2.4% +2.2% +10.0% ➖ noise
43 duckdb:duckdb +0.8% +2.4% -1.6% +10.0% ➖ noise
43 duckdb:vortex-compact -2.4% +2.4% -4.7% +25.0% ➖ noise
43 duckdb:vortex-file-compressed +0.6% +2.4% -1.7% +30.0% ➖ noise
44 datafusion:vortex-compact +5.4% +0.8% +4.6% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +3.1% +0.8% +2.2% +10.0% ➖ noise
44 duckdb:duckdb +8.5% +0.8% +7.6% +14.6% ➖ noise
44 duckdb:vortex-compact +2.3% +0.8% +1.4% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -1.2% +0.8% -2.1% +11.3% ➖ noise
45 datafusion:vortex-compact -2.2% -1.8% -0.4% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.8% -1.8% +1.1% +10.0% ➖ noise
45 duckdb:duckdb -0.1% -1.8% +1.8% +10.5% ➖ noise
45 duckdb:vortex-compact +2.5% -1.8% +4.4% +10.0% ➖ noise
45 duckdb:vortex-file-compressed -2.5% -1.8% -0.7% +12.9% ➖ noise
46 datafusion:vortex-compact +1.1% -1.6% +2.8% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +0.6% -1.6% +2.3% +10.0% ➖ noise
46 duckdb:duckdb -3.3% -1.6% -1.6% +10.0% ➖ noise
46 duckdb:vortex-compact +1.0% -1.6% +2.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +0.4% -1.6% +2.1% +10.0% ➖ noise
47 datafusion:vortex-compact -2.7% +2.8% -5.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +0.4% +2.8% -2.4% +10.0% ➖ noise
47 duckdb:duckdb +2.7% +2.8% -0.1% +10.0% ➖ noise
47 duckdb:vortex-compact +0.2% +2.8% -2.5% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -1.2% +2.8% -3.9% +10.0% ➖ noise
48 datafusion:vortex-compact -5.1% +1.0% -6.1% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +0.2% +1.0% -0.8% +10.0% ➖ noise
48 duckdb:duckdb -2.1% +1.0% -3.1% +10.0% ➖ noise
48 duckdb:vortex-compact +0.4% +1.0% -0.6% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -0.5% +1.0% -1.5% +10.7% ➖ noise
49 datafusion:vortex-compact +0.6% +0.3% +0.4% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +0.3% +0.3% +0.0% +10.0% ➖ noise
49 duckdb:duckdb +4.6% +0.3% +4.3% +18.8% ➖ noise
49 duckdb:vortex-compact -1.7% +0.3% -2.0% +11.0% ➖ noise
49 duckdb:vortex-file-compressed +2.6% +0.3% +2.4% +13.8% ➖ noise
50 datafusion:vortex-compact +1.5% -2.7% +4.4% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -5.4% -2.7% -2.7% +10.0% ➖ noise
50 duckdb:duckdb -1.6% -2.7% +1.2% +10.0% ➖ noise
50 duckdb:vortex-compact +1.6% -2.7% +4.5% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +2.7% -2.7% +5.6% +10.0% ➖ noise
51 datafusion:vortex-compact +4.9% +1.5% +3.4% +11.1% ➖ noise
51 datafusion:vortex-file-compressed +0.5% +1.5% -0.9% +10.0% ➖ noise
51 duckdb:duckdb +1.4% +1.5% -0.1% +10.0% ➖ noise
51 duckdb:vortex-compact +0.1% +1.5% -1.4% +15.0% ➖ noise
51 duckdb:vortex-file-compressed +26.6% +1.5% +24.7% +21.4% 🚨 regression
52 datafusion:vortex-compact +8.1% +0.1% +8.0% +16.8% ➖ noise
52 datafusion:vortex-file-compressed +5.9% +0.1% +5.8% +15.3% ➖ noise
52 duckdb:duckdb -0.5% +0.1% -0.6% +14.5% ➖ noise
52 duckdb:vortex-compact +5.8% +0.1% +5.7% +13.7% ➖ noise
52 duckdb:vortex-file-compressed -4.1% +0.1% -4.2% +19.7% ➖ noise
53 datafusion:vortex-compact +5.0% +0.0% +5.0% +17.1% ➖ noise
53 datafusion:vortex-file-compressed -1.3% +0.0% -1.4% +17.9% ➖ noise
53 duckdb:duckdb -2.0% +0.0% -2.1% +17.3% ➖ noise
53 duckdb:vortex-compact +4.1% +0.0% +4.1% +15.0% ➖ noise
53 duckdb:vortex-file-compressed -0.6% +0.0% -0.7% +15.5% ➖ noise
54 datafusion:vortex-compact +6.5% -1.6% +8.3% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +5.9% -1.6% +7.6% +10.0% ➖ noise
54 duckdb:duckdb +4.9% -1.6% +6.7% +11.5% ➖ noise
54 duckdb:vortex-compact -0.7% -1.6% +1.0% +10.0% ➖ noise
54 duckdb:vortex-file-compressed -0.5% -1.6% +1.2% +10.0% ➖ noise
55 datafusion:vortex-compact +7.8% +0.6% +7.2% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -1.0% +0.6% -1.6% +10.0% ➖ noise
55 duckdb:duckdb -1.6% +0.6% -2.2% +14.0% ➖ noise
55 duckdb:vortex-compact -0.5% +0.6% -1.0% +10.0% ➖ noise
55 duckdb:vortex-file-compressed -4.9% +0.6% -5.4% +14.1% ➖ noise
56 datafusion:vortex-compact +2.9% -0.8% +3.8% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -0.7% -0.8% +0.1% +10.0% ➖ noise
56 duckdb:duckdb +0.9% -0.8% +1.7% +11.5% ➖ noise
56 duckdb:vortex-compact +4.6% -0.8% +5.5% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -4.5% -0.8% -3.7% +10.9% ➖ noise
57 datafusion:vortex-compact +1.2% -0.3% +1.4% +12.6% ➖ noise
57 datafusion:vortex-file-compressed +4.6% -0.3% +4.9% +10.4% ➖ noise
57 duckdb:duckdb -0.6% -0.3% -0.3% +19.0% ➖ noise
57 duckdb:vortex-compact +7.4% -0.3% +7.7% +17.4% ➖ noise
57 duckdb:vortex-file-compressed +2.5% -0.3% +2.8% +14.7% ➖ noise
58 datafusion:vortex-compact +2.0% +2.0% +0.0% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +0.4% +2.0% -1.5% +10.0% ➖ noise
58 duckdb:duckdb +7.2% +2.0% +5.1% +15.7% ➖ noise
58 duckdb:vortex-compact +8.3% +2.0% +6.2% +25.8% ➖ noise
58 duckdb:vortex-file-compressed -1.5% +2.0% -3.4% +18.1% ➖ noise
59 datafusion:vortex-compact +3.7% -1.0% +4.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -0.4% -1.0% +0.7% +10.0% ➖ noise
59 duckdb:duckdb -0.6% -1.0% +0.5% +10.0% ➖ noise
59 duckdb:vortex-compact +0.7% -1.0% +1.8% +10.9% ➖ noise
59 duckdb:vortex-file-compressed +1.1% -1.0% +2.2% +10.0% ➖ noise
60 datafusion:vortex-compact +0.1% +1.2% -1.0% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +3.0% +1.2% +1.8% +10.0% ➖ noise
60 duckdb:duckdb +0.7% +1.2% -0.4% +12.4% ➖ noise
60 duckdb:vortex-compact +4.2% +1.2% +3.0% +10.8% ➖ noise
60 duckdb:vortex-file-compressed -4.6% +1.2% -5.7% +11.6% ➖ noise
61 datafusion:vortex-compact -3.1% -1.0% -2.1% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +0.1% -1.0% +1.2% +10.0% ➖ noise
61 duckdb:duckdb -1.6% -1.0% -0.5% +10.0% ➖ noise
61 duckdb:vortex-compact +13.4% -1.0% +14.6% +10.1% 🚨 regression
61 duckdb:vortex-file-compressed -0.7% -1.0% +0.3% +10.0% ➖ noise
62 datafusion:vortex-compact +5.5% +0.5% +5.0% +12.7% ➖ noise
62 datafusion:vortex-file-compressed -0.3% +0.5% -0.8% +14.8% ➖ noise
62 duckdb:duckdb +3.6% +0.5% +3.1% +22.1% ➖ noise
62 duckdb:vortex-compact -15.9% +0.5% -16.4% +21.3% ➖ noise
62 duckdb:vortex-file-compressed +8.2% +0.5% +7.7% +27.2% ➖ noise
63 datafusion:vortex-compact -5.1% +0.3% -5.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +2.8% +0.3% +2.5% +10.0% ➖ noise
63 duckdb:duckdb +3.5% +0.3% +3.2% +10.0% ➖ noise
63 duckdb:vortex-compact +0.2% +0.3% -0.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +0.7% +0.3% +0.4% +11.9% ➖ noise
64 datafusion:vortex-compact +2.2% -0.1% +2.3% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -1.3% -0.1% -1.3% +10.0% ➖ noise
64 duckdb:duckdb +1.0% -0.1% +1.1% +10.0% ➖ noise
64 duckdb:vortex-compact -1.7% -0.1% -1.6% +10.0% ➖ noise
64 duckdb:vortex-file-compressed -0.5% -0.1% -0.5% +10.0% ➖ noise
65 datafusion:vortex-compact -1.0% +0.3% -1.2% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +1.5% +0.3% +1.3% +10.0% ➖ noise
65 duckdb:duckdb +8.4% +0.3% +8.1% +13.5% ➖ noise
65 duckdb:vortex-compact +1.1% +0.3% +0.8% +10.0% ➖ noise
65 duckdb:vortex-file-compressed -0.5% +0.3% -0.7% +10.6% ➖ noise
66 datafusion:vortex-compact -2.7% -2.6% -0.1% +11.4% ➖ noise
66 datafusion:vortex-file-compressed +1.1% -2.6% +3.7% +11.5% ➖ noise
66 duckdb:duckdb -2.9% -2.6% -0.4% +13.5% ➖ noise
66 duckdb:vortex-compact -0.8% -2.6% +1.8% +13.7% ➖ noise
66 duckdb:vortex-file-compressed +4.7% -2.6% +7.4% +13.4% ➖ noise
67 datafusion:vortex-compact +4.7% +0.9% +3.8% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +1.7% +0.9% +0.8% +10.0% ➖ noise
67 duckdb:duckdb +1.3% +0.9% +0.5% +10.0% ➖ noise
67 duckdb:vortex-compact +0.0% +0.9% -0.8% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -0.8% +0.9% -1.6% +10.0% ➖ noise
68 datafusion:vortex-compact -1.7% +1.6% -3.2% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -0.4% +1.6% -2.0% +10.0% ➖ noise
68 duckdb:duckdb +4.1% +1.6% +2.4% +10.0% ➖ noise
68 duckdb:vortex-compact -0.2% +1.6% -1.8% +10.0% ➖ noise
68 duckdb:vortex-file-compressed -1.2% +1.6% -2.8% +10.0% ➖ noise
69 datafusion:vortex-compact -1.7% +0.5% -2.2% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +0.5% +0.5% +0.0% +10.0% ➖ noise
69 duckdb:duckdb +3.5% +0.5% +3.0% +10.0% ➖ noise
69 duckdb:vortex-compact +2.5% +0.5% +2.0% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -1.9% +0.5% -2.4% +10.0% ➖ noise
70 datafusion:vortex-compact +0.6% +2.1% -1.5% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +0.8% +2.1% -1.3% +10.0% ➖ noise
70 duckdb:duckdb -1.3% +2.1% -3.4% +13.0% ➖ noise
70 duckdb:vortex-compact -1.0% +2.1% -3.1% +10.2% ➖ noise
70 duckdb:vortex-file-compressed +2.3% +2.1% +0.2% +12.8% ➖ noise
71 datafusion:vortex-compact +0.3% +3.9% -3.5% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +0.1% +3.9% -3.7% +10.0% ➖ noise
71 duckdb:duckdb -3.8% +3.9% -7.5% +21.1% ➖ noise
71 duckdb:vortex-compact -2.0% +3.9% -5.7% +13.9% ➖ noise
71 duckdb:vortex-file-compressed -3.4% +3.9% -7.0% +15.7% ➖ noise
72 datafusion:vortex-compact -0.6% +0.2% -0.7% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +4.8% +0.2% +4.7% +10.0% ➖ noise
72 duckdb:duckdb +3.3% +0.2% +3.2% +10.8% ➖ noise
72 duckdb:vortex-compact +0.4% +0.2% +0.2% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +0.0% +0.2% -0.2% +10.0% ➖ noise
73 datafusion:vortex-compact -4.2% +7.1% -10.5% +15.5% ➖ noise
73 datafusion:vortex-file-compressed -2.1% +7.1% -8.6% +20.0% ➖ noise
73 duckdb:duckdb +4.9% +7.1% -2.1% +10.7% ➖ noise
73 duckdb:vortex-compact -1.9% +7.1% -8.4% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +6.0% +7.1% -1.0% +10.0% ➖ noise
74 datafusion:vortex-compact +0.1% +3.9% -3.6% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +5.2% +3.9% +1.3% +10.0% ➖ noise
74 duckdb:duckdb +1.1% +3.9% -2.7% +10.0% ➖ noise
74 duckdb:vortex-compact +0.8% +3.9% -2.9% +32.3% ➖ noise
74 duckdb:vortex-file-compressed +0.7% +3.9% -3.1% +17.7% ➖ noise
75 datafusion:vortex-compact -0.5% +4.6% -4.9% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +3.5% +4.6% -1.1% +10.0% ➖ noise
75 duckdb:duckdb +4.3% +4.6% -0.3% +13.8% ➖ noise
75 duckdb:vortex-compact -5.1% +4.6% -9.3% +13.1% ➖ noise
75 duckdb:vortex-file-compressed -3.3% +4.6% -7.5% +10.6% ➖ noise
76 datafusion:vortex-compact -1.5% +5.3% -6.5% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +3.9% +5.3% -1.4% +10.0% ➖ noise
76 duckdb:duckdb -2.3% +5.3% -7.3% +15.3% ➖ noise
76 duckdb:vortex-compact +1.9% +5.3% -3.3% +10.0% ➖ noise
76 duckdb:vortex-file-compressed -7.3% +5.3% -12.0% +12.4% ✅ faster
77 datafusion:vortex-compact -0.2% +8.0% -7.5% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +3.9% +8.0% -3.8% +10.0% ➖ noise
77 duckdb:duckdb -3.9% +8.0% -11.0% +14.1% ➖ noise
77 duckdb:vortex-compact -6.8% +8.0% -13.7% +12.8% ✅ faster
77 duckdb:vortex-file-compressed +0.1% +8.0% -7.2% +12.6% ➖ noise
78 datafusion:vortex-compact +2.9% +2.9% -0.0% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +3.2% +2.9% +0.3% +10.0% ➖ noise
78 duckdb:duckdb +3.9% +2.9% +1.0% +10.0% ➖ noise
78 duckdb:vortex-compact -4.4% +2.9% -7.1% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +2.1% +2.9% -0.8% +10.0% ➖ noise
79 datafusion:vortex-compact +1.1% +1.0% +0.1% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise
79 duckdb:duckdb -1.5% +1.0% -2.5% +10.0% ➖ noise
79 duckdb:vortex-compact +0.6% +1.0% -0.4% +10.0% ➖ noise
79 duckdb:vortex-file-compressed +1.9% +1.0% +0.9% +12.9% ➖ noise
80 datafusion:vortex-compact +0.3% +1.8% -1.5% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +3.6% +1.8% +1.8% +10.0% ➖ noise
80 duckdb:duckdb -7.9% +1.8% -9.5% +10.0% ✅ faster
80 duckdb:vortex-compact -1.9% +1.8% -3.7% +11.2% ➖ noise
80 duckdb:vortex-file-compressed +7.7% +1.8% +5.8% +14.5% ➖ noise
81 datafusion:vortex-compact +1.5% +2.7% -1.2% +13.0% ➖ noise
81 datafusion:vortex-file-compressed +12.4% +2.7% +9.5% +11.2% ➖ noise
81 duckdb:duckdb +0.2% +2.7% -2.5% +11.0% ➖ noise
81 duckdb:vortex-compact -2.5% +2.7% -5.1% +12.4% ➖ noise
81 duckdb:vortex-file-compressed -2.4% +2.7% -5.0% +13.0% ➖ noise
82 datafusion:vortex-compact +3.3% +0.5% +2.8% +10.2% ➖ noise
82 datafusion:vortex-file-compressed +9.1% +0.5% +8.5% +10.0% ➖ noise
82 duckdb:duckdb +6.1% +0.5% +5.5% +13.3% ➖ noise
82 duckdb:vortex-compact -0.2% +0.5% -0.7% +18.0% ➖ noise
82 duckdb:vortex-file-compressed -6.6% +0.5% -7.0% +17.4% ➖ noise
83 datafusion:vortex-compact -0.6% +0.4% -1.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +4.4% +0.4% +4.0% +10.0% ➖ noise
83 duckdb:duckdb +5.7% +0.4% +5.3% +17.3% ➖ noise
83 duckdb:vortex-compact -0.9% +0.4% -1.3% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +6.1% +0.4% +5.7% +10.0% ➖ noise
84 datafusion:vortex-compact -0.7% -2.5% +1.8% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +10.6% -2.5% +13.4% +10.1% 🚨 regression
84 duckdb:duckdb +7.3% -2.5% +10.0% +10.0% ➖ noise
84 duckdb:vortex-compact -1.1% -2.5% +1.4% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -2.5% -2.5% -0.0% +10.0% ➖ noise
85 datafusion:vortex-compact -0.3% +0.7% -1.0% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +4.5% +0.7% +3.8% +10.0% ➖ noise
85 duckdb:duckdb +0.9% +0.7% +0.1% +11.3% ➖ noise
85 duckdb:vortex-compact +5.3% +0.7% +4.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +2.4% +0.7% +1.6% +15.0% ➖ noise
86 datafusion:vortex-compact +6.9% -1.6% +8.6% +10.0% ➖ noise
86 datafusion:vortex-file-compressed +6.4% -1.6% +8.1% +12.6% ➖ noise
86 duckdb:duckdb -2.9% -1.6% -1.4% +11.4% ➖ noise
86 duckdb:vortex-compact +0.6% -1.6% +2.2% +20.1% ➖ noise
86 duckdb:vortex-file-compressed +0.3% -1.6% +1.9% +12.5% ➖ noise
87 datafusion:vortex-compact +1.8% -3.8% +5.8% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +10.2% -3.8% +14.6% +12.6% 🚨 regression
87 duckdb:duckdb +2.1% -3.8% +6.1% +16.7% ➖ noise
87 duckdb:vortex-compact -2.5% -3.8% +1.3% +15.4% ➖ noise
87 duckdb:vortex-file-compressed +3.9% -3.8% +8.0% +14.2% ➖ noise
88 datafusion:vortex-compact +0.7% +0.6% +0.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +2.8% +0.6% +2.2% +12.3% ➖ noise
88 duckdb:duckdb -0.5% +0.6% -1.1% +10.0% ➖ noise
88 duckdb:vortex-compact +1.6% +0.6% +1.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -2.2% +0.6% -2.8% +10.0% ➖ noise
89 datafusion:vortex-compact +1.1% +0.5% +0.7% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +9.3% +0.5% +8.8% +10.5% ➖ noise
89 duckdb:duckdb -2.2% +0.5% -2.7% +11.0% ➖ noise
89 duckdb:vortex-compact +4.4% +0.5% +3.9% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +1.2% +0.5% +0.7% +10.4% ➖ noise
90 datafusion:vortex-compact +4.2% -4.9% +9.6% +13.4% ➖ noise
90 datafusion:vortex-file-compressed +4.6% -4.9% +10.0% +10.0% 🚨 regression
90 duckdb:duckdb +2.7% -4.9% +8.0% +10.4% ➖ noise
90 duckdb:vortex-compact -1.2% -4.9% +3.9% +10.6% ➖ noise
90 duckdb:vortex-file-compressed +4.2% -4.9% +9.6% +10.0% ➖ noise
91 datafusion:vortex-compact +6.8% +1.8% +4.9% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +6.9% +1.8% +5.0% +10.3% ➖ noise
91 duckdb:duckdb -3.5% +1.8% -5.2% +11.3% ➖ noise
91 duckdb:vortex-compact -0.9% +1.8% -2.7% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +4.6% +1.8% +2.7% +10.0% ➖ noise
92 datafusion:vortex-compact +2.0% +1.0% +0.9% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -0.1% +1.0% -1.1% +10.0% ➖ noise
92 duckdb:duckdb -8.4% +1.0% -9.4% +12.8% ➖ noise
92 duckdb:vortex-compact +1.9% +1.0% +0.8% +13.7% ➖ noise
92 duckdb:vortex-file-compressed -4.4% +1.0% -5.4% +11.1% ➖ noise
93 datafusion:vortex-compact +4.9% -0.9% +5.8% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +0.9% -0.9% +1.8% +10.0% ➖ noise
93 duckdb:duckdb +6.7% -0.9% +7.6% +18.7% ➖ noise
93 duckdb:vortex-compact +2.6% -0.9% +3.5% +10.0% ➖ noise
93 duckdb:vortex-file-compressed -0.9% -0.9% -0.0% +13.0% ➖ noise
94 datafusion:vortex-compact +5.0% +2.3% +2.7% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +0.1% +2.3% -2.1% +10.0% ➖ noise
94 duckdb:duckdb -6.2% +2.3% -8.3% +10.4% ➖ noise
94 duckdb:vortex-compact +8.3% +2.3% +5.9% +18.8% ➖ noise
94 duckdb:vortex-file-compressed -0.3% +2.3% -2.5% +10.0% ➖ noise
95 datafusion:vortex-compact +3.9% -1.4% +5.4% +10.3% ➖ noise
95 datafusion:vortex-file-compressed -0.1% -1.4% +1.3% +10.0% ➖ noise
95 duckdb:duckdb +15.6% -1.4% +17.2% +20.8% ➖ noise
95 duckdb:vortex-compact +13.9% -1.4% +15.5% +22.1% ➖ noise
95 duckdb:vortex-file-compressed +2.1% -1.4% +3.6% +19.7% ➖ noise
96 datafusion:vortex-compact +2.1% -1.0% +3.1% +11.0% ➖ noise
96 datafusion:vortex-file-compressed +0.8% -1.0% +1.8% +15.7% ➖ noise
96 duckdb:duckdb -1.8% -1.0% -0.8% +15.7% ➖ noise
96 duckdb:vortex-compact +8.0% -1.0% +9.0% +11.3% ➖ noise
96 duckdb:vortex-file-compressed -4.7% -1.0% -3.8% +17.9% ➖ noise
97 datafusion:vortex-compact -0.5% +5.3% -5.4% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -0.4% +5.3% -5.3% +10.0% ➖ noise
97 duckdb:duckdb +8.4% +5.3% +3.0% +14.0% ➖ noise
97 duckdb:vortex-compact +6.8% +5.3% +1.4% +10.2% ➖ noise
97 duckdb:vortex-file-compressed +1.0% +5.3% -4.1% +14.3% ➖ noise
98 datafusion:vortex-compact +3.5% -0.6% +4.1% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +0.4% -0.6% +0.9% +10.0% ➖ noise
98 duckdb:duckdb -1.3% -0.6% -0.7% +13.1% ➖ noise
98 duckdb:vortex-compact +5.9% -0.6% +6.5% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +1.5% -0.6% +2.1% +12.0% ➖ noise
99 datafusion:vortex-compact +5.7% +1.5% +4.2% +12.4% ➖ noise
99 datafusion:vortex-file-compressed -1.4% +1.5% -2.8% +14.6% ➖ noise
99 duckdb:duckdb -1.0% +1.5% -2.4% +10.6% ➖ noise
99 duckdb:vortex-compact +5.9% +1.5% +4.4% +26.6% ➖ noise
99 duckdb:vortex-file-compressed -8.4% +1.5% -9.7% +26.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.6%
Vortex (geomean): 0.984x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.7%


datafusion / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base ba08515 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 688650311 699281170 0.98
tpch_q02/datafusion:vortex-file-compressed 596451905 796058148 0.75
tpch_q03/datafusion:vortex-file-compressed 1005341570 827396456 1.22
tpch_q04/datafusion:vortex-file-compressed 745877870 613818468 1.22
tpch_q05/datafusion:vortex-file-compressed 1122265919 1004347036 1.12
tpch_q06/datafusion:vortex-file-compressed 650576620 639933386 1.02
tpch_q07/datafusion:vortex-file-compressed 1080190525 1042634840 1.04
tpch_q08/datafusion:vortex-file-compressed 1258797885 1247214507 1.01
tpch_q09/datafusion:vortex-file-compressed 1475522511 1281657999 1.15
tpch_q10/datafusion:vortex-file-compressed 1007725614 1033079708 0.98
tpch_q11/datafusion:vortex-file-compressed 572787976 527152791 1.09
tpch_q12/datafusion:vortex-file-compressed 847199865 988924081 0.86
tpch_q13/datafusion:vortex-file-compressed 459001586 423416138 1.08
tpch_q14/datafusion:vortex-file-compressed 580011171 598121729 0.97
tpch_q15/datafusion:vortex-file-compressed 1139524025 1213522779 0.94
tpch_q16/datafusion:vortex-file-compressed 334257903 343660874 0.97
tpch_q17/datafusion:vortex-file-compressed 1210015012 1184480583 1.02
tpch_q18/datafusion:vortex-file-compressed 1296508066 1302631196 1.00
tpch_q19/datafusion:vortex-file-compressed 737149652 980911696 0.75
tpch_q20/datafusion:vortex-file-compressed 895999970 1020437698 0.88
tpch_q21/datafusion:vortex-file-compressed 1709762562 1671624378 1.02
tpch_q22/datafusion:vortex-file-compressed 371667248 432608531 0.86
datafusion / vortex-compact (0.887x ➖, 2↑ 0↓)
name PR 857ddc7 (ns) base ba08515 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 717199711 708291750 1.01
tpch_q02/datafusion:vortex-compact 604921030 821885416 0.74
tpch_q03/datafusion:vortex-compact 723014155 1007936496 0.72
tpch_q04/datafusion:vortex-compact 612862518 621168225 0.99
tpch_q05/datafusion:vortex-compact 🚀 932046428 1542945998 0.60
tpch_q06/datafusion:vortex-compact 617271015 775135283 0.80
tpch_q07/datafusion:vortex-compact 1086737279 1260849552 0.86
tpch_q08/datafusion:vortex-compact 1175548873 1143607688 1.03
tpch_q09/datafusion:vortex-compact 1219157618 1302864159 0.94
tpch_q10/datafusion:vortex-compact 1131972485 969670136 1.17
tpch_q11/datafusion:vortex-compact 510649977 439681878 1.16
tpch_q12/datafusion:vortex-compact 778626505 957483335 0.81
tpch_q13/datafusion:vortex-compact 403713921 435943717 0.93
tpch_q14/datafusion:vortex-compact 582086039 673410406 0.86
tpch_q15/datafusion:vortex-compact 1055716258 1230847151 0.86
tpch_q16/datafusion:vortex-compact 327945192 419340993 0.78
tpch_q17/datafusion:vortex-compact 1148577861 1288124373 0.89
tpch_q18/datafusion:vortex-compact 1083738299 1118700716 0.97
tpch_q19/datafusion:vortex-compact 788263853 831866074 0.95
tpch_q20/datafusion:vortex-compact 1057841895 1127737859 0.94
tpch_q21/datafusion:vortex-compact 1597876653 1417562564 1.13
tpch_q22/datafusion:vortex-compact 🚀 415950402 633301347 0.66
datafusion / parquet (1.028x ➖, 0↑ 1↓)
name PR 857ddc7 (ns) base ba08515 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 840835825 890972869 0.94
tpch_q02/datafusion:parquet 978738966 824299404 1.19
tpch_q03/datafusion:parquet 991253288 1022332793 0.97
tpch_q04/datafusion:parquet 500266102 514405443 0.97
tpch_q05/datafusion:parquet 1123667159 1176864936 0.95
tpch_q06/datafusion:parquet 555680382 527256617 1.05
tpch_q07/datafusion:parquet 1263031425 1468134608 0.86
tpch_q08/datafusion:parquet 1716163837 1605426849 1.07
tpch_q09/datafusion:parquet 1760287594 1743856786 1.01
tpch_q10/datafusion:parquet 2082775843 1925576000 1.08
tpch_q11/datafusion:parquet 🚨 729248288 526892331 1.38
tpch_q12/datafusion:parquet 847552903 769665503 1.10
tpch_q13/datafusion:parquet 731271824 708084604 1.03
tpch_q14/datafusion:parquet 800070380 793176891 1.01
tpch_q15/datafusion:parquet 1392357788 1221918286 1.14
tpch_q16/datafusion:parquet 461043745 400693390 1.15
tpch_q17/datafusion:parquet 1336794410 1412980876 0.95
tpch_q18/datafusion:parquet 1573321346 1621824757 0.97
tpch_q19/datafusion:parquet 1038490966 976401519 1.06
tpch_q20/datafusion:parquet 1146579928 1238020788 0.93
tpch_q21/datafusion:parquet 1705573194 1892900050 0.90
tpch_q22/datafusion:parquet 747067512 737091116 1.01
duckdb / vortex-file-compressed (1.048x ➖, 0↑ 1↓)
name PR 857ddc7 (ns) base ba08515 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 638221404 617959000 1.03
tpch_q02/duckdb:vortex-file-compressed 1211621842 1207539809 1.00
tpch_q03/duckdb:vortex-file-compressed 1015112163 911034193 1.11
tpch_q04/duckdb:vortex-file-compressed 803425670 690899167 1.16
tpch_q05/duckdb:vortex-file-compressed 1216893719 1147949382 1.06
tpch_q06/duckdb:vortex-file-compressed 826171731 809266603 1.02
tpch_q07/duckdb:vortex-file-compressed 1343064766 1179311457 1.14
tpch_q08/duckdb:vortex-file-compressed 1410612539 1502469150 0.94
tpch_q09/duckdb:vortex-file-compressed 1540999345 1447862727 1.06
tpch_q10/duckdb:vortex-file-compressed 1333469486 1150886025 1.16
tpch_q11/duckdb:vortex-file-compressed 617406338 689208442 0.90
tpch_q12/duckdb:vortex-file-compressed 792624009 752181676 1.05
tpch_q13/duckdb:vortex-file-compressed 995400899 930140789 1.07
tpch_q14/duckdb:vortex-file-compressed 850678595 862180458 0.99
tpch_q15/duckdb:vortex-file-compressed 566389649 535557214 1.06
tpch_q16/duckdb:vortex-file-compressed 476562028 517014293 0.92
tpch_q17/duckdb:vortex-file-compressed 967074253 995970258 0.97
tpch_q18/duckdb:vortex-file-compressed 1012307184 955454126 1.06
tpch_q19/duckdb:vortex-file-compressed 771059299 772653008 1.00
tpch_q20/duckdb:vortex-file-compressed 1262477046 1201688541 1.05
tpch_q21/duckdb:vortex-file-compressed 2228608203 2076378536 1.07
tpch_q22/duckdb:vortex-file-compressed 🚨 710655066 546529805 1.30
duckdb / vortex-compact (1.021x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base ba08515 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 592106984 635559224 0.93
tpch_q02/duckdb:vortex-compact 1118473979 1101696017 1.02
tpch_q03/duckdb:vortex-compact 853974136 915988652 0.93
tpch_q04/duckdb:vortex-compact 547074877 523575820 1.04
tpch_q05/duckdb:vortex-compact 1028226871 1119385016 0.92
tpch_q06/duckdb:vortex-compact 693050782 780157011 0.89
tpch_q07/duckdb:vortex-compact 1070149818 1007333641 1.06
tpch_q08/duckdb:vortex-compact 1470331864 1494487412 0.98
tpch_q09/duckdb:vortex-compact 1476430224 1335831198 1.11
tpch_q10/duckdb:vortex-compact 988658425 1152876646 0.86
tpch_q11/duckdb:vortex-compact 685120013 668335154 1.03
tpch_q12/duckdb:vortex-compact 686162772 678472818 1.01
tpch_q13/duckdb:vortex-compact 921568172 888439291 1.04
tpch_q14/duckdb:vortex-compact 998353455 865424088 1.15
tpch_q15/duckdb:vortex-compact 541546713 536540380 1.01
tpch_q16/duckdb:vortex-compact 473134851 421340261 1.12
tpch_q17/duckdb:vortex-compact 936572969 957290588 0.98
tpch_q18/duckdb:vortex-compact 840668999 743650770 1.13
tpch_q19/duckdb:vortex-compact 807355174 729694383 1.11
tpch_q20/duckdb:vortex-compact 1388415601 1261539414 1.10
tpch_q21/duckdb:vortex-compact 1689914105 1694096386 1.00
tpch_q22/duckdb:vortex-compact 717107880 636319407 1.13
duckdb / parquet (0.973x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base ba08515 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 782091025 931734427 0.84
tpch_q02/duckdb:parquet 1418885308 1543393629 0.92
tpch_q03/duckdb:parquet 1654038149 1689723199 0.98
tpch_q04/duckdb:parquet 1094465989 1307766430 0.84
tpch_q05/duckdb:parquet 2288784131 2365772721 0.97
tpch_q06/duckdb:parquet 710603546 750678304 0.95
tpch_q07/duckdb:parquet 1788878318 1898803677 0.94
tpch_q08/duckdb:parquet 2382662384 2700155381 0.88
tpch_q09/duckdb:parquet 2466079797 2691182760 0.92
tpch_q10/duckdb:parquet 3006333574 3250011534 0.93
tpch_q11/duckdb:parquet 968379916 1043521429 0.93
tpch_q12/duckdb:parquet 1048106339 1183657901 0.89
tpch_q13/duckdb:parquet 1274031142 1232076859 1.03
tpch_q14/duckdb:parquet 1200048996 1257701956 0.95
tpch_q15/duckdb:parquet 946164612 890894075 1.06
tpch_q16/duckdb:parquet 959469085 824056689 1.16
tpch_q17/duckdb:parquet 1449738395 1327052789 1.09
tpch_q18/duckdb:parquet 1563025838 1488027424 1.05
tpch_q19/duckdb:parquet 1686992234 1621097120 1.04
tpch_q20/duckdb:parquet 1974535147 1756683483 1.12
tpch_q21/duckdb:parquet 1896733404 1860163725 1.02
tpch_q22/duckdb:parquet 1086684394 1111047149 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +1.3% -11.0% +13.8% +47.5% ➖ noise
1 datafusion:vortex-file-compressed -1.5% -11.0% +10.6% +48.9% ➖ noise
1 duckdb:vortex-compact -6.8% -11.0% +4.7% +33.1% ➖ noise
1 duckdb:vortex-file-compressed +3.3% -11.0% +16.0% +38.0% ➖ noise
2 datafusion:vortex-compact -26.4% +4.5% -29.6% +46.7% ➖ noise
2 datafusion:vortex-file-compressed -25.1% +4.5% -28.3% +51.2% ➖ noise
2 duckdb:vortex-compact +1.5% +4.5% -2.8% +42.0% ➖ noise
2 duckdb:vortex-file-compressed +0.3% +4.5% -4.0% +40.8% ➖ noise
3 datafusion:vortex-compact -28.3% -2.6% -26.4% +45.7% ➖ noise
3 datafusion:vortex-file-compressed +21.5% -2.6% +24.7% +45.6% ➖ noise
3 duckdb:vortex-compact -6.8% -2.6% -4.3% +37.4% ➖ noise
3 duckdb:vortex-file-compressed +11.4% -2.6% +14.4% +39.8% ➖ noise
4 datafusion:vortex-compact -1.3% -9.8% +9.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +21.5% -9.8% +34.7% +34.7% 🚨 regression
4 duckdb:vortex-compact +4.5% -9.8% +15.8% +39.5% ➖ noise
4 duckdb:vortex-file-compressed +16.3% -9.8% +28.9% +30.1% ➖ noise
5 datafusion:vortex-compact -39.6% -3.9% -37.1% +30.0% ✅ faster
5 datafusion:vortex-file-compressed +11.7% -3.9% +16.3% +30.0% ➖ noise
5 duckdb:vortex-compact -8.1% -3.9% -4.4% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +6.0% -3.9% +10.3% +30.0% ➖ noise
6 datafusion:vortex-compact -20.4% -0.1% -20.3% +37.2% ➖ noise
6 datafusion:vortex-file-compressed +1.7% -0.1% +1.8% +30.0% ➖ noise
6 duckdb:vortex-compact -11.2% -0.1% -11.1% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +2.1% -0.1% +2.2% +30.0% ➖ noise
7 datafusion:vortex-compact -13.8% -10.0% -4.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +3.6% -10.0% +15.1% +30.0% ➖ noise
7 duckdb:vortex-compact +6.2% -10.0% +18.0% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +13.9% -10.0% +26.5% +30.0% ➖ noise
8 datafusion:vortex-compact +2.8% -2.9% +5.8% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +0.9% -2.9% +3.9% +30.0% ➖ noise
8 duckdb:vortex-compact -1.6% -2.9% +1.3% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -6.1% -2.9% -3.3% +30.0% ➖ noise
9 datafusion:vortex-compact -6.4% -3.8% -2.7% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +15.1% -3.8% +19.7% +30.0% ➖ noise
9 duckdb:vortex-compact +10.5% -3.8% +14.9% +33.4% ➖ noise
9 duckdb:vortex-file-compressed +6.4% -3.8% +10.7% +30.0% ➖ noise
10 datafusion:vortex-compact +16.7% +0.0% +16.7% +35.4% ➖ noise
10 datafusion:vortex-file-compressed -2.5% +0.0% -2.5% +30.0% ➖ noise
10 duckdb:vortex-compact -14.2% +0.0% -14.3% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +15.9% +0.0% +15.8% +30.0% ➖ noise
11 datafusion:vortex-compact +16.1% +13.3% +2.5% +32.9% ➖ noise
11 datafusion:vortex-file-compressed +8.7% +13.3% -4.1% +30.0% ➖ noise
11 duckdb:vortex-compact +2.5% +13.3% -9.5% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -10.4% +13.3% -21.0% +30.0% ➖ noise
12 datafusion:vortex-compact -18.7% -1.3% -17.6% +30.0% ➖ noise
12 datafusion:vortex-file-compressed -14.3% -1.3% -13.2% +30.0% ➖ noise
12 duckdb:vortex-compact +1.1% -1.3% +2.4% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +5.4% -1.3% +6.7% +30.0% ➖ noise
13 datafusion:vortex-compact -7.4% +3.3% -10.4% +30.0% ➖ noise
13 datafusion:vortex-file-compressed +8.4% +3.3% +4.9% +37.3% ➖ noise
13 duckdb:vortex-compact +3.7% +3.3% +0.4% +49.8% ➖ noise
13 duckdb:vortex-file-compressed +7.0% +3.3% +3.6% +45.5% ➖ noise
14 datafusion:vortex-compact -13.6% -1.9% -11.9% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -3.0% -1.9% -1.2% +30.0% ➖ noise
14 duckdb:vortex-compact +15.4% -1.9% +17.6% +30.0% ➖ noise
14 duckdb:vortex-file-compressed -1.3% -1.9% +0.6% +30.0% ➖ noise
15 datafusion:vortex-compact -14.2% +10.0% -22.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -6.1% +10.0% -14.6% +30.0% ➖ noise
15 duckdb:vortex-compact +0.9% +10.0% -8.2% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +5.8% +10.0% -3.9% +30.0% ➖ noise
16 datafusion:vortex-compact -21.8% +15.7% -32.4% +30.0% ✅ faster
16 datafusion:vortex-file-compressed -2.7% +15.7% -16.0% +30.0% ➖ noise
16 duckdb:vortex-compact +12.3% +15.7% -3.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -7.8% +15.7% -20.4% +30.0% ➖ noise
17 datafusion:vortex-compact -10.8% +1.7% -12.3% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +2.2% +1.7% +0.5% +30.0% ➖ noise
17 duckdb:vortex-compact -2.2% +1.7% -3.8% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -2.9% +1.7% -4.5% +30.0% ➖ noise
18 datafusion:vortex-compact -3.1% +0.9% -4.0% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -0.5% +0.9% -1.4% +30.0% ➖ noise
18 duckdb:vortex-compact +13.0% +0.9% +12.0% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +6.0% +0.9% +5.0% +30.0% ➖ noise
19 datafusion:vortex-compact -5.2% +5.2% -9.9% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -24.9% +5.2% -28.6% +30.0% ✅ faster
19 duckdb:vortex-compact +10.6% +5.2% +5.2% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -0.2% +5.2% -5.1% +30.0% ➖ noise
20 datafusion:vortex-compact -6.2% +2.0% -8.1% +32.7% ➖ noise
20 datafusion:vortex-file-compressed -12.2% +2.0% -13.9% +30.0% ➖ noise
20 duckdb:vortex-compact +10.1% +2.0% +7.9% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +5.1% +2.0% +3.0% +30.0% ➖ noise
21 datafusion:vortex-compact +12.7% -4.1% +17.6% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +2.3% -4.1% +6.7% +30.0% ➖ noise
21 duckdb:vortex-compact -0.2% -4.1% +4.1% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +7.3% -4.1% +12.0% +30.0% ➖ noise
22 datafusion:vortex-compact -34.3% -0.4% -34.0% +34.5% ✅ faster
22 datafusion:vortex-file-compressed -14.1% -0.4% -13.7% +30.0% ➖ noise
22 duckdb:vortex-compact +12.7% -0.4% +13.2% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +30.0% -0.4% +30.6% +30.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.998x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +0.8%


datafusion / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 405118820 396525221 1.02
tpch_q02/datafusion:vortex-file-compressed 113856111 113962255 1.00
tpch_q03/datafusion:vortex-file-compressed 211621541 210238245 1.01
tpch_q04/datafusion:vortex-file-compressed 108967837 107082752 1.02
tpch_q05/datafusion:vortex-file-compressed 390132011 382656146 1.02
tpch_q06/datafusion:vortex-file-compressed 41762281 41972355 0.99
tpch_q07/datafusion:vortex-file-compressed 565159492 559872326 1.01
tpch_q08/datafusion:vortex-file-compressed 376824370 375229020 1.00
tpch_q09/datafusion:vortex-file-compressed 672655151 659566273 1.02
tpch_q10/datafusion:vortex-file-compressed 247217955 243371193 1.02
tpch_q11/datafusion:vortex-file-compressed 87461524 84880013 1.03
tpch_q12/datafusion:vortex-file-compressed 116774032 116047851 1.01
tpch_q13/datafusion:vortex-file-compressed 219483663 218906157 1.00
tpch_q14/datafusion:vortex-file-compressed 56827125 56401126 1.01
tpch_q15/datafusion:vortex-file-compressed 107381399 106239808 1.01
tpch_q16/datafusion:vortex-file-compressed 77659063 75659753 1.03
tpch_q17/datafusion:vortex-file-compressed 656383560 648303594 1.01
tpch_q18/datafusion:vortex-file-compressed 880559942 870318562 1.01
tpch_q19/datafusion:vortex-file-compressed 92166350 93026136 0.99
tpch_q20/datafusion:vortex-file-compressed 170199397 167735393 1.01
tpch_q21/datafusion:vortex-file-compressed 682219551 682705264 1.00
tpch_q22/datafusion:vortex-file-compressed 61088908 60174531 1.02
datafusion / vortex-compact (0.963x ➖, 2↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 432988084 455721333 0.95
tpch_q02/datafusion:vortex-compact 118837722 118877480 1.00
tpch_q03/datafusion:vortex-compact 215503030 215974968 1.00
tpch_q04/datafusion:vortex-compact 119668409 119377101 1.00
tpch_q05/datafusion:vortex-compact 391216043 392636186 1.00
tpch_q06/datafusion:vortex-compact 63147032 63607664 0.99
tpch_q07/datafusion:vortex-compact 586935850 590086598 0.99
tpch_q08/datafusion:vortex-compact 389019133 388670222 1.00
tpch_q09/datafusion:vortex-compact 681595523 682146245 1.00
tpch_q10/datafusion:vortex-compact 274751446 290733218 0.95
tpch_q11/datafusion:vortex-compact 90387748 97015503 0.93
tpch_q12/datafusion:vortex-compact 164510803 165725640 0.99
tpch_q13/datafusion:vortex-compact 271791243 282434800 0.96
tpch_q14/datafusion:vortex-compact 73011557 77327640 0.94
tpch_q15/datafusion:vortex-compact 164504244 168710924 0.98
tpch_q16/datafusion:vortex-compact 82527579 88754709 0.93
tpch_q17/datafusion:vortex-compact 🚀 651476788 830032032 0.78
tpch_q18/datafusion:vortex-compact 🚀 885078805 1081964152 0.82
tpch_q19/datafusion:vortex-compact 136711683 137729555 0.99
tpch_q20/datafusion:vortex-compact 198397395 197496809 1.00
tpch_q21/datafusion:vortex-compact 702076942 691255488 1.02
tpch_q22/datafusion:vortex-compact 72383558 72130351 1.00
datafusion / parquet (1.008x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 416231941 449995038 0.92
tpch_q02/datafusion:parquet 187340710 185159187 1.01
tpch_q03/datafusion:parquet 296507738 293242874 1.01
tpch_q04/datafusion:parquet 137455619 136861139 1.00
tpch_q05/datafusion:parquet 454849945 446411046 1.02
tpch_q06/datafusion:parquet 126981022 119919782 1.06
tpch_q07/datafusion:parquet 630413308 624418600 1.01
tpch_q08/datafusion:parquet 492733974 491518355 1.00
tpch_q09/datafusion:parquet 775181354 769225434 1.01
tpch_q10/datafusion:parquet 511641634 507838200 1.01
tpch_q11/datafusion:parquet 132484930 129931219 1.02
tpch_q12/datafusion:parquet 218765096 211155556 1.04
tpch_q13/datafusion:parquet 338994466 339323149 1.00
tpch_q14/datafusion:parquet 155868359 165047027 0.94
tpch_q15/datafusion:parquet 243546223 241675168 1.01
tpch_q16/datafusion:parquet 139151211 136291020 1.02
tpch_q17/datafusion:parquet 695541315 687267409 1.01
tpch_q18/datafusion:parquet 897885345 879976293 1.02
tpch_q19/datafusion:parquet 268428866 265881458 1.01
tpch_q20/datafusion:parquet 311007756 305151177 1.02
tpch_q21/datafusion:parquet 742970311 737875592 1.01
tpch_q22/datafusion:parquet 221068609 215919543 1.02
datafusion / arrow (1.008x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 591992419 583279283 1.01
tpch_q02/datafusion:arrow 165226649 161333136 1.02
tpch_q03/datafusion:arrow 448650718 442233356 1.01
tpch_q04/datafusion:arrow 335262717 330593244 1.01
tpch_q05/datafusion:arrow 880482898 870359989 1.01
tpch_q06/datafusion:arrow 265290326 262169574 1.01
tpch_q07/datafusion:arrow 1101130095 1074250831 1.03
tpch_q08/datafusion:arrow 1087406725 1068063672 1.02
tpch_q09/datafusion:arrow 1298029851 1298494095 1.00
tpch_q10/datafusion:arrow 585487508 582929422 1.00
tpch_q11/datafusion:arrow 145798523 144125629 1.01
tpch_q12/datafusion:arrow 653203724 641892763 1.02
tpch_q13/datafusion:arrow 516847951 498692827 1.04
tpch_q14/datafusion:arrow 292597796 297664248 0.98
tpch_q15/datafusion:arrow 635344221 624671692 1.02
tpch_q16/datafusion:arrow 105071847 106187649 0.99
tpch_q17/datafusion:arrow 1285330485 1272451490 1.01
tpch_q18/datafusion:arrow 1765018362 1754422023 1.01
tpch_q19/datafusion:arrow 477579437 483596475 0.99
tpch_q20/datafusion:arrow 470822729 473367358 0.99
tpch_q21/datafusion:arrow 2753382399 2766049288 1.00
tpch_q22/datafusion:arrow 138232662 139516719 0.99
duckdb / vortex-file-compressed (1.012x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 175227319 176616166 0.99
tpch_q02/duckdb:vortex-file-compressed 55048158 53616940 1.03
tpch_q03/duckdb:vortex-file-compressed 134174084 134132630 1.00
tpch_q04/duckdb:vortex-file-compressed 162773106 157979372 1.03
tpch_q05/duckdb:vortex-file-compressed 135406467 134335528 1.01
tpch_q06/duckdb:vortex-file-compressed 49173236 49171952 1.00
tpch_q07/duckdb:vortex-file-compressed 154630011 153391198 1.01
tpch_q08/duckdb:vortex-file-compressed 180068541 179568999 1.00
tpch_q09/duckdb:vortex-file-compressed 339144454 333913097 1.02
tpch_q10/duckdb:vortex-file-compressed 165677458 163973804 1.01
tpch_q11/duckdb:vortex-file-compressed 35494807 34320337 1.03
tpch_q12/duckdb:vortex-file-compressed 98469880 96308961 1.02
tpch_q13/duckdb:vortex-file-compressed 243692260 241749536 1.01
tpch_q14/duckdb:vortex-file-compressed 73137987 71379493 1.02
tpch_q15/duckdb:vortex-file-compressed 96909321 96721991 1.00
tpch_q16/duckdb:vortex-file-compressed 81747143 80758391 1.01
tpch_q17/duckdb:vortex-file-compressed 102665895 103298861 0.99
tpch_q18/duckdb:vortex-file-compressed 305255952 298662695 1.02
tpch_q19/duckdb:vortex-file-compressed 92178159 90566386 1.02
tpch_q20/duckdb:vortex-file-compressed 166873016 166102863 1.00
tpch_q21/duckdb:vortex-file-compressed 598496108 590442470 1.01
tpch_q22/duckdb:vortex-file-compressed 78506299 77771798 1.01
duckdb / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228823941 235974769 0.97
tpch_q02/duckdb:vortex-compact 58983787 59564756 0.99
tpch_q03/duckdb:vortex-compact 141524013 141133510 1.00
tpch_q04/duckdb:vortex-compact 176019170 175131599 1.01
tpch_q05/duckdb:vortex-compact 147795170 145179812 1.02
tpch_q06/duckdb:vortex-compact 83442597 84239335 0.99
tpch_q07/duckdb:vortex-compact 203610923 203492471 1.00
tpch_q08/duckdb:vortex-compact 191539298 190684543 1.00
tpch_q09/duckdb:vortex-compact 365100594 360778454 1.01
tpch_q10/duckdb:vortex-compact 186522080 184132466 1.01
tpch_q11/duckdb:vortex-compact 41502386 41542668 1.00
tpch_q12/duckdb:vortex-compact 202681408 201541608 1.01
tpch_q13/duckdb:vortex-compact 293902698 291804728 1.01
tpch_q14/duckdb:vortex-compact 103076996 101617106 1.01
tpch_q15/duckdb:vortex-compact 117824800 117434581 1.00
tpch_q16/duckdb:vortex-compact 87802614 85465010 1.03
tpch_q17/duckdb:vortex-compact 118148604 116255558 1.02
tpch_q18/duckdb:vortex-compact 302029308 295663687 1.02
tpch_q19/duckdb:vortex-compact 114926684 114245883 1.01
tpch_q20/duckdb:vortex-compact 207787022 205400714 1.01
tpch_q21/duckdb:vortex-compact 626324605 619447381 1.01
tpch_q22/duckdb:vortex-compact 90533807 89244143 1.01
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 262345575 257889471 1.02
tpch_q02/duckdb:parquet 96239500 101506766 0.95
tpch_q03/duckdb:parquet 208674072 205477888 1.02
tpch_q04/duckdb:parquet 131685662 132481446 0.99
tpch_q05/duckdb:parquet 215733552 212031248 1.02
tpch_q06/duckdb:parquet 66455686 63822626 1.04
tpch_q07/duckdb:parquet 178741117 178753599 1.00
tpch_q08/duckdb:parquet 250059263 253057321 0.99
tpch_q09/duckdb:parquet 482745273 490609222 0.98
tpch_q10/duckdb:parquet 609248410 605144731 1.01
tpch_q11/duckdb:parquet 59482904 56289164 1.06
tpch_q12/duckdb:parquet 123442301 121830413 1.01
tpch_q13/duckdb:parquet 445667468 442263974 1.01
tpch_q14/duckdb:parquet 171698069 171926870 1.00
tpch_q15/duckdb:parquet 96534708 94437176 1.02
tpch_q16/duckdb:parquet 161149813 160427698 1.00
tpch_q17/duckdb:parquet 179267757 173061312 1.04
tpch_q18/duckdb:parquet 347198191 348747486 1.00
tpch_q19/duckdb:parquet 285574805 282317818 1.01
tpch_q20/duckdb:parquet 227135698 228183381 1.00
tpch_q21/duckdb:parquet 562923110 552000348 1.02
tpch_q22/duckdb:parquet 291466880 286101608 1.02
duckdb / duckdb (0.996x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116860199 117833318 0.99
tpch_q02/duckdb:duckdb 47460329 47173771 1.01
tpch_q03/duckdb:duckdb 96212175 98538068 0.98
tpch_q04/duckdb:duckdb 132727422 133434053 0.99
tpch_q05/duckdb:duckdb 111085934 109897397 1.01
tpch_q06/duckdb:duckdb 37236453 38979965 0.96
tpch_q07/duckdb:duckdb 87013638 88245216 0.99
tpch_q08/duckdb:duckdb 110667385 109880631 1.01
tpch_q09/duckdb:duckdb 277239791 279483214 0.99
tpch_q10/duckdb:duckdb 202386365 200108648 1.01
tpch_q11/duckdb:duckdb 15759702 15489319 1.02
tpch_q12/duckdb:duckdb 85173804 85528439 1.00
tpch_q13/duckdb:duckdb 224049903 221114542 1.01
tpch_q14/duckdb:duckdb 70851207 72237383 0.98
tpch_q15/duckdb:duckdb 76780256 77707834 0.99
tpch_q16/duckdb:duckdb 72573514 73868479 0.98
tpch_q17/duckdb:duckdb 84870861 84966596 1.00
tpch_q18/duckdb:duckdb 211748989 212623283 1.00
tpch_q19/duckdb:duckdb 116769377 117221246 1.00
tpch_q20/duckdb:duckdb 112047899 111536188 1.00
tpch_q21/duckdb:duckdb 294673553 302718865 0.97
tpch_q22/duckdb:duckdb 67631701 65458768 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +1.5% -3.0% +4.6% +10.0% ➖ noise
1 datafusion:vortex-compact -5.0% -3.0% -2.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +2.2% -3.0% +5.3% +10.0% ➖ noise
1 duckdb:duckdb -0.8% -3.0% +2.2% +10.0% ➖ noise
1 duckdb:vortex-compact -3.0% -3.0% -0.0% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.8% -3.0% +2.3% +10.0% ➖ noise
2 datafusion:arrow +2.4% -2.1% +4.6% +10.0% ➖ noise
2 datafusion:vortex-compact -0.0% -2.1% +2.1% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -0.1% -2.1% +2.0% +10.0% ➖ noise
2 duckdb:duckdb +0.6% -2.1% +2.7% +10.0% ➖ noise
2 duckdb:vortex-compact -1.0% -2.1% +1.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +2.7% -2.1% +4.8% +10.0% ➖ noise
3 datafusion:arrow +1.5% +1.3% +0.1% +10.0% ➖ noise
3 datafusion:vortex-compact -0.2% +1.3% -1.5% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.7% +1.3% -0.7% +10.0% ➖ noise
3 duckdb:duckdb -2.4% +1.3% -3.6% +10.0% ➖ noise
3 duckdb:vortex-compact +0.3% +1.3% -1.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.0% +1.3% -1.3% +10.0% ➖ noise
4 datafusion:arrow +1.4% -0.1% +1.5% +10.0% ➖ noise
4 datafusion:vortex-compact +0.2% -0.1% +0.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.8% -0.1% +1.8% +10.0% ➖ noise
4 duckdb:duckdb -0.5% -0.1% -0.4% +10.0% ➖ noise
4 duckdb:vortex-compact +0.5% -0.1% +0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.0% -0.1% +3.1% +10.0% ➖ noise
5 datafusion:arrow +1.2% +1.8% -0.6% +10.0% ➖ noise
5 datafusion:vortex-compact -0.4% +1.8% -2.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.0% +1.8% +0.1% +10.0% ➖ noise
5 duckdb:duckdb +1.1% +1.8% -0.7% +10.0% ➖ noise
5 duckdb:vortex-compact +1.8% +1.8% -0.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.8% +1.8% -1.0% +10.0% ➖ noise
6 datafusion:arrow +1.2% +5.0% -3.6% +10.0% ➖ noise
6 datafusion:vortex-compact -0.7% +5.0% -5.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -0.5% +5.0% -5.2% +10.0% ➖ noise
6 duckdb:duckdb -4.5% +5.0% -9.0% +10.0% ➖ noise
6 duckdb:vortex-compact -0.9% +5.0% -5.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.0% +5.0% -4.8% +10.0% ➖ noise
7 datafusion:arrow +2.5% +0.5% +2.0% +10.0% ➖ noise
7 datafusion:vortex-compact -0.5% +0.5% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.9% +0.5% +0.5% +10.0% ➖ noise
7 duckdb:duckdb -1.4% +0.5% -1.9% +10.0% ➖ noise
7 duckdb:vortex-compact +0.1% +0.5% -0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.8% +0.5% +0.3% +10.0% ➖ noise
8 datafusion:arrow +1.8% -0.5% +2.3% +10.0% ➖ noise
8 datafusion:vortex-compact +0.1% -0.5% +0.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.4% -0.5% +0.9% +10.0% ➖ noise
8 duckdb:duckdb +0.7% -0.5% +1.2% +10.0% ➖ noise
8 duckdb:vortex-compact +0.4% -0.5% +0.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.3% -0.5% +0.8% +10.0% ➖ noise
9 datafusion:arrow -0.0% -0.4% +0.4% +10.0% ➖ noise
9 datafusion:vortex-compact -0.1% -0.4% +0.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.0% -0.4% +2.4% +10.0% ➖ noise
9 duckdb:duckdb -0.8% -0.4% -0.4% +10.0% ➖ noise
9 duckdb:vortex-compact +1.2% -0.4% +1.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.6% -0.4% +2.0% +10.0% ➖ noise
10 datafusion:arrow +0.4% +0.7% -0.3% +10.0% ➖ noise
10 datafusion:vortex-compact -5.5% +0.7% -6.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.6% +0.7% +0.9% +10.0% ➖ noise
10 duckdb:duckdb +1.1% +0.7% +0.4% +10.0% ➖ noise
10 duckdb:vortex-compact +1.3% +0.7% +0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +1.0% +0.7% +0.3% +10.0% ➖ noise
11 datafusion:arrow +1.2% +3.8% -2.5% +10.0% ➖ noise
11 datafusion:vortex-compact -6.8% +3.8% -10.2% +10.0% ✅ faster
11 datafusion:vortex-file-compressed +3.0% +3.8% -0.7% +10.0% ➖ noise
11 duckdb:duckdb +1.7% +3.8% -2.0% +11.5% ➖ noise
11 duckdb:vortex-compact -0.1% +3.8% -3.8% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +3.8% -0.4% +10.0% ➖ noise
12 datafusion:arrow +1.8% +2.5% -0.7% +27.7% ➖ noise
12 datafusion:vortex-compact -0.7% +2.5% -3.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.6% +2.5% -1.8% +10.0% ➖ noise
12 duckdb:duckdb -0.4% +2.5% -2.8% +10.0% ➖ noise
12 duckdb:vortex-compact +0.6% +2.5% -1.8% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +2.2% +2.5% -0.2% +10.0% ➖ noise
13 datafusion:arrow +3.6% +0.3% +3.3% +10.0% ➖ noise
13 datafusion:vortex-compact -3.8% +0.3% -4.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +0.3% +0.3% -0.1% +10.0% ➖ noise
13 duckdb:duckdb +1.3% +0.3% +1.0% +10.0% ➖ noise
13 duckdb:vortex-compact +0.7% +0.3% +0.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.8% +0.3% +0.5% +10.0% ➖ noise
14 datafusion:arrow -1.7% -2.9% +1.2% +10.0% ➖ noise
14 datafusion:vortex-compact -5.6% -2.9% -2.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.8% -2.9% +3.7% +10.1% ➖ noise
14 duckdb:duckdb -1.9% -2.9% +1.0% +10.0% ➖ noise
14 duckdb:vortex-compact +1.4% -2.9% +4.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +2.5% -2.9% +5.5% +10.0% ➖ noise
15 datafusion:arrow +1.7% +1.5% +0.2% +10.0% ➖ noise
15 datafusion:vortex-compact -2.5% +1.5% -3.9% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.1% +1.5% -0.4% +10.0% ➖ noise
15 duckdb:duckdb -1.2% +1.5% -2.6% +10.0% ➖ noise
15 duckdb:vortex-compact +0.3% +1.5% -1.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.2% +1.5% -1.3% +10.0% ➖ noise
16 datafusion:arrow -1.1% +1.3% -2.3% +10.0% ➖ noise
16 datafusion:vortex-compact -7.0% +1.3% -8.2% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.6% +1.3% +1.4% +10.0% ➖ noise
16 duckdb:duckdb -1.8% +1.3% -3.0% +10.0% ➖ noise
16 duckdb:vortex-compact +2.7% +1.3% +1.4% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.2% +1.3% -0.0% +10.0% ➖ noise
17 datafusion:arrow +1.0% +2.4% -1.3% +10.0% ➖ noise
17 datafusion:vortex-compact -21.5% +2.4% -23.3% +10.0% ✅ faster
17 datafusion:vortex-file-compressed +1.2% +2.4% -1.1% +10.0% ➖ noise
17 duckdb:duckdb -0.1% +2.4% -2.4% +10.0% ➖ noise
17 duckdb:vortex-compact +1.6% +2.4% -0.7% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.6% +2.4% -2.9% +10.0% ➖ noise
18 datafusion:arrow +0.6% +0.8% -0.2% +10.0% ➖ noise
18 datafusion:vortex-compact -18.2% +0.8% -18.8% +10.0% ✅ faster
18 datafusion:vortex-file-compressed +1.2% +0.8% +0.4% +10.0% ➖ noise
18 duckdb:duckdb -0.4% +0.8% -1.2% +10.0% ➖ noise
18 duckdb:vortex-compact +2.2% +0.8% +1.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.2% +0.8% +1.4% +10.0% ➖ noise
19 datafusion:arrow -1.2% +1.1% -2.3% +10.0% ➖ noise
19 datafusion:vortex-compact -0.7% +1.1% -1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.9% +1.1% -2.0% +10.0% ➖ noise
19 duckdb:duckdb -0.4% +1.1% -1.4% +10.0% ➖ noise
19 duckdb:vortex-compact +0.6% +1.1% -0.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +1.8% +1.1% +0.7% +10.0% ➖ noise
20 datafusion:arrow -0.5% +0.7% -1.3% +10.0% ➖ noise
20 datafusion:vortex-compact +0.5% +0.7% -0.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.5% +0.7% +0.7% +10.0% ➖ noise
20 duckdb:duckdb +0.5% +0.7% -0.3% +10.0% ➖ noise
20 duckdb:vortex-compact +1.2% +0.7% +0.4% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +0.5% +0.7% -0.3% +10.0% ➖ noise
21 datafusion:arrow -0.5% +1.3% -1.8% +10.0% ➖ noise
21 datafusion:vortex-compact +1.6% +1.3% +0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.1% +1.3% -1.4% +10.0% ➖ noise
21 duckdb:duckdb -2.7% +1.3% -3.9% +10.0% ➖ noise
21 duckdb:vortex-compact +1.1% +1.3% -0.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +1.4% +1.3% +0.0% +10.0% ➖ noise
22 datafusion:arrow -0.9% +2.1% -3.0% +10.0% ➖ noise
22 datafusion:vortex-compact +0.4% +2.1% -1.7% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +1.5% +2.1% -0.6% +10.0% ➖ noise
22 duckdb:duckdb +3.3% +2.1% +1.2% +10.0% ➖ noise
22 duckdb:vortex-compact +1.4% +2.1% -0.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.9% +2.1% -1.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.004x ➖


datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 126640200 130178180 0.97
polarsignals_q01/datafusion:vortex-file-compressed 377475105 382403587 0.99
polarsignals_q02/datafusion:vortex-file-compressed 24199356 24521907 0.99
polarsignals_q03/datafusion:vortex-file-compressed 387256348 385130531 1.01
polarsignals_q04/datafusion:vortex-file-compressed 11834075 11745348 1.01
polarsignals_q05/datafusion:vortex-file-compressed 16647441 16233489 1.03
polarsignals_q06/datafusion:vortex-file-compressed 19395684 19748241 0.98
polarsignals_q07/datafusion:vortex-file-compressed 15644698 14246785 1.10
polarsignals_q08/datafusion:vortex-file-compressed 474619866 476632316 1.00
polarsignals_q09/datafusion:vortex-file-compressed 10741602 10952906 0.98

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 0.969x ➖
Parquet (geomean): 0.981x ➖
Shifts: Parquet (control) -1.9% · Median polish -3.9%


datafusion / vortex-file-compressed (0.994x ➖, 1↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1875022 1947383 0.96
clickbench_q01/datafusion:vortex-file-compressed 15228296 14573761 1.04
clickbench_q02/datafusion:vortex-file-compressed 33527063 34080379 0.98
clickbench_q03/datafusion:vortex-file-compressed 38175379 39469406 0.97
clickbench_q04/datafusion:vortex-file-compressed 309261511 303073916 1.02
clickbench_q05/datafusion:vortex-file-compressed 316010330 312833816 1.01
clickbench_q06/datafusion:vortex-file-compressed 1923739 1847873 1.04
clickbench_q07/datafusion:vortex-file-compressed 17448492 17638200 0.99
clickbench_q08/datafusion:vortex-file-compressed 377586890 381159856 0.99
clickbench_q09/datafusion:vortex-file-compressed 566026627 553812209 1.02
clickbench_q10/datafusion:vortex-file-compressed 72487304 72417016 1.00
clickbench_q11/datafusion:vortex-file-compressed 84470896 83027519 1.02
clickbench_q12/datafusion:vortex-file-compressed 275998312 274458655 1.01
clickbench_q13/datafusion:vortex-file-compressed 411768824 420468419 0.98
clickbench_q14/datafusion:vortex-file-compressed 257215789 262962127 0.98
clickbench_q15/datafusion:vortex-file-compressed 361979681 357516944 1.01
clickbench_q16/datafusion:vortex-file-compressed 695035505 692910950 1.00
clickbench_q17/datafusion:vortex-file-compressed 684078288 688301714 0.99
clickbench_q18/datafusion:vortex-file-compressed 1377142481 1338075880 1.03
clickbench_q19/datafusion:vortex-file-compressed 25981195 24849205 1.05
clickbench_q20/datafusion:vortex-file-compressed 357668247 351713187 1.02
clickbench_q21/datafusion:vortex-file-compressed 405515118 400716848 1.01
clickbench_q22/datafusion:vortex-file-compressed 494568049 500041025 0.99
clickbench_q23/datafusion:vortex-file-compressed 728649387 744082167 0.98
clickbench_q24/datafusion:vortex-file-compressed 🚀 45795476 51756196 0.88
clickbench_q25/datafusion:vortex-file-compressed 73373670 74098415 0.99
clickbench_q26/datafusion:vortex-file-compressed 45764246 45602739 1.00
clickbench_q27/datafusion:vortex-file-compressed 800186116 851709424 0.94
clickbench_q28/datafusion:vortex-file-compressed 6726361804 6927501651 0.97
clickbench_q29/datafusion:vortex-file-compressed 237234376 235916099 1.01
clickbench_q30/datafusion:vortex-file-compressed 232354095 233659762 0.99
clickbench_q31/datafusion:vortex-file-compressed 268954436 273997423 0.98
clickbench_q32/datafusion:vortex-file-compressed 1186921221 1299106268 0.91
clickbench_q33/datafusion:vortex-file-compressed 1426357286 1475738276 0.97
clickbench_q34/datafusion:vortex-file-compressed 1412487905 1412170319 1.00
clickbench_q35/datafusion:vortex-file-compressed 524006154 513009919 1.02
clickbench_q36/datafusion:vortex-file-compressed 79475194 78549084 1.01
clickbench_q37/datafusion:vortex-file-compressed 39496971 38420873 1.03
clickbench_q38/datafusion:vortex-file-compressed 22417544 22265308 1.01
clickbench_q39/datafusion:vortex-file-compressed 149912893 145023140 1.03
clickbench_q40/datafusion:vortex-file-compressed 18836475 19002224 0.99
clickbench_q41/datafusion:vortex-file-compressed 16915732 18007191 0.94
clickbench_q42/datafusion:vortex-file-compressed 18752246 19409483 0.97
datafusion / parquet (1.007x ➖, 0↑ 1↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1960573 1925768 1.02
clickbench_q01/datafusion:parquet 19780932 21434109 0.92
clickbench_q02/datafusion:parquet 56617192 55733507 1.02
clickbench_q03/datafusion:parquet 45589836 46712723 0.98
clickbench_q04/datafusion:parquet 330858275 333536625 0.99
clickbench_q05/datafusion:parquet 377297319 365514939 1.03
clickbench_q06/datafusion:parquet 1922277 1833657 1.05
clickbench_q07/datafusion:parquet 26613410 26600666 1.00
clickbench_q08/datafusion:parquet 417248137 419214659 1.00
clickbench_q09/datafusion:parquet 644547642 639070255 1.01
clickbench_q10/datafusion:parquet 109815159 109188497 1.01
clickbench_q11/datafusion:parquet 135585279 135414559 1.00
clickbench_q12/datafusion:parquet 361784829 362928054 1.00
clickbench_q13/datafusion:parquet 497043487 505634632 0.98
clickbench_q14/datafusion:parquet 360014073 360707940 1.00
clickbench_q15/datafusion:parquet 380610541 366946030 1.04
clickbench_q16/datafusion:parquet 718146747 697881390 1.03
clickbench_q17/datafusion:parquet 680344428 681346129 1.00
clickbench_q18/datafusion:parquet 1402035081 1395765934 1.00
clickbench_q19/datafusion:parquet 34739206 34349954 1.01
clickbench_q20/datafusion:parquet 625766742 620264448 1.01
clickbench_q21/datafusion:parquet 684657423 682657101 1.00
clickbench_q22/datafusion:parquet 994081319 979832902 1.01
clickbench_q23/datafusion:parquet 3691992422 3680661490 1.00
clickbench_q24/datafusion:parquet 90771121 92998941 0.98
clickbench_q25/datafusion:parquet 142277459 146812943 0.97
clickbench_q26/datafusion:parquet 90290006 89200111 1.01
clickbench_q27/datafusion:parquet 1079045756 1053969842 1.02
clickbench_q28/datafusion:parquet 6623809517 6458022051 1.03
clickbench_q29/datafusion:parquet 240856545 251921891 0.96
clickbench_q30/datafusion:parquet 368243593 356342372 1.03
clickbench_q31/datafusion:parquet 389147535 390486539 1.00
clickbench_q32/datafusion:parquet 🚨 1299979353 1168638736 1.11
clickbench_q33/datafusion:parquet 1587667019 1522124047 1.04
clickbench_q34/datafusion:parquet 1543034150 1534825148 1.01
clickbench_q35/datafusion:parquet 538116013 525976867 1.02
clickbench_q36/datafusion:parquet 147189938 144336116 1.02
clickbench_q37/datafusion:parquet 61275217 60105332 1.02
clickbench_q38/datafusion:parquet 90424573 92853089 0.97
clickbench_q39/datafusion:parquet 276797192 270137703 1.02
clickbench_q40/datafusion:parquet 35505591 36216849 0.98
clickbench_q41/datafusion:parquet 30008520 30192228 0.99
clickbench_q42/datafusion:parquet 31862909 31646372 1.01
duckdb / vortex-file-compressed (0.946x ➖, 8↑ 1↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6136779 6685313 0.92
clickbench_q01/duckdb:vortex-file-compressed 14604582 15685713 0.93
clickbench_q02/duckdb:vortex-file-compressed 🚀 25532574 29775630 0.86
clickbench_q03/duckdb:vortex-file-compressed 30910304 33880842 0.91
clickbench_q04/duckdb:vortex-file-compressed 188995723 198110303 0.95
clickbench_q05/duckdb:vortex-file-compressed 178425821 197441016 0.90
clickbench_q06/duckdb:vortex-file-compressed 20738613 20330296 1.02
clickbench_q07/duckdb:vortex-file-compressed 16790440 18014003 0.93
clickbench_q08/duckdb:vortex-file-compressed 266505881 277243149 0.96
clickbench_q09/duckdb:vortex-file-compressed 347246522 366127442 0.95
clickbench_q10/duckdb:vortex-file-compressed 72657406 75388203 0.96
clickbench_q11/duckdb:vortex-file-compressed 83561430 89973674 0.93
clickbench_q12/duckdb:vortex-file-compressed 202657250 218666078 0.93
clickbench_q13/duckdb:vortex-file-compressed 407302361 445249638 0.91
clickbench_q14/duckdb:vortex-file-compressed 238377783 259975867 0.92
clickbench_q15/duckdb:vortex-file-compressed 249135887 271903609 0.92
clickbench_q16/duckdb:vortex-file-compressed 768559828 848418400 0.91
clickbench_q17/duckdb:vortex-file-compressed 559545871 611294379 0.92
clickbench_q18/duckdb:vortex-file-compressed 1197756063 1241031131 0.97
clickbench_q19/duckdb:vortex-file-compressed 23959449 25182258 0.95
clickbench_q20/duckdb:vortex-file-compressed 🚀 403794611 458215789 0.88
clickbench_q21/duckdb:vortex-file-compressed 414832985 448032647 0.93
clickbench_q22/duckdb:vortex-file-compressed 🚀 566487907 643997304 0.88
clickbench_q23/duckdb:vortex-file-compressed 🚨 1809960365 922274874 1.96
clickbench_q24/duckdb:vortex-file-compressed 🚀 47458290 53952317 0.88
clickbench_q25/duckdb:vortex-file-compressed 89426616 89536962 1.00
clickbench_q26/duckdb:vortex-file-compressed 🚀 46807845 68276173 0.69
clickbench_q27/duckdb:vortex-file-compressed 🚀 518982745 582900409 0.89
clickbench_q28/duckdb:vortex-file-compressed 2996670059 3205449570 0.93
clickbench_q29/duckdb:vortex-file-compressed 29545620 31514332 0.94
clickbench_q30/duckdb:vortex-file-compressed 191663026 210083676 0.91
clickbench_q31/duckdb:vortex-file-compressed 281129963 307711640 0.91
clickbench_q32/duckdb:vortex-file-compressed 1343295640 1491957189 0.90
clickbench_q33/duckdb:vortex-file-compressed 🚀 1617868449 2019548022 0.80
clickbench_q34/duckdb:vortex-file-compressed 🚀 1685656882 1979205787 0.85
clickbench_q35/duckdb:vortex-file-compressed 379486473 401296982 0.95
clickbench_q36/duckdb:vortex-file-compressed 35407242 32948798 1.07
clickbench_q37/duckdb:vortex-file-compressed 24915279 23669398 1.05
clickbench_q38/duckdb:vortex-file-compressed 27673479 26960012 1.03
clickbench_q39/duckdb:vortex-file-compressed 46871224 47163214 0.99
clickbench_q40/duckdb:vortex-file-compressed 24778761 24739285 1.00
clickbench_q41/duckdb:vortex-file-compressed 25134662 24052754 1.04
clickbench_q42/duckdb:vortex-file-compressed 25774953 26551813 0.97
duckdb / parquet (0.956x ➖, 2↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 24735532 28024716 0.88
clickbench_q01/duckdb:parquet 27798102 28914860 0.96
clickbench_q02/duckdb:parquet 47602847 48898047 0.97
clickbench_q03/duckdb:parquet 37783600 39828415 0.95
clickbench_q04/duckdb:parquet 206163980 213292557 0.97
clickbench_q05/duckdb:parquet 265891948 280427544 0.95
clickbench_q06/duckdb:parquet 45585066 48971997 0.93
clickbench_q07/duckdb:parquet 30584426 30868307 0.99
clickbench_q08/duckdb:parquet 264239149 280388224 0.94
clickbench_q09/duckdb:parquet 394447522 417892392 0.94
clickbench_q10/duckdb:parquet 82083945 82804116 0.99
clickbench_q11/duckdb:parquet 98458441 103844011 0.95
clickbench_q12/duckdb:parquet 285663529 303816431 0.94
clickbench_q13/duckdb:parquet 476822667 520927710 0.92
clickbench_q14/duckdb:parquet 325998080 341524992 0.95
clickbench_q15/duckdb:parquet 265192038 282973460 0.94
clickbench_q16/duckdb:parquet 644132952 691223589 0.93
clickbench_q17/duckdb:parquet 🚀 539134625 601163217 0.90
clickbench_q18/duckdb:parquet 1075741112 1127123067 0.95
clickbench_q19/duckdb:parquet 25688140 26525870 0.97
clickbench_q20/duckdb:parquet 419106624 445387612 0.94
clickbench_q21/duckdb:parquet 544413573 579918300 0.94
clickbench_q22/duckdb:parquet 926129457 973092529 0.95
clickbench_q23/duckdb:parquet 315737892 310672579 1.02
clickbench_q24/duckdb:parquet 69577623 69069700 1.01
clickbench_q25/duckdb:parquet 154680802 161805032 0.96
clickbench_q26/duckdb:parquet 50304209 51021724 0.99
clickbench_q27/duckdb:parquet 646782355 673047930 0.96
clickbench_q28/duckdb:parquet 4791276572 5068391654 0.95
clickbench_q29/duckdb:parquet 40568929 42448396 0.96
clickbench_q30/duckdb:parquet 300262679 312403314 0.96
clickbench_q31/duckdb:parquet 357828923 387289443 0.92
clickbench_q32/duckdb:parquet 1162591694 1288098895 0.90
clickbench_q33/duckdb:parquet 1272649451 1394612781 0.91
clickbench_q34/duckdb:parquet 1334574841 1375782456 0.97
clickbench_q35/duckdb:parquet 364058344 383242804 0.95
clickbench_q36/duckdb:parquet 48220367 44109762 1.09
clickbench_q37/duckdb:parquet 33424371 33369805 1.00
clickbench_q38/duckdb:parquet 32982116 33586157 0.98
clickbench_q39/duckdb:parquet 80431642 87920609 0.91
clickbench_q40/duckdb:parquet 17650783 18277206 0.97
clickbench_q41/duckdb:parquet 18231951 18067198 1.01
clickbench_q42/duckdb:parquet 21158385 21868946 0.97
duckdb / duckdb (0.931x ➖, 7↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17158646 18158321 0.94
clickbench_q01/duckdb:duckdb 33568783 34967523 0.96
clickbench_q02/duckdb:duckdb 45878119 47980872 0.96
clickbench_q03/duckdb:duckdb 46772082 48489349 0.96
clickbench_q04/duckdb:duckdb 188235410 201211007 0.94
clickbench_q05/duckdb:duckdb 266168270 281102679 0.95
clickbench_q06/duckdb:duckdb 34927261 37988360 0.92
clickbench_q07/duckdb:duckdb 35156253 37497195 0.94
clickbench_q08/duckdb:duckdb 247406848 269240418 0.92
clickbench_q09/duckdb:duckdb 366283247 390251606 0.94
clickbench_q10/duckdb:duckdb 97717361 103403461 0.95
clickbench_q11/duckdb:duckdb 108735143 111834455 0.97
clickbench_q12/duckdb:duckdb 238545474 249328199 0.96
clickbench_q13/duckdb:duckdb 🚀 456382015 530907402 0.86
clickbench_q14/duckdb:duckdb 272423388 291776985 0.93
clickbench_q15/duckdb:duckdb 221190227 230224698 0.96
clickbench_q16/duckdb:duckdb 657694275 679058143 0.97
clickbench_q17/duckdb:duckdb 546976344 596559517 0.92
clickbench_q18/duckdb:duckdb 1262386424 1301475294 0.97
clickbench_q19/duckdb:duckdb 34394787 36212065 0.95
clickbench_q20/duckdb:duckdb 🚀 966216909 1204255480 0.80
clickbench_q21/duckdb:duckdb 🚀 971114933 1221858213 0.79
clickbench_q22/duckdb:duckdb 1048687584 1154022767 0.91
clickbench_q23/duckdb:duckdb 259628620 267697120 0.97
clickbench_q24/duckdb:duckdb 61377500 64038538 0.96
clickbench_q25/duckdb:duckdb 142455210 147906552 0.96
clickbench_q26/duckdb:duckdb 60253822 65573256 0.92
clickbench_q27/duckdb:duckdb 🚀 1057490530 1186549772 0.89
clickbench_q28/duckdb:duckdb 4649144403 4889246896 0.95
clickbench_q29/duckdb:duckdb 48722982 51339590 0.95
clickbench_q30/duckdb:duckdb 257762215 278580900 0.93
clickbench_q31/duckdb:duckdb 🚀 425375258 479073724 0.89
clickbench_q32/duckdb:duckdb 1470375429 1545527486 0.95
clickbench_q33/duckdb:duckdb 🚀 1812896801 2092137391 0.87
clickbench_q34/duckdb:duckdb 🚀 1947483927 2258030706 0.86
clickbench_q35/duckdb:duckdb 282008384 291581081 0.97
clickbench_q36/duckdb:duckdb 42222525 43625307 0.97
clickbench_q37/duckdb:duckdb 31459577 33183955 0.95
clickbench_q38/duckdb:duckdb 30819748 32345304 0.95
clickbench_q39/duckdb:duckdb 68352502 69555251 0.98
clickbench_q40/duckdb:duckdb 31213544 33140355 0.94
clickbench_q41/duckdb:duckdb 30037200 32758341 0.92
clickbench_q42/duckdb:duckdb 31704355 33483884 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -3.7% -5.2% +1.6% +778.8% ➖ noise
0 duckdb:duckdb -5.5% -5.2% -0.3% +270.3% ➖ noise
0 duckdb:vortex-file-compressed -8.2% -5.2% -3.2% +350.6% ➖ noise
1 datafusion:vortex-file-compressed +4.5% -5.8% +10.9% +22.5% ➖ noise
1 duckdb:duckdb -4.0% -5.8% +1.9% +56.2% ➖ noise
1 duckdb:vortex-file-compressed -6.9% -5.8% -1.2% +17.3% ➖ noise
2 datafusion:vortex-file-compressed -1.6% -0.6% -1.1% +15.6% ➖ noise
2 duckdb:duckdb -4.4% -0.6% -3.8% +16.6% ➖ noise
2 duckdb:vortex-file-compressed -14.3% -0.6% -13.8% +12.9% ✅ faster
3 datafusion:vortex-file-compressed -3.3% -3.8% +0.5% +155.8% ➖ noise
3 duckdb:duckdb -3.5% -3.8% +0.2% +42.2% ➖ noise
3 duckdb:vortex-file-compressed -8.8% -3.8% -5.2% +86.5% ➖ noise
4 datafusion:vortex-file-compressed +2.0% -2.1% +4.2% +10.0% ➖ noise
4 duckdb:duckdb -6.4% -2.1% -4.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.6% -2.1% -2.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.0% -1.1% +2.1% +10.0% ➖ noise
5 duckdb:duckdb -5.3% -1.1% -4.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -9.6% -1.1% -8.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +4.1% -1.2% +5.4% +53.3% ➖ noise
6 duckdb:duckdb -8.1% -1.2% -6.9% +29.0% ➖ noise
6 duckdb:vortex-file-compressed +2.0% -1.2% +3.3% +17.6% ➖ noise
7 datafusion:vortex-file-compressed -1.1% -0.4% -0.6% +17.8% ➖ noise
7 duckdb:duckdb -6.2% -0.4% -5.8% +14.0% ➖ noise
7 duckdb:vortex-file-compressed -6.8% -0.4% -6.4% +12.1% ➖ noise
8 datafusion:vortex-file-compressed -0.9% -3.2% +2.3% +10.0% ➖ noise
8 duckdb:duckdb -8.1% -3.2% -5.1% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.9% -3.2% -0.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +2.2% -2.4% +4.8% +10.0% ➖ noise
9 duckdb:duckdb -6.1% -2.4% -3.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -5.2% -2.4% -2.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.1% -0.2% +0.2% +10.0% ➖ noise
10 duckdb:duckdb -5.5% -0.2% -5.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.6% -0.2% -3.5% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.7% -2.6% +4.4% +10.0% ➖ noise
11 duckdb:duckdb -2.8% -2.6% -0.2% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -7.1% -2.6% -4.7% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.6% -3.2% +3.9% +10.0% ➖ noise
12 duckdb:duckdb -4.3% -3.2% -1.2% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -7.3% -3.2% -4.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -2.1% -5.1% +3.2% +10.0% ➖ noise
13 duckdb:duckdb -14.0% -5.1% -9.4% +10.0% ✅ faster
13 duckdb:vortex-file-compressed -8.5% -5.1% -3.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.2% -2.4% +0.2% +10.0% ➖ noise
14 duckdb:duckdb -6.6% -2.4% -4.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -8.3% -2.4% -6.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +1.2% -1.4% +2.7% +10.0% ➖ noise
15 duckdb:duckdb -3.9% -1.4% -2.6% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -8.4% -1.4% -7.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.3% -2.1% +2.4% +10.0% ➖ noise
16 duckdb:duckdb -3.1% -2.1% -1.1% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -9.4% -2.1% -7.5% +20.8% ➖ noise
17 datafusion:vortex-file-compressed -0.6% -5.4% +5.0% +10.0% ➖ noise
17 duckdb:duckdb -8.3% -5.4% -3.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -8.5% -5.4% -3.3% +19.7% ➖ noise
18 datafusion:vortex-file-compressed +2.9% -2.1% +5.1% +10.0% ➖ noise
18 duckdb:duckdb -3.0% -2.1% -0.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.5% -2.1% -1.4% +10.3% ➖ noise
19 datafusion:vortex-file-compressed +4.6% -1.0% +5.6% +15.2% ➖ noise
19 duckdb:duckdb -5.0% -1.0% -4.0% +10.5% ➖ noise
19 duckdb:vortex-file-compressed -4.9% -1.0% -3.9% +21.8% ➖ noise
20 datafusion:vortex-file-compressed +1.7% -2.6% +4.4% +199.2% ➖ noise
20 duckdb:duckdb -19.8% -2.6% -17.7% +24.2% ➖ noise
20 duckdb:vortex-file-compressed -11.9% -2.6% -9.6% +72.3% ➖ noise
21 datafusion:vortex-file-compressed +1.2% -3.0% +4.3% +10.0% ➖ noise
21 duckdb:duckdb -20.5% -3.0% -18.1% +13.1% ✅ faster
21 duckdb:vortex-file-compressed -7.4% -3.0% -4.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.1% -1.7% +0.7% +11.7% ➖ noise
22 duckdb:duckdb -9.1% -1.7% -7.5% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -12.0% -1.7% -10.5% +12.3% ➖ noise
23 datafusion:vortex-file-compressed -2.1% +1.0% -3.0% +38.6% ➖ noise
23 duckdb:duckdb -3.0% +1.0% -3.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +96.2% +1.0% +94.4% +34.2% 🚨 regression
24 datafusion:vortex-file-compressed -11.5% -0.8% -10.8% +21.5% ➖ noise
24 duckdb:duckdb -4.2% -0.8% -3.3% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -12.0% -0.8% -11.3% +17.9% ➖ noise
25 datafusion:vortex-file-compressed -1.0% -3.7% +2.9% +10.0% ➖ noise
25 duckdb:duckdb -3.7% -3.7% +0.1% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.1% -3.7% +3.8% +15.2% ➖ noise
26 datafusion:vortex-file-compressed +0.4% -0.1% +0.5% +12.4% ➖ noise
26 duckdb:duckdb -8.1% -0.1% -8.0% +12.6% ➖ noise
26 duckdb:vortex-file-compressed -31.4% -0.1% -31.4% +24.2% ✅ faster
27 datafusion:vortex-file-compressed -6.0% -0.8% -5.3% +10.0% ➖ noise
27 duckdb:duckdb -10.9% -0.8% -10.1% +10.0% ✅ faster
27 duckdb:vortex-file-compressed -11.0% -0.8% -10.2% +10.0% ✅ faster
28 datafusion:vortex-file-compressed -2.9% -1.5% -1.4% +10.0% ➖ noise
28 duckdb:duckdb -4.9% -1.5% -3.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -6.5% -1.5% -5.1% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.6% -4.4% +5.2% +10.0% ➖ noise
29 duckdb:duckdb -5.1% -4.4% -0.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -6.2% -4.4% -1.9% +15.3% ➖ noise
30 datafusion:vortex-file-compressed -0.6% -0.3% -0.2% +10.0% ➖ noise
30 duckdb:duckdb -7.5% -0.3% -7.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -8.8% -0.3% -8.5% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.8% -4.0% +2.3% +10.0% ➖ noise
31 duckdb:duckdb -11.2% -4.0% -7.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -8.6% -4.0% -4.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -8.6% +0.2% -8.8% +13.0% ➖ noise
32 duckdb:duckdb -4.9% +0.2% -5.1% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -10.0% +0.2% -10.1% +10.0% ✅ faster
33 datafusion:vortex-file-compressed -3.3% -2.4% -0.9% +12.9% ➖ noise
33 duckdb:duckdb -13.3% -2.4% -11.2% +10.0% ✅ faster
33 duckdb:vortex-file-compressed -19.9% -2.4% -17.9% +11.2% ✅ faster
34 datafusion:vortex-file-compressed +0.0% -1.2% +1.3% +10.0% ➖ noise
34 duckdb:duckdb -13.8% -1.2% -12.7% +10.0% ✅ faster
34 duckdb:vortex-file-compressed -14.8% -1.2% -13.8% +10.0% ✅ faster
35 datafusion:vortex-file-compressed +2.1% -1.4% +3.6% +10.0% ➖ noise
35 duckdb:duckdb -3.3% -1.4% -1.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -5.4% -1.4% -4.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.2% +5.6% -4.2% +10.5% ➖ noise
36 duckdb:duckdb -3.2% +5.6% -8.3% +11.0% ➖ noise
36 duckdb:vortex-file-compressed +7.5% +5.6% +1.8% +11.5% ➖ noise
37 datafusion:vortex-file-compressed +2.8% +1.1% +1.7% +10.0% ➖ noise
37 duckdb:duckdb -5.2% +1.1% -6.2% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +5.3% +1.1% +4.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +0.7% -2.2% +3.0% +10.0% ➖ noise
38 duckdb:duckdb -4.7% -2.2% -2.6% +10.1% ➖ noise
38 duckdb:vortex-file-compressed +2.6% -2.2% +5.0% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +3.4% -3.2% +6.8% +10.2% ➖ noise
39 duckdb:duckdb -1.7% -3.2% +1.5% +19.3% ➖ noise
39 duckdb:vortex-file-compressed -0.6% -3.2% +2.6% +10.5% ➖ noise
40 datafusion:vortex-file-compressed -0.9% -2.7% +1.9% +11.6% ➖ noise
40 duckdb:duckdb -5.8% -2.7% -3.2% +11.2% ➖ noise
40 duckdb:vortex-file-compressed +0.2% -2.7% +2.9% +11.7% ➖ noise
41 datafusion:vortex-file-compressed -6.1% +0.1% -6.2% +10.6% ➖ noise
41 duckdb:duckdb -8.3% +0.1% -8.4% +10.4% ➖ noise
41 duckdb:vortex-file-compressed +4.5% +0.1% +4.3% +10.2% ➖ noise
42 datafusion:vortex-file-compressed -3.4% -1.3% -2.1% +10.1% ➖ noise
42 duckdb:duckdb -5.3% -1.3% -4.1% +17.5% ➖ noise
42 duckdb:vortex-file-compressed -2.9% -1.3% -1.6% +15.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.5%
Vortex (geomean): 0.910x ➖
Parquet (geomean): 0.943x ➖
Shifts: Parquet (control) -5.7% · Median polish -7.7%


datafusion / vortex-file-compressed (0.891x ✅, 12↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51954593 57034076 0.91
tpch_q02/datafusion:vortex-file-compressed 🚀 34479957 38954145 0.89
tpch_q03/datafusion:vortex-file-compressed 🚀 28044359 32696152 0.86
tpch_q04/datafusion:vortex-file-compressed 20216283 22128773 0.91
tpch_q05/datafusion:vortex-file-compressed 🚀 56579535 64679763 0.87
tpch_q06/datafusion:vortex-file-compressed 11162343 12282338 0.91
tpch_q07/datafusion:vortex-file-compressed 🚀 67504584 79345256 0.85
tpch_q08/datafusion:vortex-file-compressed 🚀 47975884 53766864 0.89
tpch_q09/datafusion:vortex-file-compressed 59349328 65703632 0.90
tpch_q10/datafusion:vortex-file-compressed 47598663 52309892 0.91
tpch_q11/datafusion:vortex-file-compressed 🚀 18578242 21408842 0.87
tpch_q12/datafusion:vortex-file-compressed 25320212 28097994 0.90
tpch_q13/datafusion:vortex-file-compressed 🚀 28455050 32758769 0.87
tpch_q14/datafusion:vortex-file-compressed 🚀 17022126 19066797 0.89
tpch_q15/datafusion:vortex-file-compressed 26227590 27949200 0.94
tpch_q16/datafusion:vortex-file-compressed 26005464 28820507 0.90
tpch_q17/datafusion:vortex-file-compressed 🚀 68769130 77524655 0.89
tpch_q18/datafusion:vortex-file-compressed 🚀 83664765 97072864 0.86
tpch_q19/datafusion:vortex-file-compressed 24384083 26289021 0.93
tpch_q20/datafusion:vortex-file-compressed 34215346 37724004 0.91
tpch_q21/datafusion:vortex-file-compressed 🚀 79162312 91750551 0.86
tpch_q22/datafusion:vortex-file-compressed 🚀 16738917 19087007 0.88
datafusion / vortex-compact (0.903x ➖, 13↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 58832632 66125681 0.89
tpch_q02/datafusion:vortex-compact 38700850 41439711 0.93
tpch_q03/datafusion:vortex-compact 🚀 31656350 35338940 0.90
tpch_q04/datafusion:vortex-compact 🚀 24044483 26805046 0.90
tpch_q05/datafusion:vortex-compact 🚀 59588368 66457648 0.90
tpch_q06/datafusion:vortex-compact 14645317 15719685 0.93
tpch_q07/datafusion:vortex-compact 🚀 72673347 81891938 0.89
tpch_q08/datafusion:vortex-compact 52249380 56239257 0.93
tpch_q09/datafusion:vortex-compact 64968775 71564893 0.91
tpch_q10/datafusion:vortex-compact 55876019 61839901 0.90
tpch_q11/datafusion:vortex-compact 🚀 20691640 23079315 0.90
tpch_q12/datafusion:vortex-compact 🚀 34605257 38850150 0.89
tpch_q13/datafusion:vortex-compact 🚀 37442593 42195151 0.89
tpch_q14/datafusion:vortex-compact 21621804 23849089 0.91
tpch_q15/datafusion:vortex-compact 36161998 39558969 0.91
tpch_q16/datafusion:vortex-compact 31144469 32996053 0.94
tpch_q17/datafusion:vortex-compact 🚀 72390414 81694456 0.89
tpch_q18/datafusion:vortex-compact 🚀 89558010 103353258 0.87
tpch_q19/datafusion:vortex-compact 36067439 37859589 0.95
tpch_q20/datafusion:vortex-compact 🚀 39980871 45045821 0.89
tpch_q21/datafusion:vortex-compact 🚀 91851830 103974064 0.88
tpch_q22/datafusion:vortex-compact 🚀 17780823 20072105 0.89
datafusion / parquet (0.939x ➖, 6↑ 2↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 134965318 99521528 1.36
tpch_q02/datafusion:parquet 73253542 78482149 0.93
tpch_q03/datafusion:parquet 79157568 81975718 0.97
tpch_q04/datafusion:parquet 50034929 53410043 0.94
tpch_q05/datafusion:parquet 109139514 115900414 0.94
tpch_q06/datafusion:parquet 🚨 43448898 37438525 1.16
tpch_q07/datafusion:parquet 120196883 128090135 0.94
tpch_q08/datafusion:parquet 103269195 113103095 0.91
tpch_q09/datafusion:parquet 142973496 148741020 0.96
tpch_q10/datafusion:parquet 125409459 139231494 0.90
tpch_q11/datafusion:parquet 49806554 54602577 0.91
tpch_q12/datafusion:parquet 🚀 83687320 103378791 0.81
tpch_q13/datafusion:parquet 219218633 236526031 0.93
tpch_q14/datafusion:parquet 53203831 51049348 1.04
tpch_q15/datafusion:parquet 🚀 65269027 73889350 0.88
tpch_q16/datafusion:parquet 53185624 59038741 0.90
tpch_q17/datafusion:parquet 🚀 143673848 167340806 0.86
tpch_q18/datafusion:parquet 🚀 174885822 196413656 0.89
tpch_q19/datafusion:parquet 🚀 71035425 88971380 0.80
tpch_q20/datafusion:parquet 82018667 86665557 0.95
tpch_q21/datafusion:parquet 151037048 163121212 0.93
tpch_q22/datafusion:parquet 🚀 36072465 40286258 0.90
datafusion / arrow (0.879x ✅, 13↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 🚀 57249399 68501380 0.84
tpch_q02/datafusion:arrow 22184562 24381490 0.91
tpch_q03/datafusion:arrow 🚀 35307983 41756422 0.85
tpch_q04/datafusion:arrow 🚀 28862965 34598606 0.83
tpch_q05/datafusion:arrow 87452203 91576318 0.95
tpch_q06/datafusion:arrow 22714328 24100012 0.94
tpch_q07/datafusion:arrow 117367700 128083605 0.92
tpch_q08/datafusion:arrow 🚀 48155098 58481544 0.82
tpch_q09/datafusion:arrow 🚀 76534196 89720902 0.85
tpch_q10/datafusion:arrow 🚀 54698522 64910667 0.84
tpch_q11/datafusion:arrow 11976714 13110721 0.91
tpch_q12/datafusion:arrow 🚀 57586866 67213453 0.86
tpch_q13/datafusion:arrow 50169539 52198449 0.96
tpch_q14/datafusion:arrow 🚀 23943421 28145245 0.85
tpch_q15/datafusion:arrow 🚀 47546522 55497925 0.86
tpch_q16/datafusion:arrow 21360725 23215983 0.92
tpch_q17/datafusion:arrow 🚀 73105972 86466534 0.85
tpch_q18/datafusion:arrow 🚀 153276512 171871919 0.89
tpch_q19/datafusion:arrow 🚀 40170589 50153498 0.80
tpch_q20/datafusion:arrow 🚀 40579387 46809613 0.87
tpch_q21/datafusion:arrow 161599204 177791856 0.91
tpch_q22/datafusion:arrow 20758317 22092194 0.94
duckdb / vortex-file-compressed (0.913x ➖, 6↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33617471 35303234 0.95
tpch_q02/duckdb:vortex-file-compressed 29002803 31435002 0.92
tpch_q03/duckdb:vortex-file-compressed 30068838 32918574 0.91
tpch_q04/duckdb:vortex-file-compressed 🚀 32180238 35801912 0.90
tpch_q05/duckdb:vortex-file-compressed 35894304 39190749 0.92
tpch_q06/duckdb:vortex-file-compressed 11337572 12532623 0.90
tpch_q07/duckdb:vortex-file-compressed 🚀 38710719 44706941 0.87
tpch_q08/duckdb:vortex-file-compressed 42266411 46909512 0.90
tpch_q09/duckdb:vortex-file-compressed 88168124 95938000 0.92
tpch_q10/duckdb:vortex-file-compressed 39178437 43121283 0.91
tpch_q11/duckdb:vortex-file-compressed 17032852 18066217 0.94
tpch_q12/duckdb:vortex-file-compressed 25100103 26838827 0.94
tpch_q13/duckdb:vortex-file-compressed 38906552 42740706 0.91
tpch_q14/duckdb:vortex-file-compressed 🚀 22149759 25987313 0.85
tpch_q15/duckdb:vortex-file-compressed 17298987 18336350 0.94
tpch_q16/duckdb:vortex-file-compressed 🚀 31419206 34954831 0.90
tpch_q17/duckdb:vortex-file-compressed 27520477 29082889 0.95
tpch_q18/duckdb:vortex-file-compressed 53929236 57683503 0.93
tpch_q19/duckdb:vortex-file-compressed 🚀 33850814 37940779 0.89
tpch_q20/duckdb:vortex-file-compressed 36350799 39362956 0.92
tpch_q21/duckdb:vortex-file-compressed 🚀 115319846 131536660 0.88
tpch_q22/duckdb:vortex-file-compressed 19907778 21328247 0.93
duckdb / vortex-compact (0.933x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40136037 42579415 0.94
tpch_q02/duckdb:vortex-compact 39470152 42032499 0.94
tpch_q03/duckdb:vortex-compact 33844469 36115939 0.94
tpch_q04/duckdb:vortex-compact 34981140 38169954 0.92
tpch_q05/duckdb:vortex-compact 39572252 41740058 0.95
tpch_q06/duckdb:vortex-compact 14882792 16053453 0.93
tpch_q07/duckdb:vortex-compact 44630601 46981364 0.95
tpch_q08/duckdb:vortex-compact 47558913 51091159 0.93
tpch_q09/duckdb:vortex-compact 95513515 105333133 0.91
tpch_q10/duckdb:vortex-compact 42709356 45553487 0.94
tpch_q11/duckdb:vortex-compact 21066108 22810567 0.92
tpch_q12/duckdb:vortex-compact 37650438 39703397 0.95
tpch_q13/duckdb:vortex-compact 48850096 51367761 0.95
tpch_q14/duckdb:vortex-compact 31767480 33729924 0.94
tpch_q15/duckdb:vortex-compact 20214405 21567416 0.94
tpch_q16/duckdb:vortex-compact 38862687 41429264 0.94
tpch_q17/duckdb:vortex-compact 31740183 34449208 0.92
tpch_q18/duckdb:vortex-compact 53645549 56472949 0.95
tpch_q19/duckdb:vortex-compact 39903196 43575534 0.92
tpch_q20/duckdb:vortex-compact 43662976 48254472 0.90
tpch_q21/duckdb:vortex-compact 118440745 129484761 0.91
tpch_q22/duckdb:vortex-compact 22654869 23837698 0.95
duckdb / parquet (0.948x ➖, 2↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 79341921 77507043 1.02
tpch_q02/duckdb:parquet 40416098 42787244 0.94
tpch_q03/duckdb:parquet 70782821 74453144 0.95
tpch_q04/duckdb:parquet 47856218 50224657 0.95
tpch_q05/duckdb:parquet 69077602 71462039 0.97
tpch_q06/duckdb:parquet 21153755 21315828 0.99
tpch_q07/duckdb:parquet 🚀 69800803 84382536 0.83
tpch_q08/duckdb:parquet 99391916 104882862 0.95
tpch_q09/duckdb:parquet 160565555 156996402 1.02
tpch_q10/duckdb:parquet 121426043 129386737 0.94
tpch_q11/duckdb:parquet 23104552 24919730 0.93
tpch_q12/duckdb:parquet 48472312 50328301 0.96
tpch_q13/duckdb:parquet 270067851 292423901 0.92
tpch_q14/duckdb:parquet 48844762 52756146 0.93
tpch_q15/duckdb:parquet 27238861 28586875 0.95
tpch_q16/duckdb:parquet 58158128 60213562 0.97
tpch_q17/duckdb:parquet 53029067 58837380 0.90
tpch_q18/duckdb:parquet 115110875 121635232 0.95
tpch_q19/duckdb:parquet 68198192 69499531 0.98
tpch_q20/duckdb:parquet 63837630 66346071 0.96
tpch_q21/duckdb:parquet 🚀 168390940 188540539 0.89
tpch_q22/duckdb:parquet 53492256 55871607 0.96
duckdb / duckdb (0.947x ➖, 1↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16230804 16946556 0.96
tpch_q02/duckdb:duckdb 12945921 14188106 0.91
tpch_q03/duckdb:duckdb 19143347 20647175 0.93
tpch_q04/duckdb:duckdb 20296039 20887865 0.97
tpch_q05/duckdb:duckdb 20559033 21108920 0.97
tpch_q06/duckdb:duckdb 5572192 5801880 0.96
tpch_q07/duckdb:duckdb 22768977 25284333 0.90
tpch_q08/duckdb:duckdb 21695734 22855309 0.95
tpch_q09/duckdb:duckdb 57105676 60069476 0.95
tpch_q10/duckdb:duckdb 46405423 46559722 1.00
tpch_q11/duckdb:duckdb 🚀 6236342 7136217 0.87
tpch_q12/duckdb:duckdb 14021315 15018632 0.93
tpch_q13/duckdb:duckdb 39363620 41868627 0.94
tpch_q14/duckdb:duckdb 18940867 18501121 1.02
tpch_q15/duckdb:duckdb 12162037 12909339 0.94
tpch_q16/duckdb:duckdb 24109762 25974498 0.93
tpch_q17/duckdb:duckdb 14040034 15023303 0.93
tpch_q18/duckdb:duckdb 39768837 41030273 0.97
tpch_q19/duckdb:duckdb 29121697 29576231 0.98
tpch_q20/duckdb:duckdb 22818945 24781828 0.92
tpch_q21/duckdb:duckdb 59252287 64641234 0.92
tpch_q22/duckdb:duckdb 25345841 26141683 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -16.4% +17.8% -29.1% +18.8% ✅ faster
1 datafusion:vortex-compact -11.0% +17.8% -24.5% +18.8% ✅ faster
1 datafusion:vortex-file-compressed -8.9% +17.8% -22.7% +18.8% ✅ faster
1 duckdb:duckdb -4.2% +17.8% -18.7% +18.8% ✅ faster
1 duckdb:vortex-compact -5.7% +17.8% -20.0% +18.8% ✅ faster
1 duckdb:vortex-file-compressed -4.8% +17.8% -19.2% +18.8% ✅ faster
2 datafusion:arrow -9.0% -6.1% -3.1% +18.8% ➖ noise
2 datafusion:vortex-compact -6.6% -6.1% -0.5% +18.8% ➖ noise
2 datafusion:vortex-file-compressed -11.5% -6.1% -5.7% +18.8% ➖ noise
2 duckdb:duckdb -8.8% -6.1% -2.8% +18.8% ➖ noise
2 duckdb:vortex-compact -6.1% -6.1% +0.0% +18.8% ➖ noise
2 duckdb:vortex-file-compressed -7.7% -6.1% -1.7% +18.8% ➖ noise
3 datafusion:arrow -15.4% -4.2% -11.7% +18.8% ➖ noise
3 datafusion:vortex-compact -10.4% -4.2% -6.5% +18.8% ➖ noise
3 datafusion:vortex-file-compressed -14.2% -4.2% -10.5% +18.8% ➖ noise
3 duckdb:duckdb -7.3% -4.2% -3.2% +18.8% ➖ noise
3 duckdb:vortex-compact -6.3% -4.2% -2.2% +18.8% ➖ noise
3 duckdb:vortex-file-compressed -8.7% -4.2% -4.7% +18.8% ➖ noise
4 datafusion:arrow -16.6% -5.5% -11.7% +18.8% ➖ noise
4 datafusion:vortex-compact -10.3% -5.5% -5.1% +18.8% ➖ noise
4 datafusion:vortex-file-compressed -8.6% -5.5% -3.3% +18.8% ➖ noise
4 duckdb:duckdb -2.8% -5.5% +2.8% +18.8% ➖ noise
4 duckdb:vortex-compact -8.4% -5.5% -3.0% +18.8% ➖ noise
4 duckdb:vortex-file-compressed -10.1% -5.5% -4.9% +18.8% ➖ noise
5 datafusion:arrow -4.5% -4.6% +0.1% +18.8% ➖ noise
5 datafusion:vortex-compact -10.3% -4.6% -6.0% +18.8% ➖ noise
5 datafusion:vortex-file-compressed -12.5% -4.6% -8.3% +18.8% ➖ noise
5 duckdb:duckdb -2.6% -4.6% +2.1% +18.8% ➖ noise
5 duckdb:vortex-compact -5.2% -4.6% -0.6% +18.8% ➖ noise
5 duckdb:vortex-file-compressed -8.4% -4.6% -4.0% +18.8% ➖ noise
6 datafusion:arrow -5.7% +7.3% -12.2% +18.8% ➖ noise
6 datafusion:vortex-compact -6.8% +7.3% -13.2% +18.8% ➖ noise
6 datafusion:vortex-file-compressed -9.1% +7.3% -15.3% +18.8% ➖ noise
6 duckdb:duckdb -4.0% +7.3% -10.5% +18.8% ➖ noise
6 duckdb:vortex-compact -7.3% +7.3% -13.6% +18.8% ➖ noise
6 duckdb:vortex-file-compressed -9.5% +7.3% -15.7% +18.8% ➖ noise
7 datafusion:arrow -8.4% -11.9% +4.0% +18.8% ➖ noise
7 datafusion:vortex-compact -11.3% -11.9% +0.7% +18.8% ➖ noise
7 datafusion:vortex-file-compressed -14.9% -11.9% -3.4% +18.8% ➖ noise
7 duckdb:duckdb -9.9% -11.9% +2.2% +18.8% ➖ noise
7 duckdb:vortex-compact -5.0% -11.9% +7.8% +18.8% ➖ noise
7 duckdb:vortex-file-compressed -13.4% -11.9% -1.7% +18.8% ➖ noise
8 datafusion:arrow -17.7% -7.0% -11.5% +18.8% ➖ noise
8 datafusion:vortex-compact -7.1% -7.0% -0.1% +18.8% ➖ noise
8 datafusion:vortex-file-compressed -10.8% -7.0% -4.1% +18.8% ➖ noise
8 duckdb:duckdb -5.1% -7.0% +2.1% +18.8% ➖ noise
8 duckdb:vortex-compact -6.9% -7.0% +0.1% +18.8% ➖ noise
8 duckdb:vortex-file-compressed -9.9% -7.0% -3.1% +18.8% ➖ noise
9 datafusion:arrow -14.7% -0.8% -14.0% +18.8% ➖ noise
9 datafusion:vortex-compact -9.2% -0.8% -8.4% +18.8% ➖ noise
9 datafusion:vortex-file-compressed -9.7% -0.8% -8.9% +18.8% ➖ noise
9 duckdb:duckdb -4.9% -0.8% -4.1% +18.8% ➖ noise
9 duckdb:vortex-compact -9.3% -0.8% -8.5% +18.8% ➖ noise
9 duckdb:vortex-file-compressed -8.1% -0.8% -7.3% +18.8% ➖ noise
10 datafusion:arrow -15.7% -8.1% -8.3% +18.8% ➖ noise
10 datafusion:vortex-compact -9.6% -8.1% -1.7% +18.8% ➖ noise
10 datafusion:vortex-file-compressed -9.0% -8.1% -1.0% +18.8% ➖ noise
10 duckdb:duckdb -0.3% -8.1% +8.4% +18.8% ➖ noise
10 duckdb:vortex-compact -6.2% -8.1% +2.0% +18.8% ➖ noise
10 duckdb:vortex-file-compressed -9.1% -8.1% -1.2% +18.8% ➖ noise
11 datafusion:arrow -8.6% -8.0% -0.7% +18.8% ➖ noise
11 datafusion:vortex-compact -10.3% -8.0% -2.5% +18.8% ➖ noise
11 datafusion:vortex-file-compressed -13.2% -8.0% -5.6% +18.8% ➖ noise
11 duckdb:duckdb -12.6% -8.0% -5.0% +18.8% ➖ noise
11 duckdb:vortex-compact -7.6% -8.0% +0.4% +18.8% ➖ noise
11 duckdb:vortex-file-compressed -5.7% -8.0% +2.5% +18.8% ➖ noise
12 datafusion:arrow -14.3% -11.7% -3.0% +18.8% ➖ noise
12 datafusion:vortex-compact -10.9% -11.7% +0.9% +18.8% ➖ noise
12 datafusion:vortex-file-compressed -9.9% -11.7% +2.1% +18.8% ➖ noise
12 duckdb:duckdb -6.6% -11.7% +5.7% +18.8% ➖ noise
12 duckdb:vortex-compact -5.2% -11.7% +7.4% +18.8% ➖ noise
12 duckdb:vortex-file-compressed -6.5% -11.7% +5.9% +18.8% ➖ noise
13 datafusion:arrow -3.9% -7.5% +3.9% +18.8% ➖ noise
13 datafusion:vortex-compact -11.3% -7.5% -4.1% +18.8% ➖ noise
13 datafusion:vortex-file-compressed -13.1% -7.5% -6.1% +18.8% ➖ noise
13 duckdb:duckdb -6.0% -7.5% +1.6% +18.8% ➖ noise
13 duckdb:vortex-compact -4.9% -7.5% +2.8% +18.8% ➖ noise
13 duckdb:vortex-file-compressed -9.0% -7.5% -1.6% +18.8% ➖ noise
14 datafusion:arrow -14.9% -1.8% -13.4% +18.8% ➖ noise
14 datafusion:vortex-compact -9.3% -1.8% -7.7% +18.8% ➖ noise
14 datafusion:vortex-file-compressed -10.7% -1.8% -9.1% +18.8% ➖ noise
14 duckdb:duckdb +2.4% -1.8% +4.2% +18.8% ➖ noise
14 duckdb:vortex-compact -5.8% -1.8% -4.1% +18.8% ➖ noise
14 duckdb:vortex-file-compressed -14.8% -1.8% -13.2% +18.8% ➖ noise
15 datafusion:arrow -14.3% -8.3% -6.6% +18.8% ➖ noise
15 datafusion:vortex-compact -8.6% -8.3% -0.4% +18.8% ➖ noise
15 datafusion:vortex-file-compressed -6.2% -8.3% +2.3% +18.8% ➖ noise
15 duckdb:duckdb -5.8% -8.3% +2.7% +18.8% ➖ noise
15 duckdb:vortex-compact -6.3% -8.3% +2.2% +18.8% ➖ noise
15 duckdb:vortex-file-compressed -5.7% -8.3% +2.8% +18.8% ➖ noise
16 datafusion:arrow -8.0% -6.7% -1.4% +18.8% ➖ noise
16 datafusion:vortex-compact -5.6% -6.7% +1.2% +18.8% ➖ noise
16 datafusion:vortex-file-compressed -9.8% -6.7% -3.3% +18.8% ➖ noise
16 duckdb:duckdb -7.2% -6.7% -0.5% +18.8% ➖ noise
16 duckdb:vortex-compact -6.2% -6.7% +0.6% +18.8% ➖ noise
16 duckdb:vortex-file-compressed -10.1% -6.7% -3.6% +18.8% ➖ noise
17 datafusion:arrow -15.5% -12.0% -3.9% +18.8% ➖ noise
17 datafusion:vortex-compact -11.4% -12.0% +0.7% +18.8% ➖ noise
17 datafusion:vortex-file-compressed -11.3% -12.0% +0.8% +18.8% ➖ noise
17 duckdb:duckdb -6.5% -12.0% +6.2% +18.8% ➖ noise
17 duckdb:vortex-compact -7.9% -12.0% +4.7% +18.8% ➖ noise
17 duckdb:vortex-file-compressed -5.4% -12.0% +7.6% +18.8% ➖ noise
18 datafusion:arrow -10.8% -8.2% -2.8% +18.8% ➖ noise
18 datafusion:vortex-compact -13.3% -8.2% -5.6% +18.8% ➖ noise
18 datafusion:vortex-file-compressed -13.8% -8.2% -6.1% +18.8% ➖ noise
18 duckdb:duckdb -3.1% -8.2% +5.6% +18.8% ➖ noise
18 duckdb:vortex-compact -5.0% -8.2% +3.5% +18.8% ➖ noise
18 duckdb:vortex-file-compressed -6.5% -8.2% +1.8% +18.8% ➖ noise
19 datafusion:arrow -19.9% -11.5% -9.5% +18.8% ➖ noise
19 datafusion:vortex-compact -4.7% -11.5% +7.6% +18.8% ➖ noise
19 datafusion:vortex-file-compressed -7.2% -11.5% +4.8% +18.8% ➖ noise
19 duckdb:duckdb -1.5% -11.5% +11.2% +18.8% ➖ noise
19 duckdb:vortex-compact -8.4% -11.5% +3.5% +18.8% ➖ noise
19 duckdb:vortex-file-compressed -10.8% -11.5% +0.8% +18.8% ➖ noise
20 datafusion:arrow -13.3% -4.6% -9.2% +18.8% ➖ noise
20 datafusion:vortex-compact -11.2% -4.6% -7.0% +18.8% ➖ noise
20 datafusion:vortex-file-compressed -9.3% -4.6% -5.0% +18.8% ➖ noise
20 duckdb:duckdb -7.9% -4.6% -3.5% +18.8% ➖ noise
20 duckdb:vortex-compact -9.5% -4.6% -5.2% +18.8% ➖ noise
20 duckdb:vortex-file-compressed -7.7% -4.6% -3.2% +18.8% ➖ noise
21 datafusion:arrow -9.1% -9.1% -0.0% +18.8% ➖ noise
21 datafusion:vortex-compact -11.7% -9.1% -2.9% +18.8% ➖ noise
21 datafusion:vortex-file-compressed -13.7% -9.1% -5.1% +18.8% ➖ noise
21 duckdb:duckdb -8.3% -9.1% +0.8% +18.8% ➖ noise
21 duckdb:vortex-compact -8.5% -9.1% +0.6% +18.8% ➖ noise
21 duckdb:vortex-file-compressed -12.3% -9.1% -3.6% +18.8% ➖ noise
22 datafusion:arrow -6.0% -7.4% +1.5% +18.8% ➖ noise
22 datafusion:vortex-compact -11.4% -7.4% -4.3% +18.8% ➖ noise
22 datafusion:vortex-file-compressed -12.3% -7.4% -5.3% +18.8% ➖ noise
22 duckdb:duckdb -3.0% -7.4% +4.7% +18.8% ➖ noise
22 duckdb:vortex-compact -5.0% -7.4% +2.6% +18.8% ➖ noise
22 duckdb:vortex-file-compressed -6.7% -7.4% +0.8% +18.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.0%
Vortex (geomean): 1.021x ➖
Parquet (geomean): 1.001x ➖
Shifts: Parquet (control) +0.1% · Median polish +2.6%


datafusion / vortex-file-compressed (1.130x ➖, 1↑ 1↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 34823608 57817792 0.60
fineweb_q01/datafusion:vortex-file-compressed 🚨 1004036824 458628109 2.19
fineweb_q02/datafusion:vortex-file-compressed 717342267 600183989 1.20
fineweb_q03/datafusion:vortex-file-compressed 1654668241 1430619795 1.16
fineweb_q04/datafusion:vortex-file-compressed 1376478868 1360495412 1.01
fineweb_q05/datafusion:vortex-file-compressed 1394112264 1352172048 1.03
fineweb_q06/datafusion:vortex-file-compressed 1806733037 1481996985 1.22
fineweb_q07/datafusion:vortex-file-compressed 1519151990 1368606774 1.11
fineweb_q08/datafusion:vortex-file-compressed 611041124 524291288 1.17
datafusion / vortex-compact (0.979x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 36987466 32134036 1.15
fineweb_q01/datafusion:vortex-compact 515338946 665494333 0.77
fineweb_q02/datafusion:vortex-compact 615603832 793039904 0.78
fineweb_q03/datafusion:vortex-compact 1889402709 1818314601 1.04
fineweb_q04/datafusion:vortex-compact 2289335041 2218473629 1.03
fineweb_q05/datafusion:vortex-compact 1767160161 1686005966 1.05
fineweb_q06/datafusion:vortex-compact 1545599449 1484547406 1.04
fineweb_q07/datafusion:vortex-compact 1344569368 1384144896 0.97
fineweb_q08/datafusion:vortex-compact 448058849 426122117 1.05
datafusion / parquet (1.058x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1263832198 1055698078 1.20
fineweb_q01/datafusion:parquet 2037666216 1830577085 1.11
fineweb_q02/datafusion:parquet 2061911705 1754047433 1.18
fineweb_q03/datafusion:parquet 1749985067 1822056584 0.96
fineweb_q04/datafusion:parquet 1845503773 1926729669 0.96
fineweb_q05/datafusion:parquet 1808250602 1854105644 0.98
fineweb_q06/datafusion:parquet 1963556052 1742425143 1.13
fineweb_q07/datafusion:parquet 1994772956 1933713634 1.03
fineweb_q08/datafusion:parquet 2008712331 1981085869 1.01
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 76625821 80223621 0.96
fineweb_q01/duckdb:vortex-file-compressed 717625462 834007755 0.86
fineweb_q02/duckdb:vortex-file-compressed 463636292 462744473 1.00
fineweb_q03/duckdb:vortex-file-compressed 1518305364 1536736133 0.99
fineweb_q04/duckdb:vortex-file-compressed 1629531809 1524140619 1.07
fineweb_q05/duckdb:vortex-file-compressed 1552087122 1442760139 1.08
fineweb_q06/duckdb:vortex-file-compressed 1709720302 1695883663 1.01
fineweb_q07/duckdb:vortex-file-compressed 1540125469 1465482779 1.05
fineweb_q08/duckdb:vortex-file-compressed 591922911 683709991 0.87
duckdb / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 67681029 79225253 0.85
fineweb_q01/duckdb:vortex-compact 571997118 534554217 1.07
fineweb_q02/duckdb:vortex-compact 580523477 599463229 0.97
fineweb_q03/duckdb:vortex-compact 1762104522 1644494959 1.07
fineweb_q04/duckdb:vortex-compact 1844212201 1699116411 1.09
fineweb_q05/duckdb:vortex-compact 1609944393 1447677380 1.11
fineweb_q06/duckdb:vortex-compact 1533230681 1908078785 0.80
fineweb_q07/duckdb:vortex-compact 1380965548 1320486042 1.05
fineweb_q08/duckdb:vortex-compact 538294719 513620110 1.05
duckdb / parquet (0.948x ➖, 0↑ 0↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1135370662 1249228535 0.91
fineweb_q01/duckdb:parquet 1372980456 1360178110 1.01
fineweb_q02/duckdb:parquet 1292763371 1440814937 0.90
fineweb_q03/duckdb:parquet 3576510348 3731597347 0.96
fineweb_q04/duckdb:parquet 1872126066 2085567783 0.90
fineweb_q05/duckdb:parquet 2115081049 2235636987 0.95
fineweb_q06/duckdb:parquet 4333060429 4502722005 0.96
fineweb_q07/duckdb:parquet 2754388372 2829894442 0.97
fineweb_q08/duckdb:parquet 1178162338 1194883658 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +15.1% +4.3% +10.3% +211.8% ➖ noise
0 datafusion:vortex-file-compressed -39.8% +4.3% -42.3% +150.7% ➖ noise
0 duckdb:vortex-compact -14.6% +4.3% -18.1% +61.0% ➖ noise
0 duckdb:vortex-file-compressed -4.5% +4.3% -8.4% +65.1% ➖ noise
1 datafusion:vortex-compact -22.6% +6.0% -26.9% +68.9% ➖ noise
1 datafusion:vortex-file-compressed +118.9% +6.0% +106.5% +92.7% 🚨 regression
1 duckdb:vortex-compact +7.0% +6.0% +0.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -14.0% +6.0% -18.8% +49.4% ➖ noise
2 datafusion:vortex-compact -22.4% +2.7% -24.4% +30.0% ✅ faster
2 datafusion:vortex-file-compressed +19.5% +2.7% +16.4% +32.4% ➖ noise
2 duckdb:vortex-compact -3.2% +2.7% -5.7% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +0.2% +2.7% -2.4% +30.0% ➖ noise
3 datafusion:vortex-compact +3.9% -4.1% +8.3% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +15.7% -4.1% +20.6% +30.0% ➖ noise
3 duckdb:vortex-compact +7.2% -4.1% +11.7% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -1.2% -4.1% +3.0% +30.0% ➖ noise
4 datafusion:vortex-compact +3.2% -7.3% +11.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.2% -7.3% +9.1% +32.0% ➖ noise
4 duckdb:vortex-compact +8.5% -7.3% +17.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +6.9% -7.3% +15.3% +30.0% ➖ noise
5 datafusion:vortex-compact +4.8% -3.9% +9.1% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +3.1% -3.9% +7.3% +30.0% ➖ noise
5 duckdb:vortex-compact +11.2% -3.9% +15.8% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +7.6% -3.9% +12.0% +30.0% ➖ noise
6 datafusion:vortex-compact +4.1% +4.1% -0.0% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +21.9% +4.1% +17.1% +30.0% ➖ noise
6 duckdb:vortex-compact -19.6% +4.1% -22.8% +44.6% ➖ noise
6 duckdb:vortex-file-compressed +0.8% +4.1% -3.2% +30.0% ➖ noise
7 datafusion:vortex-compact -2.9% +0.2% -3.1% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +11.0% +0.2% +10.8% +30.0% ➖ noise
7 duckdb:vortex-compact +4.6% +0.2% +4.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +5.1% +0.2% +4.9% +30.0% ➖ noise
8 datafusion:vortex-compact +5.1% -0.0% +5.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +16.5% -0.0% +16.6% +30.0% ➖ noise
8 duckdb:vortex-compact +4.8% -0.0% +4.8% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -13.4% -0.0% -13.4% +30.0% ➖ noise

@robert3005
Copy link
Copy Markdown
Contributor

I think you need to rebase for benchmarks to run since some of the logic changed

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 857ddc7 1 Explore Profiling Data
Previous Runs (2)
Status Commit Job Attempt Link
🟢 Done 6479854 1 Explore Profiling Data
🟢 Done 44d4c59 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Benchmarks: Random Access

Vortex (geomean): 0.854x ✅
Parquet (geomean): 1.039x ➖


unknown / unknown (0.966x ➖, 10↑ 4↓)
name PR 857ddc7 (ns) base 1b2f6ee (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2511044 2718194 0.92
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1295970 1239577 1.05
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11723757447 11504725037 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11283607398 11048532135 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8520598 9376873 0.91
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6896313 7405968 0.93
random-access/feature-vectors/uniform/lance-tokio-local-disk 1529315 1433124 1.07
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2437027 2289898 1.06
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11100704006 11081575375 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11177746737 11100005794 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13969917 15076674 0.93
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 14369848 14961094 0.96
random-access/lance-tokio-local-disk 768184 739512 1.04
random-access/lance-tokio-local-disk-footer 1360622 1332640 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk 271647 262114 1.04
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 717521 753301 0.95
random-access/nested-lists/correlated/parquet-tokio-local-disk 144059177 134051722 1.07
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 143689397 136331157 1.05
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 741045 882350 0.84
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 735951 895037 0.82
random-access/nested-lists/uniform/lance-tokio-local-disk 1184649 1221285 0.97
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1674335 1701720 0.98
random-access/nested-lists/uniform/parquet-tokio-local-disk 140373445 139101863 1.01
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 140172534 135962725 1.03
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2382676 2690824 0.89
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2377261 2664592 0.89
random-access/nested-structs/correlated/lance-tokio-local-disk 432335 432882 1.00
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 643297 636905 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚨 29562137 25758470 1.15
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚨 29470474 25784508 1.14
random-access/nested-structs/correlated/vortex-tokio-local-disk 936603 948759 0.99
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 926785 901278 1.03
random-access/nested-structs/uniform/lance-tokio-local-disk 2856695 2826519 1.01
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3139079 3055507 1.03
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚨 29472823 25710931 1.15
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚨 29536563 25708134 1.15
random-access/nested-structs/uniform/vortex-tokio-local-disk 1896474 1865187 1.02
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1876801 1972937 0.95
random-access/parquet-tokio-local-disk 179311569 181851185 0.99
random-access/parquet-tokio-local-disk-footer 177643962 185693835 0.96
random-access/taxi/correlated/lance-tokio-local-disk 981943 973803 1.01
random-access/taxi/correlated/lance-tokio-local-disk-footer 1663703 1651463 1.01
random-access/taxi/correlated/parquet-tokio-local-disk 275811994 272870225 1.01
random-access/taxi/correlated/parquet-tokio-local-disk-footer 271157612 278175487 0.97
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1788162 2645763 0.68
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1933575 2740811 0.71
random-access/taxi/uniform/lance-tokio-local-disk 8846514 8328654 1.06
random-access/taxi/uniform/lance-tokio-local-disk-footer 9480919 8952027 1.06
random-access/taxi/uniform/parquet-tokio-local-disk 289735488 288052952 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 291348007 291074073 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4708160 5824955 0.81
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4646253 5773546 0.80
random-access/vortex-tokio-local-disk 🚀 1319434 1928764 0.68
random-access/vortex-tokio-local-disk-footer 🚀 1338336 1972747 0.68

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

BENCHMARK FAILED

Benchmark Compression failed! Check the workflow run for details.

@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@connortsui20 connortsui20 added action/benchmark Trigger full benchmarks to run on this PR labels Apr 16, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@connortsui20
Copy link
Copy Markdown
Contributor Author

did something go wrong here? This is saying that file sizes are changing too which is somewhat unexpected but maybe it is true if this is somehow wrong?

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@robert3005
Copy link
Copy Markdown
Contributor

I think that while the compressor is stable if you change the order you feed files into the compressor the compression might change due to different numbers being drawn from the generator.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@connortsui20
Copy link
Copy Markdown
Contributor Author

connortsui20 commented Apr 16, 2026

This seems strange, why would the order in which I download things affect the order that the compressor compresses files? Downloading files should be an atomic operation, in that we download all of the files and then continue, so I don't know why this changes things.

I'll dig into this a bit more.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@connortsui20 connortsui20 added the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
@connortsui20
Copy link
Copy Markdown
Contributor Author

ok I think that was a phantom from other changes on develop, everything seems fine now except #7490 (comment)?

@connortsui20 connortsui20 merged commit 7e0af3c into develop Apr 16, 2026
57 of 58 checks passed
@connortsui20 connortsui20 deleted the ct/unify-download branch April 16, 2026 19:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/feature A new feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants