Skip to content

allow make view inline#7500

Open
joseph-isaacs wants to merge 2 commits intodevelopfrom
ji/inline-make-views
Open

allow make view inline#7500
joseph-isaacs wants to merge 2 commits intodevelopfrom
ji/inline-make-views

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

..

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 16, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Apr 16, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 16, 2026

Merging this PR will degrade performance by 23.81%

⚡ 2 improved benchmarks
❌ 25 regressed benchmarks
✅ 1136 untouched benchmarks
⏩ 1457 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_constant_utf8_append_to_builder[("hi", 1000, 10)] 105.7 µs 90.2 µs +17.27%
Simulation chunked_constant_utf8_append_to_builder[("hello world!!", 1000, 10)] 108.3 µs 92.8 µs +16.78%
Simulation take_search[(0.005, 0.05)] 132 µs 168.7 µs -21.73%
Simulation take_search[(0.005, 0.1)] 247.7 µs 320.8 µs -22.78%
Simulation take_search[(0.005, 1.0)] 2.3 ms 3.1 ms -23.81%
Simulation take_search[(0.01, 0.05)] 143.1 µs 179.7 µs -20.4%
Simulation take_search[(0.005, 0.5)] 1.2 ms 1.5 ms -23.68%
Simulation take_search[(0.01, 0.5)] 1.3 ms 1.6 ms -22.22%
Simulation take_search[(0.1, 0.05)] 212.8 µs 249.5 µs -14.7%
Simulation take_search[(0.01, 1.0)] 2.5 ms 3.3 ms -22.34%
Simulation take_search[(0.1, 0.1)] 386.1 µs 459.2 µs -15.92%
Simulation take_search_chunked[(0.01, 0.05)] 182.8 µs 213.9 µs -14.53%
Simulation take_search[(0.01, 0.1)] 268.5 µs 341.6 µs -21.39%
Simulation take_search[(0.1, 0.5)] 1.8 ms 2.2 ms -16.94%
Simulation take_search_chunked[(0.005, 1.0)] 3.1 ms 3.7 ms -16.78%
Simulation take_search_chunked[(0.005, 0.05)] 169.9 µs 201 µs -15.46%
Simulation take_search_chunked[(0.005, 0.5)] 1.5 ms 1.9 ms -16.7%
Simulation take_search_chunked[(0.01, 0.5)] 1.7 ms 2 ms -15.69%
Simulation take_search_chunked[(0.01, 0.1)] 346.7 µs 408.8 µs -15.17%
Simulation take_search[(0.1, 1.0)] 3.5 ms 4.3 ms -17.1%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/inline-make-views (44f3660) with develop (ce52b71)

Open in CodSpeed

Footnotes

  1. 1457 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 16, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 6b83bac 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.962x ➖


datafusion / vortex-file-compressed (0.962x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 127635551 132852167 0.96
polarsignals_q01/datafusion:vortex-file-compressed 381703023 406489678 0.94
polarsignals_q02/datafusion:vortex-file-compressed 23765702 25573933 0.93
polarsignals_q03/datafusion:vortex-file-compressed 391682606 395740934 0.99
polarsignals_q04/datafusion:vortex-file-compressed 11785409 12320026 0.96
polarsignals_q05/datafusion:vortex-file-compressed 16388691 17585476 0.93
polarsignals_q06/datafusion:vortex-file-compressed 19977617 20147105 0.99
polarsignals_q07/datafusion:vortex-file-compressed 14832912 14626050 1.01
polarsignals_q08/datafusion:vortex-file-compressed 470652227 493968511 0.95
polarsignals_q09/datafusion:vortex-file-compressed 11131653 11594641 0.96

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +7.6%
Vortex (geomean): 0.962x ➖
Parquet (geomean): 0.894x ✅
Shifts: Parquet (control) -10.6% · Median polish -6.2%


datafusion / vortex-file-compressed (0.920x ➖, 3↑ 1↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 5675151 5037988 1.13
fineweb_q01/datafusion:vortex-file-compressed 🚀 27238864 30678846 0.89
fineweb_q02/datafusion:vortex-file-compressed 28792116 30554849 0.94
fineweb_q03/datafusion:vortex-file-compressed 🚀 85809095 106483154 0.81
fineweb_q04/datafusion:vortex-file-compressed 265068583 272659892 0.97
fineweb_q05/datafusion:vortex-file-compressed 231784991 255779823 0.91
fineweb_q06/datafusion:vortex-file-compressed 🚀 66739327 82352540 0.81
fineweb_q07/datafusion:vortex-file-compressed 71738198 76398805 0.94
fineweb_q08/datafusion:vortex-file-compressed 26238370 28319908 0.93
datafusion / vortex-compact (0.942x ➖, 3↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5426884 5520106 0.98
fineweb_q01/datafusion:vortex-compact 164981000 168746604 0.98
fineweb_q02/datafusion:vortex-compact 164632515 176134653 0.93
fineweb_q03/datafusion:vortex-compact 1489153992 1542082107 0.97
fineweb_q04/datafusion:vortex-compact 1600104594 1723947288 0.93
fineweb_q05/datafusion:vortex-compact 🚀 1254166636 1399975884 0.90
fineweb_q06/datafusion:vortex-compact 🚀 706701192 826111458 0.86
fineweb_q07/datafusion:vortex-compact 🚀 746269764 833383890 0.90
fineweb_q08/datafusion:vortex-compact 24114764 22819142 1.06
datafusion / parquet (0.890x ✅, 5↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6750831 8039235 0.84
fineweb_q01/datafusion:parquet 🚀 295890408 344542917 0.86
fineweb_q02/datafusion:parquet 🚀 292127874 340379097 0.86
fineweb_q03/datafusion:parquet 305545143 327440641 0.93
fineweb_q04/datafusion:parquet 🚀 309825481 347352362 0.89
fineweb_q05/datafusion:parquet 🚀 308179013 348245532 0.88
fineweb_q06/datafusion:parquet 296868829 324139679 0.92
fineweb_q07/datafusion:parquet 292918163 317881158 0.92
fineweb_q08/datafusion:parquet 290373790 320410293 0.91
duckdb / vortex-file-compressed (1.021x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3795507 3637554 1.04
fineweb_q01/duckdb:vortex-file-compressed 30155296 27701232 1.09
fineweb_q02/duckdb:vortex-file-compressed 29362557 29162434 1.01
fineweb_q03/duckdb:vortex-file-compressed 172947568 157742447 1.10
fineweb_q04/duckdb:vortex-file-compressed 238423144 232745789 1.02
fineweb_q05/duckdb:vortex-file-compressed 223218551 227538190 0.98
fineweb_q06/duckdb:vortex-file-compressed 67896532 73496177 0.92
fineweb_q07/duckdb:vortex-file-compressed 73540405 71086582 1.03
fineweb_q08/duckdb:vortex-file-compressed 26725890 26616171 1.00
duckdb / vortex-compact (0.969x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4538790 4592488 0.99
fineweb_q01/duckdb:vortex-compact 109449360 104192779 1.05
fineweb_q02/duckdb:vortex-compact 115413168 120412563 0.96
fineweb_q03/duckdb:vortex-compact 875046411 920164946 0.95
fineweb_q04/duckdb:vortex-compact 917584807 965897348 0.95
fineweb_q05/duckdb:vortex-compact 825874985 862251430 0.96
fineweb_q06/duckdb:vortex-compact 474146718 498851363 0.95
fineweb_q07/duckdb:vortex-compact 487800451 525849917 0.93
fineweb_q08/duckdb:vortex-compact 23626836 23872612 0.99
duckdb / parquet (0.899x ✅, 5↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30396042 32794298 0.93
fineweb_q01/duckdb:parquet 86306889 94549451 0.91
fineweb_q02/duckdb:parquet 88900169 94247585 0.94
fineweb_q03/duckdb:parquet 🚀 316487782 357463959 0.89
fineweb_q04/duckdb:parquet 🚀 445229677 507992792 0.88
fineweb_q05/duckdb:parquet 🚀 416288306 481015146 0.87
fineweb_q06/duckdb:parquet 🚀 202556189 233852380 0.87
fineweb_q07/duckdb:parquet 🚀 213521635 240485495 0.89
fineweb_q08/duckdb:parquet 35330919 37816269 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -1.7% -11.8% +11.4% +43.4% ➖ noise
0 datafusion:vortex-file-compressed +12.6% -11.8% +27.7% +71.9% ➖ noise
0 duckdb:vortex-compact -1.2% -11.8% +12.0% +36.0% ➖ noise
0 duckdb:vortex-file-compressed +4.3% -11.8% +18.3% +46.4% ➖ noise
1 datafusion:vortex-compact -2.2% -11.5% +10.4% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed -11.2% -11.5% +0.3% +16.6% ➖ noise
1 duckdb:vortex-compact +5.0% -11.5% +18.6% +14.3% 🚨 regression
1 duckdb:vortex-file-compressed +8.9% -11.5% +22.9% +35.9% ➖ noise
2 datafusion:vortex-compact -6.5% -10.0% +3.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.8% -10.0% +4.7% +14.1% ➖ noise
2 duckdb:vortex-compact -4.2% -10.0% +6.5% +13.9% ➖ noise
2 duckdb:vortex-file-compressed +0.7% -10.0% +11.9% +13.3% ➖ noise
3 datafusion:vortex-compact -3.4% -9.1% +6.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -19.4% -9.1% -11.3% +25.9% ➖ noise
3 duckdb:vortex-compact -4.9% -9.1% +4.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +9.6% -9.1% +20.6% +23.5% ➖ noise
4 datafusion:vortex-compact -7.2% -11.6% +5.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.8% -11.6% +10.0% +10.1% ➖ noise
4 duckdb:vortex-compact -5.0% -11.6% +7.4% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% -11.6% +15.9% +10.0% 🚨 regression
5 datafusion:vortex-compact -10.4% -12.5% +2.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -9.4% -12.5% +3.5% +10.0% ➖ noise
5 duckdb:vortex-compact -4.2% -12.5% +9.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.9% -12.5% +12.1% +10.0% 🚨 regression
6 datafusion:vortex-compact -14.5% -10.9% -4.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -19.0% -10.9% -9.0% +15.0% ➖ noise
6 duckdb:vortex-compact -5.0% -10.9% +6.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -7.6% -10.9% +3.7% +10.0% ➖ noise
7 datafusion:vortex-compact -10.5% -9.5% -1.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -6.1% -9.5% +3.8% +13.8% ➖ noise
7 duckdb:vortex-compact -7.2% -9.5% +2.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.5% -9.5% +14.4% +12.1% 🚨 regression
8 datafusion:vortex-compact +5.7% -8.0% +14.8% +28.2% ➖ noise
8 datafusion:vortex-file-compressed -7.4% -8.0% +0.7% +39.1% ➖ noise
8 duckdb:vortex-compact -1.0% -8.0% +7.6% +21.9% ➖ noise
8 duckdb:vortex-file-compressed +0.4% -8.0% +9.1% +17.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.5%
Vortex (geomean): 1.097x ➖
Parquet (geomean): 1.057x ➖
Shifts: Parquet (control) +5.7% · Median polish +7.7%


datafusion / vortex-file-compressed (1.082x ➖, 0↑ 6↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 55061258 48297881 1.14
tpch_q02/datafusion:vortex-file-compressed 34911156 32775522 1.07
tpch_q03/datafusion:vortex-file-compressed 29332851 26914520 1.09
tpch_q04/datafusion:vortex-file-compressed 20251011 18982062 1.07
tpch_q05/datafusion:vortex-file-compressed 57933893 53277020 1.09
tpch_q06/datafusion:vortex-file-compressed 11178107 10717083 1.04
tpch_q07/datafusion:vortex-file-compressed 68449623 64233283 1.07
tpch_q08/datafusion:vortex-file-compressed 47843255 44631762 1.07
tpch_q09/datafusion:vortex-file-compressed 61134565 56788753 1.08
tpch_q10/datafusion:vortex-file-compressed 48070698 44309093 1.08
tpch_q11/datafusion:vortex-file-compressed 19168496 17509874 1.09
tpch_q12/datafusion:vortex-file-compressed 25249295 24395145 1.04
tpch_q13/datafusion:vortex-file-compressed 28366466 27230930 1.04
tpch_q14/datafusion:vortex-file-compressed 16903002 16480457 1.03
tpch_q15/datafusion:vortex-file-compressed 25969837 25194448 1.03
tpch_q16/datafusion:vortex-file-compressed 25263682 24664981 1.02
tpch_q17/datafusion:vortex-file-compressed 🚨 70775428 63278274 1.12
tpch_q18/datafusion:vortex-file-compressed 🚨 89698513 77607163 1.16
tpch_q19/datafusion:vortex-file-compressed 25118596 23846199 1.05
tpch_q20/datafusion:vortex-file-compressed 🚨 36300118 32912071 1.10
tpch_q21/datafusion:vortex-file-compressed 🚨 87201837 74918283 1.16
tpch_q22/datafusion:vortex-file-compressed 🚨 18977520 16086680 1.18
datafusion / vortex-compact (1.097x ➖, 0↑ 13↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 63061390 58558316 1.08
tpch_q02/datafusion:vortex-compact 39127722 36493999 1.07
tpch_q03/datafusion:vortex-compact 🚨 35071077 30642854 1.14
tpch_q04/datafusion:vortex-compact 🚨 26051803 23263864 1.12
tpch_q05/datafusion:vortex-compact 🚨 62572412 56293230 1.11
tpch_q06/datafusion:vortex-compact 14324117 14251011 1.01
tpch_q07/datafusion:vortex-compact 🚨 77429477 69844278 1.11
tpch_q08/datafusion:vortex-compact 🚨 55112535 50006125 1.10
tpch_q09/datafusion:vortex-compact 🚨 68251464 61503309 1.11
tpch_q10/datafusion:vortex-compact 🚨 59254884 53044268 1.12
tpch_q11/datafusion:vortex-compact 🚨 21188483 18915054 1.12
tpch_q12/datafusion:vortex-compact 🚨 36322837 32892758 1.10
tpch_q13/datafusion:vortex-compact 38289245 35381688 1.08
tpch_q14/datafusion:vortex-compact 22795127 20989864 1.09
tpch_q15/datafusion:vortex-compact 36111577 35636741 1.01
tpch_q16/datafusion:vortex-compact 31326102 29331215 1.07
tpch_q17/datafusion:vortex-compact 🚨 74507296 66973562 1.11
tpch_q18/datafusion:vortex-compact 🚨 96163892 83527937 1.15
tpch_q19/datafusion:vortex-compact 36472205 33870188 1.08
tpch_q20/datafusion:vortex-compact 🚨 43120970 37963718 1.14
tpch_q21/datafusion:vortex-compact 🚨 98449029 85092928 1.16
tpch_q22/datafusion:vortex-compact 18342640 16969737 1.08
datafusion / parquet (1.050x ➖, 1↑ 6↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 130087219 134280595 0.97
tpch_q02/datafusion:parquet 73807106 69400917 1.06
tpch_q03/datafusion:parquet 75734522 79067260 0.96
tpch_q04/datafusion:parquet 51707704 47511676 1.09
tpch_q05/datafusion:parquet 🚨 113004256 100796834 1.12
tpch_q06/datafusion:parquet 43108780 43273125 1.00
tpch_q07/datafusion:parquet 119534246 110819618 1.08
tpch_q08/datafusion:parquet 104520329 100281303 1.04
tpch_q09/datafusion:parquet 138439841 129817815 1.07
tpch_q10/datafusion:parquet 127498379 120116823 1.06
tpch_q11/datafusion:parquet 52206454 47958156 1.09
tpch_q12/datafusion:parquet 🚨 98218544 87164751 1.13
tpch_q13/datafusion:parquet 🚨 226447083 201679246 1.12
tpch_q14/datafusion:parquet 46415641 48025731 0.97
tpch_q15/datafusion:parquet 71035411 66600414 1.07
tpch_q16/datafusion:parquet 🚨 55131478 49929247 1.10
tpch_q17/datafusion:parquet 🚨 148717233 131351273 1.13
tpch_q18/datafusion:parquet 🚨 181431805 162064252 1.12
tpch_q19/datafusion:parquet 🚀 73823276 90414818 0.82
tpch_q20/datafusion:parquet 82134484 78433129 1.05
tpch_q21/datafusion:parquet 154834412 146227197 1.06
tpch_q22/datafusion:parquet 37898670 35637783 1.06
datafusion / arrow (1.111x ❌, 0↑ 11↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 57740866 55355259 1.04
tpch_q02/datafusion:arrow 23049227 21968824 1.05
tpch_q03/datafusion:arrow 🚨 37374828 33859779 1.10
tpch_q04/datafusion:arrow 28631428 27111116 1.06
tpch_q05/datafusion:arrow 🚨 90992608 75000681 1.21
tpch_q06/datafusion:arrow 🚨 24581239 19641662 1.25
tpch_q07/datafusion:arrow 119330029 111624324 1.07
tpch_q08/datafusion:arrow 49542481 45186109 1.10
tpch_q09/datafusion:arrow 78099373 72658466 1.07
tpch_q10/datafusion:arrow 55675875 51090145 1.09
tpch_q11/datafusion:arrow 🚨 13129879 11421335 1.15
tpch_q12/datafusion:arrow 🚨 63031115 54625798 1.15
tpch_q13/datafusion:arrow 51933216 48200675 1.08
tpch_q14/datafusion:arrow 🚨 25111923 22337863 1.12
tpch_q15/datafusion:arrow 🚨 49341929 42916460 1.15
tpch_q16/datafusion:arrow 22311788 20482792 1.09
tpch_q17/datafusion:arrow 🚨 77815426 69543953 1.12
tpch_q18/datafusion:arrow 🚨 157778579 139834483 1.13
tpch_q19/datafusion:arrow 🚨 42539964 38665303 1.10
tpch_q20/datafusion:arrow 🚨 44233413 37524999 1.18
tpch_q21/datafusion:arrow 163437887 149790022 1.09
tpch_q22/datafusion:arrow 21043658 19957913 1.05
duckdb / vortex-file-compressed (1.129x ❌, 0↑ 17↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 35981136 33034972 1.09
tpch_q02/duckdb:vortex-file-compressed 🚨 30337360 27495858 1.10
tpch_q03/duckdb:vortex-file-compressed 🚨 33653457 29155577 1.15
tpch_q04/duckdb:vortex-file-compressed 🚨 35827217 30320360 1.18
tpch_q05/duckdb:vortex-file-compressed 🚨 38812257 33458126 1.16
tpch_q06/duckdb:vortex-file-compressed 🚨 12376501 10644178 1.16
tpch_q07/duckdb:vortex-file-compressed 🚨 43330983 38380112 1.13
tpch_q08/duckdb:vortex-file-compressed 🚨 44886029 39502818 1.14
tpch_q09/duckdb:vortex-file-compressed 🚨 92342889 80533342 1.15
tpch_q10/duckdb:vortex-file-compressed 🚨 41094669 36874215 1.11
tpch_q11/duckdb:vortex-file-compressed 17632833 16075379 1.10
tpch_q12/duckdb:vortex-file-compressed 🚨 26309179 23409457 1.12
tpch_q13/duckdb:vortex-file-compressed 🚨 42922860 36936260 1.16
tpch_q14/duckdb:vortex-file-compressed 23863544 21934844 1.09
tpch_q15/duckdb:vortex-file-compressed 🚨 17879387 16136672 1.11
tpch_q16/duckdb:vortex-file-compressed 🚨 33764134 29955174 1.13
tpch_q17/duckdb:vortex-file-compressed 🚨 27812415 25017791 1.11
tpch_q18/duckdb:vortex-file-compressed 55305563 50886382 1.09
tpch_q19/duckdb:vortex-file-compressed 34865429 31826849 1.10
tpch_q20/duckdb:vortex-file-compressed 🚨 39927863 34440134 1.16
tpch_q21/duckdb:vortex-file-compressed 🚨 125840493 107964009 1.17
tpch_q22/duckdb:vortex-file-compressed 🚨 21150733 18479875 1.14
duckdb / vortex-compact (1.082x ➖, 0↑ 7↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 43270127 39568055 1.09
tpch_q02/duckdb:vortex-compact 40667055 37868245 1.07
tpch_q03/duckdb:vortex-compact 34450087 32311472 1.07
tpch_q04/duckdb:vortex-compact 🚨 36624090 33169522 1.10
tpch_q05/duckdb:vortex-compact 40491650 37940864 1.07
tpch_q06/duckdb:vortex-compact 🚨 16021882 14412263 1.11
tpch_q07/duckdb:vortex-compact 46201287 42779679 1.08
tpch_q08/duckdb:vortex-compact 47842385 45571832 1.05
tpch_q09/duckdb:vortex-compact 🚨 101285226 90746850 1.12
tpch_q10/duckdb:vortex-compact 43511852 40741321 1.07
tpch_q11/duckdb:vortex-compact 21836573 20156539 1.08
tpch_q12/duckdb:vortex-compact 38160212 36261345 1.05
tpch_q13/duckdb:vortex-compact 48157117 46532620 1.03
tpch_q14/duckdb:vortex-compact 31913500 30060171 1.06
tpch_q15/duckdb:vortex-compact 🚨 21512852 19095452 1.13
tpch_q16/duckdb:vortex-compact 🚨 40649240 36805534 1.10
tpch_q17/duckdb:vortex-compact 32660305 31288631 1.04
tpch_q18/duckdb:vortex-compact 54991523 50003000 1.10
tpch_q19/duckdb:vortex-compact 🚨 40731790 36987588 1.10
tpch_q20/duckdb:vortex-compact 45938714 42082759 1.09
tpch_q21/duckdb:vortex-compact 🚨 121436885 110171098 1.10
tpch_q22/duckdb:vortex-compact 22185416 20647256 1.07
duckdb / parquet (1.064x ➖, 0↑ 3↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77761116 76657657 1.01
tpch_q02/duckdb:parquet 41477350 38675673 1.07
tpch_q03/duckdb:parquet 71847187 69020597 1.04
tpch_q04/duckdb:parquet 48825767 46935210 1.04
tpch_q05/duckdb:parquet 70760110 66654636 1.06
tpch_q06/duckdb:parquet 20703325 19878167 1.04
tpch_q07/duckdb:parquet 76478274 71424279 1.07
tpch_q08/duckdb:parquet 88521423 81710794 1.08
tpch_q09/duckdb:parquet 🚨 171089866 145327374 1.18
tpch_q10/duckdb:parquet 122899308 114871826 1.07
tpch_q11/duckdb:parquet 23284481 22258714 1.05
tpch_q12/duckdb:parquet 48196018 44668602 1.08
tpch_q13/duckdb:parquet 🚨 281330094 247274622 1.14
tpch_q14/duckdb:parquet 51337011 48857892 1.05
tpch_q15/duckdb:parquet 25603691 24099058 1.06
tpch_q16/duckdb:parquet 59279416 55434451 1.07
tpch_q17/duckdb:parquet 🚨 55310640 50254250 1.10
tpch_q18/duckdb:parquet 119128424 119065567 1.00
tpch_q19/duckdb:parquet 68290243 65664118 1.04
tpch_q20/duckdb:parquet 65114219 62758216 1.04
tpch_q21/duckdb:parquet 181171660 168119139 1.08
tpch_q22/duckdb:parquet 54040513 51316015 1.05
duckdb / duckdb (1.067x ➖, 0↑ 6↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 🚨 17489299 15736304 1.11
tpch_q02/duckdb:duckdb 13258327 12972293 1.02
tpch_q03/duckdb:duckdb 19674380 18722663 1.05
tpch_q04/duckdb:duckdb 19592795 19980441 0.98
tpch_q05/duckdb:duckdb 19982722 20073074 1.00
tpch_q06/duckdb:duckdb 🚨 5754927 5182656 1.11
tpch_q07/duckdb:duckdb 🚨 24409092 21690936 1.13
tpch_q08/duckdb:duckdb 22179455 20893748 1.06
tpch_q09/duckdb:duckdb 🚨 61918377 51512595 1.20
tpch_q10/duckdb:duckdb 45808297 45734365 1.00
tpch_q11/duckdb:duckdb 🚨 6630801 5624766 1.18
tpch_q12/duckdb:duckdb 14540861 13890634 1.05
tpch_q13/duckdb:duckdb 39417410 39228453 1.00
tpch_q14/duckdb:duckdb 🚨 18522309 16062996 1.15
tpch_q15/duckdb:duckdb 12481066 11716631 1.07
tpch_q16/duckdb:duckdb 24674243 24192449 1.02
tpch_q17/duckdb:duckdb 14869269 13552420 1.10
tpch_q18/duckdb:duckdb 40433777 38334016 1.05
tpch_q19/duckdb:duckdb 28987731 26958767 1.08
tpch_q20/duckdb:duckdb 23486033 23043281 1.02
tpch_q21/duckdb:duckdb 60306577 56185979 1.07
tpch_q22/duckdb:duckdb 25564613 24222145 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +4.3% -0.9% +5.2% +18.5% ➖ noise
1 datafusion:vortex-compact +7.7% -0.9% +8.6% +16.9% ➖ noise
1 datafusion:vortex-file-compressed +14.0% -0.9% +15.0% +17.5% ➖ noise
1 duckdb:duckdb +11.1% -0.9% +12.1% +17.0% ➖ noise
1 duckdb:vortex-compact +9.4% -0.9% +10.3% +16.8% ➖ noise
1 duckdb:vortex-file-compressed +8.9% -0.9% +9.9% +16.5% ➖ noise
2 datafusion:arrow +4.9% +6.8% -1.8% +12.7% ➖ noise
2 datafusion:vortex-compact +7.2% +6.8% +0.4% +12.7% ➖ noise
2 datafusion:vortex-file-compressed +6.5% +6.8% -0.3% +12.7% ➖ noise
2 duckdb:duckdb +2.2% +6.8% -4.3% +12.7% ➖ noise
2 duckdb:vortex-compact +7.4% +6.8% +0.6% +12.7% ➖ noise
2 duckdb:vortex-file-compressed +10.3% +6.8% +3.3% +12.7% ➖ noise
3 datafusion:arrow +10.4% -0.1% +10.5% +12.7% ➖ noise
3 datafusion:vortex-compact +14.5% -0.1% +14.6% +12.7% 🚨 regression
3 datafusion:vortex-file-compressed +9.0% -0.1% +9.1% +12.7% ➖ noise
3 duckdb:duckdb +5.1% -0.1% +5.2% +12.7% ➖ noise
3 duckdb:vortex-compact +6.6% -0.1% +6.8% +12.7% ➖ noise
3 duckdb:vortex-file-compressed +15.4% -0.1% +15.6% +12.7% 🚨 regression
4 datafusion:arrow +5.6% +6.4% -0.7% +12.7% ➖ noise
4 datafusion:vortex-compact +12.0% +6.4% +5.2% +12.7% ➖ noise
4 datafusion:vortex-file-compressed +6.7% +6.4% +0.3% +12.7% ➖ noise
4 duckdb:duckdb -1.9% +6.4% -7.8% +12.7% ➖ noise
4 duckdb:vortex-compact +10.4% +6.4% +3.8% +12.7% ➖ noise
4 duckdb:vortex-file-compressed +18.2% +6.4% +11.1% +12.7% ➖ noise
5 datafusion:arrow +21.3% +9.1% +11.2% +12.7% ➖ noise
5 datafusion:vortex-compact +11.2% +9.1% +1.9% +12.7% ➖ noise
5 datafusion:vortex-file-compressed +8.7% +9.1% -0.3% +12.7% ➖ noise
5 duckdb:duckdb -0.5% +9.1% -8.7% +12.7% ➖ noise
5 duckdb:vortex-compact +6.7% +9.1% -2.2% +12.7% ➖ noise
5 duckdb:vortex-file-compressed +16.0% +9.1% +6.3% +12.7% ➖ noise
6 datafusion:arrow +25.1% +1.9% +22.9% +14.2% 🚨 regression
6 datafusion:vortex-compact +0.5% +1.9% -1.3% +15.2% ➖ noise
6 datafusion:vortex-file-compressed +4.3% +1.9% +2.4% +15.1% ➖ noise
6 duckdb:duckdb +11.0% +1.9% +9.0% +16.2% ➖ noise
6 duckdb:vortex-compact +11.2% +1.9% +9.1% +15.2% ➖ noise
6 duckdb:vortex-file-compressed +16.3% +1.9% +14.2% +16.1% ➖ noise
7 datafusion:arrow +6.9% +7.5% -0.5% +12.7% ➖ noise
7 datafusion:vortex-compact +10.9% +7.5% +3.2% +12.7% ➖ noise
7 datafusion:vortex-file-compressed +6.6% +7.5% -0.8% +12.7% ➖ noise
7 duckdb:duckdb +12.5% +7.5% +4.7% +12.7% ➖ noise
7 duckdb:vortex-compact +8.0% +7.5% +0.5% +12.7% ➖ noise
7 duckdb:vortex-file-compressed +12.9% +7.5% +5.1% +12.7% ➖ noise
8 datafusion:arrow +9.6% +6.3% +3.2% +12.7% ➖ noise
8 datafusion:vortex-compact +10.2% +6.3% +3.7% +12.7% ➖ noise
8 datafusion:vortex-file-compressed +7.2% +6.3% +0.9% +12.7% ➖ noise
8 duckdb:duckdb +6.2% +6.3% -0.1% +12.7% ➖ noise
8 duckdb:vortex-compact +5.0% +6.3% -1.2% +12.7% ➖ noise
8 duckdb:vortex-file-compressed +13.6% +6.3% +6.9% +12.7% ➖ noise
9 datafusion:arrow +7.5% +12.0% -4.1% +12.7% ➖ noise
9 datafusion:vortex-compact +11.0% +12.0% -1.0% +12.7% ➖ noise
9 datafusion:vortex-file-compressed +7.7% +12.0% -3.9% +12.7% ➖ noise
9 duckdb:duckdb +20.2% +12.0% +7.3% +12.7% ➖ noise
9 duckdb:vortex-compact +11.6% +12.0% -0.4% +12.7% ➖ noise
9 duckdb:vortex-file-compressed +14.7% +12.0% +2.3% +12.7% ➖ noise
10 datafusion:arrow +9.0% +6.6% +2.3% +12.7% ➖ noise
10 datafusion:vortex-compact +11.7% +6.6% +4.8% +12.7% ➖ noise
10 datafusion:vortex-file-compressed +8.5% +6.6% +1.8% +12.7% ➖ noise
10 duckdb:duckdb +0.2% +6.6% -6.0% +12.7% ➖ noise
10 duckdb:vortex-compact +6.8% +6.6% +0.2% +12.7% ➖ noise
10 duckdb:vortex-file-compressed +11.4% +6.6% +4.6% +12.7% ➖ noise
11 datafusion:arrow +15.0% +6.7% +7.7% +12.7% ➖ noise
11 datafusion:vortex-compact +12.0% +6.7% +5.0% +12.7% ➖ noise
11 datafusion:vortex-file-compressed +9.5% +6.7% +2.6% +12.7% ➖ noise
11 duckdb:duckdb +17.9% +6.7% +10.5% +12.7% ➖ noise
11 duckdb:vortex-compact +8.3% +6.7% +1.5% +12.7% ➖ noise
11 duckdb:vortex-file-compressed +9.7% +6.7% +2.8% +12.7% ➖ noise
12 datafusion:arrow +15.4% +10.3% +4.6% +12.7% ➖ noise
12 datafusion:vortex-compact +10.4% +10.3% +0.1% +12.7% ➖ noise
12 datafusion:vortex-file-compressed +3.5% +10.3% -6.1% +12.7% ➖ noise
12 duckdb:duckdb +4.7% +10.3% -5.1% +12.7% ➖ noise
12 duckdb:vortex-compact +5.2% +10.3% -4.6% +12.7% ➖ noise
12 duckdb:vortex-file-compressed +12.4% +10.3% +1.9% +12.7% ➖ noise
13 datafusion:arrow +7.7% +13.0% -4.7% +12.7% ➖ noise
13 datafusion:vortex-compact +8.2% +13.0% -4.3% +12.7% ➖ noise
13 datafusion:vortex-file-compressed +4.2% +13.0% -7.8% +12.7% ➖ noise
13 duckdb:duckdb +0.5% +13.0% -11.1% +12.7% ➖ noise
13 duckdb:vortex-compact +3.5% +13.0% -8.4% +12.7% ➖ noise
13 duckdb:vortex-file-compressed +16.2% +13.0% +2.8% +12.7% ➖ noise
14 datafusion:arrow +12.4% +0.8% +11.6% +13.4% ➖ noise
14 datafusion:vortex-compact +8.6% +0.8% +7.8% +12.7% ➖ noise
14 datafusion:vortex-file-compressed +2.6% +0.8% +1.8% +12.7% ➖ noise
14 duckdb:duckdb +15.3% +0.8% +14.4% +18.6% ➖ noise
14 duckdb:vortex-compact +6.2% +0.8% +5.4% +12.7% ➖ noise
14 duckdb:vortex-file-compressed +8.8% +0.8% +8.0% +13.9% ➖ noise
15 datafusion:arrow +15.0% +6.5% +8.0% +12.7% ➖ noise
15 datafusion:vortex-compact +1.3% +6.5% -4.8% +12.7% ➖ noise
15 datafusion:vortex-file-compressed +3.1% +6.5% -3.2% +12.7% ➖ noise
15 duckdb:duckdb +6.5% +6.5% +0.1% +12.7% ➖ noise
15 duckdb:vortex-compact +12.7% +6.5% +5.8% +12.7% ➖ noise
15 duckdb:vortex-file-compressed +10.8% +6.5% +4.1% +12.7% ➖ noise
16 datafusion:arrow +8.9% +8.7% +0.2% +12.7% ➖ noise
16 datafusion:vortex-compact +6.8% +8.7% -1.7% +12.7% ➖ noise
16 datafusion:vortex-file-compressed +2.4% +8.7% -5.7% +12.7% ➖ noise
16 duckdb:duckdb +2.0% +8.7% -6.1% +12.7% ➖ noise
16 duckdb:vortex-compact +10.4% +8.7% +1.6% +12.7% ➖ noise
16 duckdb:vortex-file-compressed +12.7% +8.7% +3.7% +12.7% ➖ noise
17 datafusion:arrow +11.9% +11.6% +0.2% +12.7% ➖ noise
17 datafusion:vortex-compact +11.2% +11.6% -0.3% +12.7% ➖ noise
17 datafusion:vortex-file-compressed +11.8% +11.6% +0.2% +12.7% ➖ noise
17 duckdb:duckdb +9.7% +11.6% -1.7% +12.7% ➖ noise
17 duckdb:vortex-compact +4.4% +11.6% -6.5% +12.7% ➖ noise
17 duckdb:vortex-file-compressed +11.2% +11.6% -0.4% +12.7% ➖ noise
18 datafusion:arrow +12.8% +5.8% +6.6% +12.7% ➖ noise
18 datafusion:vortex-compact +15.1% +5.8% +8.8% +12.7% ➖ noise
18 datafusion:vortex-file-compressed +15.6% +5.8% +9.2% +12.7% ➖ noise
18 duckdb:duckdb +5.5% +5.8% -0.3% +12.7% ➖ noise
18 duckdb:vortex-compact +10.0% +5.8% +3.9% +12.7% ➖ noise
18 duckdb:vortex-file-compressed +8.7% +5.8% +2.7% +12.7% ➖ noise
19 datafusion:arrow +10.0% -7.9% +19.4% +13.3% 🚨 regression
19 datafusion:vortex-compact +7.7% -7.9% +16.9% +12.7% 🚨 regression
19 datafusion:vortex-file-compressed +5.3% -7.9% +14.3% +12.9% 🚨 regression
19 duckdb:duckdb +7.5% -7.9% +16.7% +14.6% 🚨 regression
19 duckdb:vortex-compact +10.1% -7.9% +19.5% +13.9% 🚨 regression
19 duckdb:vortex-file-compressed +9.5% -7.9% +18.9% +13.5% 🚨 regression
20 datafusion:arrow +17.9% +4.2% +13.1% +12.7% 🚨 regression
20 datafusion:vortex-compact +13.6% +4.2% +9.0% +12.7% ➖ noise
20 datafusion:vortex-file-compressed +10.3% +4.2% +5.8% +12.7% ➖ noise
20 duckdb:duckdb +1.9% +4.2% -2.2% +12.7% ➖ noise
20 duckdb:vortex-compact +9.2% +4.2% +4.7% +12.7% ➖ noise
20 duckdb:vortex-file-compressed +15.9% +4.2% +11.2% +12.7% ➖ noise
21 datafusion:arrow +9.1% +6.8% +2.1% +12.7% ➖ noise
21 datafusion:vortex-compact +15.7% +6.8% +8.3% +12.7% ➖ noise
21 datafusion:vortex-file-compressed +16.4% +6.8% +9.0% +12.7% ➖ noise
21 duckdb:duckdb +7.3% +6.8% +0.5% +12.7% ➖ noise
21 duckdb:vortex-compact +10.2% +6.8% +3.2% +12.7% ➖ noise
21 duckdb:vortex-file-compressed +16.6% +6.8% +9.1% +12.7% ➖ noise
22 datafusion:arrow +5.4% +5.8% -0.4% +12.7% ➖ noise
22 datafusion:vortex-compact +8.1% +5.8% +2.1% +12.7% ➖ noise
22 datafusion:vortex-file-compressed +18.0% +5.8% +11.5% +12.7% ➖ noise
22 duckdb:duckdb +5.5% +5.8% -0.3% +12.7% ➖ noise
22 duckdb:vortex-compact +7.4% +5.8% +1.5% +12.7% ➖ noise
22 duckdb:vortex-file-compressed +14.5% +5.8% +8.2% +12.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 1.004x ➖
Shifts: Parquet (control) +0.4% · Median polish +0.4%


datafusion / vortex-file-compressed (1.004x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 28506044 27933472 1.02
tpcds_q02/datafusion:vortex-file-compressed 52500427 51824517 1.01
tpcds_q03/datafusion:vortex-file-compressed 20499051 20240562 1.01
tpcds_q04/datafusion:vortex-file-compressed 290119263 283374572 1.02
tpcds_q05/datafusion:vortex-file-compressed 53155658 52435718 1.01
tpcds_q06/datafusion:vortex-file-compressed 49742000 49221066 1.01
tpcds_q07/datafusion:vortex-file-compressed 51358699 48284421 1.06
tpcds_q08/datafusion:vortex-file-compressed 35078334 35427352 0.99
tpcds_q09/datafusion:vortex-file-compressed 57350782 55119086 1.04
tpcds_q10/datafusion:vortex-file-compressed 44262362 44199498 1.00
tpcds_q11/datafusion:vortex-file-compressed 164551444 165086987 1.00
tpcds_q12/datafusion:vortex-file-compressed 22084811 22618102 0.98
tpcds_q13/datafusion:vortex-file-compressed 53684526 55407346 0.97
tpcds_q14/datafusion:vortex-file-compressed 194474802 197084573 0.99
tpcds_q15/datafusion:vortex-file-compressed 35312465 34445804 1.03
tpcds_q16/datafusion:vortex-file-compressed 28611588 28473714 1.00
tpcds_q17/datafusion:vortex-file-compressed 64326153 63699045 1.01
tpcds_q18/datafusion:vortex-file-compressed 78698617 75488492 1.04
tpcds_q19/datafusion:vortex-file-compressed 29717015 29555529 1.01
tpcds_q20/datafusion:vortex-file-compressed 25350049 25113412 1.01
tpcds_q21/datafusion:vortex-file-compressed 137903770 138661723 0.99
tpcds_q22/datafusion:vortex-file-compressed 55823828 57350107 0.97
tpcds_q23/datafusion:vortex-file-compressed 144797591 144627440 1.00
tpcds_q24/datafusion:vortex-file-compressed 110436484 108482834 1.02
tpcds_q25/datafusion:vortex-file-compressed 65404454 65399608 1.00
tpcds_q26/datafusion:vortex-file-compressed 35693991 35574875 1.00
tpcds_q27/datafusion:vortex-file-compressed 117337291 116601805 1.01
tpcds_q28/datafusion:vortex-file-compressed 48869351 48295385 1.01
tpcds_q29/datafusion:vortex-file-compressed 64876189 65736770 0.99
tpcds_q30/datafusion:vortex-file-compressed 28779492 30209517 0.95
tpcds_q31/datafusion:vortex-file-compressed 91343512 90907625 1.00
tpcds_q32/datafusion:vortex-file-compressed 21560101 21599603 1.00
tpcds_q33/datafusion:vortex-file-compressed 37796695 36959899 1.02
tpcds_q34/datafusion:vortex-file-compressed 29397557 29932772 0.98
tpcds_q35/datafusion:vortex-file-compressed 53372905 53310364 1.00
tpcds_q36/datafusion:vortex-file-compressed 75621025 76126085 0.99
tpcds_q37/datafusion:vortex-file-compressed 32921711 34649007 0.95
tpcds_q38/datafusion:vortex-file-compressed 49593106 52645262 0.94
tpcds_q39/datafusion:vortex-file-compressed 138519643 134456224 1.03
tpcds_q40/datafusion:vortex-file-compressed 49694355 49976882 0.99
tpcds_q41/datafusion:vortex-file-compressed 18399679 17837045 1.03
tpcds_q42/datafusion:vortex-file-compressed 18230796 19097016 0.95
tpcds_q43/datafusion:vortex-file-compressed 31530664 31594462 1.00
tpcds_q44/datafusion:vortex-file-compressed 40295985 39815642 1.01
tpcds_q45/datafusion:vortex-file-compressed 33637781 33808588 0.99
tpcds_q46/datafusion:vortex-file-compressed 45198565 46286216 0.98
tpcds_q47/datafusion:vortex-file-compressed 200757221 201432649 1.00
tpcds_q48/datafusion:vortex-file-compressed 44893995 43822913 1.02
tpcds_q49/datafusion:vortex-file-compressed 68431686 67080994 1.02
tpcds_q50/datafusion:vortex-file-compressed 43958221 44878487 0.98
tpcds_q51/datafusion:vortex-file-compressed 87263980 90540188 0.96
tpcds_q52/datafusion:vortex-file-compressed 19029885 18807562 1.01
tpcds_q53/datafusion:vortex-file-compressed 25201415 24730851 1.02
tpcds_q54/datafusion:vortex-file-compressed 42391369 41685445 1.02
tpcds_q55/datafusion:vortex-file-compressed 17535849 18014658 0.97
tpcds_q56/datafusion:vortex-file-compressed 38891784 40511100 0.96
tpcds_q57/datafusion:vortex-file-compressed 125052046 127706874 0.98
tpcds_q58/datafusion:vortex-file-compressed 68650587 68036529 1.01
tpcds_q59/datafusion:vortex-file-compressed 70522272 70002262 1.01
tpcds_q60/datafusion:vortex-file-compressed 39210310 40445718 0.97
tpcds_q61/datafusion:vortex-file-compressed 49376579 50162992 0.98
tpcds_q62/datafusion:vortex-file-compressed 30801511 31086718 0.99
tpcds_q63/datafusion:vortex-file-compressed 26136684 25473630 1.03
tpcds_q64/datafusion:vortex-file-compressed 467067524 455119500 1.03
tpcds_q65/datafusion:vortex-file-compressed 47666800 48329229 0.99
tpcds_q66/datafusion:vortex-file-compressed 89610541 93618768 0.96
tpcds_q67/datafusion:vortex-file-compressed 116955351 116743833 1.00
tpcds_q68/datafusion:vortex-file-compressed 42383612 44452813 0.95
tpcds_q69/datafusion:vortex-file-compressed 39797372 42955301 0.93
tpcds_q70/datafusion:vortex-file-compressed 112593145 109405618 1.03
tpcds_q71/datafusion:vortex-file-compressed 31759782 29712338 1.07
tpcds_q72/datafusion:vortex-file-compressed 2574667942 2545265006 1.01
tpcds_q73/datafusion:vortex-file-compressed 32097929 32171169 1.00
tpcds_q74/datafusion:vortex-file-compressed 114108925 111585604 1.02
tpcds_q75/datafusion:vortex-file-compressed 118792555 117638335 1.01
tpcds_q76/datafusion:vortex-file-compressed 32778617 32023510 1.02
tpcds_q77/datafusion:vortex-file-compressed 50348335 51194726 0.98
tpcds_q78/datafusion:vortex-file-compressed 123582202 123481208 1.00
tpcds_q79/datafusion:vortex-file-compressed 37571246 35859012 1.05
tpcds_q80/datafusion:vortex-file-compressed 113549458 111003932 1.02
tpcds_q81/datafusion:vortex-file-compressed 36469974 33605743 1.09
tpcds_q82/datafusion:vortex-file-compressed 35075598 34008709 1.03
tpcds_q83/datafusion:vortex-file-compressed 51308203 49102918 1.04
tpcds_q84/datafusion:vortex-file-compressed 15646074 15366882 1.02
tpcds_q85/datafusion:vortex-file-compressed 101587869 101254977 1.00
tpcds_q86/datafusion:vortex-file-compressed 19094391 18313847 1.04
tpcds_q87/datafusion:vortex-file-compressed 52730822 50826852 1.04
tpcds_q88/datafusion:vortex-file-compressed 68261987 66181593 1.03
tpcds_q89/datafusion:vortex-file-compressed 36550923 35373022 1.03
tpcds_q90/datafusion:vortex-file-compressed 18198863 17710121 1.03
tpcds_q91/datafusion:vortex-file-compressed 25681888 25132759 1.02
tpcds_q92/datafusion:vortex-file-compressed 18392555 18324864 1.00
tpcds_q93/datafusion:vortex-file-compressed 34126149 33306706 1.02
tpcds_q94/datafusion:vortex-file-compressed 23800013 23728265 1.00
tpcds_q95/datafusion:vortex-file-compressed 59401597 60459370 0.98
tpcds_q96/datafusion:vortex-file-compressed 15077954 15513170 0.97
tpcds_q97/datafusion:vortex-file-compressed 29210233 29152838 1.00
tpcds_q98/datafusion:vortex-file-compressed 32427326 32255696 1.01
tpcds_q99/datafusion:vortex-file-compressed 46580322 45881644 1.02
datafusion / vortex-compact (1.008x ➖, 0↑ 1↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 37363942 34810110 1.07
tpcds_q02/datafusion:vortex-compact 60746889 59820700 1.02
tpcds_q03/datafusion:vortex-compact 27721409 26278398 1.05
tpcds_q04/datafusion:vortex-compact 325297080 324607887 1.00
tpcds_q05/datafusion:vortex-compact 64581091 69455678 0.93
tpcds_q06/datafusion:vortex-compact 57596118 55384845 1.04
tpcds_q07/datafusion:vortex-compact 65159001 62807317 1.04
tpcds_q08/datafusion:vortex-compact 44833657 45732489 0.98
tpcds_q09/datafusion:vortex-compact 72179513 72774399 0.99
tpcds_q10/datafusion:vortex-compact 65642926 64514855 1.02
tpcds_q11/datafusion:vortex-compact 192600215 187085800 1.03
tpcds_q12/datafusion:vortex-compact 27312271 27386576 1.00
tpcds_q13/datafusion:vortex-compact 121709130 127066673 0.96
tpcds_q14/datafusion:vortex-compact 255131274 256946219 0.99
tpcds_q15/datafusion:vortex-compact 38687482 38288940 1.01
tpcds_q16/datafusion:vortex-compact 38944374 37970959 1.03
tpcds_q17/datafusion:vortex-compact 92491531 91407563 1.01
tpcds_q18/datafusion:vortex-compact 89394952 87084896 1.03
tpcds_q19/datafusion:vortex-compact 44251405 43599209 1.01
tpcds_q20/datafusion:vortex-compact 30736161 30432257 1.01
tpcds_q21/datafusion:vortex-compact 141661171 141661614 1.00
tpcds_q22/datafusion:vortex-compact 64451177 63330868 1.02
tpcds_q23/datafusion:vortex-compact 182173560 181460358 1.00
tpcds_q24/datafusion:vortex-compact 141110334 137615148 1.03
tpcds_q25/datafusion:vortex-compact 95182672 96286398 0.99
tpcds_q26/datafusion:vortex-compact 45984542 45147461 1.02
tpcds_q27/datafusion:vortex-compact 157272876 152752869 1.03
tpcds_q28/datafusion:vortex-compact 86483969 85475648 1.01
tpcds_q29/datafusion:vortex-compact 94091363 93192442 1.01
tpcds_q30/datafusion:vortex-compact 35176695 34775281 1.01
tpcds_q31/datafusion:vortex-compact 134390973 135179963 0.99
tpcds_q32/datafusion:vortex-compact 27103916 26024381 1.04
tpcds_q33/datafusion:vortex-compact 54213858 53727590 1.01
tpcds_q34/datafusion:vortex-compact 49108288 49507208 0.99
tpcds_q35/datafusion:vortex-compact 70299318 69952333 1.00
tpcds_q36/datafusion:vortex-compact 102977932 100029002 1.03
tpcds_q37/datafusion:vortex-compact 47177377 46628173 1.01
tpcds_q38/datafusion:vortex-compact 69732992 69954403 1.00
tpcds_q39/datafusion:vortex-compact 139647458 151692850 0.92
tpcds_q40/datafusion:vortex-compact 56021376 58973134 0.95
tpcds_q41/datafusion:vortex-compact 🚨 22307694 19808640 1.13
tpcds_q42/datafusion:vortex-compact 25111468 24443581 1.03
tpcds_q43/datafusion:vortex-compact 38868485 38292548 1.02
tpcds_q44/datafusion:vortex-compact 73291187 72304792 1.01
tpcds_q45/datafusion:vortex-compact 39143810 38466683 1.02
tpcds_q46/datafusion:vortex-compact 70528928 70248492 1.00
tpcds_q47/datafusion:vortex-compact 230288191 229189303 1.00
tpcds_q48/datafusion:vortex-compact 89861829 91548125 0.98
tpcds_q49/datafusion:vortex-compact 89817879 90135449 1.00
tpcds_q50/datafusion:vortex-compact 64877038 63836211 1.02
tpcds_q51/datafusion:vortex-compact 98599308 98222884 1.00
tpcds_q52/datafusion:vortex-compact 25575040 25972336 0.98
tpcds_q53/datafusion:vortex-compact 36117842 36036663 1.00
tpcds_q54/datafusion:vortex-compact 60628584 59860509 1.01
tpcds_q55/datafusion:vortex-compact 24498504 23870936 1.03
tpcds_q56/datafusion:vortex-compact 56538690 55089368 1.03
tpcds_q57/datafusion:vortex-compact 137545687 138586995 0.99
tpcds_q58/datafusion:vortex-compact 79426860 80332852 0.99
tpcds_q59/datafusion:vortex-compact 85535555 85041980 1.01
tpcds_q60/datafusion:vortex-compact 56357284 56940861 0.99
tpcds_q61/datafusion:vortex-compact 73655413 73308492 1.00
tpcds_q62/datafusion:vortex-compact 33694315 33294731 1.01
tpcds_q63/datafusion:vortex-compact 36620968 35980847 1.02
tpcds_q64/datafusion:vortex-compact 533679082 533424102 1.00
tpcds_q65/datafusion:vortex-compact 71731088 69628082 1.03
tpcds_q66/datafusion:vortex-compact 98924084 96144957 1.03
tpcds_q67/datafusion:vortex-compact 126323263 122828042 1.03
tpcds_q68/datafusion:vortex-compact 70091486 69153802 1.01
tpcds_q69/datafusion:vortex-compact 61250050 60631068 1.01
tpcds_q70/datafusion:vortex-compact 123132429 124855082 0.99
tpcds_q71/datafusion:vortex-compact 47516174 48857043 0.97
tpcds_q72/datafusion:vortex-compact 2625053928 2568152048 1.02
tpcds_q73/datafusion:vortex-compact 51209034 51917944 0.99
tpcds_q74/datafusion:vortex-compact 135567885 135815576 1.00
tpcds_q75/datafusion:vortex-compact 159927356 161854693 0.99
tpcds_q76/datafusion:vortex-compact 50828864 50095106 1.01
tpcds_q77/datafusion:vortex-compact 67385759 65895153 1.02
tpcds_q78/datafusion:vortex-compact 150065130 148294418 1.01
tpcds_q79/datafusion:vortex-compact 59917395 60642199 0.99
tpcds_q80/datafusion:vortex-compact 130565253 132782790 0.98
tpcds_q81/datafusion:vortex-compact 42206721 41689739 1.01
tpcds_q82/datafusion:vortex-compact 48031980 47974940 1.00
tpcds_q83/datafusion:vortex-compact 58707010 56158137 1.05
tpcds_q84/datafusion:vortex-compact 17831587 17934052 0.99
tpcds_q85/datafusion:vortex-compact 126936933 124932075 1.02
tpcds_q86/datafusion:vortex-compact 23582803 22356728 1.05
tpcds_q87/datafusion:vortex-compact 71589836 70388836 1.02
tpcds_q88/datafusion:vortex-compact 137748986 139120856 0.99
tpcds_q89/datafusion:vortex-compact 46499996 44778141 1.04
tpcds_q90/datafusion:vortex-compact 24391242 24528286 0.99
tpcds_q91/datafusion:vortex-compact 40363494 39882263 1.01
tpcds_q92/datafusion:vortex-compact 25789242 25613766 1.01
tpcds_q93/datafusion:vortex-compact 45170753 44546559 1.01
tpcds_q94/datafusion:vortex-compact 30450321 31086092 0.98
tpcds_q95/datafusion:vortex-compact 70255916 70060236 1.00
tpcds_q96/datafusion:vortex-compact 26474146 26847302 0.99
tpcds_q97/datafusion:vortex-compact 42389071 43572335 0.97
tpcds_q98/datafusion:vortex-compact 39384006 37209355 1.06
tpcds_q99/datafusion:vortex-compact 50433279 48986211 1.03
datafusion / parquet (1.006x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 36586539 37523769 0.98
tpcds_q02/datafusion:parquet 45739238 46978534 0.97
tpcds_q03/datafusion:parquet 14395570 15697406 0.92
tpcds_q04/datafusion:parquet 308382359 313663765 0.98
tpcds_q05/datafusion:parquet 49901579 49789016 1.00
tpcds_q06/datafusion:parquet 65909101 64975959 1.01
tpcds_q07/datafusion:parquet 90732814 89910250 1.01
tpcds_q08/datafusion:parquet 33708391 32447246 1.04
tpcds_q09/datafusion:parquet 58202137 56033213 1.04
tpcds_q10/datafusion:parquet 84108530 80562079 1.04
tpcds_q11/datafusion:parquet 179571254 183401921 0.98
tpcds_q12/datafusion:parquet 22743678 22828885 1.00
tpcds_q13/datafusion:parquet 85725094 86650463 0.99
tpcds_q14/datafusion:parquet 190893815 193746594 0.99
tpcds_q15/datafusion:parquet 26209085 26424578 0.99
tpcds_q16/datafusion:parquet 28409645 27333178 1.04
tpcds_q17/datafusion:parquet 68891515 66853777 1.03
tpcds_q18/datafusion:parquet 129102787 128739352 1.00
tpcds_q19/datafusion:parquet 28152155 27118979 1.04
tpcds_q20/datafusion:parquet 20863466 20065265 1.04
tpcds_q21/datafusion:parquet 21896615 21859203 1.00
tpcds_q22/datafusion:parquet 138318181 129473073 1.07
tpcds_q23/datafusion:parquet 163839593 161816864 1.01
tpcds_q24/datafusion:parquet 103283385 104015216 0.99
tpcds_q25/datafusion:parquet 69135646 71260283 0.97
tpcds_q26/datafusion:parquet 75021810 73919942 1.01
tpcds_q27/datafusion:parquet 159313276 160748688 0.99
tpcds_q28/datafusion:parquet 48511077 48642378 1.00
tpcds_q29/datafusion:parquet 71637279 70832367 1.01
tpcds_q30/datafusion:parquet 43890075 44322259 0.99
tpcds_q31/datafusion:parquet 75395083 73244322 1.03
tpcds_q32/datafusion:parquet 21375071 22350380 0.96
tpcds_q33/datafusion:parquet 34781189 34959903 0.99
tpcds_q34/datafusion:parquet 27778988 25812749 1.08
tpcds_q35/datafusion:parquet 81368965 82811834 0.98
tpcds_q36/datafusion:parquet 63138878 62736571 1.01
tpcds_q37/datafusion:parquet 23129888 23567298 0.98
tpcds_q38/datafusion:parquet 49847131 48993206 1.02
tpcds_q39/datafusion:parquet 81298538 80576534 1.01
tpcds_q40/datafusion:parquet 28040597 26983468 1.04
tpcds_q41/datafusion:parquet 15260851 14957762 1.02
tpcds_q42/datafusion:parquet 13287083 13595880 0.98
tpcds_q43/datafusion:parquet 18762326 18764199 1.00
tpcds_q44/datafusion:parquet 40430985 40541169 1.00
tpcds_q45/datafusion:parquet 31625595 32346214 0.98
tpcds_q46/datafusion:parquet 37859706 38458860 0.98
tpcds_q47/datafusion:parquet 132895505 132933051 1.00
tpcds_q48/datafusion:parquet 77173762 78034960 0.99
tpcds_q49/datafusion:parquet 63264512 64881981 0.98
tpcds_q50/datafusion:parquet 46911826 47473444 0.99
tpcds_q51/datafusion:parquet 86769917 90416185 0.96
tpcds_q52/datafusion:parquet 14572644 13889344 1.05
tpcds_q53/datafusion:parquet 21792284 20743185 1.05
tpcds_q54/datafusion:parquet 43603670 42392189 1.03
tpcds_q55/datafusion:parquet 13660850 14194772 0.96
tpcds_q56/datafusion:parquet 35817716 34656370 1.03
tpcds_q57/datafusion:parquet 112591397 103760399 1.09
tpcds_q58/datafusion:parquet 57018675 57896254 0.98
tpcds_q59/datafusion:parquet 57535032 57835744 0.99
tpcds_q60/datafusion:parquet 34704257 33533412 1.03
tpcds_q61/datafusion:parquet 50511979 50174416 1.01
tpcds_q62/datafusion:parquet 28211745 27651036 1.02
tpcds_q63/datafusion:parquet 21842279 21420165 1.02
tpcds_q64/datafusion:parquet 544752781 543368518 1.00
tpcds_q65/datafusion:parquet 43581511 44597293 0.98
tpcds_q66/datafusion:parquet 74901166 76160026 0.98
tpcds_q67/datafusion:parquet 151373606 148195532 1.02
tpcds_q68/datafusion:parquet 36769708 37635469 0.98
tpcds_q69/datafusion:parquet 79280891 76631881 1.03
tpcds_q70/datafusion:parquet 94195014 98988823 0.95
tpcds_q71/datafusion:parquet 25427939 25943074 0.98
tpcds_q72/datafusion:parquet 631080998 648425031 0.97
tpcds_q73/datafusion:parquet 26059454 23989615 1.09
tpcds_q74/datafusion:parquet 101903370 106415983 0.96
tpcds_q75/datafusion:parquet 115806873 115596316 1.00
tpcds_q76/datafusion:parquet 34747876 34251402 1.01
tpcds_q77/datafusion:parquet 51055208 50129337 1.02
tpcds_q78/datafusion:parquet 123421786 121839586 1.01
tpcds_q79/datafusion:parquet 32347454 30318934 1.07
tpcds_q80/datafusion:parquet 91804088 94074891 0.98
tpcds_q81/datafusion:parquet 42712345 39826042 1.07
tpcds_q82/datafusion:parquet 23098293 23526286 0.98
tpcds_q83/datafusion:parquet 47778933 47197335 1.01
tpcds_q84/datafusion:parquet 47974028 47349717 1.01
tpcds_q85/datafusion:parquet 171841778 169944154 1.01
tpcds_q86/datafusion:parquet 18476398 17879817 1.03
tpcds_q87/datafusion:parquet 50718100 49684738 1.02
tpcds_q88/datafusion:parquet 69448543 68182653 1.02
tpcds_q89/datafusion:parquet 24045658 24604483 0.98
tpcds_q90/datafusion:parquet 18709513 17742564 1.05
tpcds_q91/datafusion:parquet 69753847 67087276 1.04
tpcds_q92/datafusion:parquet 21689860 21803953 0.99
tpcds_q93/datafusion:parquet 35243212 35045419 1.01
tpcds_q94/datafusion:parquet 24085396 24754677 0.97
tpcds_q95/datafusion:parquet 66670630 67273863 0.99
tpcds_q96/datafusion:parquet 13879907 13637057 1.02
tpcds_q97/datafusion:parquet 33136105 33358006 0.99
tpcds_q98/datafusion:parquet 24891239 25626574 0.97
tpcds_q99/datafusion:parquet 28278251 27212626 1.04
duckdb / vortex-file-compressed (1.007x ➖, 0↑ 2↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21798908 21731453 1.00
tpcds_q02/duckdb:vortex-file-compressed 50989547 49972323 1.02
tpcds_q03/duckdb:vortex-file-compressed 32253029 30708647 1.05
tpcds_q04/duckdb:vortex-file-compressed 101392447 96950881 1.05
tpcds_q05/duckdb:vortex-file-compressed 34490160 35459321 0.97
tpcds_q06/duckdb:vortex-file-compressed 33684190 34569595 0.97
tpcds_q07/duckdb:vortex-file-compressed 22517858 22572809 1.00
tpcds_q08/duckdb:vortex-file-compressed 25774359 25051226 1.03
tpcds_q09/duckdb:vortex-file-compressed 38373756 37373542 1.03
tpcds_q10/duckdb:vortex-file-compressed 35718919 34732503 1.03
tpcds_q11/duckdb:vortex-file-compressed 60242048 56362489 1.07
tpcds_q12/duckdb:vortex-file-compressed 14713043 14628724 1.01
tpcds_q13/duckdb:vortex-file-compressed 31870068 32912932 0.97
tpcds_q14/duckdb:vortex-file-compressed 113681167 111581325 1.02
tpcds_q15/duckdb:vortex-file-compressed 40407510 40153475 1.01
tpcds_q16/duckdb:vortex-file-compressed 29260305 28862182 1.01
tpcds_q17/duckdb:vortex-file-compressed 35330658 35418656 1.00
tpcds_q18/duckdb:vortex-file-compressed 44072919 44409839 0.99
tpcds_q19/duckdb:vortex-file-compressed 32816911 32591180 1.01
tpcds_q20/duckdb:vortex-file-compressed 15947308 16123905 0.99
tpcds_q21/duckdb:vortex-file-compressed 19324044 19983746 0.97
tpcds_q22/duckdb:vortex-file-compressed 106351710 102543516 1.04
tpcds_q23/duckdb:vortex-file-compressed 106479298 103760972 1.03
tpcds_q24/duckdb:vortex-file-compressed 52675445 53285672 0.99
tpcds_q25/duckdb:vortex-file-compressed 36349021 35084788 1.04
tpcds_q26/duckdb:vortex-file-compressed 37732172 37961634 0.99
tpcds_q27/duckdb:vortex-file-compressed 53689419 50202041 1.07
tpcds_q28/duckdb:vortex-file-compressed 37816327 37101342 1.02
tpcds_q29/duckdb:vortex-file-compressed 34041778 34616458 0.98
tpcds_q30/duckdb:vortex-file-compressed 25607017 25404228 1.01
tpcds_q31/duckdb:vortex-file-compressed 33122124 32318618 1.02
tpcds_q32/duckdb:vortex-file-compressed 17510650 16960876 1.03
tpcds_q33/duckdb:vortex-file-compressed 23552717 22578383 1.04
tpcds_q34/duckdb:vortex-file-compressed 18358542 19251441 0.95
tpcds_q35/duckdb:vortex-file-compressed 63690308 61737000 1.03
tpcds_q36/duckdb:vortex-file-compressed 27521521 27032797 1.02
tpcds_q37/duckdb:vortex-file-compressed 21667005 21587849 1.00
tpcds_q38/duckdb:vortex-file-compressed 37217851 37048391 1.00
tpcds_q39/duckdb:vortex-file-compressed 🚨 46919358 42551886 1.10
tpcds_q40/duckdb:vortex-file-compressed 23572838 23344522 1.01
tpcds_q41/duckdb:vortex-file-compressed 13894720 13800448 1.01
tpcds_q42/duckdb:vortex-file-compressed 12314927 12331474 1.00
tpcds_q43/duckdb:vortex-file-compressed 30269123 30155290 1.00
tpcds_q44/duckdb:vortex-file-compressed 21747776 22270670 0.98
tpcds_q45/duckdb:vortex-file-compressed 26700092 27569067 0.97
tpcds_q46/duckdb:vortex-file-compressed 45943276 45391765 1.01
tpcds_q47/duckdb:vortex-file-compressed 50840035 50393037 1.01
tpcds_q48/duckdb:vortex-file-compressed 29759241 30993212 0.96
tpcds_q49/duckdb:vortex-file-compressed 31349055 30335730 1.03
tpcds_q50/duckdb:vortex-file-compressed 35884303 34483106 1.04
tpcds_q51/duckdb:vortex-file-compressed 108925501 100846078 1.08
tpcds_q52/duckdb:vortex-file-compressed 12475694 12575447 0.99
tpcds_q53/duckdb:vortex-file-compressed 19951275 19157274 1.04
tpcds_q54/duckdb:vortex-file-compressed 30051395 29494499 1.02
tpcds_q55/duckdb:vortex-file-compressed 12374877 12424664 1.00
tpcds_q56/duckdb:vortex-file-compressed 23202939 23311302 1.00
tpcds_q57/duckdb:vortex-file-compressed 48598543 45054259 1.08
tpcds_q58/duckdb:vortex-file-compressed 30853029 31157796 0.99
tpcds_q59/duckdb:vortex-file-compressed 76979217 78853604 0.98
tpcds_q60/duckdb:vortex-file-compressed 25516342 24865110 1.03
tpcds_q61/duckdb:vortex-file-compressed 37470480 37324100 1.00
tpcds_q62/duckdb:vortex-file-compressed 18641744 17135610 1.09
tpcds_q63/duckdb:vortex-file-compressed 20273718 20240155 1.00
tpcds_q64/duckdb:vortex-file-compressed 80874559 80635001 1.00
tpcds_q65/duckdb:vortex-file-compressed 23914144 23758972 1.01
tpcds_q66/duckdb:vortex-file-compressed 33871917 34107638 0.99
tpcds_q67/duckdb:vortex-file-compressed 137352458 142102380 0.97
tpcds_q68/duckdb:vortex-file-compressed 40043172 39649117 1.01
tpcds_q69/duckdb:vortex-file-compressed 37457634 38320077 0.98
tpcds_q70/duckdb:vortex-file-compressed 28034158 26199553 1.07
tpcds_q71/duckdb:vortex-file-compressed 20593700 20210389 1.02
tpcds_q72/duckdb:vortex-file-compressed 171591847 172179893 1.00
tpcds_q73/duckdb:vortex-file-compressed 18341600 19192844 0.96
tpcds_q74/duckdb:vortex-file-compressed 62893582 63934790 0.98
tpcds_q75/duckdb:vortex-file-compressed 56339234 58285121 0.97
tpcds_q76/duckdb:vortex-file-compressed 20811614 22239731 0.94
tpcds_q77/duckdb:vortex-file-compressed 28604284 26184001 1.09
tpcds_q78/duckdb:vortex-file-compressed 75488128 76526092 0.99
tpcds_q79/duckdb:vortex-file-compressed 34553631 34612742 1.00
tpcds_q80/duckdb:vortex-file-compressed 49211096 52335570 0.94
tpcds_q81/duckdb:vortex-file-compressed 31229961 29734314 1.05
tpcds_q82/duckdb:vortex-file-compressed 21934763 22330490 0.98
tpcds_q83/duckdb:vortex-file-compressed 29047013 29638288 0.98
tpcds_q84/duckdb:vortex-file-compressed 17852861 17162127 1.04
tpcds_q85/duckdb:vortex-file-compressed 46259500 46364168 1.00
tpcds_q86/duckdb:vortex-file-compressed 18548317 17350831 1.07
tpcds_q87/duckdb:vortex-file-compressed 37209889 39398186 0.94
tpcds_q88/duckdb:vortex-file-compressed 35131873 36506094 0.96
tpcds_q89/duckdb:vortex-file-compressed 19579226 19189161 1.02
tpcds_q90/duckdb:vortex-file-compressed 13499897 14202484 0.95
tpcds_q91/duckdb:vortex-file-compressed 29961077 30511201 0.98
tpcds_q92/duckdb:vortex-file-compressed 14707422 14358358 1.02
tpcds_q93/duckdb:vortex-file-compressed 🚨 28394337 25324544 1.12
tpcds_q94/duckdb:vortex-file-compressed 20794012 22653855 0.92
tpcds_q95/duckdb:vortex-file-compressed 147900574 148351407 1.00
tpcds_q96/duckdb:vortex-file-compressed 10797006 10154456 1.06
tpcds_q97/duckdb:vortex-file-compressed 37047544 37896411 0.98
tpcds_q98/duckdb:vortex-file-compressed 17479448 17689412 0.99
tpcds_q99/duckdb:vortex-file-compressed 31361709 33282713 0.94
duckdb / vortex-compact (1.000x ➖, 1↑ 0↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 24763622 24507690 1.01
tpcds_q02/duckdb:vortex-compact 57040488 57124885 1.00
tpcds_q03/duckdb:vortex-compact 57266470 56679512 1.01
tpcds_q04/duckdb:vortex-compact 111330627 104410736 1.07
tpcds_q05/duckdb:vortex-compact 37052196 38041935 0.97
tpcds_q06/duckdb:vortex-compact 38189136 37504461 1.02
tpcds_q07/duckdb:vortex-compact 36110458 34717374 1.04
tpcds_q08/duckdb:vortex-compact 35259602 33456397 1.05
tpcds_q09/duckdb:vortex-compact 57097915 57927837 0.99
tpcds_q10/duckdb:vortex-compact 47140636 47739880 0.99
tpcds_q11/duckdb:vortex-compact 62545243 64003339 0.98
tpcds_q12/duckdb:vortex-compact 18868506 20493355 0.92
tpcds_q13/duckdb:vortex-compact 48642047 49271517 0.99
tpcds_q14/duckdb:vortex-compact 120971361 119765160 1.01
tpcds_q15/duckdb:vortex-compact 45657093 44499127 1.03
tpcds_q16/duckdb:vortex-compact 34476169 34323324 1.00
tpcds_q17/duckdb:vortex-compact 46061958 48224419 0.96
tpcds_q18/duckdb:vortex-compact 57064626 56595699 1.01
tpcds_q19/duckdb:vortex-compact 39626852 38780887 1.02
tpcds_q20/duckdb:vortex-compact 20337617 20218715 1.01
tpcds_q21/duckdb:vortex-compact 27771854 28603467 0.97
tpcds_q22/duckdb:vortex-compact 110544869 111811344 0.99
tpcds_q23/duckdb:vortex-compact 106551230 103586920 1.03
tpcds_q24/duckdb:vortex-compact 64935405 66164424 0.98
tpcds_q25/duckdb:vortex-compact 47829167 48950397 0.98
tpcds_q26/duckdb:vortex-compact 49515782 48036550 1.03
tpcds_q27/duckdb:vortex-compact 62776652 66011719 0.95
tpcds_q28/duckdb:vortex-compact 86572168 83614321 1.04
tpcds_q29/duckdb:vortex-compact 47931592 45914659 1.04
tpcds_q30/duckdb:vortex-compact 29770566 29593844 1.01
tpcds_q31/duckdb:vortex-compact 34727739 34247179 1.01
tpcds_q32/duckdb:vortex-compact 23185094 23179344 1.00
tpcds_q33/duckdb:vortex-compact 30907142 30734075 1.01
tpcds_q34/duckdb:vortex-compact 25637094 25510923 1.00
tpcds_q35/duckdb:vortex-compact 68427006 67312541 1.02
tpcds_q36/duckdb:vortex-compact 34319753 34709523 0.99
tpcds_q37/duckdb:vortex-compact 32225147 31293367 1.03
tpcds_q38/duckdb:vortex-compact 41330300 38748737 1.07
tpcds_q39/duckdb:vortex-compact 52851771 55708270 0.95
tpcds_q40/duckdb:vortex-compact 29545772 28812103 1.03
tpcds_q41/duckdb:vortex-compact 17006273 16684583 1.02
tpcds_q42/duckdb:vortex-compact 15792022 16189900 0.98
tpcds_q43/duckdb:vortex-compact 38905717 38145535 1.02
tpcds_q44/duckdb:vortex-compact 31119410 30463653 1.02
tpcds_q45/duckdb:vortex-compact 30647842 30803396 0.99
tpcds_q46/duckdb:vortex-compact 56745951 57372907 0.99
tpcds_q47/duckdb:vortex-compact 56086977 55090508 1.02
tpcds_q48/duckdb:vortex-compact 40139374 40538984 0.99
tpcds_q49/duckdb:vortex-compact 43982091 44665154 0.98
tpcds_q50/duckdb:vortex-compact 46408919 46603423 1.00
tpcds_q51/duckdb:vortex-compact 100657997 103703134 0.97
tpcds_q52/duckdb:vortex-compact 17179692 16978634 1.01
tpcds_q53/duckdb:vortex-compact 28070043 27075619 1.04
tpcds_q54/duckdb:vortex-compact 34781439 33965600 1.02
tpcds_q55/duckdb:vortex-compact 16851150 16775764 1.00
tpcds_q56/duckdb:vortex-compact 30454089 30174787 1.01
tpcds_q57/duckdb:vortex-compact 46023294 49046663 0.94
tpcds_q58/duckdb:vortex-compact 46564584 43782192 1.06
tpcds_q59/duckdb:vortex-compact 99120777 98002760 1.01
tpcds_q60/duckdb:vortex-compact 30331607 29820909 1.02
tpcds_q61/duckdb:vortex-compact 52057500 51881063 1.00
tpcds_q62/duckdb:vortex-compact 25993088 26554973 0.98
tpcds_q63/duckdb:vortex-compact 27004478 27548122 0.98
tpcds_q64/duckdb:vortex-compact 101965267 101115001 1.01
tpcds_q65/duckdb:vortex-compact 30204927 31044899 0.97
tpcds_q66/duckdb:vortex-compact 38629875 38744839 1.00
tpcds_q67/duckdb:vortex-compact 148625389 150075749 0.99
tpcds_q68/duckdb:vortex-compact 51375581 51902064 0.99
tpcds_q69/duckdb:vortex-compact 48825362 47847147 1.02
tpcds_q70/duckdb:vortex-compact 35966394 35218380 1.02
tpcds_q71/duckdb:vortex-compact 25375913 25111447 1.01
tpcds_q72/duckdb:vortex-compact 191856318 192647735 1.00
tpcds_q73/duckdb:vortex-compact 25195367 25428671 0.99
tpcds_q74/duckdb:vortex-compact 🚀 66806300 86497294 0.77
tpcds_q75/duckdb:vortex-compact 69851600 68184332 1.02
tpcds_q76/duckdb:vortex-compact 39809420 37663285 1.06
tpcds_q77/duckdb:vortex-compact 36459859 38225639 0.95
tpcds_q78/duckdb:vortex-compact 86801235 81290171 1.07
tpcds_q79/duckdb:vortex-compact 54544807 53636461 1.02
tpcds_q80/duckdb:vortex-compact 65791424 65701237 1.00
tpcds_q81/duckdb:vortex-compact 35277082 34308644 1.03
tpcds_q82/duckdb:vortex-compact 32059522 31699723 1.01
tpcds_q83/duckdb:vortex-compact 44881091 45637365 0.98
tpcds_q84/duckdb:vortex-compact 22401724 22633738 0.99
tpcds_q85/duckdb:vortex-compact 57373992 60590722 0.95
tpcds_q86/duckdb:vortex-compact 20354721 19706644 1.03
tpcds_q87/duckdb:vortex-compact 42100793 41089520 1.02
tpcds_q88/duckdb:vortex-compact 39539954 39229903 1.01
tpcds_q89/duckdb:vortex-compact 27369141 27142082 1.01
tpcds_q90/duckdb:vortex-compact 15603680 15392862 1.01
tpcds_q91/duckdb:vortex-compact 51436809 52754229 0.98
tpcds_q92/duckdb:vortex-compact 20514760 20658517 0.99
tpcds_q93/duckdb:vortex-compact 31795068 31497012 1.01
tpcds_q94/duckdb:vortex-compact 24292169 25875992 0.94
tpcds_q95/duckdb:vortex-compact 137602038 143375556 0.96
tpcds_q96/duckdb:vortex-compact 13512209 13276508 1.02
tpcds_q97/duckdb:vortex-compact 40999951 40339828 1.02
tpcds_q98/duckdb:vortex-compact 23983442 23886364 1.00
tpcds_q99/duckdb:vortex-compact 34069016 33611170 1.01
duckdb / parquet (1.002x ➖, 1↑ 1↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 28051411 29625261 0.95
tpcds_q02/duckdb:parquet 22706889 23358113 0.97
tpcds_q03/duckdb:parquet 11315366 11264269 1.00
tpcds_q04/duckdb:parquet 166053816 168338662 0.99
tpcds_q05/duckdb:parquet 30026892 30259103 0.99
tpcds_q06/duckdb:parquet 26925490 27786000 0.97
tpcds_q07/duckdb:parquet 20613040 20522274 1.00
tpcds_q08/duckdb:parquet 26905301 26600772 1.01
tpcds_q09/duckdb:parquet 38739902 39648980 0.98
tpcds_q10/duckdb:parquet 32596265 33998940 0.96
tpcds_q11/duckdb:parquet 88430986 82100694 1.08
tpcds_q12/duckdb:parquet 14065818 14255669 0.99
tpcds_q13/duckdb:parquet 33012671 32373330 1.02
tpcds_q14/duckdb:parquet 98608725 99722681 0.99
tpcds_q15/duckdb:parquet 28193594 28777464 0.98
tpcds_q16/duckdb:parquet 20947985 21887899 0.96
tpcds_q17/duckdb:parquet 37311460 37549090 0.99
tpcds_q18/duckdb:parquet 44550548 44334391 1.00
tpcds_q19/duckdb:parquet 28714546 27880561 1.03
tpcds_q20/duckdb:parquet 15126801 15415753 0.98
tpcds_q21/duckdb:parquet 🚀 10141574 11348918 0.89
tpcds_q22/duckdb:parquet 67664194 68739095 0.98
tpcds_q23/duckdb:parquet 80234798 78180860 1.03
tpcds_q24/duckdb:parquet 44460093 42387817 1.05
tpcds_q25/duckdb:parquet 32103106 32497595 0.99
tpcds_q26/duckdb:parquet 35244382 37346273 0.94
tpcds_q27/duckdb:parquet 48699831 47819749 1.02
tpcds_q28/duckdb:parquet 38069396 37620981 1.01
tpcds_q29/duckdb:parquet 33709979 35691616 0.94
tpcds_q30/duckdb:parquet 33186296 33687044 0.99
tpcds_q31/duckdb:parquet 24033173 22875881 1.05
tpcds_q32/duckdb:parquet 11019241 11495295 0.96
tpcds_q33/duckdb:parquet 20631255 20381321 1.01
tpcds_q34/duckdb:parquet 20025197 20569892 0.97
tpcds_q35/duckdb:parquet 55143055 55571512 0.99
tpcds_q36/duckdb:parquet 19265755 19449544 0.99
tpcds_q37/duckdb:parquet 12835067 11895877 1.08
tpcds_q38/duckdb:parquet 33105847 32183503 1.03
tpcds_q39/duckdb:parquet 29047753 29471580 0.99
tpcds_q40/duckdb:parquet 17527883 17539263 1.00
tpcds_q41/duckdb:parquet 7758007 7489457 1.04
tpcds_q42/duckdb:parquet 9099765 9604199 0.95
tpcds_q43/duckdb:parquet 15815903 14806888 1.07
tpcds_q44/duckdb:parquet 21553087 21577567 1.00
tpcds_q45/duckdb:parquet 26473772 25510444 1.04
tpcds_q46/duckdb:parquet 42664088 42743389 1.00
tpcds_q47/duckdb:parquet 43835440 43917617 1.00
tpcds_q48/duckdb:parquet 28883487 28764111 1.00
tpcds_q49/duckdb:parquet 23574802 23955797 0.98
tpcds_q50/duckdb:parquet 24088530 23850395 1.01
tpcds_q51/duckdb:parquet 98015992 93549247 1.05
tpcds_q52/duckdb:parquet 10406972 10948393 0.95
tpcds_q53/duckdb:parquet 14657449 14844019 0.99
tpcds_q54/duckdb:parquet 25507106 25066135 1.02
tpcds_q55/duckdb:parquet 9853519 9620567 1.02
tpcds_q56/duckdb:parquet 20253205 20443594 0.99
tpcds_q57/duckdb:parquet 34145626 33358267 1.02
tpcds_q58/duckdb:parquet 21916621 22312188 0.98
tpcds_q59/duckdb:parquet 35599880 34583687 1.03
tpcds_q60/duckdb:parquet 21182426 21870639 0.97
tpcds_q61/duckdb:parquet 30610355 30176420 1.01
tpcds_q62/duckdb:parquet 12166288 11578257 1.05
tpcds_q63/duckdb:parquet 13714821 13620872 1.01
tpcds_q64/duckdb:parquet 73628089 73637534 1.00
tpcds_q65/duckdb:parquet 19157250 19228283 1.00
tpcds_q66/duckdb:parquet 🚨 29591067 26750637 1.11
tpcds_q67/duckdb:parquet 133021790 132810528 1.00
tpcds_q68/duckdb:parquet 35989799 35686846 1.01
tpcds_q69/duckdb:parquet 36187510 35855030 1.01
tpcds_q70/duckdb:parquet 19672829 18850866 1.04
tpcds_q71/duckdb:parquet 18989116 18215836 1.04
tpcds_q72/duckdb:parquet 164679267 162878476 1.01
tpcds_q73/duckdb:parquet 17383874 17778992 0.98
tpcds_q74/duckdb:parquet 126171853 126549752 1.00
tpcds_q75/duckdb:parquet 52699417 51380110 1.03
tpcds_q76/duckdb:parquet 19371909 19229419 1.01
tpcds_q77/duckdb:parquet 21195430 21373188 0.99
tpcds_q78/duckdb:parquet 73732116 72839982 1.01
tpcds_q79/duckdb:parquet 26917152 26963488 1.00
tpcds_q80/duckdb:parquet 39957480 41265164 0.97
tpcds_q81/duckdb:parquet 31167607 31731823 0.98
tpcds_q82/duckdb:parquet 13872637 12911270 1.07
tpcds_q83/duckdb:parquet 16302376 16672173 0.98
tpcds_q84/duckdb:parquet 18908980 18799053 1.01
tpcds_q85/duckdb:parquet 37763681 35996433 1.05
tpcds_q86/duckdb:parquet 12328060 12124511 1.02
tpcds_q87/duckdb:parquet 36509967 36555699 1.00
tpcds_q88/duckdb:parquet 48393236 48190506 1.00
tpcds_q89/duckdb:parquet 16041653 17014055 0.94
tpcds_q90/duckdb:parquet 7062012 7176188 0.98
tpcds_q91/duckdb:parquet 22652046 21434352 1.06
tpcds_q92/duckdb:parquet 11507353 10969132 1.05
tpcds_q93/duckdb:parquet 28725454 29212106 0.98
tpcds_q94/duckdb:parquet 17270904 16689264 1.03
tpcds_q95/duckdb:parquet 140743896 141295284 1.00
tpcds_q96/duckdb:parquet 8387381 8677221 0.97
tpcds_q97/duckdb:parquet 34862230 35098525 0.99
tpcds_q98/duckdb:parquet 17107492 17172608 1.00
tpcds_q99/duckdb:parquet 19120214 19304484 0.99
duckdb / duckdb (1.005x ➖, 1↑ 5↓)
name PR 6b83bac (ns) base 7e0af3c (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19871246 19627408 1.01
tpcds_q02/duckdb:duckdb 17845352 18351204 0.97
tpcds_q03/duckdb:duckdb 8115456 8150469 1.00
tpcds_q04/duckdb:duckdb 169970500 174290731 0.98
tpcds_q05/duckdb:duckdb 17676208 18295862 0.97
tpcds_q06/duckdb:duckdb 21786395 22040621 0.99
tpcds_q07/duckdb:duckdb 38202033 38029197 1.00
tpcds_q08/duckdb:duckdb 119976201 120537744 1.00
tpcds_q09/duckdb:duckdb 19341774 19521049 0.99
tpcds_q10/duckdb:duckdb 22792049 23355638 0.98
tpcds_q11/duckdb:duckdb 83735772 89950279 0.93
tpcds_q12/duckdb:duckdb 10072093 10763272 0.94
tpcds_q13/duckdb:duckdb 23245964 23309992 1.00
tpcds_q14/duckdb:duckdb 90551770 91572490 0.99
tpcds_q15/duckdb:duckdb 24294592 23939731 1.01
tpcds_q16/duckdb:duckdb 17799828 16376336 1.09
tpcds_q17/duckdb:duckdb 20890580 20759145 1.01
tpcds_q18/duckdb:duckdb 43882341 42237721 1.04
tpcds_q19/duckdb:duckdb 17303827 15886044 1.09
tpcds_q20/duckdb:duckdb 11532130 11849417 0.97
tpcds_q21/duckdb:duckdb 6387930 6320826 1.01
tpcds_q22/duckdb:duckdb 60170418 62909901 0.96
tpcds_q23/duckdb:duckdb 76565827 71764820 1.07
tpcds_q24/duckdb:duckdb 24514303 23688675 1.03
tpcds_q25/duckdb:duckdb 17554935 17768417 0.99
tpcds_q26/duckdb:duckdb 25675312 26046188 0.99
tpcds_q27/duckdb:duckdb 🚨 39052533 34499101 1.13
tpcds_q28/duckdb:duckdb 21278757 21336455 1.00
tpcds_q29/duckdb:duckdb 19626225 20445757 0.96
tpcds_q30/duckdb:duckdb 28133623 28132631 1.00
tpcds_q31/duckdb:duckdb 47941562 46299266 1.04
tpcds_q32/duckdb:duckdb 7182922 7041779 1.02
tpcds_q33/duckdb:duckdb 12108041 12275433 0.99
tpcds_q34/duckdb:duckdb 14617249 15057642 0.97
tpcds_q35/duckdb:duckdb 32248333 32297640 1.00
tpcds_q36/duckdb:duckdb 69017351 66754862 1.03
tpcds_q37/duckdb:duckdb 🚀 6458087 7271330 0.89
tpcds_q38/duckdb:duckdb 29644676 29375952 1.01
tpcds_q39/duckdb:duckdb 🚨 25944999 23569770 1.10
tpcds_q40/duckdb:duckdb 12062004 13074186 0.92
tpcds_q41/duckdb:duckdb 7472100 7981064 0.94
tpcds_q42/duckdb:duckdb 6375359 6044241 1.05
tpcds_q43/duckdb:duckdb 10883508 10939650 0.99
tpcds_q44/duckdb:duckdb 13230690 13480797 0.98
tpcds_q45/duckdb:duckdb 🚨 18162515 16250647 1.12
tpcds_q46/duckdb:duckdb 34489218 36372864 0.95
tpcds_q47/duckdb:duckdb 40243057 39761003 1.01
tpcds_q48/duckdb:duckdb 21680606 21269018 1.02
tpcds_q49/duckdb:duckdb 16985611 16303333 1.04
tpcds_q50/duckdb:duckdb 13388139 13909049 0.96
tpcds_q51/duckdb:duckdb 89851103 91011774 0.99
tpcds_q52/duckdb:duckdb 7394250 7058240 1.05
tpcds_q53/duckdb:duckdb 12799247 12421973 1.03
tpcds_q54/duckdb:duckdb 16994288 16338870 1.04
tpcds_q55/duckdb:duckdb 6744812 6309010 1.07
tpcds_q56/duckdb:duckdb 13137429 13296924 0.99
tpcds_q57/duckdb:duckdb 30656748 31557203 0.97
tpcds_q58/duckdb:duckdb 11709672 11857266 0.99
tpcds_q59/duckdb:duckdb 35156837 34999145 1.00
tpcds_q60/duckdb:duckdb 14493796 14046447 1.03
tpcds_q61/duckdb:duckdb 13360750 13850155 0.96
tpcds_q62/duckdb:duckdb 9167045 8829084 1.04
tpcds_q63/duckdb:duckdb 11853075 11659691 1.02
tpcds_q64/duckdb:duckdb 50921958 53140791 0.96
tpcds_q65/duckdb:duckdb 31326050 30682008 1.02
tpcds_q66/duckdb:duckdb 24773134 24017068 1.03
tpcds_q67/duckdb:duckdb 127807580 127609365 1.00
tpcds_q68/duckdb:duckdb 24491126 24390385 1.00
tpcds_q69/duckdb:duckdb 23475689 23354868 1.01
tpcds_q70/duckdb:duckdb 14119069 14032542 1.01
tpcds_q71/duckdb:duckdb 🚨 12395670 11235355 1.10
tpcds_q72/duckdb:duckdb 41839947 39897098 1.05
tpcds_q73/duckdb:duckdb 10416310 10578535 0.98
tpcds_q74/duckdb:duckdb 141083194 143443269 0.98
tpcds_q75/duckdb:duckdb 41472616 42025877 0.99
tpcds_q76/duckdb:duckdb 12702665 11794923 1.08
tpcds_q77/duckdb:duckdb 11743819 11506594 1.02
tpcds_q78/duckdb:duckdb 60652601 61232640 0.99
tpcds_q79/duckdb:duckdb 17374824 17554990 0.99
tpcds_q80/duckdb:duckdb 27588351 27510783 1.00
tpcds_q81/duckdb:duckdb 37218728 38731054 0.96
tpcds_q82/duckdb:duckdb 7799604 8245656 0.95
tpcds_q83/duckdb:duckdb 8867912 9081712 0.98
tpcds_q84/duckdb:duckdb 13287420 13985268 0.95
tpcds_q85/duckdb:duckdb 22696674 23628182 0.96
tpcds_q86/duckdb:duckdb 10807442 10367421 1.04
tpcds_q87/duckdb:duckdb 34098663 32227994 1.06
tpcds_q88/duckdb:duckdb 24525971 24418546 1.00
tpcds_q89/duckdb:duckdb 14134663 13761698 1.03
tpcds_q90/duckdb:duckdb 5394413 5130165 1.05
tpcds_q91/duckdb:duckdb 12775060 12407168 1.03
tpcds_q92/duckdb:duckdb 7969155 8608231 0.93
tpcds_q93/duckdb:duckdb 21384525 22432574 0.95
tpcds_q94/duckdb:duckdb 13178134 12853562 1.03
tpcds_q95/duckdb:duckdb 🚨 127417949 106429163 1.20
tpcds_q96/duckdb:duckdb 4470498 4461742 1.00
tpcds_q97/duckdb:duckdb 29385966 30018358 0.98
tpcds_q98/duckdb:duckdb 12805925 12731857 1.01
tpcds_q99/duckdb:duckdb 16132115 16361980 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.3% -3.9% +11.7% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed +2.0% -3.9% +6.2% +11.8% ➖ noise
1 duckdb:duckdb +1.2% -3.9% +5.4% +13.7% ➖ noise
1 duckdb:vortex-compact +1.0% -3.9% +5.2% +10.7% ➖ noise
1 duckdb:vortex-file-compressed +0.3% -3.9% +4.4% +10.1% ➖ noise
2 datafusion:vortex-compact +1.5% -2.7% +4.4% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.3% -2.7% +4.1% +10.0% ➖ noise
2 duckdb:duckdb -2.8% -2.7% -0.0% +10.0% ➖ noise
2 duckdb:vortex-compact -0.1% -2.7% +2.6% +27.9% ➖ noise
2 duckdb:vortex-file-compressed +2.0% -2.7% +4.9% +23.3% ➖ noise
3 datafusion:vortex-compact +5.5% -4.0% +9.9% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.3% -4.0% +5.5% +10.0% ➖ noise
3 duckdb:duckdb -0.4% -4.0% +3.7% +16.3% ➖ noise
3 duckdb:vortex-compact +1.0% -4.0% +5.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.0% -4.0% +9.4% +10.0% ➖ noise
4 datafusion:vortex-compact +0.2% -1.5% +1.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.4% -1.5% +4.0% +10.0% ➖ noise
4 duckdb:duckdb -2.5% -1.5% -1.0% +10.7% ➖ noise
4 duckdb:vortex-compact +6.6% -1.5% +8.3% +15.2% ➖ noise
4 duckdb:vortex-file-compressed +4.6% -1.5% +6.2% +10.0% ➖ noise
5 datafusion:vortex-compact -7.0% -0.3% -6.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +1.4% -0.3% +1.6% +11.0% ➖ noise
5 duckdb:duckdb -3.4% -0.3% -3.1% +12.8% ➖ noise
5 duckdb:vortex-compact -2.6% -0.3% -2.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.7% -0.3% -2.5% +11.0% ➖ noise
6 datafusion:vortex-compact +4.0% -0.9% +4.9% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.1% -0.9% +1.9% +10.0% ➖ noise
6 duckdb:duckdb -1.2% -0.9% -0.3% +12.8% ➖ noise
6 duckdb:vortex-compact +1.8% -0.9% +2.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.6% -0.9% -1.7% +10.0% ➖ noise
7 datafusion:vortex-compact +3.7% +0.7% +3.0% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +6.4% +0.7% +5.7% +11.0% ➖ noise
7 duckdb:duckdb +0.5% +0.7% -0.2% +20.3% ➖ noise
7 duckdb:vortex-compact +4.0% +0.7% +3.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.2% +0.7% -0.9% +10.0% ➖ noise
8 datafusion:vortex-compact -2.0% +2.5% -4.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.0% +2.5% -3.4% +10.3% ➖ noise
8 duckdb:duckdb -0.5% +2.5% -2.9% +10.0% ➖ noise
8 duckdb:vortex-compact +5.4% +2.5% +2.8% +10.6% ➖ noise
8 duckdb:vortex-file-compressed +2.9% +2.5% +0.4% +10.5% ➖ noise
9 datafusion:vortex-compact -0.8% +0.7% -1.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.0% +0.7% +3.3% +10.0% ➖ noise
9 duckdb:duckdb -0.9% +0.7% -1.6% +10.0% ➖ noise
9 duckdb:vortex-compact -1.4% +0.7% -2.2% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.7% +0.7% +1.9% +10.0% ➖ noise
10 datafusion:vortex-compact +1.7% +0.0% +1.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.1% +0.0% +0.1% +10.0% ➖ noise
10 duckdb:duckdb -2.4% +0.0% -2.5% +21.8% ➖ noise
10 duckdb:vortex-compact -1.3% +0.0% -1.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.8% +0.0% +2.8% +10.0% ➖ noise
11 datafusion:vortex-compact +2.9% +2.7% +0.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.3% +2.7% -2.9% +10.0% ➖ noise
11 duckdb:duckdb -6.9% +2.7% -9.4% +15.3% ➖ noise
11 duckdb:vortex-compact -2.3% +2.7% -4.8% +11.7% ➖ noise
11 duckdb:vortex-file-compressed +6.9% +2.7% +4.1% +13.5% ➖ noise
12 datafusion:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.4% -0.9% -1.5% +10.0% ➖ noise
12 duckdb:duckdb -6.4% -0.9% -5.6% +16.8% ➖ noise
12 duckdb:vortex-compact -7.9% -0.9% -7.1% +13.9% ➖ noise
12 duckdb:vortex-file-compressed +0.6% -0.9% +1.4% +16.2% ➖ noise
13 datafusion:vortex-compact -4.2% +0.4% -4.6% +10.3% ➖ noise
13 datafusion:vortex-file-compressed -3.1% +0.4% -3.5% +10.0% ➖ noise
13 duckdb:duckdb -0.3% +0.4% -0.7% +10.0% ➖ noise
13 duckdb:vortex-compact -1.3% +0.4% -1.7% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -3.2% +0.4% -3.6% +13.9% ➖ noise
14 datafusion:vortex-compact -0.7% -1.3% +0.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -1.3% -1.3% -0.0% +10.0% ➖ noise
14 duckdb:duckdb -1.1% -1.3% +0.2% +10.0% ➖ noise
14 duckdb:vortex-compact +1.0% -1.3% +2.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.9% -1.3% +3.2% +10.0% ➖ noise
15 datafusion:vortex-compact +1.0% -1.4% +2.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.5% -1.4% +4.0% +12.6% ➖ noise
15 duckdb:duckdb +1.5% -1.4% +2.9% +12.9% ➖ noise
15 duckdb:vortex-compact +2.6% -1.4% +4.1% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.6% -1.4% +2.1% +10.0% ➖ noise
16 datafusion:vortex-compact +2.6% -0.3% +2.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.5% -0.3% +0.7% +10.3% ➖ noise
16 duckdb:duckdb +8.7% -0.3% +9.0% +13.7% ➖ noise
16 duckdb:vortex-compact +0.4% -0.3% +0.7% +10.4% ➖ noise
16 duckdb:vortex-file-compressed +1.4% -0.3% +1.6% +10.0% ➖ noise
17 datafusion:vortex-compact +1.2% +1.2% -0.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +1.0% +1.2% -0.2% +10.0% ➖ noise
17 duckdb:duckdb +0.6% +1.2% -0.6% +10.0% ➖ noise
17 duckdb:vortex-compact -4.5% +1.2% -5.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.2% +1.2% -1.4% +10.1% ➖ noise
18 datafusion:vortex-compact +2.7% +0.4% +2.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.3% +0.4% +3.9% +10.0% ➖ noise
18 duckdb:duckdb +3.9% +0.4% +3.5% +10.0% ➖ noise
18 duckdb:vortex-compact +0.8% +0.4% +0.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.8% +0.4% -1.1% +10.0% ➖ noise
19 datafusion:vortex-compact +1.5% +3.4% -1.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +0.5% +3.4% -2.8% +10.1% ➖ noise
19 duckdb:duckdb +8.9% +3.4% +5.3% +10.9% ➖ noise
19 duckdb:vortex-compact +2.2% +3.4% -1.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.7% +3.4% -2.6% +10.8% ➖ noise
20 datafusion:vortex-compact +1.0% +1.0% -0.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +0.9% +1.0% -0.1% +10.0% ➖ noise
20 duckdb:duckdb -2.7% +1.0% -3.7% +10.0% ➖ noise
20 duckdb:vortex-compact +0.6% +1.0% -0.4% +11.9% ➖ noise
20 duckdb:vortex-file-compressed -1.1% +1.0% -2.1% +19.1% ➖ noise
21 datafusion:vortex-compact -0.0% -5.4% +5.7% +10.7% ➖ noise
21 datafusion:vortex-file-compressed -0.5% -5.4% +5.1% +11.4% ➖ noise
21 duckdb:duckdb +1.1% -5.4% +6.8% +22.3% ➖ noise
21 duckdb:vortex-compact -2.9% -5.4% +2.6% +15.1% ➖ noise
21 duckdb:vortex-file-compressed -3.3% -5.4% +2.2% +18.9% ➖ noise
22 datafusion:vortex-compact +1.8% +2.5% -0.8% +11.0% ➖ noise
22 datafusion:vortex-file-compressed -2.7% +2.5% -5.1% +13.5% ➖ noise
22 duckdb:duckdb -4.4% +2.5% -6.7% +13.0% ➖ noise
22 duckdb:vortex-compact -1.1% +2.5% -3.6% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +3.7% +2.5% +1.1% +11.1% ➖ noise
23 datafusion:vortex-compact +0.4% +1.9% -1.5% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +0.1% +1.9% -1.8% +10.0% ➖ noise
23 duckdb:duckdb +6.7% +1.9% +4.7% +10.2% ➖ noise
23 duckdb:vortex-compact +2.9% +1.9% +0.9% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +2.6% +1.9% +0.7% +10.0% ➖ noise
24 datafusion:vortex-compact +2.5% +2.1% +0.5% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +1.8% +2.1% -0.2% +10.0% ➖ noise
24 duckdb:duckdb +3.5% +2.1% +1.4% +18.9% ➖ noise
24 duckdb:vortex-compact -1.9% +2.1% -3.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed -1.1% +2.1% -3.1% +10.3% ➖ noise
25 datafusion:vortex-compact -1.1% -2.1% +1.0% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +0.0% -2.1% +2.2% +10.0% ➖ noise
25 duckdb:duckdb -1.2% -2.1% +0.9% +10.1% ➖ noise
25 duckdb:vortex-compact -2.3% -2.1% -0.2% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +3.6% -2.1% +5.8% +10.0% ➖ noise
26 datafusion:vortex-compact +1.9% -2.1% +4.1% +11.5% ➖ noise
26 datafusion:vortex-file-compressed +0.3% -2.1% +2.5% +10.2% ➖ noise
26 duckdb:duckdb -1.4% -2.1% +0.7% +11.9% ➖ noise
26 duckdb:vortex-compact +3.1% -2.1% +5.3% +13.4% ➖ noise
26 duckdb:vortex-file-compressed -0.6% -2.1% +1.6% +12.2% ➖ noise
27 datafusion:vortex-compact +3.0% +0.5% +2.5% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +0.6% +0.5% +0.2% +10.0% ➖ noise
27 duckdb:duckdb +13.2% +0.5% +12.7% +20.5% ➖ noise
27 duckdb:vortex-compact -4.9% +0.5% -5.3% +14.6% ➖ noise
27 duckdb:vortex-file-compressed +6.9% +0.5% +6.5% +15.7% ➖ noise
28 datafusion:vortex-compact +1.2% +0.5% +0.7% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +1.2% +0.5% +0.7% +10.0% ➖ noise
28 duckdb:duckdb -0.3% +0.5% -0.7% +10.0% ➖ noise
28 duckdb:vortex-compact +3.5% +0.5% +3.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +1.9% +0.5% +1.5% +10.0% ➖ noise
29 datafusion:vortex-compact +1.0% -2.3% +3.3% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -1.3% -2.3% +1.0% +10.0% ➖ noise
29 duckdb:duckdb -4.0% -2.3% -1.8% +10.0% ➖ noise
29 duckdb:vortex-compact +4.4% -2.3% +6.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -1.7% -2.3% +0.6% +11.7% ➖ noise
30 datafusion:vortex-compact +1.2% -1.2% +2.4% +13.7% ➖ noise
30 datafusion:vortex-file-compressed -4.7% -1.2% -3.5% +11.3% ➖ noise
30 duckdb:duckdb +0.0% -1.2% +1.3% +10.0% ➖ noise
30 duckdb:vortex-compact +0.6% -1.2% +1.9% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +0.8% -1.2% +2.1% +10.0% ➖ noise
31 datafusion:vortex-compact -0.6% +4.0% -4.4% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.5% +4.0% -3.4% +10.0% ➖ noise
31 duckdb:duckdb +3.5% +4.0% -0.4% +10.0% ➖ noise
31 duckdb:vortex-compact +1.4% +4.0% -2.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +2.5% +4.0% -1.4% +10.0% ➖ noise
32 datafusion:vortex-compact +4.1% -4.3% +8.8% +13.4% ➖ noise
32 datafusion:vortex-file-compressed -0.2% -4.3% +4.3% +10.6% ➖ noise
32 duckdb:duckdb +2.0% -4.3% +6.5% +18.0% ➖ noise
32 duckdb:vortex-compact +0.0% -4.3% +4.5% +12.6% ➖ noise
32 duckdb:vortex-file-compressed +3.2% -4.3% +7.8% +15.0% ➖ noise
33 datafusion:vortex-compact +0.9% +0.4% +0.5% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +2.3% +0.4% +1.9% +10.0% ➖ noise
33 duckdb:duckdb -1.4% +0.4% -1.7% +10.0% ➖ noise
33 duckdb:vortex-compact +0.6% +0.4% +0.2% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +4.3% +0.4% +3.9% +14.1% ➖ noise
34 datafusion:vortex-compact -0.8% +2.4% -3.1% +11.0% ➖ noise
34 datafusion:vortex-file-compressed -1.8% +2.4% -4.0% +10.0% ➖ noise
34 duckdb:duckdb -2.9% +2.4% -5.2% +10.3% ➖ noise
34 duckdb:vortex-compact +0.5% +2.4% -1.8% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -4.6% +2.4% -6.8% +12.7% ➖ noise
35 datafusion:vortex-compact +0.5% -1.3% +1.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.1% -1.3% +1.4% +10.0% ➖ noise
35 duckdb:duckdb -0.2% -1.3% +1.1% +12.5% ➖ noise
35 duckdb:vortex-compact +1.7% -1.3% +3.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +3.2% -1.3% +4.5% +12.4% ➖ noise
36 datafusion:vortex-compact +2.9% -0.2% +3.1% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -0.7% -0.2% -0.5% +10.0% ➖ noise
36 duckdb:duckdb +3.4% -0.2% +3.5% +10.8% ➖ noise
36 duckdb:vortex-compact -1.1% -0.2% -1.0% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +1.8% -0.2% +2.0% +14.9% ➖ noise
37 datafusion:vortex-compact +1.2% +2.9% -1.7% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -5.0% +2.9% -7.7% +10.0% ➖ noise
37 duckdb:duckdb -11.2% +2.9% -13.7% +14.9% ✅ faster
37 duckdb:vortex-compact +3.0% +2.9% +0.1% +11.3% ➖ noise
37 duckdb:vortex-file-compressed +0.4% +2.9% -2.5% +23.9% ➖ noise
38 datafusion:vortex-compact -0.3% +2.3% -2.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -5.8% +2.3% -7.9% +10.0% ➖ noise
38 duckdb:duckdb +0.9% +2.3% -1.4% +17.6% ➖ noise
38 duckdb:vortex-compact +6.7% +2.3% +4.3% +15.9% ➖ noise
38 duckdb:vortex-file-compressed +0.5% +2.3% -1.8% +15.7% ➖ noise
39 datafusion:vortex-compact -7.9% -0.3% -7.7% +20.1% ➖ noise
39 datafusion:vortex-file-compressed +3.0% -0.3% +3.3% +13.8% ➖ noise
39 duckdb:duckdb +10.1% -0.3% +10.4% +21.2% ➖ noise
39 duckdb:vortex-compact -5.1% -0.3% -4.9% +14.0% ➖ noise
39 duckdb:vortex-file-compressed +10.3% -0.3% +10.6% +17.7% ➖ noise
40 datafusion:vortex-compact -5.0% +1.9% -6.8% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.6% +1.9% -2.4% +11.2% ➖ noise
40 duckdb:duckdb -7.7% +1.9% -9.5% +17.4% ➖ noise
40 duckdb:vortex-compact +2.5% +1.9% +0.6% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +1.0% +1.9% -0.9% +16.4% ➖ noise
41 datafusion:vortex-compact +12.6% +2.8% +9.5% +11.5% ➖ noise
41 datafusion:vortex-file-compressed +3.2% +2.8% +0.3% +12.8% ➖ noise
41 duckdb:duckdb -6.4% +2.8% -8.9% +10.0% ➖ noise
41 duckdb:vortex-compact +1.9% +2.8% -0.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +0.7% +2.8% -2.1% +13.8% ➖ noise
42 datafusion:vortex-compact +2.7% -3.8% +6.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -4.5% -3.8% -0.8% +13.9% ➖ noise
42 duckdb:duckdb +5.5% -3.8% +9.6% +14.3% ➖ noise
42 duckdb:vortex-compact -2.5% -3.8% +1.4% +28.7% ➖ noise
42 duckdb:vortex-file-compressed -0.1% -3.8% +3.8% +48.6% ➖ noise
43 datafusion:vortex-compact +1.5% +3.3% -1.8% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -0.2% +3.3% -3.4% +10.0% ➖ noise
43 duckdb:duckdb -0.5% +3.3% -3.7% +11.1% ➖ noise
43 duckdb:vortex-compact +2.0% +3.3% -1.3% +26.6% ➖ noise
43 duckdb:vortex-file-compressed +0.4% +3.3% -2.9% +10.0% ➖ noise
44 datafusion:vortex-compact +1.4% -0.2% +1.6% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +1.2% -0.2% +1.4% +10.0% ➖ noise
44 duckdb:duckdb -1.9% -0.2% -1.7% +10.0% ➖ noise
44 duckdb:vortex-compact +2.2% -0.2% +2.3% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -2.3% -0.2% -2.2% +10.0% ➖ noise
45 datafusion:vortex-compact +1.8% +0.7% +1.0% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.5% +0.7% -1.2% +10.0% ➖ noise
45 duckdb:duckdb +11.8% +0.7% +11.0% +23.3% ➖ noise
45 duckdb:vortex-compact -0.5% +0.7% -1.2% +10.6% ➖ noise
45 duckdb:vortex-file-compressed -3.2% +0.7% -3.9% +10.0% ➖ noise
46 datafusion:vortex-compact +0.4% -0.9% +1.3% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -2.3% -0.9% -1.5% +10.0% ➖ noise
46 duckdb:duckdb -5.2% -0.9% -4.3% +10.0% ➖ noise
46 duckdb:vortex-compact -1.1% -0.9% -0.2% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +1.2% -0.9% +2.1% +10.0% ➖ noise
47 datafusion:vortex-compact +0.5% -0.1% +0.6% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -0.3% -0.1% -0.2% +10.0% ➖ noise
47 duckdb:duckdb +1.2% -0.1% +1.3% +10.0% ➖ noise
47 duckdb:vortex-compact +1.8% -0.1% +1.9% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +0.9% -0.1% +1.0% +10.0% ➖ noise
48 datafusion:vortex-compact -1.8% -0.3% -1.5% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +2.4% -0.3% +2.8% +11.0% ➖ noise
48 duckdb:duckdb +1.9% -0.3% +2.3% +10.0% ➖ noise
48 duckdb:vortex-compact -1.0% -0.3% -0.6% +10.2% ➖ noise
48 duckdb:vortex-file-compressed -4.0% -0.3% -3.6% +10.0% ➖ noise
49 datafusion:vortex-compact -0.4% -2.0% +1.7% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +2.0% -2.0% +4.1% +10.0% ➖ noise
49 duckdb:duckdb +4.2% -2.0% +6.4% +15.9% ➖ noise
49 duckdb:vortex-compact -1.5% -2.0% +0.5% +10.0% ➖ noise
49 duckdb:vortex-file-compressed +3.3% -2.0% +5.5% +10.0% ➖ noise
50 datafusion:vortex-compact +1.6% -0.1% +1.7% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -2.1% -0.1% -2.0% +10.0% ➖ noise
50 duckdb:duckdb -3.7% -0.1% -3.7% +10.3% ➖ noise
50 duckdb:vortex-compact -0.4% -0.1% -0.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed +4.1% -0.1% +4.2% +10.0% ➖ noise
51 datafusion:vortex-compact +0.4% +0.3% +0.1% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -3.6% +0.3% -3.9% +10.3% ➖ noise
51 duckdb:duckdb -1.3% +0.3% -1.5% +11.0% ➖ noise
51 duckdb:vortex-compact -2.9% +0.3% -3.2% +10.0% ➖ noise
51 duckdb:vortex-file-compressed +8.0% +0.3% +7.7% +23.2% ➖ noise
52 datafusion:vortex-compact -1.5% -0.1% -1.4% +15.0% ➖ noise
52 datafusion:vortex-file-compressed +1.2% -0.1% +1.3% +10.8% ➖ noise
52 duckdb:duckdb +4.8% -0.1% +4.9% +12.7% ➖ noise
52 duckdb:vortex-compact +1.2% -0.1% +1.3% +11.4% ➖ noise
52 duckdb:vortex-file-compressed -0.8% -0.1% -0.7% +16.9% ➖ noise
53 datafusion:vortex-compact +0.2% +1.9% -1.6% +13.5% ➖ noise
53 datafusion:vortex-file-compressed +1.9% +1.9% +0.1% +10.0% ➖ noise
53 duckdb:duckdb +3.0% +1.9% +1.2% +10.2% ➖ noise
53 duckdb:vortex-compact +3.7% +1.9% +1.8% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +4.1% +1.9% +2.3% +10.7% ➖ noise
54 datafusion:vortex-compact +1.3% +2.3% -1.0% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.7% +2.3% -0.6% +10.0% ➖ noise
54 duckdb:duckdb +4.0% +2.3% +1.7% +14.8% ➖ noise
54 duckdb:vortex-compact +2.4% +2.3% +0.1% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +1.9% +2.3% -0.4% +10.0% ➖ noise
55 datafusion:vortex-compact +2.6% -0.7% +3.4% +10.0% ➖ noise
55 datafusion:vortex-file-compressed -2.7% -0.7% -2.0% +10.0% ➖ noise
55 duckdb:duckdb +6.9% -0.7% +7.7% +14.5% ➖ noise
55 duckdb:vortex-compact +0.4% -0.7% +1.2% +14.0% ➖ noise
55 duckdb:vortex-file-compressed -0.4% -0.7% +0.3% +10.6% ➖ noise
56 datafusion:vortex-compact +2.6% +1.2% +1.4% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -4.0% +1.2% -5.1% +10.0% ➖ noise
56 duckdb:duckdb -1.2% +1.2% -2.4% +10.0% ➖ noise
56 duckdb:vortex-compact +0.9% +1.2% -0.3% +14.1% ➖ noise
56 duckdb:vortex-file-compressed -0.5% +1.2% -1.6% +10.5% ➖ noise
57 datafusion:vortex-compact -0.8% +5.4% -5.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -2.1% +5.4% -7.1% +10.0% ➖ noise
57 duckdb:duckdb -2.9% +5.4% -7.8% +10.0% ➖ noise
57 duckdb:vortex-compact -6.2% +5.4% -11.0% +11.9% ✅ faster
57 duckdb:vortex-file-compressed +7.9% +5.4% +2.3% +10.0% ➖ noise
58 datafusion:vortex-compact -1.1% -1.6% +0.5% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +0.9% -1.6% +2.6% +12.0% ➖ noise
58 duckdb:duckdb -1.2% -1.6% +0.4% +12.3% ➖ noise
58 duckdb:vortex-compact +6.4% -1.6% +8.1% +15.7% ➖ noise
58 duckdb:vortex-file-compressed -1.0% -1.6% +0.7% +20.0% ➖ noise
59 datafusion:vortex-compact +0.6% +1.2% -0.6% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +0.7% +1.2% -0.4% +10.0% ➖ noise
59 duckdb:duckdb +0.5% +1.2% -0.7% +10.0% ➖ noise
59 duckdb:vortex-compact +1.1% +1.2% -0.1% +15.9% ➖ noise
59 duckdb:vortex-file-compressed -2.4% +1.2% -3.5% +10.0% ➖ noise
60 datafusion:vortex-compact -1.0% +0.1% -1.1% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -3.1% +0.1% -3.2% +10.0% ➖ noise
60 duckdb:duckdb +3.2% +0.1% +3.1% +12.5% ➖ noise
60 duckdb:vortex-compact +1.7% +0.1% +1.6% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +2.6% +0.1% +2.5% +10.7% ➖ noise
61 datafusion:vortex-compact +0.5% +1.1% -0.6% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -1.6% +1.1% -2.6% +10.0% ➖ noise
61 duckdb:duckdb -3.5% +1.1% -4.5% +10.0% ➖ noise
61 duckdb:vortex-compact +0.3% +1.1% -0.7% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +0.4% +1.1% -0.7% +13.7% ➖ noise
62 datafusion:vortex-compact +1.2% +3.5% -2.3% +15.0% ➖ noise
62 datafusion:vortex-file-compressed -0.9% +3.5% -4.3% +15.8% ➖ noise
62 duckdb:duckdb +3.8% +3.5% +0.3% +25.5% ➖ noise
62 duckdb:vortex-compact -2.1% +3.5% -5.5% +29.8% ➖ noise
62 duckdb:vortex-file-compressed +8.8% +3.5% +5.1% +20.7% ➖ noise
63 datafusion:vortex-compact +1.8% +1.3% +0.4% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +2.6% +1.3% +1.3% +10.0% ➖ noise
63 duckdb:duckdb +1.7% +1.3% +0.3% +10.0% ➖ noise
63 duckdb:vortex-compact -2.0% +1.3% -3.3% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +0.2% +1.3% -1.1% +10.8% ➖ noise
64 datafusion:vortex-compact +0.0% +0.1% -0.1% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +2.6% +0.1% +2.5% +10.0% ➖ noise
64 duckdb:duckdb -4.2% +0.1% -4.3% +10.0% ➖ noise
64 duckdb:vortex-compact +0.8% +0.1% +0.7% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +0.3% +0.1% +0.2% +10.0% ➖ noise
65 datafusion:vortex-compact +3.0% -1.3% +4.4% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -1.4% -1.3% -0.0% +10.0% ➖ noise
65 duckdb:duckdb +2.1% -1.3% +3.5% +14.2% ➖ noise
65 duckdb:vortex-compact -2.7% -1.3% -1.4% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +0.7% -1.3% +2.0% +10.1% ➖ noise
66 datafusion:vortex-compact +2.9% +4.3% -1.4% +10.6% ➖ noise
66 datafusion:vortex-file-compressed -4.3% +4.3% -8.2% +11.4% ➖ noise
66 duckdb:duckdb +3.1% +4.3% -1.1% +14.1% ➖ noise
66 duckdb:vortex-compact -0.3% +4.3% -4.4% +13.4% ➖ noise
66 duckdb:vortex-file-compressed -0.7% +4.3% -4.8% +11.6% ➖ noise
67 datafusion:vortex-compact +2.8% +1.1% +1.7% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +0.2% +1.1% -1.0% +10.0% ➖ noise
67 duckdb:duckdb +0.2% +1.1% -1.0% +10.0% ➖ noise
67 duckdb:vortex-compact -1.0% +1.1% -2.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed -3.3% +1.1% -4.4% +10.0% ➖ noise
68 datafusion:vortex-compact +1.4% -0.7% +2.1% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -4.7% -0.7% -3.9% +10.0% ➖ noise
68 duckdb:duckdb +0.4% -0.7% +1.2% +11.3% ➖ noise
68 duckdb:vortex-compact -1.0% -0.7% -0.3% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +1.0% -0.7% +1.7% +10.0% ➖ noise
69 datafusion:vortex-compact +1.0% +2.2% -1.1% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -7.4% +2.2% -9.3% +10.0% ✅ faster
69 duckdb:duckdb +0.5% +2.2% -1.6% +10.0% ➖ noise
69 duckdb:vortex-compact +2.0% +2.2% -0.1% +10.0% ➖ noise
69 duckdb:vortex-file-compressed -2.3% +2.2% -4.3% +10.0% ➖ noise
70 datafusion:vortex-compact -1.4% -0.3% -1.0% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +2.9% -0.3% +3.3% +10.0% ➖ noise
70 duckdb:duckdb +0.6% -0.3% +1.0% +12.5% ➖ noise
70 duckdb:vortex-compact +2.1% -0.3% +2.5% +10.0% ➖ noise
70 duckdb:vortex-file-compressed +7.0% -0.3% +7.4% +10.8% ➖ noise
71 datafusion:vortex-compact -2.7% +1.1% -3.8% +11.7% ➖ noise
71 datafusion:vortex-file-compressed +6.9% +1.1% +5.7% +10.0% ➖ noise
71 duckdb:duckdb +10.3% +1.1% +9.1% +13.6% ➖ noise
71 duckdb:vortex-compact +1.1% +1.1% -0.0% +15.4% ➖ noise
71 duckdb:vortex-file-compressed +1.9% +1.1% +0.8% +13.0% ➖ noise
72 datafusion:vortex-compact +2.2% -0.8% +3.0% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +1.2% -0.8% +2.0% +10.0% ➖ noise
72 duckdb:duckdb +4.9% -0.8% +5.7% +11.2% ➖ noise
72 duckdb:vortex-compact -0.4% -0.8% +0.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.3% -0.8% +0.5% +10.0% ➖ noise
73 datafusion:vortex-compact -1.4% +3.1% -4.3% +16.4% ➖ noise
73 datafusion:vortex-file-compressed -0.2% +3.1% -3.2% +14.6% ➖ noise
73 duckdb:duckdb -1.5% +3.1% -4.5% +18.9% ➖ noise
73 duckdb:vortex-compact -0.9% +3.1% -3.9% +10.0% ➖ noise
73 duckdb:vortex-file-compressed -4.4% +3.1% -7.3% +12.9% ➖ noise
74 datafusion:vortex-compact -0.2% -2.3% +2.2% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +2.3% -2.3% +4.7% +10.0% ➖ noise
74 duckdb:duckdb -1.6% -2.3% +0.7% +10.0% ➖ noise
74 duckdb:vortex-compact -22.8% -2.3% -21.0% +18.7% ✅ faster
74 duckdb:vortex-file-compressed -1.6% -2.3% +0.7% +22.1% ➖ noise
75 datafusion:vortex-compact -1.2% +1.4% -2.5% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +1.0% +1.4% -0.4% +10.0% ➖ noise
75 duckdb:duckdb -1.3% +1.4% -2.6% +10.0% ➖ noise
75 duckdb:vortex-compact +2.4% +1.4% +1.1% +12.4% ➖ noise
75 duckdb:vortex-file-compressed -3.3% +1.4% -4.6% +10.0% ➖ noise
76 datafusion:vortex-compact +1.5% +1.1% +0.4% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +2.4% +1.1% +1.2% +10.0% ➖ noise
76 duckdb:duckdb +7.7% +1.1% +6.5% +15.1% ➖ noise
76 duckdb:vortex-compact +5.7% +1.1% +4.6% +12.5% ➖ noise
76 duckdb:vortex-file-compressed -6.4% +1.1% -7.4% +10.1% ➖ noise
77 datafusion:vortex-compact +2.3% +0.5% +1.8% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -1.7% +0.5% -2.1% +10.0% ➖ noise
77 duckdb:duckdb +2.1% +0.5% +1.6% +10.0% ➖ noise
77 duckdb:vortex-compact -4.6% +0.5% -5.1% +10.7% ➖ noise
77 duckdb:vortex-file-compressed +9.2% +0.5% +8.7% +10.0% ➖ noise
78 datafusion:vortex-compact +1.2% +1.3% -0.1% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +0.1% +1.3% -1.2% +10.0% ➖ noise
78 duckdb:duckdb -0.9% +1.3% -2.2% +10.0% ➖ noise
78 duckdb:vortex-compact +6.8% +1.3% +5.4% +10.0% ➖ noise
78 duckdb:vortex-file-compressed -1.4% +1.3% -2.6% +10.0% ➖ noise
79 datafusion:vortex-compact -1.2% +3.2% -4.3% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +4.8% +3.2% +1.5% +10.0% ➖ noise
79 duckdb:duckdb -1.0% +3.2% -4.1% +10.0% ➖ noise
79 duckdb:vortex-compact +1.7% +3.2% -1.5% +10.0% ➖ noise
79 duckdb:vortex-file-compressed -0.2% +3.2% -3.3% +12.6% ➖ noise
80 datafusion:vortex-compact -1.7% -2.8% +1.2% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +2.3% -2.8% +5.2% +10.0% ➖ noise
80 duckdb:duckdb +0.3% -2.8% +3.2% +13.3% ➖ noise
80 duckdb:vortex-compact +0.1% -2.8% +3.0% +12.2% ➖ noise
80 duckdb:vortex-file-compressed -6.0% -2.8% -3.3% +10.6% ➖ noise
81 datafusion:vortex-compact +1.2% +2.6% -1.4% +14.5% ➖ noise
81 datafusion:vortex-file-compressed +8.5% +2.6% +5.7% +12.1% ➖ noise
81 duckdb:duckdb -3.9% +2.6% -6.4% +10.3% ➖ noise
81 duckdb:vortex-compact +2.8% +2.6% +0.2% +10.0% ➖ noise
81 duckdb:vortex-file-compressed +5.0% +2.6% +2.3% +10.0% ➖ noise
82 datafusion:vortex-compact +0.1% +2.7% -2.5% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +3.1% +2.7% +0.4% +10.0% ➖ noise
82 duckdb:duckdb -5.4% +2.7% -7.9% +14.7% ➖ noise
82 duckdb:vortex-compact +1.1% +2.7% -1.5% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -1.8% +2.7% -4.4% +11.5% ➖ noise
83 datafusion:vortex-compact +4.5% -0.5% +5.1% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +4.5% -0.5% +5.0% +10.0% ➖ noise
83 duckdb:duckdb -2.4% -0.5% -1.9% +11.8% ➖ noise
83 duckdb:vortex-compact -1.7% -0.5% -1.2% +10.0% ➖ noise
83 duckdb:vortex-file-compressed -2.0% -0.5% -1.5% +10.0% ➖ noise
84 datafusion:vortex-compact -0.6% +1.0% -1.5% +10.0% ➖ noise
84 datafusion:vortex-file-compressed +1.8% +1.0% +0.9% +10.0% ➖ noise
84 duckdb:duckdb -5.0% +1.0% -5.9% +10.0% ➖ noise
84 duckdb:vortex-compact -1.0% +1.0% -2.0% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +4.0% +1.0% +3.0% +10.0% ➖ noise
85 datafusion:vortex-compact +1.6% +3.0% -1.4% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +0.3% +3.0% -2.6% +10.0% ➖ noise
85 duckdb:duckdb -3.9% +3.0% -6.7% +10.0% ➖ noise
85 duckdb:vortex-compact -5.3% +3.0% -8.1% +14.7% ➖ noise
85 duckdb:vortex-file-compressed -0.2% +3.0% -3.1% +10.0% ➖ noise
86 datafusion:vortex-compact +5.5% +2.5% +2.9% +10.1% ➖ noise
86 datafusion:vortex-file-compressed +4.3% +2.5% +1.7% +10.8% ➖ noise
86 duckdb:duckdb +4.2% +2.5% +1.7% +15.4% ➖ noise
86 duckdb:vortex-compact +3.3% +2.5% +0.8% +19.7% ➖ noise
86 duckdb:vortex-file-compressed +6.9% +2.5% +4.3% +14.5% ➖ noise
87 datafusion:vortex-compact +1.7% +1.0% +0.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +3.7% +1.0% +2.7% +10.0% ➖ noise
87 duckdb:duckdb +5.8% +1.0% +4.8% +12.2% ➖ noise
87 duckdb:vortex-compact +2.5% +1.0% +1.5% +11.8% ➖ noise
87 duckdb:vortex-file-compressed -5.6% +1.0% -6.5% +11.5% ➖ noise
88 datafusion:vortex-compact -1.0% +1.1% -2.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +3.1% +1.1% +2.0% +10.0% ➖ noise
88 duckdb:duckdb +0.4% +1.1% -0.7% +10.0% ➖ noise
88 duckdb:vortex-compact +0.8% +1.1% -0.3% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -3.8% +1.1% -4.8% +10.0% ➖ noise
89 datafusion:vortex-compact +3.8% -4.0% +8.2% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +3.3% -4.0% +7.6% +10.7% ➖ noise
89 duckdb:duckdb +2.7% -4.0% +7.0% +11.2% ➖ noise
89 duckdb:vortex-compact +0.8% -4.0% +5.0% +10.0% ➖ noise
89 duckdb:vortex-file-compressed +2.0% -4.0% +6.3% +12.1% ➖ noise
90 datafusion:vortex-compact -0.6% +1.9% -2.4% +10.0% ➖ noise
90 datafusion:vortex-file-compressed +2.8% +1.9% +0.9% +10.0% ➖ noise
90 duckdb:duckdb +5.2% +1.9% +3.2% +10.0% ➖ noise
90 duckdb:vortex-compact +1.4% +1.9% -0.5% +10.0% ➖ noise
90 duckdb:vortex-file-compressed -4.9% +1.9% -6.7% +10.0% ➖ noise
91 datafusion:vortex-compact +1.2% +4.8% -3.5% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +2.2% +4.8% -2.5% +10.0% ➖ noise
91 duckdb:duckdb +3.0% +4.8% -1.8% +18.6% ➖ noise
91 duckdb:vortex-compact -2.5% +4.8% -7.0% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -1.8% +4.8% -6.3% +10.0% ➖ noise
92 datafusion:vortex-compact +0.7% +2.2% -1.4% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +0.4% +2.2% -1.7% +10.0% ➖ noise
92 duckdb:duckdb -7.4% +2.2% -9.4% +11.6% ➖ noise
92 duckdb:vortex-compact -0.7% +2.2% -2.8% +11.6% ➖ noise
92 duckdb:vortex-file-compressed +2.4% +2.2% +0.3% +13.1% ➖ noise
93 datafusion:vortex-compact +1.4% -0.6% +2.0% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +2.5% -0.6% +3.0% +10.0% ➖ noise
93 duckdb:duckdb -4.7% -0.6% -4.1% +20.8% ➖ noise
93 duckdb:vortex-compact +0.9% -0.6% +1.5% +13.2% ➖ noise
93 duckdb:vortex-file-compressed +12.1% -0.6% +12.7% +21.1% ➖ noise
94 datafusion:vortex-compact -2.0% +0.3% -2.4% +12.5% ➖ noise
94 datafusion:vortex-file-compressed +0.3% +0.3% -0.0% +13.5% ➖ noise
94 duckdb:duckdb +2.5% +0.3% +2.2% +15.8% ➖ noise
94 duckdb:vortex-compact -6.1% +0.3% -6.4% +14.5% ➖ noise
94 duckdb:vortex-file-compressed -8.2% +0.3% -8.5% +15.1% ➖ noise
95 datafusion:vortex-compact +0.3% -0.6% +0.9% +10.0% ➖ noise
95 datafusion:vortex-file-compressed -1.7% -0.6% -1.1% +10.0% ➖ noise
95 duckdb:duckdb +19.7% -0.6% +20.5% +19.1% 🚨 regression
95 duckdb:vortex-compact -4.0% -0.6% -3.4% +19.6% ➖ noise
95 duckdb:vortex-file-compressed -0.3% -0.6% +0.3% +20.4% ➖ noise
96 datafusion:vortex-compact -1.4% -0.8% -0.6% +11.7% ➖ noise
96 datafusion:vortex-file-compressed -2.8% -0.8% -2.0% +13.5% ➖ noise
96 duckdb:duckdb +0.2% -0.8% +1.0% +16.5% ➖ noise
96 duckdb:vortex-compact +1.8% -0.8% +2.6% +12.4% ➖ noise
96 duckdb:vortex-file-compressed +6.3% -0.8% +7.2% +19.3% ➖ noise
97 datafusion:vortex-compact -2.7% -0.7% -2.1% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +0.2% -0.7% +0.9% +10.0% ➖ noise
97 duckdb:duckdb -2.1% -0.7% -1.4% +11.0% ➖ noise
97 duckdb:vortex-compact +1.6% -0.7% +2.3% +14.2% ➖ noise
97 duckdb:vortex-file-compressed -2.2% -0.7% -1.6% +11.4% ➖ noise
98 datafusion:vortex-compact +5.8% -1.6% +7.6% +14.5% ➖ noise
98 datafusion:vortex-file-compressed +0.5% -1.6% +2.2% +11.0% ➖ noise
98 duckdb:duckdb +0.6% -1.6% +2.3% +13.4% ➖ noise
98 duckdb:vortex-compact +0.4% -1.6% +2.1% +12.4% ➖ noise
98 duckdb:vortex-file-compressed -1.2% -1.6% +0.5% +13.1% ➖ noise
99 datafusion:vortex-compact +3.0% +1.5% +1.5% +15.9% ➖ noise
99 datafusion:vortex-file-compressed +1.5% +1.5% +0.1% +16.7% ➖ noise
99 duckdb:duckdb -1.4% +1.5% -2.8% +23.8% ➖ noise
99 duckdb:vortex-compact +1.4% +1.5% -0.1% +25.5% ➖ noise
99 duckdb:vortex-file-compressed -5.8% +1.5% -7.1% +21.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 0.950x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -4.9%


datafusion / vortex-file-compressed (0.896x ➖, 1↑ 1↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 28057450 44566271 0.63
fineweb_q01/datafusion:vortex-file-compressed 🚨 662713728 502752437 1.32
fineweb_q02/datafusion:vortex-file-compressed 492233146 572762984 0.86
fineweb_q03/datafusion:vortex-file-compressed 1556697008 2050848490 0.76
fineweb_q04/datafusion:vortex-file-compressed 1448649490 1400347440 1.03
fineweb_q05/datafusion:vortex-file-compressed 1397143359 1373742227 1.02
fineweb_q06/datafusion:vortex-file-compressed 1628711731 1887492092 0.86
fineweb_q07/datafusion:vortex-file-compressed 1376367250 1531469802 0.90
fineweb_q08/datafusion:vortex-file-compressed 549169712 652976520 0.84
datafusion / vortex-compact (0.938x ➖, 1↑ 1↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 36462808 87807291 0.42
fineweb_q01/datafusion:vortex-compact 803988849 652721098 1.23
fineweb_q02/datafusion:vortex-compact 🚨 831037043 561660176 1.48
fineweb_q03/datafusion:vortex-compact 1886621300 1992825621 0.95
fineweb_q04/datafusion:vortex-compact 2255869192 2430496561 0.93
fineweb_q05/datafusion:vortex-compact 1718391195 1903389320 0.90
fineweb_q06/datafusion:vortex-compact 1425107346 1541792070 0.92
fineweb_q07/datafusion:vortex-compact 1343354682 1480788853 0.91
fineweb_q08/datafusion:vortex-compact 451216135 403633586 1.12
datafusion / parquet (0.979x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1233245621 1250895435 0.99
fineweb_q01/datafusion:parquet 1848162318 1894320286 0.98
fineweb_q02/datafusion:parquet 1760829051 2077059185 0.85
fineweb_q03/datafusion:parquet 2029906413 1917504971 1.06
fineweb_q04/datafusion:parquet 1787329786 1936742358 0.92
fineweb_q05/datafusion:parquet 2087540698 1912858316 1.09
fineweb_q06/datafusion:parquet 1947191652 1804191078 1.08
fineweb_q07/datafusion:parquet 1780104965 1854678256 0.96
fineweb_q08/datafusion:parquet 1860106863 2025809279 0.92
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 1↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 84225276 87886477 0.96
fineweb_q01/duckdb:vortex-file-compressed 600785689 665755597 0.90
fineweb_q02/duckdb:vortex-file-compressed 🚨 604755609 425932823 1.42
fineweb_q03/duckdb:vortex-file-compressed 1440397992 1553335000 0.93
fineweb_q04/duckdb:vortex-file-compressed 1500979102 1593176736 0.94
fineweb_q05/duckdb:vortex-file-compressed 1439569957 1547993554 0.93
fineweb_q06/duckdb:vortex-file-compressed 1697313352 1771110367 0.96
fineweb_q07/duckdb:vortex-file-compressed 1467326802 1531703209 0.96
fineweb_q08/duckdb:vortex-file-compressed 604954224 646684593 0.94
duckdb / vortex-compact (0.986x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 89724151 78384254 1.14
fineweb_q01/duckdb:vortex-compact 652841844 559301341 1.17
fineweb_q02/duckdb:vortex-compact 733801529 596135999 1.23
fineweb_q03/duckdb:vortex-compact 1641083152 1840044866 0.89
fineweb_q04/duckdb:vortex-compact 1682244576 1934173815 0.87
fineweb_q05/duckdb:vortex-compact 1494563391 1740851064 0.86
fineweb_q06/duckdb:vortex-compact 1468640134 1610434311 0.91
fineweb_q07/duckdb:vortex-compact 1270624280 1505869559 0.84
fineweb_q08/duckdb:vortex-compact 501309311 481254136 1.04
duckdb / parquet (0.980x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1239458870 1215691731 1.02
fineweb_q01/duckdb:parquet 1436664544 1404971087 1.02
fineweb_q02/duckdb:parquet 1400810113 1506035020 0.93
fineweb_q03/duckdb:parquet 3608058033 3958670492 0.91
fineweb_q04/duckdb:parquet 1916247215 1960702986 0.98
fineweb_q05/duckdb:parquet 2143168246 2309907217 0.93
fineweb_q06/duckdb:parquet 4450930409 4409373557 1.01
fineweb_q07/duckdb:parquet 2740039399 2684912202 1.02
fineweb_q08/duckdb:parquet 1201041124 1186463596 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -58.5% +0.3% -58.6% +242.7% ➖ noise
0 datafusion:vortex-file-compressed -37.0% +0.3% -37.2% +158.1% ➖ noise
0 duckdb:vortex-compact +14.5% +0.3% +14.2% +60.3% ➖ noise
0 duckdb:vortex-file-compressed -4.2% +0.3% -4.4% +37.3% ➖ noise
1 datafusion:vortex-compact +23.2% -0.1% +23.3% +54.7% ➖ noise
1 datafusion:vortex-file-compressed +31.8% -0.1% +32.0% +69.0% ➖ noise
1 duckdb:vortex-compact +16.7% -0.1% +16.9% +30.0% ➖ noise
1 duckdb:vortex-file-compressed -9.8% -0.1% -9.7% +30.0% ➖ noise
2 datafusion:vortex-compact +48.0% -11.2% +66.6% +33.1% 🚨 regression
2 datafusion:vortex-file-compressed -14.1% -11.2% -3.2% +47.5% ➖ noise
2 duckdb:vortex-compact +23.1% -11.2% +38.6% +30.0% 🚨 regression
2 duckdb:vortex-file-compressed +42.0% -11.2% +59.9% +30.0% 🚨 regression
3 datafusion:vortex-compact -5.3% -1.8% -3.6% +30.0% ➖ noise
3 datafusion:vortex-file-compressed -24.1% -1.8% -22.7% +70.2% ➖ noise
3 duckdb:vortex-compact -10.8% -1.8% -9.2% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -7.3% -1.8% -5.6% +30.0% ➖ noise
4 datafusion:vortex-compact -7.2% -5.0% -2.3% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +3.4% -5.0% +8.9% +30.0% ➖ noise
4 duckdb:vortex-compact -13.0% -5.0% -8.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -5.8% -5.0% -0.8% +30.0% ➖ noise
5 datafusion:vortex-compact -9.7% +0.6% -10.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +1.7% +0.6% +1.1% +30.0% ➖ noise
5 duckdb:vortex-compact -14.1% +0.6% -14.7% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -7.0% +0.6% -7.6% +30.0% ➖ noise
6 datafusion:vortex-compact -7.6% +4.4% -11.4% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -13.7% +4.4% -17.3% +30.0% ➖ noise
6 duckdb:vortex-compact -8.8% +4.4% -12.6% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -4.2% +4.4% -8.2% +30.0% ➖ noise
7 datafusion:vortex-compact -9.3% -1.0% -8.3% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -10.1% -1.0% -9.2% +30.0% ➖ noise
7 duckdb:vortex-compact -15.6% -1.0% -14.7% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -4.2% -1.0% -3.2% +30.0% ➖ noise
8 datafusion:vortex-compact +11.8% -3.6% +16.0% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -15.9% -3.6% -12.8% +30.0% ➖ noise
8 duckdb:vortex-compact +4.2% -3.6% +8.0% +33.7% ➖ noise
8 duckdb:vortex-file-compressed -6.5% -3.6% -3.0% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Random Access

Vortex (geomean): 0.873x ✅
Parquet (geomean): 1.023x ➖


unknown / unknown (0.967x ➖, 7↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 2858244 2726422 1.05
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1330586 1293547 1.03
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11838522219 11582036688 1.02
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11320641372 11284649648 1.00
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8704768 9597302 0.91
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 7047864 7999156 0.88
random-access/feature-vectors/uniform/lance-tokio-local-disk 1556546 1485583 1.05
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2468657 2405726 1.03
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11304177426 11281254010 1.00
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11334296791 11180983607 1.01
random-access/feature-vectors/uniform/vortex-tokio-local-disk 14116531 14878159 0.95
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 13992357 14974703 0.93
random-access/lance-tokio-local-disk 759914 733918 1.04
random-access/lance-tokio-local-disk-footer 1380415 1340238 1.03
random-access/nested-lists/correlated/lance-tokio-local-disk 274985 269118 1.02
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 713622 705123 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk 139272626 133197659 1.05
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 139292687 133355701 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk 747609 722035 1.04
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 752289 736863 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk 1198377 1170298 1.02
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1689577 1645958 1.03
random-access/nested-lists/uniform/parquet-tokio-local-disk 139147645 133760520 1.04
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 139274132 133861061 1.04
random-access/nested-lists/uniform/vortex-tokio-local-disk 2597355 2574511 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2700038 2523234 1.07
random-access/nested-structs/correlated/lance-tokio-local-disk 436566 461327 0.95
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 648181 703200 0.92
random-access/nested-structs/correlated/parquet-tokio-local-disk 27835906 26712286 1.04
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27977892 26625604 1.05
random-access/nested-structs/correlated/vortex-tokio-local-disk 962601 978159 0.98
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 928522 980045 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk 2908758 3046717 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3149719 3285254 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 28169118 26447669 1.07
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27955892 26810339 1.04
random-access/nested-structs/uniform/vortex-tokio-local-disk 1860482 2039583 0.91
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1869634 2018732 0.93
random-access/parquet-tokio-local-disk 180257334 180823993 1.00
random-access/parquet-tokio-local-disk-footer 179953626 184294576 0.98
random-access/taxi/correlated/lance-tokio-local-disk 990179 959869 1.03
random-access/taxi/correlated/lance-tokio-local-disk-footer 1681268 1636725 1.03
random-access/taxi/correlated/parquet-tokio-local-disk 274814776 270207785 1.02
random-access/taxi/correlated/parquet-tokio-local-disk-footer 271530366 269375309 1.01
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1810473 3075902 0.59
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1981138 2970291 0.67
random-access/taxi/uniform/lance-tokio-local-disk 8856046 8415928 1.05
random-access/taxi/uniform/lance-tokio-local-disk-footer 9553817 9126608 1.05
random-access/taxi/uniform/parquet-tokio-local-disk 289419093 287190371 1.01
random-access/taxi/uniform/parquet-tokio-local-disk-footer 287061567 287932353 1.00
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4820789 5787580 0.83
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4746712 5690417 0.83
random-access/vortex-tokio-local-disk 🚀 1343468 1868164 0.72
random-access/vortex-tokio-local-disk-footer 🚀 1344039 1944123 0.69

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.996x ➖
Parquet (geomean): 0.997x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%


datafusion / vortex-file-compressed (0.990x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 413562418 398121803 1.04
tpch_q02/datafusion:vortex-file-compressed 112176449 114194898 0.98
tpch_q03/datafusion:vortex-file-compressed 212015887 216217945 0.98
tpch_q04/datafusion:vortex-file-compressed 107130044 109068682 0.98
tpch_q05/datafusion:vortex-file-compressed 380964995 386624988 0.99
tpch_q06/datafusion:vortex-file-compressed 41666200 42800272 0.97
tpch_q07/datafusion:vortex-file-compressed 559810242 565322114 0.99
tpch_q08/datafusion:vortex-file-compressed 376724241 380855030 0.99
tpch_q09/datafusion:vortex-file-compressed 658106579 665884865 0.99
tpch_q10/datafusion:vortex-file-compressed 241357167 243596832 0.99
tpch_q11/datafusion:vortex-file-compressed 84877865 85899883 0.99
tpch_q12/datafusion:vortex-file-compressed 116106417 117576515 0.99
tpch_q13/datafusion:vortex-file-compressed 216742301 217977088 0.99
tpch_q14/datafusion:vortex-file-compressed 57149866 56905135 1.00
tpch_q15/datafusion:vortex-file-compressed 106976399 106869126 1.00
tpch_q16/datafusion:vortex-file-compressed 77045439 77545117 0.99
tpch_q17/datafusion:vortex-file-compressed 631954434 644878633 0.98
tpch_q18/datafusion:vortex-file-compressed 871492647 876940352 0.99
tpch_q19/datafusion:vortex-file-compressed 90813153 93222872 0.97
tpch_q20/datafusion:vortex-file-compressed 168333034 170718217 0.99
tpch_q21/datafusion:vortex-file-compressed 677499964 682348684 0.99
tpch_q22/datafusion:vortex-file-compressed 59758043 60410701 0.99
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 431867265 441641550 0.98
tpch_q02/datafusion:vortex-compact 118246412 119072426 0.99
tpch_q03/datafusion:vortex-compact 216795324 217071635 1.00
tpch_q04/datafusion:vortex-compact 119609010 118775670 1.01
tpch_q05/datafusion:vortex-compact 390567514 394353537 0.99
tpch_q06/datafusion:vortex-compact 63488479 63368141 1.00
tpch_q07/datafusion:vortex-compact 579674424 586321350 0.99
tpch_q08/datafusion:vortex-compact 382475794 385128834 0.99
tpch_q09/datafusion:vortex-compact 672391887 683717221 0.98
tpch_q10/datafusion:vortex-compact 268170566 276819169 0.97
tpch_q11/datafusion:vortex-compact 89609595 90303806 0.99
tpch_q12/datafusion:vortex-compact 164894908 165860539 0.99
tpch_q13/datafusion:vortex-compact 267392713 270592624 0.99
tpch_q14/datafusion:vortex-compact 72782697 73911463 0.98
tpch_q15/datafusion:vortex-compact 163857008 164138618 1.00
tpch_q16/datafusion:vortex-compact 82221553 82846280 0.99
tpch_q17/datafusion:vortex-compact 640035482 652849552 0.98
tpch_q18/datafusion:vortex-compact 872662051 880601181 0.99
tpch_q19/datafusion:vortex-compact 134637375 134402798 1.00
tpch_q20/datafusion:vortex-compact 196214529 196714153 1.00
tpch_q21/datafusion:vortex-compact 693369148 694689890 1.00
tpch_q22/datafusion:vortex-compact 69939885 72008614 0.97
datafusion / parquet (0.999x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 427323541 415185537 1.03
tpch_q02/datafusion:parquet 186245439 187304400 0.99
tpch_q03/datafusion:parquet 293856724 295443651 0.99
tpch_q04/datafusion:parquet 136635697 136002677 1.00
tpch_q05/datafusion:parquet 444145047 457267838 0.97
tpch_q06/datafusion:parquet 125045849 118861516 1.05
tpch_q07/datafusion:parquet 619051043 625533022 0.99
tpch_q08/datafusion:parquet 500241215 494892630 1.01
tpch_q09/datafusion:parquet 765747081 772784648 0.99
tpch_q10/datafusion:parquet 513003074 508403241 1.01
tpch_q11/datafusion:parquet 130817191 129129396 1.01
tpch_q12/datafusion:parquet 216053970 212951609 1.01
tpch_q13/datafusion:parquet 339528645 339516331 1.00
tpch_q14/datafusion:parquet 157442266 162038044 0.97
tpch_q15/datafusion:parquet 245460915 244612715 1.00
tpch_q16/datafusion:parquet 135797394 137705041 0.99
tpch_q17/datafusion:parquet 684593986 700676071 0.98
tpch_q18/datafusion:parquet 869445093 875646545 0.99
tpch_q19/datafusion:parquet 265416513 268027558 0.99
tpch_q20/datafusion:parquet 307091971 308714781 0.99
tpch_q21/datafusion:parquet 738864956 739537415 1.00
tpch_q22/datafusion:parquet 218381959 217836663 1.00
datafusion / arrow (0.983x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 579153957 582479178 0.99
tpch_q02/datafusion:arrow 162928529 162151976 1.00
tpch_q03/datafusion:arrow 435628195 446920412 0.97
tpch_q04/datafusion:arrow 330379259 339444083 0.97
tpch_q05/datafusion:arrow 865428778 891857165 0.97
tpch_q06/datafusion:arrow 258033143 266640857 0.97
tpch_q07/datafusion:arrow 1080448508 1090262694 0.99
tpch_q08/datafusion:arrow 1068131541 1092497929 0.98
tpch_q09/datafusion:arrow 1257637308 1300473558 0.97
tpch_q10/datafusion:arrow 570948172 577151098 0.99
tpch_q11/datafusion:arrow 144308801 145308934 0.99
tpch_q12/datafusion:arrow 636728674 640200279 0.99
tpch_q13/datafusion:arrow 509599252 518057587 0.98
tpch_q14/datafusion:arrow 284030368 293253627 0.97
tpch_q15/datafusion:arrow 607113829 626713970 0.97
tpch_q16/datafusion:arrow 107166475 104659459 1.02
tpch_q17/datafusion:arrow 1269974846 1303684406 0.97
tpch_q18/datafusion:arrow 1738783678 1784948125 0.97
tpch_q19/datafusion:arrow 479641800 481108284 1.00
tpch_q20/datafusion:arrow 462995293 471675274 0.98
tpch_q21/datafusion:arrow 2714040631 2761886018 0.98
tpch_q22/datafusion:arrow 137877123 139976168 0.99
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 176730445 175043255 1.01
tpch_q02/duckdb:vortex-file-compressed 51813687 53233654 0.97
tpch_q03/duckdb:vortex-file-compressed 131524275 132280295 0.99
tpch_q04/duckdb:vortex-file-compressed 160751297 161086498 1.00
tpch_q05/duckdb:vortex-file-compressed 133072785 133346397 1.00
tpch_q06/duckdb:vortex-file-compressed 50811949 48685795 1.04
tpch_q07/duckdb:vortex-file-compressed 154425346 153488954 1.01
tpch_q08/duckdb:vortex-file-compressed 179676043 178888892 1.00
tpch_q09/duckdb:vortex-file-compressed 336911004 336561437 1.00
tpch_q10/duckdb:vortex-file-compressed 162981085 163667548 1.00
tpch_q11/duckdb:vortex-file-compressed 35380256 34494609 1.03
tpch_q12/duckdb:vortex-file-compressed 97083546 98275350 0.99
tpch_q13/duckdb:vortex-file-compressed 241005430 240620740 1.00
tpch_q14/duckdb:vortex-file-compressed 70533959 70295680 1.00
tpch_q15/duckdb:vortex-file-compressed 96668300 96516342 1.00
tpch_q16/duckdb:vortex-file-compressed 82701883 81563833 1.01
tpch_q17/duckdb:vortex-file-compressed 100697420 101642689 0.99
tpch_q18/duckdb:vortex-file-compressed 302853251 296435483 1.02
tpch_q19/duckdb:vortex-file-compressed 90033164 91450486 0.98
tpch_q20/duckdb:vortex-file-compressed 164901262 165671936 1.00
tpch_q21/duckdb:vortex-file-compressed 591173649 589630007 1.00
tpch_q22/duckdb:vortex-file-compressed 77275595 77804487 0.99
duckdb / vortex-compact (1.000x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 236479657 236088295 1.00
tpch_q02/duckdb:vortex-compact 57343767 59013515 0.97
tpch_q03/duckdb:vortex-compact 141100148 139368988 1.01
tpch_q04/duckdb:vortex-compact 174600036 174498754 1.00
tpch_q05/duckdb:vortex-compact 147357870 146349615 1.01
tpch_q06/duckdb:vortex-compact 84407870 83409113 1.01
tpch_q07/duckdb:vortex-compact 203334302 202503112 1.00
tpch_q08/duckdb:vortex-compact 189978363 187121886 1.02
tpch_q09/duckdb:vortex-compact 358356660 360643924 0.99
tpch_q10/duckdb:vortex-compact 186516593 185521751 1.01
tpch_q11/duckdb:vortex-compact 41116466 41095331 1.00
tpch_q12/duckdb:vortex-compact 203190827 201472668 1.01
tpch_q13/duckdb:vortex-compact 292492313 294842374 0.99
tpch_q14/duckdb:vortex-compact 102975589 103868294 0.99
tpch_q15/duckdb:vortex-compact 119317118 117993460 1.01
tpch_q16/duckdb:vortex-compact 86480924 86132833 1.00
tpch_q17/duckdb:vortex-compact 116392078 115647320 1.01
tpch_q18/duckdb:vortex-compact 292817983 292263063 1.00
tpch_q19/duckdb:vortex-compact 113371848 115458497 0.98
tpch_q20/duckdb:vortex-compact 204435513 204098356 1.00
tpch_q21/duckdb:vortex-compact 623741942 618986797 1.01
tpch_q22/duckdb:vortex-compact 88382550 90574651 0.98
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257403027 257717833 1.00
tpch_q02/duckdb:parquet 97044696 100463949 0.97
tpch_q03/duckdb:parquet 205359190 205915369 1.00
tpch_q04/duckdb:parquet 129929168 130948439 0.99
tpch_q05/duckdb:parquet 215420975 216781241 0.99
tpch_q06/duckdb:parquet 63579752 66216998 0.96
tpch_q07/duckdb:parquet 176877081 179862886 0.98
tpch_q08/duckdb:parquet 250074353 252653394 0.99
tpch_q09/duckdb:parquet 500733634 493771696 1.01
tpch_q10/duckdb:parquet 610027190 608013530 1.00
tpch_q11/duckdb:parquet 57490315 57470634 1.00
tpch_q12/duckdb:parquet 124206349 121086311 1.03
tpch_q13/duckdb:parquet 448195878 447897600 1.00
tpch_q14/duckdb:parquet 169434957 173369111 0.98
tpch_q15/duckdb:parquet 94838840 95730671 0.99
tpch_q16/duckdb:parquet 157734491 160212118 0.98
tpch_q17/duckdb:parquet 177499602 175136897 1.01
tpch_q18/duckdb:parquet 347999747 351397937 0.99
tpch_q19/duckdb:parquet 281920417 279196458 1.01
tpch_q20/duckdb:parquet 228752613 231559382 0.99
tpch_q21/duckdb:parquet 556308354 557921369 1.00
tpch_q22/duckdb:parquet 289499397 290134633 1.00
duckdb / duckdb (0.995x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117621430 117390965 1.00
tpch_q02/duckdb:duckdb 46868634 44841490 1.05
tpch_q03/duckdb:duckdb 96614454 97918283 0.99
tpch_q04/duckdb:duckdb 127124281 131861984 0.96
tpch_q05/duckdb:duckdb 108361950 109632567 0.99
tpch_q06/duckdb:duckdb 37370985 37388323 1.00
tpch_q07/duckdb:duckdb 86626386 86539527 1.00
tpch_q08/duckdb:duckdb 110208164 109887011 1.00
tpch_q09/duckdb:duckdb 273601354 278278025 0.98
tpch_q10/duckdb:duckdb 203184126 203052898 1.00
tpch_q11/duckdb:duckdb 15101730 15616324 0.97
tpch_q12/duckdb:duckdb 84651185 84883584 1.00
tpch_q13/duckdb:duckdb 218775852 219206519 1.00
tpch_q14/duckdb:duckdb 69760106 71455239 0.98
tpch_q15/duckdb:duckdb 77056153 77482611 0.99
tpch_q16/duckdb:duckdb 74156819 73346491 1.01
tpch_q17/duckdb:duckdb 84625275 85240668 0.99
tpch_q18/duckdb:duckdb 212723501 211163949 1.01
tpch_q19/duckdb:duckdb 114750053 115977168 0.99
tpch_q20/duckdb:duckdb 111930993 111469185 1.00
tpch_q21/duckdb:duckdb 297299058 296027107 1.00
tpch_q22/duckdb:duckdb 66584130 68097519 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.6% +1.4% -1.9% +10.0% ➖ noise
1 datafusion:vortex-compact -2.2% +1.4% -3.6% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +3.9% +1.4% +2.5% +10.0% ➖ noise
1 duckdb:duckdb +0.2% +1.4% -1.2% +10.0% ➖ noise
1 duckdb:vortex-compact +0.2% +1.4% -1.2% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.0% +1.4% -0.4% +10.0% ➖ noise
2 datafusion:arrow +0.5% -2.0% +2.5% +10.0% ➖ noise
2 datafusion:vortex-compact -0.7% -2.0% +1.3% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.8% -2.0% +0.2% +10.0% ➖ noise
2 duckdb:duckdb +4.5% -2.0% +6.6% +10.0% ➖ noise
2 duckdb:vortex-compact -2.8% -2.0% -0.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.7% -2.0% -0.7% +10.0% ➖ noise
3 datafusion:arrow -2.5% -0.4% -2.1% +10.0% ➖ noise
3 datafusion:vortex-compact -0.1% -0.4% +0.3% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -1.9% -0.4% -1.5% +10.0% ➖ noise
3 duckdb:duckdb -1.3% -0.4% -0.9% +10.0% ➖ noise
3 duckdb:vortex-compact +1.2% -0.4% +1.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.6% -0.4% -0.2% +10.0% ➖ noise
4 datafusion:arrow -2.7% -0.2% -2.5% +10.0% ➖ noise
4 datafusion:vortex-compact +0.7% -0.2% +0.9% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -1.8% -0.2% -1.6% +10.0% ➖ noise
4 duckdb:duckdb -3.6% -0.2% -3.4% +10.0% ➖ noise
4 duckdb:vortex-compact +0.1% -0.2% +0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.2% -0.2% -0.0% +10.0% ➖ noise
5 datafusion:arrow -3.0% -1.8% -1.2% +10.0% ➖ noise
5 datafusion:vortex-compact -1.0% -1.8% +0.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.5% -1.8% +0.3% +10.0% ➖ noise
5 duckdb:duckdb -1.2% -1.8% +0.6% +10.0% ➖ noise
5 duckdb:vortex-compact +0.7% -1.8% +2.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.2% -1.8% +1.6% +10.0% ➖ noise
6 datafusion:arrow -3.2% +0.5% -3.7% +10.0% ➖ noise
6 datafusion:vortex-compact +0.2% +0.5% -0.3% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.6% +0.5% -3.1% +10.0% ➖ noise
6 duckdb:duckdb -0.0% +0.5% -0.5% +10.1% ➖ noise
6 duckdb:vortex-compact +1.2% +0.5% +0.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +4.4% +0.5% +3.8% +10.0% ➖ noise
7 datafusion:arrow -0.9% -1.3% +0.5% +10.0% ➖ noise
7 datafusion:vortex-compact -1.1% -1.3% +0.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.0% -1.3% +0.4% +10.0% ➖ noise
7 duckdb:duckdb +0.1% -1.3% +1.5% +10.0% ➖ noise
7 duckdb:vortex-compact +0.4% -1.3% +1.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% -1.3% +2.0% +10.0% ➖ noise
8 datafusion:arrow -2.2% +0.0% -2.3% +10.0% ➖ noise
8 datafusion:vortex-compact -0.7% +0.0% -0.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -1.1% +0.0% -1.1% +10.0% ➖ noise
8 duckdb:duckdb +0.3% +0.0% +0.3% +10.0% ➖ noise
8 duckdb:vortex-compact +1.5% +0.0% +1.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.4% +0.0% +0.4% +10.0% ➖ noise
9 datafusion:arrow -3.3% +0.2% -3.5% +10.0% ➖ noise
9 datafusion:vortex-compact -1.7% +0.2% -1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.2% +0.2% -1.4% +10.0% ➖ noise
9 duckdb:duckdb -1.7% +0.2% -1.9% +10.0% ➖ noise
9 duckdb:vortex-compact -0.6% +0.2% -0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.1% +0.2% -0.1% +10.0% ➖ noise
10 datafusion:arrow -1.1% +0.6% -1.7% +10.0% ➖ noise
10 datafusion:vortex-compact -3.1% +0.6% -3.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.9% +0.6% -1.5% +10.0% ➖ noise
10 duckdb:duckdb +0.1% +0.6% -0.5% +10.0% ➖ noise
10 duckdb:vortex-compact +0.5% +0.6% -0.1% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.4% +0.6% -1.0% +10.0% ➖ noise
11 datafusion:arrow -0.7% +0.7% -1.3% +10.0% ➖ noise
11 datafusion:vortex-compact -0.8% +0.7% -1.4% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -1.2% +0.7% -1.8% +10.0% ➖ noise
11 duckdb:duckdb -3.3% +0.7% -3.9% +10.6% ➖ noise
11 duckdb:vortex-compact +0.1% +0.7% -0.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.6% +0.7% +1.9% +10.9% ➖ noise
12 datafusion:arrow -0.5% +2.0% -2.5% +27.3% ➖ noise
12 datafusion:vortex-compact -0.6% +2.0% -2.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -1.3% +2.0% -3.2% +10.0% ➖ noise
12 duckdb:duckdb -0.3% +2.0% -2.2% +10.0% ➖ noise
12 duckdb:vortex-compact +0.9% +2.0% -1.1% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.2% +2.0% -3.2% +10.0% ➖ noise
13 datafusion:arrow -1.6% +0.0% -1.7% +10.0% ➖ noise
13 datafusion:vortex-compact -1.2% +0.0% -1.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.6% +0.0% -0.6% +10.0% ➖ noise
13 duckdb:duckdb -0.2% +0.0% -0.2% +10.0% ➖ noise
13 duckdb:vortex-compact -0.8% +0.0% -0.8% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.2% +0.0% +0.1% +10.0% ➖ noise
14 datafusion:arrow -3.1% -2.6% -0.6% +10.0% ➖ noise
14 datafusion:vortex-compact -1.5% -2.6% +1.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.4% -2.6% +3.1% +10.0% ➖ noise
14 duckdb:duckdb -2.4% -2.6% +0.2% +10.0% ➖ noise
14 duckdb:vortex-compact -0.9% -2.6% +1.7% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +0.3% -2.6% +3.0% +10.0% ➖ noise
15 datafusion:arrow -3.1% -0.3% -2.8% +10.0% ➖ noise
15 datafusion:vortex-compact -0.2% -0.3% +0.1% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +0.1% -0.3% +0.4% +10.0% ➖ noise
15 duckdb:duckdb -0.6% -0.3% -0.3% +10.0% ➖ noise
15 duckdb:vortex-compact +1.1% -0.3% +1.4% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.2% -0.3% +0.5% +10.0% ➖ noise
16 datafusion:arrow +2.4% -1.5% +3.9% +10.0% ➖ noise
16 datafusion:vortex-compact -0.8% -1.5% +0.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -0.6% -1.5% +0.8% +10.0% ➖ noise
16 duckdb:duckdb +1.1% -1.5% +2.6% +10.0% ➖ noise
16 duckdb:vortex-compact +0.4% -1.5% +1.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.4% -1.5% +2.9% +10.0% ➖ noise
17 datafusion:arrow -2.6% -0.5% -2.1% +10.0% ➖ noise
17 datafusion:vortex-compact -2.0% -0.5% -1.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -2.0% -0.5% -1.5% +10.0% ➖ noise
17 duckdb:duckdb -0.7% -0.5% -0.2% +10.0% ➖ noise
17 duckdb:vortex-compact +0.6% -0.5% +1.1% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.9% -0.5% -0.4% +10.0% ➖ noise
18 datafusion:arrow -2.6% -0.8% -1.8% +10.0% ➖ noise
18 datafusion:vortex-compact -0.9% -0.8% -0.1% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.6% -0.8% +0.2% +10.0% ➖ noise
18 duckdb:duckdb +0.7% -0.8% +1.6% +10.0% ➖ noise
18 duckdb:vortex-compact +0.2% -0.8% +1.0% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +2.2% -0.8% +3.0% +10.0% ➖ noise
19 datafusion:arrow -0.3% -0.0% -0.3% +10.0% ➖ noise
19 datafusion:vortex-compact +0.2% -0.0% +0.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -2.6% -0.0% -2.6% +10.0% ➖ noise
19 duckdb:duckdb -1.1% -0.0% -1.1% +10.0% ➖ noise
19 duckdb:vortex-compact -1.8% -0.0% -1.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -1.5% -0.0% -1.5% +10.0% ➖ noise
20 datafusion:arrow -1.8% -0.9% -1.0% +10.0% ➖ noise
20 datafusion:vortex-compact -0.3% -0.9% +0.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.4% -0.9% -0.5% +10.0% ➖ noise
20 duckdb:duckdb +0.4% -0.9% +1.3% +10.0% ➖ noise
20 duckdb:vortex-compact +0.2% -0.9% +1.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -0.5% -0.9% +0.4% +10.0% ➖ noise
21 datafusion:arrow -1.7% -0.2% -1.5% +10.0% ➖ noise
21 datafusion:vortex-compact -0.2% -0.2% -0.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.7% -0.2% -0.5% +10.0% ➖ noise
21 duckdb:duckdb +0.4% -0.2% +0.6% +10.0% ➖ noise
21 duckdb:vortex-compact +0.8% -0.2% +1.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +0.3% -0.2% +0.5% +10.0% ➖ noise
22 datafusion:arrow -1.5% +0.0% -1.5% +10.0% ➖ noise
22 datafusion:vortex-compact -2.9% +0.0% -2.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.1% +0.0% -1.1% +10.0% ➖ noise
22 duckdb:duckdb -2.2% +0.0% -2.2% +10.0% ➖ noise
22 duckdb:vortex-compact -2.4% +0.0% -2.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -0.7% +0.0% -0.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.2%
Vortex (geomean): 0.999x ➖
Parquet (geomean): 0.977x ➖
Shifts: Parquet (control) -2.3% · Median polish -0.8%


duckdb / vortex-file-compressed (1.001x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11170911 10993628 1.02
statpopgen_q01/duckdb:vortex-file-compressed 21008159 22155881 0.95
statpopgen_q02/duckdb:vortex-file-compressed 1367602482 1386885394 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3340480305 3109725784 1.07
statpopgen_q04/duckdb:vortex-file-compressed 3139811028 3139165372 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1430244495 1461820891 0.98
statpopgen_q06/duckdb:vortex-file-compressed 2112872528 2140748294 0.99
statpopgen_q07/duckdb:vortex-file-compressed 222033393 220605175 1.01
statpopgen_q08/duckdb:vortex-file-compressed 265054832 259051861 1.02
statpopgen_q09/duckdb:vortex-file-compressed 2871196598 2897596987 0.99
statpopgen_q10/duckdb:vortex-file-compressed 4721898382 4711531270 1.00
duckdb / vortex-compact (0.997x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11299729 11040143 1.02
statpopgen_q01/duckdb:vortex-compact 166630017 166012577 1.00
statpopgen_q02/duckdb:vortex-compact 1812780354 1835566624 0.99
statpopgen_q03/duckdb:vortex-compact 3420290982 3488402913 0.98
statpopgen_q04/duckdb:vortex-compact 3455484027 3521477300 0.98
statpopgen_q05/duckdb:vortex-compact 1872160116 1858640453 1.01
statpopgen_q06/duckdb:vortex-compact 2675700716 2695583390 0.99
statpopgen_q07/duckdb:vortex-compact 880368095 885570585 0.99
statpopgen_q08/duckdb:vortex-compact 925154350 916518994 1.01
statpopgen_q09/duckdb:vortex-compact 3287934412 3353909491 0.98
statpopgen_q10/duckdb:vortex-compact 5399276895 5383160233 1.00
duckdb / parquet (0.977x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 319092556 334768223 0.95
statpopgen_q01/duckdb:parquet 406601031 418802444 0.97
statpopgen_q02/duckdb:parquet 1005425600 1024861793 0.98
statpopgen_q03/duckdb:parquet 1506052453 1534369686 0.98
statpopgen_q04/duckdb:parquet 1527440323 1539448079 0.99
statpopgen_q05/duckdb:parquet 1008901005 1040745076 0.97
statpopgen_q06/duckdb:parquet 1498645988 1517080658 0.99
statpopgen_q07/duckdb:parquet 1311521351 1320485259 0.99
statpopgen_q08/duckdb:parquet 1327957146 1330760390 1.00
statpopgen_q09/duckdb:parquet 1325822529 1375316084 0.96
statpopgen_q10/duckdb:parquet 2641021911 2746528904 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +2.4% -4.7% +7.4% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +1.6% -4.7% +6.6% +10.0% ➖ noise
1 duckdb:vortex-compact +0.4% -2.9% +3.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -5.2% -2.9% -2.3% +271.6% ➖ noise
2 duckdb:vortex-compact -1.2% -1.9% +0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.4% -1.9% +0.5% +10.0% ➖ noise
3 duckdb:vortex-compact -2.0% -1.8% -0.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +7.4% -1.8% +9.4% +10.0% ➖ noise
4 duckdb:vortex-compact -1.9% -0.8% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.0% -0.8% +0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +0.7% -3.1% +3.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.2% -3.1% +0.9% +10.0% ➖ noise
6 duckdb:vortex-compact -0.7% -1.2% +0.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.3% -1.2% -0.1% +10.0% ➖ noise
7 duckdb:vortex-compact -0.6% -0.7% +0.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% -0.7% +1.3% +10.0% ➖ noise
8 duckdb:vortex-compact +0.9% -0.2% +1.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.3% -0.2% +2.5% +10.0% ➖ noise
9 duckdb:vortex-compact -2.0% -3.6% +1.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.9% -3.6% +2.8% +10.0% ➖ noise
10 duckdb:vortex-compact +0.3% -3.8% +4.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.2% -3.8% +4.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -7.7%
Vortex (geomean): 0.954x ➖
Parquet (geomean): 1.034x ➖
Shifts: Parquet (control) +3.4% · Median polish +1.0%


datafusion / vortex-file-compressed (0.932x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 222976833 222038154 1.00
tpch_q02/datafusion:vortex-file-compressed 547705280 469736879 1.17
tpch_q03/datafusion:vortex-file-compressed 416185268 383517031 1.09
tpch_q04/datafusion:vortex-file-compressed 267299893 222172264 1.20
tpch_q05/datafusion:vortex-file-compressed 505704362 545000143 0.93
tpch_q06/datafusion:vortex-file-compressed 307817113 380553601 0.81
tpch_q07/datafusion:vortex-file-compressed 439327004 606910043 0.72
tpch_q08/datafusion:vortex-file-compressed 591471912 683277187 0.87
tpch_q09/datafusion:vortex-file-compressed 412796747 529867791 0.78
tpch_q10/datafusion:vortex-file-compressed 493217643 571952835 0.86
tpch_q11/datafusion:vortex-file-compressed 341224422 403863418 0.84
tpch_q12/datafusion:vortex-file-compressed 362454545 441718116 0.82
tpch_q13/datafusion:vortex-file-compressed 176386864 157346497 1.12
tpch_q14/datafusion:vortex-file-compressed 230678420 262485696 0.88
tpch_q15/datafusion:vortex-file-compressed 353075911 356771124 0.99
tpch_q16/datafusion:vortex-file-compressed 233535807 203298523 1.15
tpch_q17/datafusion:vortex-file-compressed 379205901 427835099 0.89
tpch_q18/datafusion:vortex-file-compressed 356304370 399799954 0.89
tpch_q19/datafusion:vortex-file-compressed 378437380 529284762 0.71
tpch_q20/datafusion:vortex-file-compressed 392778078 392116890 1.00
tpch_q21/datafusion:vortex-file-compressed 453876844 443395345 1.02
tpch_q22/datafusion:vortex-file-compressed 164788975 166913543 0.99
datafusion / vortex-compact (0.907x ➖, 2↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 255844956 248700101 1.03
tpch_q02/datafusion:vortex-compact 420236934 422772626 0.99
tpch_q03/datafusion:vortex-compact 414743118 416593895 1.00
tpch_q04/datafusion:vortex-compact 246700888 278223379 0.89
tpch_q05/datafusion:vortex-compact 540050662 450283470 1.20
tpch_q06/datafusion:vortex-compact 405659396 389917428 1.04
tpch_q07/datafusion:vortex-compact 377722482 480791263 0.79
tpch_q08/datafusion:vortex-compact 640396249 551206818 1.16
tpch_q09/datafusion:vortex-compact 432985438 406333871 1.07
tpch_q10/datafusion:vortex-compact 590456187 462425299 1.28
tpch_q11/datafusion:vortex-compact 349570967 323096883 1.08
tpch_q12/datafusion:vortex-compact 459895780 596092816 0.77
tpch_q13/datafusion:vortex-compact 🚀 129008401 195075920 0.66
tpch_q14/datafusion:vortex-compact 🚀 260532012 394658892 0.66
tpch_q15/datafusion:vortex-compact 527454120 720424764 0.73
tpch_q16/datafusion:vortex-compact 196745278 209731952 0.94
tpch_q17/datafusion:vortex-compact 334971473 420368404 0.80
tpch_q18/datafusion:vortex-compact 301769447 356906528 0.85
tpch_q19/datafusion:vortex-compact 464252097 616622537 0.75
tpch_q20/datafusion:vortex-compact 482477422 552033034 0.87
tpch_q21/datafusion:vortex-compact 598166459 626967966 0.95
tpch_q22/datafusion:vortex-compact 143115971 180183872 0.79
datafusion / parquet (1.060x ➖, 2↑ 6↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 246872968 238875126 1.03
tpch_q02/datafusion:parquet 🚨 573004435 411047296 1.39
tpch_q03/datafusion:parquet 358234008 313273176 1.14
tpch_q04/datafusion:parquet 236497079 188105161 1.26
tpch_q05/datafusion:parquet 549575495 486147440 1.13
tpch_q06/datafusion:parquet 🚨 237803238 166864844 1.43
tpch_q07/datafusion:parquet 580471902 581238729 1.00
tpch_q08/datafusion:parquet 🚀 646767751 947031810 0.68
tpch_q09/datafusion:parquet 558562119 538022860 1.04
tpch_q10/datafusion:parquet 589247362 519744086 1.13
tpch_q11/datafusion:parquet 🚨 468363225 340332767 1.38
tpch_q12/datafusion:parquet 253020960 252984828 1.00
tpch_q13/datafusion:parquet 432352136 433730375 1.00
tpch_q14/datafusion:parquet 174755491 220313667 0.79
tpch_q15/datafusion:parquet 296565268 340599847 0.87
tpch_q16/datafusion:parquet 182668225 183989280 0.99
tpch_q17/datafusion:parquet 350037092 481387202 0.73
tpch_q18/datafusion:parquet 🚨 795084689 555526525 1.43
tpch_q19/datafusion:parquet 🚨 568077434 370301385 1.53
tpch_q20/datafusion:parquet 🚨 475733218 357078777 1.33
tpch_q21/datafusion:parquet 754503977 633010305 1.19
tpch_q22/datafusion:parquet 🚀 125211362 224053225 0.56
duckdb / vortex-file-compressed (0.983x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 313736285 277452088 1.13
tpch_q02/duckdb:vortex-file-compressed 1018452298 983328400 1.04
tpch_q03/duckdb:vortex-file-compressed 710379362 658185563 1.08
tpch_q04/duckdb:vortex-file-compressed 359775353 505017449 0.71
tpch_q05/duckdb:vortex-file-compressed 844245009 841449258 1.00
tpch_q06/duckdb:vortex-file-compressed 450921169 406109759 1.11
tpch_q07/duckdb:vortex-file-compressed 729979048 746621979 0.98
tpch_q08/duckdb:vortex-file-compressed 1110281363 1044574717 1.06
tpch_q09/duckdb:vortex-file-compressed 944863181 884159660 1.07
tpch_q10/duckdb:vortex-file-compressed 693873110 760425984 0.91
tpch_q11/duckdb:vortex-file-compressed 488423008 542644199 0.90
tpch_q12/duckdb:vortex-file-compressed 530147304 483624107 1.10
tpch_q13/duckdb:vortex-file-compressed 461337427 521130570 0.89
tpch_q14/duckdb:vortex-file-compressed 412301289 540798141 0.76
tpch_q15/duckdb:vortex-file-compressed 263553611 273872853 0.96
tpch_q16/duckdb:vortex-file-compressed 387288755 366238756 1.06
tpch_q17/duckdb:vortex-file-compressed 778146228 758979783 1.03
tpch_q18/duckdb:vortex-file-compressed 579104593 608345619 0.95
tpch_q19/duckdb:vortex-file-compressed 515341147 475848072 1.08
tpch_q20/duckdb:vortex-file-compressed 783634473 888060206 0.88
tpch_q21/duckdb:vortex-file-compressed 1167692475 1042167530 1.12
tpch_q22/duckdb:vortex-file-compressed 354932382 370430769 0.96
duckdb / vortex-compact (0.998x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 339650877 306385735 1.11
tpch_q02/duckdb:vortex-compact 974733021 939936344 1.04
tpch_q03/duckdb:vortex-compact 624665965 573154932 1.09
tpch_q04/duckdb:vortex-compact 376193038 379924191 0.99
tpch_q05/duckdb:vortex-compact 803103657 940766911 0.85
tpch_q06/duckdb:vortex-compact 409107387 366216509 1.12
tpch_q07/duckdb:vortex-compact 697854647 796013429 0.88
tpch_q08/duckdb:vortex-compact 974845417 977409329 1.00
tpch_q09/duckdb:vortex-compact 963107534 877993089 1.10
tpch_q10/duckdb:vortex-compact 709265254 704964046 1.01
tpch_q11/duckdb:vortex-compact 484406921 483687956 1.00
tpch_q12/duckdb:vortex-compact 452646926 451590193 1.00
tpch_q13/duckdb:vortex-compact 449118475 486440506 0.92
tpch_q14/duckdb:vortex-compact 462259034 625698538 0.74
tpch_q15/duckdb:vortex-compact 313219280 311052190 1.01
tpch_q16/duckdb:vortex-compact 351354651 359438181 0.98
tpch_q17/duckdb:vortex-compact 702079263 716172129 0.98
tpch_q18/duckdb:vortex-compact 519100146 479950912 1.08
tpch_q19/duckdb:vortex-compact 460661584 423571664 1.09
tpch_q20/duckdb:vortex-compact 756234017 798777079 0.95
tpch_q21/duckdb:vortex-compact 1199231396 1081980435 1.11
tpch_q22/duckdb:vortex-compact 389344012 382841748 1.02
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 462211209 404684628 1.14
tpch_q02/duckdb:parquet 1265668313 1224059243 1.03
tpch_q03/duckdb:parquet 1063824722 993691791 1.07
tpch_q04/duckdb:parquet 660582101 648080836 1.02
tpch_q05/duckdb:parquet 1505497783 1713479937 0.88
tpch_q06/duckdb:parquet 464463230 441155417 1.05
tpch_q07/duckdb:parquet 1322302414 1283486265 1.03
tpch_q08/duckdb:parquet 2072768340 1853521253 1.12
tpch_q09/duckdb:parquet 1548171461 1475676912 1.05
tpch_q10/duckdb:parquet 1370370883 1338757033 1.02
tpch_q11/duckdb:parquet 827350667 874593815 0.95
tpch_q12/duckdb:parquet 784695058 917753977 0.86
tpch_q13/duckdb:parquet 895397071 892244449 1.00
tpch_q14/duckdb:parquet 692451671 634974445 1.09
tpch_q15/duckdb:parquet 527415418 555685752 0.95
tpch_q16/duckdb:parquet 659250643 637446452 1.03
tpch_q17/duckdb:parquet 848777632 747529334 1.14
tpch_q18/duckdb:parquet 857963596 900150420 0.95
tpch_q19/duckdb:parquet 785531544 834129777 0.94
tpch_q20/duckdb:parquet 1140416511 1098146543 1.04
tpch_q21/duckdb:parquet 1102692477 1176223361 0.94
tpch_q22/duckdb:parquet 605619025 635727863 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.9% +8.6% -5.3% +65.9% ➖ noise
1 datafusion:vortex-file-compressed +0.4% +8.6% -7.6% +76.6% ➖ noise
1 duckdb:vortex-compact +10.9% +8.6% +2.0% +53.3% ➖ noise
1 duckdb:vortex-file-compressed +13.1% +8.6% +4.1% +44.3% ➖ noise
2 datafusion:vortex-compact -0.6% +20.1% -17.2% +38.9% ➖ noise
2 datafusion:vortex-file-compressed +16.6% +20.1% -2.9% +39.9% ➖ noise
2 duckdb:vortex-compact +3.7% +20.1% -13.6% +38.9% ➖ noise
2 duckdb:vortex-file-compressed +3.6% +20.1% -13.7% +38.9% ➖ noise
3 datafusion:vortex-compact -0.4% +10.6% -10.0% +44.5% ➖ noise
3 datafusion:vortex-file-compressed +8.5% +10.6% -1.9% +66.2% ➖ noise
3 duckdb:vortex-compact +9.0% +10.6% -1.5% +38.9% ➖ noise
3 duckdb:vortex-file-compressed +7.9% +10.6% -2.5% +38.9% ➖ noise
4 datafusion:vortex-compact -11.3% +13.2% -21.7% +40.0% ➖ noise
4 datafusion:vortex-file-compressed +20.3% +13.2% +6.3% +38.9% ➖ noise
4 duckdb:vortex-compact -1.0% +13.2% -12.5% +38.9% ➖ noise
4 duckdb:vortex-file-compressed -28.8% +13.2% -37.1% +40.9% ✅ faster
5 datafusion:vortex-compact +19.9% -0.3% +20.3% +38.9% ➖ noise
5 datafusion:vortex-file-compressed -7.2% -0.3% -6.9% +38.9% ➖ noise
5 duckdb:vortex-compact -14.6% -0.3% -14.3% +38.9% ➖ noise
5 duckdb:vortex-file-compressed +0.3% -0.3% +0.7% +38.9% ➖ noise
6 datafusion:vortex-compact +4.0% +22.5% -15.1% +38.9% ➖ noise
6 datafusion:vortex-file-compressed -19.1% +22.5% -34.0% +38.9% ✅ faster
6 duckdb:vortex-compact +11.7% +22.5% -8.8% +38.9% ➖ noise
6 duckdb:vortex-file-compressed +11.0% +22.5% -9.4% +38.9% ➖ noise
7 datafusion:vortex-compact -21.4% +1.4% -22.5% +38.9% ➖ noise
7 datafusion:vortex-file-compressed -27.6% +1.4% -28.6% +38.9% ✅ faster
7 duckdb:vortex-compact -12.3% +1.4% -13.6% +38.9% ➖ noise
7 duckdb:vortex-file-compressed -2.2% +1.4% -3.6% +38.9% ➖ noise
8 datafusion:vortex-compact +16.2% -12.6% +32.9% +38.9% ➖ noise
8 datafusion:vortex-file-compressed -13.4% -12.6% -0.9% +38.9% ➖ noise
8 duckdb:vortex-compact -0.3% -12.6% +14.1% +38.9% ➖ noise
8 duckdb:vortex-file-compressed +6.3% -12.6% +21.6% +38.9% ➖ noise
9 datafusion:vortex-compact +6.6% +4.4% +2.1% +38.9% ➖ noise
9 datafusion:vortex-file-compressed -22.1% +4.4% -25.4% +38.9% ➖ noise
9 duckdb:vortex-compact +9.7% +4.4% +5.1% +38.9% ➖ noise
9 duckdb:vortex-file-compressed +6.9% +4.4% +2.4% +38.9% ➖ noise
10 datafusion:vortex-compact +27.7% +7.7% +18.5% +38.9% ➖ noise
10 datafusion:vortex-file-compressed -13.8% +7.7% -20.0% +38.9% ➖ noise
10 duckdb:vortex-compact +0.6% +7.7% -6.6% +38.9% ➖ noise
10 duckdb:vortex-file-compressed -8.8% +7.7% -15.3% +38.9% ➖ noise
11 datafusion:vortex-compact +8.2% +14.1% -5.2% +39.4% ➖ noise
11 datafusion:vortex-file-compressed -15.5% +14.1% -26.0% +38.9% ➖ noise
11 duckdb:vortex-compact +0.1% +14.1% -12.2% +38.9% ➖ noise
11 duckdb:vortex-file-compressed -10.0% +14.1% -21.1% +38.9% ➖ noise
12 datafusion:vortex-compact -22.8% -7.5% -16.6% +38.9% ➖ noise
12 datafusion:vortex-file-compressed -17.9% -7.5% -11.3% +38.9% ➖ noise
12 duckdb:vortex-compact +0.2% -7.5% +8.4% +38.9% ➖ noise
12 duckdb:vortex-file-compressed +9.6% -7.5% +18.5% +38.9% ➖ noise
13 datafusion:vortex-compact -33.9% +0.0% -33.9% +52.0% ➖ noise
13 datafusion:vortex-file-compressed +12.1% +0.0% +12.1% +38.9% ➖ noise
13 duckdb:vortex-compact -7.7% +0.0% -7.7% +38.9% ➖ noise
13 duckdb:vortex-file-compressed -11.5% +0.0% -11.5% +38.9% ➖ noise
14 datafusion:vortex-compact -34.0% -7.0% -29.0% +38.9% ✅ faster
14 datafusion:vortex-file-compressed -12.1% -7.0% -5.5% +38.9% ➖ noise
14 duckdb:vortex-compact -26.1% -7.0% -20.6% +38.9% ➖ noise
14 duckdb:vortex-file-compressed -23.8% -7.0% -18.0% +38.9% ➖ noise
15 datafusion:vortex-compact -26.8% -9.1% -19.5% +38.9% ➖ noise
15 datafusion:vortex-file-compressed -1.0% -9.1% +8.9% +38.9% ➖ noise
15 duckdb:vortex-compact +0.7% -9.1% +10.8% +38.9% ➖ noise
15 duckdb:vortex-file-compressed -3.8% -9.1% +5.9% +38.9% ➖ noise
16 datafusion:vortex-compact -6.2% +1.3% -7.4% +38.9% ➖ noise
16 datafusion:vortex-file-compressed +14.9% +1.3% +13.4% +38.9% ➖ noise
16 duckdb:vortex-compact -2.2% +1.3% -3.5% +38.9% ➖ noise
16 duckdb:vortex-file-compressed +5.7% +1.3% +4.4% +38.9% ➖ noise
17 datafusion:vortex-compact -20.3% -9.1% -12.3% +38.9% ➖ noise
17 datafusion:vortex-file-compressed -11.4% -9.1% -2.5% +41.8% ➖ noise
17 duckdb:vortex-compact -2.0% -9.1% +7.9% +38.9% ➖ noise
17 duckdb:vortex-file-compressed +2.5% -9.1% +12.8% +38.9% ➖ noise
18 datafusion:vortex-compact -15.4% +16.8% -27.6% +38.9% ➖ noise
18 datafusion:vortex-file-compressed -10.9% +16.8% -23.7% +38.9% ➖ noise
18 duckdb:vortex-compact +8.2% +16.8% -7.4% +38.9% ➖ noise
18 duckdb:vortex-file-compressed -4.8% +16.8% -18.5% +38.9% ➖ noise
19 datafusion:vortex-compact -24.7% +20.2% -37.4% +38.9% ✅ faster
19 datafusion:vortex-file-compressed -28.5% +20.2% -40.5% +38.9% ✅ faster
19 duckdb:vortex-compact +8.8% +20.2% -9.5% +41.0% ➖ noise
19 duckdb:vortex-file-compressed +8.3% +20.2% -9.9% +38.9% ➖ noise
20 datafusion:vortex-compact -12.6% +17.6% -25.7% +38.9% ➖ noise
20 datafusion:vortex-file-compressed +0.2% +17.6% -14.8% +38.9% ➖ noise
20 duckdb:vortex-compact -5.3% +17.6% -19.5% +38.9% ➖ noise
20 duckdb:vortex-file-compressed -11.8% +17.6% -25.0% +38.9% ➖ noise
21 datafusion:vortex-compact -4.6% +5.7% -9.7% +38.9% ➖ noise
21 datafusion:vortex-file-compressed +2.4% +5.7% -3.2% +38.9% ➖ noise
21 duckdb:vortex-compact +10.8% +5.7% +4.9% +38.9% ➖ noise
21 duckdb:vortex-file-compressed +12.0% +5.7% +6.0% +38.9% ➖ noise
22 datafusion:vortex-compact -20.6% -27.0% +8.9% +38.9% ➖ noise
22 datafusion:vortex-file-compressed -1.3% -27.0% +35.3% +38.9% ➖ noise
22 duckdb:vortex-compact +1.7% -27.0% +39.4% +38.9% 🚨 regression
22 duckdb:vortex-file-compressed -4.2% -27.0% +31.3% +38.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 1.039x ➖
Parquet (geomean): 1.037x ➖
Shifts: Parquet (control) +3.7% · Median polish +2.8%


datafusion / vortex-file-compressed (1.043x ➖, 1↑ 5↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2041800 1889203 1.08
clickbench_q01/datafusion:vortex-file-compressed 14403917 13939671 1.03
clickbench_q02/datafusion:vortex-file-compressed 34143148 31264638 1.09
clickbench_q03/datafusion:vortex-file-compressed 40593695 38421356 1.06
clickbench_q04/datafusion:vortex-file-compressed 314741615 310446627 1.01
clickbench_q05/datafusion:vortex-file-compressed 328476474 320204655 1.03
clickbench_q06/datafusion:vortex-file-compressed 1982802 1952097 1.02
clickbench_q07/datafusion:vortex-file-compressed 19298381 18292606 1.05
clickbench_q08/datafusion:vortex-file-compressed 395520986 384078789 1.03
clickbench_q09/datafusion:vortex-file-compressed 597357138 566643951 1.05
clickbench_q10/datafusion:vortex-file-compressed 🚨 79211239 71141010 1.11
clickbench_q11/datafusion:vortex-file-compressed 87090247 83595534 1.04
clickbench_q12/datafusion:vortex-file-compressed 279669089 273938782 1.02
clickbench_q13/datafusion:vortex-file-compressed 432615278 416784825 1.04
clickbench_q14/datafusion:vortex-file-compressed 269343388 265927485 1.01
clickbench_q15/datafusion:vortex-file-compressed 379809828 362106765 1.05
clickbench_q16/datafusion:vortex-file-compressed 720917707 703023248 1.03
clickbench_q17/datafusion:vortex-file-compressed 736808087 690992706 1.07
clickbench_q18/datafusion:vortex-file-compressed 1406999917 1425231293 0.99
clickbench_q19/datafusion:vortex-file-compressed 🚀 25728178 29457193 0.87
clickbench_q20/datafusion:vortex-file-compressed 368977158 357468484 1.03
clickbench_q21/datafusion:vortex-file-compressed 426142373 410380432 1.04
clickbench_q22/datafusion:vortex-file-compressed 513621875 498112225 1.03
clickbench_q23/datafusion:vortex-file-compressed 🚨 771249825 678127265 1.14
clickbench_q24/datafusion:vortex-file-compressed 55795749 51084111 1.09
clickbench_q25/datafusion:vortex-file-compressed 72446613 77179786 0.94
clickbench_q26/datafusion:vortex-file-compressed 48174658 50979572 0.94
clickbench_q27/datafusion:vortex-file-compressed 839764628 805667284 1.04
clickbench_q28/datafusion:vortex-file-compressed 6928252745 6773034054 1.02
clickbench_q29/datafusion:vortex-file-compressed 248623564 240289452 1.03
clickbench_q30/datafusion:vortex-file-compressed 252307267 234920960 1.07
clickbench_q31/datafusion:vortex-file-compressed 290372925 267821296 1.08
clickbench_q32/datafusion:vortex-file-compressed 🚨 1335692902 1152075470 1.16
clickbench_q33/datafusion:vortex-file-compressed 1464547543 1386736735 1.06
clickbench_q34/datafusion:vortex-file-compressed 1444272802 1410979228 1.02
clickbench_q35/datafusion:vortex-file-compressed 542536782 512752782 1.06
clickbench_q36/datafusion:vortex-file-compressed 🚨 87606394 78469854 1.12
clickbench_q37/datafusion:vortex-file-compressed 42073564 38958439 1.08
clickbench_q38/datafusion:vortex-file-compressed 24137332 23760536 1.02
clickbench_q39/datafusion:vortex-file-compressed 160024346 158633031 1.01
clickbench_q40/datafusion:vortex-file-compressed 19808323 18076950 1.10
clickbench_q41/datafusion:vortex-file-compressed 18896836 18844724 1.00
clickbench_q42/datafusion:vortex-file-compressed 🚨 21511971 19294008 1.11
datafusion / parquet (1.064x ➖, 0↑ 6↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2799471 1920311 1.46
clickbench_q01/datafusion:parquet 22098914 21971992 1.01
clickbench_q02/datafusion:parquet 60796900 59155606 1.03
clickbench_q03/datafusion:parquet 🚨 50471429 45640822 1.11
clickbench_q04/datafusion:parquet 🚨 379731036 336899338 1.13
clickbench_q05/datafusion:parquet 398983801 363436517 1.10
clickbench_q06/datafusion:parquet 1918219 1750763 1.10
clickbench_q07/datafusion:parquet 28635011 26908531 1.06
clickbench_q08/datafusion:parquet 463356314 427134131 1.08
clickbench_q09/datafusion:parquet 🚨 745423521 651010395 1.15
clickbench_q10/datafusion:parquet 123785551 112623919 1.10
clickbench_q11/datafusion:parquet 146236467 136832979 1.07
clickbench_q12/datafusion:parquet 396006192 363664601 1.09
clickbench_q13/datafusion:parquet 565325210 516715143 1.09
clickbench_q14/datafusion:parquet 391502184 357169990 1.10
clickbench_q15/datafusion:parquet 402994610 374913037 1.07
clickbench_q16/datafusion:parquet 754698340 692817899 1.09
clickbench_q17/datafusion:parquet 🚨 762040568 685266393 1.11
clickbench_q18/datafusion:parquet 1439888625 1441675345 1.00
clickbench_q19/datafusion:parquet 🚨 40324020 35103556 1.15
clickbench_q20/datafusion:parquet 659963480 635774055 1.04
clickbench_q21/datafusion:parquet 709680218 686502900 1.03
clickbench_q22/datafusion:parquet 1016093889 1002645621 1.01
clickbench_q23/datafusion:parquet 3855301817 3692172146 1.04
clickbench_q24/datafusion:parquet 94273635 88760086 1.06
clickbench_q25/datafusion:parquet 145885650 142519668 1.02
clickbench_q26/datafusion:parquet 94673073 88734976 1.07
clickbench_q27/datafusion:parquet 1101716062 1082950935 1.02
clickbench_q28/datafusion:parquet 6476094736 6626676262 0.98
clickbench_q29/datafusion:parquet 239455778 246049560 0.97
clickbench_q30/datafusion:parquet 383060442 366344778 1.05
clickbench_q31/datafusion:parquet 420063253 399517785 1.05
clickbench_q32/datafusion:parquet 1355755828 1294823745 1.05
clickbench_q33/datafusion:parquet 1648905913 1584652243 1.04
clickbench_q34/datafusion:parquet 1612366093 1541082887 1.05
clickbench_q35/datafusion:parquet 559000312 528575550 1.06
clickbench_q36/datafusion:parquet 151082807 143507010 1.05
clickbench_q37/datafusion:parquet 65184941 61994008 1.05
clickbench_q38/datafusion:parquet 96375727 96545280 1.00
clickbench_q39/datafusion:parquet 290225981 280206447 1.04
clickbench_q40/datafusion:parquet 36883459 35975269 1.03
clickbench_q41/datafusion:parquet 32100799 30518422 1.05
clickbench_q42/datafusion:parquet 33225390 32467060 1.02
duckdb / vortex-file-compressed (1.036x ➖, 0↑ 5↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6560128 6281683 1.04
clickbench_q01/duckdb:vortex-file-compressed 14914735 14390149 1.04
clickbench_q02/duckdb:vortex-file-compressed 27059245 26764191 1.01
clickbench_q03/duckdb:vortex-file-compressed 32122742 31639124 1.02
clickbench_q04/duckdb:vortex-file-compressed 188758659 189376520 1.00
clickbench_q05/duckdb:vortex-file-compressed 184888763 185613519 1.00
clickbench_q06/duckdb:vortex-file-compressed 19762809 19628632 1.01
clickbench_q07/duckdb:vortex-file-compressed 16833419 15908726 1.06
clickbench_q08/duckdb:vortex-file-compressed 267105762 267649839 1.00
clickbench_q09/duckdb:vortex-file-compressed 345057848 342988254 1.01
clickbench_q10/duckdb:vortex-file-compressed 71999875 72000647 1.00
clickbench_q11/duckdb:vortex-file-compressed 84846174 83205039 1.02
clickbench_q12/duckdb:vortex-file-compressed 206594044 199982058 1.03
clickbench_q13/duckdb:vortex-file-compressed 411955569 407366127 1.01
clickbench_q14/duckdb:vortex-file-compressed 240372304 236047187 1.02
clickbench_q15/duckdb:vortex-file-compressed 248159147 249363749 1.00
clickbench_q16/duckdb:vortex-file-compressed 785280051 749860903 1.05
clickbench_q17/duckdb:vortex-file-compressed 566308146 552507657 1.02
clickbench_q18/duckdb:vortex-file-compressed 1242734643 1152589328 1.08
clickbench_q19/duckdb:vortex-file-compressed 24447229 23891430 1.02
clickbench_q20/duckdb:vortex-file-compressed 400715093 370953080 1.08
clickbench_q21/duckdb:vortex-file-compressed 424728188 410959219 1.03
clickbench_q22/duckdb:vortex-file-compressed 572431750 620649278 0.92
clickbench_q23/duckdb:vortex-file-compressed 1833394738 1770863835 1.04
clickbench_q24/duckdb:vortex-file-compressed 55953583 54021760 1.04
clickbench_q25/duckdb:vortex-file-compressed 80553096 78705065 1.02
clickbench_q26/duckdb:vortex-file-compressed 48851917 51234463 0.95
clickbench_q27/duckdb:vortex-file-compressed 513957071 505344135 1.02
clickbench_q28/duckdb:vortex-file-compressed 3018037459 2998684463 1.01
clickbench_q29/duckdb:vortex-file-compressed 30495657 29323443 1.04
clickbench_q30/duckdb:vortex-file-compressed 197423552 191972008 1.03
clickbench_q31/duckdb:vortex-file-compressed 286509582 286469700 1.00
clickbench_q32/duckdb:vortex-file-compressed 1409988681 1371739860 1.03
clickbench_q33/duckdb:vortex-file-compressed 🚨 1608524829 1417923030 1.13
clickbench_q34/duckdb:vortex-file-compressed 🚨 1691177684 1495625285 1.13
clickbench_q35/duckdb:vortex-file-compressed 381397703 380459991 1.00
clickbench_q36/duckdb:vortex-file-compressed 35270612 32113202 1.10
clickbench_q37/duckdb:vortex-file-compressed 🚨 28326096 23956677 1.18
clickbench_q38/duckdb:vortex-file-compressed 27822913 26016604 1.07
clickbench_q39/duckdb:vortex-file-compressed 48581358 47211165 1.03
clickbench_q40/duckdb:vortex-file-compressed 🚨 27033600 24278256 1.11
clickbench_q41/duckdb:vortex-file-compressed 25578867 23261150 1.10
clickbench_q42/duckdb:vortex-file-compressed 🚨 26766762 24065076 1.11
duckdb / parquet (1.011x ➖, 1↑ 1↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 26760833 26216786 1.02
clickbench_q01/duckdb:parquet 27803376 27994942 0.99
clickbench_q02/duckdb:parquet 50048076 48231345 1.04
clickbench_q03/duckdb:parquet 37856054 38660107 0.98
clickbench_q04/duckdb:parquet 206888281 201507048 1.03
clickbench_q05/duckdb:parquet 275503980 273968539 1.01
clickbench_q06/duckdb:parquet 46542780 45015264 1.03
clickbench_q07/duckdb:parquet 29737061 29167298 1.02
clickbench_q08/duckdb:parquet 271700244 266668957 1.02
clickbench_q09/duckdb:parquet 403113294 396965418 1.02
clickbench_q10/duckdb:parquet 82896124 80964438 1.02
clickbench_q11/duckdb:parquet 99147284 98177207 1.01
clickbench_q12/duckdb:parquet 287515758 296210271 0.97
clickbench_q13/duckdb:parquet 494734748 479315242 1.03
clickbench_q14/duckdb:parquet 334471382 324116975 1.03
clickbench_q15/duckdb:parquet 255193597 257740522 0.99
clickbench_q16/duckdb:parquet 657505425 641377091 1.03
clickbench_q17/duckdb:parquet 542427463 552102914 0.98
clickbench_q18/duckdb:parquet 1101745076 1086791808 1.01
clickbench_q19/duckdb:parquet 25643149 25504539 1.01
clickbench_q20/duckdb:parquet 428653792 421606981 1.02
clickbench_q21/duckdb:parquet 545440072 547558014 1.00
clickbench_q22/duckdb:parquet 927802865 939705560 0.99
clickbench_q23/duckdb:parquet 313162143 317582257 0.99
clickbench_q24/duckdb:parquet 70504131 70013793 1.01
clickbench_q25/duckdb:parquet 157207147 156983654 1.00
clickbench_q26/duckdb:parquet 49794596 49308048 1.01
clickbench_q27/duckdb:parquet 647725888 650239718 1.00
clickbench_q28/duckdb:parquet 4835050797 4812580558 1.00
clickbench_q29/duckdb:parquet 40560359 40245600 1.01
clickbench_q30/duckdb:parquet 302929974 299628315 1.01
clickbench_q31/duckdb:parquet 361889121 361091636 1.00
clickbench_q32/duckdb:parquet 1220297550 1158472475 1.05
clickbench_q33/duckdb:parquet 1322632757 1299195147 1.02
clickbench_q34/duckdb:parquet 1413600810 1329502040 1.06
clickbench_q35/duckdb:parquet 362670722 364283888 1.00
clickbench_q36/duckdb:parquet 48251279 46252952 1.04
clickbench_q37/duckdb:parquet 31880208 32721346 0.97
clickbench_q38/duckdb:parquet 33949034 34215233 0.99
clickbench_q39/duckdb:parquet 80464740 79240653 1.02
clickbench_q40/duckdb:parquet 🚀 16919568 19375282 0.87
clickbench_q41/duckdb:parquet 🚨 18892574 17021701 1.11
clickbench_q42/duckdb:parquet 21966963 20117490 1.09
duckdb / duckdb (0.973x ➖, 3↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 🚀 17558929 19585998 0.90
clickbench_q01/duckdb:duckdb 33115966 36454626 0.91
clickbench_q02/duckdb:duckdb 45809501 49434076 0.93
clickbench_q03/duckdb:duckdb 48404365 49750184 0.97
clickbench_q04/duckdb:duckdb 188485932 191002203 0.99
clickbench_q05/duckdb:duckdb 267914938 271448584 0.99
clickbench_q06/duckdb:duckdb 35761790 39067298 0.92
clickbench_q07/duckdb:duckdb 36388742 38653692 0.94
clickbench_q08/duckdb:duckdb 248047015 248002658 1.00
clickbench_q09/duckdb:duckdb 374736929 367224815 1.02
clickbench_q10/duckdb:duckdb 98138394 100193420 0.98
clickbench_q11/duckdb:duckdb 107851859 109179509 0.99
clickbench_q12/duckdb:duckdb 238004018 235055110 1.01
clickbench_q13/duckdb:duckdb 486764137 492795438 0.99
clickbench_q14/duckdb:duckdb 277312892 276086105 1.00
clickbench_q15/duckdb:duckdb 218202395 219177005 1.00
clickbench_q16/duckdb:duckdb 668625204 644841390 1.04
clickbench_q17/duckdb:duckdb 563714966 569365170 0.99
clickbench_q18/duckdb:duckdb 1258021543 1232717676 1.02
clickbench_q19/duckdb:duckdb 🚀 34169664 37969062 0.90
clickbench_q20/duckdb:duckdb 971178470 1065228718 0.91
clickbench_q21/duckdb:duckdb 1043001601 1070219220 0.97
clickbench_q22/duckdb:duckdb 1109113046 1051596012 1.05
clickbench_q23/duckdb:duckdb 268164944 259821083 1.03
clickbench_q24/duckdb:duckdb 63402798 64290290 0.99
clickbench_q25/duckdb:duckdb 143750007 147120418 0.98
clickbench_q26/duckdb:duckdb 61723834 61134168 1.01
clickbench_q27/duckdb:duckdb 🚀 1074939077 1204634610 0.89
clickbench_q28/duckdb:duckdb 4674072925 4688286117 1.00
clickbench_q29/duckdb:duckdb 48731526 52737118 0.92
clickbench_q30/duckdb:duckdb 270937838 260992252 1.04
clickbench_q31/duckdb:duckdb 426134303 427992187 1.00
clickbench_q32/duckdb:duckdb 1481794518 1504758043 0.98
clickbench_q33/duckdb:duckdb 2170142324 2123601441 1.02
clickbench_q34/duckdb:duckdb 2394669138 2237635559 1.07
clickbench_q35/duckdb:duckdb 282591966 287899066 0.98
clickbench_q36/duckdb:duckdb 41957178 46249536 0.91
clickbench_q37/duckdb:duckdb 32389919 34328096 0.94
clickbench_q38/duckdb:duckdb 32929883 34855035 0.94
clickbench_q39/duckdb:duckdb 66309708 68847767 0.96
clickbench_q40/duckdb:duckdb 32625774 34824142 0.94
clickbench_q41/duckdb:duckdb 31000607 33085489 0.94
clickbench_q42/duckdb:duckdb 32316218 35239903 0.92
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +8.1% +22.0% -11.4% +749.9% ➖ noise
0 duckdb:duckdb -10.3% +22.0% -26.5% +256.5% ➖ noise
0 duckdb:vortex-file-compressed +4.4% +22.0% -14.4% +350.2% ➖ noise
1 datafusion:vortex-file-compressed +3.3% -0.1% +3.4% +32.5% ➖ noise
1 duckdb:duckdb -9.2% -0.1% -9.1% +57.9% ➖ noise
1 duckdb:vortex-file-compressed +3.6% -0.1% +3.7% +18.2% ➖ noise
2 datafusion:vortex-file-compressed +9.2% +3.3% +5.7% +19.9% ➖ noise
2 duckdb:duckdb -7.3% +3.3% -10.3% +23.2% ➖ noise
2 duckdb:vortex-file-compressed +1.1% +3.3% -2.1% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.7% +4.1% +1.5% +160.3% ➖ noise
3 duckdb:duckdb -2.7% +4.1% -6.5% +53.8% ➖ noise
3 duckdb:vortex-file-compressed +1.5% +4.1% -2.4% +81.4% ➖ noise
4 datafusion:vortex-file-compressed +1.4% +7.6% -5.8% +10.0% ➖ noise
4 duckdb:duckdb -1.3% +7.6% -8.3% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% +7.6% -7.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.6% +5.1% -2.4% +10.0% ➖ noise
5 duckdb:duckdb -1.3% +5.1% -6.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.4% +5.1% -5.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +1.6% +6.4% -4.6% +39.3% ➖ noise
6 duckdb:duckdb -8.5% +6.4% -14.0% +31.7% ➖ noise
6 duckdb:vortex-file-compressed +0.7% +6.4% -5.4% +20.5% ➖ noise
7 datafusion:vortex-file-compressed +5.5% +4.2% +1.3% +10.3% ➖ noise
7 duckdb:duckdb -5.9% +4.2% -9.6% +14.2% ➖ noise
7 duckdb:vortex-file-compressed +5.8% +4.2% +1.6% +12.5% ➖ noise
8 datafusion:vortex-file-compressed +3.0% +5.1% -2.0% +10.0% ➖ noise
8 duckdb:duckdb +0.0% +5.1% -4.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -0.2% +5.1% -5.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +5.4% +7.8% -2.2% +10.0% ➖ noise
9 duckdb:duckdb +2.0% +7.8% -5.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.6% +7.8% -6.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +11.3% +6.1% +5.0% +12.7% ➖ noise
10 duckdb:duckdb -2.1% +6.1% -7.7% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.0% +6.1% -5.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.2% +3.9% +0.3% +10.0% ➖ noise
11 duckdb:duckdb -1.2% +3.9% -4.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +2.0% +3.9% -1.8% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.1% +2.8% -0.7% +10.0% ➖ noise
12 duckdb:duckdb +1.3% +2.8% -1.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.3% +2.8% +0.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.8% +6.3% -2.3% +10.0% ➖ noise
13 duckdb:duckdb -1.2% +6.3% -7.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.1% +6.3% -4.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.3% +6.4% -4.8% +10.0% ➖ noise
14 duckdb:duckdb +0.4% +6.4% -5.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +1.8% +6.4% -4.3% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +4.9% +3.2% +1.7% +10.0% ➖ noise
15 duckdb:duckdb -0.4% +3.2% -3.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.5% +3.2% -3.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +2.5% +5.7% -3.0% +10.0% ➖ noise
16 duckdb:duckdb +3.7% +5.7% -1.9% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +4.7% +5.7% -0.9% +15.6% ➖ noise
17 datafusion:vortex-file-compressed +6.6% +4.5% +2.0% +10.0% ➖ noise
17 duckdb:duckdb -1.0% +4.5% -5.3% +11.3% ➖ noise
17 duckdb:vortex-file-compressed +2.5% +4.5% -1.9% +20.1% ➖ noise
18 datafusion:vortex-file-compressed -1.3% +0.6% -1.9% +10.0% ➖ noise
18 duckdb:duckdb +2.1% +0.6% +1.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +7.8% +0.6% +7.2% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -12.7% +7.5% -18.7% +21.3% ✅ faster
19 duckdb:duckdb -10.0% +7.5% -16.3% +12.7% ✅ faster
19 duckdb:vortex-file-compressed +2.3% +7.5% -4.8% +28.6% ➖ noise
20 datafusion:vortex-file-compressed +3.2% +2.7% +0.5% +196.0% ➖ noise
20 duckdb:duckdb -8.8% +2.7% -11.3% +27.0% ➖ noise
20 duckdb:vortex-file-compressed +8.0% +2.7% +5.1% +13.2% ➖ noise
21 datafusion:vortex-file-compressed +3.8% +1.5% +2.3% +10.0% ➖ noise
21 duckdb:duckdb -2.5% +1.5% -4.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +3.4% +1.5% +1.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +3.1% +0.0% +3.1% +11.2% ➖ noise
22 duckdb:duckdb +5.5% +0.0% +5.4% +17.0% ➖ noise
22 duckdb:vortex-file-compressed -7.8% +0.0% -7.8% +17.2% ➖ noise
23 datafusion:vortex-file-compressed +13.7% +1.5% +12.1% +41.5% ➖ noise
23 duckdb:duckdb +3.2% +1.5% +1.7% +10.0% ➖ noise
23 duckdb:vortex-file-compressed +3.5% +1.5% +2.0% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +9.2% +3.4% +5.6% +20.2% ➖ noise
24 duckdb:duckdb -1.4% +3.4% -4.6% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +3.6% +3.4% +0.2% +21.5% ➖ noise
25 datafusion:vortex-file-compressed -6.1% +1.2% -7.3% +15.2% ➖ noise
25 duckdb:duckdb -2.3% +1.2% -3.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +2.3% +1.2% +1.1% +13.8% ➖ noise
26 datafusion:vortex-file-compressed -5.5% +3.8% -9.0% +18.5% ➖ noise
26 duckdb:duckdb +1.0% +3.8% -2.7% +12.4% ➖ noise
26 duckdb:vortex-file-compressed -4.7% +3.8% -8.1% +26.5% ➖ noise
27 datafusion:vortex-file-compressed +4.2% +0.7% +3.5% +10.0% ➖ noise
27 duckdb:duckdb -10.8% +0.7% -11.4% +10.0% ✅ faster
27 duckdb:vortex-file-compressed +1.7% +0.7% +1.0% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.3% -0.9% +3.2% +10.0% ➖ noise
28 duckdb:duckdb -0.3% -0.9% +0.6% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +0.6% -0.9% +1.6% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.5% -1.0% +4.5% +10.0% ➖ noise
29 duckdb:duckdb -7.6% -1.0% -6.7% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +4.0% -1.0% +5.0% +16.0% ➖ noise
30 datafusion:vortex-file-compressed +7.4% +2.8% +4.5% +10.0% ➖ noise
30 duckdb:duckdb +3.8% +2.8% +1.0% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +2.8% +2.8% +0.0% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +8.4% +2.7% +5.6% +10.0% ➖ noise
31 duckdb:duckdb -0.4% +2.7% -3.0% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +0.0% +2.7% -2.6% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +15.9% +5.0% +10.4% +16.8% ➖ noise
32 duckdb:duckdb -1.5% +5.0% -6.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +2.8% +5.0% -2.1% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +5.6% +2.9% +2.6% +10.0% ➖ noise
33 duckdb:duckdb +2.2% +2.9% -0.7% +10.0% ➖ noise
33 duckdb:vortex-file-compressed +13.4% +2.9% +10.2% +10.0% 🚨 regression
34 datafusion:vortex-file-compressed +2.4% +5.5% -3.0% +10.0% ➖ noise
34 duckdb:duckdb +7.0% +5.5% +1.5% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +13.1% +5.5% +7.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +5.8% +2.6% +3.1% +10.0% ➖ noise
35 duckdb:duckdb -1.8% +2.6% -4.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.2% +2.6% -2.3% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +11.6% +4.8% +6.5% +13.2% ➖ noise
36 duckdb:duckdb -9.3% +4.8% -13.4% +18.2% ➖ noise
36 duckdb:vortex-file-compressed +9.8% +4.8% +4.8% +13.4% ➖ noise
37 datafusion:vortex-file-compressed +8.0% +1.2% +6.7% +10.0% ➖ noise
37 duckdb:duckdb -5.6% +1.2% -6.8% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +18.2% +1.2% +16.8% +18.7% ➖ noise
38 datafusion:vortex-file-compressed +1.6% -0.5% +2.1% +13.3% ➖ noise
38 duckdb:duckdb -5.5% -0.5% -5.1% +11.3% ➖ noise
38 duckdb:vortex-file-compressed +6.9% -0.5% +7.5% +10.0% ➖ noise
39 datafusion:vortex-file-compressed +0.9% +2.6% -1.6% +12.1% ➖ noise
39 duckdb:duckdb -3.7% +2.6% -6.1% +16.1% ➖ noise
39 duckdb:vortex-file-compressed +2.9% +2.6% +0.3% +11.3% ➖ noise
40 datafusion:vortex-file-compressed +9.6% -5.4% +15.8% +16.1% ➖ noise
40 duckdb:duckdb -6.3% -5.4% -1.0% +12.3% ➖ noise
40 duckdb:vortex-file-compressed +11.3% -5.4% +17.7% +18.4% ➖ noise
41 datafusion:vortex-file-compressed +0.3% +8.0% -7.2% +16.4% ➖ noise
41 duckdb:duckdb -6.3% +8.0% -13.3% +10.3% ✅ faster
41 duckdb:vortex-file-compressed +10.0% +8.0% +1.8% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +11.5% +5.7% +5.5% +10.5% ➖ noise
42 duckdb:duckdb -8.3% +5.7% -13.2% +10.0% ✅ faster
42 duckdb:vortex-file-compressed +11.2% +5.7% +5.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: Compression

Vortex (geomean): 1.007x ➖
Parquet (geomean): 1.017x ➖


unknown / unknown (1.022x ➖, 1↑ 6↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
compress time/Arade 1221564783 1171723909 1.04
compress time/Bimbo 7316314126 7058875539 1.04
compress time/CMSprovider 2993733552 2931874205 1.02
compress time/Euro2016 453907400 416816520 1.09
compress time/Food 411723176 391904667 1.05
compress time/HashTags 815855971 804322748 1.01
compress time/TPC-H l_comment canonical 1363028352 1310695560 1.04
compress time/TPC-H l_comment chunked 1368291791 1303005820 1.05
compress time/taxi 746092236 716777827 1.04
compress time/wide table cols=100 chunks=1 rows=1000 12364522 12992605 0.95
compress time/wide table cols=100 chunks=50 rows=1000 13485506 12634329 1.07
compress time/wide table cols=1000 chunks=1 rows=1000 141246521 135103572 1.05
compress time/wide table cols=1000 chunks=50 rows=1000 142520969 139933475 1.02
compress time/wide table cols=10000 chunks=1 rows=1000 1440236710 1417671732 1.02
compress time/wide table cols=10000 chunks=50 rows=1000 1452734616 1408684858 1.03
decompress time/Arade 33000526 31604882 1.04
decompress time/Bimbo 105180606 98521038 1.07
decompress time/CMSprovider 94578921 86378786 1.09
decompress time/Euro2016 22530006 21099887 1.07
decompress time/Food 🚨 11132626 10010841 1.11
decompress time/HashTags 83356037 81926635 1.02
decompress time/TPC-H l_comment canonical 44170332 40522509 1.09
decompress time/TPC-H l_comment chunked 42202991 40886262 1.03
decompress time/taxi 21533017 22147154 0.97
decompress time/wide table cols=100 chunks=1 rows=1000 2878145 2812508 1.02
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 3224083 2703073 1.19
decompress time/wide table cols=1000 chunks=1 rows=1000 25940991 24475259 1.06
decompress time/wide table cols=1000 chunks=50 rows=1000 26553427 24491336 1.08
decompress time/wide table cols=10000 chunks=1 rows=1000 271058379 246905989 1.10
decompress time/wide table cols=10000 chunks=50 rows=1000 268204631 250237810 1.07
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3095785916 3030019091 1.02
parquet_rs-zstd compress time/Bimbo 17836754156 17061539661 1.05
parquet_rs-zstd compress time/CMSprovider 8094412727 7691092505 1.05
parquet_rs-zstd compress time/Euro2016 1397868323 1347894345 1.04
parquet_rs-zstd compress time/Food 953453817 927954541 1.03
parquet_rs-zstd compress time/HashTags 2601881031 2443589990 1.06
parquet_rs-zstd compress time/TPC-H l_comment canonical 3200787939 3117454469 1.03
parquet_rs-zstd compress time/TPC-H l_comment chunked 3197009800 3094922783 1.03
parquet_rs-zstd compress time/taxi 1551803806 1498253813 1.04
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 7637013 6633598 1.15
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚨 7370372 6671450 1.10
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 91982341 90715619 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 92365396 85805315 1.08
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 883873651 877614048 1.01
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 877777723 893786163 0.98
parquet_rs-zstd decompress time/Arade 657427590 641593374 1.02
parquet_rs-zstd decompress time/Bimbo 1732025851 1716374052 1.01
parquet_rs-zstd decompress time/CMSprovider 2034210930 1926620572 1.06
parquet_rs-zstd decompress time/Euro2016 398561508 388964304 1.02
parquet_rs-zstd decompress time/Food 228695728 219903205 1.04
parquet_rs-zstd decompress time/HashTags 690403427 635967688 1.09
parquet_rs-zstd decompress time/TPC-H l_comment canonical 574718234 568836312 1.01
parquet_rs-zstd decompress time/TPC-H l_comment chunked 572625501 562287868 1.02
parquet_rs-zstd decompress time/taxi 249481841 245271627 1.02
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2893467 2735566 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2847620 2715296 1.05
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 33109929 32939138 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 32871722 32523027 1.01
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 367591167 373340892 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 375900674 376285240 1.00
vortex-file-compressed size/Arade 145363828 145363828 1.00
vortex-file-compressed size/Bimbo 468763364 468763364 1.00
vortex-file-compressed size/CMSprovider 417907844 417907844 1.00
vortex-file-compressed size/Euro2016 163395324 163599188 1.00
vortex-file-compressed size/Food 41926968 41926968 1.00
vortex-file-compressed size/HashTags 195647860 195647860 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087392 179087392 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087392 179087392 1.00
vortex-file-compressed size/taxi 52363980 52363980 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930880 930880 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293680 9293680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957680 92957680 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957680 92957680 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.02
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.99
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.97
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.05
vortex:parquet-zstd ratio compress time/Food 0 0 1.02
vortex:parquet-zstd ratio compress time/HashTags 0 0 0.95
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.01
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.02
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.83
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.95
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.05
vortex:parquet-zstd ratio decompress time/Arade 0 0 1.02
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 1.06
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.04
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.04
vortex:parquet-zstd ratio decompress time/Food 0 0 1.07
vortex:parquet-zstd ratio decompress time/HashTags 0 0 0.94
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 1.08
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.01
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.96
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 🚨 1 0 1.14
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 0 0 1.11
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.07
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.8%
Vortex (geomean): 0.984x ➖
Parquet (geomean): 0.957x ➖
Shifts: Parquet (control) -4.3% · Median polish +2.1%


datafusion / vortex-file-compressed (0.945x ➖, 2↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 683556768 694733480 0.98
tpch_q02/datafusion:vortex-file-compressed 666036624 778675849 0.86
tpch_q03/datafusion:vortex-file-compressed 🚀 830029030 1476964760 0.56
tpch_q04/datafusion:vortex-file-compressed 619770269 757623309 0.82
tpch_q05/datafusion:vortex-file-compressed 1045977744 1180110997 0.89
tpch_q06/datafusion:vortex-file-compressed 692395925 652820694 1.06
tpch_q07/datafusion:vortex-file-compressed 1223278122 1239903661 0.99
tpch_q08/datafusion:vortex-file-compressed 1456621258 1621544453 0.90
tpch_q09/datafusion:vortex-file-compressed 1585934634 1598645123 0.99
tpch_q10/datafusion:vortex-file-compressed 1120008734 1076991465 1.04
tpch_q11/datafusion:vortex-file-compressed 612304036 604846530 1.01
tpch_q12/datafusion:vortex-file-compressed 952815175 895187025 1.06
tpch_q13/datafusion:vortex-file-compressed 478083490 426995616 1.12
tpch_q14/datafusion:vortex-file-compressed 611143330 605415117 1.01
tpch_q15/datafusion:vortex-file-compressed 1267477337 1133951587 1.12
tpch_q16/datafusion:vortex-file-compressed 396971628 408711957 0.97
tpch_q17/datafusion:vortex-file-compressed 1210458421 1277036002 0.95
tpch_q18/datafusion:vortex-file-compressed 1403417044 1363859068 1.03
tpch_q19/datafusion:vortex-file-compressed 815868449 836300139 0.98
tpch_q20/datafusion:vortex-file-compressed 986365213 1025289133 0.96
tpch_q21/datafusion:vortex-file-compressed 1731475596 1671174638 1.04
tpch_q22/datafusion:vortex-file-compressed 🚀 323265706 473423312 0.68
datafusion / vortex-compact (0.904x ➖, 3↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 715974305 697190985 1.03
tpch_q02/datafusion:vortex-compact 1031028654 834477466 1.24
tpch_q03/datafusion:vortex-compact 1118067237 1158101256 0.97
tpch_q04/datafusion:vortex-compact 598174741 695266077 0.86
tpch_q05/datafusion:vortex-compact 1054532602 956694283 1.10
tpch_q06/datafusion:vortex-compact 656523875 613150633 1.07
tpch_q07/datafusion:vortex-compact 1098767802 1018992062 1.08
tpch_q08/datafusion:vortex-compact 1363482581 1356483661 1.01
tpch_q09/datafusion:vortex-compact 1285035218 1337576146 0.96
tpch_q10/datafusion:vortex-compact 925904732 933338628 0.99
tpch_q11/datafusion:vortex-compact 440232041 562093362 0.78
tpch_q12/datafusion:vortex-compact 🚀 837009141 1204231088 0.70
tpch_q13/datafusion:vortex-compact 490988322 455974384 1.08
tpch_q14/datafusion:vortex-compact 711833793 735239303 0.97
tpch_q15/datafusion:vortex-compact 1117696857 1469634229 0.76
tpch_q16/datafusion:vortex-compact 🚀 350766983 732911486 0.48
tpch_q17/datafusion:vortex-compact 1208967170 1223045199 0.99
tpch_q18/datafusion:vortex-compact 1227804109 1188219078 1.03
tpch_q19/datafusion:vortex-compact 🚀 742607289 1151067595 0.65
tpch_q20/datafusion:vortex-compact 831378789 1101888528 0.75
tpch_q21/datafusion:vortex-compact 1526623893 1670635979 0.91
tpch_q22/datafusion:vortex-compact 444655704 488638109 0.91
datafusion / parquet (0.880x ➖, 5↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 874779964 828880643 1.06
tpch_q02/datafusion:parquet 905776285 827291253 1.09
tpch_q03/datafusion:parquet 1111715838 1076621784 1.03
tpch_q04/datafusion:parquet 🚀 484656279 709311286 0.68
tpch_q05/datafusion:parquet 🚀 1193100477 2097896205 0.57
tpch_q06/datafusion:parquet 🚀 516800486 917378465 0.56
tpch_q07/datafusion:parquet 1604270046 1725585850 0.93
tpch_q08/datafusion:parquet 1620997555 1870552590 0.87
tpch_q09/datafusion:parquet 1715988610 2047294713 0.84
tpch_q10/datafusion:parquet 🚀 2012633656 3156715826 0.64
tpch_q11/datafusion:parquet 552686313 779493931 0.71
tpch_q12/datafusion:parquet 767845692 683990654 1.12
tpch_q13/datafusion:parquet 757167386 702341840 1.08
tpch_q14/datafusion:parquet 834957984 838549648 1.00
tpch_q15/datafusion:parquet 1536803482 1233799443 1.25
tpch_q16/datafusion:parquet 426707184 415041092 1.03
tpch_q17/datafusion:parquet 1449329369 1376854798 1.05
tpch_q18/datafusion:parquet 1918440715 1782182174 1.08
tpch_q19/datafusion:parquet 1231191341 1292764564 0.95
tpch_q20/datafusion:parquet 1427116802 1661936069 0.86
tpch_q21/datafusion:parquet 1956595811 2253432283 0.87
tpch_q22/datafusion:parquet 🚀 712320443 1167118270 0.61
duckdb / vortex-file-compressed (1.058x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 720388376 646903509 1.11
tpch_q02/duckdb:vortex-file-compressed 1206116265 1182261745 1.02
tpch_q03/duckdb:vortex-file-compressed 1042675459 989889197 1.05
tpch_q04/duckdb:vortex-file-compressed 704204745 804824021 0.87
tpch_q05/duckdb:vortex-file-compressed 1173263191 1218190495 0.96
tpch_q06/duckdb:vortex-file-compressed 898501754 812516581 1.11
tpch_q07/duckdb:vortex-file-compressed 1370157991 1117503944 1.23
tpch_q08/duckdb:vortex-file-compressed 1620804176 1471597515 1.10
tpch_q09/duckdb:vortex-file-compressed 1793934986 1408565268 1.27
tpch_q10/duckdb:vortex-file-compressed 1276410238 1142996646 1.12
tpch_q11/duckdb:vortex-file-compressed 686126550 712615815 0.96
tpch_q12/duckdb:vortex-file-compressed 793775837 715028101 1.11
tpch_q13/duckdb:vortex-file-compressed 947063829 953098135 0.99
tpch_q14/duckdb:vortex-file-compressed 915291980 856943458 1.07
tpch_q15/duckdb:vortex-file-compressed 597705671 537234880 1.11
tpch_q16/duckdb:vortex-file-compressed 491614517 488073741 1.01
tpch_q17/duckdb:vortex-file-compressed 1030022935 1004654181 1.03
tpch_q18/duckdb:vortex-file-compressed 989694368 900369347 1.10
tpch_q19/duckdb:vortex-file-compressed 813880625 798816423 1.02
tpch_q20/duckdb:vortex-file-compressed 1324682270 1205690620 1.10
tpch_q21/duckdb:vortex-file-compressed 2092087634 2003474326 1.04
tpch_q22/duckdb:vortex-file-compressed 602335273 623258668 0.97
duckdb / vortex-compact (1.038x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 638171339 616480558 1.04
tpch_q02/duckdb:vortex-compact 1159487652 1042533385 1.11
tpch_q03/duckdb:vortex-compact 863372592 812400370 1.06
tpch_q04/duckdb:vortex-compact 582127739 511274130 1.14
tpch_q05/duckdb:vortex-compact 1052447989 1041456949 1.01
tpch_q06/duckdb:vortex-compact 748015167 786744264 0.95
tpch_q07/duckdb:vortex-compact 1130754175 1013159579 1.12
tpch_q08/duckdb:vortex-compact 1414593781 1316720019 1.07
tpch_q09/duckdb:vortex-compact 1335184971 1341704903 1.00
tpch_q10/duckdb:vortex-compact 1014233491 1012674620 1.00
tpch_q11/duckdb:vortex-compact 728468391 634156820 1.15
tpch_q12/duckdb:vortex-compact 689428362 775050574 0.89
tpch_q13/duckdb:vortex-compact 896378177 893794999 1.00
tpch_q14/duckdb:vortex-compact 975603461 875494448 1.11
tpch_q15/duckdb:vortex-compact 583323468 555056539 1.05
tpch_q16/duckdb:vortex-compact 481868262 433183508 1.11
tpch_q17/duckdb:vortex-compact 981637835 932560784 1.05
tpch_q18/duckdb:vortex-compact 796409029 794831067 1.00
tpch_q19/duckdb:vortex-compact 741129367 767844877 0.97
tpch_q20/duckdb:vortex-compact 1237807263 1166825534 1.06
tpch_q21/duckdb:vortex-compact 1786968424 1722446423 1.04
tpch_q22/duckdb:vortex-compact 607032258 637874709 0.95
duckdb / parquet (1.041x ➖, 0↑ 0↓)
name PR 6b83bac (ns) base ce52b71 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 851602945 860472089 0.99
tpch_q02/duckdb:parquet 1618900925 1636559436 0.99
tpch_q03/duckdb:parquet 1977201405 1755187079 1.13
tpch_q04/duckdb:parquet 1069124590 1062290377 1.01
tpch_q05/duckdb:parquet 2024402906 2134884259 0.95
tpch_q06/duckdb:parquet 758952732 717193795 1.06
tpch_q07/duckdb:parquet 2069609541 1884825928 1.10
tpch_q08/duckdb:parquet 2692761794 2392130719 1.13
tpch_q09/duckdb:parquet 2634097270 2524677649 1.04
tpch_q10/duckdb:parquet 3189456513 3063830297 1.04
tpch_q11/duckdb:parquet 1132316497 1104838442 1.02
tpch_q12/duckdb:parquet 1222814274 1207285191 1.01
tpch_q13/duckdb:parquet 1350135271 1146144551 1.18
tpch_q14/duckdb:parquet 1224525022 1200471791 1.02
tpch_q15/duckdb:parquet 799367593 907029706 0.88
tpch_q16/duckdb:parquet 918103800 812537517 1.13
tpch_q17/duckdb:parquet 1311343317 1368832671 0.96
tpch_q18/duckdb:parquet 1535701930 1306996870 1.17
tpch_q19/duckdb:parquet 1502046983 1424535168 1.05
tpch_q20/duckdb:parquet 1802145175 1843833701 0.98
tpch_q21/duckdb:parquet 1934078561 1705882598 1.13
tpch_q22/duckdb:parquet 1058500446 1072583095 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +2.7% +2.2% +0.5% +46.2% ➖ noise
1 datafusion:vortex-file-compressed -1.6% +2.2% -3.7% +48.5% ➖ noise
1 duckdb:vortex-compact +3.5% +2.2% +1.3% +39.3% ➖ noise
1 duckdb:vortex-file-compressed +11.4% +2.2% +9.0% +39.3% ➖ noise
2 datafusion:vortex-compact +23.6% +4.1% +18.7% +39.3% ➖ noise
2 datafusion:vortex-file-compressed -14.5% +4.1% -17.8% +39.3% ➖ noise
2 duckdb:vortex-compact +11.2% +4.1% +6.9% +39.3% ➖ noise
2 duckdb:vortex-file-compressed +2.0% +4.1% -2.0% +39.3% ➖ noise
3 datafusion:vortex-compact -3.5% +7.9% -10.5% +40.6% ➖ noise
3 datafusion:vortex-file-compressed -43.8% +7.9% -47.9% +98.4% ➖ noise
3 duckdb:vortex-compact +6.3% +7.9% -1.5% +39.3% ➖ noise
3 duckdb:vortex-file-compressed +5.3% +7.9% -2.3% +39.3% ➖ noise
4 datafusion:vortex-compact -14.0% -17.1% +3.7% +39.3% ➖ noise
4 datafusion:vortex-file-compressed -18.2% -17.1% -1.4% +39.3% ➖ noise
4 duckdb:vortex-compact +13.9% -17.1% +37.3% +39.3% ➖ noise
4 duckdb:vortex-file-compressed -12.5% -17.1% +5.5% +39.3% ➖ noise
5 datafusion:vortex-compact +10.2% -26.6% +50.1% +39.3% 🚨 regression
5 datafusion:vortex-file-compressed -11.4% -26.6% +20.7% +39.3% ➖ noise
5 duckdb:vortex-compact +1.1% -26.6% +37.6% +39.3% ➖ noise
5 duckdb:vortex-file-compressed -3.7% -26.6% +31.2% +39.3% ➖ noise
6 datafusion:vortex-compact +7.1% -22.8% +38.7% +39.3% ➖ noise
6 datafusion:vortex-file-compressed +6.1% -22.8% +37.4% +39.3% ➖ noise
6 duckdb:vortex-compact -4.9% -22.8% +23.1% +39.3% ➖ noise
6 duckdb:vortex-file-compressed +10.6% -22.8% +43.2% +39.3% 🚨 regression
7 datafusion:vortex-compact +7.8% +1.0% +6.7% +39.3% ➖ noise
7 datafusion:vortex-file-compressed -1.3% +1.0% -2.4% +39.3% ➖ noise
7 duckdb:vortex-compact +11.6% +1.0% +10.5% +39.3% ➖ noise
7 duckdb:vortex-file-compressed +22.6% +1.0% +21.4% +39.3% ➖ noise
8 datafusion:vortex-compact +0.5% -1.2% +1.8% +39.3% ➖ noise
8 datafusion:vortex-file-compressed -10.2% -1.2% -9.0% +39.3% ➖ noise
8 duckdb:vortex-compact +7.4% -1.2% +8.8% +39.3% ➖ noise
8 duckdb:vortex-file-compressed +10.1% -1.2% +11.5% +39.3% ➖ noise
9 datafusion:vortex-compact -3.9% -6.5% +2.7% +39.3% ➖ noise
9 datafusion:vortex-file-compressed -0.8% -6.5% +6.1% +39.3% ➖ noise
9 duckdb:vortex-compact -0.5% -6.5% +6.4% +39.3% ➖ noise
9 duckdb:vortex-file-compressed +27.4% -6.5% +36.2% +39.3% ➖ noise
10 datafusion:vortex-compact -0.8% -18.5% +21.8% +39.3% ➖ noise
10 datafusion:vortex-file-compressed +4.0% -18.5% +27.6% +39.3% ➖ noise
10 duckdb:vortex-compact +0.2% -18.5% +22.9% +39.3% ➖ noise
10 duckdb:vortex-file-compressed +11.7% -18.5% +37.1% +39.3% ➖ noise
11 datafusion:vortex-compact -21.7% -14.8% -8.1% +39.3% ➖ noise
11 datafusion:vortex-file-compressed +1.2% -14.8% +18.8% +39.3% ➖ noise
11 duckdb:vortex-compact +14.9% -14.8% +34.8% +39.3% ➖ noise
11 duckdb:vortex-file-compressed -3.7% -14.8% +12.9% +39.3% ➖ noise
12 datafusion:vortex-compact -30.5% +6.6% -34.8% +39.3% ✅ faster
12 datafusion:vortex-file-compressed +6.4% +6.6% -0.2% +39.3% ➖ noise
12 duckdb:vortex-compact -11.0% +6.6% -16.6% +39.3% ➖ noise
12 duckdb:vortex-file-compressed +11.0% +6.6% +4.1% +39.3% ➖ noise
13 datafusion:vortex-compact +7.7% +12.7% -4.4% +39.3% ➖ noise
13 datafusion:vortex-file-compressed +12.0% +12.7% -0.6% +39.3% ➖ noise
13 duckdb:vortex-compact +0.3% +12.7% -11.0% +41.7% ➖ noise
13 duckdb:vortex-file-compressed -0.6% +12.7% -11.8% +39.3% ➖ noise
14 datafusion:vortex-compact -3.2% +0.8% -3.9% +39.3% ➖ noise
14 datafusion:vortex-file-compressed +0.9% +0.8% +0.2% +39.3% ➖ noise
14 duckdb:vortex-compact +11.4% +0.8% +10.6% +39.3% ➖ noise
14 duckdb:vortex-file-compressed +6.8% +0.8% +6.0% +39.3% ➖ noise
15 datafusion:vortex-compact -23.9% +4.8% -27.4% +39.3% ➖ noise
15 datafusion:vortex-file-compressed +11.8% +4.8% +6.7% +39.3% ➖ noise
15 duckdb:vortex-compact +5.1% +4.8% +0.3% +39.3% ➖ noise
15 duckdb:vortex-file-compressed +11.3% +4.8% +6.2% +39.3% ➖ noise
16 datafusion:vortex-compact -52.1% +7.8% -55.6% +47.9% ✅ faster
16 datafusion:vortex-file-compressed -2.9% +7.8% -9.9% +39.3% ➖ noise
16 duckdb:vortex-compact +11.2% +7.8% +3.2% +39.3% ➖ noise
16 duckdb:vortex-file-compressed +0.7% +7.8% -6.5% +39.3% ➖ noise
17 datafusion:vortex-compact -1.2% +0.4% -1.6% +39.3% ➖ noise
17 datafusion:vortex-file-compressed -5.2% +0.4% -5.6% +39.3% ➖ noise
17 duckdb:vortex-compact +5.3% +0.4% +4.8% +39.3% ➖ noise
17 duckdb:vortex-file-compressed +2.5% +0.4% +2.1% +39.3% ➖ noise
18 datafusion:vortex-compact +3.3% +12.5% -8.1% +39.3% ➖ noise
18 datafusion:vortex-file-compressed +2.9% +12.5% -8.5% +39.3% ➖ noise
18 duckdb:vortex-compact +0.2% +12.5% -10.9% +39.3% ➖ noise
18 duckdb:vortex-file-compressed +9.9% +12.5% -2.3% +39.3% ➖ noise
19 datafusion:vortex-compact -35.5% +0.2% -35.6% +39.3% ✅ faster
19 datafusion:vortex-file-compressed -2.4% +0.2% -2.6% +39.3% ➖ noise
19 duckdb:vortex-compact -3.5% +0.2% -3.7% +39.3% ➖ noise
19 duckdb:vortex-file-compressed +1.9% +0.2% +1.7% +39.3% ➖ noise
20 datafusion:vortex-compact -24.5% -8.4% -17.6% +39.3% ➖ noise
20 datafusion:vortex-file-compressed -3.8% -8.4% +5.0% +39.3% ➖ noise
20 duckdb:vortex-compact +6.1% -8.4% +15.8% +39.3% ➖ noise
20 duckdb:vortex-file-compressed +9.9% -8.4% +19.9% +39.3% ➖ noise
21 datafusion:vortex-compact -8.6% -0.8% -7.9% +39.3% ➖ noise
21 datafusion:vortex-file-compressed +3.6% -0.8% +4.4% +39.3% ➖ noise
21 duckdb:vortex-compact +3.7% -0.8% +4.6% +39.3% ➖ noise
21 duckdb:vortex-file-compressed +4.4% -0.8% +5.2% +39.3% ➖ noise
22 datafusion:vortex-compact -9.0% -22.4% +17.3% +39.3% ➖ noise
22 datafusion:vortex-file-compressed -31.7% -22.4% -12.0% +39.3% ➖ noise
22 duckdb:vortex-compact -4.8% -22.4% +22.6% +39.3% ➖ noise
22 duckdb:vortex-file-compressed -3.4% -22.4% +24.5% +39.3% ➖ noise

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Copy link
Copy Markdown
Contributor

@robert3005 robert3005 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I will need to see godbolt for this

@joseph-isaacs joseph-isaacs added the do not merge Pull requests that are not intended to merge label Apr 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement do not merge Pull requests that are not intended to merge

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants