Skip to content

wip: chunked iter exe#7263

Draft
joseph-isaacs wants to merge 2 commits intodevelopfrom
ji/more-iter-exe
Draft

wip: chunked iter exe#7263
joseph-isaacs wants to merge 2 commits intodevelopfrom
ji/more-iter-exe

Conversation

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Summary

Closes: #000

Testing

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Apr 2, 2026
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 2, 2026

Merging this PR will degrade performance by 48.38%

⚡ 5 improved benchmarks
❌ 31 regressed benchmarks
✅ 1086 untouched benchmarks
⏩ 1530 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 1000, 10)] 142.8 µs 212.8 µs -32.9%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 10, 10)] 126.4 µs 194.4 µs -34.97%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 100, 10)] 126.3 µs 196 µs -35.53%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 1000, 100)] 1.1 ms 1.9 ms -40.9%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 1000, 100)] 1.6 ms 2.1 ms -24.5%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 10, 10)] 175.2 µs 248.6 µs -29.52%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 100, 10)] 124.5 µs 195.6 µs -36.37%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 100, 100)] 958.7 µs 1,830.7 µs -47.63%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 10, 10)] 152.5 µs 239.1 µs -36.23%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 1000, 100)] 1.1 ms 1.9 ms -40.72%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 10, 100)] 1.2 ms 1.9 ms -37.14%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 1000, 10)] 189.6 µs 275.8 µs -31.27%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 1000, 10)] 141.5 µs 212 µs -33.27%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 100, 10)] 155.7 µs 242.6 µs -35.81%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 10, 100)] 943.5 µs 1,827.7 µs -48.38%
Simulation chunked_dict_primitive_into_canonical[u64, (1000, 100, 100)] 1.2 ms 1.9 ms -36.47%
Simulation chunked_dict_primitive_into_canonical[f64, (1000, 100, 100)] 1.2 ms 1.9 ms -36.54%
Simulation chunked_dict_primitive_into_canonical[u32, (1000, 100, 100)] 959.3 µs 1,834.8 µs -47.72%
Simulation chunked_dict_primitive_into_canonical[f32, (1000, 10, 100)] 954.5 µs 1,821.2 µs -47.59%
Simulation chunked_dict_primitive_into_canonical[u64, (1000, 10, 100)] 1.2 ms 1.9 ms -37.18%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing ji/more-iter-exe (7d9fc3d) with develop (38ab5af)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 2, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 7d9fc3d 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.133x ❌


datafusion / vortex-file-compressed (1.133x ❌, 0↑ 9↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 137330232 126300187 1.09
polarsignals_q01/datafusion:vortex-file-compressed 🚨 414626595 376353843 1.10
polarsignals_q02/datafusion:vortex-file-compressed 🚨 26138255 22718881 1.15
polarsignals_q03/datafusion:vortex-file-compressed 🚨 431197006 377657148 1.14
polarsignals_q04/datafusion:vortex-file-compressed 🚨 12708076 10823840 1.17
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17568924 15378771 1.14
polarsignals_q06/datafusion:vortex-file-compressed 🚨 20912406 18513625 1.13
polarsignals_q07/datafusion:vortex-file-compressed 🚨 15120319 13401606 1.13
polarsignals_q08/datafusion:vortex-file-compressed 🚨 524577100 463357706 1.13
polarsignals_q09/datafusion:vortex-file-compressed 🚨 12193669 10621527 1.15

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -0.0%
Vortex (geomean): 1.017x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +2.0%


datafusion / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 51409744 50201468 1.02
tpch_q02/datafusion:vortex-file-compressed 33157642 33509251 0.99
tpch_q03/datafusion:vortex-file-compressed 28278347 29329487 0.96
tpch_q04/datafusion:vortex-file-compressed 18682125 19421660 0.96
tpch_q05/datafusion:vortex-file-compressed 54919821 53903049 1.02
tpch_q06/datafusion:vortex-file-compressed 10822603 10333435 1.05
tpch_q07/datafusion:vortex-file-compressed 64802273 61929719 1.05
tpch_q08/datafusion:vortex-file-compressed 44678793 44742470 1.00
tpch_q09/datafusion:vortex-file-compressed 56634379 54364106 1.04
tpch_q10/datafusion:vortex-file-compressed 43946022 45811364 0.96
tpch_q11/datafusion:vortex-file-compressed 17722594 17848255 0.99
tpch_q12/datafusion:vortex-file-compressed 22870457 22702601 1.01
tpch_q13/datafusion:vortex-file-compressed 29084566 28262111 1.03
tpch_q14/datafusion:vortex-file-compressed 15637038 15620124 1.00
tpch_q15/datafusion:vortex-file-compressed 23965604 24656386 0.97
tpch_q16/datafusion:vortex-file-compressed 25242772 24289406 1.04
tpch_q17/datafusion:vortex-file-compressed 64422118 63775027 1.01
tpch_q18/datafusion:vortex-file-compressed 80547192 79828186 1.01
tpch_q19/datafusion:vortex-file-compressed 23637738 22004200 1.07
tpch_q20/datafusion:vortex-file-compressed 32330207 34481512 0.94
tpch_q21/datafusion:vortex-file-compressed 76901011 73686696 1.04
tpch_q22/datafusion:vortex-file-compressed 16626341 15648108 1.06
datafusion / vortex-compact (1.010x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58724665 59179082 0.99
tpch_q02/datafusion:vortex-compact 37142801 36082583 1.03
tpch_q03/datafusion:vortex-compact 31661138 32335271 0.98
tpch_q04/datafusion:vortex-compact 23577650 23290940 1.01
tpch_q05/datafusion:vortex-compact 55217314 55045867 1.00
tpch_q06/datafusion:vortex-compact 13914695 13608033 1.02
tpch_q07/datafusion:vortex-compact 70751536 70700175 1.00
tpch_q08/datafusion:vortex-compact 49631613 49087865 1.01
tpch_q09/datafusion:vortex-compact 62789350 60977255 1.03
tpch_q10/datafusion:vortex-compact 52371583 53816440 0.97
tpch_q11/datafusion:vortex-compact 20020390 19972236 1.00
tpch_q12/datafusion:vortex-compact 33423005 33142646 1.01
tpch_q13/datafusion:vortex-compact 36782902 37718036 0.98
tpch_q14/datafusion:vortex-compact 21192651 21321089 0.99
tpch_q15/datafusion:vortex-compact 34586028 33512515 1.03
tpch_q16/datafusion:vortex-compact 30615805 29995975 1.02
tpch_q17/datafusion:vortex-compact 69188540 70102960 0.99
tpch_q18/datafusion:vortex-compact 86948317 83447770 1.04
tpch_q19/datafusion:vortex-compact 34840707 33310116 1.05
tpch_q20/datafusion:vortex-compact 40577177 38606599 1.05
tpch_q21/datafusion:vortex-compact 88508069 86212511 1.03
tpch_q22/datafusion:vortex-compact 17068740 17161553 0.99
datafusion / parquet (1.038x ➖, 1↑ 4↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 136275152 137259838 0.99
tpch_q02/datafusion:parquet 70232300 69103424 1.02
tpch_q03/datafusion:parquet 73127582 69961827 1.05
tpch_q04/datafusion:parquet 48305437 47714756 1.01
tpch_q05/datafusion:parquet 104426677 102920644 1.01
tpch_q06/datafusion:parquet 🚨 45079148 34066464 1.32
tpch_q07/datafusion:parquet 115049514 111615015 1.03
tpch_q08/datafusion:parquet 🚨 109114266 98086527 1.11
tpch_q09/datafusion:parquet 139738776 134970415 1.04
tpch_q10/datafusion:parquet 120799267 118652152 1.02
tpch_q11/datafusion:parquet 48281903 47303751 1.02
tpch_q12/datafusion:parquet 97784700 95120410 1.03
tpch_q13/datafusion:parquet 213830515 203484974 1.05
tpch_q14/datafusion:parquet 🚨 52873890 43886250 1.20
tpch_q15/datafusion:parquet 70042084 66445309 1.05
tpch_q16/datafusion:parquet 50719865 52009979 0.98
tpch_q17/datafusion:parquet 🚨 144614062 127841566 1.13
tpch_q18/datafusion:parquet 172545816 175213862 0.98
tpch_q19/datafusion:parquet 🚀 72936084 89076217 0.82
tpch_q20/datafusion:parquet 76106490 76493866 0.99
tpch_q21/datafusion:parquet 150923652 145697670 1.04
tpch_q22/datafusion:parquet 35478119 34815258 1.02
datafusion / arrow (1.010x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 53224826 55132518 0.97
tpch_q02/datafusion:arrow 21835786 22338673 0.98
tpch_q03/datafusion:arrow 33975100 34725027 0.98
tpch_q04/datafusion:arrow 27411211 27557590 0.99
tpch_q05/datafusion:arrow 77318615 83160660 0.93
tpch_q06/datafusion:arrow 20241419 20610521 0.98
tpch_q07/datafusion:arrow 113948461 113589693 1.00
tpch_q08/datafusion:arrow 44897394 45197480 0.99
tpch_q09/datafusion:arrow 72797452 68945176 1.06
tpch_q10/datafusion:arrow 54995189 50587594 1.09
tpch_q11/datafusion:arrow 12061089 11595950 1.04
tpch_q12/datafusion:arrow 🚨 59980823 54269461 1.11
tpch_q13/datafusion:arrow 51078237 49449039 1.03
tpch_q14/datafusion:arrow 23889290 22974190 1.04
tpch_q15/datafusion:arrow 45864590 44133261 1.04
tpch_q16/datafusion:arrow 21376020 20968514 1.02
tpch_q17/datafusion:arrow 73017238 72621986 1.01
tpch_q18/datafusion:arrow 146997104 142190609 1.03
tpch_q19/datafusion:arrow 40408282 44672267 0.90
tpch_q20/datafusion:arrow 40216088 39958386 1.01
tpch_q21/datafusion:arrow 157486581 152450079 1.03
tpch_q22/datafusion:arrow 20467734 20348360 1.01
duckdb / vortex-file-compressed (1.027x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33268509 33025707 1.01
tpch_q02/duckdb:vortex-file-compressed 27403575 26864391 1.02
tpch_q03/duckdb:vortex-file-compressed 29393887 28874434 1.02
tpch_q04/duckdb:vortex-file-compressed 28883745 28903090 1.00
tpch_q05/duckdb:vortex-file-compressed 34194984 32846451 1.04
tpch_q06/duckdb:vortex-file-compressed 11355782 10473593 1.08
tpch_q07/duckdb:vortex-file-compressed 38539296 36915479 1.04
tpch_q08/duckdb:vortex-file-compressed 41677663 38917966 1.07
tpch_q09/duckdb:vortex-file-compressed 76274505 79574003 0.96
tpch_q10/duckdb:vortex-file-compressed 37498349 35408569 1.06
tpch_q11/duckdb:vortex-file-compressed 16270343 15500975 1.05
tpch_q12/duckdb:vortex-file-compressed 22566154 22118833 1.02
tpch_q13/duckdb:vortex-file-compressed 38413925 36479704 1.05
tpch_q14/duckdb:vortex-file-compressed 22222525 20874987 1.06
tpch_q15/duckdb:vortex-file-compressed 16215957 16002601 1.01
tpch_q16/duckdb:vortex-file-compressed 30527119 30191146 1.01
tpch_q17/duckdb:vortex-file-compressed 25404209 24869410 1.02
tpch_q18/duckdb:vortex-file-compressed 46369915 47263719 0.98
tpch_q19/duckdb:vortex-file-compressed 33338943 32280091 1.03
tpch_q20/duckdb:vortex-file-compressed 34528901 34233497 1.01
tpch_q21/duckdb:vortex-file-compressed 103814751 101931237 1.02
tpch_q22/duckdb:vortex-file-compressed 18597474 18053677 1.03
duckdb / vortex-compact (1.022x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40688391 39893204 1.02
tpch_q02/duckdb:vortex-compact 36721572 37551994 0.98
tpch_q03/duckdb:vortex-compact 33566046 32422200 1.04
tpch_q04/duckdb:vortex-compact 34093329 35170089 0.97
tpch_q05/duckdb:vortex-compact 38778505 38352133 1.01
tpch_q06/duckdb:vortex-compact 🚨 16188513 14258377 1.14
tpch_q07/duckdb:vortex-compact 43900450 41994998 1.05
tpch_q08/duckdb:vortex-compact 48257634 45908894 1.05
tpch_q09/duckdb:vortex-compact 93971514 86796211 1.08
tpch_q10/duckdb:vortex-compact 42292923 40893133 1.03
tpch_q11/duckdb:vortex-compact 21478140 20963469 1.02
tpch_q12/duckdb:vortex-compact 38033371 36713715 1.04
tpch_q13/duckdb:vortex-compact 47911926 46525801 1.03
tpch_q14/duckdb:vortex-compact 30705370 30451624 1.01
tpch_q15/duckdb:vortex-compact 19617462 19491815 1.01
tpch_q16/duckdb:vortex-compact 36728685 36654274 1.00
tpch_q17/duckdb:vortex-compact 31975401 30947390 1.03
tpch_q18/duckdb:vortex-compact 51576594 51737284 1.00
tpch_q19/duckdb:vortex-compact 37771520 36700456 1.03
tpch_q20/duckdb:vortex-compact 42168861 44345295 0.95
tpch_q21/duckdb:vortex-compact 116069961 111388610 1.04
tpch_q22/duckdb:vortex-compact 20663025 20919312 0.99
duckdb / parquet (0.997x ➖, 6↑ 2↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77327960 77404094 1.00
tpch_q02/duckdb:parquet 40576798 39185264 1.04
tpch_q03/duckdb:parquet 69753333 69225304 1.01
tpch_q04/duckdb:parquet 🚀 46719320 56048278 0.83
tpch_q05/duckdb:parquet 68528572 65940715 1.04
tpch_q06/duckdb:parquet 21083261 20881093 1.01
tpch_q07/duckdb:parquet 🚀 68942971 79538121 0.87
tpch_q08/duckdb:parquet 81631278 79556248 1.03
tpch_q09/duckdb:parquet 🚀 135473240 154462632 0.88
tpch_q10/duckdb:parquet 125711335 124072890 1.01
tpch_q11/duckdb:parquet 22811668 22114273 1.03
tpch_q12/duckdb:parquet 🚀 45224932 51333854 0.88
tpch_q13/duckdb:parquet 263628918 259800113 1.01
tpch_q14/duckdb:parquet 48862768 48783720 1.00
tpch_q15/duckdb:parquet 🚨 32620857 23819583 1.37
tpch_q16/duckdb:parquet 56074645 54624419 1.03
tpch_q17/duckdb:parquet 🚀 48837661 57620781 0.85
tpch_q18/duckdb:parquet 119955993 115567719 1.04
tpch_q19/duckdb:parquet 🚀 68379529 76567227 0.89
tpch_q20/duckdb:parquet 🚨 81459163 63124256 1.29
tpch_q21/duckdb:parquet 181566413 180766727 1.00
tpch_q22/duckdb:parquet 51682861 52330070 0.99
duckdb / duckdb (1.023x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16254817 16049706 1.01
tpch_q02/duckdb:duckdb 11856427 12449698 0.95
tpch_q03/duckdb:duckdb 19962188 19138445 1.04
tpch_q04/duckdb:duckdb 19751822 19168671 1.03
tpch_q05/duckdb:duckdb 🚨 20868319 18790734 1.11
tpch_q06/duckdb:duckdb 5469486 5332818 1.03
tpch_q07/duckdb:duckdb 23325128 23164106 1.01
tpch_q08/duckdb:duckdb 20934035 20793554 1.01
tpch_q09/duckdb:duckdb 56360123 53274465 1.06
tpch_q10/duckdb:duckdb 44005270 40313142 1.09
tpch_q11/duckdb:duckdb 5932511 5589083 1.06
tpch_q12/duckdb:duckdb 13757753 13566886 1.01
tpch_q13/duckdb:duckdb 39339810 36020632 1.09
tpch_q14/duckdb:duckdb 16176372 16393615 0.99
tpch_q15/duckdb:duckdb 11822748 11751084 1.01
tpch_q16/duckdb:duckdb 23969846 22884296 1.05
tpch_q17/duckdb:duckdb 13533684 13794595 0.98
tpch_q18/duckdb:duckdb 40154306 37503633 1.07
tpch_q19/duckdb:duckdb 26010672 27652318 0.94
tpch_q20/duckdb:duckdb 22532660 22768892 0.99
tpch_q21/duckdb:duckdb 57011109 55729227 1.02
tpch_q22/duckdb:duckdb 23779700 24152501 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.5% -0.4% -3.1% +28.7% ➖ noise
1 datafusion:vortex-compact -0.8% -0.4% -0.4% +26.4% ➖ noise
1 datafusion:vortex-file-compressed +2.4% -0.4% +2.8% +27.5% ➖ noise
1 duckdb:duckdb +1.3% -0.4% +1.7% +25.9% ➖ noise
1 duckdb:vortex-compact +2.0% -0.4% +2.4% +25.0% ➖ noise
1 duckdb:vortex-file-compressed +0.7% -0.4% +1.1% +25.8% ➖ noise
2 datafusion:arrow -2.3% +2.6% -4.7% +21.7% ➖ noise
2 datafusion:vortex-compact +2.9% +2.6% +0.3% +21.7% ➖ noise
2 datafusion:vortex-file-compressed -1.0% +2.6% -3.5% +21.7% ➖ noise
2 duckdb:duckdb -4.8% +2.6% -7.2% +21.7% ➖ noise
2 duckdb:vortex-compact -2.2% +2.6% -4.7% +21.7% ➖ noise
2 duckdb:vortex-file-compressed +2.0% +2.6% -0.6% +21.7% ➖ noise
3 datafusion:arrow -2.2% +2.6% -4.7% +21.7% ➖ noise
3 datafusion:vortex-compact -2.1% +2.6% -4.6% +21.7% ➖ noise
3 datafusion:vortex-file-compressed -3.6% +2.6% -6.1% +21.7% ➖ noise
3 duckdb:duckdb +4.3% +2.6% +1.6% +21.7% ➖ noise
3 duckdb:vortex-compact +3.5% +2.6% +0.9% +21.7% ➖ noise
3 duckdb:vortex-file-compressed +1.8% +2.6% -0.8% +21.7% ➖ noise
4 datafusion:arrow -0.5% -8.1% +8.3% +21.7% ➖ noise
4 datafusion:vortex-compact +1.2% -8.1% +10.2% +21.7% ➖ noise
4 datafusion:vortex-file-compressed -3.8% -8.1% +4.7% +21.7% ➖ noise
4 duckdb:duckdb +3.0% -8.1% +12.2% +21.7% ➖ noise
4 duckdb:vortex-compact -3.1% -8.1% +5.5% +21.7% ➖ noise
4 duckdb:vortex-file-compressed -0.1% -8.1% +8.8% +21.7% ➖ noise
5 datafusion:arrow -7.0% +2.7% -9.5% +21.7% ➖ noise
5 datafusion:vortex-compact +0.3% +2.7% -2.3% +21.7% ➖ noise
5 datafusion:vortex-file-compressed +1.9% +2.7% -0.8% +21.7% ➖ noise
5 duckdb:duckdb +11.1% +2.7% +8.2% +21.7% ➖ noise
5 duckdb:vortex-compact +1.1% +2.7% -1.5% +21.7% ➖ noise
5 duckdb:vortex-file-compressed +4.1% +2.7% +1.4% +21.7% ➖ noise
6 datafusion:arrow -1.8% +15.6% -15.0% +21.7% ➖ noise
6 datafusion:vortex-compact +2.3% +15.6% -11.5% +21.7% ➖ noise
6 datafusion:vortex-file-compressed +4.7% +15.6% -9.4% +21.7% ➖ noise
6 duckdb:duckdb +2.6% +15.6% -11.3% +21.9% ➖ noise
6 duckdb:vortex-compact +13.5% +15.6% -1.8% +24.3% ➖ noise
6 duckdb:vortex-file-compressed +8.4% +15.6% -6.2% +21.7% ➖ noise
7 datafusion:arrow +0.3% -5.5% +6.1% +21.7% ➖ noise
7 datafusion:vortex-compact +0.1% -5.5% +5.9% +21.7% ➖ noise
7 datafusion:vortex-file-compressed +4.6% -5.5% +10.7% +21.7% ➖ noise
7 duckdb:duckdb +0.7% -5.5% +6.5% +21.7% ➖ noise
7 duckdb:vortex-compact +4.5% -5.5% +10.6% +21.7% ➖ noise
7 duckdb:vortex-file-compressed +4.4% -5.5% +10.4% +21.7% ➖ noise
8 datafusion:arrow -0.7% +6.8% -7.0% +21.7% ➖ noise
8 datafusion:vortex-compact +1.1% +6.8% -5.4% +21.7% ➖ noise
8 datafusion:vortex-file-compressed -0.1% +6.8% -6.5% +21.7% ➖ noise
8 duckdb:duckdb +0.7% +6.8% -5.8% +21.7% ➖ noise
8 duckdb:vortex-compact +5.1% +6.8% -1.6% +21.7% ➖ noise
8 duckdb:vortex-file-compressed +7.1% +6.8% +0.2% +21.7% ➖ noise
9 datafusion:arrow +5.6% -4.7% +10.8% +21.7% ➖ noise
9 datafusion:vortex-compact +3.0% -4.7% +8.1% +21.7% ➖ noise
9 datafusion:vortex-file-compressed +4.2% -4.7% +9.3% +21.7% ➖ noise
9 duckdb:duckdb +5.8% -4.7% +11.0% +21.7% ➖ noise
9 duckdb:vortex-compact +8.3% -4.7% +13.6% +21.7% ➖ noise
9 duckdb:vortex-file-compressed -4.1% -4.7% +0.6% +21.7% ➖ noise
10 datafusion:arrow +8.7% +1.6% +7.0% +21.7% ➖ noise
10 datafusion:vortex-compact -2.7% +1.6% -4.2% +21.7% ➖ noise
10 datafusion:vortex-file-compressed -4.1% +1.6% -5.5% +21.7% ➖ noise
10 duckdb:duckdb +9.2% +1.6% +7.5% +21.7% ➖ noise
10 duckdb:vortex-compact +3.4% +1.6% +1.8% +21.7% ➖ noise
10 duckdb:vortex-file-compressed +5.9% +1.6% +4.3% +21.7% ➖ noise
11 datafusion:arrow +4.0% +2.6% +1.4% +33.2% ➖ noise
11 datafusion:vortex-compact +0.2% +2.6% -2.3% +21.7% ➖ noise
11 datafusion:vortex-file-compressed -0.7% +2.6% -3.2% +21.7% ➖ noise
11 duckdb:duckdb +6.1% +2.6% +3.4% +21.7% ➖ noise
11 duckdb:vortex-compact +2.5% +2.6% -0.2% +21.7% ➖ noise
11 duckdb:vortex-file-compressed +5.0% +2.6% +2.3% +21.7% ➖ noise
12 datafusion:arrow +10.5% -4.8% +16.1% +21.7% ➖ noise
12 datafusion:vortex-compact +0.8% -4.8% +6.0% +21.7% ➖ noise
12 datafusion:vortex-file-compressed +0.7% -4.8% +5.9% +21.7% ➖ noise
12 duckdb:duckdb +1.4% -4.8% +6.6% +21.7% ➖ noise
12 duckdb:vortex-compact +3.6% -4.8% +8.9% +21.7% ➖ noise
12 duckdb:vortex-file-compressed +2.0% -4.8% +7.2% +21.7% ➖ noise
13 datafusion:arrow +3.3% +3.3% +0.0% +21.7% ➖ noise
13 datafusion:vortex-compact -2.5% +3.3% -5.6% +21.7% ➖ noise
13 datafusion:vortex-file-compressed +2.9% +3.3% -0.3% +21.7% ➖ noise
13 duckdb:duckdb +9.2% +3.3% +5.8% +21.7% ➖ noise
13 duckdb:vortex-compact +3.0% +3.3% -0.3% +21.7% ➖ noise
13 duckdb:vortex-file-compressed +5.3% +3.3% +2.0% +21.7% ➖ noise
14 datafusion:arrow +4.0% +9.9% -5.3% +21.7% ➖ noise
14 datafusion:vortex-compact -0.6% +9.9% -9.5% +21.7% ➖ noise
14 datafusion:vortex-file-compressed +0.1% +9.9% -8.9% +21.7% ➖ noise
14 duckdb:duckdb -1.3% +9.9% -10.2% +28.8% ➖ noise
14 duckdb:vortex-compact +0.8% +9.9% -8.2% +21.7% ➖ noise
14 duckdb:vortex-file-compressed +6.5% +9.9% -3.1% +21.7% ➖ noise
15 datafusion:arrow +3.9% +20.2% -13.5% +21.7% ➖ noise
15 datafusion:vortex-compact +3.2% +20.2% -14.1% +21.7% ➖ noise
15 datafusion:vortex-file-compressed -2.8% +20.2% -19.1% +21.7% ✅ faster
15 duckdb:duckdb +0.6% +20.2% -16.3% +21.7% ➖ noise
15 duckdb:vortex-compact +0.6% +20.2% -16.2% +21.7% ➖ noise
15 duckdb:vortex-file-compressed +1.3% +20.2% -15.7% +21.7% ➖ noise
16 datafusion:arrow +1.9% +0.1% +1.9% +21.7% ➖ noise
16 datafusion:vortex-compact +2.1% +0.1% +2.0% +21.7% ➖ noise
16 datafusion:vortex-file-compressed +3.9% +0.1% +3.9% +21.7% ➖ noise
16 duckdb:duckdb +4.7% +0.1% +4.7% +21.7% ➖ noise
16 duckdb:vortex-compact +0.2% +0.1% +0.1% +21.7% ➖ noise
16 duckdb:vortex-file-compressed +1.1% +0.1% +1.1% +21.7% ➖ noise
17 datafusion:arrow +0.5% -2.1% +2.7% +21.7% ➖ noise
17 datafusion:vortex-compact -1.3% -2.1% +0.8% +21.7% ➖ noise
17 datafusion:vortex-file-compressed +1.0% -2.1% +3.2% +21.7% ➖ noise
17 duckdb:duckdb -1.9% -2.1% +0.2% +21.7% ➖ noise
17 duckdb:vortex-compact +3.3% -2.1% +5.5% +21.7% ➖ noise
17 duckdb:vortex-file-compressed +2.2% -2.1% +4.3% +21.7% ➖ noise
18 datafusion:arrow +3.4% +1.1% +2.3% +21.7% ➖ noise
18 datafusion:vortex-compact +4.2% +1.1% +3.1% +21.7% ➖ noise
18 datafusion:vortex-file-compressed +0.9% +1.1% -0.2% +21.7% ➖ noise
18 duckdb:duckdb +7.1% +1.1% +5.9% +21.7% ➖ noise
18 duckdb:vortex-compact -0.3% +1.1% -1.4% +21.7% ➖ noise
18 duckdb:vortex-file-compressed -1.9% +1.1% -3.0% +21.7% ➖ noise
19 datafusion:arrow -9.5% -14.5% +5.8% +21.7% ➖ noise
19 datafusion:vortex-compact +4.6% -14.5% +22.3% +21.7% 🚨 regression
19 datafusion:vortex-file-compressed +7.4% -14.5% +25.6% +21.7% 🚨 regression
19 duckdb:duckdb -5.9% -14.5% +10.0% +21.7% ➖ noise
19 duckdb:vortex-compact +2.9% -14.5% +20.4% +21.7% ➖ noise
19 duckdb:vortex-file-compressed +3.3% -14.5% +20.8% +21.7% ➖ noise
20 datafusion:arrow +0.6% +13.3% -11.2% +21.7% ➖ noise
20 datafusion:vortex-compact +5.1% +13.3% -7.2% +21.7% ➖ noise
20 datafusion:vortex-file-compressed -6.2% +13.3% -17.3% +21.7% ➖ noise
20 duckdb:duckdb -1.0% +13.3% -12.7% +21.7% ➖ noise
20 duckdb:vortex-compact -4.9% +13.3% -16.1% +21.7% ➖ noise
20 duckdb:vortex-file-compressed +0.9% +13.3% -11.0% +21.7% ➖ noise
21 datafusion:arrow +3.3% +2.0% +1.3% +21.7% ➖ noise
21 datafusion:vortex-compact +2.7% +2.0% +0.6% +21.7% ➖ noise
21 datafusion:vortex-file-compressed +4.4% +2.0% +2.3% +21.7% ➖ noise
21 duckdb:duckdb +2.3% +2.0% +0.3% +21.7% ➖ noise
21 duckdb:vortex-compact +4.2% +2.0% +2.2% +21.7% ➖ noise
21 duckdb:vortex-file-compressed +1.8% +2.0% -0.2% +21.7% ➖ noise
22 datafusion:arrow +0.6% +0.3% +0.3% +21.7% ➖ noise
22 datafusion:vortex-compact -0.5% +0.3% -0.9% +21.7% ➖ noise
22 datafusion:vortex-file-compressed +6.3% +0.3% +5.9% +21.7% ➖ noise
22 duckdb:duckdb -1.5% +0.3% -1.9% +21.7% ➖ noise
22 duckdb:vortex-compact -1.2% +0.3% -1.5% +21.7% ➖ noise
22 duckdb:vortex-file-compressed +3.0% +0.3% +2.7% +21.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish +1.7%


datafusion / vortex-file-compressed (1.029x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 6430351 6529421 0.98
fineweb_q01/datafusion:vortex-file-compressed 31066523 29079473 1.07
fineweb_q02/datafusion:vortex-file-compressed 31133111 33751265 0.92
fineweb_q03/datafusion:vortex-file-compressed 94886545 93364613 1.02
fineweb_q04/datafusion:vortex-file-compressed 275360924 273644727 1.01
fineweb_q05/datafusion:vortex-file-compressed 247064309 247379992 1.00
fineweb_q06/datafusion:vortex-file-compressed 78762693 73796337 1.07
fineweb_q07/datafusion:vortex-file-compressed 🚨 84384377 75333035 1.12
fineweb_q08/datafusion:vortex-file-compressed 31336705 28616089 1.10
datafusion / vortex-compact (1.054x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5673022 5162633 1.10
fineweb_q01/datafusion:vortex-compact 🚨 184399339 167366677 1.10
fineweb_q02/datafusion:vortex-compact 184132120 170679481 1.08
fineweb_q03/datafusion:vortex-compact 1629099732 1555130943 1.05
fineweb_q04/datafusion:vortex-compact 1784907492 1717694705 1.04
fineweb_q05/datafusion:vortex-compact 1415834521 1339037275 1.06
fineweb_q06/datafusion:vortex-compact 802250259 761663864 1.05
fineweb_q07/datafusion:vortex-compact 825010743 807248555 1.02
fineweb_q08/datafusion:vortex-compact 24482232 24586642 1.00
datafusion / parquet (1.003x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 7071230 7292299 0.97
fineweb_q01/datafusion:parquet 288986771 303649146 0.95
fineweb_q02/datafusion:parquet 296696956 309062704 0.96
fineweb_q03/datafusion:parquet 316848408 300651810 1.05
fineweb_q04/datafusion:parquet 316259105 317336182 1.00
fineweb_q05/datafusion:parquet 315695719 310571776 1.02
fineweb_q06/datafusion:parquet 301530479 311175342 0.97
fineweb_q07/datafusion:parquet 312321184 293766428 1.06
fineweb_q08/datafusion:parquet 302789658 288402493 1.05
duckdb / vortex-file-compressed (0.970x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3635929 3958736 0.92
fineweb_q01/duckdb:vortex-file-compressed 28438729 28728517 0.99
fineweb_q02/duckdb:vortex-file-compressed 27896072 29422490 0.95
fineweb_q03/duckdb:vortex-file-compressed 161310667 171873157 0.94
fineweb_q04/duckdb:vortex-file-compressed 237672902 236938146 1.00
fineweb_q05/duckdb:vortex-file-compressed 221446237 219674658 1.01
fineweb_q06/duckdb:vortex-file-compressed 69290307 68615583 1.01
fineweb_q07/duckdb:vortex-file-compressed 69908127 75658441 0.92
fineweb_q08/duckdb:vortex-file-compressed 27415856 27633708 0.99
duckdb / vortex-compact (1.014x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4678683 4719526 0.99
fineweb_q01/duckdb:vortex-compact 106337033 108454341 0.98
fineweb_q02/duckdb:vortex-compact 120655778 122854040 0.98
fineweb_q03/duckdb:vortex-compact 953511694 935288726 1.02
fineweb_q04/duckdb:vortex-compact 1023248694 995361576 1.03
fineweb_q05/duckdb:vortex-compact 917639593 893610849 1.03
fineweb_q06/duckdb:vortex-compact 525755268 500856848 1.05
fineweb_q07/duckdb:vortex-compact 534535786 510962723 1.05
fineweb_q08/duckdb:vortex-compact 24997278 24968775 1.00
duckdb / parquet (1.004x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 38968374 39656486 0.98
fineweb_q01/duckdb:parquet 105009890 103126595 1.02
fineweb_q02/duckdb:parquet 109865683 107562218 1.02
fineweb_q03/duckdb:parquet 340376088 328057639 1.04
fineweb_q04/duckdb:parquet 474694145 456561716 1.04
fineweb_q05/duckdb:parquet 448301521 435018485 1.03
fineweb_q06/duckdb:parquet 209219825 216149482 0.97
fineweb_q07/duckdb:parquet 223652915 225804724 0.99
fineweb_q08/duckdb:parquet 61322579 64511311 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +9.9% -2.4% +12.6% +37.8% ➖ noise
0 datafusion:vortex-file-compressed -1.5% -2.4% +0.9% +50.2% ➖ noise
0 duckdb:vortex-compact -0.9% -2.4% +1.6% +31.3% ➖ noise
0 duckdb:vortex-file-compressed -8.2% -2.4% -5.9% +46.8% ➖ noise
1 datafusion:vortex-compact +10.2% -1.6% +11.9% +10.0% 🚨 regression
1 datafusion:vortex-file-compressed +6.8% -1.6% +8.5% +11.4% ➖ noise
1 duckdb:vortex-compact -2.0% -1.6% -0.4% +14.7% ➖ noise
1 duckdb:vortex-file-compressed -1.0% -1.6% +0.6% +39.9% ➖ noise
2 datafusion:vortex-compact +7.9% -1.0% +8.9% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.8% -1.0% -6.8% +18.6% ➖ noise
2 duckdb:vortex-compact -1.8% -1.0% -0.8% +13.5% ➖ noise
2 duckdb:vortex-file-compressed -5.2% -1.0% -4.3% +10.0% ➖ noise
3 datafusion:vortex-compact +4.8% +4.6% +0.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +1.6% +4.6% -2.8% +29.1% ➖ noise
3 duckdb:vortex-compact +1.9% +4.6% -2.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -6.1% +4.6% -10.2% +28.3% ➖ noise
4 datafusion:vortex-compact +3.9% +1.8% +2.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.6% +1.8% -1.1% +10.0% ➖ noise
4 duckdb:vortex-compact +2.8% +1.8% +1.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.3% +1.8% -1.5% +10.0% ➖ noise
5 datafusion:vortex-compact +5.7% +2.3% +3.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -0.1% +2.3% -2.4% +11.0% ➖ noise
5 duckdb:vortex-compact +2.7% +2.3% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.8% +2.3% -1.5% +10.0% ➖ noise
6 datafusion:vortex-compact +5.3% -3.2% +8.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +6.7% -3.2% +10.2% +11.2% ➖ noise
6 duckdb:vortex-compact +5.0% -3.2% +8.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.0% -3.2% +4.3% +12.7% ➖ noise
7 datafusion:vortex-compact +2.2% +2.6% -0.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +12.0% +2.6% +9.2% +10.0% ➖ noise
7 duckdb:vortex-compact +4.6% +2.6% +1.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -7.6% +2.6% -10.0% +13.2% ➖ noise
8 datafusion:vortex-compact -0.4% -0.1% -0.3% +12.7% ➖ noise
8 datafusion:vortex-file-compressed +9.5% -0.1% +9.6% +37.7% ➖ noise
8 duckdb:vortex-compact +0.1% -0.1% +0.2% +25.4% ➖ noise
8 duckdb:vortex-file-compressed -0.8% -0.1% -0.7% +11.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.6%
Vortex (geomean): 1.003x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish +5.2%


datafusion / vortex-file-compressed (0.919x ➖, 25↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30667056 32327926 0.95
tpcds_q02/datafusion:vortex-file-compressed 🚀 55892316 62244123 0.90
tpcds_q03/datafusion:vortex-file-compressed 🚀 22040295 24826593 0.89
tpcds_q04/datafusion:vortex-file-compressed 🚀 313026540 348992019 0.90
tpcds_q05/datafusion:vortex-file-compressed 58935903 62811774 0.94
tpcds_q06/datafusion:vortex-file-compressed 🚀 55393794 61677352 0.90
tpcds_q07/datafusion:vortex-file-compressed 60659535 63383630 0.96
tpcds_q08/datafusion:vortex-file-compressed 39992044 43785997 0.91
tpcds_q09/datafusion:vortex-file-compressed 59307339 63564874 0.93
tpcds_q10/datafusion:vortex-file-compressed 50094362 55219229 0.91
tpcds_q11/datafusion:vortex-file-compressed 🚀 179535906 202743269 0.89
tpcds_q12/datafusion:vortex-file-compressed 🚀 24648517 27660012 0.89
tpcds_q13/datafusion:vortex-file-compressed 66550065 71082219 0.94
tpcds_q14/datafusion:vortex-file-compressed 216271732 237811026 0.91
tpcds_q15/datafusion:vortex-file-compressed 🚀 36679076 42511946 0.86
tpcds_q16/datafusion:vortex-file-compressed 30230087 33491862 0.90
tpcds_q17/datafusion:vortex-file-compressed 71525078 79318369 0.90
tpcds_q18/datafusion:vortex-file-compressed 87538640 90323977 0.97
tpcds_q19/datafusion:vortex-file-compressed 34694611 35915360 0.97
tpcds_q20/datafusion:vortex-file-compressed 29034233 30007051 0.97
tpcds_q21/datafusion:vortex-file-compressed 147184440 159242154 0.92
tpcds_q22/datafusion:vortex-file-compressed 64432096 70999902 0.91
tpcds_q23/datafusion:vortex-file-compressed 161488051 179010676 0.90
tpcds_q24/datafusion:vortex-file-compressed 123269175 134078291 0.92
tpcds_q25/datafusion:vortex-file-compressed 73390139 80201407 0.92
tpcds_q26/datafusion:vortex-file-compressed 39683644 42561158 0.93
tpcds_q27/datafusion:vortex-file-compressed 130662492 142370583 0.92
tpcds_q28/datafusion:vortex-file-compressed 52742732 56389227 0.94
tpcds_q29/datafusion:vortex-file-compressed 72815896 79756162 0.91
tpcds_q30/datafusion:vortex-file-compressed 34089269 34532846 0.99
tpcds_q31/datafusion:vortex-file-compressed 108403264 113304993 0.96
tpcds_q32/datafusion:vortex-file-compressed 23243095 24689224 0.94
tpcds_q33/datafusion:vortex-file-compressed 42891120 44659682 0.96
tpcds_q34/datafusion:vortex-file-compressed 36671347 39163925 0.94
tpcds_q35/datafusion:vortex-file-compressed 59809526 63926622 0.94
tpcds_q36/datafusion:vortex-file-compressed 82013128 88821824 0.92
tpcds_q37/datafusion:vortex-file-compressed 🚀 35866674 42027963 0.85
tpcds_q38/datafusion:vortex-file-compressed 58935906 61982964 0.95
tpcds_q39/datafusion:vortex-file-compressed 🚀 149133199 176161546 0.85
tpcds_q40/datafusion:vortex-file-compressed 57084079 61350217 0.93
tpcds_q41/datafusion:vortex-file-compressed 🚀 19714551 22014643 0.90
tpcds_q42/datafusion:vortex-file-compressed 🚀 19784683 22316647 0.89
tpcds_q43/datafusion:vortex-file-compressed 🚀 34828180 39477614 0.88
tpcds_q44/datafusion:vortex-file-compressed 49685339 54641090 0.91
tpcds_q45/datafusion:vortex-file-compressed 36298797 38910320 0.93
tpcds_q46/datafusion:vortex-file-compressed 54012263 58804506 0.92
tpcds_q47/datafusion:vortex-file-compressed 228670513 250198002 0.91
tpcds_q48/datafusion:vortex-file-compressed 51046643 56336141 0.91
tpcds_q49/datafusion:vortex-file-compressed 74188811 81145889 0.91
tpcds_q50/datafusion:vortex-file-compressed 🚀 49822782 58263723 0.86
tpcds_q51/datafusion:vortex-file-compressed 🚀 93755779 106483574 0.88
tpcds_q52/datafusion:vortex-file-compressed 🚀 20261054 22840365 0.89
tpcds_q53/datafusion:vortex-file-compressed 29401803 30371731 0.97
tpcds_q54/datafusion:vortex-file-compressed 46922404 52019546 0.90
tpcds_q55/datafusion:vortex-file-compressed 20142072 20741293 0.97
tpcds_q56/datafusion:vortex-file-compressed 43836281 46840581 0.94
tpcds_q57/datafusion:vortex-file-compressed 139145724 149653508 0.93
tpcds_q58/datafusion:vortex-file-compressed 🚀 74748451 83863594 0.89
tpcds_q59/datafusion:vortex-file-compressed 80235463 87622098 0.92
tpcds_q60/datafusion:vortex-file-compressed 45824762 47953361 0.96
tpcds_q61/datafusion:vortex-file-compressed 🚀 54373202 60920507 0.89
tpcds_q62/datafusion:vortex-file-compressed 🚀 32358784 38695813 0.84
tpcds_q63/datafusion:vortex-file-compressed 27953905 31000958 0.90
tpcds_q64/datafusion:vortex-file-compressed 501642405 544445532 0.92
tpcds_q65/datafusion:vortex-file-compressed 52151892 56471771 0.92
tpcds_q66/datafusion:vortex-file-compressed 99990675 107253481 0.93
tpcds_q67/datafusion:vortex-file-compressed 127682551 140281463 0.91
tpcds_q68/datafusion:vortex-file-compressed 52408391 52754388 0.99
tpcds_q69/datafusion:vortex-file-compressed 46935522 49339286 0.95
tpcds_q70/datafusion:vortex-file-compressed 118829404 126834720 0.94
tpcds_q71/datafusion:vortex-file-compressed 34520388 37743720 0.91
tpcds_q72/datafusion:vortex-file-compressed 🚀 2881258877 3292479629 0.88
tpcds_q73/datafusion:vortex-file-compressed 🚀 39398421 44565243 0.88
tpcds_q74/datafusion:vortex-file-compressed 126789706 140799797 0.90
tpcds_q75/datafusion:vortex-file-compressed 🚀 125472570 143122424 0.88
tpcds_q76/datafusion:vortex-file-compressed 38263060 40842634 0.94
tpcds_q77/datafusion:vortex-file-compressed 56660335 60092973 0.94
tpcds_q78/datafusion:vortex-file-compressed 139606326 154843269 0.90
tpcds_q79/datafusion:vortex-file-compressed 45952156 48654541 0.94
tpcds_q80/datafusion:vortex-file-compressed 123832599 137503005 0.90
tpcds_q81/datafusion:vortex-file-compressed 40528027 44417893 0.91
tpcds_q82/datafusion:vortex-file-compressed 🚀 38782641 45974007 0.84
tpcds_q83/datafusion:vortex-file-compressed 55632597 58106884 0.96
tpcds_q84/datafusion:vortex-file-compressed 18240120 18501062 0.99
tpcds_q85/datafusion:vortex-file-compressed 111244007 114840230 0.97
tpcds_q86/datafusion:vortex-file-compressed 21643827 22522300 0.96
tpcds_q87/datafusion:vortex-file-compressed 60002456 65064517 0.92
tpcds_q88/datafusion:vortex-file-compressed 88732908 98443203 0.90
tpcds_q89/datafusion:vortex-file-compressed 40085849 43704911 0.92
tpcds_q90/datafusion:vortex-file-compressed 20706982 21492931 0.96
tpcds_q91/datafusion:vortex-file-compressed 29582974 30862192 0.96
tpcds_q92/datafusion:vortex-file-compressed 21860838 22392134 0.98
tpcds_q93/datafusion:vortex-file-compressed 🚀 38254972 43220630 0.89
tpcds_q94/datafusion:vortex-file-compressed 28488712 29141076 0.98
tpcds_q95/datafusion:vortex-file-compressed 63798613 70645413 0.90
tpcds_q96/datafusion:vortex-file-compressed 🚀 19390916 21718627 0.89
tpcds_q97/datafusion:vortex-file-compressed 🚀 34089621 38603073 0.88
tpcds_q98/datafusion:vortex-file-compressed 35753393 39704994 0.90
tpcds_q99/datafusion:vortex-file-compressed 51457944 57097286 0.90
datafusion / vortex-compact (0.949x ➖, 18↑ 3↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 39695461 42884114 0.93
tpcds_q02/datafusion:vortex-compact 61994267 66102682 0.94
tpcds_q03/datafusion:vortex-compact 28512229 29531173 0.97
tpcds_q04/datafusion:vortex-compact 🚀 352791663 393642309 0.90
tpcds_q05/datafusion:vortex-compact 🚀 69021914 77035625 0.90
tpcds_q06/datafusion:vortex-compact 🚀 60918170 67999688 0.90
tpcds_q07/datafusion:vortex-compact 🚀 72142111 82208093 0.88
tpcds_q08/datafusion:vortex-compact 48697967 51138232 0.95
tpcds_q09/datafusion:vortex-compact 🚀 109734314 133161493 0.82
tpcds_q10/datafusion:vortex-compact 66343948 71419684 0.93
tpcds_q11/datafusion:vortex-compact 🚀 196193200 229260834 0.86
tpcds_q12/datafusion:vortex-compact 28204255 30519028 0.92
tpcds_q13/datafusion:vortex-compact 135193594 146132243 0.93
tpcds_q14/datafusion:vortex-compact 🚀 264309708 299207640 0.88
tpcds_q15/datafusion:vortex-compact 42861252 47429453 0.90
tpcds_q16/datafusion:vortex-compact 42555845 45206402 0.94
tpcds_q17/datafusion:vortex-compact 100170403 107452143 0.93
tpcds_q18/datafusion:vortex-compact 99254774 105800260 0.94
tpcds_q19/datafusion:vortex-compact 44596794 48213931 0.92
tpcds_q20/datafusion:vortex-compact 33729121 34499336 0.98
tpcds_q21/datafusion:vortex-compact 151979842 166803942 0.91
tpcds_q22/datafusion:vortex-compact 🚀 69902205 78320332 0.89
tpcds_q23/datafusion:vortex-compact 🚀 191962469 213650315 0.90
tpcds_q24/datafusion:vortex-compact 146371273 159665139 0.92
tpcds_q25/datafusion:vortex-compact 99055281 105583607 0.94
tpcds_q26/datafusion:vortex-compact 50851810 52989179 0.96
tpcds_q27/datafusion:vortex-compact 167096658 180891535 0.92
tpcds_q28/datafusion:vortex-compact 107661038 115493863 0.93
tpcds_q29/datafusion:vortex-compact 98577951 108950194 0.90
tpcds_q30/datafusion:vortex-compact 40106448 41867799 0.96
tpcds_q31/datafusion:vortex-compact 131427943 145360255 0.90
tpcds_q32/datafusion:vortex-compact 28373612 30426465 0.93
tpcds_q33/datafusion:vortex-compact 53230648 56994332 0.93
tpcds_q34/datafusion:vortex-compact 51608417 53374883 0.97
tpcds_q35/datafusion:vortex-compact 73403954 76390858 0.96
tpcds_q36/datafusion:vortex-compact 104689191 111789599 0.94
tpcds_q37/datafusion:vortex-compact 51951889 55046518 0.94
tpcds_q38/datafusion:vortex-compact 70558286 73526142 0.96
tpcds_q39/datafusion:vortex-compact 🚀 155603015 181197537 0.86
tpcds_q40/datafusion:vortex-compact 64833108 70014261 0.93
tpcds_q41/datafusion:vortex-compact 23965928 25208667 0.95
tpcds_q42/datafusion:vortex-compact 26787677 28030673 0.96
tpcds_q43/datafusion:vortex-compact 41550155 43885884 0.95
tpcds_q44/datafusion:vortex-compact 79394009 87533243 0.91
tpcds_q45/datafusion:vortex-compact 41098231 42806778 0.96
tpcds_q46/datafusion:vortex-compact 71828579 76133162 0.94
tpcds_q47/datafusion:vortex-compact 241512225 267164726 0.90
tpcds_q48/datafusion:vortex-compact 100285702 104853661 0.96
tpcds_q49/datafusion:vortex-compact 105302571 113205953 0.93
tpcds_q50/datafusion:vortex-compact 67989607 70595922 0.96
tpcds_q51/datafusion:vortex-compact 101316220 107678893 0.94
tpcds_q52/datafusion:vortex-compact 26217544 29060884 0.90
tpcds_q53/datafusion:vortex-compact 35391432 38664789 0.92
tpcds_q54/datafusion:vortex-compact 61005910 63709130 0.96
tpcds_q55/datafusion:vortex-compact 25957833 27905306 0.93
tpcds_q56/datafusion:vortex-compact 57385167 58829668 0.98
tpcds_q57/datafusion:vortex-compact 149292744 162143230 0.92
tpcds_q58/datafusion:vortex-compact 81471819 88825372 0.92
tpcds_q59/datafusion:vortex-compact 🚀 89494090 99760921 0.90
tpcds_q60/datafusion:vortex-compact 56842993 60355974 0.94
tpcds_q61/datafusion:vortex-compact 76509545 80286984 0.95
tpcds_q62/datafusion:vortex-compact 🚀 34155416 38191613 0.89
tpcds_q63/datafusion:vortex-compact 36178859 40178087 0.90
tpcds_q64/datafusion:vortex-compact 572127288 613996852 0.93
tpcds_q65/datafusion:vortex-compact 68574278 73380128 0.93
tpcds_q66/datafusion:vortex-compact 104450318 110251349 0.95
tpcds_q67/datafusion:vortex-compact 🚀 130378008 146267358 0.89
tpcds_q68/datafusion:vortex-compact 72782214 80011978 0.91
tpcds_q69/datafusion:vortex-compact 62900500 66096931 0.95
tpcds_q70/datafusion:vortex-compact 131155794 141923132 0.92
tpcds_q71/datafusion:vortex-compact 🚀 46125121 53030260 0.87
tpcds_q72/datafusion:vortex-compact 🚀 2861814599 3249059773 0.88
tpcds_q73/datafusion:vortex-compact 50398309 54688807 0.92
tpcds_q74/datafusion:vortex-compact 141825175 154324118 0.92
tpcds_q75/datafusion:vortex-compact 174575627 187013531 0.93
tpcds_q76/datafusion:vortex-compact 🚀 53164486 59621436 0.89
tpcds_q77/datafusion:vortex-compact 69432412 75391765 0.92
tpcds_q78/datafusion:vortex-compact 🚀 158684695 177075595 0.90
tpcds_q79/datafusion:vortex-compact 🚀 58329519 66526573 0.88
tpcds_q80/datafusion:vortex-compact 140428810 153837831 0.91
tpcds_q81/datafusion:vortex-compact 45129712 48211276 0.94
tpcds_q82/datafusion:vortex-compact 54043104 50447680 1.07
tpcds_q83/datafusion:vortex-compact 66003424 62618610 1.05
tpcds_q84/datafusion:vortex-compact 🚨 21436705 18879469 1.14
tpcds_q85/datafusion:vortex-compact 133661825 126710475 1.05
tpcds_q86/datafusion:vortex-compact 21413489 19721319 1.09
tpcds_q87/datafusion:vortex-compact 71012836 65035096 1.09
tpcds_q88/datafusion:vortex-compact 136898540 132760942 1.03
tpcds_q89/datafusion:vortex-compact 🚨 49781461 43974874 1.13
tpcds_q90/datafusion:vortex-compact 26280259 24620666 1.07
tpcds_q91/datafusion:vortex-compact 43399056 39883543 1.09
tpcds_q92/datafusion:vortex-compact 22751664 21443704 1.06
tpcds_q93/datafusion:vortex-compact 51157910 46813413 1.09
tpcds_q94/datafusion:vortex-compact 🚨 34589352 31036361 1.11
tpcds_q95/datafusion:vortex-compact 76831406 72152285 1.06
tpcds_q96/datafusion:vortex-compact 27125978 26433786 1.03
tpcds_q97/datafusion:vortex-compact 42909973 41334200 1.04
tpcds_q98/datafusion:vortex-compact 40953457 37879648 1.08
tpcds_q99/datafusion:vortex-compact 54312750 50481486 1.08
datafusion / parquet (0.942x ➖, 14↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 39503016 40749612 0.97
tpcds_q02/datafusion:parquet 49305914 50074956 0.98
tpcds_q03/datafusion:parquet 15537256 17183457 0.90
tpcds_q04/datafusion:parquet 🚀 322926883 374586515 0.86
tpcds_q05/datafusion:parquet 56815593 62571727 0.91
tpcds_q06/datafusion:parquet 67623866 66721658 1.01
tpcds_q07/datafusion:parquet 98983743 99037837 1.00
tpcds_q08/datafusion:parquet 34380503 36257976 0.95
tpcds_q09/datafusion:parquet 🚀 57802735 64409288 0.90
tpcds_q10/datafusion:parquet 88883404 89654231 0.99
tpcds_q11/datafusion:parquet 201376758 211852653 0.95
tpcds_q12/datafusion:parquet 24748242 24766224 1.00
tpcds_q13/datafusion:parquet 92023204 96097719 0.96
tpcds_q14/datafusion:parquet 205793444 225484630 0.91
tpcds_q15/datafusion:parquet 27750908 29521155 0.94
tpcds_q16/datafusion:parquet 31367626 32330285 0.97
tpcds_q17/datafusion:parquet 72921476 80100305 0.91
tpcds_q18/datafusion:parquet 139729843 143475934 0.97
tpcds_q19/datafusion:parquet 28185441 30977820 0.91
tpcds_q20/datafusion:parquet 24302936 23910712 1.02
tpcds_q21/datafusion:parquet 25238531 24954260 1.01
tpcds_q22/datafusion:parquet 164986838 160144307 1.03
tpcds_q23/datafusion:parquet 🚀 175851662 197676285 0.89
tpcds_q24/datafusion:parquet 113346031 124380828 0.91
tpcds_q25/datafusion:parquet 🚀 75223332 84600023 0.89
tpcds_q26/datafusion:parquet 82219408 84988843 0.97
tpcds_q27/datafusion:parquet 178593861 190909419 0.94
tpcds_q28/datafusion:parquet 53752542 57866916 0.93
tpcds_q29/datafusion:parquet 🚀 76826132 86075177 0.89
tpcds_q30/datafusion:parquet 46981589 49808731 0.94
tpcds_q31/datafusion:parquet 79799952 84659403 0.94
tpcds_q32/datafusion:parquet 25953242 25190924 1.03
tpcds_q33/datafusion:parquet 37396254 39838999 0.94
tpcds_q34/datafusion:parquet 30455231 29827380 1.02
tpcds_q35/datafusion:parquet 90077072 98276970 0.92
tpcds_q36/datafusion:parquet 🚀 66628960 74511859 0.89
tpcds_q37/datafusion:parquet 24838539 26303732 0.94
tpcds_q38/datafusion:parquet 52743706 55659069 0.95
tpcds_q39/datafusion:parquet 92713671 100804701 0.92
tpcds_q40/datafusion:parquet 28562505 29623259 0.96
tpcds_q41/datafusion:parquet 18357176 18422024 1.00
tpcds_q42/datafusion:parquet 15675354 15466739 1.01
tpcds_q43/datafusion:parquet 19777884 21525593 0.92
tpcds_q44/datafusion:parquet 45510271 46913714 0.97
tpcds_q45/datafusion:parquet 36547948 36557453 1.00
tpcds_q46/datafusion:parquet 🚀 40036848 44787223 0.89
tpcds_q47/datafusion:parquet 144822251 159731670 0.91
tpcds_q48/datafusion:parquet 83246403 91018302 0.91
tpcds_q49/datafusion:parquet 71909756 75589483 0.95
tpcds_q50/datafusion:parquet 🚀 50717688 56635126 0.90
tpcds_q51/datafusion:parquet 96132667 100741998 0.95
tpcds_q52/datafusion:parquet 🚀 15357065 17625381 0.87
tpcds_q53/datafusion:parquet 23520122 25306034 0.93
tpcds_q54/datafusion:parquet 45787299 47093997 0.97
tpcds_q55/datafusion:parquet 14891658 15387226 0.97
tpcds_q56/datafusion:parquet 36848062 39737068 0.93
tpcds_q57/datafusion:parquet 120554098 124095970 0.97
tpcds_q58/datafusion:parquet 61784121 65381790 0.94
tpcds_q59/datafusion:parquet 61926829 65903183 0.94
tpcds_q60/datafusion:parquet 37572521 39185136 0.96
tpcds_q61/datafusion:parquet 🚀 52558311 59792366 0.88
tpcds_q62/datafusion:parquet 29011086 27712053 1.05
tpcds_q63/datafusion:parquet 23036097 24177931 0.95
tpcds_q64/datafusion:parquet 592937413 622341017 0.95
tpcds_q65/datafusion:parquet 45245639 49731410 0.91
tpcds_q66/datafusion:parquet 80926424 81010321 1.00
tpcds_q67/datafusion:parquet 🚀 155887144 180513377 0.86
tpcds_q68/datafusion:parquet 41426551 45280066 0.91
tpcds_q69/datafusion:parquet 85199400 85578268 1.00
tpcds_q70/datafusion:parquet 97776465 107172618 0.91
tpcds_q71/datafusion:parquet 28942493 29090696 0.99
tpcds_q72/datafusion:parquet 715296757 769325928 0.93
tpcds_q73/datafusion:parquet 30104773 30970347 0.97
tpcds_q74/datafusion:parquet 🚀 110748002 123298354 0.90
tpcds_q75/datafusion:parquet 128359686 134352470 0.96
tpcds_q76/datafusion:parquet 37271339 40587437 0.92
tpcds_q77/datafusion:parquet 52206970 56097777 0.93
tpcds_q78/datafusion:parquet 133282408 143930955 0.93
tpcds_q79/datafusion:parquet 33367482 35613956 0.94
tpcds_q80/datafusion:parquet 101452035 108226533 0.94
tpcds_q81/datafusion:parquet 43333823 47709850 0.91
tpcds_q82/datafusion:parquet 24995263 25765497 0.97
tpcds_q83/datafusion:parquet 51177777 54408675 0.94
tpcds_q84/datafusion:parquet 50155524 51994731 0.96
tpcds_q85/datafusion:parquet 179069086 190465758 0.94
tpcds_q86/datafusion:parquet 20599505 20377768 1.01
tpcds_q87/datafusion:parquet 54340877 56804537 0.96
tpcds_q88/datafusion:parquet 72381420 79048277 0.92
tpcds_q89/datafusion:parquet 25217584 27908115 0.90
tpcds_q90/datafusion:parquet 20223791 22031499 0.92
tpcds_q91/datafusion:parquet 73199421 78433390 0.93
tpcds_q92/datafusion:parquet 23111174 25657533 0.90
tpcds_q93/datafusion:parquet 38959024 42956695 0.91
tpcds_q94/datafusion:parquet 🚀 25384078 28457048 0.89
tpcds_q95/datafusion:parquet 70858556 77275514 0.92
tpcds_q96/datafusion:parquet 15981619 16913715 0.94
tpcds_q97/datafusion:parquet 🚀 33724757 39092990 0.86
tpcds_q98/datafusion:parquet 27366175 29884031 0.92
tpcds_q99/datafusion:parquet 32544525 32007444 1.02
duckdb / vortex-file-compressed (1.073x ➖, 0↑ 26↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 28659689 26755976 1.07
tpcds_q02/duckdb:vortex-file-compressed 🚨 90312755 80089862 1.13
tpcds_q03/duckdb:vortex-file-compressed 25406158 25041430 1.01
tpcds_q04/duckdb:vortex-file-compressed 113325575 105158398 1.08
tpcds_q05/duckdb:vortex-file-compressed 105429876 105315752 1.00
tpcds_q06/duckdb:vortex-file-compressed 38260383 35735151 1.07
tpcds_q07/duckdb:vortex-file-compressed 25959924 24481401 1.06
tpcds_q08/duckdb:vortex-file-compressed 24744119 22845136 1.08
tpcds_q09/duckdb:vortex-file-compressed 🚨 44535935 39272852 1.13
tpcds_q10/duckdb:vortex-file-compressed 40616824 37945561 1.07
tpcds_q11/duckdb:vortex-file-compressed 65701393 61344057 1.07
tpcds_q12/duckdb:vortex-file-compressed 15294245 14362726 1.06
tpcds_q13/duckdb:vortex-file-compressed 🚨 36720343 32718596 1.12
tpcds_q14/duckdb:vortex-file-compressed 202869679 192317434 1.05
tpcds_q15/duckdb:vortex-file-compressed 🚨 44599789 40170419 1.11
tpcds_q16/duckdb:vortex-file-compressed 30808234 30756658 1.00
tpcds_q17/duckdb:vortex-file-compressed 🚨 43167024 38805632 1.11
tpcds_q18/duckdb:vortex-file-compressed 🚨 51053302 45238603 1.13
tpcds_q19/duckdb:vortex-file-compressed 35221277 32791812 1.07
tpcds_q20/duckdb:vortex-file-compressed 17528217 16674880 1.05
tpcds_q21/duckdb:vortex-file-compressed 21566999 19738543 1.09
tpcds_q22/duckdb:vortex-file-compressed 🚨 118668620 107704179 1.10
tpcds_q23/duckdb:vortex-file-compressed 135054259 128672817 1.05
tpcds_q24/duckdb:vortex-file-compressed 59989339 55810734 1.07
tpcds_q25/duckdb:vortex-file-compressed 🚨 41278513 36413161 1.13
tpcds_q26/duckdb:vortex-file-compressed 🚨 44911892 40329249 1.11
tpcds_q27/duckdb:vortex-file-compressed 93017157 86229966 1.08
tpcds_q28/duckdb:vortex-file-compressed 38700793 35383768 1.09
tpcds_q29/duckdb:vortex-file-compressed 38699610 37144423 1.04
tpcds_q30/duckdb:vortex-file-compressed 31730469 28855842 1.10
tpcds_q31/duckdb:vortex-file-compressed 27587889 26020578 1.06
tpcds_q32/duckdb:vortex-file-compressed 18436025 17224584 1.07
tpcds_q33/duckdb:vortex-file-compressed 75308477 70142443 1.07
tpcds_q34/duckdb:vortex-file-compressed 🚨 21322336 19119099 1.12
tpcds_q35/duckdb:vortex-file-compressed 69659012 63616035 1.09
tpcds_q36/duckdb:vortex-file-compressed 29673498 28716741 1.03
tpcds_q37/duckdb:vortex-file-compressed 🚨 25921557 21872229 1.19
tpcds_q38/duckdb:vortex-file-compressed 40228768 37248585 1.08
tpcds_q39/duckdb:vortex-file-compressed 47643882 45709141 1.04
tpcds_q40/duckdb:vortex-file-compressed 🚨 27536278 24587325 1.12
tpcds_q41/duckdb:vortex-file-compressed 🚨 14823028 13071191 1.13
tpcds_q42/duckdb:vortex-file-compressed 12809363 11930769 1.07
tpcds_q43/duckdb:vortex-file-compressed 21528266 20099058 1.07
tpcds_q44/duckdb:vortex-file-compressed 24072743 22812656 1.06
tpcds_q45/duckdb:vortex-file-compressed 🚨 29992277 26755354 1.12
tpcds_q46/duckdb:vortex-file-compressed 52694968 48140331 1.09
tpcds_q47/duckdb:vortex-file-compressed 51664960 48252404 1.07
tpcds_q48/duckdb:vortex-file-compressed 33649897 31927980 1.05
tpcds_q49/duckdb:vortex-file-compressed 33081911 32760742 1.01
tpcds_q50/duckdb:vortex-file-compressed 🚨 43725352 36985192 1.18
tpcds_q51/duckdb:vortex-file-compressed 106291367 98183415 1.08
tpcds_q52/duckdb:vortex-file-compressed 🚨 13393250 12078187 1.11
tpcds_q53/duckdb:vortex-file-compressed 18352548 17264646 1.06
tpcds_q54/duckdb:vortex-file-compressed 51175290 49808900 1.03
tpcds_q55/duckdb:vortex-file-compressed 12497651 11753660 1.06
tpcds_q56/duckdb:vortex-file-compressed 🚨 76892504 67289185 1.14
tpcds_q57/duckdb:vortex-file-compressed 48002607 45286031 1.06
tpcds_q58/duckdb:vortex-file-compressed 34079934 31437552 1.08
tpcds_q59/duckdb:vortex-file-compressed 🚨 66812898 60492679 1.10
tpcds_q60/duckdb:vortex-file-compressed 71183355 72928666 0.98
tpcds_q61/duckdb:vortex-file-compressed 🚨 43063054 38017926 1.13
tpcds_q62/duckdb:vortex-file-compressed 18908210 17915652 1.06
tpcds_q63/duckdb:vortex-file-compressed 18717934 17548818 1.07
tpcds_q64/duckdb:vortex-file-compressed 88010496 80096551 1.10
tpcds_q65/duckdb:vortex-file-compressed 24196227 23725305 1.02
tpcds_q66/duckdb:vortex-file-compressed 61587666 65626174 0.94
tpcds_q67/duckdb:vortex-file-compressed 155029000 146055118 1.06
tpcds_q68/duckdb:vortex-file-compressed 41926996 40922913 1.02
tpcds_q69/duckdb:vortex-file-compressed 41579377 37994903 1.09
tpcds_q70/duckdb:vortex-file-compressed 26574820 24528289 1.08
tpcds_q71/duckdb:vortex-file-compressed 🚨 23189861 20358088 1.14
tpcds_q72/duckdb:vortex-file-compressed 185663590 176136909 1.05
tpcds_q73/duckdb:vortex-file-compressed 20588758 20327051 1.01
tpcds_q74/duckdb:vortex-file-compressed 52892040 53261671 0.99
tpcds_q75/duckdb:vortex-file-compressed 64199379 58442352 1.10
tpcds_q76/duckdb:vortex-file-compressed 🚨 74320780 61596759 1.21
tpcds_q77/duckdb:vortex-file-compressed 🚨 72301833 63331567 1.14
tpcds_q78/duckdb:vortex-file-compressed 80688965 79946881 1.01
tpcds_q79/duckdb:vortex-file-compressed 45709575 42676230 1.07
tpcds_q80/duckdb:vortex-file-compressed 98486856 95656217 1.03
tpcds_q81/duckdb:vortex-file-compressed 35473304 34102933 1.04
tpcds_q82/duckdb:vortex-file-compressed 22408027 21627756 1.04
tpcds_q83/duckdb:vortex-file-compressed 29883955 29121256 1.03
tpcds_q84/duckdb:vortex-file-compressed 18523852 17040066 1.09
tpcds_q85/duckdb:vortex-file-compressed 🚨 50434309 45668738 1.10
tpcds_q86/duckdb:vortex-file-compressed 🚨 19861841 17452041 1.14
tpcds_q87/duckdb:vortex-file-compressed 41567867 39367015 1.06
tpcds_q88/duckdb:vortex-file-compressed 36635624 35321509 1.04
tpcds_q89/duckdb:vortex-file-compressed 18444847 19374793 0.95
tpcds_q90/duckdb:vortex-file-compressed 16626469 15648500 1.06
tpcds_q91/duckdb:vortex-file-compressed 30364272 28191143 1.08
tpcds_q92/duckdb:vortex-file-compressed 15714558 14655867 1.07
tpcds_q93/duckdb:vortex-file-compressed 🚨 34133967 28879468 1.18
tpcds_q94/duckdb:vortex-file-compressed 24138709 22367701 1.08
tpcds_q95/duckdb:vortex-file-compressed 148886651 163580264 0.91
tpcds_q96/duckdb:vortex-file-compressed 12865712 11822827 1.09
tpcds_q97/duckdb:vortex-file-compressed 39421236 37594524 1.05
tpcds_q98/duckdb:vortex-file-compressed 🚨 20043831 17477984 1.15
tpcds_q99/duckdb:vortex-file-compressed 33069112 32221838 1.03
duckdb / vortex-compact (1.081x ➖, 1↑ 34↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 🚨 37870247 34050786 1.11
tpcds_q02/duckdb:vortex-compact 🚨 139408284 125596404 1.11
tpcds_q03/duckdb:vortex-compact 53539755 52454080 1.02
tpcds_q04/duckdb:vortex-compact 133101132 121148398 1.10
tpcds_q05/duckdb:vortex-compact 168514747 162979535 1.03
tpcds_q06/duckdb:vortex-compact 🚨 42471034 37587798 1.13
tpcds_q07/duckdb:vortex-compact 38720076 36163298 1.07
tpcds_q08/duckdb:vortex-compact 29179503 27580202 1.06
tpcds_q09/duckdb:vortex-compact 114612557 109628023 1.05
tpcds_q10/duckdb:vortex-compact 50478175 46397786 1.09
tpcds_q11/duckdb:vortex-compact 76088625 73951701 1.03
tpcds_q12/duckdb:vortex-compact 🚨 21538953 18718804 1.15
tpcds_q13/duckdb:vortex-compact 🚨 51417149 46657794 1.10
tpcds_q14/duckdb:vortex-compact 277476082 271285772 1.02
tpcds_q15/duckdb:vortex-compact 🚨 49813692 44819033 1.11
tpcds_q16/duckdb:vortex-compact 39414452 37461562 1.05
tpcds_q17/duckdb:vortex-compact 52020927 47325600 1.10
tpcds_q18/duckdb:vortex-compact 70390345 68038073 1.03
tpcds_q19/duckdb:vortex-compact 39880064 38370127 1.04
tpcds_q20/duckdb:vortex-compact 🚨 23223618 19850288 1.17
tpcds_q21/duckdb:vortex-compact 🚨 30235992 27379206 1.10
tpcds_q22/duckdb:vortex-compact 🚨 128485135 115532442 1.11
tpcds_q23/duckdb:vortex-compact 175818713 160399223 1.10
tpcds_q24/duckdb:vortex-compact 🚨 77113217 67126796 1.15
tpcds_q25/duckdb:vortex-compact 50683177 49125318 1.03
tpcds_q26/duckdb:vortex-compact 🚨 54993484 48009812 1.15
tpcds_q27/duckdb:vortex-compact 138175693 129649399 1.07
tpcds_q28/duckdb:vortex-compact 110694327 105564829 1.05
tpcds_q29/duckdb:vortex-compact 49611598 47363744 1.05
tpcds_q30/duckdb:vortex-compact 36715151 37203776 0.99
tpcds_q31/duckdb:vortex-compact 🚨 34109690 29219101 1.17
tpcds_q32/duckdb:vortex-compact 25066141 23492597 1.07
tpcds_q33/duckdb:vortex-compact 140566681 134697451 1.04
tpcds_q34/duckdb:vortex-compact 23747947 22499154 1.06
tpcds_q35/duckdb:vortex-compact 71618945 68008421 1.05
tpcds_q36/duckdb:vortex-compact 33949210 33395151 1.02
tpcds_q37/duckdb:vortex-compact 33305237 30477834 1.09
tpcds_q38/duckdb:vortex-compact 40627591 37033093 1.10
tpcds_q39/duckdb:vortex-compact 57805368 54668972 1.06
tpcds_q40/duckdb:vortex-compact 32669418 29821988 1.10
tpcds_q41/duckdb:vortex-compact 17530429 16485647 1.06
tpcds_q42/duckdb:vortex-compact 14918151 14676169 1.02
tpcds_q43/duckdb:vortex-compact 24521476 23783921 1.03
tpcds_q44/duckdb:vortex-compact 🚨 31276804 27961092 1.12
tpcds_q45/duckdb:vortex-compact 🚨 36913731 30499458 1.21
tpcds_q46/duckdb:vortex-compact 59477179 56564715 1.05
tpcds_q47/duckdb:vortex-compact 57128559 53468478 1.07
tpcds_q48/duckdb:vortex-compact 43023516 41694103 1.03
tpcds_q49/duckdb:vortex-compact 50939019 47080364 1.08
tpcds_q50/duckdb:vortex-compact 🚨 38939078 35345866 1.10
tpcds_q51/duckdb:vortex-compact 110116718 101797105 1.08
tpcds_q52/duckdb:vortex-compact 15776603 15226605 1.04
tpcds_q53/duckdb:vortex-compact 22515571 21853473 1.03
tpcds_q54/duckdb:vortex-compact 🚨 91417756 82352430 1.11
tpcds_q55/duckdb:vortex-compact 15028080 14168635 1.06
tpcds_q56/duckdb:vortex-compact 138273196 130948497 1.06
tpcds_q57/duckdb:vortex-compact 🚀 47811298 54314245 0.88
tpcds_q58/duckdb:vortex-compact 🚨 45849465 40989283 1.12
tpcds_q59/duckdb:vortex-compact 🚨 93188303 75262678 1.24
tpcds_q60/duckdb:vortex-compact 139264810 132939417 1.05
tpcds_q61/duckdb:vortex-compact 48943784 45595265 1.07
tpcds_q62/duckdb:vortex-compact 23900490 22055992 1.08
tpcds_q63/duckdb:vortex-compact 🚨 23530893 20409807 1.15
tpcds_q64/duckdb:vortex-compact 105160362 97074931 1.08
tpcds_q65/duckdb:vortex-compact 🚨 29526896 26176223 1.13
tpcds_q66/duckdb:vortex-compact 103605451 95540352 1.08
tpcds_q67/duckdb:vortex-compact 155762931 150597427 1.03
tpcds_q68/duckdb:vortex-compact 54602204 50840287 1.07
tpcds_q69/duckdb:vortex-compact 49580808 45680603 1.09
tpcds_q70/duckdb:vortex-compact 28210989 27430682 1.03
tpcds_q71/duckdb:vortex-compact 27327797 24952761 1.10
tpcds_q72/duckdb:vortex-compact 209882993 199123368 1.05
tpcds_q73/duckdb:vortex-compact 23331952 21926273 1.06
tpcds_q74/duckdb:vortex-compact 🚨 60758729 54072441 1.12
tpcds_q75/duckdb:vortex-compact 74787068 72934199 1.03
tpcds_q76/duckdb:vortex-compact 🚨 140484481 124819449 1.13
tpcds_q77/duckdb:vortex-compact 129237032 127465123 1.01
tpcds_q78/duckdb:vortex-compact 89180194 91179633 0.98
tpcds_q79/duckdb:vortex-compact 75709845 72709279 1.04
tpcds_q80/duckdb:vortex-compact 172029307 162696957 1.06
tpcds_q81/duckdb:vortex-compact 42589422 39629699 1.07
tpcds_q82/duckdb:vortex-compact 🚨 34984733 31406462 1.11
tpcds_q83/duckdb:vortex-compact 🚨 50368016 45235600 1.11
tpcds_q84/duckdb:vortex-compact 🚨 23976192 21455013 1.12
tpcds_q85/duckdb:vortex-compact 🚨 68056955 58653993 1.16
tpcds_q86/duckdb:vortex-compact 🚨 24045322 20208918 1.19
tpcds_q87/duckdb:vortex-compact 44113695 41967765 1.05
tpcds_q88/duckdb:vortex-compact 35538924 34255504 1.04
tpcds_q89/duckdb:vortex-compact 23706211 21669843 1.09
tpcds_q90/duckdb:vortex-compact 🚨 18741241 15769120 1.19
tpcds_q91/duckdb:vortex-compact 🚨 50339410 44417815 1.13
tpcds_q92/duckdb:vortex-compact 🚨 22535308 19627163 1.15
tpcds_q93/duckdb:vortex-compact 🚨 39622827 35583717 1.11
tpcds_q94/duckdb:vortex-compact 🚨 29752824 26149663 1.14
tpcds_q95/duckdb:vortex-compact 155696338 147067188 1.06
tpcds_q96/duckdb:vortex-compact 🚨 12906944 11355629 1.14
tpcds_q97/duckdb:vortex-compact 43488049 40455298 1.07
tpcds_q98/duckdb:vortex-compact 24800985 22599459 1.10
tpcds_q99/duckdb:vortex-compact 🚨 39569292 35783694 1.11
duckdb / parquet (1.058x ➖, 0↑ 16↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 47306494 45011645 1.05
tpcds_q02/duckdb:parquet 59483441 63682859 0.93
tpcds_q03/duckdb:parquet 12364408 11870539 1.04
tpcds_q04/duckdb:parquet 129759245 121482368 1.07
tpcds_q05/duckdb:parquet 77285609 71459791 1.08
tpcds_q06/duckdb:parquet 🚨 31084566 27686586 1.12
tpcds_q07/duckdb:parquet 24049201 23334348 1.03
tpcds_q08/duckdb:parquet 28495573 28939674 0.98
tpcds_q09/duckdb:parquet 40272500 39470749 1.02
tpcds_q10/duckdb:parquet 36916209 34606922 1.07
tpcds_q11/duckdb:parquet 90638295 88799009 1.02
tpcds_q12/duckdb:parquet 🚨 15747456 14168878 1.11
tpcds_q13/duckdb:parquet 35941647 33942551 1.06
tpcds_q14/duckdb:parquet 166247712 160228935 1.04
tpcds_q15/duckdb:parquet 🚨 33167485 29123917 1.14
tpcds_q16/duckdb:parquet 21926703 21693777 1.01
tpcds_q17/duckdb:parquet 🚨 40471265 36457758 1.11
tpcds_q18/duckdb:parquet 47144561 45887321 1.03
tpcds_q19/duckdb:parquet 30463513 30274644 1.01
tpcds_q20/duckdb:parquet 16368041 15073639 1.09
tpcds_q21/duckdb:parquet 11734241 11070581 1.06
tpcds_q22/duckdb:parquet 🚨 74527124 67465636 1.10
tpcds_q23/duckdb:parquet 118393660 112933365 1.05
tpcds_q24/duckdb:parquet 45604999 45730591 1.00
tpcds_q25/duckdb:parquet 32992110 32453025 1.02
tpcds_q26/duckdb:parquet 37729140 36689268 1.03
tpcds_q27/duckdb:parquet 91304492 88498081 1.03
tpcds_q28/duckdb:parquet 37897479 37390795 1.01
tpcds_q29/duckdb:parquet 38475343 36552921 1.05
tpcds_q30/duckdb:parquet 42518162 40142227 1.06
tpcds_q31/duckdb:parquet 23992368 23043254 1.04
tpcds_q32/duckdb:parquet 11323389 11598212 0.98
tpcds_q33/duckdb:parquet 73051707 70357821 1.04
tpcds_q34/duckdb:parquet 22551295 20563991 1.10
tpcds_q35/duckdb:parquet 62603225 57558800 1.09
tpcds_q36/duckdb:parquet 🚨 23097732 20270484 1.14
tpcds_q37/duckdb:parquet 🚨 15013144 12888070 1.16
tpcds_q38/duckdb:parquet 36508782 33414893 1.09
tpcds_q39/duckdb:parquet 33045778 32544973 1.02
tpcds_q40/duckdb:parquet 19040636 17420600 1.09
tpcds_q41/duckdb:parquet 8143630 7456427 1.09
tpcds_q42/duckdb:parquet 10774639 10311838 1.04
tpcds_q43/duckdb:parquet 16091171 15629357 1.03
tpcds_q44/duckdb:parquet 23062847 21034771 1.10
tpcds_q45/duckdb:parquet 28556221 26283782 1.09
tpcds_q46/duckdb:parquet 48772450 44855906 1.09
tpcds_q47/duckdb:parquet 47222099 45415824 1.04
tpcds_q48/duckdb:parquet 31474085 30149279 1.04
tpcds_q49/duckdb:parquet 25398442 24080932 1.05
tpcds_q50/duckdb:parquet 25076882 23926286 1.05
tpcds_q51/duckdb:parquet 97486769 95610941 1.02
tpcds_q52/duckdb:parquet 11209950 10725068 1.05
tpcds_q53/duckdb:parquet 16732296 15997542 1.05
tpcds_q54/duckdb:parquet 🚨 40794885 35516584 1.15
tpcds_q55/duckdb:parquet 11425531 10566397 1.08
tpcds_q56/duckdb:parquet 69523429 66571299 1.04
tpcds_q57/duckdb:parquet 36484835 35839942 1.02
tpcds_q58/duckdb:parquet 22148405 20992046 1.06
tpcds_q59/duckdb:parquet 35987968 36558389 0.98
tpcds_q60/duckdb:parquet 73432607 74029606 0.99
tpcds_q61/duckdb:parquet 33259309 30636565 1.09
tpcds_q62/duckdb:parquet 🚨 12848920 11548230 1.11
tpcds_q63/duckdb:parquet 15685483 14967536 1.05
tpcds_q64/duckdb:parquet 75525927 77244804 0.98
tpcds_q65/duckdb:parquet 21436280 20251287 1.06
tpcds_q66/duckdb:parquet 59594339 57706719 1.03
tpcds_q67/duckdb:parquet 141275347 135844122 1.04
tpcds_q68/duckdb:parquet 38788382 37103698 1.05
tpcds_q69/duckdb:parquet 38345290 37580696 1.02
tpcds_q70/duckdb:parquet 20030901 19563226 1.02
tpcds_q71/duckdb:parquet 19835222 18792023 1.06
tpcds_q72/duckdb:parquet 165830655 166116365 1.00
tpcds_q73/duckdb:parquet 19419340 18117751 1.07
tpcds_q74/duckdb:parquet 50903959 50182269 1.01
tpcds_q75/duckdb:parquet 55046713 52822158 1.04
tpcds_q76/duckdb:parquet 74437671 67830287 1.10
tpcds_q77/duckdb:parquet 63283687 57648618 1.10
tpcds_q78/duckdb:parquet 78231954 74284985 1.05
tpcds_q79/duckdb:parquet 28350454 27105435 1.05
tpcds_q80/duckdb:parquet 86793729 80362585 1.08
tpcds_q81/duckdb:parquet 48713101 46893999 1.04
tpcds_q82/duckdb:parquet 🚨 17291039 15301805 1.13
tpcds_q83/duckdb:parquet 🚨 17651351 16028885 1.10
tpcds_q84/duckdb:parquet 19787486 19024282 1.04
tpcds_q85/duckdb:parquet 41416765 38889836 1.06
tpcds_q86/duckdb:parquet 12462346 13077199 0.95
tpcds_q87/duckdb:parquet 🚨 39919697 35203753 1.13
tpcds_q88/duckdb:parquet 29498826 28620000 1.03
tpcds_q89/duckdb:parquet 18006059 17073446 1.05
tpcds_q90/duckdb:parquet 🚨 8941615 7048244 1.27
tpcds_q91/duckdb:parquet 24077843 23320612 1.03
tpcds_q92/duckdb:parquet 🚨 13060786 11349929 1.15
tpcds_q93/duckdb:parquet 30859365 29203995 1.06
tpcds_q94/duckdb:parquet 16825231 16271063 1.03
tpcds_q95/duckdb:parquet 🚨 150286966 119471098 1.26
tpcds_q96/duckdb:parquet 9607179 9148686 1.05
tpcds_q97/duckdb:parquet 37465812 34398586 1.09
tpcds_q98/duckdb:parquet 18149040 17918104 1.01
tpcds_q99/duckdb:parquet 🚨 21765364 19325095 1.13
duckdb / duckdb (1.063x ➖, 0↑ 23↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20689205 19278577 1.07
tpcds_q02/duckdb:duckdb 18087319 18542107 0.98
tpcds_q03/duckdb:duckdb 🚨 9399101 7996814 1.18
tpcds_q04/duckdb:duckdb 167976066 160777413 1.04
tpcds_q05/duckdb:duckdb 🚨 19368644 17133964 1.13
tpcds_q06/duckdb:duckdb 23103478 22263834 1.04
tpcds_q07/duckdb:duckdb 40105645 37529346 1.07
tpcds_q08/duckdb:duckdb 121146190 119720658 1.01
tpcds_q09/duckdb:duckdb 20640048 19449810 1.06
tpcds_q10/duckdb:duckdb 24154823 22863657 1.06
tpcds_q11/duckdb:duckdb 142348710 140302113 1.01
tpcds_q12/duckdb:duckdb 12116669 11193734 1.08
tpcds_q13/duckdb:duckdb 24469869 23808275 1.03
tpcds_q14/duckdb:duckdb 95885269 92686691 1.03
tpcds_q15/duckdb:duckdb 26493736 24503215 1.08
tpcds_q16/duckdb:duckdb 17528811 17795220 0.99
tpcds_q17/duckdb:duckdb 🚨 23932940 21500111 1.11
tpcds_q18/duckdb:duckdb 45704103 43147912 1.06
tpcds_q19/duckdb:duckdb 🚨 17715735 16083647 1.10
tpcds_q20/duckdb:duckdb 12574401 11567471 1.09
tpcds_q21/duckdb:duckdb 6931272 6398826 1.08
tpcds_q22/duckdb:duckdb 🚨 68484285 58047970 1.18
tpcds_q23/duckdb:duckdb 75204276 74856950 1.00
tpcds_q24/duckdb:duckdb 24789595 22925152 1.08
tpcds_q25/duckdb:duckdb 17069512 16365280 1.04
tpcds_q26/duckdb:duckdb 🚨 27902952 25215470 1.11
tpcds_q27/duckdb:duckdb 🚨 43187261 39071032 1.11
tpcds_q28/duckdb:duckdb 22516233 21485219 1.05
tpcds_q29/duckdb:duckdb 20756523 19611059 1.06
tpcds_q30/duckdb:duckdb 30361671 27686509 1.10
tpcds_q31/duckdb:duckdb 19805456 19510380 1.02
tpcds_q32/duckdb:duckdb 7559000 6988315 1.08
tpcds_q33/duckdb:duckdb 12805811 12176768 1.05
tpcds_q34/duckdb:duckdb 15250532 14669373 1.04
tpcds_q35/duckdb:duckdb 33221521 31461013 1.06
tpcds_q36/duckdb:duckdb 74773748 69186988 1.08
tpcds_q37/duckdb:duckdb 7678716 7209304 1.07
tpcds_q38/duckdb:duckdb 32658799 30578629 1.07
tpcds_q39/duckdb:duckdb 27543031 28908725 0.95
tpcds_q40/duckdb:duckdb 13882451 13583306 1.02
tpcds_q41/duckdb:duckdb 🚨 8629906 7824018 1.10
tpcds_q42/duckdb:duckdb 6753964 6295688 1.07
tpcds_q43/duckdb:duckdb 11435849 10877273 1.05
tpcds_q44/duckdb:duckdb 13671920 13075064 1.05
tpcds_q45/duckdb:duckdb 17081549 16017466 1.07
tpcds_q46/duckdb:duckdb 🚨 39291023 35655831 1.10
tpcds_q47/duckdb:duckdb 🚨 44476024 40225211 1.11
tpcds_q48/duckdb:duckdb 22103300 21631979 1.02
tpcds_q49/duckdb:duckdb 🚨 17854211 16207342 1.10
tpcds_q50/duckdb:duckdb 14559726 13444048 1.08
tpcds_q51/duckdb:duckdb 94802161 90685783 1.05
tpcds_q52/duckdb:duckdb 7208807 7108951 1.01
tpcds_q53/duckdb:duckdb 12251583 11859899 1.03
tpcds_q54/duckdb:duckdb 17196029 16545345 1.04
tpcds_q55/duckdb:duckdb 🚨 7602736 6878255 1.11
tpcds_q56/duckdb:duckdb 14320375 13695617 1.05
tpcds_q57/duckdb:duckdb 33617610 31289300 1.07
tpcds_q58/duckdb:duckdb 12875056 11753900 1.10
tpcds_q59/duckdb:duckdb 35649295 34003801 1.05
tpcds_q60/duckdb:duckdb 15281814 14209333 1.08
tpcds_q61/duckdb:duckdb 14961846 13927410 1.07
tpcds_q62/duckdb:duckdb 🚨 9867099 8883006 1.11
tpcds_q63/duckdb:duckdb 11315825 11592869 0.98
tpcds_q64/duckdb:duckdb 53482858 53147378 1.01
tpcds_q65/duckdb:duckdb 🚨 36439510 30881325 1.18
tpcds_q66/duckdb:duckdb 26304224 24535512 1.07
tpcds_q67/duckdb:duckdb 🚨 138852208 124989959 1.11
tpcds_q68/duckdb:duckdb 26229119 24718294 1.06
tpcds_q69/duckdb:duckdb 24600653 23281631 1.06
tpcds_q70/duckdb:duckdb 14672760 13844081 1.06
tpcds_q71/duckdb:duckdb 13137856 12297621 1.07
tpcds_q72/duckdb:duckdb 43525066 42950860 1.01
tpcds_q73/duckdb:duckdb 10977990 10070000 1.09
tpcds_q74/duckdb:duckdb 101588466 95772281 1.06
tpcds_q75/duckdb:duckdb 42296865 40520966 1.04
tpcds_q76/duckdb:duckdb 11800062 11750471 1.00
tpcds_q77/duckdb:duckdb 11925542 11580496 1.03
tpcds_q78/duckdb:duckdb 🚨 67190739 61075564 1.10
tpcds_q79/duckdb:duckdb 18939999 17360003 1.09
tpcds_q80/duckdb:duckdb 🚨 30260700 26303625 1.15
tpcds_q81/duckdb:duckdb 39377206 37520365 1.05
tpcds_q82/duckdb:duckdb 8445857 8175505 1.03
tpcds_q83/duckdb:duckdb 9766800 9221199 1.06
tpcds_q84/duckdb:duckdb 13858315 13639009 1.02
tpcds_q85/duckdb:duckdb 25185597 23366502 1.08
tpcds_q86/duckdb:duckdb 🚨 11393866 10230821 1.11
tpcds_q87/duckdb:duckdb 35677565 34006496 1.05
tpcds_q88/duckdb:duckdb 24741048 23833094 1.04
tpcds_q89/duckdb:duckdb 13652475 12981244 1.05
tpcds_q90/duckdb:duckdb 🚨 6186596 5358250 1.15
tpcds_q91/duckdb:duckdb 🚨 13795163 12263003 1.12
tpcds_q92/duckdb:duckdb 🚨 9901184 8676541 1.14
tpcds_q93/duckdb:duckdb 🚨 23648074 21105345 1.12
tpcds_q94/duckdb:duckdb 12626819 13907885 0.91
tpcds_q95/duckdb:duckdb 116292218 125811702 0.92
tpcds_q96/duckdb:duckdb 4752976 4351249 1.09
tpcds_q97/duckdb:duckdb 31284451 30480729 1.03
tpcds_q98/duckdb:duckdb 🚨 14393586 12779947 1.13
tpcds_q99/duckdb:duckdb 17335202 16351086 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -7.4% +0.9% -8.3% +15.5% ➖ noise
1 datafusion:vortex-file-compressed -5.1% +0.9% -6.0% +16.1% ➖ noise
1 duckdb:duckdb +7.3% +0.9% +6.3% +14.9% ➖ noise
1 duckdb:vortex-compact +11.2% +0.9% +10.2% +17.1% ➖ noise
1 duckdb:vortex-file-compressed +7.1% +0.9% +6.1% +16.1% ➖ noise
2 datafusion:vortex-compact -6.2% -4.1% -2.2% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -10.2% -4.1% -6.4% +10.4% ➖ noise
2 duckdb:duckdb -2.5% -4.1% +1.7% +10.0% ➖ noise
2 duckdb:vortex-compact +11.0% -4.1% +15.7% +10.0% 🚨 regression
2 duckdb:vortex-file-compressed +12.8% -4.1% +17.6% +10.2% 🚨 regression
3 datafusion:vortex-compact -3.5% -3.0% -0.5% +12.4% ➖ noise
3 datafusion:vortex-file-compressed -11.2% -3.0% -8.5% +13.5% ➖ noise
3 duckdb:duckdb +17.5% -3.0% +21.1% +17.8% 🚨 regression
3 duckdb:vortex-compact +2.1% -3.0% +5.2% +10.3% ➖ noise
3 duckdb:vortex-file-compressed +1.5% -3.0% +4.5% +15.2% ➖ noise
4 datafusion:vortex-compact -10.4% -4.0% -6.6% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -10.3% -4.0% -6.5% +10.0% ➖ noise
4 duckdb:duckdb +4.5% -4.0% +8.9% +10.0% ➖ noise
4 duckdb:vortex-compact +9.9% -4.0% +14.5% +10.0% 🚨 regression
4 duckdb:vortex-file-compressed +7.8% -4.0% +12.3% +10.0% 🚨 regression
5 datafusion:vortex-compact -10.4% -0.9% -9.6% +10.0% ✅ faster
5 datafusion:vortex-file-compressed -6.2% -0.9% -5.3% +11.4% ➖ noise
5 duckdb:duckdb +13.0% -0.9% +14.1% +15.5% ➖ noise
5 duckdb:vortex-compact +3.4% -0.9% +4.3% +16.3% ➖ noise
5 duckdb:vortex-file-compressed +0.1% -0.9% +1.0% +10.0% ➖ noise
6 datafusion:vortex-compact -10.4% +6.7% -16.0% +10.3% ✅ faster
6 datafusion:vortex-file-compressed -10.2% +6.7% -15.8% +10.0% ✅ faster
6 duckdb:duckdb +3.8% +6.7% -2.7% +11.8% ➖ noise
6 duckdb:vortex-compact +13.0% +6.7% +5.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +7.1% +6.7% +0.4% +10.0% ➖ noise
7 datafusion:vortex-compact -12.2% +1.5% -13.5% +10.0% ✅ faster
7 datafusion:vortex-file-compressed -4.3% +1.5% -5.7% +14.5% ➖ noise
7 duckdb:duckdb +6.9% +1.5% +5.3% +15.8% ➖ noise
7 duckdb:vortex-compact +7.1% +1.5% +5.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +6.0% +1.5% +4.5% +10.0% ➖ noise
8 datafusion:vortex-compact -4.8% -3.4% -1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -8.7% -3.4% -5.5% +11.6% ➖ noise
8 duckdb:duckdb +1.2% -3.4% +4.7% +10.0% ➖ noise
8 duckdb:vortex-compact +5.8% -3.4% +9.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +8.3% -3.4% +12.1% +10.2% 🚨 regression
9 datafusion:vortex-compact -17.6% -4.3% -13.9% +10.0% ✅ faster
9 datafusion:vortex-file-compressed -6.7% -4.3% -2.5% +10.0% ➖ noise
9 duckdb:duckdb +6.1% -4.3% +10.9% +10.0% 🚨 regression
9 duckdb:vortex-compact +4.5% -4.3% +9.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +13.4% -4.3% +18.5% +10.0% 🚨 regression
10 datafusion:vortex-compact -7.1% +2.8% -9.7% +10.0% ✅ faster
10 datafusion:vortex-file-compressed -9.3% +2.8% -11.8% +10.0% ✅ faster
10 duckdb:duckdb +5.6% +2.8% +2.7% +10.0% ➖ noise
10 duckdb:vortex-compact +8.8% +2.8% +5.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +7.0% +2.8% +4.1% +10.0% ➖ noise
11 datafusion:vortex-compact -14.4% -1.5% -13.1% +10.0% ✅ faster
11 datafusion:vortex-file-compressed -11.4% -1.5% -10.1% +10.0% ✅ faster
11 duckdb:duckdb +1.5% -1.5% +3.0% +10.0% ➖ noise
11 duckdb:vortex-compact +2.9% -1.5% +4.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +7.1% -1.5% +8.7% +11.5% ➖ noise
12 datafusion:vortex-compact -7.6% +5.4% -12.3% +13.8% ✅ faster
12 datafusion:vortex-file-compressed -10.9% +5.4% -15.4% +13.8% ✅ faster
12 duckdb:duckdb +8.2% +5.4% +2.7% +18.4% ➖ noise
12 duckdb:vortex-compact +15.1% +5.4% +9.2% +27.5% ➖ noise
12 duckdb:vortex-file-compressed +6.5% +5.4% +1.0% +11.2% ➖ noise
13 datafusion:vortex-compact -7.5% +0.7% -8.1% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -6.4% +0.7% -7.0% +10.0% ➖ noise
13 duckdb:duckdb +2.8% +0.7% +2.1% +10.0% ➖ noise
13 duckdb:vortex-compact +10.2% +0.7% +9.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +12.2% +0.7% +11.5% +10.0% 🚨 regression
14 datafusion:vortex-compact -11.7% -2.7% -9.2% +10.0% ✅ faster
14 datafusion:vortex-file-compressed -9.1% -2.7% -6.5% +10.0% ➖ noise
14 duckdb:duckdb +3.5% -2.7% +6.3% +10.0% ➖ noise
14 duckdb:vortex-compact +2.3% -2.7% +5.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.5% -2.7% +8.4% +10.3% ➖ noise
15 datafusion:vortex-compact -9.6% +3.5% -12.7% +13.6% ✅ faster
15 datafusion:vortex-file-compressed -13.7% +3.5% -16.6% +12.6% ✅ faster
15 duckdb:duckdb +8.1% +3.5% +4.5% +15.3% ➖ noise
15 duckdb:vortex-compact +11.1% +3.5% +7.4% +16.6% ➖ noise
15 duckdb:vortex-file-compressed +11.0% +3.5% +7.3% +16.2% ➖ noise
16 datafusion:vortex-compact -5.9% -1.0% -4.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -9.7% -1.0% -8.9% +10.4% ➖ noise
16 duckdb:duckdb -1.5% -1.0% -0.5% +16.6% ➖ noise
16 duckdb:vortex-compact +5.2% -1.0% +6.2% +11.6% ➖ noise
16 duckdb:vortex-file-compressed +0.2% -1.0% +1.2% +10.0% ➖ noise
17 datafusion:vortex-compact -6.8% +0.5% -7.3% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -9.8% +0.5% -10.3% +10.0% ✅ faster
17 duckdb:duckdb +11.3% +0.5% +10.7% +10.0% 🚨 regression
17 duckdb:vortex-compact +9.9% +0.5% +9.3% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +11.2% +0.5% +10.7% +10.0% 🚨 regression
18 datafusion:vortex-compact -6.2% +0.0% -6.2% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -3.1% +0.0% -3.1% +10.0% ➖ noise
18 duckdb:duckdb +5.9% +0.0% +5.9% +11.2% ➖ noise
18 duckdb:vortex-compact +3.5% +0.0% +3.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +12.9% +0.0% +12.8% +10.0% 🚨 regression
19 datafusion:vortex-compact -7.5% -4.3% -3.3% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.4% -4.3% +1.0% +10.8% ➖ noise
19 duckdb:duckdb +10.1% -4.3% +15.1% +10.0% 🚨 regression
19 duckdb:vortex-compact +3.9% -4.3% +8.6% +10.3% ➖ noise
19 duckdb:vortex-file-compressed +7.4% -4.3% +12.3% +10.0% 🚨 regression
20 datafusion:vortex-compact -2.2% +5.1% -6.9% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -3.2% +5.1% -7.9% +10.0% ➖ noise
20 duckdb:duckdb +8.7% +5.1% +3.5% +10.0% ➖ noise
20 duckdb:vortex-compact +17.0% +5.1% +11.4% +13.3% ➖ noise
20 duckdb:vortex-file-compressed +5.1% +5.1% +0.1% +12.8% ➖ noise
21 datafusion:vortex-compact -8.9% +3.5% -12.0% +10.0% ✅ faster
21 datafusion:vortex-file-compressed -7.6% +3.5% -10.7% +10.4% ✅ faster
21 duckdb:duckdb +8.3% +3.5% +4.6% +18.6% ➖ noise
21 duckdb:vortex-compact +10.4% +3.5% +6.7% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +9.3% +3.5% +5.5% +17.5% ➖ noise
22 datafusion:vortex-compact -10.7% +6.7% -16.3% +11.9% ✅ faster
22 datafusion:vortex-file-compressed -9.3% +6.7% -14.9% +12.5% ✅ faster
22 duckdb:duckdb +18.0% +6.7% +10.6% +12.2% ➖ noise
22 duckdb:vortex-compact +11.2% +6.7% +4.2% +10.8% ➖ noise
22 duckdb:vortex-file-compressed +10.2% +6.7% +3.3% +10.6% ➖ noise
23 datafusion:vortex-compact -10.2% -3.4% -7.0% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -9.8% -3.4% -6.6% +10.0% ➖ noise
23 duckdb:duckdb +0.5% -3.4% +4.0% +13.9% ➖ noise
23 duckdb:vortex-compact +9.6% -3.4% +13.5% +10.1% 🚨 regression
23 duckdb:vortex-file-compressed +5.0% -3.4% +8.7% +10.0% ➖ noise
24 datafusion:vortex-compact -8.3% -4.7% -3.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -8.1% -4.7% -3.6% +10.0% ➖ noise
24 duckdb:duckdb +8.1% -4.7% +13.4% +10.0% 🚨 regression
24 duckdb:vortex-compact +14.9% -4.7% +20.5% +10.7% 🚨 regression
24 duckdb:vortex-file-compressed +7.5% -4.7% +12.8% +10.0% 🚨 regression
25 datafusion:vortex-compact -6.2% -4.9% -1.3% +10.0% ➖ noise
25 datafusion:vortex-file-compressed -8.5% -4.9% -3.8% +10.0% ➖ noise
25 duckdb:duckdb +4.3% -4.9% +9.7% +10.9% ➖ noise
25 duckdb:vortex-compact +3.2% -4.9% +8.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +13.4% -4.9% +19.2% +10.0% 🚨 regression
26 datafusion:vortex-compact -4.0% -0.3% -3.8% +10.3% ➖ noise
26 datafusion:vortex-file-compressed -6.8% -0.3% -6.5% +10.0% ➖ noise
26 duckdb:duckdb +10.7% -0.3% +10.9% +15.7% ➖ noise
26 duckdb:vortex-compact +14.5% -0.3% +14.8% +15.0% ➖ noise
26 duckdb:vortex-file-compressed +11.4% -0.3% +11.7% +11.3% 🚨 regression
27 datafusion:vortex-compact -7.6% -1.8% -6.0% +10.0% ➖ noise
27 datafusion:vortex-file-compressed -8.2% -1.8% -6.6% +10.0% ➖ noise
27 duckdb:duckdb +10.5% -1.8% +12.5% +16.9% ➖ noise
27 duckdb:vortex-compact +6.6% -1.8% +8.5% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +7.9% -1.8% +9.8% +10.0% ➖ noise
28 datafusion:vortex-compact -6.8% -3.0% -3.9% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -6.5% -3.0% -3.6% +10.0% ➖ noise
28 duckdb:duckdb +4.8% -3.0% +8.0% +10.0% ➖ noise
28 duckdb:vortex-compact +4.9% -3.0% +8.1% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +9.4% -3.0% +12.7% +10.0% 🚨 regression
29 datafusion:vortex-compact -9.5% -3.1% -6.7% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -8.7% -3.1% -5.8% +10.0% ➖ noise
29 duckdb:duckdb +5.8% -3.1% +9.2% +11.1% ➖ noise
29 duckdb:vortex-compact +4.7% -3.1% +8.1% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +4.2% -3.1% +7.5% +14.3% ➖ noise
30 datafusion:vortex-compact -4.2% -0.0% -4.2% +10.0% ➖ noise
30 datafusion:vortex-file-compressed -1.3% -0.0% -1.2% +10.0% ➖ noise
30 duckdb:duckdb +9.7% -0.0% +9.7% +16.0% ➖ noise
30 duckdb:vortex-compact -1.3% -0.0% -1.3% +14.3% ➖ noise
30 duckdb:vortex-file-compressed +10.0% -0.0% +10.0% +10.0% 🚨 regression
31 datafusion:vortex-compact -9.6% -0.9% -8.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -4.3% -0.9% -3.4% +10.0% ➖ noise
31 duckdb:duckdb +1.5% -0.9% +2.5% +10.8% ➖ noise
31 duckdb:vortex-compact +16.7% -0.9% +17.8% +10.0% 🚨 regression
31 duckdb:vortex-file-compressed +6.0% -0.9% +7.0% +15.1% ➖ noise
32 datafusion:vortex-compact -6.7% +0.3% -7.0% +17.6% ➖ noise
32 datafusion:vortex-file-compressed -5.9% +0.3% -6.1% +18.8% ➖ noise
32 duckdb:duckdb +8.2% +0.3% +7.9% +18.2% ➖ noise
32 duckdb:vortex-compact +6.7% +0.3% +6.4% +17.2% ➖ noise
32 duckdb:vortex-file-compressed +7.0% +0.3% +6.7% +19.3% ➖ noise
33 datafusion:vortex-compact -6.6% -1.3% -5.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -4.0% -1.3% -2.7% +10.0% ➖ noise
33 duckdb:duckdb +5.2% -1.3% +6.5% +13.0% ➖ noise
33 duckdb:vortex-compact +4.4% -1.3% +5.7% +10.2% ➖ noise
33 duckdb:vortex-file-compressed +7.4% -1.3% +8.8% +10.5% ➖ noise
34 datafusion:vortex-compact -3.3% +5.8% -8.6% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -6.4% +5.8% -11.5% +10.0% ✅ faster
34 duckdb:duckdb +4.0% +5.8% -1.8% +10.2% ➖ noise
34 duckdb:vortex-compact +5.6% +5.8% -0.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +11.5% +5.8% +5.4% +10.3% ➖ noise
35 datafusion:vortex-compact -3.9% -0.2% -3.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -6.4% -0.2% -6.3% +10.0% ➖ noise
35 duckdb:duckdb +5.6% -0.2% +5.8% +12.7% ➖ noise
35 duckdb:vortex-compact +5.3% -0.2% +5.5% +11.1% ➖ noise
35 duckdb:vortex-file-compressed +9.5% -0.2% +9.7% +10.5% ➖ noise
36 datafusion:vortex-compact -6.4% +0.9% -7.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -7.7% +0.9% -8.5% +10.0% ➖ noise
36 duckdb:duckdb +8.1% +0.9% +7.1% +10.0% ➖ noise
36 duckdb:vortex-compact +1.7% +0.9% +0.7% +10.0% ➖ noise
36 duckdb:vortex-file-compressed +3.3% +0.9% +2.4% +20.8% ➖ noise
37 datafusion:vortex-compact -5.6% +4.9% -10.0% +10.0% ✅ faster
37 datafusion:vortex-file-compressed -14.7% +4.9% -18.6% +11.9% ✅ faster
37 duckdb:duckdb +6.5% +4.9% +1.6% +17.1% ➖ noise
37 duckdb:vortex-compact +9.3% +4.9% +4.2% +12.8% ➖ noise
37 duckdb:vortex-file-compressed +18.5% +4.9% +13.0% +13.5% ➖ noise
38 datafusion:vortex-compact -4.0% +1.8% -5.7% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -4.9% +1.8% -6.6% +10.0% ➖ noise
38 duckdb:duckdb +6.8% +1.8% +5.0% +12.6% ➖ noise
38 duckdb:vortex-compact +9.7% +1.8% +7.8% +14.6% ➖ noise
38 duckdb:vortex-file-compressed +8.0% +1.8% +6.1% +12.3% ➖ noise
39 datafusion:vortex-compact -14.1% -3.4% -11.1% +15.5% ➖ noise
39 datafusion:vortex-file-compressed -15.3% -3.4% -12.4% +13.2% ✅ faster
39 duckdb:duckdb -4.7% -3.4% -1.4% +19.2% ➖ noise
39 duckdb:vortex-compact +5.7% -3.4% +9.4% +16.8% ➖ noise
39 duckdb:vortex-file-compressed +4.2% -3.4% +7.9% +15.8% ➖ noise
40 datafusion:vortex-compact -7.4% +2.7% -9.8% +10.0% ✅ faster
40 datafusion:vortex-file-compressed -7.0% +2.7% -9.4% +10.4% ➖ noise
40 duckdb:duckdb +2.2% +2.7% -0.4% +25.9% ➖ noise
40 duckdb:vortex-compact +9.5% +2.7% +6.7% +11.2% ➖ noise
40 duckdb:vortex-file-compressed +12.0% +2.7% +9.1% +17.5% ➖ noise
41 datafusion:vortex-compact -4.9% +4.3% -8.9% +10.0% ➖ noise
41 datafusion:vortex-file-compressed -10.4% +4.3% -14.2% +10.0% ✅ faster
41 duckdb:duckdb +10.3% +4.3% +5.7% +10.0% ➖ noise
41 duckdb:vortex-compact +6.3% +4.3% +1.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +13.4% +4.3% +8.7% +10.0% ➖ noise
42 datafusion:vortex-compact -4.4% +2.9% -7.1% +10.0% ➖ noise
42 datafusion:vortex-file-compressed -11.3% +2.9% -13.8% +10.5% ✅ faster
42 duckdb:duckdb +7.3% +2.9% +4.2% +14.5% ➖ noise
42 duckdb:vortex-compact +1.6% +2.9% -1.2% +13.0% ➖ noise
42 duckdb:vortex-file-compressed +7.4% +2.9% +4.3% +13.4% ➖ noise
43 datafusion:vortex-compact -5.3% -2.7% -2.7% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -11.8% -2.7% -9.3% +10.0% ✅ faster
43 duckdb:duckdb +5.1% -2.7% +8.1% +10.6% ➖ noise
43 duckdb:vortex-compact +3.1% -2.7% +6.0% +13.9% ➖ noise
43 duckdb:vortex-file-compressed +7.1% -2.7% +10.1% +10.0% 🚨 regression
44 datafusion:vortex-compact -9.3% +3.1% -12.1% +10.0% ✅ faster
44 datafusion:vortex-file-compressed -9.1% +3.1% -11.8% +10.0% ✅ faster
44 duckdb:duckdb +4.6% +3.1% +1.4% +10.0% ➖ noise
44 duckdb:vortex-compact +11.9% +3.1% +8.5% +10.2% ➖ noise
44 duckdb:vortex-file-compressed +5.5% +3.1% +2.3% +10.4% ➖ noise
45 datafusion:vortex-compact -4.0% +4.2% -7.9% +11.8% ➖ noise
45 datafusion:vortex-file-compressed -6.7% +4.2% -10.5% +10.0% ✅ faster
45 duckdb:duckdb +6.6% +4.2% +2.3% +10.4% ➖ noise
45 duckdb:vortex-compact +21.0% +4.2% +16.1% +10.0% 🚨 regression
45 duckdb:vortex-file-compressed +12.1% +4.2% +7.6% +10.0% ➖ noise
46 datafusion:vortex-compact -5.7% -1.4% -4.3% +10.0% ➖ noise
46 datafusion:vortex-file-compressed -8.1% -1.4% -6.8% +10.4% ➖ noise
46 duckdb:duckdb +10.2% -1.4% +11.8% +10.2% 🚨 regression
46 duckdb:vortex-compact +5.1% -1.4% +6.7% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +9.5% -1.4% +11.0% +10.0% 🚨 regression
47 datafusion:vortex-compact -9.6% -2.9% -6.9% +10.0% ➖ noise
47 datafusion:vortex-file-compressed -8.6% -2.9% -5.9% +10.0% ➖ noise
47 duckdb:duckdb +10.6% -2.9% +13.9% +10.3% 🚨 regression
47 duckdb:vortex-compact +6.8% -2.9% +10.0% +10.0% 🚨 regression
47 duckdb:vortex-file-compressed +7.1% -2.9% +10.3% +10.0% 🚨 regression
48 datafusion:vortex-compact -4.4% -2.3% -2.1% +10.0% ➖ noise
48 datafusion:vortex-file-compressed -9.4% -2.3% -7.3% +10.0% ➖ noise
48 duckdb:duckdb +2.2% -2.3% +4.6% +10.0% ➖ noise
48 duckdb:vortex-compact +3.2% -2.3% +5.6% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +5.4% -2.3% +7.9% +10.6% ➖ noise
49 datafusion:vortex-compact -7.0% +0.2% -7.1% +10.0% ➖ noise
49 datafusion:vortex-file-compressed -8.6% +0.2% -8.7% +10.0% ➖ noise
49 duckdb:duckdb +10.2% +0.2% +10.0% +12.0% ➖ noise
49 duckdb:vortex-compact +8.2% +0.2% +8.0% +11.5% ➖ noise
49 duckdb:vortex-file-compressed +1.0% +0.2% +0.8% +11.3% ➖ noise
50 datafusion:vortex-compact -3.7% -3.1% -0.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed -14.5% -3.1% -11.7% +10.0% ✅ faster
50 duckdb:duckdb +8.3% -3.1% +11.8% +11.2% 🚨 regression
50 duckdb:vortex-compact +10.2% -3.1% +13.7% +10.0% 🚨 regression
50 duckdb:vortex-file-compressed +18.2% -3.1% +22.0% +10.0% 🚨 regression
51 datafusion:vortex-compact -5.9% -1.4% -4.6% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -12.0% -1.4% -10.7% +10.0% ✅ faster
51 duckdb:duckdb +4.5% -1.4% +6.0% +10.0% ➖ noise
51 duckdb:vortex-compact +8.2% -1.4% +9.7% +10.4% ➖ noise
51 duckdb:vortex-file-compressed +8.3% -1.4% +9.8% +18.6% ➖ noise
52 datafusion:vortex-compact -9.8% -4.6% -5.5% +18.5% ➖ noise
52 datafusion:vortex-file-compressed -11.3% -4.6% -7.0% +13.8% ➖ noise
52 duckdb:duckdb +1.4% -4.6% +6.3% +19.9% ➖ noise
52 duckdb:vortex-compact +3.6% -4.6% +8.6% +17.8% ➖ noise
52 duckdb:vortex-file-compressed +10.9% -4.6% +16.2% +22.6% ➖ noise
53 datafusion:vortex-compact -8.5% -1.4% -7.2% +10.0% ➖ noise
53 datafusion:vortex-file-compressed -3.2% -1.4% -1.8% +14.8% ➖ noise
53 duckdb:duckdb +3.3% -1.4% +4.8% +10.1% ➖ noise
53 duckdb:vortex-compact +3.0% -1.4% +4.5% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +6.3% -1.4% +7.8% +10.0% ➖ noise
54 datafusion:vortex-compact -4.2% +5.7% -9.4% +10.0% ✅ faster
54 datafusion:vortex-file-compressed -9.8% +5.7% -14.6% +10.0% ✅ faster
54 duckdb:duckdb +3.9% +5.7% -1.6% +11.8% ➖ noise
54 duckdb:vortex-compact +11.0% +5.7% +5.0% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +2.7% +5.7% -2.8% +10.9% ➖ noise
55 datafusion:vortex-compact -7.0% +2.3% -9.1% +11.7% ➖ noise
55 datafusion:vortex-file-compressed -2.9% +2.3% -5.1% +12.8% ➖ noise
55 duckdb:duckdb +10.5% +2.3% +8.1% +16.5% ➖ noise
55 duckdb:vortex-compact +6.1% +2.3% +3.7% +15.8% ➖ noise
55 duckdb:vortex-file-compressed +6.3% +2.3% +3.9% +18.7% ➖ noise
56 datafusion:vortex-compact -2.5% -1.6% -0.9% +10.0% ➖ noise
56 datafusion:vortex-file-compressed -6.4% -1.6% -4.9% +10.0% ➖ noise
56 duckdb:duckdb +4.6% -1.6% +6.3% +10.6% ➖ noise
56 duckdb:vortex-compact +5.6% -1.6% +7.3% +10.0% ➖ noise
56 duckdb:vortex-file-compressed +14.3% -1.6% +16.1% +11.7% 🚨 regression
57 datafusion:vortex-compact -7.9% -0.6% -7.4% +10.0% ➖ noise
57 datafusion:vortex-file-compressed -7.0% -0.6% -6.5% +10.0% ➖ noise
57 duckdb:duckdb +7.4% -0.6% +8.0% +11.4% ➖ noise
57 duckdb:vortex-compact -12.0% -0.6% -11.5% +18.9% ➖ noise
57 duckdb:vortex-file-compressed +6.0% -0.6% +6.6% +10.0% ➖ noise
58 datafusion:vortex-compact -8.3% -0.1% -8.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -10.9% -0.1% -10.7% +10.0% ✅ faster
58 duckdb:duckdb +9.5% -0.1% +9.7% +10.0% ➖ noise
58 duckdb:vortex-compact +11.9% -0.1% +12.0% +12.4% ➖ noise
58 duckdb:vortex-file-compressed +8.4% -0.1% +8.6% +14.0% ➖ noise
59 datafusion:vortex-compact -10.3% -3.8% -6.7% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -8.4% -3.8% -4.8% +10.0% ➖ noise
59 duckdb:duckdb +4.8% -3.8% +9.0% +10.0% ➖ noise
59 duckdb:vortex-compact +23.8% -3.8% +28.7% +10.0% 🚨 regression
59 duckdb:vortex-file-compressed +10.4% -3.8% +14.8% +10.0% 🚨 regression
60 datafusion:vortex-compact -5.8% -2.5% -3.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed -4.4% -2.5% -2.0% +10.0% ➖ noise
60 duckdb:duckdb +7.5% -2.5% +10.3% +12.1% ➖ noise
60 duckdb:vortex-compact +4.8% -2.5% +7.4% +10.0% ➖ noise
60 duckdb:vortex-file-compressed -2.4% -2.5% +0.1% +12.6% ➖ noise
61 datafusion:vortex-compact -4.7% -2.3% -2.4% +10.0% ➖ noise
61 datafusion:vortex-file-compressed -10.7% -2.3% -8.6% +10.0% ➖ noise
61 duckdb:duckdb +7.4% -2.3% +10.0% +10.0% ➖ noise
61 duckdb:vortex-compact +7.3% -2.3% +9.9% +10.0% ➖ noise
61 duckdb:vortex-file-compressed +13.3% -2.3% +16.0% +10.0% 🚨 regression
62 datafusion:vortex-compact -10.6% +7.9% -17.1% +13.8% ✅ faster
62 datafusion:vortex-file-compressed -16.4% +7.9% -22.5% +11.9% ✅ faster
62 duckdb:duckdb +11.1% +7.9% +2.9% +11.3% ➖ noise
62 duckdb:vortex-compact +8.4% +7.9% +0.4% +20.1% ➖ noise
62 duckdb:vortex-file-compressed +5.5% +7.9% -2.2% +26.8% ➖ noise
63 datafusion:vortex-compact -10.0% -0.1% -9.9% +10.0% ✅ faster
63 datafusion:vortex-file-compressed -9.8% -0.1% -9.8% +10.0% ✅ faster
63 duckdb:duckdb -2.4% -0.1% -2.3% +10.0% ➖ noise
63 duckdb:vortex-compact +15.3% -0.1% +15.4% +10.0% 🚨 regression
63 duckdb:vortex-file-compressed +6.7% -0.1% +6.7% +14.5% ➖ noise
64 datafusion:vortex-compact -6.8% -3.5% -3.5% +10.0% ➖ noise
64 datafusion:vortex-file-compressed -7.9% -3.5% -4.5% +10.0% ➖ noise
64 duckdb:duckdb +0.6% -3.5% +4.3% +10.0% ➖ noise
64 duckdb:vortex-compact +8.3% -3.5% +12.2% +10.0% 🚨 regression
64 duckdb:vortex-file-compressed +9.9% -3.5% +13.8% +10.0% 🚨 regression
65 datafusion:vortex-compact -6.5% -1.9% -4.8% +10.0% ➖ noise
65 datafusion:vortex-file-compressed -7.6% -1.9% -5.9% +10.2% ➖ noise
65 duckdb:duckdb +18.0% -1.9% +20.2% +23.0% ➖ noise
65 duckdb:vortex-compact +12.8% -1.9% +14.9% +22.1% ➖ noise
65 duckdb:vortex-file-compressed +2.0% -1.9% +3.9% +13.4% ➖ noise
66 datafusion:vortex-compact -5.3% +1.6% -6.7% +12.6% ➖ noise
66 datafusion:vortex-file-compressed -6.8% +1.6% -8.2% +11.7% ➖ noise
66 duckdb:duckdb +7.2% +1.6% +5.6% +16.7% ➖ noise
66 duckdb:vortex-compact +8.4% +1.6% +6.8% +14.1% ➖ noise
66 duckdb:vortex-file-compressed -6.2% +1.6% -7.6% +14.4% ➖ noise
67 datafusion:vortex-compact -10.9% -5.2% -5.9% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -9.0% -5.2% -4.0% +10.0% ➖ noise
67 duckdb:duckdb +11.1% -5.2% +17.2% +10.0% 🚨 regression
67 duckdb:vortex-compact +3.4% -5.2% +9.1% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +6.1% -5.2% +12.0% +10.0% 🚨 regression
68 datafusion:vortex-compact -9.0% -2.2% -7.0% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -0.7% -2.2% +1.6% +10.0% ➖ noise
68 duckdb:duckdb +6.1% -2.2% +8.5% +10.0% ➖ noise
68 duckdb:vortex-compact +7.4% -2.2% +9.8% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +2.5% -2.2% +4.8% +10.0% ➖ noise
69 datafusion:vortex-compact -4.8% +0.8% -5.6% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -4.9% +0.8% -5.6% +10.0% ➖ noise
69 duckdb:duckdb +5.7% +0.8% +4.8% +10.0% ➖ noise
69 duckdb:vortex-compact +8.5% +0.8% +7.7% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +9.4% +0.8% +8.6% +12.5% ➖ noise
70 datafusion:vortex-compact -7.6% -3.3% -4.4% +10.0% ➖ noise
70 datafusion:vortex-file-compressed -6.3% -3.3% -3.1% +10.0% ➖ noise
70 duckdb:duckdb +6.0% -3.3% +9.7% +15.3% ➖ noise
70 duckdb:vortex-compact +2.8% -3.3% +6.4% +10.4% ➖ noise
70 duckdb:vortex-file-compressed +8.3% -3.3% +12.1% +10.8% 🚨 regression
71 datafusion:vortex-compact -13.0% +2.5% -15.1% +10.9% ✅ faster
71 datafusion:vortex-file-compressed -8.5% +2.5% -10.7% +11.8% ✅ faster
71 duckdb:duckdb +6.8% +2.5% +4.3% +17.5% ➖ noise
71 duckdb:vortex-compact +9.5% +2.5% +6.9% +25.2% ➖ noise
71 duckdb:vortex-file-compressed +13.9% +2.5% +11.2% +14.0% ➖ noise
72 datafusion:vortex-compact -11.9% -3.7% -8.6% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -12.5% -3.7% -9.2% +10.0% ✅ faster
72 duckdb:duckdb +1.3% -3.7% +5.2% +11.8% ➖ noise
72 duckdb:vortex-compact +5.4% -3.7% +9.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +5.4% -3.7% +9.4% +10.0% ➖ noise
73 datafusion:vortex-compact -7.8% +2.1% -9.7% +19.5% ➖ noise
73 datafusion:vortex-file-compressed -11.6% +2.1% -13.4% +17.7% ➖ noise
73 duckdb:duckdb +9.0% +2.1% +6.8% +12.9% ➖ noise
73 duckdb:vortex-compact +6.4% +2.1% +4.3% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +1.3% +2.1% -0.8% +10.0% ➖ noise
74 datafusion:vortex-compact -8.1% -4.5% -3.7% +10.0% ➖ noise
74 datafusion:vortex-file-compressed -10.0% -4.5% -5.7% +10.0% ➖ noise
74 duckdb:duckdb +6.1% -4.5% +11.1% +10.0% 🚨 regression
74 duckdb:vortex-compact +12.4% -4.5% +17.7% +11.8% 🚨 regression
74 duckdb:vortex-file-compressed -0.7% -4.5% +4.0% +10.0% ➖ noise
75 datafusion:vortex-compact -6.7% -0.2% -6.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed -12.3% -0.2% -12.1% +12.9% ✅ faster
75 duckdb:duckdb +4.4% -0.2% +4.6% +10.9% ➖ noise
75 duckdb:vortex-compact +2.5% -0.2% +2.8% +10.1% ➖ noise
75 duckdb:vortex-file-compressed +9.9% -0.2% +10.1% +11.2% ➖ noise
76 datafusion:vortex-compact -10.8% +0.4% -11.2% +10.0% ✅ faster
76 datafusion:vortex-file-compressed -6.3% +0.4% -6.7% +11.0% ➖ noise
76 duckdb:duckdb +0.4% +0.4% +0.0% +14.0% ➖ noise
76 duckdb:vortex-compact +12.6% +0.4% +12.1% +10.0% 🚨 regression
76 duckdb:vortex-file-compressed +20.7% +0.4% +20.2% +20.9% ➖ noise
77 datafusion:vortex-compact -7.9% +1.1% -8.9% +10.0% ➖ noise
77 datafusion:vortex-file-compressed -5.7% +1.1% -6.7% +10.0% ➖ noise
77 duckdb:duckdb +3.0% +1.1% +1.9% +14.1% ➖ noise
77 duckdb:vortex-compact +1.4% +1.1% +0.3% +11.8% ➖ noise
77 duckdb:vortex-file-compressed +14.2% +1.1% +12.9% +11.6% 🚨 regression
78 datafusion:vortex-compact -10.4% -1.2% -9.3% +10.0% ✅ faster
78 datafusion:vortex-file-compressed -9.8% -1.2% -8.7% +10.0% ➖ noise
78 duckdb:duckdb +10.0% -1.2% +11.4% +10.0% 🚨 regression
78 duckdb:vortex-compact -2.2% -1.2% -1.0% +10.1% ➖ noise
78 duckdb:vortex-file-compressed +0.9% -1.2% +2.2% +10.0% ➖ noise
79 datafusion:vortex-compact -12.3% -1.0% -11.4% +10.0% ✅ faster
79 datafusion:vortex-file-compressed -5.6% -1.0% -4.6% +10.0% ➖ noise
79 duckdb:duckdb +9.1% -1.0% +10.2% +20.4% ➖ noise
79 duckdb:vortex-compact +4.1% -1.0% +5.2% +11.4% ➖ noise
79 duckdb:vortex-file-compressed +7.1% -1.0% +8.2% +10.5% ➖ noise
80 datafusion:vortex-compact -8.7% +0.6% -9.3% +10.0% ✅ faster
80 datafusion:vortex-file-compressed -9.9% +0.6% -10.5% +10.0% ✅ faster
80 duckdb:duckdb +15.0% +0.6% +14.3% +13.4% 🚨 regression
80 duckdb:vortex-compact +5.7% +0.6% +5.1% +14.3% ➖ noise
80 duckdb:vortex-file-compressed +3.0% +0.6% +2.3% +10.0% ➖ noise
81 datafusion:vortex-compact -6.4% -2.9% -3.6% +12.4% ➖ noise
81 datafusion:vortex-file-compressed -8.8% -2.9% -6.1% +12.9% ➖ noise
81 duckdb:duckdb +4.9% -2.9% +8.0% +10.7% ➖ noise
81 duckdb:vortex-compact +7.5% -2.9% +10.6% +13.3% ➖ noise
81 duckdb:vortex-file-compressed +4.0% -2.9% +7.1% +10.0% ➖ noise
82 datafusion:vortex-compact +7.1% +4.7% +2.3% +10.0% ➖ noise
82 datafusion:vortex-file-compressed -15.6% +4.7% -19.4% +10.0% ✅ faster
82 duckdb:duckdb +3.3% +4.7% -1.3% +17.9% ➖ noise
82 duckdb:vortex-compact +11.4% +4.7% +6.4% +10.0% ➖ noise
82 duckdb:vortex-file-compressed +3.6% +4.7% -1.0% +13.7% ➖ noise
83 datafusion:vortex-compact +5.4% +1.8% +3.6% +10.0% ➖ noise
83 datafusion:vortex-file-compressed -4.3% +1.8% -5.9% +10.0% ➖ noise
83 duckdb:duckdb +5.9% +1.8% +4.1% +12.3% ➖ noise
83 duckdb:vortex-compact +11.3% +1.8% +9.4% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +2.6% +1.8% +0.8% +16.1% ➖ noise
84 datafusion:vortex-compact +13.5% +0.2% +13.4% +11.5% 🚨 regression
84 datafusion:vortex-file-compressed -1.4% +0.2% -1.6% +10.0% ➖ noise
84 duckdb:duckdb +1.6% +0.2% +1.4% +10.4% ➖ noise
84 duckdb:vortex-compact +11.8% +0.2% +11.6% +10.0% 🚨 regression
84 duckdb:vortex-file-compressed +8.7% +0.2% +8.5% +10.0% ➖ noise
85 datafusion:vortex-compact +5.5% +0.1% +5.4% +10.0% ➖ noise
85 datafusion:vortex-file-compressed -3.1% +0.1% -3.2% +10.0% ➖ noise
85 duckdb:duckdb +7.8% +0.1% +7.7% +10.0% ➖ noise
85 duckdb:vortex-compact +16.0% +0.1% +16.0% +10.0% 🚨 regression
85 duckdb:vortex-file-compressed +10.4% +0.1% +10.4% +10.0% 🚨 regression
86 datafusion:vortex-compact +8.6% -1.8% +10.6% +12.4% ➖ noise
86 datafusion:vortex-file-compressed -3.9% -1.8% -2.1% +10.9% ➖ noise
86 duckdb:duckdb +11.4% -1.8% +13.5% +12.7% 🚨 regression
86 duckdb:vortex-compact +19.0% -1.8% +21.2% +23.0% ➖ noise
86 duckdb:vortex-file-compressed +13.8% -1.8% +16.0% +19.4% ➖ noise
87 datafusion:vortex-compact +9.2% +4.2% +4.8% +10.0% ➖ noise
87 datafusion:vortex-file-compressed -7.8% +4.2% -11.5% +10.0% ✅ faster
87 duckdb:duckdb +4.9% +4.2% +0.7% +10.1% ➖ noise
87 duckdb:vortex-compact +5.1% +4.2% +0.9% +13.8% ➖ noise
87 duckdb:vortex-file-compressed +5.6% +4.2% +1.4% +10.0% ➖ noise
88 datafusion:vortex-compact +3.1% -2.9% +6.1% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -9.9% -2.9% -7.2% +10.0% ➖ noise
88 duckdb:duckdb +3.8% -2.9% +6.9% +10.0% ➖ noise
88 duckdb:vortex-compact +3.7% -2.9% +6.8% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +3.7% -2.9% +6.8% +10.0% ➖ noise
89 datafusion:vortex-compact +13.2% -2.4% +16.0% +10.0% 🚨 regression
89 datafusion:vortex-file-compressed -8.3% -2.4% -6.0% +10.0% ➖ noise
89 duckdb:duckdb +5.2% -2.4% +7.7% +10.7% ➖ noise
89 duckdb:vortex-compact +9.4% -2.4% +12.1% +14.9% ➖ noise
89 duckdb:vortex-file-compressed -4.8% -2.4% -2.5% +14.6% ➖ noise
90 datafusion:vortex-compact +6.7% +7.9% -1.1% +11.0% ➖ noise
90 datafusion:vortex-file-compressed -3.7% +7.9% -10.7% +11.1% ✅ faster
90 duckdb:duckdb +15.5% +7.9% +7.0% +11.9% ➖ noise
90 duckdb:vortex-compact +18.8% +7.9% +10.1% +11.7% ➖ noise
90 duckdb:vortex-file-compressed +6.2% +7.9% -1.5% +12.2% ➖ noise
91 datafusion:vortex-compact +8.8% -1.8% +10.9% +10.0% 🚨 regression
91 datafusion:vortex-file-compressed -4.1% -1.8% -2.3% +10.0% ➖ noise
91 duckdb:duckdb +12.5% -1.8% +14.6% +22.5% ➖ noise
91 duckdb:vortex-compact +13.3% -1.8% +15.5% +10.0% 🚨 regression
91 duckdb:vortex-file-compressed +7.7% -1.8% +9.7% +10.7% ➖ noise
92 datafusion:vortex-compact +6.1% +1.8% +4.2% +10.0% ➖ noise
92 datafusion:vortex-file-compressed -2.4% +1.8% -4.1% +10.0% ➖ noise
92 duckdb:duckdb +14.1% +1.8% +12.1% +11.9% 🚨 regression
92 duckdb:vortex-compact +14.8% +1.8% +12.8% +16.9% ➖ noise
92 duckdb:vortex-file-compressed +7.2% +1.8% +5.3% +13.0% ➖ noise
93 datafusion:vortex-compact +9.3% -2.1% +11.6% +10.0% 🚨 regression
93 datafusion:vortex-file-compressed -11.5% -2.1% -9.6% +10.0% ✅ faster
93 duckdb:duckdb +12.0% -2.1% +14.5% +11.7% 🚨 regression
93 duckdb:vortex-compact +11.4% -2.1% +13.7% +10.0% 🚨 regression
93 duckdb:vortex-file-compressed +18.2% -2.1% +20.7% +10.1% 🚨 regression
94 datafusion:vortex-compact +11.4% -4.0% +16.0% +10.0% 🚨 regression
94 datafusion:vortex-file-compressed -2.2% -4.0% +1.8% +10.0% ➖ noise
94 duckdb:duckdb -9.2% -4.0% -5.5% +11.0% ➖ noise
94 duckdb:vortex-compact +13.8% -4.0% +18.5% +12.6% 🚨 regression
94 duckdb:vortex-file-compressed +7.9% -4.0% +12.4% +10.0% 🚨 regression
95 datafusion:vortex-compact +6.5% +7.4% -0.9% +10.7% ➖ noise
95 datafusion:vortex-file-compressed -9.7% +7.4% -15.9% +10.5% ✅ faster
95 duckdb:duckdb -7.6% +7.4% -13.9% +18.5% ➖ noise
95 duckdb:vortex-compact +5.9% +7.4% -1.4% +18.0% ➖ noise
95 duckdb:vortex-file-compressed -9.0% +7.4% -15.3% +19.2% ➖ noise
96 datafusion:vortex-compact +2.6% -0.4% +3.0% +10.1% ➖ noise
96 datafusion:vortex-file-compressed -10.7% -0.4% -10.4% +12.1% ➖ noise
96 duckdb:duckdb +9.2% -0.4% +9.7% +12.9% ➖ noise
96 duckdb:vortex-compact +13.7% -0.4% +14.1% +12.7% 🚨 regression
96 duckdb:vortex-file-compressed +8.8% -0.4% +9.2% +12.3% ➖ noise
97 datafusion:vortex-compact +3.8% -3.1% +7.1% +10.0% ➖ noise
97 datafusion:vortex-file-compressed -11.7% -3.1% -8.9% +10.0% ➖ noise
97 duckdb:duckdb +2.6% -3.1% +5.9% +11.0% ➖ noise
97 duckdb:vortex-compact +7.5% -3.1% +10.9% +10.7% 🚨 regression
97 duckdb:vortex-file-compressed +4.9% -3.1% +8.2% +12.6% ➖ noise
98 datafusion:vortex-compact +8.1% -3.7% +12.3% +12.1% 🚨 regression
98 datafusion:vortex-file-compressed -10.0% -3.7% -6.5% +10.9% ➖ noise
98 duckdb:duckdb +12.6% -3.7% +16.9% +12.7% 🚨 regression
98 duckdb:vortex-compact +9.7% -3.7% +13.9% +10.3% 🚨 regression
98 duckdb:vortex-file-compressed +14.7% -3.7% +19.1% +13.3% 🚨 regression
99 datafusion:vortex-compact +7.6% +7.0% +0.5% +19.3% ➖ noise
99 datafusion:vortex-file-compressed -9.9% +7.0% -15.8% +20.3% ➖ noise
99 duckdb:duckdb +6.0% +7.0% -0.9% +25.9% ➖ noise
99 duckdb:vortex-compact +10.6% +7.0% +3.3% +19.7% ➖ noise
99 duckdb:vortex-file-compressed +2.6% +7.0% -4.1% +33.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.9%
Vortex (geomean): 1.035x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +3.5%


datafusion / vortex-file-compressed (1.036x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 413195727 412701579 1.00
tpch_q02/datafusion:vortex-file-compressed 122871168 120074259 1.02
tpch_q03/datafusion:vortex-file-compressed 208144561 201635699 1.03
tpch_q04/datafusion:vortex-file-compressed 102731020 102499285 1.00
tpch_q05/datafusion:vortex-file-compressed 396238992 378669490 1.05
tpch_q06/datafusion:vortex-file-compressed 42731138 41257231 1.04
tpch_q07/datafusion:vortex-file-compressed 586652510 561210844 1.05
tpch_q08/datafusion:vortex-file-compressed 388987295 380380521 1.02
tpch_q09/datafusion:vortex-file-compressed 711519169 659730730 1.08
tpch_q10/datafusion:vortex-file-compressed 245277604 234393278 1.05
tpch_q11/datafusion:vortex-file-compressed 87619300 85397920 1.03
tpch_q12/datafusion:vortex-file-compressed 111144152 108336820 1.03
tpch_q13/datafusion:vortex-file-compressed 228695596 223271391 1.02
tpch_q14/datafusion:vortex-file-compressed 58106314 57783438 1.01
tpch_q15/datafusion:vortex-file-compressed 113540681 106785185 1.06
tpch_q16/datafusion:vortex-file-compressed 80411762 77739913 1.03
tpch_q17/datafusion:vortex-file-compressed 672464845 640740835 1.05
tpch_q18/datafusion:vortex-file-compressed 925496912 878329044 1.05
tpch_q19/datafusion:vortex-file-compressed 100008824 101658674 0.98
tpch_q20/datafusion:vortex-file-compressed 180749025 173369920 1.04
tpch_q21/datafusion:vortex-file-compressed 693719498 659403589 1.05
tpch_q22/datafusion:vortex-file-compressed 🚨 66361369 60297749 1.10
datafusion / vortex-compact (1.033x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 456281551 446967185 1.02
tpch_q02/datafusion:vortex-compact 127876696 120748552 1.06
tpch_q03/datafusion:vortex-compact 221817190 221129942 1.00
tpch_q04/datafusion:vortex-compact 124916990 121152513 1.03
tpch_q05/datafusion:vortex-compact 405068576 393767514 1.03
tpch_q06/datafusion:vortex-compact 66467584 64996338 1.02
tpch_q07/datafusion:vortex-compact 601705736 585958781 1.03
tpch_q08/datafusion:vortex-compact 395592809 390979572 1.01
tpch_q09/datafusion:vortex-compact 711885369 679673916 1.05
tpch_q10/datafusion:vortex-compact 282843223 272545016 1.04
tpch_q11/datafusion:vortex-compact 97590933 91076514 1.07
tpch_q12/datafusion:vortex-compact 174821644 168828458 1.04
tpch_q13/datafusion:vortex-compact 283873709 274575747 1.03
tpch_q14/datafusion:vortex-compact 77410313 75546010 1.02
tpch_q15/datafusion:vortex-compact 173571591 168594663 1.03
tpch_q16/datafusion:vortex-compact 85021744 83340634 1.02
tpch_q17/datafusion:vortex-compact 677631186 652236508 1.04
tpch_q18/datafusion:vortex-compact 935335781 891726576 1.05
tpch_q19/datafusion:vortex-compact 150950460 148012666 1.02
tpch_q20/datafusion:vortex-compact 209881274 198958293 1.05
tpch_q21/datafusion:vortex-compact 722167417 701977771 1.03
tpch_q22/datafusion:vortex-compact 74335863 71680198 1.04
datafusion / parquet (1.036x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 421853360 430172336 0.98
tpch_q02/datafusion:parquet 194189100 190622020 1.02
tpch_q03/datafusion:parquet 303598933 296499631 1.02
tpch_q04/datafusion:parquet 141252910 135189317 1.04
tpch_q05/datafusion:parquet 466872882 439681826 1.06
tpch_q06/datafusion:parquet 127996968 117813261 1.09
tpch_q07/datafusion:parquet 655293924 623292513 1.05
tpch_q08/datafusion:parquet 489649455 479678337 1.02
tpch_q09/datafusion:parquet 796961834 754425540 1.06
tpch_q10/datafusion:parquet 532619242 502188319 1.06
tpch_q11/datafusion:parquet 136218368 129445103 1.05
tpch_q12/datafusion:parquet 208869674 202440781 1.03
tpch_q13/datafusion:parquet 345918945 342492491 1.01
tpch_q14/datafusion:parquet 159760640 165846446 0.96
tpch_q15/datafusion:parquet 254184530 254367782 1.00
tpch_q16/datafusion:parquet 141884065 137343875 1.03
tpch_q17/datafusion:parquet 724877553 684965581 1.06
tpch_q18/datafusion:parquet 965182177 885016533 1.09
tpch_q19/datafusion:parquet 277233988 264018382 1.05
tpch_q20/datafusion:parquet 318309099 304729242 1.04
tpch_q21/datafusion:parquet 764340300 735945036 1.04
tpch_q22/datafusion:parquet 227349316 219727088 1.03
datafusion / arrow (1.069x ➖, 0↑ 4↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 641404779 601890768 1.07
tpch_q02/datafusion:arrow 171189659 165213747 1.04
tpch_q03/datafusion:arrow 🚨 510499817 459548304 1.11
tpch_q04/datafusion:arrow 379865651 349044144 1.09
tpch_q05/datafusion:arrow 1002820980 917780256 1.09
tpch_q06/datafusion:arrow 🚨 303566497 275242289 1.10
tpch_q07/datafusion:arrow 1233278636 1133646304 1.09
tpch_q08/datafusion:arrow 1245904989 1134540628 1.10
tpch_q09/datafusion:arrow 1430001808 1340401534 1.07
tpch_q10/datafusion:arrow 656366029 598290293 1.10
tpch_q11/datafusion:arrow 152886089 149812288 1.02
tpch_q12/datafusion:arrow 697425597 683371069 1.02
tpch_q13/datafusion:arrow 541914632 521699303 1.04
tpch_q14/datafusion:arrow 333571342 314439669 1.06
tpch_q15/datafusion:arrow 717965687 663049426 1.08
tpch_q16/datafusion:arrow 111855905 110037357 1.02
tpch_q17/datafusion:arrow 1399806651 1315936250 1.06
tpch_q18/datafusion:arrow 🚨 2002851312 1787753056 1.12
tpch_q19/datafusion:arrow 551293084 502630312 1.10
tpch_q20/datafusion:arrow 🚨 538292106 487700505 1.10
tpch_q21/datafusion:arrow 3020704061 2812519933 1.07
tpch_q22/datafusion:arrow 144708394 147181509 0.98
duckdb / vortex-file-compressed (1.045x ➖, 0↑ 2↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 181772434 179268727 1.01
tpch_q02/duckdb:vortex-file-compressed 🚨 58027215 51613543 1.12
tpch_q03/duckdb:vortex-file-compressed 129606538 127001185 1.02
tpch_q04/duckdb:vortex-file-compressed 157785115 147751012 1.07
tpch_q05/duckdb:vortex-file-compressed 137219803 132305261 1.04
tpch_q06/duckdb:vortex-file-compressed 54299130 52351785 1.04
tpch_q07/duckdb:vortex-file-compressed 152698916 144865449 1.05
tpch_q08/duckdb:vortex-file-compressed 183508143 174305565 1.05
tpch_q09/duckdb:vortex-file-compressed 344594057 339110221 1.02
tpch_q10/duckdb:vortex-file-compressed 161712153 152943932 1.06
tpch_q11/duckdb:vortex-file-compressed 38060322 35373462 1.08
tpch_q12/duckdb:vortex-file-compressed 94086723 90862391 1.04
tpch_q13/duckdb:vortex-file-compressed 251985384 245416935 1.03
tpch_q14/duckdb:vortex-file-compressed 🚨 73078256 65794633 1.11
tpch_q15/duckdb:vortex-file-compressed 100865901 96231959 1.05
tpch_q16/duckdb:vortex-file-compressed 83785317 80165418 1.05
tpch_q17/duckdb:vortex-file-compressed 105081640 101057820 1.04
tpch_q18/duckdb:vortex-file-compressed 277409599 283650717 0.98
tpch_q19/duckdb:vortex-file-compressed 94362049 91417857 1.03
tpch_q20/duckdb:vortex-file-compressed 171796656 166152431 1.03
tpch_q21/duckdb:vortex-file-compressed 583425071 557051328 1.05
tpch_q22/duckdb:vortex-file-compressed 81137804 77990792 1.04
duckdb / vortex-compact (1.028x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 232405210 230167725 1.01
tpch_q02/duckdb:vortex-compact 60430368 60938092 0.99
tpch_q03/duckdb:vortex-compact 146114827 139057182 1.05
tpch_q04/duckdb:vortex-compact 184434473 173659176 1.06
tpch_q05/duckdb:vortex-compact 153439448 146836405 1.04
tpch_q06/duckdb:vortex-compact 89273464 91973281 0.97
tpch_q07/duckdb:vortex-compact 209218084 202571481 1.03
tpch_q08/duckdb:vortex-compact 201337283 192973974 1.04
tpch_q09/duckdb:vortex-compact 370834043 365292430 1.02
tpch_q10/duckdb:vortex-compact 193193322 185517685 1.04
tpch_q11/duckdb:vortex-compact 43799750 41314608 1.06
tpch_q12/duckdb:vortex-compact 211859267 207848601 1.02
tpch_q13/duckdb:vortex-compact 305544409 294434682 1.04
tpch_q14/duckdb:vortex-compact 107300419 105993435 1.01
tpch_q15/duckdb:vortex-compact 123328600 119801105 1.03
tpch_q16/duckdb:vortex-compact 88397242 85850561 1.03
tpch_q17/duckdb:vortex-compact 125398635 117571992 1.07
tpch_q18/duckdb:vortex-compact 295524733 292063744 1.01
tpch_q19/duckdb:vortex-compact 117504329 117032835 1.00
tpch_q20/duckdb:vortex-compact 215257463 209794673 1.03
tpch_q21/duckdb:vortex-compact 654690791 632967754 1.03
tpch_q22/duckdb:vortex-compact 93389578 91240710 1.02
duckdb / parquet (1.020x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 251819514 265778419 0.95
tpch_q02/duckdb:parquet 107546503 103550217 1.04
tpch_q03/duckdb:parquet 220356982 214282344 1.03
tpch_q04/duckdb:parquet 138547040 134050474 1.03
tpch_q05/duckdb:parquet 224933539 218317853 1.03
tpch_q06/duckdb:parquet 69516885 66773079 1.04
tpch_q07/duckdb:parquet 184689999 179552179 1.03
tpch_q08/duckdb:parquet 259789385 252524090 1.03
tpch_q09/duckdb:parquet 465814924 465472090 1.00
tpch_q10/duckdb:parquet 618191849 609867354 1.01
tpch_q11/duckdb:parquet 40860564 39265429 1.04
tpch_q12/duckdb:parquet 126346063 125548833 1.01
tpch_q13/duckdb:parquet 474258407 452640073 1.05
tpch_q14/duckdb:parquet 172495240 169940839 1.02
tpch_q15/duckdb:parquet 100706281 96760639 1.04
tpch_q16/duckdb:parquet 161931185 165837528 0.98
tpch_q17/duckdb:parquet 177974399 177432926 1.00
tpch_q18/duckdb:parquet 355284819 347455191 1.02
tpch_q19/duckdb:parquet 281517372 281721421 1.00
tpch_q20/duckdb:parquet 234178456 227083335 1.03
tpch_q21/duckdb:parquet 591710877 567126547 1.04
tpch_q22/duckdb:parquet 298198280 290608528 1.03
duckdb / duckdb (1.013x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117813578 116833266 1.01
tpch_q02/duckdb:duckdb 45600434 47214287 0.97
tpch_q03/duckdb:duckdb 98474041 97141192 1.01
tpch_q04/duckdb:duckdb 134363059 129388127 1.04
tpch_q05/duckdb:duckdb 114341512 109446703 1.04
tpch_q06/duckdb:duckdb 39210076 39743838 0.99
tpch_q07/duckdb:duckdb 87200638 86247065 1.01
tpch_q08/duckdb:duckdb 112704314 110229080 1.02
tpch_q09/duckdb:duckdb 284294179 279409114 1.02
tpch_q10/duckdb:duckdb 211273594 198249210 1.07
tpch_q11/duckdb:duckdb 15677441 15552133 1.01
tpch_q12/duckdb:duckdb 86107452 85022577 1.01
tpch_q13/duckdb:duckdb 258322391 250891122 1.03
tpch_q14/duckdb:duckdb 72529875 70981389 1.02
tpch_q15/duckdb:duckdb 78392303 77859282 1.01
tpch_q16/duckdb:duckdb 74971227 72970902 1.03
tpch_q17/duckdb:duckdb 85251083 84911860 1.00
tpch_q18/duckdb:duckdb 215144874 212158404 1.01
tpch_q19/duckdb:duckdb 114129689 115800942 0.99
tpch_q20/duckdb:duckdb 111811187 111593745 1.00
tpch_q21/duckdb:duckdb 311716683 303579375 1.03
tpch_q22/duckdb:duckdb 66756003 67545513 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +6.6% -3.6% +10.6% +10.0% 🚨 regression
1 datafusion:vortex-compact +2.1% -3.6% +5.9% +10.8% ➖ noise
1 datafusion:vortex-file-compressed +0.1% -3.6% +3.9% +11.7% ➖ noise
1 duckdb:duckdb +0.8% -3.6% +4.6% +10.0% ➖ noise
1 duckdb:vortex-compact +1.0% -3.6% +4.8% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.4% -3.6% +5.2% +10.0% ➖ noise
2 datafusion:arrow +3.6% +2.9% +0.7% +10.0% ➖ noise
2 datafusion:vortex-compact +5.9% +2.9% +3.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +2.3% +2.9% -0.5% +10.2% ➖ noise
2 duckdb:duckdb -3.4% +2.9% -6.1% +11.2% ➖ noise
2 duckdb:vortex-compact -0.8% +2.9% -3.6% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +12.4% +2.9% +9.3% +10.9% ➖ noise
3 datafusion:arrow +11.1% +2.6% +8.3% +10.0% ➖ noise
3 datafusion:vortex-compact +0.3% +2.6% -2.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +3.2% +2.6% +0.6% +10.0% ➖ noise
3 duckdb:duckdb +1.4% +2.6% -1.2% +10.0% ➖ noise
3 duckdb:vortex-compact +5.1% +2.6% +2.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +2.1% +2.6% -0.5% +10.0% ➖ noise
4 datafusion:arrow +8.8% +3.9% +4.7% +10.0% ➖ noise
4 datafusion:vortex-compact +3.1% +3.9% -0.8% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +0.2% +3.9% -3.6% +10.0% ➖ noise
4 duckdb:duckdb +3.8% +3.9% -0.1% +10.0% ➖ noise
4 duckdb:vortex-compact +6.2% +3.9% +2.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +6.8% +3.9% +2.8% +10.0% ➖ noise
5 datafusion:arrow +9.3% +4.6% +4.5% +10.0% ➖ noise
5 datafusion:vortex-compact +2.9% +4.6% -1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +4.6% +4.6% +0.0% +10.0% ➖ noise
5 duckdb:duckdb +4.5% +4.6% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact +4.5% +4.6% -0.1% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +3.7% +4.6% -0.8% +10.0% ➖ noise
6 datafusion:arrow +10.3% +6.4% +3.7% +10.0% ➖ noise
6 datafusion:vortex-compact +2.3% +6.4% -3.8% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.6% +6.4% -2.6% +10.0% ➖ noise
6 duckdb:duckdb -1.3% +6.4% -7.2% +15.4% ➖ noise
6 duckdb:vortex-compact -2.9% +6.4% -8.7% +10.1% ➖ noise
6 duckdb:vortex-file-compressed +3.7% +6.4% -2.5% +14.6% ➖ noise
7 datafusion:arrow +8.8% +4.0% +4.6% +10.0% ➖ noise
7 datafusion:vortex-compact +2.7% +4.0% -1.3% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.5% +4.0% +0.5% +10.0% ➖ noise
7 duckdb:duckdb +1.1% +4.0% -2.8% +10.0% ➖ noise
7 duckdb:vortex-compact +3.3% +4.0% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +5.4% +4.0% +1.4% +10.0% ➖ noise
8 datafusion:arrow +9.8% +2.5% +7.2% +10.0% ➖ noise
8 datafusion:vortex-compact +1.2% +2.5% -1.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.3% +2.5% -0.2% +10.0% ➖ noise
8 duckdb:duckdb +2.2% +2.5% -0.2% +10.0% ➖ noise
8 duckdb:vortex-compact +4.3% +2.5% +1.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +5.3% +2.5% +2.7% +10.0% ➖ noise
9 datafusion:arrow +6.7% +2.8% +3.8% +10.0% ➖ noise
9 datafusion:vortex-compact +4.7% +2.8% +1.9% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +7.8% +2.8% +4.9% +10.0% ➖ noise
9 duckdb:duckdb +1.7% +2.8% -1.0% +10.0% ➖ noise
9 duckdb:vortex-compact +1.5% +2.8% -1.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.6% +2.8% -1.2% +10.0% ➖ noise
10 datafusion:arrow +9.7% +3.7% +5.8% +10.0% ➖ noise
10 datafusion:vortex-compact +3.8% +3.7% +0.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +4.6% +3.7% +0.9% +10.0% ➖ noise
10 duckdb:duckdb +6.6% +3.7% +2.8% +10.0% ➖ noise
10 duckdb:vortex-compact +4.1% +3.7% +0.4% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +5.7% +3.7% +2.0% +10.0% ➖ noise
11 datafusion:arrow +2.1% +4.6% -2.5% +10.9% ➖ noise
11 datafusion:vortex-compact +7.2% +4.6% +2.4% +14.2% ➖ noise
11 datafusion:vortex-file-compressed +2.6% +4.6% -2.0% +10.6% ➖ noise
11 duckdb:duckdb +0.8% +4.6% -3.7% +19.3% ➖ noise
11 duckdb:vortex-compact +6.0% +4.6% +1.3% +13.8% ➖ noise
11 duckdb:vortex-file-compressed +7.6% +4.6% +2.8% +13.4% ➖ noise
12 datafusion:arrow +2.1% +1.9% +0.2% +49.7% ➖ noise
12 datafusion:vortex-compact +3.5% +1.9% +1.6% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +2.6% +1.9% +0.7% +10.0% ➖ noise
12 duckdb:duckdb +1.3% +1.9% -0.6% +10.0% ➖ noise
12 duckdb:vortex-compact +1.9% +1.9% +0.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +3.5% +1.9% +1.6% +10.0% ➖ noise
13 datafusion:arrow +3.9% +2.9% +1.0% +11.2% ➖ noise
13 datafusion:vortex-compact +3.4% +2.9% +0.5% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.4% +2.9% -0.4% +10.0% ➖ noise
13 duckdb:duckdb +3.0% +2.9% +0.1% +10.0% ➖ noise
13 duckdb:vortex-compact +3.8% +2.9% +0.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +2.7% +2.9% -0.2% +10.0% ➖ noise
14 datafusion:arrow +6.1% -1.1% +7.3% +10.0% ➖ noise
14 datafusion:vortex-compact +2.5% -1.1% +3.6% +10.1% ➖ noise
14 datafusion:vortex-file-compressed +0.6% -1.1% +1.7% +13.5% ➖ noise
14 duckdb:duckdb +2.2% -1.1% +3.3% +10.0% ➖ noise
14 duckdb:vortex-compact +1.2% -1.1% +2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +11.1% -1.1% +12.3% +12.2% 🚨 regression
15 datafusion:arrow +8.3% +2.0% +6.2% +10.0% ➖ noise
15 datafusion:vortex-compact +3.0% +2.0% +1.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.3% +2.0% +4.3% +10.0% ➖ noise
15 duckdb:duckdb +0.7% +2.0% -1.3% +10.0% ➖ noise
15 duckdb:vortex-compact +2.9% +2.0% +0.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +4.8% +2.0% +2.8% +10.0% ➖ noise
16 datafusion:arrow +1.7% +0.4% +1.2% +21.0% ➖ noise
16 datafusion:vortex-compact +2.0% +0.4% +1.6% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.4% +0.4% +3.0% +11.5% ➖ noise
16 duckdb:duckdb +2.7% +0.4% +2.3% +10.0% ➖ noise
16 duckdb:vortex-compact +3.0% +0.4% +2.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +4.5% +0.4% +4.1% +10.0% ➖ noise
17 datafusion:arrow +6.4% +3.0% +3.2% +10.0% ➖ noise
17 datafusion:vortex-compact +3.9% +3.0% +0.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +5.0% +3.0% +1.9% +10.0% ➖ noise
17 duckdb:duckdb +0.4% +3.0% -2.6% +10.0% ➖ noise
17 duckdb:vortex-compact +6.7% +3.0% +3.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +4.0% +3.0% +0.9% +10.0% ➖ noise
18 datafusion:arrow +12.0% +5.6% +6.1% +10.0% ➖ noise
18 datafusion:vortex-compact +4.9% +5.6% -0.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +5.4% +5.6% -0.2% +10.0% ➖ noise
18 duckdb:duckdb +1.4% +5.6% -4.0% +10.0% ➖ noise
18 duckdb:vortex-compact +1.2% +5.6% -4.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.2% +5.6% -7.4% +10.0% ➖ noise
19 datafusion:arrow +9.7% +2.4% +7.1% +10.0% ➖ noise
19 datafusion:vortex-compact +2.0% +2.4% -0.4% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -1.6% +2.4% -4.0% +10.0% ➖ noise
19 duckdb:duckdb -1.4% +2.4% -3.8% +10.0% ➖ noise
19 duckdb:vortex-compact +0.4% +2.4% -2.0% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +3.2% +2.4% +0.8% +10.0% ➖ noise
20 datafusion:arrow +10.4% +3.8% +6.3% +10.0% ➖ noise
20 datafusion:vortex-compact +5.5% +3.8% +1.6% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +4.3% +3.8% +0.5% +10.0% ➖ noise
20 duckdb:duckdb +0.2% +3.8% -3.5% +10.0% ➖ noise
20 duckdb:vortex-compact +2.6% +3.8% -1.1% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +3.4% +3.8% -0.4% +10.0% ➖ noise
21 datafusion:arrow +7.4% +4.1% +3.2% +10.0% ➖ noise
21 datafusion:vortex-compact +2.9% +4.1% -1.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.2% +4.1% +1.1% +10.0% ➖ noise
21 duckdb:duckdb +2.7% +4.1% -1.4% +10.0% ➖ noise
21 duckdb:vortex-compact +3.4% +4.1% -0.6% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +4.7% +4.1% +0.6% +10.0% ➖ noise
22 datafusion:arrow -1.7% +3.0% -4.6% +10.0% ➖ noise
22 datafusion:vortex-compact +3.7% +3.0% +0.6% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +10.1% +3.0% +6.8% +10.0% ➖ noise
22 duckdb:duckdb -1.2% +3.0% -4.1% +10.0% ➖ noise
22 duckdb:vortex-compact +2.4% +3.0% -0.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +4.0% +3.0% +1.0% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +13.4%
Vortex (geomean): 1.211x ➖
Parquet (geomean): 1.067x ➖
Shifts: Parquet (control) +6.7% · Median polish +13.3%


datafusion / vortex-file-compressed (1.319x ❌, 2↑ 12↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 246633100 361646531 0.68
tpch_q02/datafusion:vortex-file-compressed 524579927 722922449 0.73
tpch_q03/datafusion:vortex-file-compressed 434474187 590716465 0.74
tpch_q04/datafusion:vortex-file-compressed 230810923 322147815 0.72
tpch_q05/datafusion:vortex-file-compressed 🚨 782852829 570508608 1.37
tpch_q06/datafusion:vortex-file-compressed 344382060 405758587 0.85
tpch_q07/datafusion:vortex-file-compressed 551327704 464215196 1.19
tpch_q08/datafusion:vortex-file-compressed 734197255 883718002 0.83
tpch_q09/datafusion:vortex-file-compressed 🚨 923409051 501950867 1.84
tpch_q10/datafusion:vortex-file-compressed 🚨 973508827 718381934 1.36
tpch_q11/datafusion:vortex-file-compressed 🚨 838838975 402816985 2.08
tpch_q12/datafusion:vortex-file-compressed 🚨 769833176 443227111 1.74
tpch_q13/datafusion:vortex-file-compressed 🚨 460661787 184251722 2.50
tpch_q14/datafusion:vortex-file-compressed 🚨 463791492 201474919 2.30
tpch_q15/datafusion:vortex-file-compressed 🚨 651376775 334823643 1.95
tpch_q16/datafusion:vortex-file-compressed 🚀 201108930 297564882 0.68
tpch_q17/datafusion:vortex-file-compressed 538992964 444100602 1.21
tpch_q18/datafusion:vortex-file-compressed 464809358 375212533 1.24
tpch_q19/datafusion:vortex-file-compressed 🚨 806752075 397292816 2.03
tpch_q20/datafusion:vortex-file-compressed 🚨 700768792 345510641 2.03
tpch_q21/datafusion:vortex-file-compressed 🚨 1007226716 521551339 1.93
tpch_q22/datafusion:vortex-file-compressed 🚨 351478137 193345541 1.82
datafusion / vortex-compact (1.191x ➖, 1↑ 13↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 326028903 306058863 1.07
tpch_q02/datafusion:vortex-compact 516756982 722205484 0.72
tpch_q03/datafusion:vortex-compact 🚀 416672276 739936215 0.56
tpch_q04/datafusion:vortex-compact 278793969 283716133 0.98
tpch_q05/datafusion:vortex-compact 423000862 519725267 0.81
tpch_q06/datafusion:vortex-compact 404615737 357955082 1.13
tpch_q07/datafusion:vortex-compact 🚨 609125617 463425006 1.31
tpch_q08/datafusion:vortex-compact 🚨 708573103 499047753 1.42
tpch_q09/datafusion:vortex-compact 🚨 632837878 403079834 1.57
tpch_q10/datafusion:vortex-compact 🚨 678825887 464724894 1.46
tpch_q11/datafusion:vortex-compact 🚨 447724260 265988904 1.68
tpch_q12/datafusion:vortex-compact 🚨 612673111 417781609 1.47
tpch_q13/datafusion:vortex-compact 🚨 297599077 199320178 1.49
tpch_q14/datafusion:vortex-compact 🚨 315020036 242301801 1.30
tpch_q15/datafusion:vortex-compact 🚨 661733555 458429487 1.44
tpch_q16/datafusion:vortex-compact 222263705 177599584 1.25
tpch_q17/datafusion:vortex-compact 🚨 424184455 310760853 1.36
tpch_q18/datafusion:vortex-compact 🚨 408044121 290329443 1.41
tpch_q19/datafusion:vortex-compact 🚨 606806808 453685288 1.34
tpch_q20/datafusion:vortex-compact 547732237 448817254 1.22
tpch_q21/datafusion:vortex-compact 🚨 660898836 503719774 1.31
tpch_q22/datafusion:vortex-compact 162306851 204278225 0.79
datafusion / parquet (1.060x ➖, 1↑ 4↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 244214762 233557250 1.05
tpch_q02/datafusion:parquet 414165853 408778442 1.01
tpch_q03/datafusion:parquet 542150466 438553640 1.24
tpch_q04/datafusion:parquet 258032125 255067298 1.01
tpch_q05/datafusion:parquet 780600754 675912523 1.15
tpch_q06/datafusion:parquet 206338759 238254717 0.87
tpch_q07/datafusion:parquet 708779945 619335590 1.14
tpch_q08/datafusion:parquet 🚀 667650609 1028353124 0.65
tpch_q09/datafusion:parquet 505438288 707642539 0.71
tpch_q10/datafusion:parquet 535605079 527969328 1.01
tpch_q11/datafusion:parquet 348590292 341097164 1.02
tpch_q12/datafusion:parquet 🚨 406691527 248200519 1.64
tpch_q13/datafusion:parquet 437204572 441775984 0.99
tpch_q14/datafusion:parquet 176569390 212412767 0.83
tpch_q15/datafusion:parquet 280354180 305637186 0.92
tpch_q16/datafusion:parquet 181995252 201705922 0.90
tpch_q17/datafusion:parquet 361613431 388418807 0.93
tpch_q18/datafusion:parquet 488333934 453743542 1.08
tpch_q19/datafusion:parquet 🚨 497984052 315721111 1.58
tpch_q20/datafusion:parquet 🚨 705365273 344529252 2.05
tpch_q21/datafusion:parquet 🚨 936346391 664422125 1.41
tpch_q22/datafusion:parquet 167039691 172711615 0.97
duckdb / vortex-file-compressed (1.163x ➖, 0↑ 7↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚨 373541221 283368565 1.32
tpch_q02/duckdb:vortex-file-compressed 1006660711 871093433 1.16
tpch_q03/duckdb:vortex-file-compressed 682872537 695188035 0.98
tpch_q04/duckdb:vortex-file-compressed 453052475 410484013 1.10
tpch_q05/duckdb:vortex-file-compressed 🚨 1418969458 976196134 1.45
tpch_q06/duckdb:vortex-file-compressed 540514565 531806879 1.02
tpch_q07/duckdb:vortex-file-compressed 941888937 843753549 1.12
tpch_q08/duckdb:vortex-file-compressed 1124651677 915305904 1.23
tpch_q09/duckdb:vortex-file-compressed 1032911893 991348802 1.04
tpch_q10/duckdb:vortex-file-compressed 840742016 710538072 1.18
tpch_q11/duckdb:vortex-file-compressed 🚨 695727080 496238726 1.40
tpch_q12/duckdb:vortex-file-compressed 548623242 617606414 0.89
tpch_q13/duckdb:vortex-file-compressed 🚨 596431266 430300069 1.39
tpch_q14/duckdb:vortex-file-compressed 🚨 618363944 420787621 1.47
tpch_q15/duckdb:vortex-file-compressed 311776248 299640089 1.04
tpch_q16/duckdb:vortex-file-compressed 436917204 364719650 1.20
tpch_q17/duckdb:vortex-file-compressed 🚨 865029539 613299967 1.41
tpch_q18/duckdb:vortex-file-compressed 548800891 626334519 0.88
tpch_q19/duckdb:vortex-file-compressed 460791524 444232086 1.04
tpch_q20/duckdb:vortex-file-compressed 1073982221 994621954 1.08
tpch_q21/duckdb:vortex-file-compressed 🚨 1501255735 1091663056 1.38
tpch_q22/duckdb:vortex-file-compressed 359676851 321875443 1.12
duckdb / vortex-compact (1.176x ➖, 0↑ 6↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 316470496 303802398 1.04
tpch_q02/duckdb:vortex-compact 851591505 905823178 0.94
tpch_q03/duckdb:vortex-compact 666069359 693290103 0.96
tpch_q04/duckdb:vortex-compact 364258830 305012164 1.19
tpch_q05/duckdb:vortex-compact 🚨 1267386585 723984648 1.75
tpch_q06/duckdb:vortex-compact 🚨 720837047 408032830 1.77
tpch_q07/duckdb:vortex-compact 850183393 693133247 1.23
tpch_q08/duckdb:vortex-compact 1000858708 1194678494 0.84
tpch_q09/duckdb:vortex-compact 869190774 945144527 0.92
tpch_q10/duckdb:vortex-compact 🚨 882608069 647444583 1.36
tpch_q11/duckdb:vortex-compact 🚨 790902359 437816524 1.81
tpch_q12/duckdb:vortex-compact 519962659 458949373 1.13
tpch_q13/duckdb:vortex-compact 512545820 432705784 1.18
tpch_q14/duckdb:vortex-compact 🚨 714269425 509572070 1.40
tpch_q15/duckdb:vortex-compact 352362594 305950558 1.15
tpch_q16/duckdb:vortex-compact 386662011 451780642 0.86
tpch_q17/duckdb:vortex-compact 697092158 639623431 1.09
tpch_q18/duckdb:vortex-compact 523854525 496047596 1.06
tpch_q19/duckdb:vortex-compact 🚨 625458466 378247987 1.65
tpch_q20/duckdb:vortex-compact 870038222 746895879 1.16
tpch_q21/duckdb:vortex-compact 1085634909 1065093114 1.02
tpch_q22/duckdb:vortex-compact 375581385 358468637 1.05
duckdb / parquet (1.075x ➖, 0↑ 3↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 498886934 466304967 1.07
tpch_q02/duckdb:parquet 1306635230 1371855196 0.95
tpch_q03/duckdb:parquet 1429400102 1291056569 1.11
tpch_q04/duckdb:parquet 748138206 860683584 0.87
tpch_q05/duckdb:parquet 1890992093 1732605029 1.09
tpch_q06/duckdb:parquet 🚨 618206973 411048244 1.50
tpch_q07/duckdb:parquet 1244520325 1233978349 1.01
tpch_q08/duckdb:parquet 🚨 2005481797 1506088102 1.33
tpch_q09/duckdb:parquet 1558243960 1501133591 1.04
tpch_q10/duckdb:parquet 1909900859 1615520460 1.18
tpch_q11/duckdb:parquet 965082633 822147879 1.17
tpch_q12/duckdb:parquet 🚨 1003498201 744460129 1.35
tpch_q13/duckdb:parquet 1016757735 902346343 1.13
tpch_q14/duckdb:parquet 831084249 738851867 1.12
tpch_q15/duckdb:parquet 710156393 597071389 1.19
tpch_q16/duckdb:parquet 585546602 542622375 1.08
tpch_q17/duckdb:parquet 788028909 919381317 0.86
tpch_q18/duckdb:parquet 831917999 888090708 0.94
tpch_q19/duckdb:parquet 923926277 940462018 0.98
tpch_q20/duckdb:parquet 1069908752 1126757360 0.95
tpch_q21/duckdb:parquet 1055502558 1382849614 0.76
tpch_q22/duckdb:parquet 644003225 512633767 1.26
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.5% +5.8% +0.7% +153.4% ➖ noise
1 datafusion:vortex-file-compressed -31.8% +5.8% -35.5% +115.1% ➖ noise
1 duckdb:vortex-compact +4.2% +5.8% -1.5% +111.9% ➖ noise
1 duckdb:vortex-file-compressed +31.8% +5.8% +24.6% +54.0% ➖ noise
2 datafusion:vortex-compact -28.4% -1.8% -27.2% +55.3% ➖ noise
2 datafusion:vortex-file-compressed -27.4% -1.8% -26.1% +47.9% ➖ noise
2 duckdb:vortex-compact -6.0% -1.8% -4.3% +40.4% ➖ noise
2 duckdb:vortex-file-compressed +15.6% -1.8% +17.6% +40.4% ➖ noise
3 datafusion:vortex-compact -43.7% +17.0% -51.9% +94.8% ✅ faster
3 datafusion:vortex-file-compressed -26.4% +17.0% -37.1% +107.9% ➖ noise
3 duckdb:vortex-compact -3.9% +17.0% -17.9% +67.4% ➖ noise
3 duckdb:vortex-file-compressed -1.8% +17.0% -16.0% +40.4% ➖ noise
4 datafusion:vortex-compact -1.7% -6.2% +4.8% +63.0% ➖ noise
4 datafusion:vortex-file-compressed -28.4% -6.2% -23.6% +40.4% ➖ noise
4 duckdb:vortex-compact +19.4% -6.2% +27.4% +59.5% ➖ noise
4 duckdb:vortex-file-compressed +10.4% -6.2% +17.7% +63.0% ➖ noise
5 datafusion:vortex-compact -18.6% +12.3% -27.5% +40.4% ➖ noise
5 datafusion:vortex-file-compressed +37.2% +12.3% +22.2% +50.4% ➖ noise
5 duckdb:vortex-compact +75.1% +12.3% +55.9% +50.9% 🚨 regression
5 duckdb:vortex-file-compressed +45.4% +12.3% +29.5% +47.6% ➖ noise
6 datafusion:vortex-compact +13.0% +14.1% -1.0% +53.6% ➖ noise
6 datafusion:vortex-file-compressed -15.1% +14.1% -25.6% +59.2% ➖ noise
6 duckdb:vortex-compact +76.7% +14.1% +54.8% +40.5% 🚨 regression
6 duckdb:vortex-file-compressed +1.6% +14.1% -10.9% +60.0% ➖ noise
7 datafusion:vortex-compact +31.4% +7.4% +22.3% +40.4% ➖ noise
7 datafusion:vortex-file-compressed +18.8% +7.4% +10.5% +47.6% ➖ noise
7 duckdb:vortex-compact +22.7% +7.4% +14.2% +40.4% ➖ noise
7 duckdb:vortex-file-compressed +11.6% +7.4% +3.9% +40.4% ➖ noise
8 datafusion:vortex-compact +42.0% -7.0% +52.7% +40.4% 🚨 regression
8 datafusion:vortex-file-compressed -16.9% -7.0% -10.6% +77.2% ➖ noise
8 duckdb:vortex-compact -16.2% -7.0% -9.9% +41.3% ➖ noise
8 duckdb:vortex-file-compressed +22.9% -7.0% +32.1% +40.4% ➖ noise
9 datafusion:vortex-compact +57.0% -13.9% +82.3% +56.4% 🚨 regression
9 datafusion:vortex-file-compressed +84.0% -13.9% +113.6% +48.2% 🚨 regression
9 duckdb:vortex-compact -8.0% -13.9% +6.8% +40.4% ➖ noise
9 duckdb:vortex-file-compressed +4.2% -13.9% +21.0% +40.4% ➖ noise
10 datafusion:vortex-compact +46.1% +9.5% +33.4% +49.0% ➖ noise
10 datafusion:vortex-file-compressed +35.5% +9.5% +23.7% +48.7% ➖ noise
10 duckdb:vortex-compact +36.3% +9.5% +24.5% +79.2% ➖ noise
10 duckdb:vortex-file-compressed +18.3% +9.5% +8.0% +53.2% ➖ noise
11 datafusion:vortex-compact +68.3% +9.5% +53.7% +40.4% 🚨 regression
11 datafusion:vortex-file-compressed +108.2% +9.5% +90.1% +63.5% 🚨 regression
11 duckdb:vortex-compact +80.6% +9.5% +64.9% +40.4% 🚨 regression
11 duckdb:vortex-file-compressed +40.2% +9.5% +28.0% +48.9% ➖ noise
12 datafusion:vortex-compact +46.6% +48.6% -1.3% +42.1% ➖ noise
12 datafusion:vortex-file-compressed +73.7% +48.6% +16.9% +67.7% ➖ noise
12 duckdb:vortex-compact +13.3% +48.6% -23.8% +72.9% ➖ noise
12 duckdb:vortex-file-compressed -11.2% +48.6% -40.2% +50.0% ✅ faster
13 datafusion:vortex-compact +49.3% +5.6% +41.4% +111.0% ➖ noise
13 datafusion:vortex-file-compressed +150.0% +5.6% +136.8% +114.1% 🚨 regression
13 duckdb:vortex-compact +18.5% +5.6% +12.2% +40.4% ➖ noise
13 duckdb:vortex-file-compressed +38.6% +5.6% +31.3% +40.4% ➖ noise
14 datafusion:vortex-compact +30.0% -3.3% +34.5% +47.3% ➖ noise
14 datafusion:vortex-file-compressed +130.2% -3.3% +138.1% +66.0% 🚨 regression
14 duckdb:vortex-compact +40.2% -3.3% +45.0% +63.8% ➖ noise
14 duckdb:vortex-file-compressed +47.0% -3.3% +52.0% +40.4% 🚨 regression
15 datafusion:vortex-compact +44.3% +4.5% +38.2% +40.4% ➖ noise
15 datafusion:vortex-file-compressed +94.5% +4.5% +86.3% +53.6% 🚨 regression
15 duckdb:vortex-compact +15.2% +4.5% +10.3% +71.0% ➖ noise
15 duckdb:vortex-file-compressed +4.1% +4.5% -0.4% +58.1% ➖ noise
16 datafusion:vortex-compact +25.1% -1.3% +26.8% +40.4% ➖ noise
16 datafusion:vortex-file-compressed -32.4% -1.3% -31.5% +61.2% ➖ noise
16 duckdb:vortex-compact -14.4% -1.3% -13.3% +46.3% ➖ noise
16 duckdb:vortex-file-compressed +19.8% -1.3% +21.4% +40.4% ➖ noise
17 datafusion:vortex-compact +36.5% -10.7% +52.8% +40.4% 🚨 regression
17 datafusion:vortex-file-compressed +21.4% -10.7% +35.9% +44.8% ➖ noise
17 duckdb:vortex-compact +9.0% -10.7% +22.0% +46.6% ➖ noise
17 duckdb:vortex-file-compressed +41.0% -10.7% +57.9% +40.4% 🚨 regression
18 datafusion:vortex-compact +40.5% +0.4% +40.0% +40.4% ➖ noise
18 datafusion:vortex-file-compressed +23.9% +0.4% +23.4% +66.6% ➖ noise
18 duckdb:vortex-compact +5.6% +0.4% +5.2% +45.5% ➖ noise
18 duckdb:vortex-file-compressed -12.4% +0.4% -12.7% +63.3% ➖ noise
19 datafusion:vortex-compact +33.8% +24.5% +7.4% +73.1% ➖ noise
19 datafusion:vortex-file-compressed +103.1% +24.5% +63.1% +85.2% ➖ noise
19 duckdb:vortex-compact +65.4% +24.5% +32.8% +72.7% ➖ noise
19 duckdb:vortex-file-compressed +3.7% +24.5% -16.7% +64.0% ➖ noise
20 datafusion:vortex-compact +22.0% +39.4% -12.5% +40.4% ➖ noise
20 datafusion:vortex-file-compressed +102.8% +39.4% +45.5% +56.9% ➖ noise
20 duckdb:vortex-compact +16.5% +39.4% -16.5% +47.2% ➖ noise
20 duckdb:vortex-file-compressed +8.0% +39.4% -22.6% +69.9% ➖ noise
21 datafusion:vortex-compact +31.2% +3.7% +26.5% +42.6% ➖ noise
21 datafusion:vortex-file-compressed +93.1% +3.7% +86.2% +50.5% 🚨 regression
21 duckdb:vortex-compact +1.9% +3.7% -1.7% +40.4% ➖ noise
21 duckdb:vortex-file-compressed +37.5% +3.7% +32.6% +59.5% ➖ noise
22 datafusion:vortex-compact -20.5% +10.2% -27.9% +63.3% ➖ noise
22 datafusion:vortex-file-compressed +81.8% +10.2% +64.9% +40.4% 🚨 regression
22 duckdb:vortex-compact +4.8% +10.2% -4.9% +51.6% ➖ noise
22 duckdb:vortex-file-compressed +11.7% +10.2% +1.4% +40.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -14.9%
Vortex (geomean): 0.975x ➖
Parquet (geomean): 1.145x ➖
Shifts: Parquet (control) +14.5% · Median polish +9.0%


datafusion / vortex-file-compressed (1.019x ➖, 2↑ 2↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 44874642 44022621 1.02
fineweb_q01/datafusion:vortex-file-compressed 🚀 697029490 1408353294 0.49
fineweb_q02/datafusion:vortex-file-compressed 🚀 739609731 1362570459 0.54
fineweb_q03/datafusion:vortex-file-compressed 🚨 2524144307 1453294780 1.74
fineweb_q04/datafusion:vortex-file-compressed 1516268400 1364098927 1.11
fineweb_q05/datafusion:vortex-file-compressed 1587700007 1343927203 1.18
fineweb_q06/datafusion:vortex-file-compressed 🚨 2266468307 1577262031 1.44
fineweb_q07/datafusion:vortex-file-compressed 1570273747 1450248585 1.08
fineweb_q08/datafusion:vortex-file-compressed 783375246 643149946 1.22
datafusion / vortex-compact (0.715x ➖, 3↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 39334867 59888662 0.66
fineweb_q01/datafusion:vortex-compact 🚀 578085962 1795422028 0.32
fineweb_q02/datafusion:vortex-compact 🚀 659118669 1636661906 0.40
fineweb_q03/datafusion:vortex-compact 1839586523 1889561531 0.97
fineweb_q04/datafusion:vortex-compact 2243119963 2223990817 1.01
fineweb_q05/datafusion:vortex-compact 1660917315 1710264160 0.97
fineweb_q06/datafusion:vortex-compact 1425938877 1701379857 0.84
fineweb_q07/datafusion:vortex-compact 1373677221 1507634781 0.91
fineweb_q08/datafusion:vortex-compact 419338902 535542768 0.78
datafusion / parquet (1.190x ➖, 0↑ 3↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 2005070893 2351044256 0.85
fineweb_q01/datafusion:parquet 3093547197 2837165722 1.09
fineweb_q02/datafusion:parquet 🚨 2947248713 1992027276 1.48
fineweb_q03/datafusion:parquet 2984930626 2369470441 1.26
fineweb_q04/datafusion:parquet 2229527720 2218667365 1.00
fineweb_q05/datafusion:parquet 2316054962 2135123497 1.08
fineweb_q06/datafusion:parquet 2443441191 2166688835 1.13
fineweb_q07/datafusion:parquet 🚨 3120150814 1961674551 1.59
fineweb_q08/datafusion:parquet 🚨 3052784779 2157258217 1.42
duckdb / vortex-file-compressed (1.084x ➖, 1↑ 2↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 🚨 100051256 73150532 1.37
fineweb_q01/duckdb:vortex-file-compressed 579571550 738026968 0.79
fineweb_q02/duckdb:vortex-file-compressed 508058483 532859289 0.95
fineweb_q03/duckdb:vortex-file-compressed 1699222680 1503699565 1.13
fineweb_q04/duckdb:vortex-file-compressed 1879149070 1635177234 1.15
fineweb_q05/duckdb:vortex-file-compressed 1860598106 1496410004 1.24
fineweb_q06/duckdb:vortex-file-compressed 🚨 2857252029 1575491148 1.81
fineweb_q07/duckdb:vortex-file-compressed 1452135375 1463194809 0.99
fineweb_q08/duckdb:vortex-file-compressed 🚀 639885479 919175636 0.70
duckdb / vortex-compact (1.143x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 87164266 69994960 1.25
fineweb_q01/duckdb:vortex-compact 🚨 864266548 560917279 1.54
fineweb_q02/duckdb:vortex-compact 854748194 677169244 1.26
fineweb_q03/duckdb:vortex-compact 1917017499 1657354400 1.16
fineweb_q04/duckdb:vortex-compact 1836681139 1693007925 1.08
fineweb_q05/duckdb:vortex-compact 1569609865 1560691209 1.01
fineweb_q06/duckdb:vortex-compact 1582665662 1576110342 1.00
fineweb_q07/duckdb:vortex-compact 1401262868 1488251169 0.94
fineweb_q08/duckdb:vortex-compact 521046893 452261144 1.15
duckdb / parquet (1.102x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1183141395 1050604244 1.13
fineweb_q01/duckdb:parquet 1853137421 1665633943 1.11
fineweb_q02/duckdb:parquet 1763698434 1623130340 1.09
fineweb_q03/duckdb:parquet 4593960944 3953237469 1.16
fineweb_q04/duckdb:parquet 2040198942 1864250886 1.09
fineweb_q05/duckdb:parquet 3080090048 2784286121 1.11
fineweb_q06/duckdb:parquet 3984453330 3474011321 1.15
fineweb_q07/duckdb:parquet 4374862250 4222299431 1.04
fineweb_q08/duckdb:parquet 1232437825 1172862851 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -34.3% -2.0% -33.0% +236.3% ➖ noise
0 datafusion:vortex-file-compressed +1.9% -2.0% +4.0% +148.6% ➖ noise
0 duckdb:vortex-compact +24.5% -2.0% +27.1% +144.8% ➖ noise
0 duckdb:vortex-file-compressed +36.8% -2.0% +39.6% +78.5% ➖ noise
1 datafusion:vortex-compact -67.8% +10.1% -70.8% +74.6% ✅ faster
1 datafusion:vortex-file-compressed -50.5% +10.1% -55.1% +79.5% ✅ faster
1 duckdb:vortex-compact +54.1% +10.1% +39.9% +73.3% ➖ noise
1 duckdb:vortex-file-compressed -21.5% +10.1% -28.7% +70.9% ➖ noise
2 datafusion:vortex-compact -59.7% +26.8% -68.2% +30.0% ✅ faster
2 datafusion:vortex-file-compressed -45.7% +26.8% -57.2% +54.5% ✅ faster
2 duckdb:vortex-compact +26.2% +26.8% -0.4% +89.3% ➖ noise
2 duckdb:vortex-file-compressed -4.7% +26.8% -24.8% +51.7% ➖ noise
3 datafusion:vortex-compact -2.6% +21.0% -19.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +73.7% +21.0% +43.5% +39.4% 🚨 regression
3 duckdb:vortex-compact +15.7% +21.0% -4.4% +33.8% ➖ noise
3 duckdb:vortex-file-compressed +13.0% +21.0% -6.6% +30.0% ➖ noise
4 datafusion:vortex-compact +0.9% +4.9% -3.8% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +11.2% +4.9% +6.0% +30.0% ➖ noise
4 duckdb:vortex-compact +8.5% +4.9% +3.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +14.9% +4.9% +9.6% +30.0% ➖ noise
5 datafusion:vortex-compact -2.9% +9.5% -11.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +18.1% +9.5% +7.8% +30.0% ➖ noise
5 duckdb:vortex-compact +0.6% +9.5% -8.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +24.3% +9.5% +13.5% +30.0% ➖ noise
6 datafusion:vortex-compact -16.2% +13.7% -26.3% +30.0% ✅ faster
6 datafusion:vortex-file-compressed +43.7% +13.7% +26.3% +47.7% ➖ noise
6 duckdb:vortex-compact +0.4% +13.7% -11.7% +40.1% ➖ noise
6 duckdb:vortex-file-compressed +81.4% +13.7% +59.5% +42.8% 🚨 regression
7 datafusion:vortex-compact -8.9% +28.4% -29.0% +30.0% ✅ faster
7 datafusion:vortex-file-compressed +8.3% +28.4% -15.7% +30.0% ➖ noise
7 duckdb:vortex-compact -5.8% +28.4% -26.7% +30.0% ✅ faster
7 duckdb:vortex-file-compressed -0.8% +28.4% -22.7% +40.9% ➖ noise
8 datafusion:vortex-compact -21.7% +21.9% -35.8% +64.4% ➖ noise
8 datafusion:vortex-file-compressed +21.8% +21.9% -0.1% +43.3% ➖ noise
8 duckdb:vortex-compact +15.2% +21.9% -5.5% +32.0% ➖ noise
8 duckdb:vortex-file-compressed -30.4% +21.9% -42.9% +46.6% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Random Access

Vortex (geomean): 0.841x ✅
Parquet (geomean): 0.989x ➖


unknown / unknown (0.931x ➖, 10↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 2659984 3108404 0.86
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1292811 1287458 1.00
random-access/feature-vectors/correlated/parquet-tokio-local-disk 12018574029 12132618560 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11480992387 11248461342 1.02
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8179078 8515025 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 6254089 6867608 0.91
random-access/feature-vectors/uniform/lance-tokio-local-disk 1474621 1424080 1.04
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2398637 2325988 1.03
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11473347700 11279769813 1.02
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11455391885 11257055380 1.02
random-access/feature-vectors/uniform/vortex-tokio-local-disk 12972107 13731415 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12886096 14138363 0.91
random-access/lance-tokio-local-disk 755080 832224 0.91
random-access/lance-tokio-local-disk-footer 🚀 1370565 1615825 0.85
random-access/nested-lists/correlated/lance-tokio-local-disk 270547 269818 1.00
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 720671 716800 1.01
random-access/nested-lists/correlated/parquet-tokio-local-disk 139688315 141498933 0.99
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 139618632 143132054 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 703797 700781 1.00
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 704113 705701 1.00
random-access/nested-lists/uniform/lance-tokio-local-disk 1188163 1138605 1.04
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1681177 1621364 1.04
random-access/nested-lists/uniform/parquet-tokio-local-disk 139298239 143301126 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 138275413 142887108 0.97
random-access/nested-lists/uniform/vortex-tokio-local-disk 2466334 2413806 1.02
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 2570997 2621224 0.98
random-access/nested-structs/correlated/lance-tokio-local-disk 434826 431124 1.01
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 644326 639795 1.01
random-access/nested-structs/correlated/parquet-tokio-local-disk 27381294 25070430 1.09
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 27432551 25225056 1.09
random-access/nested-structs/correlated/vortex-tokio-local-disk 897980 836385 1.07
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 898131 923486 0.97
random-access/nested-structs/uniform/lance-tokio-local-disk 2864327 2744043 1.04
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3120874 2985451 1.05
random-access/nested-structs/uniform/parquet-tokio-local-disk 27527879 25213265 1.09
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27400792 25214588 1.09
random-access/nested-structs/uniform/vortex-tokio-local-disk 1828507 1885628 0.97
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 1816007 1824382 1.00
random-access/parquet-tokio-local-disk 186282360 194763858 0.96
random-access/parquet-tokio-local-disk-footer 183014677 198666012 0.92
random-access/taxi/correlated/lance-tokio-local-disk 986462 1068810 0.92
random-access/taxi/correlated/lance-tokio-local-disk-footer 🚀 1685893 1941011 0.87
random-access/taxi/correlated/parquet-tokio-local-disk 274513744 302420913 0.91
random-access/taxi/correlated/parquet-tokio-local-disk-footer 🚀 273300449 305127083 0.90
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1709284 3055362 0.56
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1699832 2899523 0.59
random-access/taxi/uniform/lance-tokio-local-disk 9087510 9675221 0.94
random-access/taxi/uniform/lance-tokio-local-disk-footer 9618157 10501094 0.92
random-access/taxi/uniform/parquet-tokio-local-disk 297610678 319352295 0.93
random-access/taxi/uniform/parquet-tokio-local-disk-footer 294690076 321866191 0.92
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4419492 6551151 0.67
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4498586 6284475 0.72
random-access/vortex-tokio-local-disk 🚀 1263613 2107231 0.60
random-access/vortex-tokio-local-disk-footer 🚀 1277185 2081140 0.61

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Vortex (geomean): 0.977x ➖
Parquet (geomean): 0.951x ➖
Shifts: Parquet (control) -4.9% · Median polish -2.8%


duckdb / vortex-file-compressed (0.979x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10733286 11303413 0.95
statpopgen_q01/duckdb:vortex-file-compressed 26439615 28800432 0.92
statpopgen_q02/duckdb:vortex-file-compressed 1288533176 1323674733 0.97
statpopgen_q03/duckdb:vortex-file-compressed 3017964482 3120903523 0.97
statpopgen_q04/duckdb:vortex-file-compressed 3065782060 3073990497 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1364305858 1440894189 0.95
statpopgen_q06/duckdb:vortex-file-compressed 2063962103 2087706961 0.99
statpopgen_q07/duckdb:vortex-file-compressed 262572917 244945457 1.07
statpopgen_q08/duckdb:vortex-file-compressed 273464624 266373418 1.03
statpopgen_q09/duckdb:vortex-file-compressed 2810863510 2875191636 0.98
statpopgen_q10/duckdb:vortex-file-compressed 4552323728 4738189624 0.96
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10640735 11627876 0.92
statpopgen_q01/duckdb:vortex-compact 167230888 174204255 0.96
statpopgen_q02/duckdb:vortex-compact 1811383229 1857434119 0.98
statpopgen_q03/duckdb:vortex-compact 3507884539 3547568498 0.99
statpopgen_q04/duckdb:vortex-compact 3460970133 3605920262 0.96
statpopgen_q05/duckdb:vortex-compact 1881790518 1935601155 0.97
statpopgen_q06/duckdb:vortex-compact 2673600838 2731991296 0.98
statpopgen_q07/duckdb:vortex-compact 994042803 974991829 1.02
statpopgen_q08/duckdb:vortex-compact 1028259005 1007799938 1.02
statpopgen_q09/duckdb:vortex-compact 3365685706 3478398222 0.97
statpopgen_q10/duckdb:vortex-compact 5375472895 5550508968 0.97
duckdb / parquet (0.951x ➖, 0↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 306038889 322752820 0.95
statpopgen_q01/duckdb:parquet 391686243 407483627 0.96
statpopgen_q02/duckdb:parquet 977544422 1033135830 0.95
statpopgen_q03/duckdb:parquet 1488644996 1595760658 0.93
statpopgen_q04/duckdb:parquet 1471249470 1603703903 0.92
statpopgen_q05/duckdb:parquet 997845707 1055936568 0.94
statpopgen_q06/duckdb:parquet 1461922068 1557159826 0.94
statpopgen_q07/duckdb:parquet 1880377159 1912650408 0.98
statpopgen_q08/duckdb:parquet 1869328476 1948105442 0.96
statpopgen_q09/duckdb:parquet 1372441012 1413065516 0.97
statpopgen_q10/duckdb:parquet 2672282508 2800344248 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -8.5% -5.2% -3.5% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -5.0% -5.2% +0.1% +10.0% ➖ noise
1 duckdb:vortex-compact -4.0% -3.9% -0.1% +29.5% ➖ noise
1 duckdb:vortex-file-compressed -8.2% -3.9% -4.5% +232.1% ➖ noise
2 duckdb:vortex-compact -2.5% -5.4% +3.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -2.7% -5.4% +2.9% +10.0% ➖ noise
3 duckdb:vortex-compact -1.1% -6.7% +6.0% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.3% -6.7% +3.7% +10.0% ➖ noise
4 duckdb:vortex-compact -4.0% -8.3% +4.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% -8.3% +8.7% +10.0% ➖ noise
5 duckdb:vortex-compact -2.8% -5.5% +2.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.3% -5.5% +0.2% +10.0% ➖ noise
6 duckdb:vortex-compact -2.1% -6.1% +4.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.1% -6.1% +5.3% +10.0% ➖ noise
7 duckdb:vortex-compact +2.0% -1.7% +3.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +7.2% -1.7% +9.0% +24.5% ➖ noise
8 duckdb:vortex-compact +2.0% -4.0% +6.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.7% -4.0% +7.0% +10.0% ➖ noise
9 duckdb:vortex-compact -3.2% -2.9% -0.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -2.2% -2.9% +0.7% +10.0% ➖ noise
10 duckdb:vortex-compact -3.2% -4.6% +1.5% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -3.9% -4.6% +0.7% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.888x ✅
Parquet (geomean): 0.917x ➖
Shifts: Parquet (control) -8.3% · Median polish -8.3%


datafusion / vortex-file-compressed (0.881x ✅, 26↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1940758 2072246 0.94
clickbench_q01/datafusion:vortex-file-compressed 14038021 15341542 0.92
clickbench_q02/datafusion:vortex-file-compressed 34589432 38423245 0.90
clickbench_q03/datafusion:vortex-file-compressed 🚀 37564802 43986561 0.85
clickbench_q04/datafusion:vortex-file-compressed 🚀 308551883 368248124 0.84
clickbench_q05/datafusion:vortex-file-compressed 🚀 325672110 369563808 0.88
clickbench_q06/datafusion:vortex-file-compressed 🚀 1903960 2186320 0.87
clickbench_q07/datafusion:vortex-file-compressed 18110655 19592771 0.92
clickbench_q08/datafusion:vortex-file-compressed 🚀 387021488 462803495 0.84
clickbench_q09/datafusion:vortex-file-compressed 🚀 574629098 648717886 0.89
clickbench_q10/datafusion:vortex-file-compressed 78215328 84980251 0.92
clickbench_q11/datafusion:vortex-file-compressed 🚀 87605669 106625470 0.82
clickbench_q12/datafusion:vortex-file-compressed 🚀 282040130 315954280 0.89
clickbench_q13/datafusion:vortex-file-compressed 🚀 428511246 504890325 0.85
clickbench_q14/datafusion:vortex-file-compressed 🚀 260550315 313264277 0.83
clickbench_q15/datafusion:vortex-file-compressed 🚀 366522524 444520372 0.82
clickbench_q16/datafusion:vortex-file-compressed 🚀 715585250 850931557 0.84
clickbench_q17/datafusion:vortex-file-compressed 🚀 694827374 831416243 0.84
clickbench_q18/datafusion:vortex-file-compressed 🚀 1433623230 1670675300 0.86
clickbench_q19/datafusion:vortex-file-compressed 23515808 25423187 0.92
clickbench_q20/datafusion:vortex-file-compressed 358242978 369332566 0.97
clickbench_q21/datafusion:vortex-file-compressed 🚀 412295397 482050344 0.86
clickbench_q22/datafusion:vortex-file-compressed 🚀 515011879 589388030 0.87
clickbench_q23/datafusion:vortex-file-compressed 🚀 818881577 923247026 0.89
clickbench_q24/datafusion:vortex-file-compressed 🚀 46408460 56896913 0.82
clickbench_q25/datafusion:vortex-file-compressed 73240514 79935087 0.92
clickbench_q26/datafusion:vortex-file-compressed 🚀 45233473 60437556 0.75
clickbench_q27/datafusion:vortex-file-compressed 798440948 884011494 0.90
clickbench_q28/datafusion:vortex-file-compressed 6896717147 7283628284 0.95
clickbench_q29/datafusion:vortex-file-compressed 243007817 250011544 0.97
clickbench_q30/datafusion:vortex-file-compressed 🚀 238785610 279475995 0.85
clickbench_q31/datafusion:vortex-file-compressed 🚀 276007470 322444065 0.86
clickbench_q32/datafusion:vortex-file-compressed 🚀 1285174588 1555231693 0.83
clickbench_q33/datafusion:vortex-file-compressed 🚀 1411679179 1715745887 0.82
clickbench_q34/datafusion:vortex-file-compressed 🚀 1421951930 1682554240 0.85
clickbench_q35/datafusion:vortex-file-compressed 521558803 574373165 0.91
clickbench_q36/datafusion:vortex-file-compressed 87258640 89644694 0.97
clickbench_q37/datafusion:vortex-file-compressed 41882210 43950117 0.95
clickbench_q38/datafusion:vortex-file-compressed 🚀 23232463 26176700 0.89
clickbench_q39/datafusion:vortex-file-compressed 151827117 163474300 0.93
clickbench_q40/datafusion:vortex-file-compressed 20002472 21133692 0.95
clickbench_q41/datafusion:vortex-file-compressed 🚀 17561902 19896409 0.88
clickbench_q42/datafusion:vortex-file-compressed 19956291 21537570 0.93
datafusion / parquet (0.900x ➖, 22↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚀 1826442 2528166 0.72
clickbench_q01/datafusion:parquet 🚀 20373758 23342812 0.87
clickbench_q02/datafusion:parquet 57670359 61131204 0.94
clickbench_q03/datafusion:parquet 🚀 43894572 51606696 0.85
clickbench_q04/datafusion:parquet 🚀 347994396 409834526 0.85
clickbench_q05/datafusion:parquet 392484751 408633800 0.96
clickbench_q06/datafusion:parquet 1802929 1914120 0.94
clickbench_q07/datafusion:parquet 25897689 27145267 0.95
clickbench_q08/datafusion:parquet 🚀 423576022 477135502 0.89
clickbench_q09/datafusion:parquet 🚀 660958847 747986736 0.88
clickbench_q10/datafusion:parquet 🚀 112393879 129955615 0.86
clickbench_q11/datafusion:parquet 🚀 137754193 153159200 0.90
clickbench_q12/datafusion:parquet 369590078 404646725 0.91
clickbench_q13/datafusion:parquet 🚀 518324185 587271378 0.88
clickbench_q14/datafusion:parquet 🚀 361940646 410514014 0.88
clickbench_q15/datafusion:parquet 🚀 396225326 463439556 0.85
clickbench_q16/datafusion:parquet 🚀 713312734 838524311 0.85
clickbench_q17/datafusion:parquet 🚀 702743530 803649306 0.87
clickbench_q18/datafusion:parquet 🚀 1458051704 1725019643 0.85
clickbench_q19/datafusion:parquet 🚀 34576181 39248433 0.88
clickbench_q20/datafusion:parquet 622276385 681702989 0.91
clickbench_q21/datafusion:parquet 670870817 733069911 0.92
clickbench_q22/datafusion:parquet 1001743370 1054521396 0.95
clickbench_q23/datafusion:parquet 🚀 3712077295 4303504493 0.86
clickbench_q24/datafusion:parquet 91349907 94628452 0.97
clickbench_q25/datafusion:parquet 141747931 152091446 0.93
clickbench_q26/datafusion:parquet 95373099 92906215 1.03
clickbench_q27/datafusion:parquet 1066140307 1144960088 0.93
clickbench_q28/datafusion:parquet 6647323074 7042468768 0.94
clickbench_q29/datafusion:parquet 249037487 254409361 0.98
clickbench_q30/datafusion:parquet 🚀 367706297 419993896 0.88
clickbench_q31/datafusion:parquet 🚀 394764915 449692200 0.88
clickbench_q32/datafusion:parquet 1330521375 1439021089 0.92
clickbench_q33/datafusion:parquet 🚀 1563070704 1791576911 0.87
clickbench_q34/datafusion:parquet 🚀 1549369442 1778338172 0.87
clickbench_q35/datafusion:parquet 🚀 548743349 611875037 0.90
clickbench_q36/datafusion:parquet 154558643 167596551 0.92
clickbench_q37/datafusion:parquet 🚀 60560368 68509703 0.88
clickbench_q38/datafusion:parquet 90737141 100506407 0.90
clickbench_q39/datafusion:parquet 288023821 301842555 0.95
clickbench_q40/datafusion:parquet 34074029 36821786 0.93
clickbench_q41/datafusion:parquet 29349623 32382233 0.91
clickbench_q42/datafusion:parquet 32097771 34810127 0.92
duckdb / vortex-file-compressed (0.894x ✅, 20↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚀 5831145 6988457 0.83
clickbench_q01/duckdb:vortex-file-compressed 14325772 15742596 0.91
clickbench_q02/duckdb:vortex-file-compressed 24456452 26268839 0.93
clickbench_q03/duckdb:vortex-file-compressed 30686592 32651014 0.94
clickbench_q04/duckdb:vortex-file-compressed 169809307 186899362 0.91
clickbench_q05/duckdb:vortex-file-compressed 🚀 199404459 234338200 0.85
clickbench_q06/duckdb:vortex-file-compressed 🚀 18368043 21807066 0.84
clickbench_q07/duckdb:vortex-file-compressed 15922587 17666387 0.90
clickbench_q08/duckdb:vortex-file-compressed 🚀 260804110 293308324 0.89
clickbench_q09/duckdb:vortex-file-compressed 380504807 408173856 0.93
clickbench_q10/duckdb:vortex-file-compressed 75629573 81676011 0.93
clickbench_q11/duckdb:vortex-file-compressed 85830737 91970419 0.93
clickbench_q12/duckdb:vortex-file-compressed 🚀 215001666 255474184 0.84
clickbench_q13/duckdb:vortex-file-compressed 🚀 437585883 513754743 0.85
clickbench_q14/duckdb:vortex-file-compressed 🚀 242556594 279845484 0.87
clickbench_q15/duckdb:vortex-file-compressed 🚀 208994504 248804187 0.84
clickbench_q16/duckdb:vortex-file-compressed 736936905 800262360 0.92
clickbench_q17/duckdb:vortex-file-compressed 🚀 553474643 669356153 0.83
clickbench_q18/duckdb:vortex-file-compressed 1246918992 1356347565 0.92
clickbench_q19/duckdb:vortex-file-compressed 21935646 24144345 0.91
clickbench_q20/duckdb:vortex-file-compressed 🚀 390634725 457983792 0.85
clickbench_q21/duckdb:vortex-file-compressed 🚀 417160744 481774960 0.87
clickbench_q22/duckdb:vortex-file-compressed 702979065 667354867 1.05
clickbench_q23/duckdb:vortex-file-compressed 🚀 1586026207 2506791322 0.63
clickbench_q24/duckdb:vortex-file-compressed 53396403 57106533 0.94
clickbench_q25/duckdb:vortex-file-compressed 77673435 78417082 0.99
clickbench_q26/duckdb:vortex-file-compressed 44174685 45992650 0.96
clickbench_q27/duckdb:vortex-file-compressed 🚀 514186590 579964937 0.89
clickbench_q28/duckdb:vortex-file-compressed 3008394946 3163231090 0.95
clickbench_q29/duckdb:vortex-file-compressed 🚀 28167551 31635181 0.89
clickbench_q30/duckdb:vortex-file-compressed 185974592 206222626 0.90
clickbench_q31/duckdb:vortex-file-compressed 🚀 263998018 306400102 0.86
clickbench_q32/duckdb:vortex-file-compressed 1354437996 1434600597 0.94
clickbench_q33/duckdb:vortex-file-compressed 1643350334 1701559611 0.97
clickbench_q34/duckdb:vortex-file-compressed 1730848978 1858267802 0.93
clickbench_q35/duckdb:vortex-file-compressed 371630948 395689935 0.94
clickbench_q36/duckdb:vortex-file-compressed 🚀 30659664 34093401 0.90
clickbench_q37/duckdb:vortex-file-compressed 🚀 22521239 26237054 0.86
clickbench_q38/duckdb:vortex-file-compressed 24884575 26830420 0.93
clickbench_q39/duckdb:vortex-file-compressed 44647430 48591680 0.92
clickbench_q40/duckdb:vortex-file-compressed 🚀 22010688 25196651 0.87
clickbench_q41/duckdb:vortex-file-compressed 🚀 21628807 25118482 0.86
clickbench_q42/duckdb:vortex-file-compressed 🚀 22693999 26054987 0.87
duckdb / parquet (0.934x ➖, 2↑ 0↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚀 225767856 278903150 0.81
clickbench_q01/duckdb:parquet 50283039 53302485 0.94
clickbench_q02/duckdb:parquet 65875805 71212617 0.93
clickbench_q03/duckdb:parquet 64035643 69769256 0.92
clickbench_q04/duckdb:parquet 207198388 223423761 0.93
clickbench_q05/duckdb:parquet 281860026 310216108 0.91
clickbench_q06/duckdb:parquet 61475643 64790685 0.95
clickbench_q07/duckdb:parquet 52725297 54681957 0.96
clickbench_q08/duckdb:parquet 270358295 291334535 0.93
clickbench_q09/duckdb:parquet 398756468 422694770 0.94
clickbench_q10/duckdb:parquet 95744137 102739053 0.93
clickbench_q11/duckdb:parquet 110136310 115406901 0.95
clickbench_q12/duckdb:parquet 294666830 318369457 0.93
clickbench_q13/duckdb:parquet 521900605 556551212 0.94
clickbench_q14/duckdb:parquet 335435123 353497604 0.95
clickbench_q15/duckdb:parquet 242466466 265728116 0.91
clickbench_q16/duckdb:parquet 615615325 668055375 0.92
clickbench_q17/duckdb:parquet 521235742 558976535 0.93
clickbench_q18/duckdb:parquet 1062303907 1164904321 0.91
clickbench_q19/duckdb:parquet 48866215 52400455 0.93
clickbench_q20/duckdb:parquet 435917476 466323079 0.93
clickbench_q21/duckdb:parquet 563025009 587491419 0.96
clickbench_q22/duckdb:parquet 929578551 970644715 0.96
clickbench_q23/duckdb:parquet 314474892 331653767 0.95
clickbench_q24/duckdb:parquet 78493230 84084953 0.93
clickbench_q25/duckdb:parquet 141800676 144655846 0.98
clickbench_q26/duckdb:parquet 52644209 55958364 0.94
clickbench_q27/duckdb:parquet 650478786 680803108 0.96
clickbench_q28/duckdb:parquet 4854187977 5076461250 0.96
clickbench_q29/duckdb:parquet 61770862 65069954 0.95
clickbench_q30/duckdb:parquet 308459934 327441541 0.94
clickbench_q31/duckdb:parquet 349588562 374514043 0.93
clickbench_q32/duckdb:parquet 1201688044 1294044616 0.93
clickbench_q33/duckdb:parquet 🚀 1252586921 1443430486 0.87
clickbench_q34/duckdb:parquet 1325246691 1460167428 0.91
clickbench_q35/duckdb:parquet 354607491 376608539 0.94
clickbench_q36/duckdb:parquet 64592452 66940908 0.96
clickbench_q37/duckdb:parquet 54126470 56641747 0.96
clickbench_q38/duckdb:parquet 59183285 62296098 0.95
clickbench_q39/duckdb:parquet 102172630 104759073 0.98
clickbench_q40/duckdb:parquet 56062386 59530522 0.94
clickbench_q41/duckdb:parquet 59001216 62843396 0.94
clickbench_q42/duckdb:parquet 49134331 53724100 0.91
duckdb / duckdb (0.953x ➖, 4↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17254197 18607421 0.93
clickbench_q01/duckdb:duckdb 33222013 34653009 0.96
clickbench_q02/duckdb:duckdb 45362617 46024155 0.99
clickbench_q03/duckdb:duckdb 46927933 49268786 0.95
clickbench_q04/duckdb:duckdb 222641418 231092127 0.96
clickbench_q05/duckdb:duckdb 333857592 340931234 0.98
clickbench_q06/duckdb:duckdb 35273025 36550876 0.97
clickbench_q07/duckdb:duckdb 35682959 36430178 0.98
clickbench_q08/duckdb:duckdb 319400970 319597107 1.00
clickbench_q09/duckdb:duckdb 471315359 493261256 0.96
clickbench_q10/duckdb:duckdb 97828938 102598174 0.95
clickbench_q11/duckdb:duckdb 108091258 111136693 0.97
clickbench_q12/duckdb:duckdb 314415433 318119101 0.99
clickbench_q13/duckdb:duckdb 542920965 577137980 0.94
clickbench_q14/duckdb:duckdb 354825117 365608267 0.97
clickbench_q15/duckdb:duckdb 271945665 273553677 0.99
clickbench_q16/duckdb:duckdb 688930793 729748580 0.94
clickbench_q17/duckdb:duckdb 590855367 628618813 0.94
clickbench_q18/duckdb:duckdb 1277279339 1375834846 0.93
clickbench_q19/duckdb:duckdb 35033836 36025506 0.97
clickbench_q20/duckdb:duckdb 🚨 1053877755 933340325 1.13
clickbench_q21/duckdb:duckdb 1093650965 1063281515 1.03
clickbench_q22/duckdb:duckdb 1110364806 1158932809 0.96
clickbench_q23/duckdb:duckdb 251365538 268863460 0.93
clickbench_q24/duckdb:duckdb 61168955 64830014 0.94
clickbench_q25/duckdb:duckdb 124250369 126211200 0.98
clickbench_q26/duckdb:duckdb 56871096 61494262 0.92
clickbench_q27/duckdb:duckdb 1033123143 1071906837 0.96
clickbench_q28/duckdb:duckdb 4618971489 4858528737 0.95
clickbench_q29/duckdb:duckdb 48574709 49735668 0.98
clickbench_q30/duckdb:duckdb 301209006 315112744 0.96
clickbench_q31/duckdb:duckdb 427757354 456967638 0.94
clickbench_q32/duckdb:duckdb 🚀 1483742478 1772044197 0.84
clickbench_q33/duckdb:duckdb 🚀 1990994641 2356045142 0.85
clickbench_q34/duckdb:duckdb 🚀 2010229875 2415585203 0.83
clickbench_q35/duckdb:duckdb 265439604 279121121 0.95
clickbench_q36/duckdb:duckdb 40631335 43587527 0.93
clickbench_q37/duckdb:duckdb 31472364 32405077 0.97
clickbench_q38/duckdb:duckdb 31099378 32683949 0.95
clickbench_q39/duckdb:duckdb 🚀 62939220 72415820 0.87
clickbench_q40/duckdb:duckdb 31536360 33117337 0.95
clickbench_q41/duckdb:duckdb 30743524 31205235 0.99
clickbench_q42/duckdb:duckdb 31533077 33317300 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -6.3% -23.5% +22.5% +571.2% ➖ noise
0 duckdb:duckdb -7.3% -23.5% +21.3% +247.9% ➖ noise
0 duckdb:vortex-file-compressed -16.6% -23.5% +9.1% +295.7% ➖ noise
1 datafusion:vortex-file-compressed -8.5% -9.3% +0.8% +33.6% ➖ noise
1 duckdb:duckdb -4.1% -9.3% +5.7% +59.6% ➖ noise
1 duckdb:vortex-file-compressed -9.0% -9.3% +0.3% +19.6% ➖ noise
2 datafusion:vortex-file-compressed -10.0% -6.6% -3.6% +28.3% ➖ noise
2 duckdb:duckdb -1.4% -6.6% +5.5% +21.8% ➖ noise
2 duckdb:vortex-file-compressed -6.9% -6.6% -0.3% +12.7% ➖ noise
3 datafusion:vortex-file-compressed -14.6% -11.6% -3.3% +144.1% ➖ noise
3 duckdb:duckdb -4.8% -11.6% +7.8% +55.6% ➖ noise
3 duckdb:vortex-file-compressed -6.0% -11.6% +6.4% +28.9% ➖ noise
4 datafusion:vortex-file-compressed -16.2% -11.3% -5.6% +10.9% ➖ noise
4 duckdb:duckdb -3.7% -11.3% +8.6% +10.9% ➖ noise
4 duckdb:vortex-file-compressed -9.1% -11.3% +2.4% +10.9% ➖ noise
5 datafusion:vortex-file-compressed -11.9% -6.6% -5.7% +10.9% ➖ noise
5 duckdb:duckdb -2.1% -6.6% +4.8% +10.9% ➖ noise
5 duckdb:vortex-file-compressed -14.9% -6.6% -8.9% +10.9% ➖ noise
6 datafusion:vortex-file-compressed -12.9% -5.5% -7.9% +41.6% ➖ noise
6 duckdb:duckdb -3.5% -5.5% +2.1% +27.1% ➖ noise
6 duckdb:vortex-file-compressed -15.8% -5.5% -10.9% +18.1% ➖ noise
7 datafusion:vortex-file-compressed -7.6% -4.1% -3.6% +10.9% ➖ noise
7 duckdb:duckdb -2.1% -4.1% +2.1% +10.9% ➖ noise
7 duckdb:vortex-file-compressed -9.9% -4.1% -6.0% +10.9% ➖ noise
8 datafusion:vortex-file-compressed -16.4% -9.2% -7.9% +10.9% ➖ noise
8 duckdb:duckdb -0.1% -9.2% +10.1% +10.9% ➖ noise
8 duckdb:vortex-file-compressed -11.1% -9.2% -2.0% +10.9% ➖ noise
9 datafusion:vortex-file-compressed -11.4% -8.7% -3.0% +10.9% ➖ noise
9 duckdb:duckdb -4.4% -8.7% +4.7% +10.9% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -8.7% +2.1% +10.9% ➖ noise
10 datafusion:vortex-file-compressed -8.0% -10.2% +2.5% +12.4% ➖ noise
10 duckdb:duckdb -4.6% -10.2% +6.2% +10.9% ➖ noise
10 duckdb:vortex-file-compressed -7.4% -10.2% +3.1% +10.9% ➖ noise
11 datafusion:vortex-file-compressed -17.8% -7.4% -11.3% +10.9% ✅ faster
11 duckdb:duckdb -2.7% -7.4% +5.0% +10.9% ➖ noise
11 duckdb:vortex-file-compressed -6.7% -7.4% +0.7% +10.9% ➖ noise
12 datafusion:vortex-file-compressed -10.7% -8.1% -2.9% +10.9% ➖ noise
12 duckdb:duckdb -1.2% -8.1% +7.5% +10.9% ➖ noise
12 duckdb:vortex-file-compressed -15.8% -8.1% -8.5% +10.9% ➖ noise
13 datafusion:vortex-file-compressed -15.1% -9.0% -6.7% +10.9% ➖ noise
13 duckdb:duckdb -5.9% -9.0% +3.4% +10.9% ➖ noise
13 duckdb:vortex-file-compressed -14.8% -9.0% -6.4% +10.9% ➖ noise
14 datafusion:vortex-file-compressed -16.8% -8.5% -9.1% +10.9% ➖ noise
14 duckdb:duckdb -2.9% -8.5% +6.1% +10.9% ➖ noise
14 duckdb:vortex-file-compressed -13.3% -8.5% -5.2% +14.2% ➖ noise
15 datafusion:vortex-file-compressed -17.5% -11.7% -6.6% +10.9% ➖ noise
15 duckdb:duckdb -0.6% -11.7% +12.6% +10.9% 🚨 regression
15 duckdb:vortex-file-compressed -16.0% -11.7% -4.9% +10.9% ➖ noise
16 datafusion:vortex-file-compressed -15.9% -11.5% -5.0% +10.9% ➖ noise
16 duckdb:duckdb -5.6% -11.5% +6.6% +10.9% ➖ noise
16 duckdb:vortex-file-compressed -7.9% -11.5% +4.0% +17.2% ➖ noise
17 datafusion:vortex-file-compressed -16.4% -9.7% -7.5% +10.9% ➖ noise
17 duckdb:duckdb -6.0% -9.7% +4.1% +10.9% ➖ noise
17 duckdb:vortex-file-compressed -17.3% -9.7% -8.4% +13.4% ➖ noise
18 datafusion:vortex-file-compressed -14.2% -12.2% -2.3% +10.9% ➖ noise
18 duckdb:duckdb -7.2% -12.2% +5.7% +10.9% ➖ noise
18 duckdb:vortex-file-compressed -8.1% -12.2% +4.7% +10.9% ➖ noise
19 datafusion:vortex-file-compressed -7.5% -9.4% +2.1% +18.4% ➖ noise
19 duckdb:duckdb -2.8% -9.4% +7.3% +10.9% ➖ noise
19 duckdb:vortex-file-compressed -9.1% -9.4% +0.2% +29.8% ➖ noise
20 datafusion:vortex-file-compressed -3.0% -7.6% +5.0% +174.3% ➖ noise
20 duckdb:duckdb +12.9% -7.6% +22.2% +25.2% ➖ noise
20 duckdb:vortex-file-compressed -14.7% -7.6% -7.7% +10.9% ➖ noise
21 datafusion:vortex-file-compressed -14.5% -6.3% -8.7% +10.9% ➖ noise
21 duckdb:duckdb +2.9% -6.3% +9.8% +13.5% ➖ noise
21 duckdb:vortex-file-compressed -13.4% -6.3% -7.5% +10.9% ➖ noise
22 datafusion:vortex-file-compressed -12.6% -4.6% -8.4% +10.9% ➖ noise
22 duckdb:duckdb -4.2% -4.6% +0.4% +13.6% ➖ noise
22 duckdb:vortex-file-compressed +5.3% -4.6% +10.4% +21.9% ➖ noise
23 datafusion:vortex-file-compressed -11.3% -9.6% -1.9% +35.2% ➖ noise
23 duckdb:duckdb -6.5% -9.6% +3.4% +10.9% ➖ noise
23 duckdb:vortex-file-compressed -36.7% -9.6% -30.0% +10.9% ✅ faster
24 datafusion:vortex-file-compressed -18.4% -5.1% -14.1% +15.6% ✅ faster
24 duckdb:duckdb -5.6% -5.1% -0.6% +10.9% ➖ noise
24 duckdb:vortex-file-compressed -6.5% -5.1% -1.5% +22.6% ➖ noise
25 datafusion:vortex-file-compressed -8.4% -4.4% -4.1% +12.6% ➖ noise
25 duckdb:duckdb -1.6% -4.4% +3.0% +10.9% ➖ noise
25 duckdb:vortex-file-compressed -0.9% -4.4% +3.6% +18.3% ➖ noise
26 datafusion:vortex-file-compressed -25.2% -1.7% -23.8% +16.7% ✅ faster
26 duckdb:duckdb -7.5% -1.7% -5.9% +14.9% ➖ noise
26 duckdb:vortex-file-compressed -4.0% -1.7% -2.3% +20.9% ➖ noise
27 datafusion:vortex-file-compressed -9.7% -5.7% -4.2% +10.9% ➖ noise
27 duckdb:duckdb -3.6% -5.7% +2.2% +10.9% ➖ noise
27 duckdb:vortex-file-compressed -11.3% -5.7% -6.0% +10.9% ➖ noise
28 datafusion:vortex-file-compressed -5.3% -5.0% -0.3% +10.9% ➖ noise
28 duckdb:duckdb -4.9% -5.0% +0.1% +10.9% ➖ noise
28 duckdb:vortex-file-compressed -4.9% -5.0% +0.1% +10.9% ➖ noise
29 datafusion:vortex-file-compressed -2.8% -3.6% +0.8% +11.4% ➖ noise
29 duckdb:duckdb -2.3% -3.6% +1.3% +10.9% ➖ noise
29 duckdb:vortex-file-compressed -11.0% -3.6% -7.6% +13.5% ➖ noise
30 datafusion:vortex-file-compressed -14.6% -9.2% -5.9% +10.9% ➖ noise
30 duckdb:duckdb -4.4% -9.2% +5.3% +10.9% ➖ noise
30 duckdb:vortex-file-compressed -9.8% -9.2% -0.7% +10.9% ➖ noise
31 datafusion:vortex-file-compressed -14.4% -9.5% -5.4% +10.9% ➖ noise
31 duckdb:duckdb -6.4% -9.5% +3.4% +10.9% ➖ noise
31 duckdb:vortex-file-compressed -13.8% -9.5% -4.8% +10.9% ➖ noise
32 datafusion:vortex-file-compressed -17.4% -7.3% -10.8% +24.7% ➖ noise
32 duckdb:duckdb -16.3% -7.3% -9.6% +10.9% ➖ noise
32 duckdb:vortex-file-compressed -5.6% -7.3% +1.9% +10.9% ➖ noise
33 datafusion:vortex-file-compressed -17.7% -13.0% -5.4% +12.7% ➖ noise
33 duckdb:duckdb -15.5% -13.0% -2.9% +10.9% ➖ noise
33 duckdb:vortex-file-compressed -3.4% -13.0% +11.0% +10.9% 🚨 regression
34 datafusion:vortex-file-compressed -15.5% -11.1% -5.0% +10.9% ➖ noise
34 duckdb:duckdb -16.8% -11.1% -6.4% +10.9% ➖ noise
34 duckdb:vortex-file-compressed -6.9% -11.1% +4.7% +10.9% ➖ noise
35 datafusion:vortex-file-compressed -9.2% -8.1% -1.2% +14.3% ➖ noise
35 duckdb:duckdb -4.9% -8.1% +3.5% +10.9% ➖ noise
35 duckdb:vortex-file-compressed -6.1% -8.1% +2.2% +10.9% ➖ noise
36 datafusion:vortex-file-compressed -2.7% -5.7% +3.2% +10.9% ➖ noise
36 duckdb:duckdb -6.8% -5.7% -1.2% +10.9% ➖ noise
36 duckdb:vortex-file-compressed -10.1% -5.7% -4.7% +10.9% ➖ noise
37 datafusion:vortex-file-compressed -4.7% -8.1% +3.7% +12.8% ➖ noise
37 duckdb:duckdb -2.9% -8.1% +5.7% +13.8% ➖ noise
37 duckdb:vortex-file-compressed -14.2% -8.1% -6.6% +10.9% ➖ noise
38 datafusion:vortex-file-compressed -11.2% -7.4% -4.2% +10.9% ➖ noise
38 duckdb:duckdb -4.8% -7.4% +2.7% +10.9% ➖ noise
38 duckdb:vortex-file-compressed -7.3% -7.4% +0.1% +11.1% ➖ noise
39 datafusion:vortex-file-compressed -7.1% -3.5% -3.7% +10.9% ➖ noise
39 duckdb:duckdb -13.1% -3.5% -9.9% +19.2% ➖ noise
39 duckdb:vortex-file-compressed -8.1% -3.5% -4.8% +10.9% ➖ noise
40 datafusion:vortex-file-compressed -5.4% -6.6% +1.4% +13.2% ➖ noise
40 duckdb:duckdb -4.8% -6.6% +2.0% +10.9% ➖ noise
40 duckdb:vortex-file-compressed -12.6% -6.6% -6.4% +10.9% ➖ noise
41 datafusion:vortex-file-compressed -11.7% -7.8% -4.3% +10.9% ➖ noise
41 duckdb:duckdb -1.5% -7.8% +6.8% +10.9% ➖ noise
41 duckdb:vortex-file-compressed -13.9% -7.8% -6.7% +11.1% ➖ noise
42 datafusion:vortex-file-compressed -7.3% -8.2% +0.9% +10.9% ➖ noise
42 duckdb:duckdb -5.4% -8.2% +3.1% +10.9% ➖ noise
42 duckdb:vortex-file-compressed -12.9% -8.2% -5.2% +12.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +7.5%
Vortex (geomean): 1.201x ➖
Parquet (geomean): 1.116x ➖
Shifts: Parquet (control) +11.6% · Median polish +11.7%


datafusion / vortex-file-compressed (1.335x ❌, 1↑ 12↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 721060778 1138334875 0.63
tpch_q02/datafusion:vortex-file-compressed 882689490 1014740963 0.87
tpch_q03/datafusion:vortex-file-compressed 1028728642 1456520553 0.71
tpch_q04/datafusion:vortex-file-compressed 731384395 614386206 1.19
tpch_q05/datafusion:vortex-file-compressed 1453710031 1131060655 1.29
tpch_q06/datafusion:vortex-file-compressed 796957989 700291220 1.14
tpch_q07/datafusion:vortex-file-compressed 🚨 1993948841 1289721862 1.55
tpch_q08/datafusion:vortex-file-compressed 🚨 3283001985 1447344680 2.27
tpch_q09/datafusion:vortex-file-compressed 1727340547 1359670319 1.27
tpch_q10/datafusion:vortex-file-compressed 🚨 1606278548 1165516379 1.38
tpch_q11/datafusion:vortex-file-compressed 🚨 1075744392 519630441 2.07
tpch_q12/datafusion:vortex-file-compressed 🚨 1947917814 1132458548 1.72
tpch_q13/datafusion:vortex-file-compressed 🚨 716226416 453397641 1.58
tpch_q14/datafusion:vortex-file-compressed 🚨 891642885 615092924 1.45
tpch_q15/datafusion:vortex-file-compressed 🚨 1916171109 1256954591 1.52
tpch_q16/datafusion:vortex-file-compressed 🚨 766533273 325430435 2.36
tpch_q17/datafusion:vortex-file-compressed 1495778689 1176658488 1.27
tpch_q18/datafusion:vortex-file-compressed 1495493935 1501451676 1.00
tpch_q19/datafusion:vortex-file-compressed 1477943282 1414722445 1.04
tpch_q20/datafusion:vortex-file-compressed 🚨 1957340800 1233255395 1.59
tpch_q21/datafusion:vortex-file-compressed 🚨 3051673856 2046548027 1.49
tpch_q22/datafusion:vortex-file-compressed 🚨 1151269966 763307710 1.51
datafusion / vortex-compact (1.406x ❌, 0↑ 15↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 815779070 698252597 1.17
tpch_q02/datafusion:vortex-compact 🚨 1382590666 755291415 1.83
tpch_q03/datafusion:vortex-compact 🚨 1646065756 1044832375 1.58
tpch_q04/datafusion:vortex-compact 🚨 1223284092 678777394 1.80
tpch_q05/datafusion:vortex-compact 1630090270 1430726935 1.14
tpch_q06/datafusion:vortex-compact 845156731 719967108 1.17
tpch_q07/datafusion:vortex-compact 🚨 1683611798 1190542688 1.41
tpch_q08/datafusion:vortex-compact 🚨 2161195073 1098555097 1.97
tpch_q09/datafusion:vortex-compact 🚨 2463393938 1801192426 1.37
tpch_q10/datafusion:vortex-compact 2077653990 2086044371 1.00
tpch_q11/datafusion:vortex-compact 🚨 1049568731 786718693 1.33
tpch_q12/datafusion:vortex-compact 🚨 1522322560 1156650994 1.32
tpch_q13/datafusion:vortex-compact 🚨 793115775 498819978 1.59
tpch_q14/datafusion:vortex-compact 🚨 1025456819 656899376 1.56
tpch_q15/datafusion:vortex-compact 🚨 2138501276 1361507444 1.57
tpch_q16/datafusion:vortex-compact 🚨 824679209 440889617 1.87
tpch_q17/datafusion:vortex-compact 1632884716 1512157571 1.08
tpch_q18/datafusion:vortex-compact 1275570079 1257675136 1.01
tpch_q19/datafusion:vortex-compact 🚨 1075752507 817294134 1.32
tpch_q20/datafusion:vortex-compact 1302102511 1052433086 1.24
tpch_q21/datafusion:vortex-compact 🚨 2423132059 1600970068 1.51
tpch_q22/datafusion:vortex-compact 🚨 1134524400 667869790 1.70
datafusion / parquet (1.075x ➖, 1↑ 6↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 1054646788 983656409 1.07
tpch_q02/datafusion:parquet 1733270795 1671853790 1.04
tpch_q03/datafusion:parquet 🚨 2052010969 1552454963 1.32
tpch_q04/datafusion:parquet 🚨 1186155386 770647109 1.54
tpch_q05/datafusion:parquet 2739874061 2529976041 1.08
tpch_q06/datafusion:parquet 1124408014 1180253738 0.95
tpch_q07/datafusion:parquet 2873826735 3450402172 0.83
tpch_q08/datafusion:parquet 🚨 3780702615 1816617873 2.08
tpch_q09/datafusion:parquet 🚨 3744923040 2063461616 1.81
tpch_q10/datafusion:parquet 4503459387 3485238481 1.29
tpch_q11/datafusion:parquet 🚨 1022483959 750393826 1.36
tpch_q12/datafusion:parquet 1422558440 1119065860 1.27
tpch_q13/datafusion:parquet 1159616640 1401049610 0.83
tpch_q14/datafusion:parquet 🚀 896992831 1469366648 0.61
tpch_q15/datafusion:parquet 2035933188 2152420004 0.95
tpch_q16/datafusion:parquet 867211472 756537633 1.15
tpch_q17/datafusion:parquet 1780128573 2034661288 0.87
tpch_q18/datafusion:parquet 🚨 2275446896 1644790061 1.38
tpch_q19/datafusion:parquet 1554808640 1751886362 0.89
tpch_q20/datafusion:parquet 2164305897 3039561005 0.71
tpch_q21/datafusion:parquet 2173931964 2183121471 1.00
tpch_q22/datafusion:parquet 983753345 1365464719 0.72
duckdb / vortex-file-compressed (1.049x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 708489921 663996429 1.07
tpch_q02/duckdb:vortex-file-compressed 1217663641 1328305669 0.92
tpch_q03/duckdb:vortex-file-compressed 1090780576 984467062 1.11
tpch_q04/duckdb:vortex-file-compressed 788378014 870702091 0.91
tpch_q05/duckdb:vortex-file-compressed 1267343653 1328025364 0.95
tpch_q06/duckdb:vortex-file-compressed 830775908 917244864 0.91
tpch_q07/duckdb:vortex-file-compressed 1162215380 1114275918 1.04
tpch_q08/duckdb:vortex-file-compressed 1695557070 1547074907 1.10
tpch_q09/duckdb:vortex-file-compressed 1924579325 1571073315 1.23
tpch_q10/duckdb:vortex-file-compressed 1217468317 1122989314 1.08
tpch_q11/duckdb:vortex-file-compressed 🚨 1069481083 779073786 1.37
tpch_q12/duckdb:vortex-file-compressed 800156957 871075691 0.92
tpch_q13/duckdb:vortex-file-compressed 1425678754 1629589575 0.87
tpch_q14/duckdb:vortex-file-compressed 868156178 1034673580 0.84
tpch_q15/duckdb:vortex-file-compressed 609239611 538126515 1.13
tpch_q16/duckdb:vortex-file-compressed 583108796 599886098 0.97
tpch_q17/duckdb:vortex-file-compressed 1090953795 1003882627 1.09
tpch_q18/duckdb:vortex-file-compressed 1177775290 922912685 1.28
tpch_q19/duckdb:vortex-file-compressed 926435840 752311720 1.23
tpch_q20/duckdb:vortex-file-compressed 1495508273 1490181606 1.00
tpch_q21/duckdb:vortex-file-compressed 2389221008 2192099590 1.09
tpch_q22/duckdb:vortex-file-compressed 802349866 684210837 1.17
duckdb / vortex-compact (1.055x ➖, 0↑ 1↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 850219139 623622486 1.36
tpch_q02/duckdb:vortex-compact 1232111438 1201676988 1.03
tpch_q03/duckdb:vortex-compact 1154560594 950756898 1.21
tpch_q04/duckdb:vortex-compact 680635913 639400894 1.06
tpch_q05/duckdb:vortex-compact 1123185368 1071391738 1.05
tpch_q06/duckdb:vortex-compact 716363508 884571191 0.81
tpch_q07/duckdb:vortex-compact 1239664975 1169458149 1.06
tpch_q08/duckdb:vortex-compact 1724202756 1344458374 1.28
tpch_q09/duckdb:vortex-compact 1497459201 1494441385 1.00
tpch_q10/duckdb:vortex-compact 1276432036 1086187935 1.18
tpch_q11/duckdb:vortex-compact 828951522 664244202 1.25
tpch_q12/duckdb:vortex-compact 702733507 792368268 0.89
tpch_q13/duckdb:vortex-compact 1076759988 1022766889 1.05
tpch_q14/duckdb:vortex-compact 818287995 901580153 0.91
tpch_q15/duckdb:vortex-compact 516875900 499843016 1.03
tpch_q16/duckdb:vortex-compact 487859922 408228938 1.20
tpch_q17/duckdb:vortex-compact 942201019 1138099754 0.83
tpch_q18/duckdb:vortex-compact 851481504 806813591 1.06
tpch_q19/duckdb:vortex-compact 824687886 744265310 1.11
tpch_q20/duckdb:vortex-compact 1186573991 1427844454 0.83
tpch_q21/duckdb:vortex-compact 1788584089 1764758857 1.01
tpch_q22/duckdb:vortex-compact 738330324 590174916 1.25
duckdb / parquet (1.159x ➖, 0↑ 5↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1405335498 1201902641 1.17
tpch_q02/duckdb:parquet 2005957121 1635435914 1.23
tpch_q03/duckdb:parquet 2992464432 2367023746 1.26
tpch_q04/duckdb:parquet 1486143661 1202241369 1.24
tpch_q05/duckdb:parquet 2426792676 2513416328 0.97
tpch_q06/duckdb:parquet 🚨 1238755289 649045934 1.91
tpch_q07/duckdb:parquet 2572398825 2191712730 1.17
tpch_q08/duckdb:parquet 3616970422 2990132610 1.21
tpch_q09/duckdb:parquet 2825770329 2359075896 1.20
tpch_q10/duckdb:parquet 4131660861 4304197343 0.96
tpch_q11/duckdb:parquet 🚨 1472615729 1121011662 1.31
tpch_q12/duckdb:parquet 1247849434 1405474122 0.89
tpch_q13/duckdb:parquet 1336460934 1201945187 1.11
tpch_q14/duckdb:parquet 🚨 1757235136 1312563984 1.34
tpch_q15/duckdb:parquet 1082966082 1135650954 0.95
tpch_q16/duckdb:parquet 🚨 1086430300 787397501 1.38
tpch_q17/duckdb:parquet 2039141251 1644904155 1.24
tpch_q18/duckdb:parquet 1895346484 1965262584 0.96
tpch_q19/duckdb:parquet 1924526256 2042718827 0.94
tpch_q20/duckdb:parquet 1898595822 1872306051 1.01
tpch_q21/duckdb:parquet 2290321630 2257324249 1.01
tpch_q22/duckdb:parquet 🚨 1511028667 1046107208 1.44
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +16.8% +12.0% +4.3% +113.6% ➖ noise
1 datafusion:vortex-file-compressed -36.7% +12.0% -43.4% +92.9% ➖ noise
1 duckdb:vortex-compact +36.3% +12.0% +21.8% +55.0% ➖ noise
1 duckdb:vortex-file-compressed +6.7% +12.0% -4.7% +59.0% ➖ noise
2 datafusion:vortex-compact +83.1% +12.8% +62.3% +71.6% ➖ noise
2 datafusion:vortex-file-compressed -13.0% +12.8% -22.9% +75.8% ➖ noise
2 duckdb:vortex-compact +2.5% +12.8% -9.1% +85.2% ➖ noise
2 duckdb:vortex-file-compressed -8.3% +12.8% -18.7% +68.4% ➖ noise
3 datafusion:vortex-compact +57.5% +29.3% +21.9% +61.2% ➖ noise
3 datafusion:vortex-file-compressed -29.4% +29.3% -45.4% +83.6% ➖ noise
3 duckdb:vortex-compact +21.4% +29.3% -6.1% +80.7% ➖ noise
3 duckdb:vortex-file-compressed +10.8% +29.3% -14.3% +92.0% ➖ noise
4 datafusion:vortex-compact +80.2% +37.9% +30.7% +78.2% ➖ noise
4 datafusion:vortex-file-compressed +19.0% +37.9% -13.7% +55.0% ➖ noise
4 duckdb:vortex-compact +6.4% +37.9% -22.8% +55.0% ➖ noise
4 duckdb:vortex-file-compressed -9.5% +37.9% -34.4% +55.0% ➖ noise
5 datafusion:vortex-compact +13.9% +2.3% +11.4% +55.0% ➖ noise
5 datafusion:vortex-file-compressed +28.5% +2.3% +25.7% +55.0% ➖ noise
5 duckdb:vortex-compact +4.8% +2.3% +2.5% +55.0% ➖ noise
5 duckdb:vortex-file-compressed -4.6% +2.3% -6.7% +55.0% ➖ noise
6 datafusion:vortex-compact +17.4% +34.8% -12.9% +55.0% ➖ noise
6 datafusion:vortex-file-compressed +13.8% +34.8% -15.6% +55.0% ➖ noise
6 duckdb:vortex-compact -19.0% +34.8% -39.9% +55.0% ✅ faster
6 duckdb:vortex-file-compressed -9.4% +34.8% -32.8% +55.0% ➖ noise
7 datafusion:vortex-compact +41.4% -1.1% +43.0% +55.0% ➖ noise
7 datafusion:vortex-file-compressed +54.6% -1.1% +56.4% +55.4% 🚨 regression
7 duckdb:vortex-compact +6.0% -1.1% +7.2% +55.0% ➖ noise
7 duckdb:vortex-file-compressed +4.3% -1.1% +5.5% +55.0% ➖ noise
8 datafusion:vortex-compact +96.7% +58.7% +24.0% +55.0% ➖ noise
8 datafusion:vortex-file-compressed +126.8% +58.7% +43.0% +70.3% ➖ noise
8 duckdb:vortex-compact +28.2% +58.7% -19.2% +55.0% ➖ noise
8 duckdb:vortex-file-compressed +9.6% +58.7% -30.9% +55.0% ➖ noise
9 datafusion:vortex-compact +36.8% +47.4% -7.2% +55.0% ➖ noise
9 datafusion:vortex-file-compressed +27.0% +47.4% -13.8% +55.0% ➖ noise
9 duckdb:vortex-compact +0.2% +47.4% -32.0% +55.0% ➖ noise
9 duckdb:vortex-file-compressed +22.5% +47.4% -16.9% +55.0% ➖ noise
10 datafusion:vortex-compact -0.4% +11.4% -10.6% +70.9% ➖ noise
10 datafusion:vortex-file-compressed +37.8% +11.4% +23.7% +55.0% ➖ noise
10 duckdb:vortex-compact +17.5% +11.4% +5.5% +55.0% ➖ noise
10 duckdb:vortex-file-compressed +8.4% +11.4% -2.7% +55.3% ➖ noise
11 datafusion:vortex-compact +33.4% +33.8% -0.3% +77.9% ➖ noise
11 datafusion:vortex-file-compressed +107.0% +33.8% +54.7% +55.0% ➖ noise
11 duckdb:vortex-compact +24.8% +33.8% -6.7% +55.0% ➖ noise
11 duckdb:vortex-file-compressed +37.3% +33.8% +2.6% +59.8% ➖ noise
12 datafusion:vortex-compact +31.6% +6.2% +23.9% +64.6% ➖ noise
12 datafusion:vortex-file-compressed +72.0% +6.2% +61.9% +61.6% 🚨 regression
12 duckdb:vortex-compact -11.3% +6.2% -16.5% +55.0% ➖ noise
12 duckdb:vortex-file-compressed -8.1% +6.2% -13.5% +61.4% ➖ noise
13 datafusion:vortex-compact +59.0% -4.1% +65.7% +108.1% ➖ noise
13 datafusion:vortex-file-compressed +58.0% -4.1% +64.7% +92.4% ➖ noise
13 duckdb:vortex-compact +5.3% -4.1% +9.7% +94.8% ➖ noise
13 duckdb:vortex-file-compressed -12.5% -4.1% -8.8% +83.1% ➖ noise
14 datafusion:vortex-compact +56.1% -9.6% +72.7% +58.8% 🚨 regression
14 datafusion:vortex-file-compressed +45.0% -9.6% +60.3% +56.5% 🚨 regression
14 duckdb:vortex-compact -9.2% -9.6% +0.4% +55.0% ➖ noise
14 duckdb:vortex-file-compressed -16.1% -9.6% -7.2% +55.0% ➖ noise
15 datafusion:vortex-compact +57.1% -5.0% +65.4% +55.0% 🚨 regression
15 datafusion:vortex-file-compressed +52.4% -5.0% +60.5% +55.0% 🚨 regression
15 duckdb:vortex-compact +3.4% -5.0% +8.9% +55.0% ➖ noise
15 duckdb:vortex-file-compressed +13.2% -5.0% +19.2% +55.0% ➖ noise
16 datafusion:vortex-compact +87.0% +25.8% +48.7% +65.2% ➖ noise
16 datafusion:vortex-file-compressed +135.5% +25.8% +87.3% +55.0% 🚨 regression
16 duckdb:vortex-compact +19.5% +25.8% -5.0% +69.3% ➖ noise
16 duckdb:vortex-file-compressed -2.8% +25.8% -22.7% +55.0% ➖ noise
17 datafusion:vortex-compact +8.0% +4.1% +3.7% +55.0% ➖ noise
17 datafusion:vortex-file-compressed +27.1% +4.1% +22.1% +55.0% ➖ noise
17 duckdb:vortex-compact -17.2% +4.1% -20.5% +55.0% ➖ noise
17 duckdb:vortex-file-compressed +8.7% +4.1% +4.3% +55.0% ➖ noise
18 datafusion:vortex-compact +1.4% +15.5% -12.2% +55.0% ➖ noise
18 datafusion:vortex-file-compressed -0.4% +15.5% -13.8% +55.0% ➖ noise
18 duckdb:vortex-compact +5.5% +15.5% -8.6% +55.0% ➖ noise
18 duckdb:vortex-file-compressed +27.6% +15.5% +10.5% +55.0% ➖ noise
19 datafusion:vortex-compact +31.6% -8.6% +43.9% +55.0% ➖ noise
19 datafusion:vortex-file-compressed +4.5% -8.6% +14.2% +55.0% ➖ noise
19 duckdb:vortex-compact +10.8% -8.6% +21.2% +55.0% ➖ noise
19 duckdb:vortex-file-compressed +23.1% -8.6% +34.7% +55.0% ➖ noise
20 datafusion:vortex-compact +23.7% -15.0% +45.6% +59.5% ➖ noise
20 datafusion:vortex-file-compressed +58.7% -15.0% +86.8% +70.7% 🚨 regression
20 duckdb:vortex-compact -16.9% -15.0% -2.2% +55.0% ➖ noise
20 duckdb:vortex-file-compressed +0.4% -15.0% +18.1% +55.0% ➖ noise
21 datafusion:vortex-compact +51.4% +0.5% +50.6% +55.0% ➖ noise
21 datafusion:vortex-file-compressed +49.1% +0.5% +48.3% +55.0% ➖ noise
21 duckdb:vortex-compact +1.4% +0.5% +0.8% +55.0% ➖ noise
21 duckdb:vortex-file-compressed +9.0% +0.5% +8.4% +55.0% ➖ noise
22 datafusion:vortex-compact +69.9% +2.0% +66.5% +63.6% 🚨 regression
22 datafusion:vortex-file-compressed +50.8% +2.0% +47.9% +76.9% ➖ noise
22 duckdb:vortex-compact +25.1% +2.0% +22.6% +74.1% ➖ noise
22 duckdb:vortex-file-compressed +17.3% +2.0% +15.0% +55.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 2, 2026

Benchmarks: Compression

Vortex (geomean): 1.092x ➖
Parquet (geomean): 1.062x ➖


unknown / unknown (1.083x ➖, 7↑ 24↓)
name PR 7d9fc3d (ns) base 38ab5af (ns) ratio (PR/base)
compress time/Arade 1302986067 1250718561 1.04
compress time/Bimbo 7958474051 7780782563 1.02
compress time/CMSprovider 3127939873 3119056942 1.00
compress time/Euro2016 448552052 455873367 0.98
compress time/Food 🚨 448844778 383792600 1.17
compress time/HashTags 862383099 838043498 1.03
compress time/TPC-H l_comment canonical 1386284998 1378389557 1.01
compress time/TPC-H l_comment chunked 🚀 1386806580 1549763028 0.89
compress time/taxi 746877442 762656261 0.98
compress time/wide table cols=100 chunks=1 rows=1000 12972139 13024444 1.00
compress time/wide table cols=100 chunks=50 rows=1000 🚨 13642417 12205708 1.12
compress time/wide table cols=1000 chunks=1 rows=1000 137103621 131842385 1.04
compress time/wide table cols=1000 chunks=50 rows=1000 129406866 129220218 1.00
compress time/wide table cols=10000 chunks=1 rows=1000 1296970071 1309055499 0.99
compress time/wide table cols=10000 chunks=50 rows=1000 1305129847 1269959822 1.03
decompress time/Arade 30127204 30850837 0.98
decompress time/Bimbo 🚨 133477379 110559290 1.21
decompress time/CMSprovider 🚨 100957953 87886687 1.15
decompress time/Euro2016 🚨 24750068 21000079 1.18
decompress time/Food 🚨 10457490 8317768 1.26
decompress time/HashTags 96551012 90790499 1.06
decompress time/TPC-H l_comment canonical 45045691 43638126 1.03
decompress time/TPC-H l_comment chunked 🚀 46284074 55868743 0.83
decompress time/taxi 19488707 19397017 1.00
decompress time/wide table cols=100 chunks=1 rows=1000 🚨 3055990 2709568 1.13
decompress time/wide table cols=100 chunks=50 rows=1000 🚨 2919469 2653364 1.10
decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 37286574 23318691 1.60
decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 36498845 23085642 1.58
decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 1516377476 235838221 6.43
decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 1505532802 338147448 4.45
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3286391909 3119564838 1.05
parquet_rs-zstd compress time/Bimbo 18047301263 18122180436 1.00
parquet_rs-zstd compress time/CMSprovider 8759675620 8024851057 1.09
parquet_rs-zstd compress time/Euro2016 1348217639 1440530914 0.94
parquet_rs-zstd compress time/Food 990608704 961550702 1.03
parquet_rs-zstd compress time/HashTags 2635564376 2673658807 0.99
parquet_rs-zstd compress time/TPC-H l_comment canonical 🚀 3347694121 3767546619 0.89
parquet_rs-zstd compress time/TPC-H l_comment chunked 3293811428 3108593866 1.06
parquet_rs-zstd compress time/taxi 1528951328 1564749998 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚨 8228752 7139530 1.15
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 7104834 6837127 1.04
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 99350367 97998545 1.01
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 91151542 94858502 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 1003874427 983451011 1.02
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 965637508 978676276 0.99
parquet_rs-zstd decompress time/Arade 680124508 655052493 1.04
parquet_rs-zstd decompress time/Bimbo 1823823528 1768678185 1.03
parquet_rs-zstd decompress time/CMSprovider 1990117003 1970732323 1.01
parquet_rs-zstd decompress time/Euro2016 389218835 390534254 1.00
parquet_rs-zstd decompress time/Food 238102616 241765514 0.98
parquet_rs-zstd decompress time/HashTags 681508690 698759053 0.98
parquet_rs-zstd decompress time/TPC-H l_comment canonical 🚀 577694018 673738563 0.86
parquet_rs-zstd decompress time/TPC-H l_comment chunked 587489314 571313723 1.03
parquet_rs-zstd decompress time/taxi 257671921 250079665 1.03
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2872201 2700494 1.06
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2791904 2711595 1.03
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 35435637 35084125 1.01
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 33128267 33344306 0.99
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 370235383 402696592 0.92
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 380712415 381183138 1.00
vortex-file-compressed size/Arade 143600332 143600332 1.00
vortex-file-compressed size/Bimbo 510400068 510400068 1.00
vortex-file-compressed size/CMSprovider 448304012 448304012 1.00
vortex-file-compressed size/Euro2016 164458756 164537724 1.00
vortex-file-compressed size/Food 44206912 44206912 1.00
vortex-file-compressed size/HashTags 195864476 195864476 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179481896 179481896 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179481896 179481896 1.00
vortex-file-compressed size/taxi 51040172 51040172 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.99
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.03
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 0.92
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.05
vortex:parquet-zstd ratio compress time/Food 🚨 0 0 1.14
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 🚨 0 0 1.13
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 🚀 0 0 0.84
vortex:parquet-zstd ratio compress time/taxi 0 0 1.00
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 🚀 1 1 0.86
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.08
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 0.97
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.04
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.94
vortex:parquet-zstd ratio decompress time/Bimbo 🚨 0 0 1.17
vortex:parquet-zstd ratio decompress time/CMSprovider 🚨 0 0 1.14
vortex:parquet-zstd ratio decompress time/Euro2016 🚨 0 0 1.18
vortex:parquet-zstd ratio decompress time/Food 🚨 0 0 1.28
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 🚨 0 0 1.20
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 🚀 0 0 0.81
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 1 1 1.06
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 1 0 1.07
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 🚨 1 0 1.58
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 🚨 1 0 1.59
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 🚨 4 0 6.99
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚨 3 0 4.46
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant