Skip to content

Implement compare/between for bitpacked arrays - improve performance by up to 2X#7279

Draft
AdamGS wants to merge 10 commits intodevelopfrom
adamg/bitpack-compare
Draft

Implement compare/between for bitpacked arrays - improve performance by up to 2X#7279
AdamGS wants to merge 10 commits intodevelopfrom
adamg/bitpack-compare

Conversation

@AdamGS
Copy link
Copy Markdown
Contributor

@AdamGS AdamGS commented Apr 3, 2026

After some iterations, this seems to improve performance in any case we actually measure. It does require merging and releasing spiraldb/fastlanes#125.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 3, 2026

Merging this PR will improve performance by ×2.5

⚡ 30 improved benchmarks
✅ 1092 untouched benchmarks
⏩ 1530 skipped benchmarks1

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation new_bp_prim_test_between[i64, 32768] 179.7 µs 103.1 µs +74.29%
Simulation old_bp_prim_test_between[i64, 16384] 215.4 µs 91.5 µs ×2.4
Simulation new_bp_prim_test_between[i16, 16384] 85.6 µs 59.4 µs +44.11%
Simulation old_bp_prim_test_between[i16, 2048] 111.8 µs 55.3 µs ×2
Simulation old_bp_prim_test_between[i16, 16384] 161 µs 99.8 µs +61.38%
Simulation old_bp_prim_test_between[i32, 2048] 115.2 µs 55.3 µs ×2.1
Simulation new_bp_prim_test_between[i16, 32768] 123.6 µs 81.4 µs +51.78%
Simulation old_alp_prim_test_between[f64, 32768] 351.9 µs 153 µs ×2.3
Simulation old_alp_prim_test_between[f64, 2048] 135.8 µs 68.9 µs +97.09%
Simulation new_bp_prim_test_between[i32, 2048] 56.7 µs 42.9 µs +32.11%
Simulation old_bp_prim_test_between[i32, 32768] 251.7 µs 140.6 µs +79.06%
Simulation old_bp_prim_test_between[i32, 16384] 173.9 µs 95.7 µs +81.78%
Simulation new_bp_prim_test_between[i16, 2048] 53.4 µs 40.3 µs +32.52%
Simulation new_alp_prim_test_between[f64, 16384] 159.1 µs 78.5 µs ×2
Simulation old_bp_prim_test_between[i16, 32768] 215.4 µs 150 µs +43.59%
Simulation new_bp_prim_test_between[i32, 16384] 104.6 µs 63.9 µs +63.56%
Simulation new_bp_prim_test_between[i64, 2048] 64.8 µs 46.3 µs +40.01%
Simulation old_alp_prim_test_between[f64, 16384] 239.7 µs 100.9 µs ×2.4
Simulation new_alp_prim_test_between[f32, 16384] 122.2 µs 74 µs +65.16%
Simulation old_alp_prim_test_between[f32, 32768] 272.9 µs 162.4 µs +68.08%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.


Comparing adamg/bitpack-compare (dbe5a37) with develop (16bbd12)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

@AdamGS AdamGS added the changelog/performance A performance improvement label Apr 3, 2026
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from 74732ef to 8cddde0 Compare April 3, 2026 16:45
@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟡 In Progress dbe5a37 1 Explore Profiling Data
Previous Runs (4)
Status Commit Job Attempt Link
🟢 Done db42e44 2 Explore Profiling Data
🟢 Done db42e44 1 Explore Profiling Data
🟢 Done 00d6bc4 1 Explore Profiling Data
🟢 Done abd15b8 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.992x ➖


datafusion / vortex-file-compressed (0.992x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 125614776 131949109 0.95
polarsignals_q01/datafusion:vortex-file-compressed 374223824 381953304 0.98
polarsignals_q02/datafusion:vortex-file-compressed 23093202 22837261 1.01
polarsignals_q03/datafusion:vortex-file-compressed 379979637 380282377 1.00
polarsignals_q04/datafusion:vortex-file-compressed 10863991 10580091 1.03
polarsignals_q05/datafusion:vortex-file-compressed 15327803 15209574 1.01
polarsignals_q06/datafusion:vortex-file-compressed 18559851 18612481 1.00
polarsignals_q07/datafusion:vortex-file-compressed 13225621 13415788 0.99
polarsignals_q08/datafusion:vortex-file-compressed 462744030 465256083 0.99
polarsignals_q09/datafusion:vortex-file-compressed 10178817 10497088 0.97

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.3%
Vortex (geomean): 1.025x ➖
Parquet (geomean): 1.008x ➖
Shifts: Parquet (control) +0.8% · Median polish +2.2%


datafusion / vortex-file-compressed (1.025x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 48669588 49293091 0.99
tpch_q02/datafusion:vortex-file-compressed 33117168 33168092 1.00
tpch_q03/datafusion:vortex-file-compressed 27591162 27721167 1.00
tpch_q04/datafusion:vortex-file-compressed 18842253 18437671 1.02
tpch_q05/datafusion:vortex-file-compressed 53993148 52803242 1.02
tpch_q06/datafusion:vortex-file-compressed 10188214 10853477 0.94
tpch_q07/datafusion:vortex-file-compressed 63551989 64142223 0.99
tpch_q08/datafusion:vortex-file-compressed 46553223 45272966 1.03
tpch_q09/datafusion:vortex-file-compressed 57572406 54679895 1.05
tpch_q10/datafusion:vortex-file-compressed 45904897 44068914 1.04
tpch_q11/datafusion:vortex-file-compressed 18604639 17506256 1.06
tpch_q12/datafusion:vortex-file-compressed 23272072 21881629 1.06
tpch_q13/datafusion:vortex-file-compressed 28614715 26983569 1.06
tpch_q14/datafusion:vortex-file-compressed 16238739 15406359 1.05
tpch_q15/datafusion:vortex-file-compressed 24889427 23279393 1.07
tpch_q16/datafusion:vortex-file-compressed 25074053 24655656 1.02
tpch_q17/datafusion:vortex-file-compressed 64007090 62935451 1.02
tpch_q18/datafusion:vortex-file-compressed 80536339 76670031 1.05
tpch_q19/datafusion:vortex-file-compressed 22907017 22209585 1.03
tpch_q20/datafusion:vortex-file-compressed 33944948 34154945 0.99
tpch_q21/datafusion:vortex-file-compressed 75176936 74133972 1.01
tpch_q22/datafusion:vortex-file-compressed 17007748 16072635 1.06
datafusion / vortex-compact (1.022x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57223932 56759660 1.01
tpch_q02/datafusion:vortex-compact 36323760 37091893 0.98
tpch_q03/datafusion:vortex-compact 31987003 30214629 1.06
tpch_q04/datafusion:vortex-compact 23559159 23405057 1.01
tpch_q05/datafusion:vortex-compact 56334275 55392861 1.02
tpch_q06/datafusion:vortex-compact 13054471 13136234 0.99
tpch_q07/datafusion:vortex-compact 71781893 68232484 1.05
tpch_q08/datafusion:vortex-compact 51351727 50240039 1.02
tpch_q09/datafusion:vortex-compact 62692019 60883871 1.03
tpch_q10/datafusion:vortex-compact 54871567 54251805 1.01
tpch_q11/datafusion:vortex-compact 20899171 19381804 1.08
tpch_q12/datafusion:vortex-compact 34659860 32607982 1.06
tpch_q13/datafusion:vortex-compact 36862943 35705588 1.03
tpch_q14/datafusion:vortex-compact 20517187 20920011 0.98
tpch_q15/datafusion:vortex-compact 34867868 34246176 1.02
tpch_q16/datafusion:vortex-compact 29874424 29670651 1.01
tpch_q17/datafusion:vortex-compact 70238032 69376116 1.01
tpch_q18/datafusion:vortex-compact 85735429 83774333 1.02
tpch_q19/datafusion:vortex-compact 33888741 32924330 1.03
tpch_q20/datafusion:vortex-compact 37956018 37361263 1.02
tpch_q21/datafusion:vortex-compact 88852556 86199400 1.03
tpch_q22/datafusion:vortex-compact 17320076 17069123 1.01
datafusion / parquet (1.024x ➖, 2↑ 2↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 131881085 93361286 1.41
tpch_q02/datafusion:parquet 70335525 69380514 1.01
tpch_q03/datafusion:parquet 78431788 79666807 0.98
tpch_q04/datafusion:parquet 48869955 47282609 1.03
tpch_q05/datafusion:parquet 102167600 102894881 0.99
tpch_q06/datafusion:parquet 34901058 33627262 1.04
tpch_q07/datafusion:parquet 115707714 112306852 1.03
tpch_q08/datafusion:parquet 🚀 94340691 107382241 0.88
tpch_q09/datafusion:parquet 136198495 136318168 1.00
tpch_q10/datafusion:parquet 122760679 121520993 1.01
tpch_q11/datafusion:parquet 48300857 47719851 1.01
tpch_q12/datafusion:parquet 🚨 94399019 79413897 1.19
tpch_q13/datafusion:parquet 211588960 223773724 0.95
tpch_q14/datafusion:parquet 53307353 50640041 1.05
tpch_q15/datafusion:parquet 66984864 63428696 1.06
tpch_q16/datafusion:parquet 51708103 50795886 1.02
tpch_q17/datafusion:parquet 141485953 133198471 1.06
tpch_q18/datafusion:parquet 175268867 168018398 1.04
tpch_q19/datafusion:parquet 🚀 71702175 85463134 0.84
tpch_q20/datafusion:parquet 78536850 72089652 1.09
tpch_q21/datafusion:parquet 146817710 150711683 0.97
tpch_q22/datafusion:parquet 34273873 35621198 0.96
datafusion / arrow (1.014x ➖, 0↑ 2↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 55587720 56036056 0.99
tpch_q02/datafusion:arrow 22245459 22277342 1.00
tpch_q03/datafusion:arrow 33404157 34943518 0.96
tpch_q04/datafusion:arrow 28019959 27703459 1.01
tpch_q05/datafusion:arrow 77840276 81948321 0.95
tpch_q06/datafusion:arrow 20572083 21636052 0.95
tpch_q07/datafusion:arrow 114928216 112914909 1.02
tpch_q08/datafusion:arrow 48680932 45904720 1.06
tpch_q09/datafusion:arrow 🚨 77163329 69542951 1.11
tpch_q10/datafusion:arrow 🚨 56487880 51132192 1.10
tpch_q11/datafusion:arrow 12334478 11230253 1.10
tpch_q12/datafusion:arrow 54878344 54013521 1.02
tpch_q13/datafusion:arrow 50657492 50341082 1.01
tpch_q14/datafusion:arrow 23464670 22716796 1.03
tpch_q15/datafusion:arrow 46148134 43806927 1.05
tpch_q16/datafusion:arrow 21885221 20215987 1.08
tpch_q17/datafusion:arrow 71330315 69379465 1.03
tpch_q18/datafusion:arrow 141635156 141591449 1.00
tpch_q19/datafusion:arrow 40322435 44668984 0.90
tpch_q20/datafusion:arrow 38164492 41739994 0.91
tpch_q21/datafusion:arrow 160498208 151610037 1.06
tpch_q22/datafusion:arrow 19862306 19691042 1.01
duckdb / vortex-file-compressed (1.028x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33724731 33610457 1.00
tpch_q02/duckdb:vortex-file-compressed 27088545 28374559 0.95
tpch_q03/duckdb:vortex-file-compressed 30027498 29078041 1.03
tpch_q04/duckdb:vortex-file-compressed 29479007 28636684 1.03
tpch_q05/duckdb:vortex-file-compressed 32977319 33286921 0.99
tpch_q06/duckdb:vortex-file-compressed 10920218 10113196 1.08
tpch_q07/duckdb:vortex-file-compressed 36984253 34955308 1.06
tpch_q08/duckdb:vortex-file-compressed 39681174 39132400 1.01
tpch_q09/duckdb:vortex-file-compressed 77840189 78763878 0.99
tpch_q10/duckdb:vortex-file-compressed 35839573 36929535 0.97
tpch_q11/duckdb:vortex-file-compressed 16917198 16022535 1.06
tpch_q12/duckdb:vortex-file-compressed 23132230 22496588 1.03
tpch_q13/duckdb:vortex-file-compressed 37975518 36942778 1.03
tpch_q14/duckdb:vortex-file-compressed 22273433 21835642 1.02
tpch_q15/duckdb:vortex-file-compressed 16439852 15969858 1.03
tpch_q16/duckdb:vortex-file-compressed 31321558 29242193 1.07
tpch_q17/duckdb:vortex-file-compressed 27170692 25065527 1.08
tpch_q18/duckdb:vortex-file-compressed 48044146 46025387 1.04
tpch_q19/duckdb:vortex-file-compressed 33453663 30954489 1.08
tpch_q20/duckdb:vortex-file-compressed 35317172 34702776 1.02
tpch_q21/duckdb:vortex-file-compressed 104267969 100788123 1.03
tpch_q22/duckdb:vortex-file-compressed 18376920 18142356 1.01
duckdb / vortex-compact (1.027x ➖, 0↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40401204 39498726 1.02
tpch_q02/duckdb:vortex-compact 🚨 40087953 35835777 1.12
tpch_q03/duckdb:vortex-compact 33707279 32950594 1.02
tpch_q04/duckdb:vortex-compact 33809427 34847228 0.97
tpch_q05/duckdb:vortex-compact 38854554 37999346 1.02
tpch_q06/duckdb:vortex-compact 15532503 14436788 1.08
tpch_q07/duckdb:vortex-compact 42933720 41428132 1.04
tpch_q08/duckdb:vortex-compact 46111989 44635618 1.03
tpch_q09/duckdb:vortex-compact 93148253 89793111 1.04
tpch_q10/duckdb:vortex-compact 42250658 40555684 1.04
tpch_q11/duckdb:vortex-compact 20376383 21137040 0.96
tpch_q12/duckdb:vortex-compact 37342686 36819545 1.01
tpch_q13/duckdb:vortex-compact 46803948 44971116 1.04
tpch_q14/duckdb:vortex-compact 31415972 29670496 1.06
tpch_q15/duckdb:vortex-compact 19327314 19166196 1.01
tpch_q16/duckdb:vortex-compact 35482493 35190004 1.01
tpch_q17/duckdb:vortex-compact 31820888 31207053 1.02
tpch_q18/duckdb:vortex-compact 52655654 50907171 1.03
tpch_q19/duckdb:vortex-compact 36431130 36023063 1.01
tpch_q20/duckdb:vortex-compact 44147622 44177484 1.00
tpch_q21/duckdb:vortex-compact 112814712 108839829 1.04
tpch_q22/duckdb:vortex-compact 20982996 20590024 1.02
duckdb / parquet (0.993x ➖, 3↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75539039 76054843 0.99
tpch_q02/duckdb:parquet 39789367 39648775 1.00
tpch_q03/duckdb:parquet 🚀 69526623 80638437 0.86
tpch_q04/duckdb:parquet 🚀 47715157 56367561 0.85
tpch_q05/duckdb:parquet 67572670 65733936 1.03
tpch_q06/duckdb:parquet 20440187 20312625 1.01
tpch_q07/duckdb:parquet 68254255 67284016 1.01
tpch_q08/duckdb:parquet 80188201 80422281 1.00
tpch_q09/duckdb:parquet 159498229 157523664 1.01
tpch_q10/duckdb:parquet 127161925 137771481 0.92
tpch_q11/duckdb:parquet 22505418 22256756 1.01
tpch_q12/duckdb:parquet 45263856 44598012 1.01
tpch_q13/duckdb:parquet 268054778 262022268 1.02
tpch_q14/duckdb:parquet 48806268 50039284 0.98
tpch_q15/duckdb:parquet 29088762 29570041 0.98
tpch_q16/duckdb:parquet 56862214 52988236 1.07
tpch_q17/duckdb:parquet 🚨 61513308 49098477 1.25
tpch_q18/duckdb:parquet 120609849 122209901 0.99
tpch_q19/duckdb:parquet 69162066 69154124 1.00
tpch_q20/duckdb:parquet 🚀 63458551 73773904 0.86
tpch_q21/duckdb:parquet 177595482 174040275 1.02
tpch_q22/duckdb:parquet 52727859 51589173 1.02
duckdb / duckdb (1.013x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15905809 16192478 0.98
tpch_q02/duckdb:duckdb 12586559 12032900 1.05
tpch_q03/duckdb:duckdb 19823441 19766942 1.00
tpch_q04/duckdb:duckdb 19066590 18985611 1.00
tpch_q05/duckdb:duckdb 19955774 18840913 1.06
tpch_q06/duckdb:duckdb 5353911 5287065 1.01
tpch_q07/duckdb:duckdb 23337267 23013596 1.01
tpch_q08/duckdb:duckdb 20639312 20556654 1.00
tpch_q09/duckdb:duckdb 52118354 52753473 0.99
tpch_q10/duckdb:duckdb 40690471 41604715 0.98
tpch_q11/duckdb:duckdb 5787472 5472456 1.06
tpch_q12/duckdb:duckdb 13773507 14142891 0.97
tpch_q13/duckdb:duckdb 36158029 38239745 0.95
tpch_q14/duckdb:duckdb 16585823 15692224 1.06
tpch_q15/duckdb:duckdb 11707512 11916975 0.98
tpch_q16/duckdb:duckdb 22307075 22160113 1.01
tpch_q17/duckdb:duckdb 13810721 13333247 1.04
tpch_q18/duckdb:duckdb 39075477 36673357 1.07
tpch_q19/duckdb:duckdb 26968701 25085996 1.08
tpch_q20/duckdb:duckdb 22148434 22290803 0.99
tpch_q21/duckdb:duckdb 57478535 57275150 1.00
tpch_q22/duckdb:duckdb 24715092 24291227 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.8% +18.4% -16.3% +33.9% ➖ noise
1 datafusion:vortex-compact +0.8% +18.4% -14.9% +29.3% ➖ noise
1 datafusion:vortex-file-compressed -1.3% +18.4% -16.6% +31.1% ➖ noise
1 duckdb:duckdb -1.8% +18.4% -17.1% +29.3% ➖ noise
1 duckdb:vortex-compact +2.3% +18.4% -13.6% +29.5% ➖ noise
1 duckdb:vortex-file-compressed +0.3% +18.4% -15.3% +28.7% ➖ noise
2 datafusion:arrow -0.1% +0.9% -1.0% +18.0% ➖ noise
2 datafusion:vortex-compact -2.1% +0.9% -2.9% +18.0% ➖ noise
2 datafusion:vortex-file-compressed -0.2% +0.9% -1.0% +18.0% ➖ noise
2 duckdb:duckdb +4.6% +0.9% +3.7% +18.0% ➖ noise
2 duckdb:vortex-compact +11.9% +0.9% +10.9% +18.0% ➖ noise
2 duckdb:vortex-file-compressed -4.5% +0.9% -5.4% +18.0% ➖ noise
3 datafusion:arrow -4.4% -7.9% +3.8% +18.0% ➖ noise
3 datafusion:vortex-compact +5.9% -7.9% +14.9% +18.0% ➖ noise
3 datafusion:vortex-file-compressed -0.5% -7.9% +8.0% +18.0% ➖ noise
3 duckdb:duckdb +0.3% -7.9% +8.8% +18.0% ➖ noise
3 duckdb:vortex-compact +2.3% -7.9% +11.0% +18.0% ➖ noise
3 duckdb:vortex-file-compressed +3.3% -7.9% +12.1% +18.0% ➖ noise
4 datafusion:arrow +1.1% -6.5% +8.1% +18.0% ➖ noise
4 datafusion:vortex-compact +0.7% -6.5% +7.6% +18.0% ➖ noise
4 datafusion:vortex-file-compressed +2.2% -6.5% +9.3% +18.0% ➖ noise
4 duckdb:duckdb +0.4% -6.5% +7.4% +18.0% ➖ noise
4 duckdb:vortex-compact -3.0% -6.5% +3.7% +18.0% ➖ noise
4 duckdb:vortex-file-compressed +2.9% -6.5% +10.1% +18.0% ➖ noise
5 datafusion:arrow -5.0% +1.0% -6.0% +18.0% ➖ noise
5 datafusion:vortex-compact +1.7% +1.0% +0.7% +18.0% ➖ noise
5 datafusion:vortex-file-compressed +2.3% +1.0% +1.2% +18.0% ➖ noise
5 duckdb:duckdb +5.9% +1.0% +4.8% +18.6% ➖ noise
5 duckdb:vortex-compact +2.3% +1.0% +1.2% +18.0% ➖ noise
5 duckdb:vortex-file-compressed -0.9% +1.0% -1.9% +18.0% ➖ noise
6 datafusion:arrow -4.9% +2.2% -7.0% +26.8% ➖ noise
6 datafusion:vortex-compact -0.6% +2.2% -2.8% +27.0% ➖ noise
6 datafusion:vortex-file-compressed -6.1% +2.2% -8.1% +28.8% ➖ noise
6 duckdb:duckdb +1.3% +2.2% -0.9% +28.7% ➖ noise
6 duckdb:vortex-compact +7.6% +2.2% +5.3% +27.8% ➖ noise
6 duckdb:vortex-file-compressed +8.0% +2.2% +5.7% +29.1% ➖ noise
7 datafusion:arrow +1.8% +2.2% -0.4% +18.0% ➖ noise
7 datafusion:vortex-compact +5.2% +2.2% +2.9% +18.0% ➖ noise
7 datafusion:vortex-file-compressed -0.9% +2.2% -3.1% +18.0% ➖ noise
7 duckdb:duckdb +1.4% +2.2% -0.8% +18.0% ➖ noise
7 duckdb:vortex-compact +3.6% +2.2% +1.4% +18.0% ➖ noise
7 duckdb:vortex-file-compressed +5.8% +2.2% +3.5% +18.0% ➖ noise
8 datafusion:arrow +6.0% -6.4% +13.3% +18.0% ➖ noise
8 datafusion:vortex-compact +2.2% -6.4% +9.2% +18.0% ➖ noise
8 datafusion:vortex-file-compressed +2.8% -6.4% +9.9% +18.0% ➖ noise
8 duckdb:duckdb +0.4% -6.4% +7.3% +18.0% ➖ noise
8 duckdb:vortex-compact +3.3% -6.4% +10.4% +18.0% ➖ noise
8 duckdb:vortex-file-compressed +1.4% -6.4% +8.3% +18.0% ➖ noise
9 datafusion:arrow +11.0% +0.6% +10.3% +18.0% ➖ noise
9 datafusion:vortex-compact +3.0% +0.6% +2.4% +18.0% ➖ noise
9 datafusion:vortex-file-compressed +5.3% +0.6% +4.7% +18.0% ➖ noise
9 duckdb:duckdb -1.2% +0.6% -1.8% +18.0% ➖ noise
9 duckdb:vortex-compact +3.7% +0.6% +3.1% +18.0% ➖ noise
9 duckdb:vortex-file-compressed -1.2% +0.6% -1.7% +18.0% ➖ noise
10 datafusion:arrow +10.5% -3.4% +14.4% +18.0% ➖ noise
10 datafusion:vortex-compact +1.1% -3.4% +4.7% +18.0% ➖ noise
10 datafusion:vortex-file-compressed +4.2% -3.4% +7.9% +18.0% ➖ noise
10 duckdb:duckdb -2.2% -3.4% +1.3% +18.0% ➖ noise
10 duckdb:vortex-compact +4.2% -3.4% +7.9% +18.0% ➖ noise
10 duckdb:vortex-file-compressed -3.0% -3.4% +0.5% +18.0% ➖ noise
11 datafusion:arrow +9.8% +1.2% +8.6% +18.0% ➖ noise
11 datafusion:vortex-compact +7.8% +1.2% +6.6% +18.0% ➖ noise
11 datafusion:vortex-file-compressed +6.3% +1.2% +5.0% +18.0% ➖ noise
11 duckdb:duckdb +5.8% +1.2% +4.5% +18.0% ➖ noise
11 duckdb:vortex-compact -3.6% +1.2% -4.7% +18.0% ➖ noise
11 duckdb:vortex-file-compressed +5.6% +1.2% +4.4% +18.0% ➖ noise
12 datafusion:arrow +1.6% +9.8% -7.5% +19.3% ➖ noise
12 datafusion:vortex-compact +6.3% +9.8% -3.2% +18.0% ➖ noise
12 datafusion:vortex-file-compressed +6.4% +9.8% -3.2% +18.0% ➖ noise
12 duckdb:duckdb -2.6% +9.8% -11.3% +18.0% ➖ noise
12 duckdb:vortex-compact +1.4% +9.8% -7.7% +18.0% ➖ noise
12 duckdb:vortex-file-compressed +2.8% +9.8% -6.4% +18.0% ➖ noise
13 datafusion:arrow +0.6% -1.6% +2.3% +18.0% ➖ noise
13 datafusion:vortex-compact +3.2% -1.6% +5.0% +18.0% ➖ noise
13 datafusion:vortex-file-compressed +6.0% -1.6% +7.8% +18.0% ➖ noise
13 duckdb:duckdb -5.4% -1.6% -3.9% +18.9% ➖ noise
13 duckdb:vortex-compact +4.1% -1.6% +5.8% +18.0% ➖ noise
13 duckdb:vortex-file-compressed +2.8% -1.6% +4.5% +18.0% ➖ noise
14 datafusion:arrow +3.3% +1.3% +1.9% +18.0% ➖ noise
14 datafusion:vortex-compact -1.9% +1.3% -3.2% +18.0% ➖ noise
14 datafusion:vortex-file-compressed +5.4% +1.3% +4.0% +18.0% ➖ noise
14 duckdb:duckdb +5.7% +1.3% +4.3% +20.5% ➖ noise
14 duckdb:vortex-compact +5.9% +1.3% +4.5% +18.0% ➖ noise
14 duckdb:vortex-file-compressed +2.0% +1.3% +0.7% +18.0% ➖ noise
15 datafusion:arrow +5.3% +1.9% +3.4% +18.0% ➖ noise
15 datafusion:vortex-compact +1.8% +1.9% -0.1% +18.0% ➖ noise
15 datafusion:vortex-file-compressed +6.9% +1.9% +4.9% +18.0% ➖ noise
15 duckdb:duckdb -1.8% +1.9% -3.6% +18.0% ➖ noise
15 duckdb:vortex-compact +0.8% +1.9% -1.1% +18.0% ➖ noise
15 duckdb:vortex-file-compressed +2.9% +1.9% +1.0% +18.0% ➖ noise
16 datafusion:arrow +8.3% +4.5% +3.6% +18.0% ➖ noise
16 datafusion:vortex-compact +0.7% +4.5% -3.7% +18.0% ➖ noise
16 datafusion:vortex-file-compressed +1.7% +4.5% -2.7% +18.0% ➖ noise
16 duckdb:duckdb +0.7% +4.5% -3.7% +18.0% ➖ noise
16 duckdb:vortex-compact +0.8% +4.5% -3.5% +18.0% ➖ noise
16 duckdb:vortex-file-compressed +7.1% +4.5% +2.5% +18.0% ➖ noise
17 datafusion:arrow +2.8% +15.4% -10.9% +18.0% ➖ noise
17 datafusion:vortex-compact +1.2% +15.4% -12.2% +18.0% ➖ noise
17 datafusion:vortex-file-compressed +1.7% +15.4% -11.8% +18.0% ➖ noise
17 duckdb:duckdb +3.6% +15.4% -10.2% +18.0% ➖ noise
17 duckdb:vortex-compact +2.0% +15.4% -11.6% +18.0% ➖ noise
17 duckdb:vortex-file-compressed +8.4% +15.4% -6.0% +18.0% ➖ noise
18 datafusion:arrow +0.0% +1.5% -1.4% +18.0% ➖ noise
18 datafusion:vortex-compact +2.3% +1.5% +0.9% +18.0% ➖ noise
18 datafusion:vortex-file-compressed +5.0% +1.5% +3.5% +18.0% ➖ noise
18 duckdb:duckdb +6.6% +1.5% +5.0% +18.0% ➖ noise
18 duckdb:vortex-compact +3.4% +1.5% +1.9% +18.0% ➖ noise
18 duckdb:vortex-file-compressed +4.4% +1.5% +2.9% +18.0% ➖ noise
19 datafusion:arrow -9.7% -8.4% -1.5% +18.6% ➖ noise
19 datafusion:vortex-compact +2.9% -8.4% +12.4% +18.8% ➖ noise
19 datafusion:vortex-file-compressed +3.1% -8.4% +12.6% +20.1% ➖ noise
19 duckdb:duckdb +7.5% -8.4% +17.4% +23.5% ➖ noise
19 duckdb:vortex-compact +1.1% -8.4% +10.4% +19.5% ➖ noise
19 duckdb:vortex-file-compressed +8.1% -8.4% +18.0% +18.7% ➖ noise
20 datafusion:arrow -8.6% -3.2% -5.5% +18.0% ➖ noise
20 datafusion:vortex-compact +1.6% -3.2% +4.9% +18.0% ➖ noise
20 datafusion:vortex-file-compressed -0.6% -3.2% +2.7% +18.0% ➖ noise
20 duckdb:duckdb -0.6% -3.2% +2.6% +18.0% ➖ noise
20 duckdb:vortex-compact -0.1% -3.2% +3.2% +18.0% ➖ noise
20 duckdb:vortex-file-compressed +1.8% -3.2% +5.1% +19.4% ➖ noise
21 datafusion:arrow +5.9% -0.3% +6.2% +18.0% ➖ noise
21 datafusion:vortex-compact +3.1% -0.3% +3.4% +18.0% ➖ noise
21 datafusion:vortex-file-compressed +1.4% -0.3% +1.7% +18.0% ➖ noise
21 duckdb:duckdb +0.4% -0.3% +0.7% +18.0% ➖ noise
21 duckdb:vortex-compact +3.7% -0.3% +4.0% +18.0% ➖ noise
21 duckdb:vortex-file-compressed +3.5% -0.3% +3.8% +18.0% ➖ noise
22 datafusion:arrow +0.9% -0.8% +1.7% +18.0% ➖ noise
22 datafusion:vortex-compact +1.5% -0.8% +2.3% +18.0% ➖ noise
22 datafusion:vortex-file-compressed +5.8% -0.8% +6.7% +18.0% ➖ noise
22 duckdb:duckdb +1.7% -0.8% +2.6% +18.0% ➖ noise
22 duckdb:vortex-compact +1.9% -0.8% +2.8% +18.0% ➖ noise
22 duckdb:vortex-file-compressed +1.3% -0.8% +2.1% +18.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Vortex (geomean): 0.986x ➖
Parquet (geomean): 0.989x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.4%


datafusion / vortex-file-compressed (0.917x ➖, 4↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5494385 5765719 0.95
fineweb_q01/datafusion:vortex-file-compressed 🚀 27232947 31488400 0.86
fineweb_q02/datafusion:vortex-file-compressed 29859344 31436737 0.95
fineweb_q03/datafusion:vortex-file-compressed 🚀 72027083 83970956 0.86
fineweb_q04/datafusion:vortex-file-compressed 273353565 269332571 1.01
fineweb_q05/datafusion:vortex-file-compressed 🚀 227987663 264415586 0.86
fineweb_q06/datafusion:vortex-file-compressed 67964245 66189819 1.03
fineweb_q07/datafusion:vortex-file-compressed 70285627 75749803 0.93
fineweb_q08/datafusion:vortex-file-compressed 🚀 24614251 29959233 0.82
datafusion / vortex-compact (0.994x ➖, 0↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚨 5824441 5281566 1.10
fineweb_q01/datafusion:vortex-compact 165213749 172828691 0.96
fineweb_q02/datafusion:vortex-compact 167999228 169092966 0.99
fineweb_q03/datafusion:vortex-compact 1480390883 1483497605 1.00
fineweb_q04/datafusion:vortex-compact 1611407014 1623359529 0.99
fineweb_q05/datafusion:vortex-compact 1264131444 1283408636 0.98
fineweb_q06/datafusion:vortex-compact 723780500 722916924 1.00
fineweb_q07/datafusion:vortex-compact 751221669 755349347 0.99
fineweb_q08/datafusion:vortex-compact 23490024 25259735 0.93
datafusion / parquet (0.970x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6501867 7099472 0.92
fineweb_q01/datafusion:parquet 273857920 288545833 0.95
fineweb_q02/datafusion:parquet 277066849 286323121 0.97
fineweb_q03/datafusion:parquet 284425499 281674927 1.01
fineweb_q04/datafusion:parquet 299572550 296687223 1.01
fineweb_q05/datafusion:parquet 293710823 299001655 0.98
fineweb_q06/datafusion:parquet 279837849 297857041 0.94
fineweb_q07/datafusion:parquet 283139714 288650797 0.98
fineweb_q08/datafusion:parquet 277199108 284277822 0.98
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3958988 3626364 1.09
fineweb_q01/duckdb:vortex-file-compressed 29869840 29436095 1.01
fineweb_q02/duckdb:vortex-file-compressed 29021271 27279288 1.06
fineweb_q03/duckdb:vortex-file-compressed 🚨 148391638 129074909 1.15
fineweb_q04/duckdb:vortex-file-compressed 238133015 231838595 1.03
fineweb_q05/duckdb:vortex-file-compressed 224002604 213983922 1.05
fineweb_q06/duckdb:vortex-file-compressed 61315082 66779425 0.92
fineweb_q07/duckdb:vortex-file-compressed 71580490 69331702 1.03
fineweb_q08/duckdb:vortex-file-compressed 28900522 26610286 1.09
duckdb / vortex-compact (0.992x ➖, 1↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4566907 4284641 1.07
fineweb_q01/duckdb:vortex-compact 107839251 99636571 1.08
fineweb_q02/duckdb:vortex-compact 117882195 125987063 0.94
fineweb_q03/duckdb:vortex-compact 911747548 908523918 1.00
fineweb_q04/duckdb:vortex-compact 946112189 943141938 1.00
fineweb_q05/duckdb:vortex-compact 847444231 852327910 0.99
fineweb_q06/duckdb:vortex-compact 482220305 487794137 0.99
fineweb_q07/duckdb:vortex-compact 491443466 492311684 1.00
fineweb_q08/duckdb:vortex-compact 🚀 21408064 24502128 0.87
duckdb / parquet (1.009x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 40238774 38680125 1.04
fineweb_q01/duckdb:parquet 99965637 97868356 1.02
fineweb_q02/duckdb:parquet 102853593 101760072 1.01
fineweb_q03/duckdb:parquet 318192537 317819537 1.00
fineweb_q04/duckdb:parquet 447697153 448600817 1.00
fineweb_q05/duckdb:parquet 419614750 419088686 1.00
fineweb_q06/duckdb:parquet 205546466 205280751 1.00
fineweb_q07/duckdb:parquet 218298238 215971677 1.01
fineweb_q08/duckdb:parquet 63711986 63912830 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +10.3% -2.4% +13.0% +41.2% ➖ noise
0 datafusion:vortex-file-compressed -4.7% -2.4% -2.4% +71.8% ➖ noise
0 duckdb:vortex-compact +6.6% -2.4% +9.2% +39.2% ➖ noise
0 duckdb:vortex-file-compressed +9.2% -2.4% +11.8% +46.3% ➖ noise
1 datafusion:vortex-compact -4.4% -1.5% -2.9% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -13.5% -1.5% -12.2% +18.3% ➖ noise
1 duckdb:vortex-compact +8.2% -1.5% +9.9% +16.8% ➖ noise
1 duckdb:vortex-file-compressed +1.5% -1.5% +3.1% +45.5% ➖ noise
2 datafusion:vortex-compact -0.6% -1.1% +0.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -5.0% -1.1% -4.0% +13.5% ➖ noise
2 duckdb:vortex-compact -6.4% -1.1% -5.4% +11.7% ➖ noise
2 duckdb:vortex-file-compressed +6.4% -1.1% +7.6% +10.0% ➖ noise
3 datafusion:vortex-compact -0.2% +0.5% -0.8% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -14.2% +0.5% -14.7% +29.4% ➖ noise
3 duckdb:vortex-compact +0.4% +0.5% -0.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +15.0% +0.5% +14.3% +32.1% ➖ noise
4 datafusion:vortex-compact -0.7% +0.4% -1.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.5% +0.4% +1.1% +10.0% ➖ noise
4 duckdb:vortex-compact +0.3% +0.4% -0.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.7% +0.4% +2.3% +10.0% ➖ noise
5 datafusion:vortex-compact -1.5% -0.8% -0.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -13.8% -0.8% -13.1% +10.0% ✅ faster
5 duckdb:vortex-compact -0.6% -0.8% +0.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +4.7% -0.8% +5.6% +10.0% ➖ noise
6 datafusion:vortex-compact +0.1% -3.0% +3.2% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.7% -3.0% +5.9% +12.4% ➖ noise
6 duckdb:vortex-compact -1.1% -3.0% +1.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -8.2% -3.0% -5.3% +39.6% ➖ noise
7 datafusion:vortex-compact -0.5% -0.4% -0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -7.2% -0.4% -6.8% +10.0% ➖ noise
7 duckdb:vortex-compact -0.2% -0.4% +0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +3.2% -0.4% +3.7% +10.0% ➖ noise
8 datafusion:vortex-compact -7.0% -1.4% -5.7% +17.3% ➖ noise
8 datafusion:vortex-file-compressed -17.8% -1.4% -16.7% +15.2% ✅ faster
8 duckdb:vortex-compact -12.6% -1.4% -11.4% +19.8% ➖ noise
8 duckdb:vortex-file-compressed +8.6% -1.4% +10.2% +14.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.8%
Vortex (geomean): 0.946x ➖
Parquet (geomean): 0.962x ➖
Shifts: Parquet (control) -3.8% · Median polish -4.7%


datafusion / vortex-file-compressed (0.958x ➖, 9↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30667063 29842536 1.03
tpcds_q02/datafusion:vortex-file-compressed 56523865 57178709 0.99
tpcds_q03/datafusion:vortex-file-compressed 22514220 22059889 1.02
tpcds_q04/datafusion:vortex-file-compressed 315337786 331165292 0.95
tpcds_q05/datafusion:vortex-file-compressed 59164894 57127616 1.04
tpcds_q06/datafusion:vortex-file-compressed 57044660 55216217 1.03
tpcds_q07/datafusion:vortex-file-compressed 56650714 56847051 1.00
tpcds_q08/datafusion:vortex-file-compressed 41068104 39740804 1.03
tpcds_q09/datafusion:vortex-file-compressed 53842180 58873721 0.91
tpcds_q10/datafusion:vortex-file-compressed 52563555 49304248 1.07
tpcds_q11/datafusion:vortex-file-compressed 183924905 186784789 0.98
tpcds_q12/datafusion:vortex-file-compressed 24868969 26330866 0.94
tpcds_q13/datafusion:vortex-file-compressed 63057219 64949418 0.97
tpcds_q14/datafusion:vortex-file-compressed 214983674 218204350 0.99
tpcds_q15/datafusion:vortex-file-compressed 🚀 35157003 41606432 0.84
tpcds_q16/datafusion:vortex-file-compressed 29626575 30390668 0.97
tpcds_q17/datafusion:vortex-file-compressed 70472081 74384759 0.95
tpcds_q18/datafusion:vortex-file-compressed 84954303 83327959 1.02
tpcds_q19/datafusion:vortex-file-compressed 32917419 33744103 0.98
tpcds_q20/datafusion:vortex-file-compressed 27995938 28169121 0.99
tpcds_q21/datafusion:vortex-file-compressed 149235313 146604983 1.02
tpcds_q22/datafusion:vortex-file-compressed 60939435 64010257 0.95
tpcds_q23/datafusion:vortex-file-compressed 163372110 160583818 1.02
tpcds_q24/datafusion:vortex-file-compressed 125350535 123030701 1.02
tpcds_q25/datafusion:vortex-file-compressed 74272394 74487740 1.00
tpcds_q26/datafusion:vortex-file-compressed 38949302 39815116 0.98
tpcds_q27/datafusion:vortex-file-compressed 129878773 135434181 0.96
tpcds_q28/datafusion:vortex-file-compressed 🚀 48191265 61478096 0.78
tpcds_q29/datafusion:vortex-file-compressed 71240510 71362418 1.00
tpcds_q30/datafusion:vortex-file-compressed 32186003 34371193 0.94
tpcds_q31/datafusion:vortex-file-compressed 101928162 104775967 0.97
tpcds_q32/datafusion:vortex-file-compressed 23149661 24386381 0.95
tpcds_q33/datafusion:vortex-file-compressed 40787117 43966954 0.93
tpcds_q34/datafusion:vortex-file-compressed 34635094 36705894 0.94
tpcds_q35/datafusion:vortex-file-compressed 59608906 59041048 1.01
tpcds_q36/datafusion:vortex-file-compressed 80316117 84138124 0.95
tpcds_q37/datafusion:vortex-file-compressed 35969597 38361239 0.94
tpcds_q38/datafusion:vortex-file-compressed 58246214 56877321 1.02
tpcds_q39/datafusion:vortex-file-compressed 156371954 162339208 0.96
tpcds_q40/datafusion:vortex-file-compressed 55062827 57984035 0.95
tpcds_q41/datafusion:vortex-file-compressed 19641513 20160289 0.97
tpcds_q42/datafusion:vortex-file-compressed 20018181 20464177 0.98
tpcds_q43/datafusion:vortex-file-compressed 34110855 35104452 0.97
tpcds_q44/datafusion:vortex-file-compressed 47957131 50870715 0.94
tpcds_q45/datafusion:vortex-file-compressed 36502827 36338083 1.00
tpcds_q46/datafusion:vortex-file-compressed 51673331 52507209 0.98
tpcds_q47/datafusion:vortex-file-compressed 216755788 231294227 0.94
tpcds_q48/datafusion:vortex-file-compressed 50486633 50978488 0.99
tpcds_q49/datafusion:vortex-file-compressed 72450107 75762623 0.96
tpcds_q50/datafusion:vortex-file-compressed 48241039 51007985 0.95
tpcds_q51/datafusion:vortex-file-compressed 94503948 95079096 0.99
tpcds_q52/datafusion:vortex-file-compressed 20200584 21037741 0.96
tpcds_q53/datafusion:vortex-file-compressed 26843614 29013811 0.93
tpcds_q54/datafusion:vortex-file-compressed 46900964 49516904 0.95
tpcds_q55/datafusion:vortex-file-compressed 19225029 20739286 0.93
tpcds_q56/datafusion:vortex-file-compressed 43203687 43797434 0.99
tpcds_q57/datafusion:vortex-file-compressed 132665691 138262156 0.96
tpcds_q58/datafusion:vortex-file-compressed 74555518 79131579 0.94
tpcds_q59/datafusion:vortex-file-compressed 76015796 77154423 0.99
tpcds_q60/datafusion:vortex-file-compressed 43768956 45879419 0.95
tpcds_q61/datafusion:vortex-file-compressed 53799444 55039416 0.98
tpcds_q62/datafusion:vortex-file-compressed 33262891 34621585 0.96
tpcds_q63/datafusion:vortex-file-compressed 27956686 30055452 0.93
tpcds_q64/datafusion:vortex-file-compressed 500646114 519522942 0.96
tpcds_q65/datafusion:vortex-file-compressed 🚀 50233581 56210671 0.89
tpcds_q66/datafusion:vortex-file-compressed 🚀 95559795 108849797 0.88
tpcds_q67/datafusion:vortex-file-compressed 127374423 131318913 0.97
tpcds_q68/datafusion:vortex-file-compressed 49447900 52685682 0.94
tpcds_q69/datafusion:vortex-file-compressed 🚀 46307471 55302701 0.84
tpcds_q70/datafusion:vortex-file-compressed 🚀 115823802 129866439 0.89
tpcds_q71/datafusion:vortex-file-compressed 🚀 33183432 40880350 0.81
tpcds_q72/datafusion:vortex-file-compressed 2763905336 2934110124 0.94
tpcds_q73/datafusion:vortex-file-compressed 35871880 36369007 0.99
tpcds_q74/datafusion:vortex-file-compressed 123133474 130564823 0.94
tpcds_q75/datafusion:vortex-file-compressed 124447262 130190774 0.96
tpcds_q76/datafusion:vortex-file-compressed 35930925 37722418 0.95
tpcds_q77/datafusion:vortex-file-compressed 52611630 55027230 0.96
tpcds_q78/datafusion:vortex-file-compressed 🚀 128674238 145003650 0.89
tpcds_q79/datafusion:vortex-file-compressed 40950082 43081945 0.95
tpcds_q80/datafusion:vortex-file-compressed 116948676 121445857 0.96
tpcds_q81/datafusion:vortex-file-compressed 🚀 35346181 41482635 0.85
tpcds_q82/datafusion:vortex-file-compressed 35367214 38545752 0.92
tpcds_q83/datafusion:vortex-file-compressed 51158630 56243148 0.91
tpcds_q84/datafusion:vortex-file-compressed 14869475 16205992 0.92
tpcds_q85/datafusion:vortex-file-compressed 103015103 112351168 0.92
tpcds_q86/datafusion:vortex-file-compressed 19143025 20645178 0.93
tpcds_q87/datafusion:vortex-file-compressed 55243077 58653973 0.94
tpcds_q88/datafusion:vortex-file-compressed 83625262 84414157 0.99
tpcds_q89/datafusion:vortex-file-compressed 37311223 37866003 0.99
tpcds_q90/datafusion:vortex-file-compressed 18720162 20227484 0.93
tpcds_q91/datafusion:vortex-file-compressed 26498587 28044339 0.94
tpcds_q92/datafusion:vortex-file-compressed 20752901 20070352 1.03
tpcds_q93/datafusion:vortex-file-compressed 38700408 37948854 1.02
tpcds_q94/datafusion:vortex-file-compressed 26632388 28356518 0.94
tpcds_q95/datafusion:vortex-file-compressed 63861655 64441363 0.99
tpcds_q96/datafusion:vortex-file-compressed 19399587 20183421 0.96
tpcds_q97/datafusion:vortex-file-compressed 34561419 35791175 0.97
tpcds_q98/datafusion:vortex-file-compressed 35929843 36453856 0.99
tpcds_q99/datafusion:vortex-file-compressed 48108576 51449192 0.94
datafusion / vortex-compact (0.950x ➖, 4↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 38057391 38934672 0.98
tpcds_q02/datafusion:vortex-compact 59721710 62078732 0.96
tpcds_q03/datafusion:vortex-compact 26661967 27510481 0.97
tpcds_q04/datafusion:vortex-compact 331445556 360751008 0.92
tpcds_q05/datafusion:vortex-compact 65576216 65329962 1.00
tpcds_q06/datafusion:vortex-compact 60553951 62418400 0.97
tpcds_q07/datafusion:vortex-compact 69504217 73329084 0.95
tpcds_q08/datafusion:vortex-compact 46710153 48577654 0.96
tpcds_q09/datafusion:vortex-compact 104495672 113351356 0.92
tpcds_q10/datafusion:vortex-compact 64493830 63581461 1.01
tpcds_q11/datafusion:vortex-compact 190310876 207394033 0.92
tpcds_q12/datafusion:vortex-compact 26277392 27761965 0.95
tpcds_q13/datafusion:vortex-compact 131712467 139964627 0.94
tpcds_q14/datafusion:vortex-compact 257845079 273184188 0.94
tpcds_q15/datafusion:vortex-compact 40899966 42990211 0.95
tpcds_q16/datafusion:vortex-compact 39654749 42743074 0.93
tpcds_q17/datafusion:vortex-compact 93719777 100743662 0.93
tpcds_q18/datafusion:vortex-compact 94734140 99499768 0.95
tpcds_q19/datafusion:vortex-compact 43763145 44441224 0.98
tpcds_q20/datafusion:vortex-compact 30265797 32873765 0.92
tpcds_q21/datafusion:vortex-compact 140834891 154089801 0.91
tpcds_q22/datafusion:vortex-compact 🚀 64175025 76461647 0.84
tpcds_q23/datafusion:vortex-compact 189979227 192072468 0.99
tpcds_q24/datafusion:vortex-compact 142705266 148836586 0.96
tpcds_q25/datafusion:vortex-compact 94801078 99460692 0.95
tpcds_q26/datafusion:vortex-compact 46995113 51401371 0.91
tpcds_q27/datafusion:vortex-compact 159733558 171033366 0.93
tpcds_q28/datafusion:vortex-compact 102777379 106012551 0.97
tpcds_q29/datafusion:vortex-compact 95181534 98516016 0.97
tpcds_q30/datafusion:vortex-compact 38372546 39436328 0.97
tpcds_q31/datafusion:vortex-compact 125539705 132971211 0.94
tpcds_q32/datafusion:vortex-compact 27514643 29938232 0.92
tpcds_q33/datafusion:vortex-compact 52808071 54924011 0.96
tpcds_q34/datafusion:vortex-compact 48871589 51834220 0.94
tpcds_q35/datafusion:vortex-compact 67884659 73335681 0.93
tpcds_q36/datafusion:vortex-compact 101542242 103089669 0.98
tpcds_q37/datafusion:vortex-compact 🚀 47633322 53173871 0.90
tpcds_q38/datafusion:vortex-compact 65727654 71002785 0.93
tpcds_q39/datafusion:vortex-compact 156748970 157867663 0.99
tpcds_q40/datafusion:vortex-compact 57617685 62950003 0.92
tpcds_q41/datafusion:vortex-compact 🚀 20705058 23166558 0.89
tpcds_q42/datafusion:vortex-compact 25074529 26064886 0.96
tpcds_q43/datafusion:vortex-compact 39136309 39602360 0.99
tpcds_q44/datafusion:vortex-compact 76511240 80947682 0.95
tpcds_q45/datafusion:vortex-compact 37608759 40851160 0.92
tpcds_q46/datafusion:vortex-compact 67890215 71998848 0.94
tpcds_q47/datafusion:vortex-compact 230914123 248180415 0.93
tpcds_q48/datafusion:vortex-compact 98825049 100176812 0.99
tpcds_q49/datafusion:vortex-compact 96919316 105517508 0.92
tpcds_q50/datafusion:vortex-compact 63793796 68027407 0.94
tpcds_q51/datafusion:vortex-compact 98498427 102556664 0.96
tpcds_q52/datafusion:vortex-compact 26139868 27160934 0.96
tpcds_q53/datafusion:vortex-compact 35008713 37408735 0.94
tpcds_q54/datafusion:vortex-compact 58931302 61982761 0.95
tpcds_q55/datafusion:vortex-compact 25359948 26577038 0.95
tpcds_q56/datafusion:vortex-compact 56100975 58184993 0.96
tpcds_q57/datafusion:vortex-compact 140516447 148366937 0.95
tpcds_q58/datafusion:vortex-compact 78731139 83147772 0.95
tpcds_q59/datafusion:vortex-compact 87722355 89999878 0.97
tpcds_q60/datafusion:vortex-compact 55281835 54899949 1.01
tpcds_q61/datafusion:vortex-compact 72248553 73541514 0.98
tpcds_q62/datafusion:vortex-compact 33694334 35948053 0.94
tpcds_q63/datafusion:vortex-compact 35259193 36713670 0.96
tpcds_q64/datafusion:vortex-compact 553735258 570628853 0.97
tpcds_q65/datafusion:vortex-compact 66488432 70458565 0.94
tpcds_q66/datafusion:vortex-compact 104587908 108618259 0.96
tpcds_q67/datafusion:vortex-compact 133580811 135606080 0.99
tpcds_q68/datafusion:vortex-compact 69326104 72255374 0.96
tpcds_q69/datafusion:vortex-compact 60806672 62018297 0.98
tpcds_q70/datafusion:vortex-compact 124050240 133253044 0.93
tpcds_q71/datafusion:vortex-compact 46134676 47697031 0.97
tpcds_q72/datafusion:vortex-compact 2719252229 2921932316 0.93
tpcds_q73/datafusion:vortex-compact 49385218 53916313 0.92
tpcds_q74/datafusion:vortex-compact 133808947 143914470 0.93
tpcds_q75/datafusion:vortex-compact 168537363 175945386 0.96
tpcds_q76/datafusion:vortex-compact 52261083 55693913 0.94
tpcds_q77/datafusion:vortex-compact 68839628 68387158 1.01
tpcds_q78/datafusion:vortex-compact 151976350 163556532 0.93
tpcds_q79/datafusion:vortex-compact 58623697 61540813 0.95
tpcds_q80/datafusion:vortex-compact 134047269 138847174 0.97
tpcds_q81/datafusion:vortex-compact 44574577 46375411 0.96
tpcds_q82/datafusion:vortex-compact 48586025 51588682 0.94
tpcds_q83/datafusion:vortex-compact 62423578 66867046 0.93
tpcds_q84/datafusion:vortex-compact 18977889 19179870 0.99
tpcds_q85/datafusion:vortex-compact 125621359 136255099 0.92
tpcds_q86/datafusion:vortex-compact 20478343 22428544 0.91
tpcds_q87/datafusion:vortex-compact 67250152 71638510 0.94
tpcds_q88/datafusion:vortex-compact 132812562 135540604 0.98
tpcds_q89/datafusion:vortex-compact 🚀 44123775 49147498 0.90
tpcds_q90/datafusion:vortex-compact 24404401 25487661 0.96
tpcds_q91/datafusion:vortex-compact 42149578 44394388 0.95
tpcds_q92/datafusion:vortex-compact 21512709 22525991 0.96
tpcds_q93/datafusion:vortex-compact 47491104 51475792 0.92
tpcds_q94/datafusion:vortex-compact 31832490 32817981 0.97
tpcds_q95/datafusion:vortex-compact 72399779 76963214 0.94
tpcds_q96/datafusion:vortex-compact 25108476 26800840 0.94
tpcds_q97/datafusion:vortex-compact 42471688 42574783 1.00
tpcds_q98/datafusion:vortex-compact 39745328 43467915 0.91
tpcds_q99/datafusion:vortex-compact 52951994 51966678 1.02
datafusion / parquet (0.969x ➖, 10↑ 2↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 37436035 38967886 0.96
tpcds_q02/datafusion:parquet 49057778 48249120 1.02
tpcds_q03/datafusion:parquet 15557101 16561046 0.94
tpcds_q04/datafusion:parquet 🚀 324863681 361313105 0.90
tpcds_q05/datafusion:parquet 54479106 57545995 0.95
tpcds_q06/datafusion:parquet 65932882 66304707 0.99
tpcds_q07/datafusion:parquet 90085160 98075023 0.92
tpcds_q08/datafusion:parquet 35309878 34793934 1.01
tpcds_q09/datafusion:parquet 60627609 58595178 1.03
tpcds_q10/datafusion:parquet 85466318 88773346 0.96
tpcds_q11/datafusion:parquet 189444155 190461673 0.99
tpcds_q12/datafusion:parquet 24957217 24882632 1.00
tpcds_q13/datafusion:parquet 87598346 88962951 0.98
tpcds_q14/datafusion:parquet 198318260 210545095 0.94
tpcds_q15/datafusion:parquet 26005066 26777914 0.97
tpcds_q16/datafusion:parquet 28240233 31298251 0.90
tpcds_q17/datafusion:parquet 74110532 75850864 0.98
tpcds_q18/datafusion:parquet 136758568 144226811 0.95
tpcds_q19/datafusion:parquet 28552271 29291772 0.97
tpcds_q20/datafusion:parquet 22149096 23145979 0.96
tpcds_q21/datafusion:parquet 🚀 22382596 25950060 0.86
tpcds_q22/datafusion:parquet 151426350 138209032 1.10
tpcds_q23/datafusion:parquet 🚀 164337810 184517419 0.89
tpcds_q24/datafusion:parquet 105326998 115315696 0.91
tpcds_q25/datafusion:parquet 73985640 76483369 0.97
tpcds_q26/datafusion:parquet 🚀 77070050 85919598 0.90
tpcds_q27/datafusion:parquet 🚀 165027802 187704580 0.88
tpcds_q28/datafusion:parquet 50005193 50869622 0.98
tpcds_q29/datafusion:parquet 74985658 78917631 0.95
tpcds_q30/datafusion:parquet 45692975 47430014 0.96
tpcds_q31/datafusion:parquet 79250573 83380095 0.95
tpcds_q32/datafusion:parquet 23899011 24149585 0.99
tpcds_q33/datafusion:parquet 36464020 36837559 0.99
tpcds_q34/datafusion:parquet 27324483 28248985 0.97
tpcds_q35/datafusion:parquet 89490832 90412340 0.99
tpcds_q36/datafusion:parquet 66299988 68317435 0.97
tpcds_q37/datafusion:parquet 24698173 25710832 0.96
tpcds_q38/datafusion:parquet 51986762 55989877 0.93
tpcds_q39/datafusion:parquet 87091910 92236053 0.94
tpcds_q40/datafusion:parquet 29003629 30004429 0.97
tpcds_q41/datafusion:parquet 16672665 17846332 0.93
tpcds_q42/datafusion:parquet 13971469 15319646 0.91
tpcds_q43/datafusion:parquet 20450930 20687562 0.99
tpcds_q44/datafusion:parquet 42497930 43264359 0.98
tpcds_q45/datafusion:parquet 33393933 34813886 0.96
tpcds_q46/datafusion:parquet 40213132 41172109 0.98
tpcds_q47/datafusion:parquet 139974817 151745401 0.92
tpcds_q48/datafusion:parquet 82062122 84599203 0.97
tpcds_q49/datafusion:parquet 65631139 72255499 0.91
tpcds_q50/datafusion:parquet 50047823 53436905 0.94
tpcds_q51/datafusion:parquet 94181757 98509106 0.96
tpcds_q52/datafusion:parquet 🚀 15114636 17111523 0.88
tpcds_q53/datafusion:parquet 22182450 23341671 0.95
tpcds_q54/datafusion:parquet 43781365 46364352 0.94
tpcds_q55/datafusion:parquet 🚀 13927105 17112349 0.81
tpcds_q56/datafusion:parquet 38031719 39789224 0.96
tpcds_q57/datafusion:parquet 🚀 109362595 124184610 0.88
tpcds_q58/datafusion:parquet 66238252 62154693 1.07
tpcds_q59/datafusion:parquet 64031757 62787794 1.02
tpcds_q60/datafusion:parquet 40026143 36952507 1.08
tpcds_q61/datafusion:parquet 55774527 56540999 0.99
tpcds_q62/datafusion:parquet 🚨 32931348 26197992 1.26
tpcds_q63/datafusion:parquet 24072244 23719460 1.01
tpcds_q64/datafusion:parquet 605024419 592885714 1.02
tpcds_q65/datafusion:parquet 48525264 46882207 1.04
tpcds_q66/datafusion:parquet 84484081 81752656 1.03
tpcds_q67/datafusion:parquet 161681911 172296471 0.94
tpcds_q68/datafusion:parquet 41675000 43901276 0.95
tpcds_q69/datafusion:parquet 83741185 83828702 1.00
tpcds_q70/datafusion:parquet 110213849 104506833 1.05
tpcds_q71/datafusion:parquet 28739637 28021623 1.03
tpcds_q72/datafusion:parquet 699659171 702883531 1.00
tpcds_q73/datafusion:parquet 30507868 28767507 1.06
tpcds_q74/datafusion:parquet 111491482 114825119 0.97
tpcds_q75/datafusion:parquet 123968814 129307840 0.96
tpcds_q76/datafusion:parquet 37251109 38401070 0.97
tpcds_q77/datafusion:parquet 51448429 53013179 0.97
tpcds_q78/datafusion:parquet 128758312 131385158 0.98
tpcds_q79/datafusion:parquet 32556475 35229985 0.92
tpcds_q80/datafusion:parquet 100968393 102921765 0.98
tpcds_q81/datafusion:parquet 🚀 43695571 48959114 0.89
tpcds_q82/datafusion:parquet 24381445 25193909 0.97
tpcds_q83/datafusion:parquet 50567292 54320255 0.93
tpcds_q84/datafusion:parquet 50031495 49585688 1.01
tpcds_q85/datafusion:parquet 178473086 182670701 0.98
tpcds_q86/datafusion:parquet 19242372 20550615 0.94
tpcds_q87/datafusion:parquet 55699317 54188363 1.03
tpcds_q88/datafusion:parquet 73627610 74537099 0.99
tpcds_q89/datafusion:parquet 25442862 25867985 0.98
tpcds_q90/datafusion:parquet 20876630 20736688 1.01
tpcds_q91/datafusion:parquet 73282963 76187411 0.96
tpcds_q92/datafusion:parquet 22907265 25308641 0.91
tpcds_q93/datafusion:parquet 38097366 38499931 0.99
tpcds_q94/datafusion:parquet 26053749 27171529 0.96
tpcds_q95/datafusion:parquet 69871566 72232895 0.97
tpcds_q96/datafusion:parquet 15406529 16336780 0.94
tpcds_q97/datafusion:parquet 🚀 33237819 37019350 0.90
tpcds_q98/datafusion:parquet 27490865 27776088 0.99
tpcds_q99/datafusion:parquet 🚨 36589789 31422860 1.16
duckdb / vortex-file-compressed (0.936x ➖, 18↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚀 25125852 28056533 0.90
tpcds_q02/duckdb:vortex-file-compressed 79385065 87854212 0.90
tpcds_q03/duckdb:vortex-file-compressed 🚀 20793810 23969529 0.87
tpcds_q04/duckdb:vortex-file-compressed 106673631 113832732 0.94
tpcds_q05/duckdb:vortex-file-compressed 99621810 110297980 0.90
tpcds_q06/duckdb:vortex-file-compressed 36928807 39875601 0.93
tpcds_q07/duckdb:vortex-file-compressed 25793054 28174971 0.92
tpcds_q08/duckdb:vortex-file-compressed 24357276 26378617 0.92
tpcds_q09/duckdb:vortex-file-compressed 🚀 37216267 41456248 0.90
tpcds_q10/duckdb:vortex-file-compressed 37868782 40581645 0.93
tpcds_q11/duckdb:vortex-file-compressed 62608088 64243955 0.97
tpcds_q12/duckdb:vortex-file-compressed 14312272 15279625 0.94
tpcds_q13/duckdb:vortex-file-compressed 34278231 37755832 0.91
tpcds_q14/duckdb:vortex-file-compressed 203804041 196012713 1.04
tpcds_q15/duckdb:vortex-file-compressed 40936779 43836556 0.93
tpcds_q16/duckdb:vortex-file-compressed 30787168 30920257 1.00
tpcds_q17/duckdb:vortex-file-compressed 39105698 42766442 0.91
tpcds_q18/duckdb:vortex-file-compressed 🚀 45788554 51361682 0.89
tpcds_q19/duckdb:vortex-file-compressed 34149205 36637219 0.93
tpcds_q20/duckdb:vortex-file-compressed 16371496 16991969 0.96
tpcds_q21/duckdb:vortex-file-compressed 20956822 21268209 0.99
tpcds_q22/duckdb:vortex-file-compressed 110216271 116924021 0.94
tpcds_q23/duckdb:vortex-file-compressed 123855786 136754739 0.91
tpcds_q24/duckdb:vortex-file-compressed 🚀 53977249 60987152 0.89
tpcds_q25/duckdb:vortex-file-compressed 38741639 39742230 0.97
tpcds_q26/duckdb:vortex-file-compressed 42088056 42308739 0.99
tpcds_q27/duckdb:vortex-file-compressed 86793680 94158921 0.92
tpcds_q28/duckdb:vortex-file-compressed 35356733 37912135 0.93
tpcds_q29/duckdb:vortex-file-compressed 37234609 41240004 0.90
tpcds_q30/duckdb:vortex-file-compressed 29643739 30959720 0.96
tpcds_q31/duckdb:vortex-file-compressed 27171508 27194192 1.00
tpcds_q32/duckdb:vortex-file-compressed 17870353 18265225 0.98
tpcds_q33/duckdb:vortex-file-compressed 69614390 72392296 0.96
tpcds_q34/duckdb:vortex-file-compressed 19711803 20500092 0.96
tpcds_q35/duckdb:vortex-file-compressed 🚀 63339436 72395862 0.87
tpcds_q36/duckdb:vortex-file-compressed 28659981 28477956 1.01
tpcds_q37/duckdb:vortex-file-compressed 🚀 20942886 24749525 0.85
tpcds_q38/duckdb:vortex-file-compressed 36255103 38593150 0.94
tpcds_q39/duckdb:vortex-file-compressed 🚀 46586315 52705650 0.88
tpcds_q40/duckdb:vortex-file-compressed 24876590 26589657 0.94
tpcds_q41/duckdb:vortex-file-compressed 🚀 12769954 15354007 0.83
tpcds_q42/duckdb:vortex-file-compressed 11828747 12164235 0.97
tpcds_q43/duckdb:vortex-file-compressed 20504140 20694738 0.99
tpcds_q44/duckdb:vortex-file-compressed 22633191 24056218 0.94
tpcds_q45/duckdb:vortex-file-compressed 27022386 29773177 0.91
tpcds_q46/duckdb:vortex-file-compressed 49458829 51942415 0.95
tpcds_q47/duckdb:vortex-file-compressed 50140272 52993412 0.95
tpcds_q48/duckdb:vortex-file-compressed 31809262 33564318 0.95
tpcds_q49/duckdb:vortex-file-compressed 30545766 30984380 0.99
tpcds_q50/duckdb:vortex-file-compressed 36744454 38814507 0.95
tpcds_q51/duckdb:vortex-file-compressed 99097563 105528713 0.94
tpcds_q52/duckdb:vortex-file-compressed 12121535 12755302 0.95
tpcds_q53/duckdb:vortex-file-compressed 🚀 16779930 19109070 0.88
tpcds_q54/duckdb:vortex-file-compressed 🚀 49138324 54891448 0.90
tpcds_q55/duckdb:vortex-file-compressed 11765947 12680566 0.93
tpcds_q56/duckdb:vortex-file-compressed 🚀 66568851 82657018 0.81
tpcds_q57/duckdb:vortex-file-compressed 45181847 46541518 0.97
tpcds_q58/duckdb:vortex-file-compressed 33107880 35519169 0.93
tpcds_q59/duckdb:vortex-file-compressed 61339867 63933671 0.96
tpcds_q60/duckdb:vortex-file-compressed 71108472 73374909 0.97
tpcds_q61/duckdb:vortex-file-compressed 🚀 36728689 42338647 0.87
tpcds_q62/duckdb:vortex-file-compressed 18127956 18983485 0.95
tpcds_q63/duckdb:vortex-file-compressed 18612173 19702675 0.94
tpcds_q64/duckdb:vortex-file-compressed 79691536 88067330 0.90
tpcds_q65/duckdb:vortex-file-compressed 24000660 24848218 0.97
tpcds_q66/duckdb:vortex-file-compressed 58775618 62913768 0.93
tpcds_q67/duckdb:vortex-file-compressed 143024125 154826148 0.92
tpcds_q68/duckdb:vortex-file-compressed 42850949 44333082 0.97
tpcds_q69/duckdb:vortex-file-compressed 38843547 40827820 0.95
tpcds_q70/duckdb:vortex-file-compressed 24842799 26456462 0.94
tpcds_q71/duckdb:vortex-file-compressed 21026768 22338943 0.94
tpcds_q72/duckdb:vortex-file-compressed 176934790 185238340 0.96
tpcds_q73/duckdb:vortex-file-compressed 20176577 20617854 0.98
tpcds_q74/duckdb:vortex-file-compressed 52785044 56785337 0.93
tpcds_q75/duckdb:vortex-file-compressed 58800463 61383746 0.96
tpcds_q76/duckdb:vortex-file-compressed 🚀 71290386 81675859 0.87
tpcds_q77/duckdb:vortex-file-compressed 🚀 62513793 80501587 0.78
tpcds_q78/duckdb:vortex-file-compressed 82542958 85364905 0.97
tpcds_q79/duckdb:vortex-file-compressed 41529693 42911147 0.97
tpcds_q80/duckdb:vortex-file-compressed 95303969 100314365 0.95
tpcds_q81/duckdb:vortex-file-compressed 34374495 37299865 0.92
tpcds_q82/duckdb:vortex-file-compressed 🚀 22706953 25393061 0.89
tpcds_q83/duckdb:vortex-file-compressed 28631842 28917246 0.99
tpcds_q84/duckdb:vortex-file-compressed 17136630 18408281 0.93
tpcds_q85/duckdb:vortex-file-compressed 45622937 47270429 0.97
tpcds_q86/duckdb:vortex-file-compressed 🚀 17739800 19829059 0.89
tpcds_q87/duckdb:vortex-file-compressed 42747991 42106063 1.02
tpcds_q88/duckdb:vortex-file-compressed 36358884 36878327 0.99
tpcds_q89/duckdb:vortex-file-compressed 18603723 18722165 0.99
tpcds_q90/duckdb:vortex-file-compressed 15119635 15851098 0.95
tpcds_q91/duckdb:vortex-file-compressed 🚀 26184503 30925712 0.85
tpcds_q92/duckdb:vortex-file-compressed 14129574 15437875 0.92
tpcds_q93/duckdb:vortex-file-compressed 31193797 33279849 0.94
tpcds_q94/duckdb:vortex-file-compressed 21710279 23852375 0.91
tpcds_q95/duckdb:vortex-file-compressed 150392916 149435818 1.01
tpcds_q96/duckdb:vortex-file-compressed 11986413 12478591 0.96
tpcds_q97/duckdb:vortex-file-compressed 40571689 42162586 0.96
tpcds_q98/duckdb:vortex-file-compressed 18449642 19882498 0.93
tpcds_q99/duckdb:vortex-file-compressed 36651292 33666584 1.09
duckdb / vortex-compact (0.939x ➖, 15↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34234166 36521652 0.94
tpcds_q02/duckdb:vortex-compact 123978494 135199411 0.92
tpcds_q03/duckdb:vortex-compact 50315881 52615102 0.96
tpcds_q04/duckdb:vortex-compact 123633264 134326354 0.92
tpcds_q05/duckdb:vortex-compact 🚀 148775238 171785101 0.87
tpcds_q06/duckdb:vortex-compact 37476385 39745218 0.94
tpcds_q07/duckdb:vortex-compact 35838690 37406131 0.96
tpcds_q08/duckdb:vortex-compact 27720029 28322639 0.98
tpcds_q09/duckdb:vortex-compact 108438318 116784982 0.93
tpcds_q10/duckdb:vortex-compact 45012346 47570754 0.95
tpcds_q11/duckdb:vortex-compact 74904668 77476522 0.97
tpcds_q12/duckdb:vortex-compact 18539158 20245188 0.92
tpcds_q13/duckdb:vortex-compact 47676511 49366765 0.97
tpcds_q14/duckdb:vortex-compact 272319126 286673013 0.95
tpcds_q15/duckdb:vortex-compact 45136399 49318239 0.92
tpcds_q16/duckdb:vortex-compact 37208524 39559602 0.94
tpcds_q17/duckdb:vortex-compact 47947526 50988543 0.94
tpcds_q18/duckdb:vortex-compact 68936006 70289747 0.98
tpcds_q19/duckdb:vortex-compact 🚀 36784641 42216654 0.87
tpcds_q20/duckdb:vortex-compact 🚀 19882684 22220284 0.89
tpcds_q21/duckdb:vortex-compact 27069742 29139062 0.93
tpcds_q22/duckdb:vortex-compact 116506371 126135160 0.92
tpcds_q23/duckdb:vortex-compact 🚀 160413648 181307270 0.88
tpcds_q24/duckdb:vortex-compact 70910971 70765768 1.00
tpcds_q25/duckdb:vortex-compact 48860957 50220232 0.97
tpcds_q26/duckdb:vortex-compact 54060489 56071817 0.96
tpcds_q27/duckdb:vortex-compact 126776502 137045669 0.93
tpcds_q28/duckdb:vortex-compact 106622269 109427084 0.97
tpcds_q29/duckdb:vortex-compact 46950781 50557015 0.93
tpcds_q30/duckdb:vortex-compact 34376784 37967902 0.91
tpcds_q31/duckdb:vortex-compact 31849729 32976225 0.97
tpcds_q32/duckdb:vortex-compact 24258276 23885263 1.02
tpcds_q33/duckdb:vortex-compact 130216724 138785005 0.94
tpcds_q34/duckdb:vortex-compact 🚀 21948346 24614774 0.89
tpcds_q35/duckdb:vortex-compact 🚀 64606991 72252903 0.89
tpcds_q36/duckdb:vortex-compact 31890815 34906366 0.91
tpcds_q37/duckdb:vortex-compact 30587293 32953536 0.93
tpcds_q38/duckdb:vortex-compact 39873487 43869459 0.91
tpcds_q39/duckdb:vortex-compact 52759519 55325106 0.95
tpcds_q40/duckdb:vortex-compact 31075741 33822772 0.92
tpcds_q41/duckdb:vortex-compact 16885253 18667036 0.90
tpcds_q42/duckdb:vortex-compact 14930030 15695034 0.95
tpcds_q43/duckdb:vortex-compact 22989641 23948885 0.96
tpcds_q44/duckdb:vortex-compact 29331966 29922930 0.98
tpcds_q45/duckdb:vortex-compact 🚀 34141639 38222038 0.89
tpcds_q46/duckdb:vortex-compact 55718077 59654915 0.93
tpcds_q47/duckdb:vortex-compact 52406570 56848298 0.92
tpcds_q48/duckdb:vortex-compact 40925859 42430432 0.96
tpcds_q49/duckdb:vortex-compact 46282225 49568331 0.93
tpcds_q50/duckdb:vortex-compact 36294737 39284603 0.92
tpcds_q51/duckdb:vortex-compact 102332108 108487531 0.94
tpcds_q52/duckdb:vortex-compact 15322300 15590501 0.98
tpcds_q53/duckdb:vortex-compact 21533228 22925670 0.94
tpcds_q54/duckdb:vortex-compact 85341528 90603606 0.94
tpcds_q55/duckdb:vortex-compact 15237941 15525662 0.98
tpcds_q56/duckdb:vortex-compact 🚀 126479606 140813877 0.90
tpcds_q57/duckdb:vortex-compact 47516026 51260023 0.93
tpcds_q58/duckdb:vortex-compact 40754460 44052012 0.93
tpcds_q59/duckdb:vortex-compact 77379533 76955916 1.01
tpcds_q60/duckdb:vortex-compact 129662569 141047054 0.92
tpcds_q61/duckdb:vortex-compact 45287474 44973460 1.01
tpcds_q62/duckdb:vortex-compact 🚀 26695910 30061007 0.89
tpcds_q63/duckdb:vortex-compact 22135538 22549320 0.98
tpcds_q64/duckdb:vortex-compact 99775121 106649109 0.94
tpcds_q65/duckdb:vortex-compact 28897281 29164858 0.99
tpcds_q66/duckdb:vortex-compact 98800181 105750424 0.93
tpcds_q67/duckdb:vortex-compact 151509178 160781632 0.94
tpcds_q68/duckdb:vortex-compact 🚀 48297502 55267706 0.87
tpcds_q69/duckdb:vortex-compact 45992660 48609443 0.95
tpcds_q70/duckdb:vortex-compact 29783417 28424571 1.05
tpcds_q71/duckdb:vortex-compact 25831460 27029348 0.96
tpcds_q72/duckdb:vortex-compact 194462027 202324627 0.96
tpcds_q73/duckdb:vortex-compact 21575522 22380937 0.96
tpcds_q74/duckdb:vortex-compact 🚀 54867587 61992521 0.89
tpcds_q75/duckdb:vortex-compact 72301820 77847360 0.93
tpcds_q76/duckdb:vortex-compact 119051835 130545731 0.91
tpcds_q77/duckdb:vortex-compact 118023191 126436434 0.93
tpcds_q78/duckdb:vortex-compact 87584283 92584102 0.95
tpcds_q79/duckdb:vortex-compact 72944708 75231415 0.97
tpcds_q80/duckdb:vortex-compact 154983160 161021345 0.96
tpcds_q81/duckdb:vortex-compact 40019878 44339204 0.90
tpcds_q82/duckdb:vortex-compact 🚀 30165670 34435908 0.88
tpcds_q83/duckdb:vortex-compact 46345849 49057634 0.94
tpcds_q84/duckdb:vortex-compact 21359658 22748201 0.94
tpcds_q85/duckdb:vortex-compact 60293058 64396734 0.94
tpcds_q86/duckdb:vortex-compact 🚀 19412361 22675980 0.86
tpcds_q87/duckdb:vortex-compact 43418324 44720005 0.97
tpcds_q88/duckdb:vortex-compact 34077906 36246906 0.94
tpcds_q89/duckdb:vortex-compact 22919384 24254460 0.94
tpcds_q90/duckdb:vortex-compact 16043907 16847958 0.95
tpcds_q91/duckdb:vortex-compact 44134992 47296800 0.93
tpcds_q92/duckdb:vortex-compact 19932270 20108237 0.99
tpcds_q93/duckdb:vortex-compact 🚀 37204733 41536568 0.90
tpcds_q94/duckdb:vortex-compact 28210898 29888324 0.94
tpcds_q95/duckdb:vortex-compact 166233444 169020922 0.98
tpcds_q96/duckdb:vortex-compact 11629487 11852199 0.98
tpcds_q97/duckdb:vortex-compact 🚀 39674840 46803317 0.85
tpcds_q98/duckdb:vortex-compact 23467372 24056667 0.98
tpcds_q99/duckdb:vortex-compact 36991515 37064781 1.00
duckdb / parquet (0.955x ➖, 8↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 45458241 47279712 0.96
tpcds_q02/duckdb:parquet 58205651 62210889 0.94
tpcds_q03/duckdb:parquet 12324263 12481220 0.99
tpcds_q04/duckdb:parquet 124221526 129934980 0.96
tpcds_q05/duckdb:parquet 71772960 77876439 0.92
tpcds_q06/duckdb:parquet 29598755 30795956 0.96
tpcds_q07/duckdb:parquet 23417522 24338469 0.96
tpcds_q08/duckdb:parquet 28071578 28983578 0.97
tpcds_q09/duckdb:parquet 40146780 40504292 0.99
tpcds_q10/duckdb:parquet 34332884 36467929 0.94
tpcds_q11/duckdb:parquet 86527512 89638484 0.97
tpcds_q12/duckdb:parquet 14480653 15031712 0.96
tpcds_q13/duckdb:parquet 35803405 35869120 1.00
tpcds_q14/duckdb:parquet 166836583 169628588 0.98
tpcds_q15/duckdb:parquet 29692151 31664494 0.94
tpcds_q16/duckdb:parquet 21665071 23590331 0.92
tpcds_q17/duckdb:parquet 38917026 39202201 0.99
tpcds_q18/duckdb:parquet 44265693 47749615 0.93
tpcds_q19/duckdb:parquet 29907606 32371754 0.92
tpcds_q20/duckdb:parquet 15462813 15850308 0.98
tpcds_q21/duckdb:parquet 🚀 11181863 14864138 0.75
tpcds_q22/duckdb:parquet 66652864 70861780 0.94
tpcds_q23/duckdb:parquet 112863184 117184762 0.96
tpcds_q24/duckdb:parquet 45412904 46572152 0.98
tpcds_q25/duckdb:parquet 32428899 33569105 0.97
tpcds_q26/duckdb:parquet 37360150 40796523 0.92
tpcds_q27/duckdb:parquet 88903718 92990027 0.96
tpcds_q28/duckdb:parquet 37170068 37632523 0.99
tpcds_q29/duckdb:parquet 35759359 37127134 0.96
tpcds_q30/duckdb:parquet 41177585 42765653 0.96
tpcds_q31/duckdb:parquet 23693450 24565976 0.96
tpcds_q32/duckdb:parquet 11236724 11545214 0.97
tpcds_q33/duckdb:parquet 70973755 73641869 0.96
tpcds_q34/duckdb:parquet 21353023 22773909 0.94
tpcds_q35/duckdb:parquet 59505333 63134971 0.94
tpcds_q36/duckdb:parquet 20564859 20588237 1.00
tpcds_q37/duckdb:parquet 12735766 13269566 0.96
tpcds_q38/duckdb:parquet 35347674 34526227 1.02
tpcds_q39/duckdb:parquet 33494291 32845929 1.02
tpcds_q40/duckdb:parquet 18283502 18766628 0.97
tpcds_q41/duckdb:parquet 7626554 8054106 0.95
tpcds_q42/duckdb:parquet 10409582 10457134 1.00
tpcds_q43/duckdb:parquet 15955732 16764787 0.95
tpcds_q44/duckdb:parquet 21327933 22203261 0.96
tpcds_q45/duckdb:parquet 26667032 28585671 0.93
tpcds_q46/duckdb:parquet 47164387 50155879 0.94
tpcds_q47/duckdb:parquet 46275446 47868138 0.97
tpcds_q48/duckdb:parquet 🚀 30297693 33982829 0.89
tpcds_q49/duckdb:parquet 25736256 26888627 0.96
tpcds_q50/duckdb:parquet 24601660 25251335 0.97
tpcds_q51/duckdb:parquet 96599897 99149492 0.97
tpcds_q52/duckdb:parquet 10607844 11049662 0.96
tpcds_q53/duckdb:parquet 16263828 17134042 0.95
tpcds_q54/duckdb:parquet 40930548 40576651 1.01
tpcds_q55/duckdb:parquet 10780540 11428704 0.94
tpcds_q56/duckdb:parquet 68513376 71465264 0.96
tpcds_q57/duckdb:parquet 35564344 37704878 0.94
tpcds_q58/duckdb:parquet 21240389 22709514 0.94
tpcds_q59/duckdb:parquet 36872310 37100536 0.99
tpcds_q60/duckdb:parquet 73110443 73142905 1.00
tpcds_q61/duckdb:parquet 31146934 32208056 0.97
tpcds_q62/duckdb:parquet 🚀 11280376 13247983 0.85
tpcds_q63/duckdb:parquet 15529433 15839621 0.98
tpcds_q64/duckdb:parquet 74354181 75990159 0.98
tpcds_q65/duckdb:parquet 20213790 20564063 0.98
tpcds_q66/duckdb:parquet 🚀 55157484 61539717 0.90
tpcds_q67/duckdb:parquet 134497617 148839213 0.90
tpcds_q68/duckdb:parquet 37714099 39298509 0.96
tpcds_q69/duckdb:parquet 37246786 39586376 0.94
tpcds_q70/duckdb:parquet 🚀 19983087 22934135 0.87
tpcds_q71/duckdb:parquet 🚨 20779361 18442693 1.13
tpcds_q72/duckdb:parquet 166411083 167994603 0.99
tpcds_q73/duckdb:parquet 18031297 18644391 0.97
tpcds_q74/duckdb:parquet 51149235 53779021 0.95
tpcds_q75/duckdb:parquet 53725785 54562286 0.98
tpcds_q76/duckdb:parquet 74180773 71374894 1.04
tpcds_q77/duckdb:parquet 62604121 64102639 0.98
tpcds_q78/duckdb:parquet 76455040 78118812 0.98
tpcds_q79/duckdb:parquet 27278326 28404748 0.96
tpcds_q80/duckdb:parquet 83121054 86264699 0.96
tpcds_q81/duckdb:parquet 46684350 47067856 0.99
tpcds_q82/duckdb:parquet 15633624 16805878 0.93
tpcds_q83/duckdb:parquet 16719862 16932619 0.99
tpcds_q84/duckdb:parquet 19364156 20381510 0.95
tpcds_q85/duckdb:parquet 40119334 41263340 0.97
tpcds_q86/duckdb:parquet 12506307 12855987 0.97
tpcds_q87/duckdb:parquet 37495986 37875981 0.99
tpcds_q88/duckdb:parquet 28654936 29678241 0.97
tpcds_q89/duckdb:parquet 17590258 18027577 0.98
tpcds_q90/duckdb:parquet 7261646 7464861 0.97
tpcds_q91/duckdb:parquet 23639390 23048579 1.03
tpcds_q92/duckdb:parquet 🚀 11277734 12673161 0.89
tpcds_q93/duckdb:parquet 30296581 33466146 0.91
tpcds_q94/duckdb:parquet 15869639 17576012 0.90
tpcds_q95/duckdb:parquet 🚀 118837692 155783370 0.76
tpcds_q96/duckdb:parquet 9339047 9556029 0.98
tpcds_q97/duckdb:parquet 🚀 34200161 38843945 0.88
tpcds_q98/duckdb:parquet 17826839 19166674 0.93
tpcds_q99/duckdb:parquet 19196096 20195083 0.95
duckdb / duckdb (0.944x ➖, 13↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20331724 20800765 0.98
tpcds_q02/duckdb:duckdb 18324368 18626439 0.98
tpcds_q03/duckdb:duckdb 8354857 9155810 0.91
tpcds_q04/duckdb:duckdb 159331138 168592278 0.95
tpcds_q05/duckdb:duckdb 18320278 19917453 0.92
tpcds_q06/duckdb:duckdb 21741835 23616213 0.92
tpcds_q07/duckdb:duckdb 38352057 41144865 0.93
tpcds_q08/duckdb:duckdb 119921989 121029344 0.99
tpcds_q09/duckdb:duckdb 19804275 19513074 1.01
tpcds_q10/duckdb:duckdb 23761833 24011429 0.99
tpcds_q11/duckdb:duckdb 136009694 147152849 0.92
tpcds_q12/duckdb:duckdb 11453389 11674844 0.98
tpcds_q13/duckdb:duckdb 24118132 24212676 1.00
tpcds_q14/duckdb:duckdb 92452749 96534900 0.96
tpcds_q15/duckdb:duckdb 24422131 25801014 0.95
tpcds_q16/duckdb:duckdb 17119436 17671327 0.97
tpcds_q17/duckdb:duckdb 22212589 22154825 1.00
tpcds_q18/duckdb:duckdb 42338607 46140563 0.92
tpcds_q19/duckdb:duckdb 16480048 16701287 0.99
tpcds_q20/duckdb:duckdb 11185188 12003487 0.93
tpcds_q21/duckdb:duckdb 6388781 6792457 0.94
tpcds_q22/duckdb:duckdb 60331967 64954646 0.93
tpcds_q23/duckdb:duckdb 72603481 77866493 0.93
tpcds_q24/duckdb:duckdb 🚀 22379733 24939735 0.90
tpcds_q25/duckdb:duckdb 16615901 17363200 0.96
tpcds_q26/duckdb:duckdb 25658956 25913135 0.99
tpcds_q27/duckdb:duckdb 🚀 37960335 42355989 0.90
tpcds_q28/duckdb:duckdb 21069960 22159597 0.95
tpcds_q29/duckdb:duckdb 19771959 20446063 0.97
tpcds_q30/duckdb:duckdb 🚀 25525647 31136635 0.82
tpcds_q31/duckdb:duckdb 20514303 20536859 1.00
tpcds_q32/duckdb:duckdb 🚀 6663414 7468047 0.89
tpcds_q33/duckdb:duckdb 12118431 13267079 0.91
tpcds_q34/duckdb:duckdb 14658998 15612637 0.94
tpcds_q35/duckdb:duckdb 🚀 32191961 36565780 0.88
tpcds_q36/duckdb:duckdb 69069965 74863573 0.92
tpcds_q37/duckdb:duckdb 7593755 8250154 0.92
tpcds_q38/duckdb:duckdb 32125422 31469050 1.02
tpcds_q39/duckdb:duckdb 26039403 27137825 0.96
tpcds_q40/duckdb:duckdb 14163102 14108077 1.00
tpcds_q41/duckdb:duckdb 7851890 8426294 0.93
tpcds_q42/duckdb:duckdb 🚀 5710485 6869302 0.83
tpcds_q43/duckdb:duckdb 10925772 11883698 0.92
tpcds_q44/duckdb:duckdb 13339834 13853462 0.96
tpcds_q45/duckdb:duckdb 17628986 17968228 0.98
tpcds_q46/duckdb:duckdb 35432559 37105499 0.95
tpcds_q47/duckdb:duckdb 40232740 41818661 0.96
tpcds_q48/duckdb:duckdb 21441411 21944578 0.98
tpcds_q49/duckdb:duckdb 15960353 17090914 0.93
tpcds_q50/duckdb:duckdb 13734490 15036068 0.91
tpcds_q51/duckdb:duckdb 90834652 93087469 0.98
tpcds_q52/duckdb:duckdb 🚀 6852876 7815363 0.88
tpcds_q53/duckdb:duckdb 11739514 12089512 0.97
tpcds_q54/duckdb:duckdb 16316642 17403381 0.94
tpcds_q55/duckdb:duckdb 6589718 6948537 0.95
tpcds_q56/duckdb:duckdb 12591010 13947431 0.90
tpcds_q57/duckdb:duckdb 31493301 32091761 0.98
tpcds_q58/duckdb:duckdb 11505853 12774399 0.90
tpcds_q59/duckdb:duckdb 34127445 35640067 0.96
tpcds_q60/duckdb:duckdb 🚀 13892565 16251479 0.85
tpcds_q61/duckdb:duckdb 13895212 15034493 0.92
tpcds_q62/duckdb:duckdb 🚀 8889093 10077700 0.88
tpcds_q63/duckdb:duckdb 10522322 11371858 0.93
tpcds_q64/duckdb:duckdb 50376874 54151953 0.93
tpcds_q65/duckdb:duckdb 33258336 35334450 0.94
tpcds_q66/duckdb:duckdb 23905075 25887312 0.92
tpcds_q67/duckdb:duckdb 128127175 136467409 0.94
tpcds_q68/duckdb:duckdb 24652683 25784370 0.96
tpcds_q69/duckdb:duckdb 22530561 25017625 0.90
tpcds_q70/duckdb:duckdb 13999197 14068874 1.00
tpcds_q71/duckdb:duckdb 13052110 13752954 0.95
tpcds_q72/duckdb:duckdb 41629054 41030182 1.01
tpcds_q73/duckdb:duckdb 10253943 11267106 0.91
tpcds_q74/duckdb:duckdb 96991730 103974780 0.93
tpcds_q75/duckdb:duckdb 42177156 45296927 0.93
tpcds_q76/duckdb:duckdb 11733120 12619459 0.93
tpcds_q77/duckdb:duckdb 12061389 11898511 1.01
tpcds_q78/duckdb:duckdb 61943130 64551657 0.96
tpcds_q79/duckdb:duckdb 18086122 18187125 0.99
tpcds_q80/duckdb:duckdb 28338458 29806342 0.95
tpcds_q81/duckdb:duckdb 36014255 36738736 0.98
tpcds_q82/duckdb:duckdb 8034989 8582342 0.94
tpcds_q83/duckdb:duckdb 8818315 9713084 0.91
tpcds_q84/duckdb:duckdb 14017172 14937528 0.94
tpcds_q85/duckdb:duckdb 🚀 23212745 25955951 0.89
tpcds_q86/duckdb:duckdb 10318172 10570223 0.98
tpcds_q87/duckdb:duckdb 34132615 35399300 0.96
tpcds_q88/duckdb:duckdb 23773603 24459285 0.97
tpcds_q89/duckdb:duckdb 13195059 14094806 0.94
tpcds_q90/duckdb:duckdb 🚀 5328492 6268828 0.85
tpcds_q91/duckdb:duckdb 12753368 13344317 0.96
tpcds_q92/duckdb:duckdb 🚀 8300257 9795112 0.85
tpcds_q93/duckdb:duckdb 🚀 20864110 24009108 0.87
tpcds_q94/duckdb:duckdb 13116021 12894982 1.02
tpcds_q95/duckdb:duckdb 126719902 116615218 1.09
tpcds_q96/duckdb:duckdb 4528247 4724926 0.96
tpcds_q97/duckdb:duckdb 30540553 32048368 0.95
tpcds_q98/duckdb:duckdb 13648664 13903999 0.98
tpcds_q99/duckdb:duckdb 16346385 16531981 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.3% -3.9% +1.7% +10.8% ➖ noise
1 datafusion:vortex-file-compressed +2.8% -3.9% +6.9% +10.8% ➖ noise
1 duckdb:duckdb -2.3% -3.9% +1.7% +11.3% ➖ noise
1 duckdb:vortex-compact -6.3% -3.9% -2.5% +17.9% ➖ noise
1 duckdb:vortex-file-compressed -10.4% -3.9% -6.8% +16.6% ➖ noise
2 datafusion:vortex-compact -3.8% -2.5% -1.4% +10.8% ➖ noise
2 datafusion:vortex-file-compressed -1.1% -2.5% +1.4% +10.8% ➖ noise
2 duckdb:duckdb -1.6% -2.5% +0.9% +12.7% ➖ noise
2 duckdb:vortex-compact -8.3% -2.5% -6.0% +10.8% ➖ noise
2 duckdb:vortex-file-compressed -9.6% -2.5% -7.4% +13.5% ➖ noise
3 datafusion:vortex-compact -3.1% -3.7% +0.6% +12.0% ➖ noise
3 datafusion:vortex-file-compressed +2.1% -3.7% +6.0% +14.6% ➖ noise
3 duckdb:duckdb -8.7% -3.7% -5.3% +18.8% ➖ noise
3 duckdb:vortex-compact -4.4% -3.7% -0.7% +13.4% ➖ noise
3 duckdb:vortex-file-compressed -13.2% -3.7% -9.9% +10.8% ✅ faster
4 datafusion:vortex-compact -8.1% -7.3% -0.9% +10.8% ➖ noise
4 datafusion:vortex-file-compressed -4.8% -7.3% +2.7% +10.8% ➖ noise
4 duckdb:duckdb -5.5% -7.3% +1.9% +10.8% ➖ noise
4 duckdb:vortex-compact -8.0% -7.3% -0.7% +12.7% ➖ noise
4 duckdb:vortex-file-compressed -6.3% -7.3% +1.1% +10.8% ➖ noise
5 datafusion:vortex-compact +0.4% -6.6% +7.5% +10.8% ➖ noise
5 datafusion:vortex-file-compressed +3.6% -6.6% +10.9% +10.8% 🚨 regression
5 duckdb:duckdb -8.0% -6.6% -1.5% +16.0% ➖ noise
5 duckdb:vortex-compact -13.4% -6.6% -7.3% +10.8% ➖ noise
5 duckdb:vortex-file-compressed -9.7% -6.6% -3.3% +11.5% ➖ noise
6 datafusion:vortex-compact -3.0% -2.2% -0.8% +10.8% ➖ noise
6 datafusion:vortex-file-compressed +3.3% -2.2% +5.7% +12.6% ➖ noise
6 duckdb:duckdb -7.9% -2.2% -5.8% +14.5% ➖ noise
6 duckdb:vortex-compact -5.7% -2.2% -3.5% +10.8% ➖ noise
6 duckdb:vortex-file-compressed -7.4% -2.2% -5.3% +10.8% ➖ noise
7 datafusion:vortex-compact -5.2% -6.0% +0.8% +10.8% ➖ noise
7 datafusion:vortex-file-compressed -0.3% -6.0% +6.0% +10.8% ➖ noise
7 duckdb:duckdb -6.8% -6.0% -0.8% +17.6% ➖ noise
7 duckdb:vortex-compact -4.2% -6.0% +1.9% +10.8% ➖ noise
7 duckdb:vortex-file-compressed -8.5% -6.0% -2.6% +15.8% ➖ noise
8 datafusion:vortex-compact -3.8% -0.9% -3.0% +10.8% ➖ noise
8 datafusion:vortex-file-compressed +3.3% -0.9% +4.2% +10.8% ➖ noise
8 duckdb:duckdb -0.9% -0.9% -0.1% +10.8% ➖ noise
8 duckdb:vortex-compact -2.1% -0.9% -1.3% +10.8% ➖ noise
8 duckdb:vortex-file-compressed -7.7% -0.9% -6.9% +10.8% ➖ noise
9 datafusion:vortex-compact -7.8% +1.3% -9.0% +10.8% ➖ noise
9 datafusion:vortex-file-compressed -8.5% +1.3% -9.7% +10.8% ➖ noise
9 duckdb:duckdb +1.5% +1.3% +0.2% +10.8% ➖ noise
9 duckdb:vortex-compact -7.1% +1.3% -8.3% +10.8% ➖ noise
9 duckdb:vortex-file-compressed -10.2% +1.3% -11.4% +11.2% ✅ faster
10 datafusion:vortex-compact +1.4% -4.8% +6.5% +10.8% ➖ noise
10 datafusion:vortex-file-compressed +6.6% -4.8% +12.0% +10.8% 🚨 regression
10 duckdb:duckdb -1.0% -4.8% +3.9% +10.8% ➖ noise
10 duckdb:vortex-compact -5.4% -4.8% -0.6% +10.8% ➖ noise
10 duckdb:vortex-file-compressed -6.7% -4.8% -2.0% +10.8% ➖ noise
11 datafusion:vortex-compact -8.2% -2.0% -6.4% +10.8% ➖ noise
11 datafusion:vortex-file-compressed -1.5% -2.0% +0.5% +10.8% ➖ noise
11 duckdb:duckdb -7.6% -2.0% -5.7% +10.8% ➖ noise
11 duckdb:vortex-compact -3.3% -2.0% -1.3% +10.8% ➖ noise
11 duckdb:vortex-file-compressed -2.5% -2.0% -0.5% +10.8% ➖ noise
12 datafusion:vortex-compact -5.3% -1.7% -3.7% +11.0% ➖ noise
12 datafusion:vortex-file-compressed -5.6% -1.7% -3.9% +13.0% ➖ noise
12 duckdb:duckdb -1.9% -1.7% -0.2% +10.8% ➖ noise
12 duckdb:vortex-compact -8.4% -1.7% -6.8% +17.9% ➖ noise
12 duckdb:vortex-file-compressed -6.3% -1.7% -4.7% +13.8% ➖ noise
13 datafusion:vortex-compact -5.9% -0.9% -5.1% +10.8% ➖ noise
13 datafusion:vortex-file-compressed -2.9% -0.9% -2.1% +10.8% ➖ noise
13 duckdb:duckdb -0.4% -0.9% +0.5% +10.8% ➖ noise
13 duckdb:vortex-compact -3.4% -0.9% -2.6% +10.8% ➖ noise
13 duckdb:vortex-file-compressed -9.2% -0.9% -8.4% +12.4% ➖ noise
14 datafusion:vortex-compact -5.6% -3.7% -1.9% +10.8% ➖ noise
14 datafusion:vortex-file-compressed -1.5% -3.7% +2.4% +10.8% ➖ noise
14 duckdb:duckdb -4.2% -3.7% -0.5% +10.8% ➖ noise
14 duckdb:vortex-compact -5.0% -3.7% -1.3% +10.8% ➖ noise
14 duckdb:vortex-file-compressed +4.0% -3.7% +8.0% +10.8% ➖ noise
15 datafusion:vortex-compact -4.9% -4.6% -0.3% +16.9% ➖ noise
15 datafusion:vortex-file-compressed -15.5% -4.6% -11.5% +14.3% ➖ noise
15 duckdb:duckdb -5.3% -4.6% -0.8% +15.2% ➖ noise
15 duckdb:vortex-compact -8.5% -4.6% -4.1% +12.6% ➖ noise
15 duckdb:vortex-file-compressed -6.6% -4.6% -2.1% +15.5% ➖ noise
16 datafusion:vortex-compact -7.2% -9.0% +1.9% +11.3% ➖ noise
16 datafusion:vortex-file-compressed -2.5% -9.0% +7.1% +10.8% ➖ noise
16 duckdb:duckdb -3.1% -9.0% +6.4% +13.3% ➖ noise
16 duckdb:vortex-compact -5.9% -9.0% +3.3% +15.9% ➖ noise
16 duckdb:vortex-file-compressed -0.4% -9.0% +9.4% +10.8% ➖ noise
17 datafusion:vortex-compact -7.0% -1.5% -5.5% +10.8% ➖ noise
17 datafusion:vortex-file-compressed -5.3% -1.5% -3.8% +10.8% ➖ noise
17 duckdb:duckdb +0.3% -1.5% +1.8% +13.6% ➖ noise
17 duckdb:vortex-compact -6.0% -1.5% -4.5% +10.8% ➖ noise
17 duckdb:vortex-file-compressed -8.6% -1.5% -7.2% +10.8% ➖ noise
18 datafusion:vortex-compact -4.8% -6.2% +1.6% +10.8% ➖ noise
18 datafusion:vortex-file-compressed +2.0% -6.2% +8.7% +10.8% ➖ noise
18 duckdb:duckdb -8.2% -6.2% -2.1% +10.8% ➖ noise
18 duckdb:vortex-compact -1.9% -6.2% +4.6% +11.4% ➖ noise
18 duckdb:vortex-file-compressed -10.9% -6.2% -4.9% +10.8% ➖ noise
19 datafusion:vortex-compact -1.5% -5.1% +3.8% +10.8% ➖ noise
19 datafusion:vortex-file-compressed -2.4% -5.1% +2.8% +10.8% ➖ noise
19 duckdb:duckdb -1.3% -5.1% +4.0% +12.1% ➖ noise
19 duckdb:vortex-compact -12.9% -5.1% -8.2% +10.8% ➖ noise
19 duckdb:vortex-file-compressed -6.8% -5.1% -1.8% +10.8% ➖ noise
20 datafusion:vortex-compact -7.9% -3.4% -4.7% +10.8% ➖ noise
20 datafusion:vortex-file-compressed -0.6% -3.4% +2.9% +10.8% ➖ noise
20 duckdb:duckdb -6.8% -3.4% -3.6% +11.4% ➖ noise
20 duckdb:vortex-compact -10.5% -3.4% -7.4% +10.8% ➖ noise
20 duckdb:vortex-file-compressed -3.7% -3.4% -0.3% +15.9% ➖ noise
21 datafusion:vortex-compact -8.6% -19.4% +13.5% +18.6% ➖ noise
21 datafusion:vortex-file-compressed +1.8% -19.4% +26.4% +11.9% 🚨 regression
21 duckdb:duckdb -5.9% -19.4% +16.8% +19.1% ➖ noise
21 duckdb:vortex-compact -7.1% -19.4% +15.3% +13.3% 🚨 regression
21 duckdb:vortex-file-compressed -1.5% -19.4% +22.3% +22.0% 🚨 regression
22 datafusion:vortex-compact -16.1% +1.5% -17.3% +15.6% ✅ faster
22 datafusion:vortex-file-compressed -4.8% +1.5% -6.2% +12.8% ➖ noise
22 duckdb:duckdb -7.1% +1.5% -8.5% +11.0% ➖ noise
22 duckdb:vortex-compact -7.6% +1.5% -9.0% +10.8% ➖ noise
22 duckdb:vortex-file-compressed -5.7% +1.5% -7.1% +10.9% ➖ noise
23 datafusion:vortex-compact -1.1% -7.4% +6.8% +10.8% ➖ noise
23 datafusion:vortex-file-compressed +1.7% -7.4% +9.8% +10.8% ➖ noise
23 duckdb:duckdb -6.8% -7.4% +0.7% +14.7% ➖ noise
23 duckdb:vortex-compact -11.5% -7.4% -4.5% +10.8% ➖ noise
23 duckdb:vortex-file-compressed -9.4% -7.4% -2.2% +10.8% ➖ noise
24 datafusion:vortex-compact -4.1% -5.6% +1.6% +10.8% ➖ noise
24 datafusion:vortex-file-compressed +1.9% -5.6% +8.0% +10.8% ➖ noise
24 duckdb:duckdb -10.3% -5.6% -4.9% +11.1% ➖ noise
24 duckdb:vortex-compact +0.2% -5.6% +6.2% +12.5% ➖ noise
24 duckdb:vortex-file-compressed -11.5% -5.6% -6.2% +11.2% ➖ noise
25 datafusion:vortex-compact -4.7% -3.3% -1.4% +10.8% ➖ noise
25 datafusion:vortex-file-compressed -0.3% -3.3% +3.1% +10.8% ➖ noise
25 duckdb:duckdb -4.3% -3.3% -1.0% +16.1% ➖ noise
25 duckdb:vortex-compact -2.7% -3.3% +0.6% +10.8% ➖ noise
25 duckdb:vortex-file-compressed -2.5% -3.3% +0.8% +10.8% ➖ noise
26 datafusion:vortex-compact -8.6% -9.4% +0.9% +10.8% ➖ noise
26 datafusion:vortex-file-compressed -2.2% -9.4% +7.9% +10.8% ➖ noise
26 duckdb:duckdb -1.0% -9.4% +9.3% +13.1% ➖ noise
26 duckdb:vortex-compact -3.6% -9.4% +6.4% +13.7% ➖ noise
26 duckdb:vortex-file-compressed -0.5% -9.4% +9.8% +21.9% ➖ noise
27 datafusion:vortex-compact -6.6% -8.3% +1.9% +10.8% ➖ noise
27 datafusion:vortex-file-compressed -4.1% -8.3% +4.6% +10.8% ➖ noise
27 duckdb:duckdb -10.4% -8.3% -2.2% +20.4% ➖ noise
27 duckdb:vortex-compact -7.5% -8.3% +0.9% +10.8% ➖ noise
27 duckdb:vortex-file-compressed -7.8% -8.3% +0.5% +10.8% ➖ noise
28 datafusion:vortex-compact -3.1% -1.5% -1.6% +10.8% ➖ noise
28 datafusion:vortex-file-compressed -21.6% -1.5% -20.4% +10.8% ✅ faster
28 duckdb:duckdb -4.9% -1.5% -3.5% +10.8% ➖ noise
28 duckdb:vortex-compact -2.6% -1.5% -1.1% +10.8% ➖ noise
28 duckdb:vortex-file-compressed -6.7% -1.5% -5.4% +10.8% ➖ noise
29 datafusion:vortex-compact -3.4% -4.3% +1.0% +10.8% ➖ noise
29 datafusion:vortex-file-compressed -0.2% -4.3% +4.4% +10.8% ➖ noise
29 duckdb:duckdb -3.3% -4.3% +1.1% +10.8% ➖ noise
29 duckdb:vortex-compact -7.1% -4.3% -2.9% +10.8% ➖ noise
29 duckdb:vortex-file-compressed -9.7% -4.3% -5.6% +10.8% ➖ noise
30 datafusion:vortex-compact -2.7% -3.7% +1.0% +10.8% ➖ noise
30 datafusion:vortex-file-compressed -6.4% -3.7% -2.8% +12.9% ➖ noise
30 duckdb:duckdb -18.0% -3.7% -14.9% +10.8% ✅ faster
30 duckdb:vortex-compact -9.5% -3.7% -6.0% +17.0% ➖ noise
30 duckdb:vortex-file-compressed -4.3% -3.7% -0.6% +10.8% ➖ noise
31 datafusion:vortex-compact -5.6% -4.3% -1.4% +10.8% ➖ noise
31 datafusion:vortex-file-compressed -2.7% -4.3% +1.6% +10.8% ➖ noise
31 duckdb:duckdb -0.1% -4.3% +4.3% +11.0% ➖ noise
31 duckdb:vortex-compact -3.4% -4.3% +0.9% +10.8% ➖ noise
31 duckdb:vortex-file-compressed -0.1% -4.3% +4.4% +18.7% ➖ noise
32 datafusion:vortex-compact -8.1% -1.9% -6.4% +10.8% ➖ noise
32 datafusion:vortex-file-compressed -5.1% -1.9% -3.3% +10.8% ➖ noise
32 duckdb:duckdb -10.8% -1.9% -9.1% +18.6% ➖ noise
32 duckdb:vortex-compact +1.6% -1.9% +3.5% +10.8% ➖ noise
32 duckdb:vortex-file-compressed -2.2% -1.9% -0.3% +10.8% ➖ noise
33 datafusion:vortex-compact -3.9% -2.3% -1.6% +10.8% ➖ noise
33 datafusion:vortex-file-compressed -7.2% -2.3% -5.0% +11.1% ➖ noise
33 duckdb:duckdb -8.7% -2.3% -6.5% +11.8% ➖ noise
33 duckdb:vortex-compact -6.2% -2.3% -3.9% +11.3% ➖ noise
33 duckdb:vortex-file-compressed -3.8% -2.3% -1.5% +15.6% ➖ noise
34 datafusion:vortex-compact -5.7% -4.8% -1.0% +10.8% ➖ noise
34 datafusion:vortex-file-compressed -5.6% -4.8% -0.9% +10.8% ➖ noise
34 duckdb:duckdb -6.1% -4.8% -1.4% +10.8% ➖ noise
34 duckdb:vortex-compact -10.8% -4.8% -6.4% +10.8% ➖ noise
34 duckdb:vortex-file-compressed -3.8% -4.8% +1.0% +10.8% ➖ noise
35 datafusion:vortex-compact -7.4% -3.4% -4.2% +10.8% ➖ noise
35 datafusion:vortex-file-compressed +1.0% -3.4% +4.5% +10.8% ➖ noise
35 duckdb:duckdb -12.0% -3.4% -8.9% +19.7% ➖ noise
35 duckdb:vortex-compact -10.6% -3.4% -7.4% +10.8% ➖ noise
35 duckdb:vortex-file-compressed -12.5% -3.4% -9.4% +11.6% ➖ noise
36 datafusion:vortex-compact -1.5% -1.5% +0.0% +10.8% ➖ noise
36 datafusion:vortex-file-compressed -4.5% -1.5% -3.0% +10.8% ➖ noise
36 duckdb:duckdb -7.7% -1.5% -6.3% +10.8% ➖ noise
36 duckdb:vortex-compact -8.6% -1.5% -7.2% +10.8% ➖ noise
36 duckdb:vortex-file-compressed +0.6% -1.5% +2.2% +10.8% ➖ noise
37 datafusion:vortex-compact -10.4% -4.0% -6.7% +10.8% ➖ noise
37 datafusion:vortex-file-compressed -6.2% -4.0% -2.3% +13.2% ➖ noise
37 duckdb:duckdb -8.0% -4.0% -4.1% +18.0% ➖ noise
37 duckdb:vortex-compact -7.2% -4.0% -3.3% +12.6% ➖ noise
37 duckdb:vortex-file-compressed -15.4% -4.0% -11.9% +15.6% ➖ noise
38 datafusion:vortex-compact -7.4% -2.5% -5.1% +10.8% ➖ noise
38 datafusion:vortex-file-compressed +2.4% -2.5% +5.0% +10.8% ➖ noise
38 duckdb:duckdb +2.1% -2.5% +4.7% +12.8% ➖ noise
38 duckdb:vortex-compact -9.1% -2.5% -6.8% +15.1% ➖ noise
38 duckdb:vortex-file-compressed -6.1% -2.5% -3.6% +15.4% ➖ noise
39 datafusion:vortex-compact -0.7% -1.9% +1.2% +14.7% ➖ noise
39 datafusion:vortex-file-compressed -3.7% -1.9% -1.8% +16.4% ➖ noise
39 duckdb:duckdb -4.0% -1.9% -2.2% +14.0% ➖ noise
39 duckdb:vortex-compact -4.6% -1.9% -2.8% +17.6% ➖ noise
39 duckdb:vortex-file-compressed -11.6% -1.9% -9.9% +16.6% ➖ noise
40 datafusion:vortex-compact -8.5% -3.0% -5.7% +10.8% ➖ noise
40 datafusion:vortex-file-compressed -5.0% -3.0% -2.1% +10.8% ➖ noise
40 duckdb:duckdb +0.4% -3.0% +3.4% +10.8% ➖ noise
40 duckdb:vortex-compact -8.1% -3.0% -5.3% +13.3% ➖ noise
40 duckdb:vortex-file-compressed -6.4% -3.0% -3.6% +10.8% ➖ noise
41 datafusion:vortex-compact -10.6% -5.9% -5.0% +11.0% ➖ noise
41 datafusion:vortex-file-compressed -2.6% -5.9% +3.6% +10.8% ➖ noise
41 duckdb:duckdb -6.8% -5.9% -0.9% +10.8% ➖ noise
41 duckdb:vortex-compact -9.5% -5.9% -3.8% +10.8% ➖ noise
41 duckdb:vortex-file-compressed -16.8% -5.9% -11.6% +12.8% ✅ faster
42 datafusion:vortex-compact -3.8% -4.7% +1.0% +10.9% ➖ noise
42 datafusion:vortex-file-compressed -2.2% -4.7% +2.7% +10.8% ➖ noise
42 duckdb:duckdb -16.9% -4.7% -12.8% +16.7% ➖ noise
42 duckdb:vortex-compact -4.9% -4.7% -0.2% +16.5% ➖ noise
42 duckdb:vortex-file-compressed -2.8% -4.7% +2.1% +14.7% ➖ noise
43 datafusion:vortex-compact -1.2% -3.0% +1.9% +10.8% ➖ noise
43 datafusion:vortex-file-compressed -2.8% -3.0% +0.2% +10.8% ➖ noise
43 duckdb:duckdb -8.1% -3.0% -5.2% +14.2% ➖ noise
43 duckdb:vortex-compact -4.0% -3.0% -1.0% +10.8% ➖ noise
43 duckdb:vortex-file-compressed -0.9% -3.0% +2.1% +10.8% ➖ noise
44 datafusion:vortex-compact -5.5% -2.9% -2.7% +10.8% ➖ noise
44 datafusion:vortex-file-compressed -5.7% -2.9% -2.9% +10.8% ➖ noise
44 duckdb:duckdb -3.7% -2.9% -0.9% +12.6% ➖ noise
44 duckdb:vortex-compact -2.0% -2.9% +0.9% +12.5% ➖ noise
44 duckdb:vortex-file-compressed -5.9% -2.9% -3.1% +13.1% ➖ noise
45 datafusion:vortex-compact -7.9% -5.4% -2.7% +10.8% ➖ noise
45 datafusion:vortex-file-compressed +0.5% -5.4% +6.2% +10.8% ➖ noise
45 duckdb:duckdb -1.9% -5.4% +3.7% +11.2% ➖ noise
45 duckdb:vortex-compact -10.7% -5.4% -5.6% +15.0% ➖ noise
45 duckdb:vortex-file-compressed -9.2% -5.4% -4.1% +10.8% ➖ noise
46 datafusion:vortex-compact -5.7% -4.2% -1.6% +10.8% ➖ noise
46 datafusion:vortex-file-compressed -1.6% -4.2% +2.7% +10.8% ➖ noise
46 duckdb:duckdb -4.5% -4.2% -0.4% +10.8% ➖ noise
46 duckdb:vortex-compact -6.6% -4.2% -2.5% +10.8% ➖ noise
46 duckdb:vortex-file-compressed -4.8% -4.2% -0.6% +10.8% ➖ noise
47 datafusion:vortex-compact -7.0% -5.6% -1.5% +10.8% ➖ noise
47 datafusion:vortex-file-compressed -6.3% -5.6% -0.8% +10.8% ➖ noise
47 duckdb:duckdb -3.8% -5.6% +1.9% +10.8% ➖ noise
47 duckdb:vortex-compact -7.8% -5.6% -2.4% +12.8% ➖ noise
47 duckdb:vortex-file-compressed -5.4% -5.6% +0.2% +10.8% ➖ noise
48 datafusion:vortex-compact -1.3% -7.0% +6.1% +10.8% ➖ noise
48 datafusion:vortex-file-compressed -1.0% -7.0% +6.5% +10.8% ➖ noise
48 duckdb:duckdb -2.3% -7.0% +5.1% +10.8% ➖ noise
48 duckdb:vortex-compact -3.5% -7.0% +3.7% +10.8% ➖ noise
48 duckdb:vortex-file-compressed -5.2% -7.0% +1.9% +10.8% ➖ noise
49 datafusion:vortex-compact -8.1% -6.8% -1.5% +10.8% ➖ noise
49 datafusion:vortex-file-compressed -4.4% -6.8% +2.6% +10.8% ➖ noise
49 duckdb:duckdb -6.6% -6.8% +0.2% +17.8% ➖ noise
49 duckdb:vortex-compact -6.6% -6.8% +0.1% +11.7% ➖ noise
49 duckdb:vortex-file-compressed -1.4% -6.8% +5.7% +14.0% ➖ noise
50 datafusion:vortex-compact -6.2% -4.5% -1.8% +10.8% ➖ noise
50 datafusion:vortex-file-compressed -5.4% -4.5% -1.0% +10.8% ➖ noise
50 duckdb:duckdb -8.7% -4.5% -4.4% +10.8% ➖ noise
50 duckdb:vortex-compact -7.6% -4.5% -3.3% +10.8% ➖ noise
50 duckdb:vortex-file-compressed -5.3% -4.5% -0.9% +10.8% ➖ noise
51 datafusion:vortex-compact -4.0% -3.5% -0.5% +10.8% ➖ noise
51 datafusion:vortex-file-compressed -0.6% -3.5% +3.0% +10.8% ➖ noise
51 duckdb:duckdb -2.4% -3.5% +1.1% +23.8% ➖ noise
51 duckdb:vortex-compact -5.7% -3.5% -2.3% +16.0% ➖ noise
51 duckdb:vortex-file-compressed -6.1% -3.5% -2.7% +14.4% ➖ noise
52 datafusion:vortex-compact -3.8% -7.9% +4.5% +19.2% ➖ noise
52 datafusion:vortex-file-compressed -4.0% -7.9% +4.3% +14.7% ➖ noise
52 duckdb:duckdb -12.3% -7.9% -4.8% +18.4% ➖ noise
52 duckdb:vortex-compact -1.7% -7.9% +6.7% +14.8% ➖ noise
52 duckdb:vortex-file-compressed -5.0% -7.9% +3.2% +23.1% ➖ noise
53 datafusion:vortex-compact -6.4% -5.0% -1.5% +10.8% ➖ noise
53 datafusion:vortex-file-compressed -7.5% -5.0% -2.6% +10.8% ➖ noise
53 duckdb:duckdb -2.9% -5.0% +2.2% +10.8% ➖ noise
53 duckdb:vortex-compact -6.1% -5.0% -1.1% +10.8% ➖ noise
53 duckdb:vortex-file-compressed -12.2% -5.0% -7.5% +10.8% ➖ noise
54 datafusion:vortex-compact -4.9% -2.4% -2.6% +10.8% ➖ noise
54 datafusion:vortex-file-compressed -5.3% -2.4% -3.0% +10.8% ➖ noise
54 duckdb:duckdb -6.2% -2.4% -3.9% +10.8% ➖ noise
54 duckdb:vortex-compact -5.8% -2.4% -3.5% +10.8% ➖ noise
54 duckdb:vortex-file-compressed -10.5% -2.4% -8.3% +10.8% ➖ noise
55 datafusion:vortex-compact -4.6% -12.4% +8.9% +10.8% ➖ noise
55 datafusion:vortex-file-compressed -7.3% -12.4% +5.8% +10.8% ➖ noise
55 duckdb:duckdb -5.2% -12.4% +8.2% +17.1% ➖ noise
55 duckdb:vortex-compact -1.9% -12.4% +12.0% +15.2% ➖ noise
55 duckdb:vortex-file-compressed -7.2% -12.4% +5.9% +22.0% ➖ noise
56 datafusion:vortex-compact -3.6% -4.3% +0.7% +10.8% ➖ noise
56 datafusion:vortex-file-compressed -1.4% -4.3% +3.0% +10.8% ➖ noise
56 duckdb:duckdb -9.7% -4.3% -5.7% +14.1% ➖ noise
56 duckdb:vortex-compact -10.2% -4.3% -6.2% +10.9% ➖ noise
56 duckdb:vortex-file-compressed -19.5% -4.3% -15.9% +14.1% ✅ faster
57 datafusion:vortex-compact -5.3% -8.9% +3.9% +10.8% ➖ noise
57 datafusion:vortex-file-compressed -4.0% -8.9% +5.3% +10.8% ➖ noise
57 duckdb:duckdb -1.9% -8.9% +7.7% +10.8% ➖ noise
57 duckdb:vortex-compact -7.3% -8.9% +1.7% +12.2% ➖ noise
57 duckdb:vortex-file-compressed -2.9% -8.9% +6.5% +13.9% ➖ noise
58 datafusion:vortex-compact -5.3% -0.2% -5.2% +10.8% ➖ noise
58 datafusion:vortex-file-compressed -5.8% -0.2% -5.6% +10.8% ➖ noise
58 duckdb:duckdb -9.9% -0.2% -9.8% +13.0% ➖ noise
58 duckdb:vortex-compact -7.5% -0.2% -7.3% +13.2% ➖ noise
58 duckdb:vortex-file-compressed -6.8% -0.2% -6.6% +14.8% ➖ noise
59 datafusion:vortex-compact -2.5% +0.7% -3.2% +10.8% ➖ noise
59 datafusion:vortex-file-compressed -1.5% +0.7% -2.1% +10.8% ➖ noise
59 duckdb:duckdb -4.2% +0.7% -4.9% +10.8% ➖ noise
59 duckdb:vortex-compact +0.6% +0.7% -0.1% +10.8% ➖ noise
59 duckdb:vortex-file-compressed -4.1% +0.7% -4.7% +10.8% ➖ noise
60 datafusion:vortex-compact +0.7% +4.1% -3.2% +10.8% ➖ noise
60 datafusion:vortex-file-compressed -4.6% +4.1% -8.3% +10.8% ➖ noise
60 duckdb:duckdb -14.5% +4.1% -17.8% +13.4% ✅ faster
60 duckdb:vortex-compact -8.1% +4.1% -11.7% +10.8% ✅ faster
60 duckdb:vortex-file-compressed -3.1% +4.1% -6.9% +12.5% ➖ noise
61 datafusion:vortex-compact -1.8% -2.3% +0.6% +10.8% ➖ noise
61 datafusion:vortex-file-compressed -2.3% -2.3% +0.1% +10.8% ➖ noise
61 duckdb:duckdb -7.6% -2.3% -5.4% +10.8% ➖ noise
61 duckdb:vortex-compact +0.7% -2.3% +3.1% +11.0% ➖ noise
61 duckdb:vortex-file-compressed -13.3% -2.3% -11.2% +10.8% ✅ faster
62 datafusion:vortex-compact -6.3% +3.5% -9.4% +17.3% ➖ noise
62 datafusion:vortex-file-compressed -3.9% +3.5% -7.1% +15.4% ➖ noise
62 duckdb:duckdb -11.8% +3.5% -14.7% +16.6% ✅ faster
62 duckdb:vortex-compact -11.2% +3.5% -14.2% +30.7% ➖ noise
62 duckdb:vortex-file-compressed -4.5% +3.5% -7.7% +28.8% ➖ noise
63 datafusion:vortex-compact -4.0% -0.3% -3.7% +10.8% ➖ noise
63 datafusion:vortex-file-compressed -7.0% -0.3% -6.7% +10.8% ➖ noise
63 duckdb:duckdb -7.5% -0.3% -7.2% +12.9% ➖ noise
63 duckdb:vortex-compact -1.8% -0.3% -1.6% +10.8% ➖ noise
63 duckdb:vortex-file-compressed -5.5% -0.3% -5.3% +11.8% ➖ noise
64 datafusion:vortex-compact -3.0% -0.1% -2.9% +10.8% ➖ noise
64 datafusion:vortex-file-compressed -3.6% -0.1% -3.6% +10.8% ➖ noise
64 duckdb:duckdb -7.0% -0.1% -6.9% +10.8% ➖ noise
64 duckdb:vortex-compact -6.4% -0.1% -6.4% +10.8% ➖ noise
64 duckdb:vortex-file-compressed -9.5% -0.1% -9.4% +10.8% ➖ noise
65 datafusion:vortex-compact -5.6% +0.9% -6.4% +10.8% ➖ noise
65 datafusion:vortex-file-compressed -10.6% +0.9% -11.4% +11.2% ✅ faster
65 duckdb:duckdb -5.9% +0.9% -6.7% +15.5% ➖ noise
65 duckdb:vortex-compact -0.9% +0.9% -1.8% +10.8% ➖ noise
65 duckdb:vortex-file-compressed -3.4% +0.9% -4.2% +12.9% ➖ noise
66 datafusion:vortex-compact -3.7% -3.8% +0.1% +10.8% ➖ noise
66 datafusion:vortex-file-compressed -12.2% -3.8% -8.8% +11.0% ➖ noise
66 duckdb:duckdb -7.7% -3.8% -4.1% +14.3% ➖ noise
66 duckdb:vortex-compact -6.6% -3.8% -2.9% +13.7% ➖ noise
66 duckdb:vortex-file-compressed -6.6% -3.8% -2.9% +10.8% ➖ noise
67 datafusion:vortex-compact -1.5% -7.9% +7.0% +10.8% ➖ noise
67 datafusion:vortex-file-compressed -3.0% -7.9% +5.3% +10.8% ➖ noise
67 duckdb:duckdb -6.1% -7.9% +2.0% +10.8% ➖ noise
67 duckdb:vortex-compact -5.8% -7.9% +2.3% +10.8% ➖ noise
67 duckdb:vortex-file-compressed -7.6% -7.9% +0.3% +10.8% ➖ noise
68 datafusion:vortex-compact -4.1% -4.6% +0.5% +10.8% ➖ noise
68 datafusion:vortex-file-compressed -6.1% -4.6% -1.7% +14.3% ➖ noise
68 duckdb:duckdb -4.4% -4.6% +0.2% +14.4% ➖ noise
68 duckdb:vortex-compact -12.6% -4.6% -8.4% +10.8% ➖ noise
68 duckdb:vortex-file-compressed -3.3% -4.6% +1.3% +10.8% ➖ noise
69 datafusion:vortex-compact -2.0% -3.1% +1.1% +10.8% ➖ noise
69 datafusion:vortex-file-compressed -16.3% -3.1% -13.6% +13.6% ✅ faster
69 duckdb:duckdb -9.9% -3.1% -7.1% +11.0% ➖ noise
69 duckdb:vortex-compact -5.4% -3.1% -2.4% +10.8% ➖ noise
69 duckdb:vortex-file-compressed -4.9% -3.1% -1.9% +10.8% ➖ noise
70 datafusion:vortex-compact -6.9% -4.1% -2.9% +11.2% ➖ noise
70 datafusion:vortex-file-compressed -10.8% -4.1% -7.0% +10.8% ➖ noise
70 duckdb:duckdb -0.5% -4.1% +3.8% +11.9% ➖ noise
70 duckdb:vortex-compact +4.8% -4.1% +9.3% +14.0% ➖ noise
70 duckdb:vortex-file-compressed -6.1% -4.1% -2.0% +21.5% ➖ noise
71 datafusion:vortex-compact -3.3% +7.5% -10.0% +10.8% ✅ faster
71 datafusion:vortex-file-compressed -18.8% +7.5% -24.5% +12.4% ✅ faster
71 duckdb:duckdb -5.1% +7.5% -11.7% +20.2% ➖ noise
71 duckdb:vortex-compact -4.4% +7.5% -11.1% +14.7% ➖ noise
71 duckdb:vortex-file-compressed -5.9% +7.5% -12.4% +17.6% ➖ noise
72 datafusion:vortex-compact -6.9% -0.7% -6.3% +10.8% ➖ noise
72 datafusion:vortex-file-compressed -5.8% -0.7% -5.1% +10.8% ➖ noise
72 duckdb:duckdb +1.5% -0.7% +2.2% +12.0% ➖ noise
72 duckdb:vortex-compact -3.9% -0.7% -3.2% +10.8% ➖ noise
72 duckdb:vortex-file-compressed -4.5% -0.7% -3.8% +10.8% ➖ noise
73 datafusion:vortex-compact -8.4% +1.3% -9.6% +15.5% ➖ noise
73 datafusion:vortex-file-compressed -1.4% +1.3% -2.6% +28.0% ➖ noise
73 duckdb:duckdb -9.0% +1.3% -10.1% +11.1% ✅ faster
73 duckdb:vortex-compact -3.6% +1.3% -4.8% +10.8% ➖ noise
73 duckdb:vortex-file-compressed -2.1% +1.3% -3.4% +10.8% ➖ noise
74 datafusion:vortex-compact -7.0% -3.9% -3.2% +10.8% ➖ noise
74 datafusion:vortex-file-compressed -5.7% -3.9% -1.9% +10.8% ➖ noise
74 duckdb:duckdb -6.7% -3.9% -2.9% +10.8% ➖ noise
74 duckdb:vortex-compact -11.5% -3.9% -7.9% +13.5% ➖ noise
74 duckdb:vortex-file-compressed -7.0% -3.9% -3.3% +10.8% ➖ noise
75 datafusion:vortex-compact -4.2% -2.8% -1.4% +10.8% ➖ noise
75 datafusion:vortex-file-compressed -4.4% -2.8% -1.6% +10.8% ➖ noise
75 duckdb:duckdb -6.9% -2.8% -4.2% +11.5% ➖ noise
75 duckdb:vortex-compact -7.1% -2.8% -4.4% +10.8% ➖ noise
75 duckdb:vortex-file-compressed -4.2% -2.8% -1.4% +10.8% ➖ noise
76 datafusion:vortex-compact -6.2% +0.4% -6.5% +10.8% ➖ noise
76 datafusion:vortex-file-compressed -4.7% +0.4% -5.1% +11.1% ➖ noise
76 duckdb:duckdb -7.0% +0.4% -7.4% +13.9% ➖ noise
76 duckdb:vortex-compact -8.8% +0.4% -9.2% +12.9% ➖ noise
76 duckdb:vortex-file-compressed -12.7% +0.4% -13.1% +20.9% ➖ noise
77 datafusion:vortex-compact +0.7% -2.6% +3.4% +10.8% ➖ noise
77 datafusion:vortex-file-compressed -4.4% -2.6% -1.8% +10.8% ➖ noise
77 duckdb:duckdb +1.4% -2.6% +4.1% +11.9% ➖ noise
77 duckdb:vortex-compact -6.7% -2.6% -4.1% +11.7% ➖ noise
77 duckdb:vortex-file-compressed -22.3% -2.6% -20.2% +14.0% ✅ faster
78 datafusion:vortex-compact -7.1% -2.1% -5.1% +10.8% ➖ noise
78 datafusion:vortex-file-compressed -11.3% -2.1% -9.4% +10.8% ➖ noise
78 duckdb:duckdb -4.0% -2.1% -2.0% +11.8% ➖ noise
78 duckdb:vortex-compact -5.4% -2.1% -3.4% +10.8% ➖ noise
78 duckdb:vortex-file-compressed -3.3% -2.1% -1.3% +10.8% ➖ noise
79 datafusion:vortex-compact -4.7% -5.8% +1.1% +10.8% ➖ noise
79 datafusion:vortex-file-compressed -4.9% -5.8% +0.9% +10.8% ➖ noise
79 duckdb:duckdb -0.6% -5.8% +5.6% +10.8% ➖ noise
79 duckdb:vortex-compact -3.0% -5.8% +2.9% +12.6% ➖ noise
79 duckdb:vortex-file-compressed -3.2% -5.8% +2.7% +13.1% ➖ noise
80 datafusion:vortex-compact -3.5% -2.8% -0.7% +10.8% ➖ noise
80 datafusion:vortex-file-compressed -3.7% -2.8% -1.0% +10.8% ➖ noise
80 duckdb:duckdb -4.9% -2.8% -2.2% +11.1% ➖ noise
80 duckdb:vortex-compact -3.7% -2.8% -1.0% +10.8% ➖ noise
80 duckdb:vortex-file-compressed -5.0% -2.8% -2.3% +11.2% ➖ noise
81 datafusion:vortex-compact -3.9% -5.9% +2.2% +10.8% ➖ noise
81 datafusion:vortex-file-compressed -14.8% -5.9% -9.4% +12.7% ➖ noise
81 duckdb:duckdb -2.0% -5.9% +4.2% +12.2% ➖ noise
81 duckdb:vortex-compact -9.7% -5.9% -4.1% +10.8% ➖ noise
81 duckdb:vortex-file-compressed -7.8% -5.9% -2.1% +12.1% ➖ noise
82 datafusion:vortex-compact -5.8% -5.1% -0.7% +10.8% ➖ noise
82 datafusion:vortex-file-compressed -8.2% -5.1% -3.3% +13.2% ➖ noise
82 duckdb:duckdb -6.4% -5.1% -1.3% +12.8% ➖ noise
82 duckdb:vortex-compact -12.4% -5.1% -7.7% +10.8% ➖ noise
82 duckdb:vortex-file-compressed -10.6% -5.1% -5.8% +11.7% ➖ noise
83 datafusion:vortex-compact -6.6% -4.1% -2.6% +10.8% ➖ noise
83 datafusion:vortex-file-compressed -9.0% -4.1% -5.1% +10.8% ➖ noise
83 duckdb:duckdb -9.2% -4.1% -5.3% +11.7% ➖ noise
83 duckdb:vortex-compact -5.5% -4.1% -1.5% +11.3% ➖ noise
83 duckdb:vortex-file-compressed -1.0% -4.1% +3.3% +10.8% ➖ noise
84 datafusion:vortex-compact -1.1% -2.1% +1.1% +14.9% ➖ noise
84 datafusion:vortex-file-compressed -8.2% -2.1% -6.3% +12.3% ➖ noise
84 duckdb:duckdb -6.2% -2.1% -4.2% +16.4% ➖ noise
84 duckdb:vortex-compact -6.1% -2.1% -4.1% +10.8% ➖ noise
84 duckdb:vortex-file-compressed -6.9% -2.1% -4.9% +10.8% ➖ noise
85 datafusion:vortex-compact -7.8% -2.5% -5.4% +10.8% ➖ noise
85 datafusion:vortex-file-compressed -8.3% -2.5% -5.9% +10.8% ➖ noise
85 duckdb:duckdb -10.6% -2.5% -8.2% +12.3% ➖ noise
85 duckdb:vortex-compact -6.4% -2.5% -3.9% +10.8% ➖ noise
85 duckdb:vortex-file-compressed -3.5% -2.5% -1.0% +10.8% ➖ noise
86 datafusion:vortex-compact -8.7% -4.6% -4.3% +11.5% ➖ noise
86 datafusion:vortex-file-compressed -7.3% -4.6% -2.8% +11.8% ➖ noise
86 duckdb:duckdb -2.4% -4.6% +2.3% +17.1% ➖ noise
86 duckdb:vortex-compact -14.4% -4.6% -10.3% +16.1% ➖ noise
86 duckdb:vortex-file-compressed -10.5% -4.6% -6.3% +12.2% ➖ noise
87 datafusion:vortex-compact -6.1% +0.9% -6.9% +10.8% ➖ noise
87 datafusion:vortex-file-compressed -5.8% +0.9% -6.6% +10.8% ➖ noise
87 duckdb:duckdb -3.6% +0.9% -4.4% +10.9% ➖ noise
87 duckdb:vortex-compact -2.9% +0.9% -3.8% +15.0% ➖ noise
87 duckdb:vortex-file-compressed +1.5% +0.9% +0.6% +16.6% ➖ noise
88 datafusion:vortex-compact -2.0% -2.3% +0.3% +10.8% ➖ noise
88 datafusion:vortex-file-compressed -0.9% -2.3% +1.4% +10.8% ➖ noise
88 duckdb:duckdb -2.8% -2.3% -0.5% +10.8% ➖ noise
88 duckdb:vortex-compact -6.0% -2.3% -3.7% +10.8% ➖ noise
88 duckdb:vortex-file-compressed -1.4% -2.3% +1.0% +10.8% ➖ noise
89 datafusion:vortex-compact -10.2% -2.0% -8.4% +11.2% ➖ noise
89 datafusion:vortex-file-compressed -1.5% -2.0% +0.6% +11.2% ➖ noise
89 duckdb:duckdb -6.4% -2.0% -4.4% +29.3% ➖ noise
89 duckdb:vortex-compact -5.5% -2.0% -3.5% +12.8% ➖ noise
89 duckdb:vortex-file-compressed -0.6% -2.0% +1.4% +10.9% ➖ noise
90 datafusion:vortex-compact -4.3% -1.0% -3.2% +10.9% ➖ noise
90 datafusion:vortex-file-compressed -7.5% -1.0% -6.5% +10.8% ➖ noise
90 duckdb:duckdb -15.0% -1.0% -14.1% +13.5% ✅ faster
90 duckdb:vortex-compact -4.8% -1.0% -3.8% +12.5% ➖ noise
90 duckdb:vortex-file-compressed -4.6% -1.0% -3.6% +13.8% ➖ noise
91 datafusion:vortex-compact -5.1% -0.7% -4.4% +10.8% ➖ noise
91 datafusion:vortex-file-compressed -5.5% -0.7% -4.9% +10.8% ➖ noise
91 duckdb:duckdb -4.4% -0.7% -3.8% +16.8% ➖ noise
91 duckdb:vortex-compact -6.7% -0.7% -6.1% +10.8% ➖ noise
91 duckdb:vortex-file-compressed -15.3% -0.7% -14.8% +10.8% ✅ faster
92 datafusion:vortex-compact -4.5% -10.3% +6.4% +10.8% ➖ noise
92 datafusion:vortex-file-compressed +3.4% -10.3% +15.2% +10.8% 🚨 regression
92 duckdb:duckdb -15.3% -10.3% -5.6% +11.5% ➖ noise
92 duckdb:vortex-compact -0.9% -10.3% +10.4% +15.2% ➖ noise
92 duckdb:vortex-file-compressed -8.5% -10.3% +2.0% +14.2% ➖ noise
93 datafusion:vortex-compact -7.7% -5.4% -2.5% +10.8% ➖ noise
93 datafusion:vortex-file-compressed +2.0% -5.4% +7.7% +10.8% ➖ noise
93 duckdb:duckdb -13.1% -5.4% -8.2% +13.1% ➖ noise
93 duckdb:vortex-compact -10.4% -5.4% -5.4% +11.4% ➖ noise
93 duckdb:vortex-file-compressed -6.3% -5.4% -1.0% +14.1% ➖ noise
94 datafusion:vortex-compact -3.0% -7.0% +4.2% +10.8% ➖ noise
94 datafusion:vortex-file-compressed -6.1% -7.0% +0.9% +12.0% ➖ noise
94 duckdb:duckdb +1.7% -7.0% +9.3% +12.7% ➖ noise
94 duckdb:vortex-compact -5.6% -7.0% +1.4% +13.7% ➖ noise
94 duckdb:vortex-file-compressed -9.0% -7.0% -2.2% +10.8% ➖ noise
95 datafusion:vortex-compact -5.9% -14.1% +9.5% +10.8% ➖ noise
95 datafusion:vortex-file-compressed -0.9% -14.1% +15.4% +10.8% 🚨 regression
95 duckdb:duckdb +8.7% -14.1% +26.5% +14.8% 🚨 regression
95 duckdb:vortex-compact -1.6% -14.1% +14.5% +19.4% ➖ noise
95 duckdb:vortex-file-compressed +0.6% -14.1% +17.2% +15.9% 🚨 regression
96 datafusion:vortex-compact -6.3% -4.0% -2.4% +10.8% ➖ noise
96 datafusion:vortex-file-compressed -3.9% -4.0% +0.1% +13.3% ➖ noise
96 duckdb:duckdb -4.2% -4.0% -0.2% +23.9% ➖ noise
96 duckdb:vortex-compact -1.9% -4.0% +2.2% +10.8% ➖ noise
96 duckdb:vortex-file-compressed -3.9% -4.0% +0.1% +11.1% ➖ noise
97 datafusion:vortex-compact -0.2% -11.1% +12.2% +14.9% ➖ noise
97 datafusion:vortex-file-compressed -3.4% -11.1% +8.6% +10.8% ➖ noise
97 duckdb:duckdb -4.7% -11.1% +7.2% +12.9% ➖ noise
97 duckdb:vortex-compact -15.2% -11.1% -4.7% +14.8% ➖ noise
97 duckdb:vortex-file-compressed -3.8% -11.1% +8.2% +15.0% ➖ noise
98 datafusion:vortex-compact -8.6% -4.1% -4.7% +16.6% ➖ noise
98 datafusion:vortex-file-compressed -1.4% -4.1% +2.7% +10.8% ➖ noise
98 duckdb:duckdb -1.8% -4.1% +2.3% +11.9% ➖ noise
98 duckdb:vortex-compact -2.4% -4.1% +1.7% +10.9% ➖ noise
98 duckdb:vortex-file-compressed -7.2% -4.1% -3.3% +12.9% ➖ noise
99 datafusion:vortex-compact +1.9% +5.2% -3.1% +16.6% ➖ noise
99 datafusion:vortex-file-compressed -6.5% +5.2% -11.1% +13.6% ➖ noise
99 duckdb:duckdb -1.1% +5.2% -6.0% +23.5% ➖ noise
99 duckdb:vortex-compact -0.2% +5.2% -5.1% +13.4% ➖ noise
99 duckdb:vortex-file-compressed +8.9% +5.2% +3.5% +23.7% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.2%
Vortex (geomean): 1.041x ➖
Parquet (geomean): 1.028x ➖
Shifts: Parquet (control) +2.8% · Median polish +4.1%


datafusion / vortex-file-compressed (1.046x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 406162450 410308690 0.99
tpch_q02/datafusion:vortex-file-compressed 118280872 117576338 1.01
tpch_q03/datafusion:vortex-file-compressed 216684780 206345853 1.05
tpch_q04/datafusion:vortex-file-compressed 103247954 101987661 1.01
tpch_q05/datafusion:vortex-file-compressed 409101996 387272165 1.06
tpch_q06/datafusion:vortex-file-compressed 45240521 41529884 1.09
tpch_q07/datafusion:vortex-file-compressed 591904701 561452645 1.05
tpch_q08/datafusion:vortex-file-compressed 398926000 383999891 1.04
tpch_q09/datafusion:vortex-file-compressed 703787995 676334934 1.04
tpch_q10/datafusion:vortex-file-compressed 247724197 240024127 1.03
tpch_q11/datafusion:vortex-file-compressed 92027762 86112612 1.07
tpch_q12/datafusion:vortex-file-compressed 112637412 108324263 1.04
tpch_q13/datafusion:vortex-file-compressed 236382680 220376228 1.07
tpch_q14/datafusion:vortex-file-compressed 61730374 58325580 1.06
tpch_q15/datafusion:vortex-file-compressed 114996739 108269964 1.06
tpch_q16/datafusion:vortex-file-compressed 82264456 77510834 1.06
tpch_q17/datafusion:vortex-file-compressed 692983314 652124267 1.06
tpch_q18/datafusion:vortex-file-compressed 929721270 890203965 1.04
tpch_q19/datafusion:vortex-file-compressed 99761114 96395560 1.03
tpch_q20/datafusion:vortex-file-compressed 183616146 174693677 1.05
tpch_q21/datafusion:vortex-file-compressed 695600425 661501440 1.05
tpch_q22/datafusion:vortex-file-compressed 62826265 60101997 1.05
datafusion / vortex-compact (1.046x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 446508863 442947384 1.01
tpch_q02/datafusion:vortex-compact 125154590 124899168 1.00
tpch_q03/datafusion:vortex-compact 232333445 218836419 1.06
tpch_q04/datafusion:vortex-compact 125042981 121145767 1.03
tpch_q05/datafusion:vortex-compact 416558007 403632908 1.03
tpch_q06/datafusion:vortex-compact 68406666 63853100 1.07
tpch_q07/datafusion:vortex-compact 615301999 592806495 1.04
tpch_q08/datafusion:vortex-compact 409647019 396963976 1.03
tpch_q09/datafusion:vortex-compact 736741803 688386957 1.07
tpch_q10/datafusion:vortex-compact 294802978 273822529 1.08
tpch_q11/datafusion:vortex-compact 99133697 90932673 1.09
tpch_q12/datafusion:vortex-compact 175666780 170197589 1.03
tpch_q13/datafusion:vortex-compact 283431076 272546961 1.04
tpch_q14/datafusion:vortex-compact 77907729 74842484 1.04
tpch_q15/datafusion:vortex-compact 173408209 171209614 1.01
tpch_q16/datafusion:vortex-compact 87612889 83217357 1.05
tpch_q17/datafusion:vortex-compact 694696460 652474299 1.06
tpch_q18/datafusion:vortex-compact 944926991 896428221 1.05
tpch_q19/datafusion:vortex-compact 150711289 146098875 1.03
tpch_q20/datafusion:vortex-compact 207823746 198080876 1.05
tpch_q21/datafusion:vortex-compact 739214580 698837707 1.06
tpch_q22/datafusion:vortex-compact 75756735 71060715 1.07
datafusion / parquet (1.037x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 421909059 414558725 1.02
tpch_q02/datafusion:parquet 194396309 184525822 1.05
tpch_q03/datafusion:parquet 315397609 300174138 1.05
tpch_q04/datafusion:parquet 137950141 134314995 1.03
tpch_q05/datafusion:parquet 475625555 443140169 1.07
tpch_q06/datafusion:parquet 125841267 125659348 1.00
tpch_q07/datafusion:parquet 668434080 631438678 1.06
tpch_q08/datafusion:parquet 521000123 492578420 1.06
tpch_q09/datafusion:parquet 805815011 765568377 1.05
tpch_q10/datafusion:parquet 530795683 520206551 1.02
tpch_q11/datafusion:parquet 138612514 133344538 1.04
tpch_q12/datafusion:parquet 221205664 215260579 1.03
tpch_q13/datafusion:parquet 347944730 341812741 1.02
tpch_q14/datafusion:parquet 160857967 156303956 1.03
tpch_q15/datafusion:parquet 242949125 249807344 0.97
tpch_q16/datafusion:parquet 143340375 136108753 1.05
tpch_q17/datafusion:parquet 722701638 684714955 1.06
tpch_q18/datafusion:parquet 937148483 885382160 1.06
tpch_q19/datafusion:parquet 280704791 264806318 1.06
tpch_q20/datafusion:parquet 314153763 308394377 1.02
tpch_q21/datafusion:parquet 782783371 729381523 1.07
tpch_q22/datafusion:parquet 223481148 222606626 1.00
datafusion / arrow (1.053x ➖, 0↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 631368097 590464087 1.07
tpch_q02/datafusion:arrow 169506823 165913344 1.02
tpch_q03/datafusion:arrow 500795593 467376889 1.07
tpch_q04/datafusion:arrow 379398394 359660772 1.05
tpch_q05/datafusion:arrow 980264997 934472078 1.05
tpch_q06/datafusion:arrow 293319463 277545187 1.06
tpch_q07/datafusion:arrow 1225889670 1127588150 1.09
tpch_q08/datafusion:arrow 1187714343 1122381526 1.06
tpch_q09/datafusion:arrow 1413749160 1336704404 1.06
tpch_q10/datafusion:arrow 627973601 605585790 1.04
tpch_q11/datafusion:arrow 153388566 149943248 1.02
tpch_q12/datafusion:arrow 681458418 659131593 1.03
tpch_q13/datafusion:arrow 546792839 519509472 1.05
tpch_q14/datafusion:arrow 333267163 307315210 1.08
tpch_q15/datafusion:arrow 731615004 678726496 1.08
tpch_q16/datafusion:arrow 109717375 111031078 0.99
tpch_q17/datafusion:arrow 1373803293 1321106369 1.04
tpch_q18/datafusion:arrow 1952524933 1836890896 1.06
tpch_q19/datafusion:arrow 🚨 548787632 498067839 1.10
tpch_q20/datafusion:arrow 536869131 496773164 1.08
tpch_q21/datafusion:arrow 2978334487 2847567886 1.05
tpch_q22/datafusion:arrow 145251371 142598771 1.02
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 180551505 178089071 1.01
tpch_q02/duckdb:vortex-file-compressed 56167773 54846204 1.02
tpch_q03/duckdb:vortex-file-compressed 133633113 126643921 1.06
tpch_q04/duckdb:vortex-file-compressed 160895980 152089643 1.06
tpch_q05/duckdb:vortex-file-compressed 136490867 132723907 1.03
tpch_q06/duckdb:vortex-file-compressed 53721305 50292950 1.07
tpch_q07/duckdb:vortex-file-compressed 149822313 148941155 1.01
tpch_q08/duckdb:vortex-file-compressed 192979164 176557930 1.09
tpch_q09/duckdb:vortex-file-compressed 351515632 340048269 1.03
tpch_q10/duckdb:vortex-file-compressed 162551077 155528546 1.05
tpch_q11/duckdb:vortex-file-compressed 36478015 36312745 1.00
tpch_q12/duckdb:vortex-file-compressed 91996509 90956168 1.01
tpch_q13/duckdb:vortex-file-compressed 259725957 249354809 1.04
tpch_q14/duckdb:vortex-file-compressed 72702131 72832720 1.00
tpch_q15/duckdb:vortex-file-compressed 102803756 96973945 1.06
tpch_q16/duckdb:vortex-file-compressed 84689720 80114387 1.06
tpch_q17/duckdb:vortex-file-compressed 105444763 102603458 1.03
tpch_q18/duckdb:vortex-file-compressed 285965910 294714414 0.97
tpch_q19/duckdb:vortex-file-compressed 94054498 91599406 1.03
tpch_q20/duckdb:vortex-file-compressed 165141733 167315125 0.99
tpch_q21/duckdb:vortex-file-compressed 582199288 564239975 1.03
tpch_q22/duckdb:vortex-file-compressed 79318969 76296087 1.04
duckdb / vortex-compact (1.043x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 233984954 230026311 1.02
tpch_q02/duckdb:vortex-compact 61692361 58604846 1.05
tpch_q03/duckdb:vortex-compact 147557124 140718102 1.05
tpch_q04/duckdb:vortex-compact 183312948 178731387 1.03
tpch_q05/duckdb:vortex-compact 153505544 147573088 1.04
tpch_q06/duckdb:vortex-compact 90272696 84658464 1.07
tpch_q07/duckdb:vortex-compact 215091541 206611607 1.04
tpch_q08/duckdb:vortex-compact 200247938 191431247 1.05
tpch_q09/duckdb:vortex-compact 380399627 365288938 1.04
tpch_q10/duckdb:vortex-compact 194525593 186753035 1.04
tpch_q11/duckdb:vortex-compact 45293016 42787104 1.06
tpch_q12/duckdb:vortex-compact 211253572 208880505 1.01
tpch_q13/duckdb:vortex-compact 309791134 297399308 1.04
tpch_q14/duckdb:vortex-compact 111414334 102747488 1.08
tpch_q15/duckdb:vortex-compact 123731094 119880850 1.03
tpch_q16/duckdb:vortex-compact 88806035 85160982 1.04
tpch_q17/duckdb:vortex-compact 122868930 117483961 1.05
tpch_q18/duckdb:vortex-compact 311219390 302868845 1.03
tpch_q19/duckdb:vortex-compact 119124851 115786845 1.03
tpch_q20/duckdb:vortex-compact 222389050 208416667 1.07
tpch_q21/duckdb:vortex-compact 664162558 635931767 1.04
tpch_q22/duckdb:vortex-compact 93329663 90211532 1.03
duckdb / parquet (1.019x ➖, 0↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 255825095 258842652 0.99
tpch_q02/duckdb:parquet 99588692 106208358 0.94
tpch_q03/duckdb:parquet 210392446 209542618 1.00
tpch_q04/duckdb:parquet 139384448 134412835 1.04
tpch_q05/duckdb:parquet 225446248 218980464 1.03
tpch_q06/duckdb:parquet 68422321 71009729 0.96
tpch_q07/duckdb:parquet 184038028 174209747 1.06
tpch_q08/duckdb:parquet 261362317 253461391 1.03
tpch_q09/duckdb:parquet 469808556 472123635 1.00
tpch_q10/duckdb:parquet 621795936 607649018 1.02
tpch_q11/duckdb:parquet 🚨 47863035 41633512 1.15
tpch_q12/duckdb:parquet 129261314 125643055 1.03
tpch_q13/duckdb:parquet 448725965 440963214 1.02
tpch_q14/duckdb:parquet 173540839 173245639 1.00
tpch_q15/duckdb:parquet 99616154 97772249 1.02
tpch_q16/duckdb:parquet 167361146 161296497 1.04
tpch_q17/duckdb:parquet 178603302 181144297 0.99
tpch_q18/duckdb:parquet 354739547 349735457 1.01
tpch_q19/duckdb:parquet 301027834 284973119 1.06
tpch_q20/duckdb:parquet 236058040 234936582 1.00
tpch_q21/duckdb:parquet 592271373 571546829 1.04
tpch_q22/duckdb:parquet 297599516 294548082 1.01
duckdb / duckdb (1.022x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117734484 116929333 1.01
tpch_q02/duckdb:duckdb 48495163 45608438 1.06
tpch_q03/duckdb:duckdb 101321190 97439131 1.04
tpch_q04/duckdb:duckdb 136919971 132600377 1.03
tpch_q05/duckdb:duckdb 111791965 109822223 1.02
tpch_q06/duckdb:duckdb 40633842 39523090 1.03
tpch_q07/duckdb:duckdb 87903670 86470520 1.02
tpch_q08/duckdb:duckdb 115626085 111319598 1.04
tpch_q09/duckdb:duckdb 282072182 278265236 1.01
tpch_q10/duckdb:duckdb 213713541 209035716 1.02
tpch_q11/duckdb:duckdb 16748021 16716624 1.00
tpch_q12/duckdb:duckdb 85024791 84464226 1.01
tpch_q13/duckdb:duckdb 257671753 248172129 1.04
tpch_q14/duckdb:duckdb 73083984 70479028 1.04
tpch_q15/duckdb:duckdb 80336121 78905006 1.02
tpch_q16/duckdb:duckdb 76512442 74672168 1.02
tpch_q17/duckdb:duckdb 85494487 84142279 1.02
tpch_q18/duckdb:duckdb 219924728 212246055 1.04
tpch_q19/duckdb:duckdb 117928596 118318392 1.00
tpch_q20/duckdb:duckdb 113059120 111970303 1.01
tpch_q21/duckdb:duckdb 310234579 310008395 1.00
tpch_q22/duckdb:duckdb 72175366 71384616 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +6.9% +0.3% +6.6% +10.0% ➖ noise
1 datafusion:vortex-compact +0.8% +0.3% +0.5% +11.2% ➖ noise
1 datafusion:vortex-file-compressed -1.0% +0.3% -1.3% +12.9% ➖ noise
1 duckdb:duckdb +0.7% +0.3% +0.4% +10.0% ➖ noise
1 duckdb:vortex-compact +1.7% +0.3% +1.4% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +1.4% +0.3% +1.1% +10.0% ➖ noise
2 datafusion:arrow +2.2% -0.6% +2.8% +10.0% ➖ noise
2 datafusion:vortex-compact +0.2% -0.6% +0.8% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.6% -0.6% +1.2% +10.0% ➖ noise
2 duckdb:duckdb +6.3% -0.6% +7.0% +10.0% ➖ noise
2 duckdb:vortex-compact +5.3% -0.6% +5.9% +13.1% ➖ noise
2 duckdb:vortex-file-compressed +2.4% -0.6% +3.0% +10.0% ➖ noise
3 datafusion:arrow +7.2% +2.7% +4.3% +10.0% ➖ noise
3 datafusion:vortex-compact +6.2% +2.7% +3.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +5.0% +2.7% +2.2% +10.0% ➖ noise
3 duckdb:duckdb +4.0% +2.7% +1.2% +10.0% ➖ noise
3 duckdb:vortex-compact +4.9% +2.7% +2.1% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +5.5% +2.7% +2.7% +10.0% ➖ noise
4 datafusion:arrow +5.5% +3.2% +2.2% +10.0% ➖ noise
4 datafusion:vortex-compact +3.2% +3.2% +0.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.2% +3.2% -1.9% +10.0% ➖ noise
4 duckdb:duckdb +3.3% +3.2% +0.1% +10.0% ➖ noise
4 duckdb:vortex-compact +2.6% +3.2% -0.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +5.8% +3.2% +2.5% +10.0% ➖ noise
5 datafusion:arrow +4.9% +5.1% -0.2% +10.0% ➖ noise
5 datafusion:vortex-compact +3.2% +5.1% -1.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +5.6% +5.1% +0.5% +10.0% ➖ noise
5 duckdb:duckdb +1.8% +5.1% -3.2% +10.0% ➖ noise
5 duckdb:vortex-compact +4.0% +5.1% -1.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.8% +5.1% -2.2% +10.0% ➖ noise
6 datafusion:arrow +5.7% -1.8% +7.6% +10.0% ➖ noise
6 datafusion:vortex-compact +7.1% -1.8% +9.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +8.9% -1.8% +10.9% +10.0% 🚨 regression
6 duckdb:duckdb +2.8% -1.8% +4.7% +17.4% ➖ noise
6 duckdb:vortex-compact +6.6% -1.8% +8.6% +10.5% ➖ noise
6 duckdb:vortex-file-compressed +6.8% -1.8% +8.7% +13.3% ➖ noise
7 datafusion:arrow +8.7% +5.8% +2.8% +10.0% ➖ noise
7 datafusion:vortex-compact +3.8% +5.8% -1.8% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.4% +5.8% -0.3% +10.0% ➖ noise
7 duckdb:duckdb +1.7% +5.8% -3.9% +10.6% ➖ noise
7 duckdb:vortex-compact +4.1% +5.8% -1.6% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +0.6% +5.8% -4.9% +10.0% ➖ noise
8 datafusion:arrow +5.8% +4.4% +1.3% +10.0% ➖ noise
8 datafusion:vortex-compact +3.2% +4.4% -1.2% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +3.9% +4.4% -0.5% +10.0% ➖ noise
8 duckdb:duckdb +3.9% +4.4% -0.5% +10.0% ➖ noise
8 duckdb:vortex-compact +4.6% +4.4% +0.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +9.3% +4.4% +4.7% +10.0% ➖ noise
9 datafusion:arrow +5.8% +2.3% +3.3% +10.0% ➖ noise
9 datafusion:vortex-compact +7.0% +2.3% +4.6% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.1% +2.3% +1.7% +10.0% ➖ noise
9 duckdb:duckdb +1.4% +2.3% -1.0% +10.0% ➖ noise
9 duckdb:vortex-compact +4.1% +2.3% +1.8% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +3.4% +2.3% +1.0% +10.0% ➖ noise
10 datafusion:arrow +3.7% +2.2% +1.5% +10.0% ➖ noise
10 datafusion:vortex-compact +7.7% +2.2% +5.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +3.2% +2.2% +1.0% +10.0% ➖ noise
10 duckdb:duckdb +2.2% +2.2% +0.1% +10.0% ➖ noise
10 duckdb:vortex-compact +4.2% +2.2% +1.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +4.5% +2.2% +2.3% +10.0% ➖ noise
11 datafusion:arrow +2.3% +9.3% -6.4% +10.0% ➖ noise
11 datafusion:vortex-compact +9.0% +9.3% -0.3% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +6.9% +9.3% -2.2% +10.0% ➖ noise
11 duckdb:duckdb +0.2% +9.3% -8.4% +15.9% ➖ noise
11 duckdb:vortex-compact +5.9% +9.3% -3.2% +13.7% ➖ noise
11 duckdb:vortex-file-compressed +0.5% +9.3% -8.1% +12.5% ➖ noise
12 datafusion:arrow +3.4% +2.8% +0.6% +43.3% ➖ noise
12 datafusion:vortex-compact +3.2% +2.8% +0.4% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.0% +2.8% +1.1% +10.0% ➖ noise
12 duckdb:duckdb +0.7% +2.8% -2.1% +10.0% ➖ noise
12 duckdb:vortex-compact +1.1% +2.8% -1.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.1% +2.8% -1.6% +10.0% ➖ noise
13 datafusion:arrow +5.3% +1.8% +3.4% +10.0% ➖ noise
13 datafusion:vortex-compact +4.0% +1.8% +2.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +7.3% +1.8% +5.4% +10.0% ➖ noise
13 duckdb:duckdb +3.8% +1.8% +2.0% +10.0% ➖ noise
13 duckdb:vortex-compact +4.2% +1.8% +2.3% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +4.2% +1.8% +2.3% +10.0% ➖ noise
14 datafusion:arrow +8.4% +1.5% +6.8% +10.0% ➖ noise
14 datafusion:vortex-compact +4.1% +1.5% +2.5% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.8% +1.5% +4.2% +13.1% ➖ noise
14 duckdb:duckdb +3.7% +1.5% +2.1% +10.0% ➖ noise
14 duckdb:vortex-compact +8.4% +1.5% +6.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -0.2% +1.5% -1.7% +13.5% ➖ noise
15 datafusion:arrow +7.8% -0.5% +8.3% +10.0% ➖ noise
15 datafusion:vortex-compact +1.3% -0.5% +1.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +6.2% -0.5% +6.7% +10.0% ➖ noise
15 duckdb:duckdb +1.8% -0.5% +2.3% +10.0% ➖ noise
15 duckdb:vortex-compact +3.2% -0.5% +3.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +6.0% -0.5% +6.5% +10.0% ➖ noise
16 datafusion:arrow -1.2% +4.5% -5.5% +11.3% ➖ noise
16 datafusion:vortex-compact +5.3% +4.5% +0.7% +10.9% ➖ noise
16 datafusion:vortex-file-compressed +6.1% +4.5% +1.5% +11.4% ➖ noise
16 duckdb:duckdb +2.5% +4.5% -2.0% +11.9% ➖ noise
16 duckdb:vortex-compact +4.3% +4.5% -0.2% +11.3% ➖ noise
16 duckdb:vortex-file-compressed +5.7% +4.5% +1.1% +13.0% ➖ noise
17 datafusion:arrow +4.0% +2.0% +1.9% +10.0% ➖ noise
17 datafusion:vortex-compact +6.5% +2.0% +4.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +6.3% +2.0% +4.2% +10.0% ➖ noise
17 duckdb:duckdb +1.6% +2.0% -0.4% +10.0% ➖ noise
17 duckdb:vortex-compact +4.6% +2.0% +2.5% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +2.8% +2.0% +0.7% +10.0% ➖ noise
18 datafusion:arrow +6.3% +3.6% +2.6% +10.0% ➖ noise
18 datafusion:vortex-compact +5.4% +3.6% +1.7% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.4% +3.6% +0.8% +10.0% ➖ noise
18 duckdb:duckdb +3.6% +3.6% +0.0% +10.0% ➖ noise
18 duckdb:vortex-compact +2.8% +3.6% -0.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.0% +3.6% -6.4% +10.0% ➖ noise
19 datafusion:arrow +10.2% +5.8% +4.1% +10.0% ➖ noise
19 datafusion:vortex-compact +3.2% +5.8% -2.5% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.5% +5.8% -2.2% +10.0% ➖ noise
19 duckdb:duckdb -0.3% +5.8% -5.8% +10.0% ➖ noise
19 duckdb:vortex-compact +2.9% +5.8% -2.8% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.7% +5.8% -3.0% +10.0% ➖ noise
20 datafusion:arrow +8.1% +1.2% +6.8% +10.0% ➖ noise
20 datafusion:vortex-compact +4.9% +1.2% +3.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +5.1% +1.2% +3.9% +10.0% ➖ noise
20 duckdb:duckdb +1.0% +1.2% -0.2% +10.0% ➖ noise
20 duckdb:vortex-compact +6.7% +1.2% +5.5% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -1.3% +1.2% -2.4% +10.0% ➖ noise
21 datafusion:arrow +4.6% +5.5% -0.8% +10.0% ➖ noise
21 datafusion:vortex-compact +5.8% +5.5% +0.3% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +5.2% +5.5% -0.3% +10.0% ➖ noise
21 duckdb:duckdb +0.1% +5.5% -5.1% +10.0% ➖ noise
21 duckdb:vortex-compact +4.4% +5.5% -1.0% +10.0% ➖ noise
21 duckdb:vortex-file-compressed +3.2% +5.5% -2.2% +10.0% ➖ noise
22 datafusion:arrow +1.9% +0.7% +1.1% +10.0% ➖ noise
22 datafusion:vortex-compact +6.6% +0.7% +5.9% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +4.5% +0.7% +3.8% +12.0% ➖ noise
22 duckdb:duckdb +1.1% +0.7% +0.4% +13.8% ➖ noise
22 duckdb:vortex-compact +3.5% +0.7% +2.7% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +4.0% +0.7% +3.2% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.0%
Vortex (geomean): 0.968x ➖
Parquet (geomean): 0.988x ➖
Shifts: Parquet (control) -1.2% · Median polish -1.5%


duckdb / vortex-file-compressed (0.948x ➖, 1↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11515551 11724697 0.98
statpopgen_q01/duckdb:vortex-file-compressed 🚀 20371300 28028550 0.73
statpopgen_q02/duckdb:vortex-file-compressed 1325409127 1332964947 0.99
statpopgen_q03/duckdb:vortex-file-compressed 3069298130 3180385451 0.97
statpopgen_q04/duckdb:vortex-file-compressed 3140225029 3096155536 1.01
statpopgen_q05/duckdb:vortex-file-compressed 1422710571 1460550192 0.97
statpopgen_q06/duckdb:vortex-file-compressed 2090229935 2148806181 0.97
statpopgen_q07/duckdb:vortex-file-compressed 231961856 245514474 0.94
statpopgen_q08/duckdb:vortex-file-compressed 249346418 265016190 0.94
statpopgen_q09/duckdb:vortex-file-compressed 2872271435 2992549477 0.96
statpopgen_q10/duckdb:vortex-file-compressed 4740347193 4775853165 0.99
duckdb / vortex-compact (0.987x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11548824 11775456 0.98
statpopgen_q01/duckdb:vortex-compact 171013709 167578965 1.02
statpopgen_q02/duckdb:vortex-compact 1854175623 1894625859 0.98
statpopgen_q03/duckdb:vortex-compact 3557002261 3628985586 0.98
statpopgen_q04/duckdb:vortex-compact 3618151538 3644067981 0.99
statpopgen_q05/duckdb:vortex-compact 1876109756 1895417150 0.99
statpopgen_q06/duckdb:vortex-compact 2713284019 2756953528 0.98
statpopgen_q07/duckdb:vortex-compact 953313759 969487997 0.98
statpopgen_q08/duckdb:vortex-compact 991125987 1010926717 0.98
statpopgen_q09/duckdb:vortex-compact 3437154165 3468621453 0.99
statpopgen_q10/duckdb:vortex-compact 5486658237 5596377522 0.98
duckdb / parquet (0.988x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 324482971 326964523 0.99
statpopgen_q01/duckdb:parquet 412992743 412721892 1.00
statpopgen_q02/duckdb:parquet 1011646967 1034125951 0.98
statpopgen_q03/duckdb:parquet 1502775278 1557745344 0.96
statpopgen_q04/duckdb:parquet 1525275925 1559948369 0.98
statpopgen_q05/duckdb:parquet 1029692458 1023620931 1.01
statpopgen_q06/duckdb:parquet 1513676280 1536276404 0.99
statpopgen_q07/duckdb:parquet 1941575895 1935633576 1.00
statpopgen_q08/duckdb:parquet 1937021570 1969250638 0.98
statpopgen_q09/duckdb:parquet 1420036922 1441076740 0.99
statpopgen_q10/duckdb:parquet 2684283783 2713394122 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -1.9% -0.8% -1.2% +10.0% ➖ noise
0 duckdb:vortex-file-compressed -1.8% -0.8% -1.0% +10.0% ➖ noise
1 duckdb:vortex-compact +2.0% +0.1% +2.0% +31.4% ➖ noise
1 duckdb:vortex-file-compressed -27.3% +0.1% -27.4% +262.4% ➖ noise
2 duckdb:vortex-compact -2.1% -2.2% +0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -0.6% -2.2% +1.6% +10.0% ➖ noise
3 duckdb:vortex-compact -2.0% -3.5% +1.6% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -3.5% -3.5% +0.0% +10.0% ➖ noise
4 duckdb:vortex-compact -0.7% -2.2% +1.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.4% -2.2% +3.7% +10.0% ➖ noise
5 duckdb:vortex-compact -1.0% +0.6% -1.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -2.6% +0.6% -3.2% +10.0% ➖ noise
6 duckdb:vortex-compact -1.6% -1.5% -0.1% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.7% -1.5% -1.3% +10.0% ➖ noise
7 duckdb:vortex-compact -1.7% +0.3% -2.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -5.5% +0.3% -5.8% +10.0% ➖ noise
8 duckdb:vortex-compact -2.0% -1.6% -0.3% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -5.9% -1.6% -4.3% +10.0% ➖ noise
9 duckdb:vortex-compact -0.9% -1.5% +0.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -4.0% -1.5% -2.6% +10.0% ➖ noise
10 duckdb:vortex-compact -2.0% -1.1% -0.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.7% -1.1% +0.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 1.268x ❌
Parquet (geomean): 1.206x ❌
Shifts: Parquet (control) +20.6% · Median polish +22.0%


datafusion / vortex-file-compressed (1.298x ❌, 0↑ 42↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2724240 1948703 1.40
clickbench_q01/datafusion:vortex-file-compressed 🚨 17232914 14214973 1.21
clickbench_q02/datafusion:vortex-file-compressed 🚨 40102807 35324958 1.14
clickbench_q03/datafusion:vortex-file-compressed 🚨 43743670 36941881 1.18
clickbench_q04/datafusion:vortex-file-compressed 🚨 391834865 306114299 1.28
clickbench_q05/datafusion:vortex-file-compressed 🚨 416743016 315572922 1.32
clickbench_q06/datafusion:vortex-file-compressed 🚨 2835100 1956038 1.45
clickbench_q07/datafusion:vortex-file-compressed 🚨 20935888 18100466 1.16
clickbench_q08/datafusion:vortex-file-compressed 🚨 478499598 367093813 1.30
clickbench_q09/datafusion:vortex-file-compressed 🚨 866000764 555724977 1.56
clickbench_q10/datafusion:vortex-file-compressed 🚨 91654455 75875554 1.21
clickbench_q11/datafusion:vortex-file-compressed 🚨 105162250 81929361 1.28
clickbench_q12/datafusion:vortex-file-compressed 🚨 357606706 271613796 1.32
clickbench_q13/datafusion:vortex-file-compressed 🚨 531713304 413073182 1.29
clickbench_q14/datafusion:vortex-file-compressed 🚨 333428908 256015976 1.30
clickbench_q15/datafusion:vortex-file-compressed 🚨 463878709 364472015 1.27
clickbench_q16/datafusion:vortex-file-compressed 🚨 1007318573 694048425 1.45
clickbench_q17/datafusion:vortex-file-compressed 🚨 902131864 681723187 1.32
clickbench_q18/datafusion:vortex-file-compressed 🚨 1904056937 1347865649 1.41
clickbench_q19/datafusion:vortex-file-compressed 🚨 31779978 22361587 1.42
clickbench_q20/datafusion:vortex-file-compressed 🚨 408064181 357358319 1.14
clickbench_q21/datafusion:vortex-file-compressed 🚨 501796920 399122307 1.26
clickbench_q22/datafusion:vortex-file-compressed 🚨 638053752 494627319 1.29
clickbench_q23/datafusion:vortex-file-compressed 🚨 1124718165 818081878 1.37
clickbench_q24/datafusion:vortex-file-compressed 🚨 62770166 43621711 1.44
clickbench_q25/datafusion:vortex-file-compressed 🚨 97262818 67888938 1.43
clickbench_q26/datafusion:vortex-file-compressed 🚨 63752511 43444255 1.47
clickbench_q27/datafusion:vortex-file-compressed 🚨 986358311 799838551 1.23
clickbench_q28/datafusion:vortex-file-compressed 7539852757 6887299718 1.09
clickbench_q29/datafusion:vortex-file-compressed 🚨 271951442 245768657 1.11
clickbench_q30/datafusion:vortex-file-compressed 🚨 336406760 227404136 1.48
clickbench_q31/datafusion:vortex-file-compressed 🚨 377736196 271170196 1.39
clickbench_q32/datafusion:vortex-file-compressed 🚨 1735943716 1354697158 1.28
clickbench_q33/datafusion:vortex-file-compressed 🚨 1857916852 1403164407 1.32
clickbench_q34/datafusion:vortex-file-compressed 🚨 1868341073 1400589486 1.33
clickbench_q35/datafusion:vortex-file-compressed 🚨 656826098 504372312 1.30
clickbench_q36/datafusion:vortex-file-compressed 🚨 104517329 80481713 1.30
clickbench_q37/datafusion:vortex-file-compressed 🚨 47545310 38770939 1.23
clickbench_q38/datafusion:vortex-file-compressed 🚨 27374138 22727716 1.20
clickbench_q39/datafusion:vortex-file-compressed 🚨 184384582 146044429 1.26
clickbench_q40/datafusion:vortex-file-compressed 🚨 23964454 19646326 1.22
clickbench_q41/datafusion:vortex-file-compressed 🚨 21755838 16909875 1.29
clickbench_q42/datafusion:vortex-file-compressed 🚨 23146461 18532776 1.25
datafusion / parquet (1.247x ❌, 0↑ 41↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 🚨 2696169 1828687 1.47
clickbench_q01/datafusion:parquet 🚨 24319915 20845303 1.17
clickbench_q02/datafusion:parquet 🚨 62581809 55634868 1.12
clickbench_q03/datafusion:parquet 🚨 49510088 43308818 1.14
clickbench_q04/datafusion:parquet 🚨 430906778 341558041 1.26
clickbench_q05/datafusion:parquet 🚨 470960262 358091127 1.32
clickbench_q06/datafusion:parquet 🚨 2424496 1800705 1.35
clickbench_q07/datafusion:parquet 🚨 31159043 23867378 1.31
clickbench_q08/datafusion:parquet 🚨 529101404 412687224 1.28
clickbench_q09/datafusion:parquet 🚨 885300564 659023479 1.34
clickbench_q10/datafusion:parquet 🚨 136321180 107066860 1.27
clickbench_q11/datafusion:parquet 🚨 167859633 134987529 1.24
clickbench_q12/datafusion:parquet 🚨 449297119 368537711 1.22
clickbench_q13/datafusion:parquet 🚨 645869172 511895452 1.26
clickbench_q14/datafusion:parquet 🚨 459522513 355939085 1.29
clickbench_q15/datafusion:parquet 🚨 501646509 386867133 1.30
clickbench_q16/datafusion:parquet 🚨 968975511 697716494 1.39
clickbench_q17/datafusion:parquet 🚨 882232300 680401291 1.30
clickbench_q18/datafusion:parquet 🚨 1857705156 1570903142 1.18
clickbench_q19/datafusion:parquet 🚨 38044413 33495122 1.14
clickbench_q20/datafusion:parquet 🚨 738596830 598553084 1.23
clickbench_q21/datafusion:parquet 🚨 804604846 658983367 1.22
clickbench_q22/datafusion:parquet 🚨 1231198417 958129349 1.29
clickbench_q23/datafusion:parquet 🚨 4607107850 3647892749 1.26
clickbench_q24/datafusion:parquet 🚨 105208560 88143770 1.19
clickbench_q25/datafusion:parquet 🚨 167420949 138850922 1.21
clickbench_q26/datafusion:parquet 🚨 101882976 89304870 1.14
clickbench_q27/datafusion:parquet 🚨 1319778751 1044507108 1.26
clickbench_q28/datafusion:parquet 7236701613 6597212398 1.10
clickbench_q29/datafusion:parquet 259656994 242167770 1.07
clickbench_q30/datafusion:parquet 🚨 446954949 361230180 1.24
clickbench_q31/datafusion:parquet 🚨 520897299 390770302 1.33
clickbench_q32/datafusion:parquet 🚨 1626221090 1199838684 1.36
clickbench_q33/datafusion:parquet 🚨 2159122420 1499952012 1.44
clickbench_q34/datafusion:parquet 🚨 2026239515 1486276214 1.36
clickbench_q35/datafusion:parquet 🚨 684960599 530372389 1.29
clickbench_q36/datafusion:parquet 🚨 184093053 144292610 1.28
clickbench_q37/datafusion:parquet 🚨 71544408 62018350 1.15
clickbench_q38/datafusion:parquet 🚨 109121862 89603271 1.22
clickbench_q39/datafusion:parquet 🚨 332327854 270389851 1.23
clickbench_q40/datafusion:parquet 🚨 41958387 34461594 1.22
clickbench_q41/datafusion:parquet 🚨 34207375 29452468 1.16
clickbench_q42/datafusion:parquet 🚨 36672961 31914766 1.15
duckdb / vortex-file-compressed (1.239x ❌, 1↑ 42↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 8354956 5862736 1.43
clickbench_q01/duckdb:vortex-file-compressed 🚨 17618693 13658937 1.29
clickbench_q02/duckdb:vortex-file-compressed 🚨 33081974 24924044 1.33
clickbench_q03/duckdb:vortex-file-compressed 🚨 40355163 30173437 1.34
clickbench_q04/duckdb:vortex-file-compressed 🚨 210505671 170659365 1.23
clickbench_q05/duckdb:vortex-file-compressed 🚨 281800296 195533222 1.44
clickbench_q06/duckdb:vortex-file-compressed 🚨 25366837 18263997 1.39
clickbench_q07/duckdb:vortex-file-compressed 🚨 24051620 14985624 1.60
clickbench_q08/duckdb:vortex-file-compressed 🚨 331718644 262780937 1.26
clickbench_q09/duckdb:vortex-file-compressed 🚨 461461370 375832448 1.23
clickbench_q10/duckdb:vortex-file-compressed 🚨 101664913 74294728 1.37
clickbench_q11/duckdb:vortex-file-compressed 🚨 100066222 84279292 1.19
clickbench_q12/duckdb:vortex-file-compressed 🚨 259753934 210280762 1.24
clickbench_q13/duckdb:vortex-file-compressed 🚨 561556730 438214588 1.28
clickbench_q14/duckdb:vortex-file-compressed 🚨 302590607 239402002 1.26
clickbench_q15/duckdb:vortex-file-compressed 🚨 255475928 210099922 1.22
clickbench_q16/duckdb:vortex-file-compressed 🚨 838266607 695731041 1.20
clickbench_q17/duckdb:vortex-file-compressed 🚨 756995009 558829159 1.35
clickbench_q18/duckdb:vortex-file-compressed 🚨 1414713673 1166383812 1.21
clickbench_q19/duckdb:vortex-file-compressed 🚨 26097463 21998841 1.19
clickbench_q20/duckdb:vortex-file-compressed 🚨 460474238 384692115 1.20
clickbench_q21/duckdb:vortex-file-compressed 🚨 507815725 409257479 1.24
clickbench_q22/duckdb:vortex-file-compressed 🚨 735955256 561418915 1.31
clickbench_q23/duckdb:vortex-file-compressed 🚀 1011479991 1589186455 0.64
clickbench_q24/duckdb:vortex-file-compressed 🚨 58392867 51580846 1.13
clickbench_q25/duckdb:vortex-file-compressed 🚨 93290183 77822024 1.20
clickbench_q26/duckdb:vortex-file-compressed 🚨 53733244 46337711 1.16
clickbench_q27/duckdb:vortex-file-compressed 🚨 608519981 501951659 1.21
clickbench_q28/duckdb:vortex-file-compressed 🚨 3409643817 2986034414 1.14
clickbench_q29/duckdb:vortex-file-compressed 🚨 31122380 27506818 1.13
clickbench_q30/duckdb:vortex-file-compressed 🚨 217057460 182385937 1.19
clickbench_q31/duckdb:vortex-file-compressed 🚨 317785307 262079304 1.21
clickbench_q32/duckdb:vortex-file-compressed 🚨 1543933496 1320994729 1.17
clickbench_q33/duckdb:vortex-file-compressed 🚨 2004101639 1413320354 1.42
clickbench_q34/duckdb:vortex-file-compressed 🚨 2028578444 1556050187 1.30
clickbench_q35/duckdb:vortex-file-compressed 🚨 418576805 370325845 1.13
clickbench_q36/duckdb:vortex-file-compressed 🚨 35070441 28454226 1.23
clickbench_q37/duckdb:vortex-file-compressed 🚨 25545823 19912804 1.28
clickbench_q38/duckdb:vortex-file-compressed 🚨 30017924 22908391 1.31
clickbench_q39/duckdb:vortex-file-compressed 🚨 57182679 41538607 1.38
clickbench_q40/duckdb:vortex-file-compressed 🚨 25041090 21586551 1.16
clickbench_q41/duckdb:vortex-file-compressed 🚨 23306815 19992774 1.17
clickbench_q42/duckdb:vortex-file-compressed 🚨 24815957 18885486 1.31
duckdb / parquet (1.166x ❌, 0↑ 39↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 297425596 216070042 1.38
clickbench_q01/duckdb:parquet 🚨 56917227 50346813 1.13
clickbench_q02/duckdb:parquet 🚨 76729455 65441866 1.17
clickbench_q03/duckdb:parquet 🚨 72960440 63380310 1.15
clickbench_q04/duckdb:parquet 🚨 270108266 204463595 1.32
clickbench_q05/duckdb:parquet 🚨 316375224 283972227 1.11
clickbench_q06/duckdb:parquet 🚨 68558669 59066373 1.16
clickbench_q07/duckdb:parquet 🚨 59732232 51867423 1.15
clickbench_q08/duckdb:parquet 🚨 311717440 266823680 1.17
clickbench_q09/duckdb:parquet 🚨 455931646 395710486 1.15
clickbench_q10/duckdb:parquet 🚨 108077454 96518912 1.12
clickbench_q11/duckdb:parquet 🚨 123339222 108146869 1.14
clickbench_q12/duckdb:parquet 🚨 346298913 297352472 1.16
clickbench_q13/duckdb:parquet 🚨 634344455 509872640 1.24
clickbench_q14/duckdb:parquet 🚨 412155879 329239780 1.25
clickbench_q15/duckdb:parquet 🚨 284511264 242220644 1.17
clickbench_q16/duckdb:parquet 🚨 725626331 626668659 1.16
clickbench_q17/duckdb:parquet 🚨 585885718 508231517 1.15
clickbench_q18/duckdb:parquet 🚨 1233053959 1060731735 1.16
clickbench_q19/duckdb:parquet 🚨 58209222 49391046 1.18
clickbench_q20/duckdb:parquet 🚨 496501657 438881252 1.13
clickbench_q21/duckdb:parquet 🚨 650311466 556173698 1.17
clickbench_q22/duckdb:parquet 🚨 1102097612 926739485 1.19
clickbench_q23/duckdb:parquet 341271933 316968425 1.08
clickbench_q24/duckdb:parquet 83716491 78421968 1.07
clickbench_q25/duckdb:parquet 151211476 140024185 1.08
clickbench_q26/duckdb:parquet 58958535 53877395 1.09
clickbench_q27/duckdb:parquet 🚨 747913166 649259910 1.15
clickbench_q28/duckdb:parquet 🚨 5372518598 4868397589 1.10
clickbench_q29/duckdb:parquet 🚨 68994225 61184612 1.13
clickbench_q30/duckdb:parquet 🚨 347274545 304225294 1.14
clickbench_q31/duckdb:parquet 🚨 400477418 348731724 1.15
clickbench_q32/duckdb:parquet 🚨 1372747857 1136091968 1.21
clickbench_q33/duckdb:parquet 🚨 1543585988 1246899679 1.24
clickbench_q34/duckdb:parquet 🚨 1541544523 1269881528 1.21
clickbench_q35/duckdb:parquet 🚨 397363914 353213927 1.12
clickbench_q36/duckdb:parquet 🚨 71456388 63872182 1.12
clickbench_q37/duckdb:parquet 🚨 62348018 53602400 1.16
clickbench_q38/duckdb:parquet 🚨 74637587 58899782 1.27
clickbench_q39/duckdb:parquet 🚨 119012140 96768555 1.23
clickbench_q40/duckdb:parquet 🚨 65104794 55205438 1.18
clickbench_q41/duckdb:parquet 🚨 65654386 59480344 1.10
clickbench_q42/duckdb:parquet 🚨 63380417 51492086 1.23
duckdb / duckdb (1.094x ➖, 0↑ 16↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18927605 17537268 1.08
clickbench_q01/duckdb:duckdb 34548585 33465783 1.03
clickbench_q02/duckdb:duckdb 48209536 45160903 1.07
clickbench_q03/duckdb:duckdb 49849402 47632712 1.05
clickbench_q04/duckdb:duckdb 234444373 219897500 1.07
clickbench_q05/duckdb:duckdb 348471714 326846872 1.07
clickbench_q06/duckdb:duckdb 37692891 34734848 1.09
clickbench_q07/duckdb:duckdb 37841438 36152471 1.05
clickbench_q08/duckdb:duckdb 🚨 340909575 295058238 1.16
clickbench_q09/duckdb:duckdb 522945183 482519883 1.08
clickbench_q10/duckdb:duckdb 🚨 114733384 97233502 1.18
clickbench_q11/duckdb:duckdb 🚨 126290485 106229660 1.19
clickbench_q12/duckdb:duckdb 336207526 307958659 1.09
clickbench_q13/duckdb:duckdb 🚨 604049257 528411244 1.14
clickbench_q14/duckdb:duckdb 384359170 364235605 1.06
clickbench_q15/duckdb:duckdb 🚨 306785928 266647943 1.15
clickbench_q16/duckdb:duckdb 🚨 792609427 681392289 1.16
clickbench_q17/duckdb:duckdb 🚨 661830453 595689335 1.11
clickbench_q18/duckdb:duckdb 🚨 1617048631 1282151087 1.26
clickbench_q19/duckdb:duckdb 36480872 34413660 1.06
clickbench_q20/duckdb:duckdb 941374587 1017766582 0.92
clickbench_q21/duckdb:duckdb 1050704156 1071197613 0.98
clickbench_q22/duckdb:duckdb 1196087067 1119858339 1.07
clickbench_q23/duckdb:duckdb 🚨 327538784 246678273 1.33
clickbench_q24/duckdb:duckdb 65206694 60708084 1.07
clickbench_q25/duckdb:duckdb 131591686 124423463 1.06
clickbench_q26/duckdb:duckdb 🚨 60405151 53792797 1.12
clickbench_q27/duckdb:duckdb 1048551182 1097637945 0.96
clickbench_q28/duckdb:duckdb 🚨 5194688067 4589041292 1.13
clickbench_q29/duckdb:duckdb 51357466 48227044 1.06
clickbench_q30/duckdb:duckdb 🚨 356455844 289198659 1.23
clickbench_q31/duckdb:duckdb 🚨 525257367 407145847 1.29
clickbench_q32/duckdb:duckdb 1708093311 1626705478 1.05
clickbench_q33/duckdb:duckdb 2319515663 2162131658 1.07
clickbench_q34/duckdb:duckdb 🚨 2517087122 2270419244 1.11
clickbench_q35/duckdb:duckdb 🚨 298698206 264156424 1.13
clickbench_q36/duckdb:duckdb 42761069 42169063 1.01
clickbench_q37/duckdb:duckdb 33783507 31703879 1.07
clickbench_q38/duckdb:duckdb 33091791 31271105 1.06
clickbench_q39/duckdb:duckdb 🚨 78705733 69301631 1.14
clickbench_q40/duckdb:duckdb 33169106 31803863 1.04
clickbench_q41/duckdb:duckdb 32445491 30620777 1.06
clickbench_q42/duckdb:duckdb 33744970 31907058 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +39.8% +42.5% -1.9% +528.2% ➖ noise
0 duckdb:duckdb +7.9% +42.5% -24.2% +246.9% ➖ noise
0 duckdb:vortex-file-compressed +42.5% +42.5% +0.0% +292.1% ➖ noise
1 datafusion:vortex-file-compressed +21.2% +14.8% +5.6% +25.6% ➖ noise
1 duckdb:duckdb +3.2% +14.8% -10.1% +43.0% ➖ noise
1 duckdb:vortex-file-compressed +29.0% +14.8% +12.3% +16.5% ➖ noise
2 datafusion:vortex-file-compressed +13.5% +14.8% -1.1% +28.4% ➖ noise
2 duckdb:duckdb +6.8% +14.8% -7.0% +16.6% ➖ noise
2 duckdb:vortex-file-compressed +32.7% +14.8% +15.6% +14.7% 🚨 regression
3 datafusion:vortex-file-compressed +18.4% +14.7% +3.2% +151.5% ➖ noise
3 duckdb:duckdb +4.7% +14.7% -8.8% +43.7% ➖ noise
3 duckdb:vortex-file-compressed +33.7% +14.7% +16.6% +33.3% ➖ noise
4 datafusion:vortex-file-compressed +28.0% +29.1% -0.8% +14.2% ➖ noise
4 duckdb:duckdb +6.6% +29.1% -17.4% +14.2% ✅ faster
4 duckdb:vortex-file-compressed +23.3% +29.1% -4.5% +14.2% ➖ noise
5 datafusion:vortex-file-compressed +32.1% +21.0% +9.1% +14.2% ➖ noise
5 duckdb:duckdb +6.6% +21.0% -11.9% +14.2% ➖ noise
5 duckdb:vortex-file-compressed +44.1% +21.0% +19.1% +14.2% 🚨 regression
6 datafusion:vortex-file-compressed +44.9% +25.0% +15.9% +30.1% ➖ noise
6 duckdb:duckdb +8.5% +25.0% -13.2% +25.5% ➖ noise
6 duckdb:vortex-file-compressed +38.9% +25.0% +11.1% +14.7% ➖ noise
7 datafusion:vortex-file-compressed +15.7% +22.6% -5.7% +14.2% ➖ noise
7 duckdb:duckdb +4.7% +22.6% -14.6% +14.2% ✅ faster
7 duckdb:vortex-file-compressed +60.5% +22.6% +30.9% +14.2% 🚨 regression
8 datafusion:vortex-file-compressed +30.3% +22.4% +6.5% +14.2% ➖ noise
8 duckdb:duckdb +15.5% +22.4% -5.6% +14.2% ➖ noise
8 duckdb:vortex-file-compressed +26.2% +22.4% +3.1% +14.2% ➖ noise
9 datafusion:vortex-file-compressed +55.8% +24.4% +25.3% +14.2% 🚨 regression
9 duckdb:duckdb +8.4% +24.4% -12.9% +14.2% ✅ faster
9 duckdb:vortex-file-compressed +22.8% +24.4% -1.3% +14.2% ➖ noise
10 datafusion:vortex-file-compressed +20.8% +19.4% +1.2% +14.2% ➖ noise
10 duckdb:duckdb +18.0% +19.4% -1.2% +14.2% ➖ noise
10 duckdb:vortex-file-compressed +36.8% +19.4% +14.6% +14.2% 🚨 regression
11 datafusion:vortex-file-compressed +28.4% +19.1% +7.8% +14.2% ➖ noise
11 duckdb:duckdb +18.9% +19.1% -0.2% +14.2% ➖ noise
11 duckdb:vortex-file-compressed +18.7% +19.1% -0.3% +14.2% ➖ noise
12 datafusion:vortex-file-compressed +31.7% +19.2% +10.5% +14.2% ➖ noise
12 duckdb:duckdb +9.2% +19.2% -8.4% +14.2% ➖ noise
12 duckdb:vortex-file-compressed +23.5% +19.2% +3.7% +14.2% ➖ noise
13 datafusion:vortex-file-compressed +28.7% +25.3% +2.7% +14.2% ➖ noise
13 duckdb:duckdb +14.3% +25.3% -8.8% +14.2% ➖ noise
13 duckdb:vortex-file-compressed +28.1% +25.3% +2.3% +14.2% ➖ noise
14 datafusion:vortex-file-compressed +30.2% +27.1% +2.4% +14.2% ➖ noise
14 duckdb:duckdb +5.5% +27.1% -17.0% +14.2% ✅ faster
14 duckdb:vortex-file-compressed +26.4% +27.1% -0.6% +14.2% ➖ noise
15 datafusion:vortex-file-compressed +27.3% +23.4% +3.1% +14.2% ➖ noise
15 duckdb:duckdb +15.1% +23.4% -6.8% +14.2% ➖ noise
15 duckdb:vortex-file-compressed +21.6% +23.4% -1.5% +14.2% ➖ noise
16 datafusion:vortex-file-compressed +45.1% +26.8% +14.5% +14.2% 🚨 regression
16 duckdb:duckdb +16.3% +26.8% -8.3% +14.2% ➖ noise
16 duckdb:vortex-file-compressed +20.5% +26.8% -5.0% +15.7% ➖ noise
17 datafusion:vortex-file-compressed +32.3% +22.3% +8.2% +14.2% ➖ noise
17 duckdb:duckdb +11.1% +22.3% -9.1% +14.2% ➖ noise
17 duckdb:vortex-file-compressed +35.5% +22.3% +10.8% +17.4% ➖ noise
18 datafusion:vortex-file-compressed +41.3% +17.2% +20.5% +14.2% 🚨 regression
18 duckdb:duckdb +26.1% +17.2% +7.6% +14.2% ➖ noise
18 duckdb:vortex-file-compressed +21.3% +17.2% +3.4% +14.2% ➖ noise
19 datafusion:vortex-file-compressed +42.1% +15.7% +22.8% +14.2% 🚨 regression
19 duckdb:duckdb +6.0% +15.7% -8.4% +14.2% ➖ noise
19 duckdb:vortex-file-compressed +18.6% +15.7% +2.5% +22.1% ➖ noise
20 datafusion:vortex-file-compressed +14.2% +18.2% -3.4% +178.5% ➖ noise
20 duckdb:duckdb -7.5% +18.2% -21.7% +18.1% ✅ faster
20 duckdb:vortex-file-compressed +19.7% +18.2% +1.3% +14.2% ➖ noise
21 datafusion:vortex-file-compressed +25.7% +19.5% +5.2% +14.2% ➖ noise
21 duckdb:duckdb -1.9% +19.5% -17.9% +14.2% ✅ faster
21 duckdb:vortex-file-compressed +24.1% +19.5% +3.8% +14.2% ➖ noise
22 datafusion:vortex-file-compressed +29.0% +23.6% +4.4% +14.2% ➖ noise
22 duckdb:duckdb +6.8% +23.6% -13.6% +14.2% ✅ faster
22 duckdb:vortex-file-compressed +31.1% +23.6% +6.0% +14.3% ➖ noise
23 datafusion:vortex-file-compressed +37.5% +16.6% +17.9% +31.2% ➖ noise
23 duckdb:duckdb +32.8% +16.6% +13.9% +14.2% ➖ noise
23 duckdb:vortex-file-compressed -36.4% +16.6% -45.4% +24.7% ✅ faster
24 datafusion:vortex-file-compressed +43.9% +12.9% +27.5% +22.1% 🚨 regression
24 duckdb:duckdb +7.4% +12.9% -4.8% +14.2% ➖ noise
24 duckdb:vortex-file-compressed +13.2% +12.9% +0.3% +26.1% ➖ noise
25 datafusion:vortex-file-compressed +43.3% +14.1% +25.6% +14.2% 🚨 regression
25 duckdb:duckdb +5.8% +14.1% -7.3% +14.2% ➖ noise
25 duckdb:vortex-file-compressed +19.9% +14.1% +5.1% +14.2% ➖ noise
26 datafusion:vortex-file-compressed +46.7% +11.7% +31.3% +30.7% 🚨 regression
26 duckdb:duckdb +12.3% +11.7% +0.5% +16.4% ➖ noise
26 duckdb:vortex-file-compressed +16.0% +11.7% +3.8% +26.4% ➖ noise
27 datafusion:vortex-file-compressed +23.3% +20.6% +2.2% +14.2% ➖ noise
27 duckdb:duckdb -4.5% +20.6% -20.8% +14.2% ✅ faster
27 duckdb:vortex-file-compressed +21.2% +20.6% +0.5% +14.2% ➖ noise
28 datafusion:vortex-file-compressed +9.5% +10.0% -0.5% +14.2% ➖ noise
28 duckdb:duckdb +13.2% +10.0% +2.9% +14.2% ➖ noise
28 duckdb:vortex-file-compressed +14.2% +10.0% +3.8% +14.2% ➖ noise
29 datafusion:vortex-file-compressed +10.7% +10.0% +0.6% +14.2% ➖ noise
29 duckdb:duckdb +6.5% +10.0% -3.2% +14.2% ➖ noise
29 duckdb:vortex-file-compressed +13.1% +10.0% +2.9% +14.2% ➖ noise
30 datafusion:vortex-file-compressed +47.9% +18.8% +24.5% +14.2% 🚨 regression
30 duckdb:duckdb +23.3% +18.8% +3.7% +14.2% ➖ noise
30 duckdb:vortex-file-compressed +19.0% +18.8% +0.1% +14.2% ➖ noise
31 datafusion:vortex-file-compressed +39.3% +23.7% +12.6% +14.2% ➖ noise
31 duckdb:duckdb +29.0% +23.7% +4.3% +14.2% ➖ noise
31 duckdb:vortex-file-compressed +21.3% +23.7% -2.0% +14.2% ➖ noise
32 datafusion:vortex-file-compressed +28.1% +28.0% +0.1% +18.4% ➖ noise
32 duckdb:duckdb +5.0% +28.0% -17.9% +14.2% ✅ faster
32 duckdb:vortex-file-compressed +16.9% +28.0% -8.7% +14.2% ➖ noise
33 datafusion:vortex-file-compressed +32.4% +33.5% -0.8% +14.2% ➖ noise
33 duckdb:duckdb +7.3% +33.5% -19.6% +14.2% ✅ faster
33 duckdb:vortex-file-compressed +41.8% +33.5% +6.2% +14.2% ➖ noise
34 datafusion:vortex-file-compressed +33.4% +28.6% +3.7% +14.2% ➖ noise
34 duckdb:duckdb +10.9% +28.6% -13.8% +14.2% ✅ faster
34 duckdb:vortex-file-compressed +30.4% +28.6% +1.3% +14.2% ➖ noise
35 datafusion:vortex-file-compressed +30.2% +20.5% +8.0% +14.2% ➖ noise
35 duckdb:duckdb +13.1% +20.5% -6.2% +14.2% ➖ noise
35 duckdb:vortex-file-compressed +13.0% +20.5% -6.2% +14.2% ➖ noise
36 datafusion:vortex-file-compressed +29.9% +19.5% +8.7% +14.2% ➖ noise
36 duckdb:duckdb +1.4% +19.5% -15.1% +17.0% ✅ faster
36 duckdb:vortex-file-compressed +23.3% +19.5% +3.2% +16.9% ➖ noise
37 datafusion:vortex-file-compressed +22.6% +15.8% +5.9% +14.2% ➖ noise
37 duckdb:duckdb +6.6% +15.8% -8.0% +14.2% ➖ noise
37 duckdb:vortex-file-compressed +28.3% +15.8% +10.7% +14.2% ➖ noise
38 datafusion:vortex-file-compressed +20.4% +24.2% -3.0% +14.2% ➖ noise
38 duckdb:duckdb +5.8% +24.2% -14.8% +14.2% ✅ faster
38 duckdb:vortex-file-compressed +31.0% +24.2% +5.5% +14.2% ➖ noise
39 datafusion:vortex-file-compressed +26.3% +22.9% +2.7% +14.2% ➖ noise
39 duckdb:duckdb +13.6% +22.9% -7.6% +26.4% ➖ noise
39 duckdb:vortex-file-compressed +37.7% +22.9% +12.0% +14.2% ➖ noise
40 datafusion:vortex-file-compressed +22.0% +19.8% +1.8% +14.2% ➖ noise
40 duckdb:duckdb +4.3% +19.8% -13.0% +14.2% ✅ faster
40 duckdb:vortex-file-compressed +16.0% +19.8% -3.2% +14.2% ➖ noise
41 datafusion:vortex-file-compressed +28.7% +13.2% +13.6% +14.2% ➖ noise
41 duckdb:duckdb +6.0% +13.2% -6.4% +14.2% ➖ noise
41 duckdb:vortex-file-compressed +16.6% +13.2% +3.0% +14.2% ➖ noise
42 datafusion:vortex-file-compressed +24.9% +18.9% +5.0% +14.2% ➖ noise
42 duckdb:duckdb +5.8% +18.9% -11.1% +14.2% ➖ noise
42 duckdb:vortex-file-compressed +31.4% +18.9% +10.5% +14.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.6%
Vortex (geomean): 0.993x ➖
Parquet (geomean): 1.030x ➖
Shifts: Parquet (control) +3.0% · Median polish +0.5%


datafusion / vortex-file-compressed (0.997x ➖, 1↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚀 32742784 113238146 0.29
fineweb_q01/datafusion:vortex-file-compressed 638821168 522904068 1.22
fineweb_q02/datafusion:vortex-file-compressed 🚨 1266544572 516817491 2.45
fineweb_q03/datafusion:vortex-file-compressed 1574412104 1375972002 1.14
fineweb_q04/datafusion:vortex-file-compressed 1346225313 1387981521 0.97
fineweb_q05/datafusion:vortex-file-compressed 1323812671 1364263287 0.97
fineweb_q06/datafusion:vortex-file-compressed 1633771151 1503633756 1.09
fineweb_q07/datafusion:vortex-file-compressed 1357083183 1404221889 0.97
fineweb_q08/datafusion:vortex-file-compressed 551373135 552226258 1.00
datafusion / vortex-compact (0.925x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 30914774 42929914 0.72
fineweb_q01/datafusion:vortex-compact 510549090 629983339 0.81
fineweb_q02/datafusion:vortex-compact 672379809 870347121 0.77
fineweb_q03/datafusion:vortex-compact 1829729080 1831469378 1.00
fineweb_q04/datafusion:vortex-compact 2226134707 2219991565 1.00
fineweb_q05/datafusion:vortex-compact 1679485832 1681396268 1.00
fineweb_q06/datafusion:vortex-compact 1401982546 1420716765 0.99
fineweb_q07/datafusion:vortex-compact 1324422120 1284813681 1.03
fineweb_q08/datafusion:vortex-compact 452046280 419852887 1.08
datafusion / parquet (1.071x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1448812538 1302886917 1.11
fineweb_q01/datafusion:parquet 2097020850 1891789157 1.11
fineweb_q02/datafusion:parquet 1859187992 1919341378 0.97
fineweb_q03/datafusion:parquet 1829694341 1886366654 0.97
fineweb_q04/datafusion:parquet 1987134415 1922137929 1.03
fineweb_q05/datafusion:parquet 1884240693 1839032329 1.02
fineweb_q06/datafusion:parquet 2042955780 1732655491 1.18
fineweb_q07/datafusion:parquet 1910209000 1846198814 1.03
fineweb_q08/datafusion:parquet 2200415331 1773273411 1.24
duckdb / vortex-file-compressed (1.032x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 86189565 80473414 1.07
fineweb_q01/duckdb:vortex-file-compressed 651237679 645862855 1.01
fineweb_q02/duckdb:vortex-file-compressed 510004805 497382017 1.03
fineweb_q03/duckdb:vortex-file-compressed 1473007552 1461780222 1.01
fineweb_q04/duckdb:vortex-file-compressed 1556777687 1414669077 1.10
fineweb_q05/duckdb:vortex-file-compressed 1514526936 1457500390 1.04
fineweb_q06/duckdb:vortex-file-compressed 1624899637 1632198930 1.00
fineweb_q07/duckdb:vortex-file-compressed 1458656473 1444640600 1.01
fineweb_q08/duckdb:vortex-file-compressed 618697835 598998125 1.03
duckdb / vortex-compact (1.021x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 83029032 83150106 1.00
fineweb_q01/duckdb:vortex-compact 637817067 701378002 0.91
fineweb_q02/duckdb:vortex-compact 714322610 677212635 1.05
fineweb_q03/duckdb:vortex-compact 1638092032 1621542002 1.01
fineweb_q04/duckdb:vortex-compact 1735160001 1687237740 1.03
fineweb_q05/duckdb:vortex-compact 1507557042 1478104069 1.02
fineweb_q06/duckdb:vortex-compact 1475540084 1464122542 1.01
fineweb_q07/duckdb:vortex-compact 1428964084 1275740852 1.12
fineweb_q08/duckdb:vortex-compact 492926334 470157552 1.05
duckdb / parquet (0.990x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1100778944 1241344962 0.89
fineweb_q01/duckdb:parquet 1755536664 1869537397 0.94
fineweb_q02/duckdb:parquet 1688041328 1731814763 0.97
fineweb_q03/duckdb:parquet 4285175995 4039807279 1.06
fineweb_q04/duckdb:parquet 1912993001 1853885179 1.03
fineweb_q05/duckdb:parquet 2733470341 2588593786 1.06
fineweb_q06/duckdb:parquet 3478950142 3579364337 0.97
fineweb_q07/duckdb:parquet 4106484171 4133414040 0.99
fineweb_q08/duckdb:parquet 1136198093 1122567452 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -28.0% -0.7% -27.5% +109.4% ➖ noise
0 datafusion:vortex-file-compressed -71.1% -0.7% -70.9% +103.0% ✅ faster
0 duckdb:vortex-compact -0.1% -0.7% +0.6% +75.7% ➖ noise
0 duckdb:vortex-file-compressed +7.1% -0.7% +7.9% +35.0% ➖ noise
1 datafusion:vortex-compact -19.0% +2.0% -20.6% +70.1% ➖ noise
1 datafusion:vortex-file-compressed +22.2% +2.0% +19.7% +119.8% ➖ noise
1 duckdb:vortex-compact -9.1% +2.0% -10.9% +47.5% ➖ noise
1 duckdb:vortex-file-compressed +0.8% +2.0% -1.2% +30.0% ➖ noise
2 datafusion:vortex-compact -22.7% -2.8% -20.5% +54.6% ➖ noise
2 datafusion:vortex-file-compressed +145.1% -2.8% +152.2% +50.3% 🚨 regression
2 duckdb:vortex-compact +5.5% -2.8% +8.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +2.5% -2.8% +5.5% +30.0% ➖ noise
3 datafusion:vortex-compact -0.1% +1.4% -1.5% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +14.4% +1.4% +12.8% +30.0% ➖ noise
3 duckdb:vortex-compact +1.0% +1.4% -0.4% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +0.8% +1.4% -0.7% +30.0% ➖ noise
4 datafusion:vortex-compact +0.3% +3.3% -2.9% +30.0% ➖ noise
4 datafusion:vortex-file-compressed -3.0% +3.3% -6.1% +30.0% ➖ noise
4 duckdb:vortex-compact +2.8% +3.3% -0.4% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +10.0% +3.3% +6.5% +30.0% ➖ noise
5 datafusion:vortex-compact -0.1% +4.0% -4.0% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.0% +4.0% -6.7% +30.0% ➖ noise
5 duckdb:vortex-compact +2.0% +4.0% -1.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +3.9% +4.0% -0.1% +30.0% ➖ noise
6 datafusion:vortex-compact -1.3% +7.1% -7.8% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +8.7% +7.1% +1.5% +30.0% ➖ noise
6 duckdb:vortex-compact +0.8% +7.1% -5.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -0.4% +7.1% -7.0% +30.0% ➖ noise
7 datafusion:vortex-compact +3.1% +1.4% +1.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -3.4% +1.4% -4.7% +30.0% ➖ noise
7 duckdb:vortex-compact +12.0% +1.4% +10.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +1.0% +1.4% -0.4% +30.0% ➖ noise
8 datafusion:vortex-compact +7.7% +12.1% -3.9% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -0.2% +12.1% -10.9% +30.0% ➖ noise
8 duckdb:vortex-compact +4.8% +12.1% -6.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.3% +12.1% -7.8% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.4%
Vortex (geomean): 1.008x ➖
Parquet (geomean): 0.995x ➖
Shifts: Parquet (control) -0.5% · Median polish +0.6%


datafusion / vortex-file-compressed (1.092x ➖, 0↑ 3↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 214137566 205065715 1.04
tpch_q02/datafusion:vortex-file-compressed 504818707 447044567 1.13
tpch_q03/datafusion:vortex-file-compressed 435763261 343505638 1.27
tpch_q04/datafusion:vortex-file-compressed 251692281 204517472 1.23
tpch_q05/datafusion:vortex-file-compressed 470370955 404297946 1.16
tpch_q06/datafusion:vortex-file-compressed 286442225 325951322 0.88
tpch_q07/datafusion:vortex-file-compressed 383848709 386323671 0.99
tpch_q08/datafusion:vortex-file-compressed 587085850 636281069 0.92
tpch_q09/datafusion:vortex-file-compressed 406760639 335710864 1.21
tpch_q10/datafusion:vortex-file-compressed 493321034 476021409 1.04
tpch_q11/datafusion:vortex-file-compressed 347057331 341686543 1.02
tpch_q12/datafusion:vortex-file-compressed 391209331 346770067 1.13
tpch_q13/datafusion:vortex-file-compressed 223506609 220421315 1.01
tpch_q14/datafusion:vortex-file-compressed 241258955 190447373 1.27
tpch_q15/datafusion:vortex-file-compressed 🚨 455343260 304988851 1.49
tpch_q16/datafusion:vortex-file-compressed 🚨 310602722 210000808 1.48
tpch_q17/datafusion:vortex-file-compressed 435647875 405041414 1.08
tpch_q18/datafusion:vortex-file-compressed 449086044 448205439 1.00
tpch_q19/datafusion:vortex-file-compressed 524697594 556389289 0.94
tpch_q20/datafusion:vortex-file-compressed 🚨 468879609 348799920 1.34
tpch_q21/datafusion:vortex-file-compressed 509964888 515729733 0.99
tpch_q22/datafusion:vortex-file-compressed 159775736 219305418 0.73
datafusion / vortex-compact (0.965x ➖, 2↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 🚀 230454567 344704390 0.67
tpch_q02/datafusion:vortex-compact 438559038 412491156 1.06
tpch_q03/datafusion:vortex-compact 424718906 333643729 1.27
tpch_q04/datafusion:vortex-compact 243010467 224266447 1.08
tpch_q05/datafusion:vortex-compact 428367201 351014284 1.22
tpch_q06/datafusion:vortex-compact 317376822 292795570 1.08
tpch_q07/datafusion:vortex-compact 439673474 375535480 1.17
tpch_q08/datafusion:vortex-compact 🚀 583822911 1299068778 0.45
tpch_q09/datafusion:vortex-compact 385734167 550999878 0.70
tpch_q10/datafusion:vortex-compact 427433186 547933608 0.78
tpch_q11/datafusion:vortex-compact 262957055 248775748 1.06
tpch_q12/datafusion:vortex-compact 436786081 425244989 1.03
tpch_q13/datafusion:vortex-compact 213077099 210960721 1.01
tpch_q14/datafusion:vortex-compact 245747215 233839174 1.05
tpch_q15/datafusion:vortex-compact 437223319 394637691 1.11
tpch_q16/datafusion:vortex-compact 178247190 169708823 1.05
tpch_q17/datafusion:vortex-compact 340400750 336671517 1.01
tpch_q18/datafusion:vortex-compact 283726554 292158095 0.97
tpch_q19/datafusion:vortex-compact 475624546 487233990 0.98
tpch_q20/datafusion:vortex-compact 478325516 517939330 0.92
tpch_q21/datafusion:vortex-compact 552040137 540988557 1.02
tpch_q22/datafusion:vortex-compact 187308417 186594405 1.00
datafusion / parquet (1.026x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 275913625 225618010 1.22
tpch_q02/datafusion:parquet 576340242 479723132 1.20
tpch_q03/datafusion:parquet 361449321 306686969 1.18
tpch_q04/datafusion:parquet 145752976 154431877 0.94
tpch_q05/datafusion:parquet 452144608 455818703 0.99
tpch_q06/datafusion:parquet 132536510 146424673 0.91
tpch_q07/datafusion:parquet 465831136 491688895 0.95
tpch_q08/datafusion:parquet 565931610 650402211 0.87
tpch_q09/datafusion:parquet 469823577 458439024 1.02
tpch_q10/datafusion:parquet 507144102 601372408 0.84
tpch_q11/datafusion:parquet 334363766 354941853 0.94
tpch_q12/datafusion:parquet 237640920 238997341 0.99
tpch_q13/datafusion:parquet 437592818 470934195 0.93
tpch_q14/datafusion:parquet 216405437 186962313 1.16
tpch_q15/datafusion:parquet 408205887 320214951 1.27
tpch_q16/datafusion:parquet 184687249 173919584 1.06
tpch_q17/datafusion:parquet 447997319 407044712 1.10
tpch_q18/datafusion:parquet 479052930 444584362 1.08
tpch_q19/datafusion:parquet 370097467 387672601 0.95
tpch_q20/datafusion:parquet 394671329 306886098 1.29
tpch_q21/datafusion:parquet 633275733 553637058 1.14
tpch_q22/datafusion:parquet 106510711 145054504 0.73
duckdb / vortex-file-compressed (1.029x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 279033172 260881567 1.07
tpch_q02/duckdb:vortex-file-compressed 1218448969 937920718 1.30
tpch_q03/duckdb:vortex-file-compressed 696539688 565363742 1.23
tpch_q04/duckdb:vortex-file-compressed 404631686 380799807 1.06
tpch_q05/duckdb:vortex-file-compressed 1049570624 942240588 1.11
tpch_q06/duckdb:vortex-file-compressed 414422236 588139686 0.70
tpch_q07/duckdb:vortex-file-compressed 839528691 787556504 1.07
tpch_q08/duckdb:vortex-file-compressed 1008816605 907567108 1.11
tpch_q09/duckdb:vortex-file-compressed 937194955 944712800 0.99
tpch_q10/duckdb:vortex-file-compressed 720417397 772562046 0.93
tpch_q11/duckdb:vortex-file-compressed 561584752 553678393 1.01
tpch_q12/duckdb:vortex-file-compressed 526217468 508884808 1.03
tpch_q13/duckdb:vortex-file-compressed 471971571 529700010 0.89
tpch_q14/duckdb:vortex-file-compressed 490339229 600673828 0.82
tpch_q15/duckdb:vortex-file-compressed 316682181 338113231 0.94
tpch_q16/duckdb:vortex-file-compressed 388414964 370571686 1.05
tpch_q17/duckdb:vortex-file-compressed 763138544 691579094 1.10
tpch_q18/duckdb:vortex-file-compressed 710977375 560735628 1.27
tpch_q19/duckdb:vortex-file-compressed 478860516 442680825 1.08
tpch_q20/duckdb:vortex-file-compressed 886533644 845898175 1.05
tpch_q21/duckdb:vortex-file-compressed 1084301385 1106973456 0.98
tpch_q22/duckdb:vortex-file-compressed 366119443 352939094 1.04
duckdb / vortex-compact (0.953x ➖, 1↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 267695130 290628341 0.92
tpch_q02/duckdb:vortex-compact 895483805 998717969 0.90
tpch_q03/duckdb:vortex-compact 573889563 605983407 0.95
tpch_q04/duckdb:vortex-compact 354069230 366265365 0.97
tpch_q05/duckdb:vortex-compact 875157720 866228630 1.01
tpch_q06/duckdb:vortex-compact 398683126 464614783 0.86
tpch_q07/duckdb:vortex-compact 804017284 754395640 1.07
tpch_q08/duckdb:vortex-compact 950178581 892934233 1.06
tpch_q09/duckdb:vortex-compact 932641046 903920860 1.03
tpch_q10/duckdb:vortex-compact 684954236 770061134 0.89
tpch_q11/duckdb:vortex-compact 510691489 500951104 1.02
tpch_q12/duckdb:vortex-compact 522348995 434860920 1.20
tpch_q13/duckdb:vortex-compact 🚀 442807945 706202638 0.63
tpch_q14/duckdb:vortex-compact 475817684 575880101 0.83
tpch_q15/duckdb:vortex-compact 353834896 293325637 1.21
tpch_q16/duckdb:vortex-compact 370882083 364449548 1.02
tpch_q17/duckdb:vortex-compact 660063230 635555014 1.04
tpch_q18/duckdb:vortex-compact 484053640 588660942 0.82
tpch_q19/duckdb:vortex-compact 427724923 553749321 0.77
tpch_q20/duckdb:vortex-compact 691196670 760568163 0.91
tpch_q21/duckdb:vortex-compact 1171318461 1079083993 1.09
tpch_q22/duckdb:vortex-compact 394051494 393668499 1.00
duckdb / parquet (0.965x ➖, 1↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 599261843 624509460 0.96
tpch_q02/duckdb:parquet 1415482219 1394539732 1.02
tpch_q03/duckdb:parquet 1001056175 976699920 1.02
tpch_q04/duckdb:parquet 🚀 638491477 917508605 0.70
tpch_q05/duckdb:parquet 1715753834 1656066860 1.04
tpch_q06/duckdb:parquet 483284983 430318500 1.12
tpch_q07/duckdb:parquet 1340720953 1542691959 0.87
tpch_q08/duckdb:parquet 1854970693 1689439143 1.10
tpch_q09/duckdb:parquet 1536264385 1495640504 1.03
tpch_q10/duckdb:parquet 1356241274 1707517809 0.79
tpch_q11/duckdb:parquet 889402331 933058704 0.95
tpch_q12/duckdb:parquet 626663278 599094922 1.05
tpch_q13/duckdb:parquet 909929044 905990716 1.00
tpch_q14/duckdb:parquet 777955470 712773511 1.09
tpch_q15/duckdb:parquet 511652152 684598985 0.75
tpch_q16/duckdb:parquet 594250119 673405983 0.88
tpch_q17/duckdb:parquet 776739184 859060018 0.90
tpch_q18/duckdb:parquet 945268475 911436675 1.04
tpch_q19/duckdb:parquet 876724889 842402342 1.04
tpch_q20/duckdb:parquet 1172259356 1179306913 0.99
tpch_q21/duckdb:parquet 1186948628 1221342973 0.97
tpch_q22/duckdb:parquet 551659559 520138507 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -33.1% +8.3% -38.3% +102.4% ➖ noise
1 datafusion:vortex-file-compressed +4.4% +8.3% -3.6% +107.9% ➖ noise
1 duckdb:vortex-compact -7.9% +8.3% -15.0% +40.5% ➖ noise
1 duckdb:vortex-file-compressed +7.0% +8.3% -1.3% +55.2% ➖ noise
2 datafusion:vortex-compact +6.3% +10.4% -3.7% +35.4% ➖ noise
2 datafusion:vortex-file-compressed +12.9% +10.4% +2.3% +34.1% ➖ noise
2 duckdb:vortex-compact -10.3% +10.4% -18.8% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +29.9% +10.4% +17.6% +31.0% ➖ noise
3 datafusion:vortex-compact +27.3% +9.9% +15.8% +70.9% ➖ noise
3 datafusion:vortex-file-compressed +26.9% +9.9% +15.4% +71.9% ➖ noise
3 duckdb:vortex-compact -5.3% +9.9% -13.8% +39.7% ➖ noise
3 duckdb:vortex-file-compressed +23.2% +9.9% +12.1% +35.7% ➖ noise
4 datafusion:vortex-compact +8.4% -19.0% +33.7% +55.2% ➖ noise
4 datafusion:vortex-file-compressed +23.1% -19.0% +51.9% +36.4% 🚨 regression
4 duckdb:vortex-compact -3.3% -19.0% +19.3% +38.9% ➖ noise
4 duckdb:vortex-file-compressed +6.3% -19.0% +31.1% +30.0% 🚨 regression
5 datafusion:vortex-compact +22.0% +1.4% +20.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +16.3% +1.4% +14.8% +30.0% ➖ noise
5 duckdb:vortex-compact +1.0% +1.4% -0.3% +30.3% ➖ noise
5 duckdb:vortex-file-compressed +11.4% +1.4% +9.9% +30.0% ➖ noise
6 datafusion:vortex-compact +8.4% +0.8% +7.5% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -12.1% +0.8% -12.8% +45.0% ➖ noise
6 duckdb:vortex-compact -14.2% +0.8% -14.9% +30.0% ➖ noise
6 duckdb:vortex-file-compressed -29.5% +0.8% -30.1% +36.7% ✅ faster
7 datafusion:vortex-compact +17.1% -9.3% +29.0% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.6% -9.3% +9.5% +34.3% ➖ noise
7 duckdb:vortex-compact +6.6% -9.3% +17.5% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +6.6% -9.3% +17.5% +62.7% ➖ noise
8 datafusion:vortex-compact -55.1% -2.3% -54.0% +63.6% ✅ faster
8 datafusion:vortex-file-compressed -7.7% -2.3% -5.6% +30.0% ➖ noise
8 duckdb:vortex-compact +6.4% -2.3% +8.9% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +11.2% -2.3% +13.7% +30.0% ➖ noise
9 datafusion:vortex-compact -30.0% +2.6% -31.8% +38.2% ✅ faster
9 datafusion:vortex-file-compressed +21.2% +2.6% +18.1% +30.0% ➖ noise
9 duckdb:vortex-compact +3.2% +2.6% +0.6% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -0.8% +2.6% -3.3% +30.0% ➖ noise
10 datafusion:vortex-compact -22.0% -18.2% -4.7% +85.7% ➖ noise
10 datafusion:vortex-file-compressed +3.6% -18.2% +26.6% +30.7% ➖ noise
10 duckdb:vortex-compact -11.1% -18.2% +8.7% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -6.7% -18.2% +13.9% +30.5% ➖ noise
11 datafusion:vortex-compact +5.7% -5.2% +11.5% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +1.6% -5.2% +7.2% +43.8% ➖ noise
11 duckdb:vortex-compact +1.9% -5.2% +7.6% +34.9% ➖ noise
11 duckdb:vortex-file-compressed +1.4% -5.2% +7.0% +30.6% ➖ noise
12 datafusion:vortex-compact +2.7% +2.0% +0.7% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +12.8% +2.0% +10.6% +32.0% ➖ noise
12 duckdb:vortex-compact +20.1% +2.0% +17.8% +46.5% ➖ noise
12 duckdb:vortex-file-compressed +3.4% +2.0% +1.4% +41.3% ➖ noise
13 datafusion:vortex-compact +1.0% -3.4% +4.6% +49.6% ➖ noise
13 datafusion:vortex-file-compressed +1.4% -3.4% +5.0% +43.6% ➖ noise
13 duckdb:vortex-compact -37.3% -3.4% -35.1% +48.5% ✅ faster
13 duckdb:vortex-file-compressed -10.9% -3.4% -7.8% +30.0% ➖ noise
14 datafusion:vortex-compact +5.1% +12.4% -6.5% +33.1% ➖ noise
14 datafusion:vortex-file-compressed +26.7% +12.4% +12.7% +41.6% ➖ noise
14 duckdb:vortex-compact -17.4% +12.4% -26.5% +40.4% ➖ noise
14 duckdb:vortex-file-compressed -18.4% +12.4% -27.4% +65.0% ➖ noise
15 datafusion:vortex-compact +10.8% -2.4% +13.5% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +49.3% -2.4% +53.0% +30.0% 🚨 regression
15 duckdb:vortex-compact +20.6% -2.4% +23.6% +30.3% ➖ noise
15 duckdb:vortex-file-compressed -6.3% -2.4% -4.0% +47.5% ➖ noise
16 datafusion:vortex-compact +5.0% -3.2% +8.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +47.9% -3.2% +52.8% +33.7% 🚨 regression
16 duckdb:vortex-compact +1.8% -3.2% +5.1% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +4.8% -3.2% +8.3% +30.0% ➖ noise
17 datafusion:vortex-compact +1.1% -0.2% +1.4% +30.0% ➖ noise
17 datafusion:vortex-file-compressed +7.6% -0.2% +7.8% +32.0% ➖ noise
17 duckdb:vortex-compact +3.9% -0.2% +4.1% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +10.3% -0.2% +10.6% +30.0% ➖ noise
18 datafusion:vortex-compact -2.9% +5.7% -8.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +0.2% +5.7% -5.2% +33.2% ➖ noise
18 duckdb:vortex-compact -17.8% +5.7% -22.2% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +26.8% +5.7% +19.9% +30.0% ➖ noise
19 datafusion:vortex-compact -2.4% -0.3% -2.1% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -5.7% -0.3% -5.4% +31.2% ➖ noise
19 duckdb:vortex-compact -22.8% -0.3% -22.5% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +8.2% -0.3% +8.5% +30.0% ➖ noise
20 datafusion:vortex-compact -7.6% +13.1% -18.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +34.4% +13.1% +18.9% +30.0% ➖ noise
20 duckdb:vortex-compact -9.1% +13.1% -19.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +4.8% +13.1% -7.3% +30.0% ➖ noise
21 datafusion:vortex-compact +2.0% +5.4% -3.2% +31.5% ➖ noise
21 datafusion:vortex-file-compressed -1.1% +5.4% -6.2% +37.0% ➖ noise
21 duckdb:vortex-compact +8.5% +5.4% +3.0% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.0% +5.4% -7.1% +30.0% ➖ noise
22 datafusion:vortex-compact +0.4% -11.8% +13.8% +50.9% ➖ noise
22 datafusion:vortex-file-compressed -27.1% -11.8% -17.4% +54.2% ➖ noise
22 duckdb:vortex-compact +0.1% -11.8% +13.4% +46.5% ➖ noise
22 duckdb:vortex-file-compressed +3.7% -11.8% +17.5% +30.0% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 3, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.4%
Vortex (geomean): 0.996x ➖
Parquet (geomean): 1.032x ➖
Shifts: Parquet (control) +3.2% · Median polish +3.0%


datafusion / vortex-file-compressed (0.920x ➖, 3↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 763044259 917318313 0.83
tpch_q02/datafusion:vortex-file-compressed 1108400772 1321884913 0.84
tpch_q03/datafusion:vortex-file-compressed 🚀 936002578 1426552612 0.66
tpch_q04/datafusion:vortex-file-compressed 🚀 558981740 805229647 0.69
tpch_q05/datafusion:vortex-file-compressed 1076656538 1098808605 0.98
tpch_q06/datafusion:vortex-file-compressed 635768084 680187871 0.93
tpch_q07/datafusion:vortex-file-compressed 1119449568 1124524882 1.00
tpch_q08/datafusion:vortex-file-compressed 1175562093 1195493176 0.98
tpch_q09/datafusion:vortex-file-compressed 1422796148 1409999257 1.01
tpch_q10/datafusion:vortex-file-compressed 936179266 1138739861 0.82
tpch_q11/datafusion:vortex-file-compressed 535026501 697937582 0.77
tpch_q12/datafusion:vortex-file-compressed 1174660488 1100607960 1.07
tpch_q13/datafusion:vortex-file-compressed 507056536 483349579 1.05
tpch_q14/datafusion:vortex-file-compressed 🚀 591647964 852124299 0.69
tpch_q15/datafusion:vortex-file-compressed 1173151463 1283638755 0.91
tpch_q16/datafusion:vortex-file-compressed 376207427 337205409 1.12
tpch_q17/datafusion:vortex-file-compressed 1177529353 1182134468 1.00
tpch_q18/datafusion:vortex-file-compressed 1392742273 1259003320 1.11
tpch_q19/datafusion:vortex-file-compressed 811391917 748368444 1.08
tpch_q20/datafusion:vortex-file-compressed 944494094 975530422 0.97
tpch_q21/datafusion:vortex-file-compressed 1631916508 1624940254 1.00
tpch_q22/datafusion:vortex-file-compressed 356038055 373580734 0.95
datafusion / vortex-compact (0.935x ➖, 2↑ 1↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 680712548 750613672 0.91
tpch_q02/datafusion:vortex-compact 🚀 698630130 1063619407 0.66
tpch_q03/datafusion:vortex-compact 🚀 717697053 1186777677 0.60
tpch_q04/datafusion:vortex-compact 597952417 543820421 1.10
tpch_q05/datafusion:vortex-compact 937931392 936560388 1.00
tpch_q06/datafusion:vortex-compact 596220268 573398378 1.04
tpch_q07/datafusion:vortex-compact 1059326205 1115295886 0.95
tpch_q08/datafusion:vortex-compact 1137507986 1186274909 0.96
tpch_q09/datafusion:vortex-compact 🚨 1625188207 1218618158 1.33
tpch_q10/datafusion:vortex-compact 1254147545 1109906987 1.13
tpch_q11/datafusion:vortex-compact 546885140 464866678 1.18
tpch_q12/datafusion:vortex-compact 807431087 1025848492 0.79
tpch_q13/datafusion:vortex-compact 432119567 442257406 0.98
tpch_q14/datafusion:vortex-compact 579750833 673923805 0.86
tpch_q15/datafusion:vortex-compact 1046752373 1290084262 0.81
tpch_q16/datafusion:vortex-compact 316364711 336988452 0.94
tpch_q17/datafusion:vortex-compact 1185819528 1166066975 1.02
tpch_q18/datafusion:vortex-compact 1200624965 1241451025 0.97
tpch_q19/datafusion:vortex-compact 871598555 1027852662 0.85
tpch_q20/datafusion:vortex-compact 836177506 1049921059 0.80
tpch_q21/datafusion:vortex-compact 1478065217 1539123662 0.96
tpch_q22/datafusion:vortex-compact 377665946 354482848 1.07
datafusion / parquet (1.106x ➖, 0↑ 2↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 840583286 811366736 1.04
tpch_q02/datafusion:parquet 641134249 657740505 0.97
tpch_q03/datafusion:parquet 981401844 896198593 1.10
tpch_q04/datafusion:parquet 566671680 469764923 1.21
tpch_q05/datafusion:parquet 🚨 1690008395 1195064708 1.41
tpch_q06/datafusion:parquet 534299503 527622589 1.01
tpch_q07/datafusion:parquet 1402887107 1224379228 1.15
tpch_q08/datafusion:parquet 1521896692 1535676657 0.99
tpch_q09/datafusion:parquet 2059885521 1772101584 1.16
tpch_q10/datafusion:parquet 2236584696 1895133481 1.18
tpch_q11/datafusion:parquet 573212703 502116059 1.14
tpch_q12/datafusion:parquet 🚨 1293589010 694326898 1.86
tpch_q13/datafusion:parquet 798270643 693486200 1.15
tpch_q14/datafusion:parquet 905660332 765242798 1.18
tpch_q15/datafusion:parquet 1228302631 1175564254 1.04
tpch_q16/datafusion:parquet 374737273 384227088 0.98
tpch_q17/datafusion:parquet 1392439968 1401956720 0.99
tpch_q18/datafusion:parquet 1546465325 1491998221 1.04
tpch_q19/datafusion:parquet 1051616715 1004605783 1.05
tpch_q20/datafusion:parquet 1191184454 1147977966 1.04
tpch_q21/datafusion:parquet 1780023143 1876144100 0.95
tpch_q22/datafusion:parquet 819602469 831220661 0.99
duckdb / vortex-file-compressed (1.059x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 626190442 606509253 1.03
tpch_q02/duckdb:vortex-file-compressed 1263675988 1101376291 1.15
tpch_q03/duckdb:vortex-file-compressed 1145637381 1095465448 1.05
tpch_q04/duckdb:vortex-file-compressed 809710689 712946768 1.14
tpch_q05/duckdb:vortex-file-compressed 1126498971 1268767019 0.89
tpch_q06/duckdb:vortex-file-compressed 840770722 802432949 1.05
tpch_q07/duckdb:vortex-file-compressed 1126764366 1232231439 0.91
tpch_q08/duckdb:vortex-file-compressed 1630699868 1570890186 1.04
tpch_q09/duckdb:vortex-file-compressed 1586449682 1527381671 1.04
tpch_q10/duckdb:vortex-file-compressed 1371501789 1115240068 1.23
tpch_q11/duckdb:vortex-file-compressed 739742633 677278677 1.09
tpch_q12/duckdb:vortex-file-compressed 743735893 1015081058 0.73
tpch_q13/duckdb:vortex-file-compressed 1109232116 971360413 1.14
tpch_q14/duckdb:vortex-file-compressed 959526405 806509445 1.19
tpch_q15/duckdb:vortex-file-compressed 588200121 531036738 1.11
tpch_q16/duckdb:vortex-file-compressed 518475199 467640876 1.11
tpch_q17/duckdb:vortex-file-compressed 1065573068 997397193 1.07
tpch_q18/duckdb:vortex-file-compressed 999170077 960795259 1.04
tpch_q19/duckdb:vortex-file-compressed 907648904 819712250 1.11
tpch_q20/duckdb:vortex-file-compressed 1505371966 1362051916 1.11
tpch_q21/duckdb:vortex-file-compressed 2244995429 2066249472 1.09
tpch_q22/duckdb:vortex-file-compressed 767388349 684698992 1.12
duckdb / vortex-compact (1.083x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 619117591 599539893 1.03
tpch_q02/duckdb:vortex-compact 1131938183 1066330847 1.06
tpch_q03/duckdb:vortex-compact 993283055 836422683 1.19
tpch_q04/duckdb:vortex-compact 575749274 536080197 1.07
tpch_q05/duckdb:vortex-compact 1092352203 979937848 1.11
tpch_q06/duckdb:vortex-compact 749941059 726138681 1.03
tpch_q07/duckdb:vortex-compact 1159572563 1069939736 1.08
tpch_q08/duckdb:vortex-compact 1423180093 1311063986 1.09
tpch_q09/duckdb:vortex-compact 1419684077 1268462589 1.12
tpch_q10/duckdb:vortex-compact 1147615041 1400282994 0.82
tpch_q11/duckdb:vortex-compact 755046157 638856764 1.18
tpch_q12/duckdb:vortex-compact 777389164 658242529 1.18
tpch_q13/duckdb:vortex-compact 1009354956 852257037 1.18
tpch_q14/duckdb:vortex-compact 928502429 876768439 1.06
tpch_q15/duckdb:vortex-compact 646704192 631624886 1.02
tpch_q16/duckdb:vortex-compact 446457262 406379381 1.10
tpch_q17/duckdb:vortex-compact 1058302879 1035284592 1.02
tpch_q18/duckdb:vortex-compact 906197970 759329456 1.19
tpch_q19/duckdb:vortex-compact 826364386 698393565 1.18
tpch_q20/duckdb:vortex-compact 1360304880 1237377463 1.10
tpch_q21/duckdb:vortex-compact 1941602069 1857286526 1.05
tpch_q22/duckdb:vortex-compact 757779087 745159154 1.02
duckdb / parquet (0.963x ➖, 0↑ 0↓)
name PR db42e44 (ns) base a8351a9 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 876839529 1229298634 0.71
tpch_q02/duckdb:parquet 1515662165 1702755018 0.89
tpch_q03/duckdb:parquet 1782709597 1550578282 1.15
tpch_q04/duckdb:parquet 976111721 993381340 0.98
tpch_q05/duckdb:parquet 2314805568 2399375225 0.96
tpch_q06/duckdb:parquet 756877674 639181530 1.18
tpch_q07/duckdb:parquet 1936195356 1867285455 1.04
tpch_q08/duckdb:parquet 2419067468 2574723789 0.94
tpch_q09/duckdb:parquet 2334439542 2500282739 0.93
tpch_q10/duckdb:parquet 3226917577 3224541841 1.00
tpch_q11/duckdb:parquet 959555775 944937575 1.02
tpch_q12/duckdb:parquet 1052363244 1292977125 0.81
tpch_q13/duckdb:parquet 1196032003 1385632764 0.86
tpch_q14/duckdb:parquet 1261485814 1206450799 1.05
tpch_q15/duckdb:parquet 890314013 997252234 0.89
tpch_q16/duckdb:parquet 797129775 822522647 0.97
tpch_q17/duckdb:parquet 1385152527 1489285515 0.93
tpch_q18/duckdb:parquet 1437320758 1809836698 0.79
tpch_q19/duckdb:parquet 1589338353 1533173035 1.04
tpch_q20/duckdb:parquet 1750116243 1799282352 0.97
tpch_q21/duckdb:parquet 2048094745 1860474903 1.10
tpch_q22/duckdb:parquet 1066709933 971949991 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -9.3% -14.0% +5.5% +61.4% ➖ noise
1 datafusion:vortex-file-compressed -16.8% -14.0% -3.2% +55.1% ➖ noise
1 duckdb:vortex-compact +3.3% -14.0% +20.1% +30.1% ➖ noise
1 duckdb:vortex-file-compressed +3.2% -14.0% +20.1% +30.0% ➖ noise
2 datafusion:vortex-compact -34.3% -6.9% -29.5% +35.2% ✅ faster
2 datafusion:vortex-file-compressed -16.1% -6.9% -10.0% +41.0% ➖ noise
2 duckdb:vortex-compact +6.2% -6.9% +14.0% +45.5% ➖ noise
2 duckdb:vortex-file-compressed +14.7% -6.9% +23.2% +33.5% ➖ noise
3 datafusion:vortex-compact -39.5% +12.2% -46.1% +60.0% ✅ faster
3 datafusion:vortex-file-compressed -34.4% +12.2% -41.5% +57.6% ✅ faster
3 duckdb:vortex-compact +18.8% +12.2% +5.8% +44.8% ➖ noise
3 duckdb:vortex-file-compressed +4.6% +12.2% -6.8% +50.1% ➖ noise
4 datafusion:vortex-compact +10.0% +8.9% +1.0% +30.1% ➖ noise
4 datafusion:vortex-file-compressed -30.6% +8.9% -36.2% +34.6% ✅ faster
4 duckdb:vortex-compact +7.4% +8.9% -1.4% +33.6% ➖ noise
4 duckdb:vortex-file-compressed +13.6% +8.9% +4.3% +30.0% ➖ noise
5 datafusion:vortex-compact +0.1% +16.8% -14.3% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -2.0% +16.8% -16.1% +30.1% ➖ noise
5 duckdb:vortex-compact +11.5% +16.8% -4.6% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -11.2% +16.8% -24.0% +30.0% ✅ faster
6 datafusion:vortex-compact +4.0% +9.5% -5.0% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -6.5% +9.5% -14.6% +30.0% ➖ noise
6 duckdb:vortex-compact +3.3% +9.5% -5.7% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +4.8% +9.5% -4.3% +30.0% ➖ noise
7 datafusion:vortex-compact -5.0% +9.0% -12.9% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -0.5% +9.0% -8.7% +30.0% ➖ noise
7 duckdb:vortex-compact +8.4% +9.0% -0.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -8.6% +9.0% -16.1% +30.0% ➖ noise
8 datafusion:vortex-compact -4.1% -3.5% -0.6% +30.0% ➖ noise
8 datafusion:vortex-file-compressed -1.7% -3.5% +1.9% +30.0% ➖ noise
8 duckdb:vortex-compact +8.6% -3.5% +12.5% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +3.8% -3.5% +7.6% +30.0% ➖ noise
9 datafusion:vortex-compact +33.4% +4.2% +28.0% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +0.9% +4.2% -3.1% +30.0% ➖ noise
9 duckdb:vortex-compact +11.9% +4.2% +7.4% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +3.9% +4.2% -0.3% +30.0% ➖ noise
10 datafusion:vortex-compact +13.0% +8.7% +4.0% +42.8% ➖ noise
10 datafusion:vortex-file-compressed -17.8% +8.7% -24.4% +41.4% ➖ noise
10 duckdb:vortex-compact -18.0% +8.7% -24.6% +38.7% ➖ noise
10 duckdb:vortex-file-compressed +23.0% +8.7% +13.2% +37.7% ➖ noise
11 datafusion:vortex-compact +17.6% +7.7% +9.3% +30.0% ➖ noise
11 datafusion:vortex-file-compressed -23.3% +7.7% -28.8% +30.0% ✅ faster
11 duckdb:vortex-compact +18.2% +7.7% +9.8% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +9.2% +7.7% +1.4% +37.8% ➖ noise
12 datafusion:vortex-compact -21.3% +23.1% -36.1% +30.1% ✅ faster
12 datafusion:vortex-file-compressed +6.7% +23.1% -13.3% +30.0% ➖ noise
12 duckdb:vortex-compact +18.1% +23.1% -4.1% +30.0% ➖ noise
12 duckdb:vortex-file-compressed -26.7% +23.1% -40.5% +32.7% ✅ faster
13 datafusion:vortex-compact -2.3% -0.3% -2.0% +34.4% ➖ noise
13 datafusion:vortex-file-compressed +4.9% -0.3% +5.2% +30.0% ➖ noise
13 duckdb:vortex-compact +18.4% -0.3% +18.8% +54.0% ➖ noise
13 duckdb:vortex-file-compressed +14.2% -0.3% +14.6% +51.4% ➖ noise
14 datafusion:vortex-compact -14.0% +11.2% -22.7% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -30.6% +11.2% -37.6% +39.9% ✅ faster
14 duckdb:vortex-compact +5.9% +11.2% -4.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +19.0% +11.2% +6.9% +30.0% ➖ noise
15 datafusion:vortex-compact -18.9% -3.4% -16.0% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -8.6% -3.4% -5.4% +30.0% ➖ noise
15 duckdb:vortex-compact +2.4% -3.4% +6.0% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +10.8% -3.4% +14.7% +30.0% ➖ noise
16 datafusion:vortex-compact -6.1% -2.8% -3.4% +40.1% ➖ noise
16 datafusion:vortex-file-compressed +11.6% -2.8% +14.8% +58.5% ➖ noise
16 duckdb:vortex-compact +9.9% -2.8% +13.0% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +10.9% -2.8% +14.0% +48.3% ➖ noise
17 datafusion:vortex-compact +1.7% -3.9% +5.8% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -0.4% -3.9% +3.6% +30.0% ➖ noise
17 duckdb:vortex-compact +2.2% -3.9% +6.4% +36.1% ➖ noise
17 duckdb:vortex-file-compressed +6.8% -3.9% +11.2% +30.0% ➖ noise
18 datafusion:vortex-compact -3.3% -9.3% +6.6% +30.0% ➖ noise
18 datafusion:vortex-file-compressed +10.6% -9.3% +21.9% +30.0% ➖ noise
18 duckdb:vortex-compact +19.3% -9.3% +31.5% +30.0% 🚨 regression
18 duckdb:vortex-file-compressed +4.0% -9.3% +14.6% +52.1% ➖ noise
19 datafusion:vortex-compact -15.2% +4.2% -18.6% +43.4% ➖ noise
19 datafusion:vortex-file-compressed +8.4% +4.2% +4.1% +30.0% ➖ noise
19 duckdb:vortex-compact +18.3% +4.2% +13.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed +10.7% +4.2% +6.3% +30.0% ➖ noise
20 datafusion:vortex-compact -20.4% +0.5% -20.7% +30.0% ➖ noise
20 datafusion:vortex-file-compressed -3.2% +0.5% -3.6% +30.0% ➖ noise
20 duckdb:vortex-compact +9.9% +0.5% +9.4% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +10.5% +0.5% +10.0% +30.0% ➖ noise
21 datafusion:vortex-compact -4.0% +2.2% -6.0% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +0.4% +2.2% -1.7% +30.0% ➖ noise
21 duckdb:vortex-compact +4.5% +2.2% +2.3% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +8.7% +2.2% +6.3% +30.0% ➖ noise
22 datafusion:vortex-compact +6.5% +4.0% +2.4% +48.0% ➖ noise
22 datafusion:vortex-file-compressed -4.7% +4.0% -8.4% +38.2% ➖ noise
22 duckdb:vortex-compact +1.7% +4.0% -2.2% +45.7% ➖ noise
22 duckdb:vortex-file-compressed +12.1% +4.0% +7.7% +33.7% ➖ noise

@AdamGS AdamGS added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Apr 3, 2026
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch 2 times, most recently from a103738 to 4454bc6 Compare April 3, 2026 20:26
@AdamGS AdamGS changed the title Try to implement compare/between for bitpacked arrays Implement compare/between for bitpacked arrays - improve performance by up to 2X Apr 3, 2026
@AdamGS AdamGS requested review from gatesn and joseph-isaacs April 3, 2026 21:03
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch 2 times, most recently from 52289bf to dbe5a37 Compare April 3, 2026 21:29
@AdamGS AdamGS added the action/benchmark Trigger full benchmarks to run on this PR label Apr 3, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 3, 2026
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
AdamGS added 9 commits April 3, 2026 22:39
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
Signed-off-by: Adam Gutglick <adam@spiraldb.com>
@AdamGS AdamGS force-pushed the adamg/bitpack-compare branch from dbe5a37 to 33e6d30 Compare April 3, 2026 21:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant