Skip to content

Compare PR benchmarks against the benchmarks database instead of S3 - #10987

Merged
joseph-isaacs merged 11 commits into
developfrom
ji/bench-baseline-postgres
Oct 30, 2026
Merged

joseph-isaacs merged 11 commits into
developfrom
ji/bench-baseline-postgres

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Summary

PR benchmark comments get their develop baseline by downloading data.json.gz from S3 (353 MB compressed). Develop runs also append to that file, and that append is the slowest step of each develop benchmark job. Develop runs already write every result to the benchmarks Postgres, so this PR reads the PR baseline from Postgres instead. After this PR, nothing reads the S3 file. The next PR in the stack (#10988) stops writing it.

CI reads the database the same way the ingest does, through an AWS role over OIDC with an RDS IAM token. It uses the read-only pair added in vortex-data/vortex.dev#149: the role GitHubBenchmarkReadRole (vars.GH_BENCH_READ_ROLE_ARN) and the Postgres user bench_ci_read (migration 011, SELECT only).

Merge order: apply vortex.dev migration 012 (commits.branch) before merging this PR, because the ingest now writes that column.

Changes

  • .github/actions/fetch-bench-baseline (new):
    • Assumes the read role and signs in as bench_ci_read.
    • Writes the develop baseline records.
    • Takes the role, region, endpoint and database from repo variables, so each workflow only names the action.
    • If the role or the database can't be reached, it writes no baseline, the comment says so, and the job still passes.
  • scripts/fetch-benchmark-baseline.py (new):
    • Takes the PR run's --ingest-jsonl records.
    • For each measurement, reads that measurement's history newest first through the table's existing index, and stops at the first commit reachable from HEAD.
    • The newest such commit is the baseline; the script writes its rows.
    • It refuses a shallow checkout, as the old reporter did.
  • scripts/compare-benchmark-jsons.py:
    • Compares the baseline records with the PR's records.
    • Row names keep the results-JSON shape (e.g. tpch_q01/datafusion:parquet), and the scale factor and variant stay in the dataset key.
    • The S3 history scan is gone.
  • Ingest records: the Random Access, Compression and GPU Compression runs now pass --emit-ingest-records; the SQL runs already did. GPU Compression also gets id-token: write.
  • Branch on ingest: scripts/post-ingest.py takes a required --branch and writes it to commits.branch; the ingest workflows pass github.ref_name.

What the PR comments lose:

  • String Encoding has no database table, so it shows the PR's values without a baseline.
  • SQL file sizes aren't stored in the database, so the file-size section is gone.
  • Compression ratio rows aren't listed. The size and time rows they were computed from are still compared.

What they gain: compression timings get hot/cold columns, because the records carry every run.

Testing

  • scripts/tests/test_benchmark_reporting.py (28 passed) covers:

    • converting records and building a report from them, and keeping scale factors apart;
    • the "baseline could not be read" message;
    • grouping identities, the IS NULL match for absent fields, and the shallow-checkout refusal.
  • scripts/tests/test_post_ingest.py and test_measurement_id.py pass.

  • ruff format, ruff check and yamllint --strict are clean.

  • Baseline query against a local Postgres 16, built from the vortex.dev migrations with 4.2M synthetic query rows; the new query returns the same records as the old one:

    case old new
    baseline 100 commits back 31.3s 0.26s
    baseline 2,000 commits back 18.3s 1.7s

    The old query had hit the 30s statement timeout on TPC-H in CI.

  • In CI, the SQL benchmark read a real baseline through the read role (PR 2e69732a vs base c6d6bada). One run of each benchmark kind is going on 86d3c3e4.

🤖 Generated with Claude Code

https://claude.ai/code/session_01UeniBBtX1DUban9Fda2Edh

PR benchmark comments read their develop baseline from the 353 MB
`data.json.gz` S3 dump. Read it from the benchmarks Postgres instead, which
develop runs already write to.

- `scripts/fetch-benchmark-baseline.py` reads the PR run's ingest records,
  finds the newest commit reachable from HEAD that recorded the same
  measurements, and writes that commit's rows. It connects as the read-only
  `bench_read` role.
- `compare-benchmark-jsons.py` compares ingest records on both sides. File
  sizes and suite metadata still come from the PR's results JSON.
- Random access, compression and GPU compression PR runs now emit ingest
  records.

String Encoding and SQL file sizes are not in the database, so their PR
comments show the PR measurements without a baseline.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBBtX1DUban9Fda2Edh
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added action/bench-gpu-compress Run only the GPU compression benchmark on this PR action/bench-random-access Run only the random-access benchmark on this PR action/bench-compress Run only the compression benchmark on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-string Run only the string encoding benchmark on this PR labels Oct 29, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-compress Run only the compression benchmark on this PR action/bench-gpu-compress Run only the GPU compression benchmark on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-random-access Run only the random-access benchmark on this PR action/bench-string Run only the string encoding benchmark on this PR labels Oct 29, 2026

Copy link
Copy Markdown
Contributor Author

Rust tests (windows-x64) failed about a minute into its test step. The later steps never ran and the job has no logs (404), so the runner looks lost. This PR changes no Rust code. I'll re-run the failed job once when the rest of the "Linters and Tests" run finishes; GitHub refuses a re-run while the run is still going.


Generated by Claude Code

@codspeed

codspeed Bot commented Oct 29, 2026 •

Copy link
Copy Markdown

Merging this PR will not alter performance

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

✅ 2318 untouched benchmarks


Comparing ji/bench-baseline-postgres (98f50a3) with develop (8a35f30)

Open in CodSpeed

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 98f50a3 tpch-s3 1 Explore Profiling Data
🟢 Done 98f50a3 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 98f50a3 appian-nvme 1 Explore Profiling Data
🟢 Done 98f50a3 tpch-nvme 1 Explore Profiling Data
🟢 Done 98f50a3 clickbench-nvme 1 Explore Profiling Data
🟢 Done 98f50a3 compress-bench 1 Explore Profiling Data
🟢 Done 98f50a3 string-bench 1 Explore Profiling Data
🟢 Done 98f50a3 tpch-s3-10 1 Explore Profiling Data
🟢 Done 98f50a3 fineweb 1 Explore Profiling Data
🟢 Done 98f50a3 tpcds-nvme 1 Explore Profiling Data
Previous Runs (59)
Status Commit Job Attempt Link
🟢 Done 7e28809 clickbench-nvme 1 Explore Profiling Data
🟢 Done 7e28809 tpch-s3-10 1 Explore Profiling Data
🟢 Done 7e28809 fineweb 1 Explore Profiling Data
🟢 Done 7e28809 tpch-nvme 1 Explore Profiling Data
🟢 Done 2e69732 clickbench-nvme 1 Explore Profiling Data
🟢 Done 2e69732 tpch-s3-10 1 Explore Profiling Data
🟢 Done 2e69732 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 2e69732 tpch-s3 1 Explore Profiling Data
🟢 Done 2e69732 fineweb-s3 1 Explore Profiling Data
🟢 Done 2e69732 appian-nvme 1 Explore Profiling Data
🟢 Done 2e69732 fineweb 1 Explore Profiling Data
🟢 Done 2e69732 tpcds-nvme 1 Explore Profiling Data
🟢 Done 2e69732 tpch-nvme 1 Explore Profiling Data
🟢 Done 1ede4e8 clickbench-nvme 1 Explore Profiling Data
🟢 Done 1ede4e8 random-access-bench 1 Explore Profiling Data
🟢 Done 1ede4e8 tpch-s3-10 1 Explore Profiling Data
🟢 Done 1ede4e8 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 1ede4e8 appian-nvme 1 Explore Profiling Data
🟢 Done 1ede4e8 fineweb-s3 1 Explore Profiling Data
🟢 Done 1ede4e8 tpch-s3 1 Explore Profiling Data
🟢 Done 1ede4e8 tpch-nvme 1 Explore Profiling Data
🟢 Done 1ede4e8 fineweb 1 Explore Profiling Data
🟢 Done 1ede4e8 tpcds-nvme 1 Explore Profiling Data
🟢 Done c3a54a8 statpopgen 1 Explore Profiling Data
🟢 Done c3a54a8 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done c3a54a8 clickbench-nvme 1 Explore Profiling Data
🟢 Done c3a54a8 tpch-s3-10 1 Explore Profiling Data
🟢 Done c3a54a8 tpch-nvme-10 1 Explore Profiling Data
🟢 Done c3a54a8 fineweb-s3 1 Explore Profiling Data
🟢 Done c3a54a8 appian-nvme 1 Explore Profiling Data
🟢 Done c3a54a8 tpch-s3 1 Explore Profiling Data
🟢 Done c3a54a8 tpch-nvme 1 Explore Profiling Data
🟢 Done c3a54a8 tpcds-nvme 1 Explore Profiling Data
🟢 Done c3a54a8 fineweb 1 Explore Profiling Data
🟢 Done d540c8f statpopgen 1 Explore Profiling Data
🟢 Done d540c8f clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done d540c8f clickbench-nvme 1 Explore Profiling Data
🟢 Done d540c8f fineweb-s3 1 Explore Profiling Data
🟢 Done d540c8f fineweb 1 Explore Profiling Data
🟢 Done d540c8f tpch-s3-10 1 Explore Profiling Data
🟢 Done d540c8f tpch-nvme 1 Explore Profiling Data
🟢 Done d540c8f tpch-nvme-10 1 Explore Profiling Data
🟢 Done d540c8f tpch-s3 1 Explore Profiling Data
🟢 Done d540c8f appian-nvme 1 Explore Profiling Data
🟢 Done d540c8f tpcds-nvme 1 Explore Profiling Data
🟢 Done 8cc24be tpch-s3 1 Explore Profiling Data
🟢 Done 8cc24be random-access-bench 1 Explore Profiling Data
🟢 Done 8cc24be clickbench-nvme 1 Explore Profiling Data
🟢 Done 8cc24be fineweb-s3 1 Explore Profiling Data
🟢 Done 8cc24be tpcds-nvme 1 Explore Profiling Data
🟢 Done 8cc24be string-bench 1 Explore Profiling Data
🟢 Done 8cc24be compress-bench 1 Explore Profiling Data
🟢 Done 8cc24be appian-nvme 1 Explore Profiling Data
🟢 Done 8cc24be tpch-nvme 1 Explore Profiling Data
🟢 Done 8cc24be tpch-nvme-10 1 Explore Profiling Data
🟢 Done 8cc24be statpopgen 1 Explore Profiling Data
🟢 Done 8cc24be clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 8cc24be tpch-s3-10 1 Explore Profiling Data
🟢 Done 8cc24be fineweb 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR 98f50a38 vs base 85466bb6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.0%
Engines: DataFusion No clear signal (-1.1%, low confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 0.989x ➖ · cold 0.966x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.953x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.991x ➖, 2↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 7133526 / 7011277 / +1.7% 16924557 / 17905947 / -5.5% 0.42 / 0.39 / +7.6%
fineweb_q01/datafusion:vortex-compact 44204208 / 42879052 / +3.1% 73166186 / 75090877 / -2.6% 0.60 / 0.57 / +5.8%
fineweb_q02/datafusion:vortex-compact 58241798 / 74635508 / -22.0% 🟢 79745630 / 105912995 / -24.7% 🟢 0.73 / 0.70 / +3.6%
fineweb_q03/datafusion:vortex-compact 156772368 / 155695407 / +0.7% 221363957 / 226417984 / -2.2% 0.71 / 0.69 / +3.0%
fineweb_q04/datafusion:vortex-compact 162720063 / 190033528 / -14.4% 🟢 253927454 / 244388043 / +3.9% 0.64 / 0.78 / -17.6%
fineweb_q05/datafusion:vortex-compact 158090801 / 152786486 / +3.5% 224860514 / 231780900 / -3.0% 0.70 / 0.66 / +6.7%
fineweb_q06/datafusion:vortex-compact 86516748 / 85711995 / +0.9% 150238713 / 161439712 / -6.9% 0.58 / 0.53 / +8.5%
fineweb_q07/datafusion:vortex-compact 87779475 / 88127638 / -0.4% 152197769 / 165182638 / -7.9% 0.58 / 0.53 / +8.1%
fineweb_q08/datafusion:vortex-compact 9874161 / 7863723 / +25.6% 🔴 38650497 / 35887023 / +7.7% 0.26 / 0.22 / +16.6%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9376966 / 9264150 / +1.2% 31965421 / 33623281 / -4.9% 0.29 / 0.28 / +6.5%
fineweb_q01/datafusion:parquet 73400690 / 73901972 / -0.7% 142315091 / 159649481 / -10.9% 🟢 0.52 / 0.46 / +11.4%
fineweb_q02/datafusion:parquet 75000748 / 74115609 / +1.2% 144963000 / 158677225 / -8.6% 0.52 / 0.47 / +10.8%
fineweb_q03/datafusion:parquet 74623334 / 72982728 / +2.2% 138272932 / 152194458 / -9.1% 0.54 / 0.48 / +12.5%
fineweb_q04/datafusion:parquet 81940822 / 82414498 / -0.6% 139881465 / 162348821 / -13.8% 🟢 0.59 / 0.51 / +15.4%
fineweb_q05/datafusion:parquet 80497004 / 80565338 / -0.1% 143644017 / 153085603 / -6.2% 0.56 / 0.53 / +6.5%
fineweb_q06/datafusion:parquet 75862888 / 76298104 / -0.6% 147312864 / 154042722 / -4.4% 0.51 / 0.50 / +4.0%
fineweb_q07/datafusion:parquet 75299643 / 75313544 / -0.0% 146270655 / 153540760 / -4.7% 0.51 / 0.49 / +5.0%
fineweb_q08/datafusion:parquet 73736700 / 74206470 / -0.6% 141870866 / 159145075 / -10.9% 🟢 0.52 / 0.47 / +11.5%
duckdb / vortex-compact / ns (0.988x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2167655 / 2455924 / -11.7% 🟢 7953676 / 7477479 / +6.4% 0.27 / 0.33 / -17.0%
fineweb_q01/duckdb:vortex-compact 43090486 / 44358571 / -2.9% 66292172 / 65873649 / +0.6% 0.65 / 0.67 / -3.5%
fineweb_q02/duckdb:vortex-compact 43463832 / 43821170 / -0.8% 65364472 / 68221397 / -4.2% 0.66 / 0.64 / +3.5%
fineweb_q03/duckdb:vortex-compact 181914216 / 189112816 / -3.8% 219397782 / 210274113 / +4.3% 0.83 / 0.90 / -7.8%
fineweb_q04/duckdb:vortex-compact 194023808 / 187170410 / +3.7% 209600052 / 247422321 / -15.3% 🟢 0.93 / 0.76 / +22.4%
fineweb_q05/duckdb:vortex-compact 184443720 / 175782598 / +4.9% 197933974 / 221487419 / -10.6% 🟢 0.93 / 0.79 / +17.4%
fineweb_q06/duckdb:vortex-compact 88935074 / 90174264 / -1.4% 135360970 / 137912609 / -1.9% 0.66 / 0.65 / +0.5%
fineweb_q07/duckdb:vortex-compact 89569702 / 90061144 / -0.5% 133113995 / 134491681 / -1.0% 0.67 / 0.67 / +0.5%
fineweb_q08/duckdb:vortex-compact 5520118 / 5388162 / +2.4% 11403535 / 10560978 / +8.0% 0.48 / 0.51 / -5.1%
duckdb / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24165749 / 23864348 / +1.3% 28042107 / 29664754 / -5.5% 0.86 / 0.80 / +7.1%
fineweb_q01/duckdb:parquet 55086832 / 56599934 / -2.7% 74916615 / 78832857 / -5.0% 0.74 / 0.72 / +2.4%
fineweb_q02/duckdb:parquet 59217192 / 60041978 / -1.4% 82624322 / 80243734 / +3.0% 0.72 / 0.75 / -4.2%
fineweb_q03/duckdb:parquet 118488411 / 120643270 / -1.8% 187978183 / 187969167 / +0.0% 0.63 / 0.64 / -1.8%
fineweb_q04/duckdb:parquet 162214124 / 162233210 / -0.0% 215190214 / 217420062 / -1.0% 0.75 / 0.75 / +1.0%
fineweb_q05/duckdb:parquet 158650722 / 159977721 / -0.8% 209541926 / 203515222 / +3.0% 0.76 / 0.79 / -3.7%
fineweb_q06/duckdb:parquet 89484962 / 89631960 / -0.2% 152324552 / 151006499 / +0.9% 0.59 / 0.59 / -1.0%
fineweb_q07/duckdb:parquet 93725812 / 92667594 / +1.1% 147516363 / 154128561 / -4.3% 0.64 / 0.60 / +5.7%
fineweb_q08/duckdb:parquet 29848208 / 29713728 / +0.5% 31068397 / 31298972 / -0.7% 0.96 / 0.95 / +1.2%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 98f50a38 vs base f3aef93b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.9%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (+2.8%, environment too noisy confidence)
Vortex (geomean): hot 0.999x ➖ · cold 1.086x ➖
Parquet (geomean): hot 0.980x ➖ · cold 1.010x ➖
Shifts: Parquet (control) -2.0% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact 191634718 / 196611496 / -2.5% 440621469 / 444887990 / -1.0% 0.43 / 0.44 / -1.6%
clickbench-sorted_q24/datafusion:vortex-compact 17737013 / 18507630 / -4.2% 54819407 / 50276365 / +9.0% 0.32 / 0.37 / -12.1%
clickbench-sorted_q26/datafusion:vortex-compact 19302294 / 18587288 / +3.8% 52489135 / 51933297 / +1.1% 0.37 / 0.36 / +2.7%
clickbench-sorted_q36/datafusion:vortex-compact 26551812 / 25792416 / +2.9% 75962871 / 66285852 / +14.6% 🔴 0.35 / 0.39 / -10.2%
clickbench-sorted_q37/datafusion:vortex-compact 22116918 / 21535758 / +2.7% 72302121 / 65371752 / +10.6% 🔴 0.31 / 0.33 / -7.1%
clickbench-sorted_q38/datafusion:vortex-compact 21027104 / 21181528 / -0.7% 71387712 / 64065916 / +11.4% 🔴 0.29 / 0.33 / -10.9%
clickbench-sorted_q39/datafusion:vortex-compact 43794506 / 41792152 / +4.8% 88938335 / 81248545 / +9.5% 0.49 / 0.51 / -4.3%
clickbench-sorted_q40/datafusion:vortex-compact 14257953 / 13974902 / +2.0% 46919080 / 42919070 / +9.3% 0.30 / 0.33 / -6.7%
clickbench-sorted_q41/datafusion:vortex-compact 14047894 / 14863293 / -5.5% 49441791 / 41131473 / +20.2% 🔴 0.28 / 0.36 / -21.4%
clickbench-sorted_q42/datafusion:vortex-compact 11199550 / 10806542 / +3.6% 40337887 / 37336472 / +8.0% 0.28 / 0.29 / -4.1%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 754998736 / 754262396 / +0.1% 975631179 / 962316006 / +1.4% 0.77 / 0.78 / -1.3%
clickbench-sorted_q24/datafusion:parquet 9344394 / 9431386 / -0.9% 74935248 / 74548501 / +0.5% 0.12 / 0.13 / -1.4%
clickbench-sorted_q26/datafusion:parquet 8941891 / 9354780 / -4.4% 72476908 / 70766226 / +2.4% 0.12 / 0.13 / -6.7%
clickbench-sorted_q36/datafusion:parquet 93542596 / 93059244 / +0.5% 173957085 / 168863291 / +3.0% 0.54 / 0.55 / -2.4%
clickbench-sorted_q37/datafusion:parquet 63814442 / 63585187 / +0.4% 133634320 / 131943767 / +1.3% 0.48 / 0.48 / -0.9%
clickbench-sorted_q38/datafusion:parquet 87498404 / 87189590 / +0.4% 164323618 / 161796255 / +1.6% 0.53 / 0.54 / -1.2%
clickbench-sorted_q39/datafusion:parquet 159507726 / 158849753 / +0.4% 238913330 / 238551425 / +0.2% 0.67 / 0.67 / +0.3%
clickbench-sorted_q40/datafusion:parquet 44223514 / 44175298 / +0.1% 115556304 / 112529107 / +2.7% 0.38 / 0.39 / -2.5%
clickbench-sorted_q41/datafusion:parquet 41778058 / 41541906 / +0.6% 116635316 / 109755066 / +6.3% 0.36 / 0.38 / -5.4%
clickbench-sorted_q42/datafusion:parquet 25530964 / 25802514 / -1.1% 87946648 / 87542454 / +0.5% 0.29 / 0.29 / -1.5%
duckdb / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact 37461102 / 39119832 / -4.2% 68327239 / 62598317 / +9.2% 0.55 / 0.62 / -12.3%
clickbench-sorted_q24/duckdb:vortex-compact 10942371 / 11003472 / -0.6% 28179353 / 30398625 / -7.3% 0.39 / 0.36 / +7.3%
clickbench-sorted_q26/duckdb:vortex-compact 11085636 / 11218870 / -1.2% 34213648 / 29279527 / +16.9% 🔴 0.32 / 0.38 / -15.4%
clickbench-sorted_q36/duckdb:vortex-compact 25980930 / 26145865 / -0.6% 63945933 / 56277791 / +13.6% 🔴 0.41 / 0.46 / -12.5%
clickbench-sorted_q37/duckdb:vortex-compact 21237720 / 21370218 / -0.6% 57194846 / 52634661 / +8.7% 0.37 / 0.41 / -8.5%
clickbench-sorted_q38/duckdb:vortex-compact 22298023 / 21888777 / +1.9% 59937767 / 54244998 / +10.5% 🔴 0.37 / 0.40 / -7.8%
clickbench-sorted_q39/duckdb:vortex-compact 49868904 / 50190364 / -0.6% 94025698 / 79487067 / +18.3% 🔴 0.53 / 0.63 / -16.0%
clickbench-sorted_q40/duckdb:vortex-compact 11684460 / 12194054 / -4.2% 36222499 / 33385795 / +8.5% 0.32 / 0.37 / -11.7%
clickbench-sorted_q41/duckdb:vortex-compact 12927150 / 12980178 / -0.4% 37220012 / 35705365 / +4.2% 0.35 / 0.36 / -4.5%
clickbench-sorted_q42/duckdb:vortex-compact 9150210 / 8929724 / +2.5% 29039981 / 28806102 / +0.8% 0.32 / 0.31 / +1.6%
duckdb / parquet / ns (0.965x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 143024847 / 140895994 / +1.5% 170730356 / 181844143 / -6.1% 0.84 / 0.77 / +8.1%
clickbench-sorted_q24/duckdb:parquet 18194013 / 18194358 / -0.0% 23097330 / 23714278 / -2.6% 0.79 / 0.77 / +2.7%
clickbench-sorted_q26/duckdb:parquet 16681956 / 18866288 / -11.6% 🟢 23345708 / 25122815 / -7.1% 0.71 / 0.75 / -4.8%
clickbench-sorted_q36/duckdb:parquet 48684288 / 49486045 / -1.6% 66311347 / 59392710 / +11.6% 🔴 0.73 / 0.83 / -11.9%
clickbench-sorted_q37/duckdb:parquet 36653573 / 40775874 / -10.1% 🟢 49730368 / 48384881 / +2.8% 0.74 / 0.84 / -12.5%
clickbench-sorted_q38/duckdb:parquet 44428860 / 45142626 / -1.6% 60814966 / 56701076 / +7.3% 0.73 / 0.80 / -8.2%
clickbench-sorted_q39/duckdb:parquet 77063684 / 80527200 / -4.3% 90133048 / 90108753 / +0.0% 0.85 / 0.89 / -4.3%
clickbench-sorted_q40/duckdb:parquet 23086476 / 24680914 / -6.5% 32999231 / 35261916 / -6.4% 0.70 / 0.70 / -0.0%
clickbench-sorted_q41/duckdb:parquet 24530072 / 25058689 / -2.1% 33010081 / 32847256 / +0.5% 0.74 / 0.76 / -2.6%
clickbench-sorted_q42/duckdb:parquet 18450936 / 18038498 / +2.3% 26214093 / 25520703 / +2.7% 0.70 / 0.71 / -0.4%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR 98f50a38 vs base 85466bb6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+0.4%, low confidence)
Vortex (geomean): hot 0.999x ➖ · cold 0.983x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.983x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16201123 / 16447128 / -1.5% 42731410 / 44009258 / -2.9% 0.38 / 0.37 / +1.4%
tpch_q02/datafusion:vortex-compact 18395012 / 17970448 / +2.4% 36903088 / 37254145 / -0.9% 0.50 / 0.48 / +3.3%
tpch_q03/datafusion:vortex-compact 20292917 / 20539312 / -1.2% 45242069 / 47714203 / -5.2% 0.45 / 0.43 / +4.2%
tpch_q04/datafusion:vortex-compact 10896133 / 11353972 / -4.0% 32696221 / 33933006 / -3.6% 0.33 / 0.33 / -0.4%
tpch_q05/datafusion:vortex-compact 37406016 / 38068465 / -1.7% 64286293 / 67700150 / -5.0% 0.58 / 0.56 / +3.5%
tpch_q06/datafusion:vortex-compact 6947092 / 6616812 / +5.0% 26338317 / 28930602 / -9.0% 0.26 / 0.23 / +15.3%
tpch_q07/datafusion:vortex-compact 52751932 / 52849952 / -0.2% 72490360 / 76066526 / -4.7% 0.73 / 0.69 / +4.7%
tpch_q08/datafusion:vortex-compact 51883676 / 52675454 / -1.5% 72746742 / 79431759 / -8.4% 0.71 / 0.66 / +7.5%
tpch_q09/datafusion:vortex-compact 48738369 / 49657475 / -1.9% 75852064 / 71827072 / +5.6% 0.64 / 0.69 / -7.1%
tpch_q10/datafusion:vortex-compact 19323117 / 19580516 / -1.3% 47224048 / 49684539 / -5.0% 0.41 / 0.39 / +3.8%
tpch_q11/datafusion:vortex-compact 14450432 / 14715646 / -1.8% 34302092 / 34672064 / -1.1% 0.42 / 0.42 / -0.7%
tpch_q12/datafusion:vortex-compact 19769769 / 20236725 / -2.3% 41788409 / 41231428 / +1.4% 0.47 / 0.49 / -3.6%
tpch_q13/datafusion:vortex-compact 20710787 / 20170108 / +2.7% 40392306 / 41243463 / -2.1% 0.51 / 0.49 / +4.8%
tpch_q14/datafusion:vortex-compact 15504747 / 15437810 / +0.4% 39117840 / 39035683 / +0.2% 0.40 / 0.40 / +0.2%
tpch_q15/datafusion:vortex-compact 20504436 / 20335634 / +0.8% 46906600 / 47455631 / -1.2% 0.44 / 0.43 / +2.0%
tpch_q16/datafusion:vortex-compact 18860180 / 19131130 / -1.4% 39556900 / 39463414 / +0.2% 0.48 / 0.48 / -1.6%
tpch_q17/datafusion:vortex-compact 28687804 / 28398559 / +1.0% 59289212 / 58962885 / +0.6% 0.48 / 0.48 / +0.5%
tpch_q18/datafusion:vortex-compact 36443098 / 36406498 / +0.1% 60034069 / 57814507 / +3.8% 0.61 / 0.63 / -3.6%
tpch_q19/datafusion:vortex-compact 13413300 / 14087904 / -4.8% 39563625 / 40392842 / -2.1% 0.34 / 0.35 / -2.8%
tpch_q20/datafusion:vortex-compact 21392853 / 21238458 / +0.7% 44518184 / 44628218 / -0.2% 0.48 / 0.48 / +1.0%
tpch_q21/datafusion:vortex-compact 40822432 / 41035921 / -0.5% 71556616 / 70463873 / +1.6% 0.57 / 0.58 / -2.0%
tpch_q22/datafusion:vortex-compact 10864630 / 11466628 / -5.3% 31533363 / 32368505 / -2.6% 0.34 / 0.35 / -2.7%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72172874 / 72158774 / +0.0% 88789459 / 94117819 / -5.7% 0.81 / 0.77 / +6.0%
tpch_q02/datafusion:parquet 76418497 / 76209768 / +0.3% 93075806 / 98893321 / -5.9% 0.82 / 0.77 / +6.5%
tpch_q03/datafusion:parquet 83887039 / 84516191 / -0.7% 102370625 / 103869548 / -1.4% 0.82 / 0.81 / +0.7%
tpch_q04/datafusion:parquet 40868616 / 40705868 / +0.4% 58925552 / 63521931 / -7.2% 0.69 / 0.64 / +8.2%
tpch_q05/datafusion:parquet 112039899 / 111921822 / +0.1% 137242610 / 142323695 / -3.6% 0.82 / 0.79 / +3.8%
tpch_q06/datafusion:parquet 32063714 / 31772096 / +0.9% 47776992 / 49412998 / -3.3% 0.67 / 0.64 / +4.4%
tpch_q07/datafusion:parquet 115469505 / 115183146 / +0.2% 138743508 / 142460715 / -2.6% 0.83 / 0.81 / +2.9%
tpch_q08/datafusion:parquet 119636665 / 119570126 / +0.1% 145150646 / 145747185 / -0.4% 0.82 / 0.82 / +0.5%
tpch_q09/datafusion:parquet 139721096 / 140090983 / -0.3% 166755303 / 176600547 / -5.6% 0.84 / 0.79 / +5.6%
tpch_q10/datafusion:parquet 106177783 / 106735616 / -0.5% 128883063 / 137219801 / -6.1% 0.82 / 0.78 / +5.9%
tpch_q11/datafusion:parquet 61434128 / 60212326 / +2.0% 81719094 / 82203007 / -0.6% 0.75 / 0.73 / +2.6%
tpch_q12/datafusion:parquet 65583728 / 64575471 / +1.6% 82918462 / 88827541 / -6.7% 0.79 / 0.73 / +8.8%
tpch_q13/datafusion:parquet 146720298 / 147132901 / -0.3% 167577505 / 170607064 / -1.8% 0.88 / 0.86 / +1.5%
tpch_q14/datafusion:parquet 47686604 / 47963969 / -0.6% 69233955 / 71360907 / -3.0% 0.69 / 0.67 / +2.5%
tpch_q15/datafusion:parquet 74594450 / 75213460 / -0.8% 95882422 / 98681625 / -2.8% 0.78 / 0.76 / +2.1%
tpch_q16/datafusion:parquet 43667134 / 43767764 / -0.2% 62290879 / 61433703 / +1.4% 0.70 / 0.71 / -1.6%
tpch_q17/datafusion:parquet 124415397 / 124275310 / +0.1% 146158371 / 147738539 / -1.1% 0.85 / 0.84 / +1.2%
tpch_q18/datafusion:parquet 123797608 / 123692745 / +0.1% 143709661 / 148108275 / -3.0% 0.86 / 0.84 / +3.1%
tpch_q19/datafusion:parquet 57749514 / 58387677 / -1.1% 81451273 / 84297357 / -3.4% 0.71 / 0.69 / +2.4%
tpch_q20/datafusion:parquet 78901573 / 79418276 / -0.7% 101302866 / 105527372 / -4.0% 0.78 / 0.75 / +3.5%
tpch_q21/datafusion:parquet 116239757 / 116459208 / -0.2% 143854086 / 144412502 / -0.4% 0.81 / 0.81 / +0.2%
tpch_q22/datafusion:parquet 52208915 / 51641172 / +1.1% 71286661 / 69705611 / +2.3% 0.73 / 0.74 / -1.1%
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 10668916 / 10188529 / +4.7% 21311593 / 21942742 / -2.9% 0.50 / 0.46 / +7.8%
tpch_q02/duckdb:vortex-compact 19161551 / 19382956 / -1.1% 28416595 / 26956489 / +5.4% 0.67 / 0.72 / -6.2%
tpch_q03/duckdb:vortex-compact 19324039 / 19403758 / -0.4% 34237623 / 34831544 / -1.7% 0.56 / 0.56 / +1.3%
tpch_q04/duckdb:vortex-compact 12819187 / 12765426 / +0.4% 24118457 / 24840810 / -2.9% 0.53 / 0.51 / +3.4%
tpch_q05/duckdb:vortex-compact 21329414 / 21123781 / +1.0% 34088902 / 33587733 / +1.5% 0.63 / 0.63 / -0.5%
tpch_q06/duckdb:vortex-compact 5218440 / 5168256 / +1.0% 15217723 / 15822174 / -3.8% 0.34 / 0.33 / +5.0%
tpch_q07/duckdb:vortex-compact 25955471 / 25674110 / +1.1% 40244836 / 41799974 / -3.7% 0.64 / 0.61 / +5.0%
tpch_q08/duckdb:vortex-compact 22591514 / 21895022 / +3.2% 36440491 / 37748801 / -3.5% 0.62 / 0.58 / +6.9%
tpch_q09/duckdb:vortex-compact 25118849 / 24800566 / +1.3% 38179543 / 39303799 / -2.9% 0.66 / 0.63 / +4.3%
tpch_q10/duckdb:vortex-compact 37949357 / 37553703 / +1.1% 52113942 / 51772995 / +0.7% 0.73 / 0.73 / +0.4%
tpch_q11/duckdb:vortex-compact 8741225 / 8743039 / -0.0% 17337081 / 17361190 / -0.1% 0.50 / 0.50 / +0.1%
tpch_q12/duckdb:vortex-compact 17409842 / 17082386 / +1.9% 28581818 / 29161991 / -2.0% 0.61 / 0.59 / +4.0%
tpch_q13/duckdb:vortex-compact 26645302 / 26626681 / +0.1% 35029001 / 35309805 / -0.8% 0.76 / 0.75 / +0.9%
tpch_q14/duckdb:vortex-compact 12538028 / 12375469 / +1.3% 25536743 / 25854452 / -1.2% 0.49 / 0.48 / +2.6%
tpch_q15/duckdb:vortex-compact 9717364 / 9844630 / -1.3% 21505682 / 22398343 / -4.0% 0.45 / 0.44 / +2.8%
tpch_q16/duckdb:vortex-compact 17300386 / 17493389 / -1.1% 23437962 / 23403841 / +0.1% 0.74 / 0.75 / -1.2%
tpch_q17/duckdb:vortex-compact 13072529 / 13087843 / -0.1% 26874386 / 27704403 / -3.0% 0.49 / 0.47 / +3.0%
tpch_q18/duckdb:vortex-compact 24129052 / 24707424 / -2.3% 33093860 / 33690769 / -1.8% 0.73 / 0.73 / -0.6%
tpch_q19/duckdb:vortex-compact 14384762 / 14116236 / +1.9% 26445702 / 27629974 / -4.3% 0.54 / 0.51 / +6.5%
tpch_q20/duckdb:vortex-compact 19037141 / 19281422 / -1.3% 33498935 / 33399940 / +0.3% 0.57 / 0.58 / -1.6%
tpch_q21/duckdb:vortex-compact 38850967 / 38528173 / +0.8% 54619348 / 56138694 / -2.7% 0.71 / 0.69 / +3.6%
tpch_q22/duckdb:vortex-compact 23674077 / 23524497 / +0.6% 33632115 / 33698349 / -0.2% 0.70 / 0.70 / +0.8%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48316143 / 48321265 / -0.0% 54873677 / 55061013 / -0.3% 0.88 / 0.88 / +0.3%
tpch_q02/duckdb:parquet 48837409 / 48965312 / -0.3% 55850543 / 56273269 / -0.8% 0.87 / 0.87 / +0.5%
tpch_q03/duckdb:parquet 60847962 / 60374784 / +0.8% 68344802 / 69328052 / -1.4% 0.89 / 0.87 / +2.2%
tpch_q04/duckdb:parquet 35154615 / 35085494 / +0.2% 43713214 / 44480994 / -1.7% 0.80 / 0.79 / +2.0%
tpch_q05/duckdb:parquet 67764554 / 67810585 / -0.1% 77181614 / 78699631 / -1.9% 0.88 / 0.86 / +1.9%
tpch_q06/duckdb:parquet 21982631 / 22183866 / -0.9% 27525514 / 27868199 / -1.2% 0.80 / 0.80 / +0.3%
tpch_q07/duckdb:parquet 64612768 / 64341721 / +0.4% 73875137 / 74700212 / -1.1% 0.87 / 0.86 / +1.5%
tpch_q08/duckdb:parquet 76399292 / 76285144 / +0.1% 87583994 / 87455325 / +0.1% 0.87 / 0.87 / +0.0%
tpch_q09/duckdb:parquet 108397038 / 108321790 / +0.1% 120319056 / 120548383 / -0.2% 0.90 / 0.90 / +0.3%
tpch_q10/duckdb:parquet 106851002 / 106502347 / +0.3% 117696528 / 118492854 / -0.7% 0.91 / 0.90 / +1.0%
tpch_q11/duckdb:parquet 29680838 / 29891750 / -0.7% 35607980 / 35237059 / +1.1% 0.83 / 0.85 / -1.7%
tpch_q12/duckdb:parquet 38261837 / 38017243 / +0.6% 44349124 / 45321727 / -2.1% 0.86 / 0.84 / +2.9%
tpch_q13/duckdb:parquet 176137992 / 175531897 / +0.3% 185105340 / 182662916 / +1.3% 0.95 / 0.96 / -1.0%
tpch_q14/duckdb:parquet 43017052 / 43251268 / -0.5% 51408760 / 51389023 / +0.0% 0.84 / 0.84 / -0.6%
tpch_q15/duckdb:parquet 33095482 / 32979087 / +0.4% 41211370 / 42072281 / -2.0% 0.80 / 0.78 / +2.4%
tpch_q16/duckdb:parquet 48289529 / 47725257 / +1.2% 53681373 / 53380916 / +0.6% 0.90 / 0.89 / +0.6%
tpch_q17/duckdb:parquet 48474075 / 48349596 / +0.3% 58050141 / 58196947 / -0.3% 0.84 / 0.83 / +0.5%
tpch_q18/duckdb:parquet 75008032 / 75005958 / +0.0% 81112598 / 81494205 / -0.5% 0.92 / 0.92 / +0.5%
tpch_q19/duckdb:parquet 50821176 / 50449906 / +0.7% 58383644 / 56914382 / +2.6% 0.87 / 0.89 / -1.8%
tpch_q20/duckdb:parquet 64007039 / 63964403 / +0.1% 73653170 / 75273184 / -2.2% 0.87 / 0.85 / +2.3%
tpch_q21/duckdb:parquet 107453274 / 107404804 / +0.0% 115937732 / 116587137 / -0.6% 0.93 / 0.92 / +0.6%
tpch_q22/duckdb:parquet 51261036 / 51015500 / +0.5% 59360160 / 59131844 / +0.4% 0.86 / 0.86 / +0.1%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR c3a54a8e vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

The baseline could not be read from the benchmarks database; PR measurements are shown without comparison.


datafusion / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 98357582 / — / no baseline 152218818 / — / no baseline 0.65 / — / no baseline
tpch_q02/datafusion:vortex-compact 64507133 / — / no baseline 95360676 / — / no baseline 0.68 / — / no baseline
tpch_q03/datafusion:vortex-compact 67299758 / — / no baseline 111844010 / — / no baseline 0.60 / — / no baseline
tpch_q04/datafusion:vortex-compact 38081852 / — / no baseline 66833428 / — / no baseline 0.57 / — / no baseline
tpch_q05/datafusion:vortex-compact 121084145 / — / no baseline 188586159 / — / no baseline 0.64 / — / no baseline
tpch_q06/datafusion:vortex-compact 15834322 / — / no baseline 52404936 / — / no baseline 0.30 / — / no baseline
tpch_q07/datafusion:vortex-compact 140312329 / — / no baseline 194636206 / — / no baseline 0.72 / — / no baseline
tpch_q08/datafusion:vortex-compact 144600875 / — / no baseline 215318335 / — / no baseline 0.67 / — / no baseline
tpch_q09/datafusion:vortex-compact 186294426 / — / no baseline 343821126 / — / no baseline 0.54 / — / no baseline
tpch_q10/datafusion:vortex-compact 79044694 / — / no baseline 125334974 / — / no baseline 0.63 / — / no baseline
tpch_q11/datafusion:vortex-compact 44261901 / — / no baseline 66468379 / — / no baseline 0.67 / — / no baseline
tpch_q12/datafusion:vortex-compact 47025732 / — / no baseline 77207788 / — / no baseline 0.61 / — / no baseline
tpch_q13/datafusion:vortex-compact 56799371 / — / no baseline 87718486 / — / no baseline 0.65 / — / no baseline
tpch_q14/datafusion:vortex-compact 25456622 / — / no baseline 87627353 / — / no baseline 0.29 / — / no baseline
tpch_q15/datafusion:vortex-compact 45974226 / — / no baseline 93759734 / — / no baseline 0.49 / — / no baseline
tpch_q16/datafusion:vortex-compact 38051243 / — / no baseline 67257642 / — / no baseline 0.57 / — / no baseline
tpch_q17/datafusion:vortex-compact 174336444 / — / no baseline 218179681 / — / no baseline 0.80 / — / no baseline
tpch_q18/datafusion:vortex-compact 203980128 / — / no baseline 267925632 / — / no baseline 0.76 / — / no baseline
tpch_q19/datafusion:vortex-compact 35095848 / — / no baseline 83968121 / — / no baseline 0.42 / — / no baseline
tpch_q20/datafusion:vortex-compact 65203327 / — / no baseline 114137981 / — / no baseline 0.57 / — / no baseline
tpch_q21/datafusion:vortex-compact 186314680 / — / no baseline 238535107 / — / no baseline 0.78 / — / no baseline
tpch_q22/datafusion:vortex-compact 26645354 / — / no baseline 52309478 / — / no baseline 0.51 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87519979 / — / no baseline 124716087 / — / no baseline 0.70 / — / no baseline
tpch_q02/datafusion:parquet 175619984 / — / no baseline 200714756 / — / no baseline 0.87 / — / no baseline
tpch_q03/datafusion:parquet 138246132 / — / no baseline 181991607 / — / no baseline 0.76 / — / no baseline
tpch_q04/datafusion:parquet 58898419 / — / no baseline 96596927 / — / no baseline 0.61 / — / no baseline
tpch_q05/datafusion:parquet 169417159 / — / no baseline 224069553 / — / no baseline 0.76 / — / no baseline
tpch_q06/datafusion:parquet 37126545 / — / no baseline 75815890 / — / no baseline 0.49 / — / no baseline
tpch_q07/datafusion:parquet 217578600 / — / no baseline 270912034 / — / no baseline 0.80 / — / no baseline
tpch_q08/datafusion:parquet 220435651 / — / no baseline 290069938 / — / no baseline 0.76 / — / no baseline
tpch_q09/datafusion:parquet 312591380 / — / no baseline 380873487 / — / no baseline 0.82 / — / no baseline
tpch_q10/datafusion:parquet 321964261 / — / no baseline 377056307 / — / no baseline 0.85 / — / no baseline
tpch_q11/datafusion:parquet 126516786 / — / no baseline 149128418 / — / no baseline 0.85 / — / no baseline
tpch_q12/datafusion:parquet 84239021 / — / no baseline 120703684 / — / no baseline 0.70 / — / no baseline
tpch_q13/datafusion:parquet 216453620 / — / no baseline 248512154 / — / no baseline 0.87 / — / no baseline
tpch_q14/datafusion:parquet 87677416 / — / no baseline 194520316 / — / no baseline 0.45 / — / no baseline
tpch_q15/datafusion:parquet 104755914 / — / no baseline 154570553 / — / no baseline 0.68 / — / no baseline
tpch_q16/datafusion:parquet 97237838 / — / no baseline 125036049 / — / no baseline 0.78 / — / no baseline
tpch_q17/datafusion:parquet 213646718 / — / no baseline 259172152 / — / no baseline 0.82 / — / no baseline
tpch_q18/datafusion:parquet 272415272 / — / no baseline 315036525 / — / no baseline 0.86 / — / no baseline
tpch_q19/datafusion:parquet 108797070 / — / no baseline 169973903 / — / no baseline 0.64 / — / no baseline
tpch_q20/datafusion:parquet 189667478 / — / no baseline 248773413 / — / no baseline 0.76 / — / no baseline
tpch_q21/datafusion:parquet 248442364 / — / no baseline 315304972 / — / no baseline 0.79 / — / no baseline
tpch_q22/datafusion:parquet 154024393 / — / no baseline 178661023 / — / no baseline 0.86 / — / no baseline
duckdb / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 45547896 / — / no baseline 78080716 / — / no baseline 0.58 / — / no baseline
tpch_q02/duckdb:vortex-compact 40595943 / — / no baseline 56965071 / — / no baseline 0.71 / — / no baseline
tpch_q03/duckdb:vortex-compact 58284863 / — / no baseline 95775414 / — / no baseline 0.61 / — / no baseline
tpch_q04/duckdb:vortex-compact 53039211 / — / no baseline 79211694 / — / no baseline 0.67 / — / no baseline
tpch_q05/duckdb:vortex-compact 71499475 / — / no baseline 103131970 / — / no baseline 0.69 / — / no baseline
tpch_q06/duckdb:vortex-compact 19517951 / — / no baseline 52466006 / — / no baseline 0.37 / — / no baseline
tpch_q07/duckdb:vortex-compact 62886886 / — / no baseline 106452427 / — / no baseline 0.59 / — / no baseline
tpch_q08/duckdb:vortex-compact 90812150 / — / no baseline 127393496 / — / no baseline 0.71 / — / no baseline
tpch_q09/duckdb:vortex-compact 105023003 / — / no baseline 155401811 / — / no baseline 0.68 / — / no baseline
tpch_q10/duckdb:vortex-compact 102389547 / — / no baseline 140723579 / — / no baseline 0.73 / — / no baseline
tpch_q11/duckdb:vortex-compact 14089256 / — / no baseline 27497769 / — / no baseline 0.51 / — / no baseline
tpch_q12/duckdb:vortex-compact 58113329 / — / no baseline 82332315 / — / no baseline 0.71 / — / no baseline
tpch_q13/duckdb:vortex-compact 77314481 / — / no baseline 98236358 / — / no baseline 0.79 / — / no baseline
tpch_q14/duckdb:vortex-compact 32740361 / — / no baseline 70353939 / — / no baseline 0.47 / — / no baseline
tpch_q15/duckdb:vortex-compact 30290391 / — / no baseline 67340475 / — / no baseline 0.45 / — / no baseline
tpch_q16/duckdb:vortex-compact 53402989 / — / no baseline 63312053 / — / no baseline 0.84 / — / no baseline
tpch_q17/duckdb:vortex-compact 36516620 / — / no baseline 65126445 / — / no baseline 0.56 / — / no baseline
tpch_q18/duckdb:vortex-compact 101818570 / — / no baseline 118174920 / — / no baseline 0.86 / — / no baseline
tpch_q19/duckdb:vortex-compact 32977731 / — / no baseline 76150532 / — / no baseline 0.43 / — / no baseline
tpch_q20/duckdb:vortex-compact 48824519 / — / no baseline 98639772 / — / no baseline 0.49 / — / no baseline
tpch_q21/duckdb:vortex-compact 106043318 / — / no baseline 147749493 / — / no baseline 0.72 / — / no baseline
tpch_q22/duckdb:vortex-compact 39159974 / — / no baseline 56427855 / — / no baseline 0.69 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 69040649 / — / no baseline 93510043 / — / no baseline 0.74 / — / no baseline
tpch_q02/duckdb:parquet 87262100 / — / no baseline 99563140 / — / no baseline 0.88 / — / no baseline
tpch_q03/duckdb:parquet 112018850 / — / no baseline 144224602 / — / no baseline 0.78 / — / no baseline
tpch_q04/duckdb:parquet 77098537 / — / no baseline 99171456 / — / no baseline 0.78 / — / no baseline
tpch_q05/duckdb:parquet 124152141 / — / no baseline 157736741 / — / no baseline 0.79 / — / no baseline
tpch_q06/duckdb:parquet 35813781 / — / no baseline 61131189 / — / no baseline 0.59 / — / no baseline
tpch_q07/duckdb:parquet 117464765 / — / no baseline 156556099 / — / no baseline 0.75 / — / no baseline
tpch_q08/duckdb:parquet 148298955 / — / no baseline 194923035 / — / no baseline 0.76 / — / no baseline
tpch_q09/duckdb:parquet 237998474 / — / no baseline 284200894 / — / no baseline 0.84 / — / no baseline
tpch_q10/duckdb:parquet 319203702 / — / no baseline 342546557 / — / no baseline 0.93 / — / no baseline
tpch_q11/duckdb:parquet 43798782 / — / no baseline 50936726 / — / no baseline 0.86 / — / no baseline
tpch_q12/duckdb:parquet 72355441 / — / no baseline 92334769 / — / no baseline 0.78 / — / no baseline
tpch_q13/duckdb:parquet 293764947 / — / no baseline 311005577 / — / no baseline 0.94 / — / no baseline
tpch_q14/duckdb:parquet 101827820 / — / no baseline 140321987 / — / no baseline 0.73 / — / no baseline
tpch_q15/duckdb:parquet 58775733 / — / no baseline 86469386 / — / no baseline 0.68 / — / no baseline
tpch_q16/duckdb:parquet 101339724 / — / no baseline 108240803 / — / no baseline 0.94 / — / no baseline
tpch_q17/duckdb:parquet 81881002 / — / no baseline 115745257 / — / no baseline 0.71 / — / no baseline
tpch_q18/duckdb:parquet 157347941 / — / no baseline 169977650 / — / no baseline 0.93 / — / no baseline
tpch_q19/duckdb:parquet 99097920 / — / no baseline 134459723 / — / no baseline 0.74 / — / no baseline
tpch_q20/duckdb:parquet 147957527 / — / no baseline 192393254 / — / no baseline 0.77 / — / no baseline
tpch_q21/duckdb:parquet 254788520 / — / no baseline 282804642 / — / no baseline 0.90 / — / no baseline
tpch_q22/duckdb:parquet 169258736 / — / no baseline 183804599 / — / no baseline 0.92 / — / no baseline

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR c3a54a8e vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

The baseline could not be read from the benchmarks database; PR measurements are shown without comparison.


datafusion / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1827366 / — / no baseline 6487284 / — / no baseline 0.28 / — / no baseline
statpopgen_q01/datafusion:vortex-compact 22954060 / — / no baseline 23298638 / — / no baseline 0.99 / — / no baseline
statpopgen_q02/datafusion:vortex-compact 134811618 / — / no baseline 150959793 / — / no baseline 0.89 / — / no baseline
statpopgen_q03/datafusion:vortex-compact 390609034 / — / no baseline 415113277 / — / no baseline 0.94 / — / no baseline
statpopgen_q04/datafusion:vortex-compact 391987821 / — / no baseline 582257118 / — / no baseline 0.67 / — / no baseline
statpopgen_q05/datafusion:vortex-compact 237450586 / — / no baseline 257538301 / — / no baseline 0.92 / — / no baseline
statpopgen_q06/datafusion:vortex-compact 791646331 / — / no baseline 822267504 / — / no baseline 0.96 / — / no baseline
statpopgen_q07/datafusion:vortex-compact 824283390 / — / no baseline 849363648 / — / no baseline 0.97 / — / no baseline
statpopgen_q08/datafusion:vortex-compact 825215866 / — / no baseline 849643684 / — / no baseline 0.97 / — / no baseline
statpopgen_q09/datafusion:vortex-compact 296130168 / — / no baseline 319503671 / — / no baseline 0.93 / — / no baseline
statpopgen_q10/datafusion:vortex-compact 714180626 / — / no baseline 748253966 / — / no baseline 0.95 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1986722 / — / no baseline 89642843 / — / no baseline 0.02 / — / no baseline
statpopgen_q01/datafusion:parquet 164339048 / — / no baseline 174262269 / — / no baseline 0.94 / — / no baseline
statpopgen_q02/datafusion:parquet 280093377 / — / no baseline 414018423 / — / no baseline 0.68 / — / no baseline
statpopgen_q03/datafusion:parquet 384690547 / — / no baseline 540125265 / — / no baseline 0.71 / — / no baseline
statpopgen_q04/datafusion:parquet 405226116 / — / no baseline 511432725 / — / no baseline 0.79 / — / no baseline
statpopgen_q05/datafusion:parquet 312409694 / — / no baseline 449527853 / — / no baseline 0.69 / — / no baseline
statpopgen_q06/datafusion:parquet 480753510 / — / no baseline 594428271 / — / no baseline 0.81 / — / no baseline
statpopgen_q07/datafusion:parquet 422661392 / — / no baseline 635105996 / — / no baseline 0.67 / — / no baseline
statpopgen_q08/datafusion:parquet 426595844 / — / no baseline 546527536 / — / no baseline 0.78 / — / no baseline
statpopgen_q09/datafusion:parquet 350305774 / — / no baseline 461726372 / — / no baseline 0.76 / — / no baseline
statpopgen_q10/datafusion:parquet 537654546 / — / no baseline 662959518 / — / no baseline 0.81 / — / no baseline
duckdb / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12616498 / — / no baseline 14914424 / — / no baseline 0.85 / — / no baseline
statpopgen_q01/duckdb:vortex-compact 14163535 / — / no baseline 18349090 / — / no baseline 0.77 / — / no baseline
statpopgen_q02/duckdb:vortex-compact 283072187 / — / no baseline 302403869 / — / no baseline 0.94 / — / no baseline
statpopgen_q03/duckdb:vortex-compact 714847625 / — / no baseline 742790860 / — / no baseline 0.96 / — / no baseline
statpopgen_q04/duckdb:vortex-compact 711469820 / — / no baseline 749259213 / — / no baseline 0.95 / — / no baseline
statpopgen_q05/duckdb:vortex-compact 319442646 / — / no baseline 344841805 / — / no baseline 0.93 / — / no baseline
statpopgen_q06/duckdb:vortex-compact 908965098 / — / no baseline 928625086 / — / no baseline 0.98 / — / no baseline
statpopgen_q07/duckdb:vortex-compact 801525396 / — / no baseline 812316049 / — / no baseline 0.99 / — / no baseline
statpopgen_q08/duckdb:vortex-compact 813918730 / — / no baseline 814983366 / — / no baseline 1.00 / — / no baseline
statpopgen_q09/duckdb:vortex-compact 555290337 / — / no baseline 584677093 / — / no baseline 0.95 / — / no baseline
statpopgen_q10/duckdb:vortex-compact 1561659254 / — / no baseline 1555867382 / — / no baseline 1.00 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 260684800 / — / no baseline 261284576 / — / no baseline 1.00 / — / no baseline
statpopgen_q01/duckdb:parquet 323069190 / — / no baseline 329423594 / — / no baseline 0.98 / — / no baseline
statpopgen_q02/duckdb:parquet 592331852 / — / no baseline 607169493 / — / no baseline 0.98 / — / no baseline
statpopgen_q03/duckdb:parquet 754257970 / — / no baseline 838107979 / — / no baseline 0.90 / — / no baseline
statpopgen_q04/duckdb:parquet 759372740 / — / no baseline 825575552 / — / no baseline 0.92 / — / no baseline
statpopgen_q05/duckdb:parquet 549329169 / — / no baseline 584063799 / — / no baseline 0.94 / — / no baseline
statpopgen_q06/duckdb:parquet 701192518 / — / no baseline 704514837 / — / no baseline 1.00 / — / no baseline
statpopgen_q07/duckdb:parquet 588279126 / — / no baseline 670849904 / — / no baseline 0.88 / — / no baseline
statpopgen_q08/duckdb:parquet 591425941 / — / no baseline 680858359 / — / no baseline 0.87 / — / no baseline
statpopgen_q09/duckdb:parquet 716140636 / — / no baseline 812033937 / — / no baseline 0.88 / — / no baseline
statpopgen_q10/duckdb:parquet 1041368985 / — / no baseline 1187364279 / — / no baseline 0.88 / — / no baseline

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR c3a54a8e vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

The baseline could not be read from the benchmarks database; PR measurements are shown without comparison.


datafusion / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact 52117667 / — / no baseline 71479370 / — / no baseline 0.73 / — / no baseline
appian_q02/datafusion:vortex-compact 228224652 / — / no baseline 269660453 / — / no baseline 0.85 / — / no baseline
appian_q03/datafusion:vortex-compact 142490280 / — / no baseline 181998109 / — / no baseline 0.78 / — / no baseline
appian_q04/datafusion:vortex-compact 9634266566 / — / no baseline 9668752663 / — / no baseline 1.00 / — / no baseline
appian_q05/datafusion:vortex-compact 134902094 / — / no baseline 164655824 / — / no baseline 0.82 / — / no baseline
appian_q06/datafusion:vortex-compact 143697088 / — / no baseline 161815466 / — / no baseline 0.89 / — / no baseline
appian_q07/datafusion:vortex-compact 160307380 / — / no baseline 192554625 / — / no baseline 0.83 / — / no baseline
appian_q08/datafusion:vortex-compact 524070488 / — / no baseline 579704560 / — / no baseline 0.90 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 72155917 / — / no baseline 96536959 / — / no baseline 0.75 / — / no baseline
appian_q02/datafusion:parquet 292780223 / — / no baseline 335155450 / — / no baseline 0.87 / — / no baseline
appian_q03/datafusion:parquet 186374823 / — / no baseline 227929460 / — / no baseline 0.82 / — / no baseline
appian_q04/datafusion:parquet 9674856514 / — / no baseline 9739166358 / — / no baseline 0.99 / — / no baseline
appian_q05/datafusion:parquet 193039915 / — / no baseline 222424192 / — / no baseline 0.87 / — / no baseline
appian_q06/datafusion:parquet 167226174 / — / no baseline 190201564 / — / no baseline 0.88 / — / no baseline
appian_q07/datafusion:parquet 206311819 / — / no baseline 238828814 / — / no baseline 0.86 / — / no baseline
appian_q08/datafusion:parquet 630176441 / — / no baseline 696566682 / — / no baseline 0.90 / — / no baseline
duckdb / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact 84911686 / — / no baseline 99340308 / — / no baseline 0.85 / — / no baseline
appian_q02/duckdb:vortex-compact 244649941 / — / no baseline 261358119 / — / no baseline 0.94 / — / no baseline
appian_q03/duckdb:vortex-compact 113954773 / — / no baseline 134111933 / — / no baseline 0.85 / — / no baseline
appian_q04/duckdb:vortex-compact 642691047 / — / no baseline 650515752 / — / no baseline 0.99 / — / no baseline
appian_q05/duckdb:vortex-compact 121414728 / — / no baseline 131417036 / — / no baseline 0.92 / — / no baseline
appian_q06/duckdb:vortex-compact 198916381 / — / no baseline 207003750 / — / no baseline 0.96 / — / no baseline
appian_q07/duckdb:vortex-compact 118187948 / — / no baseline 128150599 / — / no baseline 0.92 / — / no baseline
appian_q08/duckdb:vortex-compact 345580783 / — / no baseline 357712314 / — / no baseline 0.97 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 94865840 / — / no baseline 106121485 / — / no baseline 0.89 / — / no baseline
appian_q02/duckdb:parquet 242629523 / — / no baseline 245642817 / — / no baseline 0.99 / — / no baseline
appian_q03/duckdb:parquet 133034689 / — / no baseline 145242443 / — / no baseline 0.92 / — / no baseline
appian_q04/duckdb:parquet 484992213 / — / no baseline 496137239 / — / no baseline 0.98 / — / no baseline
appian_q05/duckdb:parquet 131523766 / — / no baseline 139031765 / — / no baseline 0.95 / — / no baseline
appian_q06/duckdb:parquet 116528001 / — / no baseline 120295906 / — / no baseline 0.97 / — / no baseline
appian_q07/duckdb:parquet 110619082 / — / no baseline 119097334 / — / no baseline 0.93 / — / no baseline
appian_q08/duckdb:parquet 366058507 / — / no baseline 372232791 / — / no baseline 0.98 / — / no baseline

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR c3a54a8e vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

The baseline could not be read from the benchmarks database; PR measurements are shown without comparison.


datafusion / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 44541570 / — / no baseline 145766477 / — / no baseline 0.31 / — / no baseline
fineweb_q01/datafusion:vortex-compact 440421953 / — / no baseline 669409729 / — / no baseline 0.66 / — / no baseline
fineweb_q02/datafusion:vortex-compact 407651077 / — / no baseline 647277641 / — / no baseline 0.63 / — / no baseline
fineweb_q03/datafusion:vortex-compact 532754621 / — / no baseline 626848979 / — / no baseline 0.85 / — / no baseline
fineweb_q04/datafusion:vortex-compact 455857512 / — / no baseline 509007108 / — / no baseline 0.90 / — / no baseline
fineweb_q05/datafusion:vortex-compact 481197612 / — / no baseline 507083295 / — / no baseline 0.95 / — / no baseline
fineweb_q06/datafusion:vortex-compact 1005800092 / — / no baseline 766565176 / — / no baseline 1.31 / — / no baseline
fineweb_q07/datafusion:vortex-compact 494782004 / — / no baseline 419293168 / — / no baseline 1.18 / — / no baseline
fineweb_q08/datafusion:vortex-compact 167488850 / — / no baseline 388642968 / — / no baseline 0.43 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 410335044 / — / no baseline 825199772 / — / no baseline 0.50 / — / no baseline
fineweb_q01/datafusion:parquet 749887091 / — / no baseline 839297332 / — / no baseline 0.89 / — / no baseline
fineweb_q02/datafusion:parquet 1557403082 / — / no baseline 726568757 / — / no baseline 2.14 / — / no baseline
fineweb_q03/datafusion:parquet 767284454 / — / no baseline 998276953 / — / no baseline 0.77 / — / no baseline
fineweb_q04/datafusion:parquet 834940170 / — / no baseline 907323813 / — / no baseline 0.92 / — / no baseline
fineweb_q05/datafusion:parquet 715686608 / — / no baseline 725281018 / — / no baseline 0.99 / — / no baseline
fineweb_q06/datafusion:parquet 726615172 / — / no baseline 798065597 / — / no baseline 0.91 / — / no baseline
fineweb_q07/datafusion:parquet 752031838 / — / no baseline 668330021 / — / no baseline 1.13 / — / no baseline
fineweb_q08/datafusion:parquet 727811484 / — / no baseline 685862240 / — / no baseline 1.06 / — / no baseline
duckdb / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 64093093 / — / no baseline 85190548 / — / no baseline 0.75 / — / no baseline
fineweb_q01/duckdb:vortex-compact 691963265 / — / no baseline 440465377 / — / no baseline 1.57 / — / no baseline
fineweb_q02/duckdb:vortex-compact 545416501 / — / no baseline 593573662 / — / no baseline 0.92 / — / no baseline
fineweb_q03/duckdb:vortex-compact 1083823854 / — / no baseline 1070763216 / — / no baseline 1.01 / — / no baseline
fineweb_q04/duckdb:vortex-compact 1057710788 / — / no baseline 1217410933 / — / no baseline 0.87 / — / no baseline
fineweb_q05/duckdb:vortex-compact 921194590 / — / no baseline 1128274461 / — / no baseline 0.82 / — / no baseline
fineweb_q06/duckdb:vortex-compact 1086096597 / — / no baseline 1154990966 / — / no baseline 0.94 / — / no baseline
fineweb_q07/duckdb:vortex-compact 917799780 / — / no baseline 1038663190 / — / no baseline 0.88 / — / no baseline
fineweb_q08/duckdb:vortex-compact 346810974 / — / no baseline 439806412 / — / no baseline 0.79 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 301951253 / — / no baseline 404085035 / — / no baseline 0.75 / — / no baseline
fineweb_q01/duckdb:parquet 570184842 / — / no baseline 482795706 / — / no baseline 1.18 / — / no baseline
fineweb_q02/duckdb:parquet 504360020 / — / no baseline 497022878 / — / no baseline 1.01 / — / no baseline
fineweb_q03/duckdb:parquet 742804958 / — / no baseline 843238558 / — / no baseline 0.88 / — / no baseline
fineweb_q04/duckdb:parquet 704805878 / — / no baseline 746473049 / — / no baseline 0.94 / — / no baseline
fineweb_q05/duckdb:parquet 795700847 / — / no baseline 851096366 / — / no baseline 0.93 / — / no baseline
fineweb_q06/duckdb:parquet 757602450 / — / no baseline 846388383 / — / no baseline 0.90 / — / no baseline
fineweb_q07/duckdb:parquet 722428968 / — / no baseline 772769856 / — / no baseline 0.93 / — / no baseline
fineweb_q08/duckdb:parquet 323578038 / — / no baseline 465390713 / — / no baseline 0.70 / — / no baseline

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR 98f50a38 vs base 2d7dabf1
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.001x ➖
Parquet (geomean): hot 1.005x ➖ · cold 0.998x ➖
Shifts: Parquet (control) +0.5% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21154327 / 21208892 / -0.3% 39442200 / 39165288 / +0.7% 0.54 / 0.54 / -1.0%
tpcds_q02/datafusion:vortex-compact 44671420 / 45011998 / -0.8% 67822447 / 67610090 / +0.3% 0.66 / 0.67 / -1.1%
tpcds_q03/datafusion:vortex-compact 11353108 / 11575138 / -1.9% 31497073 / 30986660 / +1.6% 0.36 / 0.37 / -3.5%
tpcds_q04/datafusion:vortex-compact 93898755 / 92202969 / +1.8% 127281000 / 124580209 / +2.2% 0.74 / 0.74 / -0.3%
tpcds_q05/datafusion:vortex-compact 57361752 / 57538430 / -0.3% 81177997 / 80845199 / +0.4% 0.71 / 0.71 / -0.7%
tpcds_q06/datafusion:vortex-compact 22957163 / 23126028 / -0.7% 43463025 / 44931205 / -3.3% 0.53 / 0.51 / +2.6%
tpcds_q07/datafusion:vortex-compact 31370950 / 32145812 / -2.4% 50862088 / 52290141 / -2.7% 0.62 / 0.61 / +0.3%
tpcds_q08/datafusion:vortex-compact 26986501 / 27568684 / -2.1% 46457677 / 46822666 / -0.8% 0.58 / 0.59 / -1.3%
tpcds_q09/datafusion:vortex-compact 22082084 / 22698298 / -2.7% 40312032 / 40835100 / -1.3% 0.55 / 0.56 / -1.5%
tpcds_q10/datafusion:vortex-compact 29673584 / 28887530 / +2.7% 52976041 / 52848334 / +0.2% 0.56 / 0.55 / +2.5%
tpcds_q11/datafusion:vortex-compact 55951392 / 56099144 / -0.3% 83266986 / 85127629 / -2.2% 0.67 / 0.66 / +2.0%
tpcds_q12/datafusion:vortex-compact 18877161 / 18669060 / +1.1% 37024007 / 38139955 / -2.9% 0.51 / 0.49 / +4.2%
tpcds_q13/datafusion:vortex-compact 47445150 / 47311124 / +0.3% 68186919 / 68315359 / -0.2% 0.70 / 0.69 / +0.5%
tpcds_q14/datafusion:vortex-compact 635428434 / 632148661 / +0.5% 688509397 / 687455101 / +0.2% 0.92 / 0.92 / +0.4%
tpcds_q15/datafusion:vortex-compact 13999918 / 14630108 / -4.3% 35826855 / 35126858 / +2.0% 0.39 / 0.42 / -6.2%
tpcds_q16/datafusion:vortex-compact 19667966 / 19140628 / +2.8% 39412456 / 40410733 / -2.5% 0.50 / 0.47 / +5.4%
tpcds_q17/datafusion:vortex-compact 59075032 / 59531318 / -0.8% 80759695 / 73705281 / +9.6% 0.73 / 0.81 / -9.4%
tpcds_q18/datafusion:vortex-compact 61316082 / 60968390 / +0.6% 83271735 / 82337358 / +1.1% 0.74 / 0.74 / -0.6%
tpcds_q19/datafusion:vortex-compact 19211030 / 19184030 / +0.1% 40960507 / 41016677 / -0.1% 0.47 / 0.47 / +0.3%
tpcds_q20/datafusion:vortex-compact 20618717 / 19965828 / +3.3% 40836882 / 41129080 / -0.7% 0.50 / 0.49 / +4.0%
tpcds_q21/datafusion:vortex-compact 17647720 / 17821946 / -1.0% 41928932 / 42017619 / -0.2% 0.42 / 0.42 / -0.8%
tpcds_q22/datafusion:vortex-compact 49633380 / 50407890 / -1.5% 73656799 / 74723434 / -1.4% 0.67 / 0.67 / -0.1%
tpcds_q23/datafusion:vortex-compact 74435279 / 71837578 / +3.6% 95903132 / 95500778 / +0.4% 0.78 / 0.75 / +3.2%
tpcds_q24/datafusion:vortex-compact 71776302 / 71094618 / +1.0% 95836564 / 93238290 / +2.8% 0.75 / 0.76 / -1.8%
tpcds_q25/datafusion:vortex-compact 51582298 / 49208126 / +4.8% 83971112 / 81898832 / +2.5% 0.61 / 0.60 / +2.2%
tpcds_q26/datafusion:vortex-compact 28164684 / 27949239 / +0.8% 46827126 / 48079830 / -2.6% 0.60 / 0.58 / +3.5%
tpcds_q27/datafusion:vortex-compact 60066205 / 56330423 / +6.6% 78520388 / 80079130 / -1.9% 0.76 / 0.70 / +8.7%
tpcds_q28/datafusion:vortex-compact 26368961 / 26261707 / +0.4% 43446842 / 42285574 / +2.7% 0.61 / 0.62 / -2.3%
tpcds_q29/datafusion:vortex-compact 52889961 / 56452686 / -6.3% 81135260 / 73101532 / +11.0% 🔴 0.65 / 0.77 / -15.6%
tpcds_q30/datafusion:vortex-compact 27303323 / 27805136 / -1.8% 47506278 / 47742710 / -0.5% 0.57 / 0.58 / -1.3%
tpcds_q31/datafusion:vortex-compact 61124912 / 60821405 / +0.5% 88019253 / 87854943 / +0.2% 0.69 / 0.69 / +0.3%
tpcds_q32/datafusion:vortex-compact 13651427 / 13403004 / +1.9% 34300861 / 34073574 / +0.7% 0.40 / 0.39 / +1.2%
tpcds_q33/datafusion:vortex-compact 27911084 / 27814518 / +0.3% 52121515 / 51803746 / +0.6% 0.54 / 0.54 / -0.3%
tpcds_q34/datafusion:vortex-compact 18691098 / 18530344 / +0.9% 36961790 / 39239916 / -5.8% 0.51 / 0.47 / +7.1%
tpcds_q35/datafusion:vortex-compact 34295506 / 33166575 / +3.4% 56177298 / 58412843 / -3.8% 0.61 / 0.57 / +7.5%
tpcds_q36/datafusion:vortex-compact 48355352 / 49526324 / -2.4% 73163496 / 76104931 / -3.9% 0.66 / 0.65 / +1.6%
tpcds_q37/datafusion:vortex-compact 14573086 / 14322638 / +1.7% 37623473 / 36170152 / +4.0% 0.39 / 0.40 / -2.2%
tpcds_q38/datafusion:vortex-compact 26082948 / 26079018 / +0.0% 49965860 / 49313063 / +1.3% 0.52 / 0.53 / -1.3%
tpcds_q39/datafusion:vortex-compact 67150258 / 66983008 / +0.2% 89428543 / 91064807 / -1.8% 0.75 / 0.74 / +2.1%
tpcds_q40/datafusion:vortex-compact 24304732 / 24144746 / +0.7% 47138206 / 47555012 / -0.9% 0.52 / 0.51 / +1.6%
tpcds_q41/datafusion:vortex-compact 21341738 / 20749296 / +2.9% 35407892 / 37196605 / -4.8% 0.60 / 0.56 / +8.1%
tpcds_q42/datafusion:vortex-compact 11647117 / 11364087 / +2.5% 29332230 / 30672141 / -4.4% 0.40 / 0.37 / +7.2%
tpcds_q43/datafusion:vortex-compact 13149967 / 13060984 / +0.7% 32614358 / 31656330 / +3.0% 0.40 / 0.41 / -2.3%
tpcds_q44/datafusion:vortex-compact 28362518 / 28460052 / -0.3% 48610307 / 50796775 / -4.3% 0.58 / 0.56 / +4.1%
tpcds_q45/datafusion:vortex-compact 17433627 / 17582469 / -0.8% 36741838 / 37922439 / -3.1% 0.47 / 0.46 / +2.3%
tpcds_q46/datafusion:vortex-compact 24724172 / 24739516 / -0.1% 47189796 / 49182600 / -4.1% 0.52 / 0.50 / +4.2%
tpcds_q47/datafusion:vortex-compact 79726442 / 79644822 / +0.1% 115704669 / 110731330 / +4.5% 0.69 / 0.72 / -4.2%
tpcds_q48/datafusion:vortex-compact 43071163 / 43454083 / -0.9% 64095769 / 64599191 / -0.8% 0.67 / 0.67 / -0.1%
tpcds_q49/datafusion:vortex-compact 59227986 / 59404617 / -0.3% 82685789 / 88595587 / -6.7% 0.72 / 0.67 / +6.8%
tpcds_q50/datafusion:vortex-compact 31692963 / 32464492 / -2.4% 51372028 / 54389607 / -5.5% 0.62 / 0.60 / +3.4%
tpcds_q51/datafusion:vortex-compact 65686392 / 66895571 / -1.8% 88614342 / 88072568 / +0.6% 0.74 / 0.76 / -2.4%
tpcds_q52/datafusion:vortex-compact 11382644 / 11578716 / -1.7% 30393906 / 31867972 / -4.6% 0.37 / 0.36 / +3.1%
tpcds_q53/datafusion:vortex-compact 20876038 / 21010600 / -0.6% 42655655 / 42946429 / -0.7% 0.49 / 0.49 / +0.0%
tpcds_q54/datafusion:vortex-compact 33789007 / 33440798 / +1.0% 58302344 / 58967508 / -1.1% 0.58 / 0.57 / +2.2%
tpcds_q55/datafusion:vortex-compact 10995124 / 11354184 / -3.2% 31295546 / 30453848 / +2.8% 0.35 / 0.37 / -5.8%
tpcds_q56/datafusion:vortex-compact 25849826 / 26167793 / -1.2% 49011154 / 47762537 / +2.6% 0.53 / 0.55 / -3.7%
tpcds_q57/datafusion:vortex-compact 65711016 / 66744709 / -1.5% 93924330 / 93023467 / +1.0% 0.70 / 0.72 / -2.5%
tpcds_q58/datafusion:vortex-compact 41392630 / 41773626 / -0.9% 67775280 / 67410616 / +0.5% 0.61 / 0.62 / -1.4%
tpcds_q59/datafusion:vortex-compact 32432701 / 31615992 / +2.6% 56919297 / 56267354 / +1.2% 0.57 / 0.56 / +1.4%
tpcds_q60/datafusion:vortex-compact 26624608 / 26566750 / +0.2% 48496933 / 49005403 / -1.0% 0.55 / 0.54 / +1.3%
tpcds_q61/datafusion:vortex-compact 23385643 / 22672638 / +3.1% 42509655 / 41789685 / +1.7% 0.55 / 0.54 / +1.4%
tpcds_q62/datafusion:vortex-compact 16737599 / 16627529 / +0.7% 35219463 / 35472785 / -0.7% 0.48 / 0.47 / +1.4%
tpcds_q63/datafusion:vortex-compact 20437470 / 20816849 / -1.8% 40885380 / 41058685 / -0.4% 0.50 / 0.51 / -1.4%
tpcds_q64/datafusion:vortex-compact 302980097 / 304158196 / -0.4% 334443657 / 337189502 / -0.8% 0.91 / 0.90 / +0.4%
tpcds_q65/datafusion:vortex-compact 75380090 / 75968180 / -0.8% 99936626 / 101376122 / -1.4% 0.75 / 0.75 / +0.7%
tpcds_q66/datafusion:vortex-compact 51725868 / 51155332 / +1.1% 74180420 / 74607363 / -0.6% 0.70 / 0.69 / +1.7%
tpcds_q67/datafusion:vortex-compact 52687099 / 52192050 / +0.9% 82465627 / 84736258 / -2.7% 0.64 / 0.62 / +3.7%
tpcds_q68/datafusion:vortex-compact 25378785 / 25142890 / +0.9% 49534484 / 50606693 / -2.1% 0.51 / 0.50 / +3.1%
tpcds_q69/datafusion:vortex-compact 29059294 / 28595285 / +1.6% 49970320 / 51523459 / -3.0% 0.58 / 0.55 / +4.8%
tpcds_q70/datafusion:vortex-compact 72174363 / 71493626 / +1.0% 93026784 / 93658717 / -0.7% 0.78 / 0.76 / +1.6%
tpcds_q71/datafusion:vortex-compact 19335563 / 19189604 / +0.8% 39675376 / 38579165 / +2.8% 0.49 / 0.50 / -2.0%
tpcds_q72/datafusion:vortex-compact 359446119 / 357192424 / +0.6% 414308203 / 382785301 / +8.2% 0.87 / 0.93 / -7.0%
tpcds_q73/datafusion:vortex-compact 17373888 / 17434305 / -0.3% 37051148 / 37938345 / -2.3% 0.47 / 0.46 / +2.0%
tpcds_q74/datafusion:vortex-compact 42349799 / 41396985 / +2.3% 68504990 / 69525179 / -1.5% 0.62 / 0.60 / +3.8%
tpcds_q75/datafusion:vortex-compact 139463670 / 139424331 / +0.0% 169958055 / 170699032 / -0.4% 0.82 / 0.82 / +0.5%
tpcds_q76/datafusion:vortex-compact 30362208 / 30750442 / -1.3% 51874163 / 52622112 / -1.4% 0.59 / 0.58 / +0.2%
tpcds_q77/datafusion:vortex-compact 46123486 / 46744630 / -1.3% 67307262 / 68558252 / -1.8% 0.69 / 0.68 / +0.5%
tpcds_q78/datafusion:vortex-compact 65935889 / 66140304 / -0.3% 91659169 / 93017359 / -1.5% 0.72 / 0.71 / +1.2%
tpcds_q79/datafusion:vortex-compact 20601674 / 21551145 / -4.4% 42845403 / 41685132 / +2.8% 0.48 / 0.52 / -7.0%
tpcds_q80/datafusion:vortex-compact 74939204 / 74838210 / +0.1% 100867249 / 103220171 / -2.3% 0.74 / 0.73 / +2.5%
tpcds_q81/datafusion:vortex-compact 27046962 / 26793503 / +0.9% 44677047 / 45154513 / -1.1% 0.61 / 0.59 / +2.0%
tpcds_q82/datafusion:vortex-compact 13234136 / 13282058 / -0.4% 36004729 / 38548940 / -6.6% 0.37 / 0.34 / +6.7%
tpcds_q83/datafusion:vortex-compact 32881531 / 32802678 / +0.2% 54475339 / 54953905 / -0.9% 0.60 / 0.60 / +1.1%
tpcds_q84/datafusion:vortex-compact 11107811 / 11075942 / +0.3% 26025995 / 27105315 / -4.0% 0.43 / 0.41 / +4.4%
tpcds_q85/datafusion:vortex-compact 94934550 / 95988611 / -1.1% 120286763 / 122130826 / -1.5% 0.79 / 0.79 / +0.4%
tpcds_q86/datafusion:vortex-compact 15711622 / 15693240 / +0.1% 33735942 / 34642700 / -2.6% 0.47 / 0.45 / +2.8%
tpcds_q87/datafusion:vortex-compact 25923852 / 25989960 / -0.3% 48367224 / 50509447 / -4.2% 0.54 / 0.51 / +4.2%
tpcds_q88/datafusion:vortex-compact 36320970 / 35859212 / +1.3% 56343547 / 57359488 / -1.8% 0.64 / 0.63 / +3.1%
tpcds_q89/datafusion:vortex-compact 22981124 / 22630302 / +1.6% 43764866 / 44064817 / -0.7% 0.53 / 0.51 / +2.2%
tpcds_q90/datafusion:vortex-compact 10472574 / 10301650 / +1.7% 26393114 / 27553032 / -4.2% 0.40 / 0.37 / +6.1%
tpcds_q91/datafusion:vortex-compact 24760912 / 24614062 / +0.6% 45144861 / 44832378 / +0.7% 0.55 / 0.55 / -0.1%
tpcds_q92/datafusion:vortex-compact 13567260 / 13627230 / -0.4% 30308865 / 31172338 / -2.8% 0.45 / 0.44 / +2.4%
tpcds_q93/datafusion:vortex-compact 20417553 / 20902506 / -2.3% 40395893 / 40418430 / -0.1% 0.51 / 0.52 / -2.3%
tpcds_q94/datafusion:vortex-compact 19287498 / 19319822 / -0.2% 38010415 / 37886262 / +0.3% 0.51 / 0.51 / -0.5%
tpcds_q95/datafusion:vortex-compact 43151573 / 43521366 / -0.8% 65285283 / 63053759 / +3.5% 0.66 / 0.69 / -4.2%
tpcds_q96/datafusion:vortex-compact 8595832 / 8365176 / +2.8% 25550143 / 25623873 / -0.3% 0.34 / 0.33 / +3.1%
tpcds_q97/datafusion:vortex-compact 17452332 / 17069678 / +2.2% 36473954 / 38168271 / -4.4% 0.48 / 0.45 / +7.0%
tpcds_q98/datafusion:vortex-compact 20795465 / 20943998 / -0.7% 41010060 / 42315546 / -3.1% 0.51 / 0.49 / +2.5%
tpcds_q99/datafusion:vortex-compact 16595154 / 16547761 / +0.3% 36713507 / 36518390 / +0.5% 0.45 / 0.45 / -0.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 43251265 / 41656165 / +3.8% 57998898 / 60739830 / -4.5% 0.75 / 0.69 / +8.7%
tpcds_q02/datafusion:parquet 55679790 / 55212042 / +0.8% 70743730 / 72141593 / -1.9% 0.79 / 0.77 / +2.8%
tpcds_q03/datafusion:parquet 19098484 / 19068380 / +0.2% 31274473 / 32735429 / -4.5% 0.61 / 0.58 / +4.8%
tpcds_q04/datafusion:parquet 180285130 / 179775747 / +0.3% 206954893 / 205717005 / +0.6% 0.87 / 0.87 / -0.3%
tpcds_q05/datafusion:parquet 68644120 / 68388134 / +0.4% 88982501 / 89241286 / -0.3% 0.77 / 0.77 / +0.7%
tpcds_q06/datafusion:parquet 33884326 / 33171784 / +2.1% 47584628 / 47177646 / +0.9% 0.71 / 0.70 / +1.3%
tpcds_q07/datafusion:parquet 47526655 / 47187972 / +0.7% 66337685 / 65189947 / +1.8% 0.72 / 0.72 / -1.0%
tpcds_q08/datafusion:parquet 31041508 / 31327160 / -0.9% 46611710 / 46607379 / +0.0% 0.67 / 0.67 / -0.9%
tpcds_q09/datafusion:parquet 30204948 / 32052300 / -5.8% 37129685 / 46487644 / -20.1% 🟢 0.81 / 0.69 / +18.0%
tpcds_q10/datafusion:parquet 44112920 / 44370068 / -0.6% 57519382 / 61496713 / -6.5% 0.77 / 0.72 / +6.3%
tpcds_q11/datafusion:parquet 100017874 / 98156142 / +1.9% 118982288 / 120631405 / -1.4% 0.84 / 0.81 / +3.3%
tpcds_q12/datafusion:parquet 23825520 / 23882186 / -0.2% 36314334 / 38136193 / -4.8% 0.66 / 0.63 / +4.8%
tpcds_q13/datafusion:parquet 47139590 / 46767742 / +0.8% 67044151 / 69706171 / -3.8% 0.70 / 0.67 / +4.8%
tpcds_q14/datafusion:parquet 538191898 / 536408458 / +0.3% 584618713 / 587025047 / -0.4% 0.92 / 0.91 / +0.7%
tpcds_q15/datafusion:parquet 23966654 / 23641302 / +1.4% 37948976 / 38088623 / -0.4% 0.63 / 0.62 / +1.7%
tpcds_q16/datafusion:parquet 37344548 / 37166722 / +0.5% 51239754 / 49745797 / +3.0% 0.73 / 0.75 / -2.5%
tpcds_q17/datafusion:parquet 73505748 / 73495853 / +0.0% 96259485 / 100032376 / -3.8% 0.76 / 0.73 / +3.9%
tpcds_q18/datafusion:parquet 70151310 / 64852455 / +8.2% 86046311 / 88901176 / -3.2% 0.82 / 0.73 / +11.8%
tpcds_q19/datafusion:parquet 29846717 / 29872604 / -0.1% 43994569 / 44097025 / -0.2% 0.68 / 0.68 / +0.1%
tpcds_q20/datafusion:parquet 25738420 / 25316377 / +1.7% 36522310 / 38560695 / -5.3% 0.70 / 0.66 / +7.3%
tpcds_q21/datafusion:parquet 20125642 / 20363640 / -1.2% 32533731 / 32273865 / +0.8% 0.62 / 0.63 / -2.0%
tpcds_q22/datafusion:parquet 76818873 / 77278861 / -0.6% 88523203 / 88716275 / -0.2% 0.87 / 0.87 / -0.4%
tpcds_q23/datafusion:parquet 92120269 / 92686948 / -0.6% 117535261 / 116455275 / +0.9% 0.78 / 0.80 / -1.5%
tpcds_q24/datafusion:parquet 91211447 / 91266226 / -0.1% 116577376 / 114048985 / +2.2% 0.78 / 0.80 / -2.2%
tpcds_q25/datafusion:parquet 79875453 / 80177774 / -0.4% 99490983 / 105460992 / -5.7% 0.80 / 0.76 / +5.6%
tpcds_q26/datafusion:parquet 44667641 / 44061986 / +1.4% 61968159 / 59828461 / +3.6% 0.72 / 0.74 / -2.1%
tpcds_q27/datafusion:parquet 74560150 / 75434223 / -1.2% 95584424 / 99932460 / -4.4% 0.78 / 0.75 / +3.3%
tpcds_q28/datafusion:parquet 28527850 / 28526590 / +0.0% 42468474 / 45234134 / -6.1% 0.67 / 0.63 / +6.5%
tpcds_q29/datafusion:parquet 74028390 / 75053330 / -1.4% 94911628 / 96056731 / -1.2% 0.78 / 0.78 / -0.2%
tpcds_q30/datafusion:parquet 44955362 / 46357226 / -3.0% 61428982 / 58720009 / +4.6% 0.73 / 0.79 / -7.3%
tpcds_q31/datafusion:parquet 79593545 / 81262749 / -2.1% 97489447 / 98687517 / -1.2% 0.82 / 0.82 / -0.9%
tpcds_q32/datafusion:parquet 26493464 / 26708592 / -0.8% 41060887 / 37974864 / +8.1% 0.65 / 0.70 / -8.3%
tpcds_q33/datafusion:parquet 37589226 / 37149065 / +1.2% 53293931 / 55556857 / -4.1% 0.71 / 0.67 / +5.5%
tpcds_q34/datafusion:parquet 24665178 / 24878632 / -0.9% 35566353 / 36206744 / -1.8% 0.69 / 0.69 / +0.9%
tpcds_q35/datafusion:parquet 50709182 / 51779254 / -2.1% 64172746 / 61500424 / +4.3% 0.79 / 0.84 / -6.1%
tpcds_q36/datafusion:parquet 52710244 / 51922025 / +1.5% 71023728 / 71581681 / -0.8% 0.74 / 0.73 / +2.3%
tpcds_q37/datafusion:parquet 21304854 / 20957980 / +1.7% 34175282 / 33797545 / +1.1% 0.62 / 0.62 / +0.5%
tpcds_q38/datafusion:parquet 45530147 / 45147892 / +0.8% 58853154 / 61730671 / -4.7% 0.77 / 0.73 / +5.8%
tpcds_q39/datafusion:parquet 67558698 / 67891039 / -0.5% 84899888 / 85364973 / -0.5% 0.80 / 0.80 / +0.1%
tpcds_q40/datafusion:parquet 31361162 / 30869369 / +1.6% 49841987 / 52417766 / -4.9% 0.63 / 0.59 / +6.8%
tpcds_q41/datafusion:parquet 20333612 / 19517488 / +4.2% 31418334 / 32474556 / -3.3% 0.65 / 0.60 / +7.7%
tpcds_q42/datafusion:parquet 18174564 / 18160588 / +0.1% 29290833 / 30231589 / -3.1% 0.62 / 0.60 / +3.3%
tpcds_q43/datafusion:parquet 19592661 / 19657175 / -0.3% 31910513 / 31510198 / +1.3% 0.61 / 0.62 / -1.6%
tpcds_q44/datafusion:parquet 34063698 / 33884378 / +0.5% 51637501 / 49896068 / +3.5% 0.66 / 0.68 / -2.9%
tpcds_q45/datafusion:parquet 26842300 / 27475086 / -2.3% 40478997 / 43475561 / -6.9% 0.66 / 0.63 / +4.9%
tpcds_q46/datafusion:parquet 29632563 / 29692794 / -0.2% 47136804 / 46101558 / +2.2% 0.63 / 0.64 / -2.4%
tpcds_q47/datafusion:parquet 98080535 / 97653052 / +0.4% 117813028 / 120563890 / -2.3% 0.83 / 0.81 / +2.8%
tpcds_q48/datafusion:parquet 41377202 / 42042380 / -1.6% 58788301 / 60643283 / -3.1% 0.70 / 0.69 / +1.5%
tpcds_q49/datafusion:parquet 70804441 / 71406853 / -0.8% 93818016 / 94250311 / -0.5% 0.75 / 0.76 / -0.4%
tpcds_q50/datafusion:parquet 47834345 / 47575222 / +0.5% 68236933 / 68408296 / -0.3% 0.70 / 0.70 / +0.8%
tpcds_q51/datafusion:parquet 75748167 / 75297210 / +0.6% 95979989 / 95192056 / +0.8% 0.79 / 0.79 / -0.2%
tpcds_q52/datafusion:parquet 18828726 / 18651342 / +1.0% 32317049 / 31428897 / +2.8% 0.58 / 0.59 / -1.8%
tpcds_q53/datafusion:parquet 23154010 / 22950744 / +0.9% 39249209 / 39744660 / -1.2% 0.59 / 0.58 / +2.2%
tpcds_q54/datafusion:parquet 52649470 / 52564284 / +0.2% 67635727 / 67886731 / -0.4% 0.78 / 0.77 / +0.5%
tpcds_q55/datafusion:parquet 18193452 / 18341044 / -0.8% 30060766 / 30114011 / -0.2% 0.61 / 0.61 / -0.6%
tpcds_q56/datafusion:parquet 40875223 / 41185971 / -0.8% 55387374 / 55868014 / -0.9% 0.74 / 0.74 / +0.1%
tpcds_q57/datafusion:parquet 102478144 / 100817998 / +1.6% 117790642 / 115039732 / +2.4% 0.87 / 0.88 / -0.7%
tpcds_q58/datafusion:parquet 65672645 / 66082371 / -0.6% 85160326 / 84597044 / +0.7% 0.77 / 0.78 / -1.3%
tpcds_q59/datafusion:parquet 48183846 / 47476018 / +1.5% 64540359 / 64946079 / -0.6% 0.75 / 0.73 / +2.1%
tpcds_q60/datafusion:parquet 40116066 / 39236993 / +2.2% 55724900 / 52472347 / +6.2% 0.72 / 0.75 / -3.7%
tpcds_q61/datafusion:parquet 36258910 / 37270396 / -2.7% 51991880 / 52362044 / -0.7% 0.70 / 0.71 / -2.0%
tpcds_q62/datafusion:parquet 25324424 / 25380222 / -0.2% 38693830 / 38680199 / +0.0% 0.65 / 0.66 / -0.3%
tpcds_q63/datafusion:parquet 22184495 / 22222340 / -0.2% 38899910 / 38522171 / +1.0% 0.57 / 0.58 / -1.1%
tpcds_q64/datafusion:parquet 289065122 / 288076551 / +0.3% 329237711 / 327270934 / +0.6% 0.88 / 0.88 / -0.3%
tpcds_q65/datafusion:parquet 121464239 / 119225635 / +1.9% 140376091 / 137731003 / +1.9% 0.87 / 0.87 / -0.0%
tpcds_q66/datafusion:parquet 60899699 / 60095628 / +1.3% 79857683 / 77341868 / +3.3% 0.76 / 0.78 / -1.9%
tpcds_q67/datafusion:parquet 68990267 / 68292016 / +1.0% 92399231 / 93284535 / -0.9% 0.75 / 0.73 / +2.0%
tpcds_q68/datafusion:parquet 29706806 / 29851266 / -0.5% 49778529 / 49304783 / +1.0% 0.60 / 0.61 / -1.4%
tpcds_q69/datafusion:parquet 43991290 / 43631456 / +0.8% 58675220 / 59161600 / -0.8% 0.75 / 0.74 / +1.7%
tpcds_q70/datafusion:parquet 80869066 / 80137860 / +0.9% 98124318 / 100292559 / -2.2% 0.82 / 0.80 / +3.1%
tpcds_q71/datafusion:parquet 25250517 / 26560637 / -4.9% 38635474 / 38701579 / -0.2% 0.65 / 0.69 / -4.8%
tpcds_q72/datafusion:parquet 523133108 / 521011044 / +0.4% 540287290 / 548248961 / -1.5% 0.97 / 0.95 / +1.9%
tpcds_q73/datafusion:parquet 24058978 / 24089379 / -0.1% 36235637 / 35854802 / +1.1% 0.66 / 0.67 / -1.2%
tpcds_q74/datafusion:parquet 70662027 / 70203574 / +0.7% 88900991 / 87359783 / +1.8% 0.79 / 0.80 / -1.1%
tpcds_q75/datafusion:parquet 152560954 / 155356960 / -1.8% 184848130 / 182993640 / +1.0% 0.83 / 0.85 / -2.8%
tpcds_q76/datafusion:parquet 33931752 / 33888674 / +0.1% 46939724 / 48497632 / -3.2% 0.72 / 0.70 / +3.5%
tpcds_q77/datafusion:parquet 58066467 / 58031420 / +0.1% 75897594 / 78395973 / -3.2% 0.77 / 0.74 / +3.4%
tpcds_q78/datafusion:parquet 85638336 / 85181612 / +0.5% 119941462 / 122624455 / -2.2% 0.71 / 0.69 / +2.8%
tpcds_q79/datafusion:parquet 27095510 / 27476953 / -1.4% 42569632 / 43494692 / -2.1% 0.64 / 0.63 / +0.8%
tpcds_q80/datafusion:parquet 80824148 / 81564428 / -0.9% 112021221 / 112429126 / -0.4% 0.72 / 0.73 / -0.5%
tpcds_q81/datafusion:parquet 37927305 / 39301338 / -3.5% 53412198 / 54757794 / -2.5% 0.71 / 0.72 / -1.1%
tpcds_q82/datafusion:parquet 22071226 / 22527666 / -2.0% 36354609 / 35536114 / +2.3% 0.61 / 0.63 / -4.2%
tpcds_q83/datafusion:parquet 59232720 / 58879101 / +0.6% 73163411 / 75401712 / -3.0% 0.81 / 0.78 / +3.7%
tpcds_q84/datafusion:parquet 26584112 / 26191199 / +1.5% 39738996 / 42218701 / -5.9% 0.67 / 0.62 / +7.8%
tpcds_q85/datafusion:parquet 80343472 / 81834342 / -1.8% 103443287 / 105290866 / -1.8% 0.78 / 0.78 / -0.1%
tpcds_q86/datafusion:parquet 20986421 / 20918048 / +0.3% 32819246 / 33896487 / -3.2% 0.64 / 0.62 / +3.6%
tpcds_q87/datafusion:parquet 45816272 / 43505629 / +5.3% 63782280 / 63348604 / +0.7% 0.72 / 0.69 / +4.6%
tpcds_q88/datafusion:parquet 37308834 / 37054385 / +0.7% 49757951 / 49767774 / -0.0% 0.75 / 0.74 / +0.7%
tpcds_q89/datafusion:parquet 25934158 / 26032104 / -0.4% 43146070 / 41178749 / +4.8% 0.60 / 0.63 / -4.9%
tpcds_q90/datafusion:parquet 15290680 / 16010470 / -4.5% 28232989 / 27413832 / +3.0% 0.54 / 0.58 / -7.3%
tpcds_q91/datafusion:parquet 32143588 / 32721374 / -1.8% 46786975 / 46260785 / +1.1% 0.69 / 0.71 / -2.9%
tpcds_q92/datafusion:parquet 27032820 / 27080716 / -0.2% 40714364 / 40646305 / +0.2% 0.66 / 0.67 / -0.3%
tpcds_q93/datafusion:parquet 27072342 / 26874608 / +0.7% 46549430 / 44978764 / +3.5% 0.58 / 0.60 / -2.7%
tpcds_q94/datafusion:parquet 35341328 / 35876806 / -1.5% 48858549 / 48371540 / +1.0% 0.72 / 0.74 / -2.5%
tpcds_q95/datafusion:parquet 63408571 / 64911303 / -2.3% 77195507 / 80711697 / -4.4% 0.82 / 0.80 / +2.1%
tpcds_q96/datafusion:parquet 12342940 / 12391568 / -0.4% 24307752 / 24546508 / -1.0% 0.51 / 0.50 / +0.6%
tpcds_q97/datafusion:parquet 35321412 / 35935177 / -1.7% 51374398 / 51601225 / -0.4% 0.69 / 0.70 / -1.3%
tpcds_q98/datafusion:parquet 24873104 / 24923890 / -0.2% 40509571 / 39166129 / +3.4% 0.61 / 0.64 / -3.5%
tpcds_q99/datafusion:parquet 29786477 / 29719451 / +0.2% 41965527 / 43251836 / -3.0% 0.71 / 0.69 / +3.3%
duckdb / vortex-compact / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17824838 / 17426392 / +2.3% 25709546 / 26003191 / -1.1% 0.69 / 0.67 / +3.5%
tpcds_q02/duckdb:vortex-compact 16861324 / 16609666 / +1.5% 24292570 / 23824978 / +2.0% 0.69 / 0.70 / -0.4%
tpcds_q03/duckdb:vortex-compact 8108166 / 8089608 / +0.2% 17110901 / 16689840 / +2.5% 0.47 / 0.48 / -2.2%
tpcds_q04/duckdb:vortex-compact 47193349 / 46604444 / +1.3% 57583622 / 57541720 / +0.1% 0.82 / 0.81 / +1.2%
tpcds_q05/duckdb:vortex-compact 25291233 / 25060677 / +0.9% 33518233 / 32725810 / +2.4% 0.75 / 0.77 / -1.5%
tpcds_q06/duckdb:vortex-compact 25158316 / 24893848 / +1.1% 38786745 / 38773110 / +0.0% 0.65 / 0.64 / +1.0%
tpcds_q07/duckdb:vortex-compact 18651232 / 18139391 / +2.8% 29119341 / 27780866 / +4.8% 0.64 / 0.65 / -1.9%
tpcds_q08/duckdb:vortex-compact 22429926 / 21965906 / +2.1% 29045558 / 29758566 / -2.4% 0.77 / 0.74 / +4.6%
tpcds_q09/duckdb:vortex-compact 22012526 / 21500978 / +2.4% 30693601 / 30093307 / +2.0% 0.72 / 0.71 / +0.4%
tpcds_q10/duckdb:vortex-compact 31018762 / 30662688 / +1.2% 44328203 / 44639333 / -0.7% 0.70 / 0.69 / +1.9%
tpcds_q11/duckdb:vortex-compact 38204028 / 37777145 / +1.1% 47301240 / 47063686 / +0.5% 0.81 / 0.80 / +0.6%
tpcds_q12/duckdb:vortex-compact 13002088 / 12866804 / +1.1% 20700532 / 19879394 / +4.1% 0.63 / 0.65 / -3.0%
tpcds_q13/duckdb:vortex-compact 37774140 / 37847484 / -0.2% 48621478 / 48204048 / +0.9% 0.78 / 0.79 / -1.1%
tpcds_q14/duckdb:vortex-compact 58246006 / 57331381 / +1.6% 68996250 / 69547959 / -0.8% 0.84 / 0.82 / +2.4%
tpcds_q15/duckdb:vortex-compact 14616088 / 14394067 / +1.5% 22425017 / 22637459 / -0.9% 0.65 / 0.64 / +2.5%
tpcds_q16/duckdb:vortex-compact 27262416 / 27148458 / +0.4% 36387337 / 35328948 / +3.0% 0.75 / 0.77 / -2.5%
tpcds_q17/duckdb:vortex-compact 29171320 / 28460445 / +2.5% 42870480 / 43665640 / -1.8% 0.68 / 0.65 / +4.4%
tpcds_q18/duckdb:vortex-compact 36925936 / 35139110 / +5.1% 45547254 / 45941476 / -0.9% 0.81 / 0.76 / +6.0%
tpcds_q19/duckdb:vortex-compact 82296513 / 81279992 / +1.3% 93987004 / 94290310 / -0.3% 0.88 / 0.86 / +1.6%
tpcds_q20/duckdb:vortex-compact 13141855 / 13326761 / -1.4% 21213081 / 20929741 / +1.4% 0.62 / 0.64 / -2.7%
tpcds_q21/duckdb:vortex-compact 12050778 / 12005219 / +0.4% 23069657 / 23101373 / -0.1% 0.52 / 0.52 / +0.5%
tpcds_q22/duckdb:vortex-compact 19902492 / 19471654 / +2.2% 30207192 / 30282107 / -0.2% 0.66 / 0.64 / +2.5%
tpcds_q23/duckdb:vortex-compact 40481262 / 39774765 / +1.8% 51714014 / 52136746 / -0.8% 0.78 / 0.76 / +2.6%
tpcds_q24/duckdb:vortex-compact 28987644 / 28976782 / +0.0% 39791583 / 40374039 / -1.4% 0.73 / 0.72 / +1.5%
tpcds_q25/duckdb:vortex-compact 28094422 / 27589352 / +1.8% 41659371 / 41868722 / -0.5% 0.67 / 0.66 / +2.3%
tpcds_q26/duckdb:vortex-compact 17224986 / 17277542 / -0.3% 25719300 / 25676978 / +0.2% 0.67 / 0.67 / -0.5%
tpcds_q27/duckdb:vortex-compact 21420976 / 20346897 / +5.3% 30808972 / 31179714 / -1.2% 0.70 / 0.65 / +6.5%
tpcds_q28/duckdb:vortex-compact 21512784 / 21696156 / -0.8% 30410185 / 30798164 / -1.3% 0.71 / 0.70 / +0.4%
tpcds_q29/duckdb:vortex-compact 27381226 / 27367384 / +0.1% 42443293 / 42657066 / -0.5% 0.65 / 0.64 / +0.6%
tpcds_q30/duckdb:vortex-compact 18238729 / 18106767 / +0.7% 26811328 / 26899513 / -0.3% 0.68 / 0.67 / +1.1%
tpcds_q31/duckdb:vortex-compact 19626696 / 18793640 / +4.4% 27936510 / 27149463 / +2.9% 0.70 / 0.69 / +1.5%
tpcds_q32/duckdb:vortex-compact 13255306 / 12868874 / +3.0% 22470469 / 22666826 / -0.9% 0.59 / 0.57 / +3.9%
tpcds_q33/duckdb:vortex-compact 20195984 / 20359108 / -0.8% 30261432 / 30050665 / +0.7% 0.67 / 0.68 / -1.5%
tpcds_q34/duckdb:vortex-compact 14671534 / 14511698 / +1.1% 26439862 / 24241173 / +9.1% 0.55 / 0.60 / -7.3%
tpcds_q35/duckdb:vortex-compact 32125006 / 31319370 / +2.6% 44181162 / 42924990 / +2.9% 0.73 / 0.73 / -0.3%
tpcds_q36/duckdb:vortex-compact 15815575 / 16048216 / -1.4% 26361004 / 25402675 / +3.8% 0.60 / 0.63 / -5.0%
tpcds_q37/duckdb:vortex-compact 13510820 / 13556196 / -0.3% 26375719 / 27426842 / -3.8% 0.51 / 0.49 / +3.6%
tpcds_q38/duckdb:vortex-compact 24952897 / 24971754 / -0.1% 33239171 / 32474223 / +2.4% 0.75 / 0.77 / -2.4%
tpcds_q39/duckdb:vortex-compact 20664088 / 21130863 / -2.2% 32622048 / 31210411 / +4.5% 0.63 / 0.68 / -6.4%
tpcds_q40/duckdb:vortex-compact 15824368 / 16018876 / -1.2% 22845491 / 22328365 / +2.3% 0.69 / 0.72 / -3.5%
tpcds_q41/duckdb:vortex-compact 18706108 / 18595324 / +0.6% 26141588 / 25963755 / +0.7% 0.72 / 0.72 / -0.1%
tpcds_q42/duckdb:vortex-compact 8203064 / 8088183 / +1.4% 17283980 / 16632434 / +3.9% 0.47 / 0.49 / -2.4%
tpcds_q43/duckdb:vortex-compact 10700221 / 10844688 / -1.3% 22277703 / 18800820 / +18.5% 🔴 0.48 / 0.58 / -16.7%
tpcds_q44/duckdb:vortex-compact 15645517 / 15081750 / +3.7% 25854521 / 26764984 / -3.4% 0.61 / 0.56 / +7.4%
tpcds_q45/duckdb:vortex-compact 26330106 / 25949501 / +1.5% 33664336 / 34384321 / -2.1% 0.78 / 0.75 / +3.6%
tpcds_q46/duckdb:vortex-compact 19978894 / 19965549 / +0.1% 29380133 / 29025457 / +1.2% 0.68 / 0.69 / -1.1%
tpcds_q47/duckdb:vortex-compact 35312968 / 35549719 / -0.7% 45254812 / 44504122 / +1.7% 0.78 / 0.80 / -2.3%
tpcds_q48/duckdb:vortex-compact 39722122 / 39126353 / +1.5% 50659063 / 52935758 / -4.3% 0.78 / 0.74 / +6.1%
tpcds_q49/duckdb:vortex-compact 23027739 / 22907730 / +0.5% 37380785 / 37920208 / -1.4% 0.62 / 0.60 / +2.0%
tpcds_q50/duckdb:vortex-compact 19347774 / 19193918 / +0.8% 30549272 / 30465354 / +0.3% 0.63 / 0.63 / +0.5%
tpcds_q51/duckdb:vortex-compact 49407949 / 49435814 / -0.1% 60760782 / 59096935 / +2.8% 0.81 / 0.84 / -2.8%
tpcds_q52/duckdb:vortex-compact 8306131 / 8025046 / +3.5% 17376080 / 16483580 / +5.4% 0.48 / 0.49 / -1.8%
tpcds_q53/duckdb:vortex-compact 13203460 / 13038308 / +1.3% 22704875 / 22607598 / +0.4% 0.58 / 0.58 / +0.8%
tpcds_q54/duckdb:vortex-compact 21606038 / 21454102 / +0.7% 32129113 / 31127787 / +3.2% 0.67 / 0.69 / -2.4%
tpcds_q55/duckdb:vortex-compact 7954718 / 7837796 / +1.5% 16608368 / 16232166 / +2.3% 0.48 / 0.48 / -0.8%
tpcds_q56/duckdb:vortex-compact 19386930 / 19369632 / +0.1% 30175461 / 30330437 / -0.5% 0.64 / 0.64 / +0.6%
tpcds_q57/duckdb:vortex-compact 27312202 / 27176340 / +0.5% 36718883 / 34533990 / +6.3% 0.74 / 0.79 / -5.5%
tpcds_q58/duckdb:vortex-compact 21000373 / 20954872 / +0.2% 31568509 / 30600030 / +3.2% 0.67 / 0.68 / -2.9%
tpcds_q59/duckdb:vortex-compact 20891608 / 21295822 / -1.9% 28170271 / 27764566 / +1.5% 0.74 / 0.77 / -3.3%
tpcds_q60/duckdb:vortex-compact 20326593 / 20114170 / +1.1% 30495513 / 29943667 / +1.8% 0.67 / 0.67 / -0.8%
tpcds_q61/duckdb:vortex-compact 26400062 / 26282018 / +0.4% 36248176 / 35706122 / +1.5% 0.73 / 0.74 / -1.1%
tpcds_q62/duckdb:vortex-compact 13161332 / 12936913 / +1.7% 19666832 / 20426922 / -3.7% 0.67 / 0.63 / +5.7%
tpcds_q63/duckdb:vortex-compact 12695190 / 12744102 / -0.4% 21910250 / 22092372 / -0.8% 0.58 / 0.58 / +0.4%
tpcds_q64/duckdb:vortex-compact 57222094 / 56917222 / +0.5% 75289555 / 75826093 / -0.7% 0.76 / 0.75 / +1.3%
tpcds_q65/duckdb:vortex-compact 14118215 / 13682668 / +3.2% 23209065 / 22299598 / +4.1% 0.61 / 0.61 / -0.9%
tpcds_q66/duckdb:vortex-compact 31941728 / 33641474 / -5.1% 41316633 / 40094210 / +3.0% 0.77 / 0.84 / -7.9%
tpcds_q67/duckdb:vortex-compact 60049480 / 59504414 / +0.9% 68274255 / 69254467 / -1.4% 0.88 / 0.86 / +2.4%
tpcds_q68/duckdb:vortex-compact 19816756 / 20264215 / -2.2% 28595583 / 28742664 / -0.5% 0.69 / 0.71 / -1.7%
tpcds_q69/duckdb:vortex-compact 27471158 / 27088764 / +1.4% 41518150 / 42636298 / -2.6% 0.66 / 0.64 / +4.1%
tpcds_q70/duckdb:vortex-compact 17929524 / 17539546 / +2.2% 28544319 / 28489071 / +0.2% 0.63 / 0.62 / +2.0%
tpcds_q71/duckdb:vortex-compact 13930588 / 14068954 / -1.0% 25134324 / 24413070 / +3.0% 0.55 / 0.58 / -3.8%
tpcds_q72/duckdb:vortex-compact 59891763 / 59755576 / +0.2% 76618326 / 75485044 / +1.5% 0.78 / 0.79 / -1.3%
tpcds_q73/duckdb:vortex-compact 13683530 / 13292556 / +2.9% 22755197 / 24552871 / -7.3% 0.60 / 0.54 / +11.1%
tpcds_q74/duckdb:vortex-compact 26770656 / 26573292 / +0.7% 34293136 / 34375215 / -0.2% 0.78 / 0.77 / +1.0%
tpcds_q75/duckdb:vortex-compact 30870440 / 30183466 / +2.3% 41936349 / 41668305 / +0.6% 0.74 / 0.72 / +1.6%
tpcds_q76/duckdb:vortex-compact 14119258 / 14536249 / -2.9% 24862295 / 23557795 / +5.5% 0.57 / 0.62 / -8.0%
tpcds_q77/duckdb:vortex-compact 22736956 / 22903466 / -0.7% 32455712 / 30642713 / +5.9% 0.70 / 0.75 / -6.3%
tpcds_q78/duckdb:vortex-compact 44874223 / 44698793 / +0.4% 55957190 / 56010370 / -0.1% 0.80 / 0.80 / +0.5%
tpcds_q79/duckdb:vortex-compact 14822518 / 13938702 / +6.3% 23396262 / 22957627 / +1.9% 0.63 / 0.61 / +4.3%
tpcds_q80/duckdb:vortex-compact 40404814 / 39859105 / +1.4% 52825449 / 51724516 / +2.1% 0.76 / 0.77 / -0.7%
tpcds_q81/duckdb:vortex-compact 24567436 / 24496362 / +0.3% 31709225 / 31925688 / -0.7% 0.77 / 0.77 / +1.0%
tpcds_q82/duckdb:vortex-compact 13332894 / 13769476 / -3.2% 26476801 / 26017675 / +1.8% 0.50 / 0.53 / -4.8%
tpcds_q83/duckdb:vortex-compact 18705896 / 18240742 / +2.6% 25365290 / 26526977 / -4.4% 0.74 / 0.69 / +7.2%
tpcds_q84/duckdb:vortex-compact 17678048 / 17725919 / -0.3% 24802976 / 24246153 / +2.3% 0.71 / 0.73 / -2.5%
tpcds_q85/duckdb:vortex-compact 38867669 / 38410384 / +1.2% 52949305 / 52704245 / +0.5% 0.73 / 0.73 / +0.7%
tpcds_q86/duckdb:vortex-compact 10699286 / 10642594 / +0.5% 18051428 / 17999254 / +0.3% 0.59 / 0.59 / +0.2%
tpcds_q87/duckdb:vortex-compact 26664476 / 26216207 / +1.7% 34389787 / 33383964 / +3.0% 0.78 / 0.79 / -1.3%
tpcds_q88/duckdb:vortex-compact 33060490 / 32950752 / +0.3% 40933116 / 40489798 / +1.1% 0.81 / 0.81 / -0.8%
tpcds_q89/duckdb:vortex-compact 13929040 / 13738650 / +1.4% 23502317 / 23954988 / -1.9% 0.59 / 0.57 / +3.3%
tpcds_q90/duckdb:vortex-compact 8722372 / 8737708 / -0.2% 16147673 / 16443861 / -1.8% 0.54 / 0.53 / +1.7%
tpcds_q91/duckdb:vortex-compact 23017611 / 22907388 / +0.5% 32423189 / 32387232 / +0.1% 0.71 / 0.71 / +0.4%
tpcds_q92/duckdb:vortex-compact 14039851 / 14008400 / +0.2% 22709746 / 22512411 / +0.9% 0.62 / 0.62 / -0.6%
tpcds_q93/duckdb:vortex-compact 13164098 / 13160091 / +0.0% 28088297 / 27951902 / +0.5% 0.47 / 0.47 / -0.5%
tpcds_q94/duckdb:vortex-compact 24003528 / 23781438 / +0.9% 33292555 / 33331253 / -0.1% 0.72 / 0.71 / +1.1%
tpcds_q95/duckdb:vortex-compact 64112981 / 63873096 / +0.4% 73141581 / 73539903 / -0.5% 0.88 / 0.87 / +0.9%
tpcds_q96/duckdb:vortex-compact 8512421 / 8370577 / +1.7% 17591107 / 16592988 / +6.0% 0.48 / 0.50 / -4.1%
tpcds_q97/duckdb:vortex-compact 23682228 / 23236341 / +1.9% 32768526 / 33053011 / -0.9% 0.72 / 0.70 / +2.8%
tpcds_q98/duckdb:vortex-compact 14246607 / 13931356 / +2.3% 22768011 / 22825476 / -0.3% 0.63 / 0.61 / +2.5%
tpcds_q99/duckdb:vortex-compact 15583716 / 15272381 / +2.0% 22680756 / 22782407 / -0.4% 0.69 / 0.67 / +2.5%
duckdb / parquet / ns (1.011x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24474196 / 24327612 / +0.6% 31279156 / 31022598 / +0.8% 0.78 / 0.78 / -0.2%
tpcds_q02/duckdb:parquet 18226415 / 18364541 / -0.8% 24624956 / 24569895 / +0.2% 0.74 / 0.75 / -1.0%
tpcds_q03/duckdb:parquet 9874218 / 9829384 / +0.5% 15628598 / 16094634 / -2.9% 0.63 / 0.61 / +3.5%
tpcds_q04/duckdb:parquet 118903414 / 118406726 / +0.4% 127575238 / 127166014 / +0.3% 0.93 / 0.93 / +0.1%
tpcds_q05/duckdb:parquet 29053034 / 28672986 / +1.3% 33304429 / 33611871 / -0.9% 0.87 / 0.85 / +2.3%
tpcds_q06/duckdb:parquet 27130134 / 26675688 / +1.7% 36020221 / 35822236 / +0.6% 0.75 / 0.74 / +1.1%
tpcds_q07/duckdb:parquet 31331501 / 30802661 / +1.7% 39607928 / 40374145 / -1.9% 0.79 / 0.76 / +3.7%
tpcds_q08/duckdb:parquet 20234218 / 20112065 / +0.6% 24319109 / 24502991 / -0.8% 0.83 / 0.82 / +1.4%
tpcds_q09/duckdb:parquet 27710434 / 27150539 / +2.1% 29979142 / 31751930 / -5.6% 0.92 / 0.86 / +8.1%
tpcds_q10/duckdb:parquet 33290980 / 33155686 / +0.4% 41596102 / 41374038 / +0.5% 0.80 / 0.80 / -0.1%
tpcds_q11/duckdb:parquet 69916609 / 68837927 / +1.6% 76664499 / 76874787 / -0.3% 0.91 / 0.90 / +1.8%
tpcds_q12/duckdb:parquet 14277524 / 14225908 / +0.4% 19671976 / 19468684 / +1.0% 0.73 / 0.73 / -0.7%
tpcds_q13/duckdb:parquet 32342604 / 30861805 / +4.8% 39815549 / 39625662 / +0.5% 0.81 / 0.78 / +4.3%
tpcds_q14/duckdb:parquet 64943272 / 64471234 / +0.7% 70617277 / 70549107 / +0.1% 0.92 / 0.91 / +0.6%
tpcds_q15/duckdb:parquet 16913570 / 16926216 / -0.1% 23108591 / 23237887 / -0.6% 0.73 / 0.73 / +0.5%
tpcds_q16/duckdb:parquet 30680570 / 30822718 / -0.5% 37697376 / 37796457 / -0.3% 0.81 / 0.82 / -0.2%
tpcds_q17/duckdb:parquet 35320950 / 35112658 / +0.6% 41066455 / 40512581 / +1.4% 0.86 / 0.87 / -0.8%
tpcds_q18/duckdb:parquet 48123038 / 47534298 / +1.2% 56935842 / 55812814 / +2.0% 0.85 / 0.85 / -0.8%
tpcds_q19/duckdb:parquet 19101943 / 19862977 / -3.8% 26418551 / 27204743 / -2.9% 0.72 / 0.73 / -1.0%
tpcds_q20/duckdb:parquet 15277438 / 15153388 / +0.8% 20359894 / 20184048 / +0.9% 0.75 / 0.75 / -0.1%
tpcds_q21/duckdb:parquet 10936564 / 10908848 / +0.3% 17746447 / 16823467 / +5.5% 0.62 / 0.65 / -5.0%
tpcds_q22/duckdb:parquet 21064736 / 20881298 / +0.9% 27220287 / 26935119 / +1.1% 0.77 / 0.78 / -0.2%
tpcds_q23/duckdb:parquet 45447649 / 45280766 / +0.4% 51604958 / 48094728 / +7.3% 0.88 / 0.94 / -6.5%
tpcds_q24/duckdb:parquet 30964565 / 31324390 / -1.1% 37840524 / 37454540 / +1.0% 0.82 / 0.84 / -2.2%
tpcds_q25/duckdb:parquet 31020904 / 30892842 / +0.4% 37702808 / 37777391 / -0.2% 0.82 / 0.82 / +0.6%
tpcds_q26/duckdb:parquet 29522111 / 29265890 / +0.9% 35669292 / 35556133 / +0.3% 0.83 / 0.82 / +0.6%
tpcds_q27/duckdb:parquet 35256638 / 33600460 / +4.9% 42156628 / 41684785 / +1.1% 0.84 / 0.81 / +3.8%
tpcds_q28/duckdb:parquet 26781322 / 27055461 / -1.0% 33599597 / 33816399 / -0.6% 0.80 / 0.80 / -0.4%
tpcds_q29/duckdb:parquet 32488216 / 33845985 / -4.0% 39838798 / 39812778 / +0.1% 0.82 / 0.85 / -4.1%
tpcds_q30/duckdb:parquet 36147561 / 35726513 / +1.2% 45064721 / 44415757 / +1.5% 0.80 / 0.80 / -0.3%
tpcds_q31/duckdb:parquet 36407669 / 35755278 / +1.8% 42790360 / 43764705 / -2.2% 0.85 / 0.82 / +4.1%
tpcds_q32/duckdb:parquet 14676708 / 14499726 / +1.2% 20901643 / 21080379 / -0.8% 0.70 / 0.69 / +2.1%
tpcds_q33/duckdb:parquet 24019422 / 24879218 / -3.5% 29543756 / 28922286 / +2.1% 0.81 / 0.86 / -5.5%
tpcds_q34/duckdb:parquet 17601310 / 17272238 / +1.9% 24917817 / 24671370 / +1.0% 0.71 / 0.70 / +0.9%
tpcds_q35/duckdb:parquet 35502352 / 35826298 / -0.9% 44407024 / 43874114 / +1.2% 0.80 / 0.82 / -2.1%
tpcds_q36/duckdb:parquet 40539970 / 40202567 / +0.8% 48683542 / 48518582 / +0.3% 0.83 / 0.83 / +0.5%
tpcds_q37/duckdb:parquet 13262691 / 13007400 / +2.0% 19155692 / 20027874 / -4.4% 0.69 / 0.65 / +6.6%
tpcds_q38/duckdb:parquet 30109650 / 29660296 / +1.5% 34292523 / 33926629 / +1.1% 0.88 / 0.87 / +0.4%
tpcds_q39/duckdb:parquet 23817498 / 23410192 / +1.7% 29526565 / 29793823 / -0.9% 0.81 / 0.79 / +2.7%
tpcds_q40/duckdb:parquet 16454620 / 16258907 / +1.2% 21646647 / 21824548 / -0.8% 0.76 / 0.74 / +2.0%
tpcds_q41/duckdb:parquet 12684415 / 12107374 / +4.8% 18884720 / 18441901 / +2.4% 0.67 / 0.66 / +2.3%
tpcds_q42/duckdb:parquet 9817706 / 9676826 / +1.5% 15748451 / 16382560 / -3.9% 0.62 / 0.59 / +5.5%
tpcds_q43/duckdb:parquet 12478457 / 12749106 / -2.1% 18378096 / 18254184 / +0.7% 0.68 / 0.70 / -2.8%
tpcds_q44/duckdb:parquet 21327944 / 20383748 / +4.6% 30759458 / 26928413 / +14.2% 🔴 0.69 / 0.76 / -8.4%
tpcds_q45/duckdb:parquet 21618523 / 21359628 / +1.2% 28578784 / 28113340 / +1.7% 0.76 / 0.76 / -0.4%
tpcds_q46/duckdb:parquet 37546258 / 35800652 / +4.9% 44678844 / 43747002 / +2.1% 0.84 / 0.82 / +2.7%
tpcds_q47/duckdb:parquet 34342381 / 34254300 / +0.3% 41173062 / 41161048 / +0.0% 0.83 / 0.83 / +0.2%
tpcds_q48/duckdb:parquet 29386640 / 31393962 / -6.4% 37778599 / 37549121 / +0.6% 0.78 / 0.84 / -7.0%
tpcds_q49/duckdb:parquet 29642088 / 31021178 / -4.4% 37838776 / 36633924 / +3.3% 0.78 / 0.85 / -7.5%
tpcds_q50/duckdb:parquet 19841240 / 19825552 / +0.1% 26729123 / 26287446 / +1.7% 0.74 / 0.75 / -1.6%
tpcds_q51/duckdb:parquet 52355158 / 52181155 / +0.3% 60858820 / 77099315 / -21.1% 🟢 0.86 / 0.68 / +27.1%
tpcds_q52/duckdb:parquet 9736242 / 9804994 / -0.7% 16190806 / 16607701 / -2.5% 0.60 / 0.59 / +1.9%
tpcds_q53/duckdb:parquet 14324682 / 14242878 / +0.6% 21875867 / 21165706 / +3.4% 0.65 / 0.67 / -2.7%
tpcds_q54/duckdb:parquet 25806584 / 25128006 / +2.7% 32795087 / 31903779 / +2.8% 0.79 / 0.79 / -0.1%
tpcds_q55/duckdb:parquet 9898612 / 9694612 / +2.1% 16400185 / 15719026 / +4.3% 0.60 / 0.62 / -2.1%
tpcds_q56/duckdb:parquet 25906326 / 26571920 / -2.5% 31650168 / 30440580 / +4.0% 0.82 / 0.87 / -6.2%
tpcds_q57/duckdb:parquet 31187528 / 30746184 / +1.4% 36291796 / 36339088 / -0.1% 0.86 / 0.85 / +1.6%
tpcds_q58/duckdb:parquet 25626184 / 25001003 / +2.5% 30356068 / 30600011 / -0.8% 0.84 / 0.82 / +3.3%
tpcds_q59/duckdb:parquet 23671092 / 23337506 / +1.4% 29908722 / 29928780 / -0.1% 0.79 / 0.78 / +1.5%
tpcds_q60/duckdb:parquet 29479836 / 27171473 / +8.5% 32538989 / 33014405 / -1.4% 0.91 / 0.82 / +10.1%
tpcds_q61/duckdb:parquet 26032252 / 24847957 / +4.8% 31130057 / 29789448 / +4.5% 0.84 / 0.83 / +0.3%
tpcds_q62/duckdb:parquet 13193229 / 13233002 / -0.3% 18186353 / 18236335 / -0.3% 0.73 / 0.73 / -0.0%
tpcds_q63/duckdb:parquet 13743335 / 14205768 / -3.3% 20712891 / 19853543 / +4.3% 0.66 / 0.72 / -7.3%
tpcds_q64/duckdb:parquet 71637277 / 70928505 / +1.0% 82833233 / 82143417 / +0.8% 0.86 / 0.86 / +0.2%
tpcds_q65/duckdb:parquet 21350072 / 18921847 / +12.8% 🔴 25068722 / 24987865 / +0.3% 0.85 / 0.76 / +12.5%
tpcds_q66/duckdb:parquet 36275208 / 35543430 / +2.1% 42821130 / 42386370 / +1.0% 0.85 / 0.84 / +1.0%
tpcds_q67/duckdb:parquet 63082501 / 60537394 / +4.2% 68120817 / 66988249 / +1.7% 0.93 / 0.90 / +2.5%
tpcds_q68/duckdb:parquet 28884188 / 28342236 / +1.9% 37161349 / 36880558 / +0.8% 0.78 / 0.77 / +1.1%
tpcds_q69/duckdb:parquet 26437406 / 26021930 / +1.6% 35171510 / 34832455 / +1.0% 0.75 / 0.75 / +0.6%
tpcds_q70/duckdb:parquet 19621270 / 19552218 / +0.4% 26872899 / 26809472 / +0.2% 0.73 / 0.73 / +0.1%
tpcds_q71/duckdb:parquet 17301388 / 17266274 / +0.2% 24474511 / 23885848 / +2.5% 0.71 / 0.72 / -2.2%
tpcds_q72/duckdb:parquet 55403634 / 54713788 / +1.3% 62439023 / 62945125 / -0.8% 0.89 / 0.87 / +2.1%
tpcds_q73/duckdb:parquet 15334770 / 15191090 / +0.9% 22178247 / 21650462 / +2.4% 0.69 / 0.70 / -1.5%
tpcds_q74/duckdb:parquet 86376376 / 84730423 / +1.9% 91729790 / 91583753 / +0.2% 0.94 / 0.93 / +1.8%
tpcds_q75/duckdb:parquet 46292130 / 46720021 / -0.9% 52474407 / 51601849 / +1.7% 0.88 / 0.91 / -2.6%
tpcds_q76/duckdb:parquet 17708226 / 19225150 / -7.9% 24368801 / 24611716 / -1.0% 0.73 / 0.78 / -7.0%
tpcds_q77/duckdb:parquet 25621988 / 24537329 / +4.4% 32134418 / 31675856 / +1.4% 0.80 / 0.77 / +2.9%
tpcds_q78/duckdb:parquet 78885801 / 79063064 / -0.2% 86693088 / 88000527 / -1.5% 0.91 / 0.90 / +1.3%
tpcds_q79/duckdb:parquet 23697174 / 21672474 / +9.3% 29688260 / 29317333 / +1.3% 0.80 / 0.74 / +8.0%
tpcds_q80/duckdb:parquet 39001087 / 36775089 / +6.1% 45087036 / 44422586 / +1.5% 0.87 / 0.83 / +4.5%
tpcds_q81/duckdb:parquet 37052162 / 36594288 / +1.3% 45384826 / 44970213 / +0.9% 0.82 / 0.81 / +0.3%
tpcds_q82/duckdb:parquet 14013292 / 14008810 / +0.0% 20689328 / 20729412 / -0.2% 0.68 / 0.68 / +0.2%
tpcds_q83/duckdb:parquet 20943798 / 20627038 / +1.5% 25833138 / 25441708 / +1.5% 0.81 / 0.81 / -0.0%
tpcds_q84/duckdb:parquet 23954769 / 23183848 / +3.3% 29639517 / 29132303 / +1.7% 0.81 / 0.80 / +1.6%
tpcds_q85/duckdb:parquet 32642325 / 32992388 / -1.1% 40216199 / 40164727 / +0.1% 0.81 / 0.82 / -1.2%
tpcds_q86/duckdb:parquet 12348524 / 11935036 / +3.5% 17598794 / 17466964 / +0.8% 0.70 / 0.68 / +2.7%
tpcds_q87/duckdb:parquet 31707722 / 31435782 / +0.9% 36164637 / 35506402 / +1.9% 0.88 / 0.89 / -1.0%
tpcds_q88/duckdb:parquet 40466928 / 39894160 / +1.4% 47983162 / 46594499 / +3.0% 0.84 / 0.86 / -1.5%
tpcds_q89/duckdb:parquet 14512061 / 14447672 / +0.4% 22018189 / 21601578 / +1.9% 0.66 / 0.67 / -1.5%
tpcds_q90/duckdb:parquet 10615575 / 10164360 / +4.4% 15543111 / 15743843 / -1.3% 0.68 / 0.65 / +5.8%
tpcds_q91/duckdb:parquet 21634851 / 21397595 / +1.1% 29001885 / 29811201 / -2.7% 0.75 / 0.72 / +3.9%
tpcds_q92/duckdb:parquet 15873408 / 15940302 / -0.4% 22256025 / 22292395 / -0.2% 0.71 / 0.72 / -0.3%
tpcds_q93/duckdb:parquet 14288768 / 14216258 / +0.5% 20810856 / 20732809 / +0.4% 0.69 / 0.69 / +0.1%
tpcds_q94/duckdb:parquet 25766790 / 25653914 / +0.4% 33122827 / 33338023 / -0.6% 0.78 / 0.77 / +1.1%
tpcds_q95/duckdb:parquet 44522858 / 44089942 / +1.0% 50117523 / 50234925 / -0.2% 0.89 / 0.88 / +1.2%
tpcds_q96/duckdb:parquet 8539620 / 8269368 / +3.3% 14021963 / 13906262 / +0.8% 0.61 / 0.59 / +2.4%
tpcds_q97/duckdb:parquet 27820638 / 27549753 / +1.0% 33327761 / 34670492 / -3.9% 0.83 / 0.79 / +5.1%
tpcds_q98/duckdb:parquet 17046130 / 16760576 / +1.7% 23702691 / 23736534 / -0.1% 0.72 / 0.71 / +1.8%
tpcds_q99/duckdb:parquet 19542498 / 19210266 / +1.7% 24414356 / 24363998 / +0.2% 0.80 / 0.79 / +1.5%

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: Compression 📖

Commits: PR 8cc24be6 vs base none

No baseline is available for this benchmark yet; PR measurements are shown without comparison.


vortex / vortex-file-compressed / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 491715070 / — / no baseline 495810550 / — / no baseline 0.99 / — / no baseline
compress time/bimbo 1993575576 / — / no baseline 1951515437 / — / no baseline 1.02 / — / no baseline
compress time/cmsprovider 983195208 / — / no baseline 961994640 / — / no baseline 1.02 / — / no baseline
compress time/euro2016 168084344 / — / no baseline 168865972 / — / no baseline 1.00 / — / no baseline
compress time/food 227090588 / — / no baseline 227739327 / — / no baseline 1.00 / — / no baseline
compress time/hashtags 377415086 / — / no baseline 375490841 / — / no baseline 1.01 / — / no baseline
compress time/taxi 186753664 / — / no baseline 184428242 / — / no baseline 1.01 / — / no baseline
compress time/tpc-h l_comment canonical 394396566 / — / no baseline 390543334 / — / no baseline 1.01 / — / no baseline
compress time/tpc-h l_comment chunked 395271594 / — / no baseline 390045284 / — / no baseline 1.01 / — / no baseline
compress time/wide table cols=100 chunks=1 rows=1000 4258154 / — / no baseline 5348657 / — / no baseline 0.80 / — / no baseline
compress time/wide table cols=100 chunks=50 rows=1000 4277415 / — / no baseline 5451551 / — / no baseline 0.78 / — / no baseline
compress time/wide table cols=1000 chunks=1 rows=1000 40745470 / — / no baseline 40250099 / — / no baseline 1.01 / — / no baseline
compress time/wide table cols=1000 chunks=50 rows=1000 40808584 / — / no baseline 40309142 / — / no baseline 1.01 / — / no baseline
compress time/wide table cols=10000 chunks=1 rows=1000 463033749 / — / no baseline 458456952 / — / no baseline 1.01 / — / no baseline
compress time/wide table cols=10000 chunks=50 rows=1000 461924566 / — / no baseline 455394387 / — / no baseline 1.01 / — / no baseline
decompress time/arade 14021925 / — / no baseline 15934928 / — / no baseline 0.88 / — / no baseline
decompress time/bimbo 68091450 / — / no baseline 74112620 / — / no baseline 0.92 / — / no baseline
decompress time/cmsprovider 38932274 / — / no baseline 40175512 / — / no baseline 0.97 / — / no baseline
decompress time/euro2016 14714940 / — / no baseline 15735376 / — / no baseline 0.94 / — / no baseline
decompress time/food 3974524 / — / no baseline 5005943 / — / no baseline 0.79 / — / no baseline
decompress time/hashtags 39736555 / — / no baseline 40198906 / — / no baseline 0.99 / — / no baseline
decompress time/taxi 9641708 / — / no baseline 12455072 / — / no baseline 0.77 / — / no baseline
decompress time/tpc-h l_comment canonical 14870643 / — / no baseline 15985748 / — / no baseline 0.93 / — / no baseline
decompress time/tpc-h l_comment chunked 14946239 / — / no baseline 15777540 / — / no baseline 0.95 / — / no baseline
decompress time/wide table cols=100 chunks=1 rows=1000 1352004 / — / no baseline 1568573 / — / no baseline 0.86 / — / no baseline
decompress time/wide table cols=100 chunks=50 rows=1000 1454689 / — / no baseline 1572941 / — / no baseline 0.92 / — / no baseline
decompress time/wide table cols=1000 chunks=1 rows=1000 12643657 / — / no baseline 13682831 / — / no baseline 0.92 / — / no baseline
decompress time/wide table cols=1000 chunks=50 rows=1000 13258046 / — / no baseline 13918819 / — / no baseline 0.95 / — / no baseline
decompress time/wide table cols=10000 chunks=1 rows=1000 134497426 / — / no baseline 140218359 / — / no baseline 0.96 / — / no baseline
decompress time/wide table cols=10000 chunks=50 rows=1000 133698870 / — / no baseline 139934151 / — / no baseline 0.96 / — / no baseline
vortex / vortex-file-compressed / bytes (no group data, 0↑ 0↓)
name bytes (PR / base / %diff)
vortex-file-compressed size/arade 142213596 / — / no baseline
vortex-file-compressed size/bimbo 458580972 / — / no baseline
vortex-file-compressed size/cmsprovider 420807812 / — / no baseline
vortex-file-compressed size/euro2016 164571516 / — / no baseline
vortex-file-compressed size/food 38950912 / — / no baseline
vortex-file-compressed size/hashtags 195463068 / — / no baseline
vortex-file-compressed size/taxi 49997700 / — / no baseline
vortex-file-compressed size/tpc-h l_comment canonical 178708512 / — / no baseline
vortex-file-compressed size/tpc-h l_comment chunked 178708512 / — / no baseline
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 934080 / — / no baseline
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 934080 / — / no baseline
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9325680 / — / no baseline
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9325680 / — / no baseline
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 93277680 / — / no baseline
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 93277680 / — / no baseline
vortex / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 734807930 / — / no baseline 743051740 / — / no baseline 0.99 / — / no baseline
compress time/bimbo 1978218518 / — / no baseline 1981193296 / — / no baseline 1.00 / — / no baseline
compress time/cmsprovider 1059708298 / — / no baseline 1060358623 / — / no baseline 1.00 / — / no baseline
compress time/euro2016 645094932 / — / no baseline 646127024 / — / no baseline 1.00 / — / no baseline
compress time/food 319439352 / — / no baseline 321348590 / — / no baseline 0.99 / — / no baseline
compress time/hashtags 345182368 / — / no baseline 343750439 / — / no baseline 1.00 / — / no baseline
compress time/taxi 193404282 / — / no baseline 194940694 / — / no baseline 0.99 / — / no baseline
compress time/tpc-h l_comment canonical 1058121874 / — / no baseline 1059228298 / — / no baseline 1.00 / — / no baseline
compress time/tpc-h l_comment chunked 1054717903 / — / no baseline 1060389774 / — / no baseline 0.99 / — / no baseline
compress time/wide table cols=100 chunks=1 rows=1000 3733848 / — / no baseline 4039669 / — / no baseline 0.92 / — / no baseline
compress time/wide table cols=100 chunks=50 rows=1000 3664812 / — / no baseline 4109828 / — / no baseline 0.89 / — / no baseline
compress time/wide table cols=1000 chunks=1 rows=1000 36082737 / — / no baseline 35767599 / — / no baseline 1.01 / — / no baseline
compress time/wide table cols=1000 chunks=50 rows=1000 36227264 / — / no baseline 36573698 / — / no baseline 0.99 / — / no baseline
compress time/wide table cols=10000 chunks=1 rows=1000 373706606 / — / no baseline 373893662 / — / no baseline 1.00 / — / no baseline
compress time/wide table cols=10000 chunks=50 rows=1000 369568000 / — / no baseline 370746154 / — / no baseline 1.00 / — / no baseline
decompress time/arade 49084843 / — / no baseline 49457978 / — / no baseline 0.99 / — / no baseline
decompress time/bimbo 89058358 / — / no baseline 89053830 / — / no baseline 1.00 / — / no baseline
decompress time/cmsprovider 102786017 / — / no baseline 102586520 / — / no baseline 1.00 / — / no baseline
decompress time/euro2016 149779606 / — / no baseline 150467906 / — / no baseline 1.00 / — / no baseline
decompress time/food 25060991 / — / no baseline 25263949 / — / no baseline 0.99 / — / no baseline
decompress time/hashtags 417997864 / — / no baseline 418096514 / — / no baseline 1.00 / — / no baseline
decompress time/taxi 58634621 / — / no baseline 58939324 / — / no baseline 0.99 / — / no baseline
decompress time/tpc-h l_comment canonical 82358130 / — / no baseline 82619945 / — / no baseline 1.00 / — / no baseline
decompress time/tpc-h l_comment chunked 82408472 / — / no baseline 82677962 / — / no baseline 1.00 / — / no baseline
decompress time/wide table cols=100 chunks=1 rows=1000 2066276 / — / no baseline 2266838 / — / no baseline 0.91 / — / no baseline
decompress time/wide table cols=100 chunks=50 rows=1000 2066980 / — / no baseline 2457383 / — / no baseline 0.84 / — / no baseline
decompress time/wide table cols=1000 chunks=1 rows=1000 23683636 / — / no baseline 25503398 / — / no baseline 0.93 / — / no baseline
decompress time/wide table cols=1000 chunks=50 rows=1000 23543202 / — / no baseline 24976863 / — / no baseline 0.94 / — / no baseline
decompress time/wide table cols=10000 chunks=1 rows=1000 254696654 / — / no baseline 263088216 / — / no baseline 0.97 / — / no baseline
decompress time/wide table cols=10000 chunks=50 rows=1000 252201440 / — / no baseline 253683521 / — / no baseline 0.99 / — / no baseline
vortex / parquet / bytes (no group data, 0↑ 0↓)
name bytes (PR / base / %diff)
parquet size/arade 258014282 / — / no baseline
parquet size/bimbo 384517292 / — / no baseline
parquet size/cmsprovider 376887911 / — / no baseline
parquet size/euro2016 122979049 / — / no baseline
parquet size/food 35699500 / — / no baseline
parquet size/hashtags 133497590 / — / no baseline
parquet size/taxi 55283635 / — / no baseline
parquet size/tpc-h l_comment canonical 158358238 / — / no baseline
parquet size/tpc-h l_comment chunked 158358238 / — / no baseline
parquet size/wide table cols=100 chunks=1 rows=1000 932404 / — / no baseline
parquet size/wide table cols=100 chunks=50 rows=1000 932404 / — / no baseline
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 / — / no baseline
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 / — / no baseline
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 / — / no baseline
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 / — / no baseline
vortex / arrow-ipc / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
compress time/arade 96038426 / — / no baseline 121080013 / — / no baseline 0.79 / — / no baseline
compress time/bimbo 607020671 / — / no baseline 670234994 / — / no baseline 0.91 / — / no baseline
compress time/cmsprovider 378318531 / — / no baseline 440375187 / — / no baseline 0.86 / — / no baseline
compress time/euro2016 38284316 / — / no baseline 72067523 / — / no baseline 0.53 / — / no baseline
compress time/food 40353062 / — / no baseline 53669278 / — / no baseline 0.75 / — / no baseline
compress time/hashtags 77837349 / — / no baseline 151582503 / — / no baseline 0.51 / — / no baseline
compress time/taxi 59603846 / — / no baseline 75449201 / — / no baseline 0.79 / — / no baseline
compress time/tpc-h l_comment canonical 129957112 / — / no baseline 170489954 / — / no baseline 0.76 / — / no baseline
compress time/tpc-h l_comment chunked 130388364 / — / no baseline 169269921 / — / no baseline 0.77 / — / no baseline
compress time/wide table cols=100 chunks=1 rows=1000 201952 / — / no baseline 221603 / — / no baseline 0.91 / — / no baseline
compress time/wide table cols=100 chunks=50 rows=1000 200503.5 / — / no baseline 218619 / — / no baseline 0.92 / — / no baseline
compress time/wide table cols=1000 chunks=1 rows=1000 2225256 / — / no baseline 2297617 / — / no baseline 0.97 / — / no baseline
compress time/wide table cols=1000 chunks=50 rows=1000 2190134 / — / no baseline 2267351 / — / no baseline 0.97 / — / no baseline
compress time/wide table cols=10000 chunks=1 rows=1000 24977355 / — / no baseline 24982233 / — / no baseline 1.00 / — / no baseline
compress time/wide table cols=10000 chunks=50 rows=1000 24593868 / — / no baseline 25033627 / — / no baseline 0.98 / — / no baseline
decompress time/arade 220451940 / — / no baseline 220820191 / — / no baseline 1.00 / — / no baseline
decompress time/bimbo 421803924 / — / no baseline 423491652 / — / no baseline 1.00 / — / no baseline
decompress time/cmsprovider 700143168 / — / no baseline 701282246 / — / no baseline 1.00 / — / no baseline
decompress time/euro2016 86220738 / — / no baseline 86568865 / — / no baseline 1.00 / — / no baseline
decompress time/food 68003362 / — / no baseline 68119332 / — / no baseline 1.00 / — / no baseline
decompress time/hashtags 165809714 / — / no baseline 178972029 / — / no baseline 0.93 / — / no baseline
decompress time/taxi 52612066 / — / no baseline 52825267 / — / no baseline 1.00 / — / no baseline
decompress time/tpc-h l_comment canonical 191807169 / — / no baseline 192052561 / — / no baseline 1.00 / — / no baseline
decompress time/tpc-h l_comment chunked 190202824 / — / no baseline 190360328 / — / no baseline 1.00 / — / no baseline
decompress time/wide table cols=100 chunks=1 rows=1000 326064 / — / no baseline 345588 / — / no baseline 0.94 / — / no baseline
decompress time/wide table cols=100 chunks=50 rows=1000 323990.5 / — / no baseline 364693 / — / no baseline 0.89 / — / no baseline
decompress time/wide table cols=1000 chunks=1 rows=1000 3637427 / — / no baseline 3765023 / — / no baseline 0.97 / — / no baseline
decompress time/wide table cols=1000 chunks=50 rows=1000 3499659 / — / no baseline 3526002 / — / no baseline 0.99 / — / no baseline
decompress time/wide table cols=10000 chunks=1 rows=1000 36409435 / — / no baseline 36501425 / — / no baseline 1.00 / — / no baseline
decompress time/wide table cols=10000 chunks=50 rows=1000 36462480 / — / no baseline 36746965 / — / no baseline 0.99 / — / no baseline
vortex / arrow-ipc / bytes (no group data, 0↑ 0↓)
name bytes (PR / base / %diff)
arrow-ipc size/arade 680639722 / — / no baseline
arrow-ipc size/bimbo 3168319202 / — / no baseline
arrow-ipc size/cmsprovider 2394412322 / — / no baseline
arrow-ipc size/euro2016 359300042 / — / no baseline
arrow-ipc size/food 252069442 / — / no baseline
arrow-ipc size/hashtags 700364562 / — / no baseline
arrow-ipc size/taxi 474481242 / — / no baseline
arrow-ipc size/tpc-h l_comment canonical 1021072290 / — / no baseline
arrow-ipc size/tpc-h l_comment chunked 1021072290 / — / no baseline
arrow-ipc size/wide table cols=100 chunks=1 rows=1000 1231690 / — / no baseline
arrow-ipc size/wide table cols=100 chunks=50 rows=1000 1231690 / — / no baseline
arrow-ipc size/wide table cols=1000 chunks=1 rows=1000 12312506 / — / no baseline
arrow-ipc size/wide table cols=1000 chunks=50 rows=1000 12312506 / — / no baseline
arrow-ipc size/wide table cols=10000 chunks=1 rows=1000 123192506 / — / no baseline
arrow-ipc size/wide table cols=10000 chunks=50 rows=1000 123192506 / — / no baseline

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR 98f50a38 vs base e148f028
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.996x ➖
Parquet (geomean): hot 0.996x ➖ · cold 1.009x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact 1241808 / 1261444 / -1.6% 22124807 / 22193364 / -0.3% 0.06 / 0.06 / -1.3%
clickbench_q01/datafusion:vortex-compact 7191642 / 7705664 / -6.7% 30950389 / 36532359 / -15.3% 🟢 0.23 / 0.21 / +10.2%
clickbench_q02/datafusion:vortex-compact 13697382 / 13735380 / -0.3% 46426205 / 44657460 / +4.0% 0.30 / 0.31 / -4.1%
clickbench_q03/datafusion:vortex-compact 13129554 / 12768303 / +2.8% 49852146 / 46022935 / +8.3% 0.26 / 0.28 / -5.1%
clickbench_q04/datafusion:vortex-compact 59700412 / 58404253 / +2.2% 99352550 / 103339936 / -3.9% 0.60 / 0.57 / +6.3%
clickbench_q05/datafusion:vortex-compact 87612317 / 88471964 / -1.0% 135529781 / 133545477 / +1.5% 0.65 / 0.66 / -2.4%
clickbench_q06/datafusion:vortex-compact 1248581 / 1259942 / -0.9% 21228459 / 22796741 / -6.9% 0.06 / 0.06 / +6.4%
clickbench_q07/datafusion:vortex-compact 12236358 / 12537268 / -2.4% 39707443 / 35851196 / +10.8% 🔴 0.31 / 0.35 / -11.9%
clickbench_q08/datafusion:vortex-compact 80923962 / 85317719 / -5.1% 124178132 / 117522902 / +5.7% 0.65 / 0.73 / -10.2%
clickbench_q09/datafusion:vortex-compact 179059288 / 175749574 / +1.9% 201353701 / 210226797 / -4.2% 0.89 / 0.84 / +6.4%
clickbench_q10/datafusion:vortex-compact 27120177 / 26174931 / +3.6% 59936523 / 60199208 / -0.4% 0.45 / 0.43 / +4.1%
clickbench_q11/datafusion:vortex-compact 28878811 / 29546261 / -2.3% 64576343 / 63690693 / +1.4% 0.45 / 0.46 / -3.6%
clickbench_q12/datafusion:vortex-compact 89914442 / 91317846 / -1.5% 132375202 / 135117553 / -2.0% 0.68 / 0.68 / +0.5%
clickbench_q13/datafusion:vortex-compact 133439520 / 133952462 / -0.4% 189529246 / 195897890 / -3.3% 0.70 / 0.68 / +3.0%
clickbench_q14/datafusion:vortex-compact 94160288 / 96600084 / -2.5% 145129506 / 145493996 / -0.3% 0.65 / 0.66 / -2.3%
clickbench_q15/datafusion:vortex-compact 65805790 / 66190530 / -0.6% 99071173 / 100378057 / -1.3% 0.66 / 0.66 / +0.7%
clickbench_q16/datafusion:vortex-compact 162848154 / 165196609 / -1.4% 219164345 / 213900978 / +2.5% 0.74 / 0.77 / -3.8%
clickbench_q17/datafusion:vortex-compact 163806070 / 161663884 / +1.3% 222576170 / 224857182 / -1.0% 0.74 / 0.72 / +2.4%
clickbench_q18/datafusion:vortex-compact 301485574 / 297539278 / +1.3% 381664920 / 381500153 / +0.0% 0.79 / 0.78 / +1.3%
clickbench_q19/datafusion:vortex-compact 10112484 / 10107284 / +0.1% 41281055 / 43388558 / -4.9% 0.24 / 0.23 / +5.2%
clickbench_q20/datafusion:vortex-compact 93665311 / 90985415 / +2.9% 227443929 / 231321706 / -1.7% 0.41 / 0.39 / +4.7%
clickbench_q21/datafusion:vortex-compact 115642608 / 117872422 / -1.9% 259197195 / 260172757 / -0.4% 0.45 / 0.45 / -1.5%
clickbench_q22/datafusion:vortex-compact 219407373 / 220262283 / -0.4% 379806238 / 373193490 / +1.8% 0.58 / 0.59 / -2.1%
clickbench_q23/datafusion:vortex-compact 662908992 / 639252547 / +3.7% 780015149 / 830840348 / -6.1% 0.85 / 0.77 / +10.5%
clickbench_q24/datafusion:vortex-compact 32792239 / 34491348 / -4.9% 79306878 / 74127219 / +7.0% 0.41 / 0.47 / -11.1%
clickbench_q25/datafusion:vortex-compact 39946864 / 38453145 / +3.9% 81035523 / 78800835 / +2.8% 0.49 / 0.49 / +1.0%
clickbench_q26/datafusion:vortex-compact 32198259 / 33575629 / -4.1% 72311198 / 74912249 / -3.5% 0.45 / 0.45 / -0.7%
clickbench_q27/datafusion:vortex-compact 168631812 / 170009892 / -0.8% 259957476 / 266082344 / -2.3% 0.65 / 0.64 / +1.5%
clickbench_q28/datafusion:vortex-compact 613974844 / 609705328 / +0.7% 681581698 / 683906738 / -0.3% 0.90 / 0.89 / +1.0%
clickbench_q29/datafusion:vortex-compact 26033759 / 26176362 / -0.5% 55170198 / 52915243 / +4.3% 0.47 / 0.49 / -4.6%
clickbench_q30/datafusion:vortex-compact 73841112 / 72947194 / +1.2% 118459536 / 122039906 / -2.9% 0.62 / 0.60 / +4.3%
clickbench_q31/datafusion:vortex-compact 78006282 / 78907876 / -1.1% 151229134 / 153620812 / -1.6% 0.52 / 0.51 / +0.4%
clickbench_q32/datafusion:vortex-compact 290831657 / 288924424 / +0.7% 382791011 / 387043362 / -1.1% 0.76 / 0.75 / +1.8%
clickbench_q33/datafusion:vortex-compact 333969129 / 341567318 / -2.2% 429558701 / 428476917 / +0.3% 0.78 / 0.80 / -2.5%
clickbench_q34/datafusion:vortex-compact 332382582 / 331464824 / +0.3% 429210630 / 426481740 / +0.6% 0.77 / 0.78 / -0.4%
clickbench_q35/datafusion:vortex-compact 60490292 / 60421614 / +0.1% 91459066 / 95506039 / -4.2% 0.66 / 0.63 / +4.5%
clickbench_q36/datafusion:vortex-compact 44236377 / 44360583 / -0.3% 73832418 / 72793291 / +1.4% 0.60 / 0.61 / -1.7%
clickbench_q37/datafusion:vortex-compact 23463922 / 23019214 / +1.9% 48675616 / 50627683 / -3.9% 0.48 / 0.45 / +6.0%
clickbench_q38/datafusion:vortex-compact 19597678 / 19502574 / +0.5% 50434133 / 48715901 / +3.5% 0.39 / 0.40 / -2.9%
clickbench_q39/datafusion:vortex-compact 85247021 / 84826690 / +0.5% 117834136 / 119754326 / -1.6% 0.72 / 0.71 / +2.1%
clickbench_q40/datafusion:vortex-compact 12838178 / 12357350 / +3.9% 37686835 / 38713896 / -2.7% 0.34 / 0.32 / +6.7%
clickbench_q41/datafusion:vortex-compact 11372042 / 11586342 / -1.8% 35340945 / 36750486 / -3.8% 0.32 / 0.32 / +2.1%
clickbench_q42/datafusion:vortex-compact 10659405 / 10364691 / +2.8% 35099962 / 35710751 / -1.7% 0.30 / 0.29 / +4.6%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1248776 / 1255876 / -0.6% 50704666 / 51261799 / -1.1% 0.02 / 0.02 / +0.5%
clickbench_q01/datafusion:parquet 15845622 / 15719163 / +0.8% 68171115 / 67101091 / +1.6% 0.23 / 0.23 / -0.8%
clickbench_q02/datafusion:parquet 18669746 / 19429015 / -3.9% 81559927 / 80840176 / +0.9% 0.23 / 0.24 / -4.8%
clickbench_q03/datafusion:parquet 17480773 / 17346224 / +0.8% 80560417 / 80356127 / +0.3% 0.22 / 0.22 / +0.5%
clickbench_q04/datafusion:parquet 61510534 / 64382596 / -4.5% 123616696 / 126065223 / -1.9% 0.50 / 0.51 / -2.6%
clickbench_q05/datafusion:parquet 88501972 / 87578353 / +1.1% 157787700 / 157546371 / +0.2% 0.56 / 0.56 / +0.9%
clickbench_q06/datafusion:parquet 1260820 / 1270260 / -0.7% 51354100 / 49538823 / +3.7% 0.02 / 0.03 / -4.3%
clickbench_q07/datafusion:parquet 16946044 / 16810825 / +0.8% 69639226 / 67641707 / +3.0% 0.24 / 0.25 / -2.1%
clickbench_q08/datafusion:parquet 85535128 / 83901524 / +1.9% 166091723 / 156917733 / +5.8% 0.51 / 0.53 / -3.7%
clickbench_q09/datafusion:parquet 187384673 / 187986905 / -0.3% 273300726 / 264547775 / +3.3% 0.69 / 0.71 / -3.5%
clickbench_q10/datafusion:parquet 35992706 / 35858012 / +0.4% 101444163 / 99408040 / +2.0% 0.35 / 0.36 / -1.6%
clickbench_q11/datafusion:parquet 42958690 / 42193596 / +1.8% 111569562 / 109566699 / +1.8% 0.39 / 0.39 / -0.0%
clickbench_q12/datafusion:parquet 95834316 / 95656882 / +0.2% 167748219 / 162409857 / +3.3% 0.57 / 0.59 / -3.0%
clickbench_q13/datafusion:parquet 145782828 / 148170130 / -1.6% 229338406 / 229704607 / -0.2% 0.64 / 0.65 / -1.5%
clickbench_q14/datafusion:parquet 100887688 / 101841722 / -0.9% 172373413 / 173213189 / -0.5% 0.59 / 0.59 / -0.5%
clickbench_q15/datafusion:parquet 71664550 / 70462126 / +1.7% 132661404 / 132514285 / +0.1% 0.54 / 0.53 / +1.6%
clickbench_q16/datafusion:parquet 157157434 / 154561632 / +1.7% 237674658 / 237801708 / -0.1% 0.66 / 0.65 / +1.7%
clickbench_q17/datafusion:parquet 156132724 / 156353610 / -0.1% 239023431 / 236991834 / +0.9% 0.65 / 0.66 / -1.0%
clickbench_q18/datafusion:parquet 311107542 / 307397570 / +1.2% 425075538 / 416378601 / +2.1% 0.73 / 0.74 / -0.9%
clickbench_q19/datafusion:parquet 19026456 / 19012536 / +0.1% 78507157 / 76108297 / +3.2% 0.24 / 0.25 / -3.0%
clickbench_q20/datafusion:parquet 178619387 / 178296306 / +0.2% 299608373 / 281789723 / +6.3% 0.60 / 0.63 / -5.8%
clickbench_q21/datafusion:parquet 170970752 / 173463958 / -1.4% 317151199 / 299607418 / +5.9% 0.54 / 0.58 / -6.9%
clickbench_q22/datafusion:parquet 257778466 / 262165203 / -1.7% 456635121 / 429682724 / +6.3% 0.56 / 0.61 / -7.5%
clickbench_q23/datafusion:parquet 1014806726 / 1009828499 / +0.5% 1228730535 / 1191643014 / +3.1% 0.83 / 0.85 / -2.5%
clickbench_q24/datafusion:parquet 29887861 / 30048756 / -0.5% 90615268 / 89981801 / +0.7% 0.33 / 0.33 / -1.2%
clickbench_q25/datafusion:parquet 37083556 / 37564243 / -1.3% 105070151 / 102659865 / +2.3% 0.35 / 0.37 / -3.5%
clickbench_q26/datafusion:parquet 30405216 / 30821810 / -1.4% 90974123 / 89752784 / +1.4% 0.33 / 0.34 / -2.7%
clickbench_q27/datafusion:parquet 192191422 / 194345017 / -1.1% 305932850 / 289207881 / +5.8% 0.63 / 0.67 / -6.5%
clickbench_q28/datafusion:parquet 614833290 / 613253764 / +0.3% 709525368 / 707645358 / +0.3% 0.87 / 0.87 / -0.0%
clickbench_q29/datafusion:parquet 28496220 / 29784822 / -4.3% 91104453 / 90743403 / +0.4% 0.31 / 0.33 / -4.7%
clickbench_q30/datafusion:parquet 90368916 / 91149058 / -0.9% 174468533 / 175744833 / -0.7% 0.52 / 0.52 / -0.1%
clickbench_q31/datafusion:parquet 103447416 / 102377762 / +1.0% 198487179 / 199080813 / -0.3% 0.52 / 0.51 / +1.3%
clickbench_q32/datafusion:parquet 309128301 / 309491746 / -0.1% 430746045 / 433061755 / -0.5% 0.72 / 0.71 / +0.4%
clickbench_q33/datafusion:parquet 377169202 / 378129100 / -0.3% 476129070 / 479827958 / -0.8% 0.79 / 0.79 / +0.5%
clickbench_q34/datafusion:parquet 375111185 / 379216704 / -1.1% 479215169 / 478609411 / +0.1% 0.78 / 0.79 / -1.2%
clickbench_q35/datafusion:parquet 64980211 / 65293815 / -0.5% 123163050 / 123038359 / +0.1% 0.53 / 0.53 / -0.6%
clickbench_q36/datafusion:parquet 72845333 / 73469862 / -0.9% 138501633 / 137193462 / +1.0% 0.53 / 0.54 / -1.8%
clickbench_q37/datafusion:parquet 35250014 / 35204685 / +0.1% 91410246 / 91097358 / +0.3% 0.39 / 0.39 / -0.2%
clickbench_q38/datafusion:parquet 47482877 / 47839627 / -0.7% 109225571 / 108245704 / +0.9% 0.43 / 0.44 / -1.6%
clickbench_q39/datafusion:parquet 142818068 / 144061368 / -0.9% 210742173 / 212478991 / -0.8% 0.68 / 0.68 / -0.0%
clickbench_q40/datafusion:parquet 19777192 / 20152606 / -1.9% 77915364 / 77785220 / +0.2% 0.25 / 0.26 / -2.0%
clickbench_q41/datafusion:parquet 18472630 / 18849623 / -2.0% 75866585 / 76657524 / -1.0% 0.24 / 0.25 / -1.0%
clickbench_q42/datafusion:parquet 19400318 / 19472940 / -0.4% 74785885 / 75185315 / -0.5% 0.26 / 0.26 / +0.2%
duckdb / vortex-compact / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact 2182400 / 2474974 / -11.8% 🟢 23273028 / 22172592 / +5.0% 0.09 / 0.11 / -16.0%
clickbench_q01/duckdb:vortex-compact 7329782 / 7681734 / -4.6% 27193644 / 30977271 / -12.2% 🟢 0.27 / 0.25 / +8.7%
clickbench_q02/duckdb:vortex-compact 10707437 / 10802666 / -0.9% 32971174 / 35180396 / -6.3% 0.32 / 0.31 / +5.8%
clickbench_q03/duckdb:vortex-compact 15619856 / 15910440 / -1.8% 50702456 / 49047412 / +3.4% 0.31 / 0.32 / -5.0%
clickbench_q04/duckdb:vortex-compact 59565972 / 59349332 / +0.4% 94884556 / 94608326 / +0.3% 0.63 / 0.63 / +0.1%
clickbench_q05/duckdb:vortex-compact 70890100 / 68670504 / +3.2% 100821970 / 99450595 / +1.4% 0.70 / 0.69 / +1.8%
clickbench_q06/duckdb:vortex-compact 2827852 / 2856764 / -1.0% 30286744 / 28980651 / +4.5% 0.09 / 0.10 / -5.3%
clickbench_q07/duckdb:vortex-compact 9294069 / 9618818 / -3.4% 29712241 / 29522672 / +0.6% 0.31 / 0.33 / -4.0%
clickbench_q08/duckdb:vortex-compact 71746686 / 72636313 / -1.2% 107511664 / 108950584 / -1.3% 0.67 / 0.67 / +0.1%
clickbench_q09/duckdb:vortex-compact 100549214 / 99658382 / +0.9% 139565366 / 135896444 / +2.7% 0.72 / 0.73 / -1.8%
clickbench_q10/duckdb:vortex-compact 31370118 / 31594648 / -0.7% 67851614 / 68234557 / -0.6% 0.46 / 0.46 / -0.2%
clickbench_q11/duckdb:vortex-compact 35093845 / 34984948 / +0.3% 71277555 / 73059321 / -2.4% 0.49 / 0.48 / +2.8%
clickbench_q12/duckdb:vortex-compact 75865016 / 76495596 / -0.8% 106056592 / 109458020 / -3.1% 0.72 / 0.70 / +2.4%
clickbench_q13/duckdb:vortex-compact 140431191 / 142242654 / -1.3% 180472779 / 177023315 / +1.9% 0.78 / 0.80 / -3.2%
clickbench_q14/duckdb:vortex-compact 82961807 / 83994869 / -1.2% 114540751 / 112180374 / +2.1% 0.72 / 0.75 / -3.3%
clickbench_q15/duckdb:vortex-compact 77570534 / 77649605 / -0.1% 111531976 / 112860610 / -1.2% 0.70 / 0.69 / +1.1%
clickbench_q16/duckdb:vortex-compact 146630551 / 148908030 / -1.5% 188565373 / 189252401 / -0.4% 0.78 / 0.79 / -1.2%
clickbench_q17/duckdb:vortex-compact 152547404 / 149326933 / +2.2% 187995133 / 185893373 / +1.1% 0.81 / 0.80 / +1.0%
clickbench_q18/duckdb:vortex-compact 258665964 / 262376926 / -1.4% 317014061 / 318734885 / -0.5% 0.82 / 0.82 / -0.9%
clickbench_q19/duckdb:vortex-compact 10612949 / 10633537 / -0.2% 39255890 / 37281197 / +5.3% 0.27 / 0.29 / -5.2%
clickbench_q20/duckdb:vortex-compact 80789374 / 80827670 / -0.0% 161068332 / 156600358 / +2.9% 0.50 / 0.52 / -2.8%
clickbench_q21/duckdb:vortex-compact 131996288 / 130526508 / +1.1% 270700472 / 274230570 / -1.3% 0.49 / 0.48 / +2.4%
clickbench_q22/duckdb:vortex-compact 284236046 / 284433162 / -0.1% 467952506 / 484016177 / -3.3% 0.61 / 0.59 / +3.4%
clickbench_q23/duckdb:vortex-compact 48481164 / 45667348 / +6.2% 83624456 / 79622282 / +5.0% 0.58 / 0.57 / +1.1%
clickbench_q24/duckdb:vortex-compact 17822142 / 18075856 / -1.4% 36791163 / 38791119 / -5.2% 0.48 / 0.47 / +4.0%
clickbench_q25/duckdb:vortex-compact 32538781 / 32527334 / +0.0% 61366496 / 61459401 / -0.2% 0.53 / 0.53 / +0.2%
clickbench_q26/duckdb:vortex-compact 14165489 / 14901440 / -4.9% 33396950 / 37384925 / -10.7% 🟢 0.42 / 0.40 / +6.4%
clickbench_q27/duckdb:vortex-compact 147226596 / 146656486 / +0.4% 258410089 / 263082430 / -1.8% 0.57 / 0.56 / +2.2%
clickbench_q28/duckdb:vortex-compact 538790162 / 538301668 / +0.1% 599305869 / 608251864 / -1.5% 0.90 / 0.88 / +1.6%
clickbench_q29/duckdb:vortex-compact 19530360 / 19900357 / -1.9% 43164475 / 45747680 / -5.6% 0.45 / 0.44 / +4.0%
clickbench_q30/duckdb:vortex-compact 82047192 / 83265025 / -1.5% 121713270 / 124798704 / -2.5% 0.67 / 0.67 / +1.0%
clickbench_q31/duckdb:vortex-compact 131158582 / 130217954 / +0.7% 204982019 / 205710367 / -0.4% 0.64 / 0.63 / +1.1%
clickbench_q32/duckdb:vortex-compact 384677852 / 386104554 / -0.4% 423729260 / 423891578 / -0.0% 0.91 / 0.91 / -0.3%
clickbench_q33/duckdb:vortex-compact 353253168 / 351248610 / +0.6% 452451446 / 463534048 / -2.4% 0.78 / 0.76 / +3.0%
clickbench_q34/duckdb:vortex-compact 376741404 / 376047698 / +0.2% 480688655 / 476056465 / +1.0% 0.78 / 0.79 / -0.8%
clickbench_q35/duckdb:vortex-compact 60359242 / 60744784 / -0.6% 88392639 / 90580014 / -2.4% 0.68 / 0.67 / +1.8%
clickbench_q36/duckdb:vortex-compact 12930498 / 12454660 / +3.8% 33590742 / 32200982 / +4.3% 0.38 / 0.39 / -0.5%
clickbench_q37/duckdb:vortex-compact 9816788 / 10423408 / -5.8% 27996084 / 29398702 / -4.8% 0.35 / 0.35 / -1.1%
clickbench_q38/duckdb:vortex-compact 8954494 / 9047458 / -1.0% 32846007 / 28958574 / +13.4% 🔴 0.27 / 0.31 / -12.7%
clickbench_q39/duckdb:vortex-compact 20764067 / 21095151 / -1.6% 41107407 / 43360993 / -5.2% 0.51 / 0.49 / +3.8%
clickbench_q40/duckdb:vortex-compact 8270310 / 8432742 / -1.9% 30479035 / 28100695 / +8.5% 0.27 / 0.30 / -9.6%
clickbench_q41/duckdb:vortex-compact 8700080 / 9075303 / -4.1% 31671228 / 29174844 / +8.6% 0.27 / 0.31 / -11.7%
clickbench_q42/duckdb:vortex-compact 7405969 / 7353009 / +0.7% 28078161 / 28102215 / -0.1% 0.26 / 0.26 / +0.8%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 11672514 / 11675714 / -0.0% 18952324 / 18906546 / +0.2% 0.62 / 0.62 / -0.3%
clickbench_q01/duckdb:parquet 17719866 / 17590210 / +0.7% 23988251 / 25693739 / -6.6% 0.74 / 0.68 / +7.9%
clickbench_q02/duckdb:parquet 24376870 / 24060928 / +1.3% 34998185 / 39398331 / -11.2% 🟢 0.70 / 0.61 / +14.1%
clickbench_q03/duckdb:parquet 24794228 / 24644680 / +0.6% 38942104 / 42495867 / -8.4% 0.64 / 0.58 / +9.8%
clickbench_q04/duckdb:parquet 63411920 / 63559733 / -0.2% 78893113 / 76895477 / +2.6% 0.80 / 0.83 / -2.8%
clickbench_q05/duckdb:parquet 84751532 / 86010460 / -1.5% 99411104 / 104774979 / -5.1% 0.85 / 0.82 / +3.9%
clickbench_q06/duckdb:parquet 22518892 / 23116991 / -2.6% 34138165 / 29875899 / +14.3% 🔴 0.66 / 0.77 / -14.7%
clickbench_q07/duckdb:parquet 19852864 / 18397734 / +7.9% 27786225 / 27385545 / +1.5% 0.71 / 0.67 / +6.4%
clickbench_q08/duckdb:parquet 76773634 / 78214002 / -1.8% 95835793 / 92197472 / +3.9% 0.80 / 0.85 / -5.6%
clickbench_q09/duckdb:parquet 105548140 / 106021010 / -0.4% 126394073 / 123016227 / +2.7% 0.84 / 0.86 / -3.1%
clickbench_q10/duckdb:parquet 42141360 / 42295810 / -0.4% 56897262 / 60689423 / -6.2% 0.74 / 0.70 / +6.3%
clickbench_q11/duckdb:parquet 47731868 / 48001771 / -0.6% 63433454 / 67787320 / -6.4% 0.75 / 0.71 / +6.3%
clickbench_q12/duckdb:parquet 95982402 / 94471366 / +1.6% 115172688 / 113239138 / +1.7% 0.83 / 0.83 / -0.1%
clickbench_q13/duckdb:parquet 152534720 / 154241616 / -1.1% 174952950 / 176445269 / -0.8% 0.87 / 0.87 / -0.3%
clickbench_q14/duckdb:parquet 104946695 / 103737419 / +1.2% 124557273 / 124897721 / -0.3% 0.84 / 0.83 / +1.4%
clickbench_q15/duckdb:parquet 89332872 / 91052918 / -1.9% 106189942 / 105015498 / +1.1% 0.84 / 0.87 / -3.0%
clickbench_q16/duckdb:parquet 175703860 / 182820740 / -3.9% 188620213 / 190281628 / -0.9% 0.93 / 0.96 / -3.0%
clickbench_q17/duckdb:parquet 181611733 / 181602952 / +0.0% 190810402 / 193945202 / -1.6% 0.95 / 0.94 / +1.6%
clickbench_q18/duckdb:parquet 310815612 / 308460222 / +0.8% 338840875 / 336896382 / +0.6% 0.92 / 0.92 / +0.2%
clickbench_q19/duckdb:parquet 22830847 / 22139812 / +3.1% 33032548 / 31774257 / +4.0% 0.69 / 0.70 / -0.8%
clickbench_q20/duckdb:parquet 194364895 / 184163618 / +5.5% 237827528 / 236632875 / +0.5% 0.82 / 0.78 / +5.0%
clickbench_q21/duckdb:parquet 234058786 / 225715599 / +3.7% 267543753 / 265890128 / +0.6% 0.87 / 0.85 / +3.1%
clickbench_q22/duckdb:parquet 312224374 / 319121114 / -2.2% 364197829 / 361686859 / +0.7% 0.86 / 0.88 / -2.8%
clickbench_q23/duckdb:parquet 170698892 / 171586590 / -0.5% 248032871 / 239694381 / +3.5% 0.69 / 0.72 / -3.9%
clickbench_q24/duckdb:parquet 32965284 / 32746400 / +0.7% 41946690 / 36937990 / +13.6% 🔴 0.79 / 0.89 / -11.4%
clickbench_q25/duckdb:parquet 44210512 / 43350562 / +2.0% 60828532 / 60216973 / +1.0% 0.73 / 0.72 / +1.0%
clickbench_q26/duckdb:parquet 33415128 / 35609696 / -6.2% 52930766 / 39619958 / +33.6% 🔴 0.63 / 0.90 / -29.8%
clickbench_q27/duckdb:parquet 199134742 / 196593103 / +1.3% 234566952 / 237850894 / -1.4% 0.85 / 0.83 / +2.7%
clickbench_q28/duckdb:parquet 997107628 / 982825530 / +1.5% 1011238039 / 973040188 / +3.9% 0.99 / 1.01 / -2.4%
clickbench_q29/duckdb:parquet 25841859 / 27114991 / -4.7% 34833141 / 34764553 / +0.2% 0.74 / 0.78 / -4.9%
clickbench_q30/duckdb:parquet 108868380 / 108962096 / -0.1% 140069211 / 134782003 / +3.9% 0.78 / 0.81 / -3.9%
clickbench_q31/duckdb:parquet 150777184 / 163830642 / -8.0% 185271997 / 206757760 / -10.4% 🟢 0.81 / 0.79 / +2.7%
clickbench_q32/duckdb:parquet 401295109 / 402299056 / -0.2% 436829555 / 425852822 / +2.6% 0.92 / 0.94 / -2.8%
clickbench_q33/duckdb:parquet 493531882 / 491279264 / +0.5% 453104016 / 457594881 / -1.0% 1.09 / 1.07 / +1.5%
clickbench_q34/duckdb:parquet 483271796 / 476194408 / +1.5% 469081485 / 458122657 / +2.4% 1.03 / 1.04 / -0.9%
clickbench_q35/duckdb:parquet 64649402 / 65053774 / -0.6% 80085855 / 78318359 / +2.3% 0.81 / 0.83 / -2.8%
clickbench_q36/duckdb:parquet 31374185 / 32755520 / -4.2% 40200055 / 42104208 / -4.5% 0.78 / 0.78 / +0.3%
clickbench_q37/duckdb:parquet 25667536 / 26025994 / -1.4% 33949453 / 35621219 / -4.7% 0.76 / 0.73 / +3.5%
clickbench_q38/duckdb:parquet 25922800 / 25662576 / +1.0% 34833316 / 34931433 / -0.3% 0.74 / 0.73 / +1.3%
clickbench_q39/duckdb:parquet 53878442 / 53997373 / -0.2% 63500871 / 64623205 / -1.7% 0.85 / 0.84 / +1.5%
clickbench_q40/duckdb:parquet 16624844 / 16201884 / +2.6% 24190720 / 24790308 / -2.4% 0.69 / 0.65 / +5.2%
clickbench_q41/duckdb:parquet 16818507 / 17450942 / -3.6% 24945443 / 24763137 / +0.7% 0.67 / 0.70 / -4.3%
clickbench_q42/duckdb:parquet 16421100 / 16662917 / -1.5% 26942320 / 26012187 / +3.6% 0.61 / 0.64 / -4.9%

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR c3a54a8e vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

The baseline could not be read from the benchmarks database; PR measurements are shown without comparison.


datafusion / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 492995383 / — / no baseline 776452295 / — / no baseline 0.63 / — / no baseline
tpch_q02/datafusion:vortex-compact 515657041 / — / no baseline 1297014989 / — / no baseline 0.40 / — / no baseline
tpch_q03/datafusion:vortex-compact 507174862 / — / no baseline 1200093305 / — / no baseline 0.42 / — / no baseline
tpch_q04/datafusion:vortex-compact 577847665 / — / no baseline 772698063 / — / no baseline 0.75 / — / no baseline
tpch_q05/datafusion:vortex-compact 716786626 / — / no baseline 1028690945 / — / no baseline 0.70 / — / no baseline
tpch_q06/datafusion:vortex-compact 238928002 / — / no baseline 415421187 / — / no baseline 0.58 / — / no baseline
tpch_q07/datafusion:vortex-compact 735613293 / — / no baseline 1234047817 / — / no baseline 0.60 / — / no baseline
tpch_q08/datafusion:vortex-compact 913406695 / — / no baseline 1083643666 / — / no baseline 0.84 / — / no baseline
tpch_q09/datafusion:vortex-compact 717359508 / — / no baseline 983808415 / — / no baseline 0.73 / — / no baseline
tpch_q10/datafusion:vortex-compact 663145076 / — / no baseline 995418889 / — / no baseline 0.67 / — / no baseline
tpch_q11/datafusion:vortex-compact 305728190 / — / no baseline 618867771 / — / no baseline 0.49 / — / no baseline
tpch_q12/datafusion:vortex-compact 327015733 / — / no baseline 580948387 / — / no baseline 0.56 / — / no baseline
tpch_q13/datafusion:vortex-compact 257642752 / — / no baseline 660377091 / — / no baseline 0.39 / — / no baseline
tpch_q14/datafusion:vortex-compact 286212618 / — / no baseline 473237354 / — / no baseline 0.60 / — / no baseline
tpch_q15/datafusion:vortex-compact 551500399 / — / no baseline 823960208 / — / no baseline 0.67 / — / no baseline
tpch_q16/datafusion:vortex-compact 225534422 / — / no baseline 459164029 / — / no baseline 0.49 / — / no baseline
tpch_q17/datafusion:vortex-compact 738391309 / — / no baseline 918661069 / — / no baseline 0.80 / — / no baseline
tpch_q18/datafusion:vortex-compact 948047717 / — / no baseline 1334413396 / — / no baseline 0.71 / — / no baseline
tpch_q19/datafusion:vortex-compact 377377331 / — / no baseline 597933249 / — / no baseline 0.63 / — / no baseline
tpch_q20/datafusion:vortex-compact 666378506 / — / no baseline 834041605 / — / no baseline 0.80 / — / no baseline
tpch_q21/datafusion:vortex-compact 1680082146 / — / no baseline 1310274788 / — / no baseline 1.28 / — / no baseline
tpch_q22/datafusion:vortex-compact 295858168 / — / no baseline 713613050 / — / no baseline 0.41 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 321425528 / — / no baseline 844765639 / — / no baseline 0.38 / — / no baseline
tpch_q02/datafusion:parquet 486886300 / — / no baseline 924608664 / — / no baseline 0.53 / — / no baseline
tpch_q03/datafusion:parquet 501696375 / — / no baseline 948717602 / — / no baseline 0.53 / — / no baseline
tpch_q04/datafusion:parquet 367617355 / — / no baseline 488579286 / — / no baseline 0.75 / — / no baseline
tpch_q05/datafusion:parquet 581440350 / — / no baseline 778044634 / — / no baseline 0.75 / — / no baseline
tpch_q06/datafusion:parquet 191138000 / — / no baseline 461488667 / — / no baseline 0.41 / — / no baseline
tpch_q07/datafusion:parquet 580780068 / — / no baseline 753036236 / — / no baseline 0.77 / — / no baseline
tpch_q08/datafusion:parquet 845133990 / — / no baseline 1126381152 / — / no baseline 0.75 / — / no baseline
tpch_q09/datafusion:parquet 959736407 / — / no baseline 1249366462 / — / no baseline 0.77 / — / no baseline
tpch_q10/datafusion:parquet 1211105757 / — / no baseline 1783364608 / — / no baseline 0.68 / — / no baseline
tpch_q11/datafusion:parquet 382029688 / — / no baseline 575825710 / — / no baseline 0.66 / — / no baseline
tpch_q12/datafusion:parquet 369816507 / — / no baseline 754884413 / — / no baseline 0.49 / — / no baseline
tpch_q13/datafusion:parquet 407861503 / — / no baseline 630807838 / — / no baseline 0.65 / — / no baseline
tpch_q14/datafusion:parquet 404813116 / — / no baseline 541250709 / — / no baseline 0.75 / — / no baseline
tpch_q15/datafusion:parquet 567234226 / — / no baseline 809335957 / — / no baseline 0.70 / — / no baseline
tpch_q16/datafusion:parquet 216610589 / — / no baseline 524858650 / — / no baseline 0.41 / — / no baseline
tpch_q17/datafusion:parquet 629227442 / — / no baseline 793387878 / — / no baseline 0.79 / — / no baseline
tpch_q18/datafusion:parquet 491091745 / — / no baseline 786088282 / — / no baseline 0.62 / — / no baseline
tpch_q19/datafusion:parquet 436158048 / — / no baseline 648308404 / — / no baseline 0.67 / — / no baseline
tpch_q20/datafusion:parquet 689669549 / — / no baseline 831336658 / — / no baseline 0.83 / — / no baseline
tpch_q21/datafusion:parquet 1030695396 / — / no baseline 954531335 / — / no baseline 1.08 / — / no baseline
tpch_q22/datafusion:parquet 440198414 / — / no baseline 742662177 / — / no baseline 0.59 / — / no baseline
duckdb / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 1082998390 / — / no baseline 1073230199 / — / no baseline 1.01 / — / no baseline
tpch_q02/duckdb:vortex-compact 533234489 / — / no baseline 703085069 / — / no baseline 0.76 / — / no baseline
tpch_q03/duckdb:vortex-compact 1131351372 / — / no baseline 1425668376 / — / no baseline 0.79 / — / no baseline
tpch_q04/duckdb:vortex-compact 800644534 / — / no baseline 982760579 / — / no baseline 0.81 / — / no baseline
tpch_q05/duckdb:vortex-compact 979356009 / — / no baseline 1359080978 / — / no baseline 0.72 / — / no baseline
tpch_q06/duckdb:vortex-compact 842066750 / — / no baseline 952808007 / — / no baseline 0.88 / — / no baseline
tpch_q07/duckdb:vortex-compact 1123636508 / — / no baseline 1403799232 / — / no baseline 0.80 / — / no baseline
tpch_q08/duckdb:vortex-compact 1137832377 / — / no baseline 1469132635 / — / no baseline 0.77 / — / no baseline
tpch_q09/duckdb:vortex-compact 1259931575 / — / no baseline 1411548362 / — / no baseline 0.89 / — / no baseline
tpch_q10/duckdb:vortex-compact 1347286533 / — / no baseline 1600378089 / — / no baseline 0.84 / — / no baseline
tpch_q11/duckdb:vortex-compact 354212765 / — / no baseline 436641096 / — / no baseline 0.81 / — / no baseline
tpch_q12/duckdb:vortex-compact 803810034 / — / no baseline 1022494016 / — / no baseline 0.79 / — / no baseline
tpch_q13/duckdb:vortex-compact 552047524 / — / no baseline 519063365 / — / no baseline 1.06 / — / no baseline
tpch_q14/duckdb:vortex-compact 878367467 / — / no baseline 1004386732 / — / no baseline 0.87 / — / no baseline
tpch_q15/duckdb:vortex-compact 792753763 / — / no baseline 970757579 / — / no baseline 0.82 / — / no baseline
tpch_q16/duckdb:vortex-compact 272203154 / — / no baseline 368997059 / — / no baseline 0.74 / — / no baseline
tpch_q17/duckdb:vortex-compact 919775121 / — / no baseline 1321380143 / — / no baseline 0.70 / — / no baseline
tpch_q18/duckdb:vortex-compact 1188868436 / — / no baseline 1595730417 / — / no baseline 0.75 / — / no baseline
tpch_q19/duckdb:vortex-compact 952274267 / — / no baseline 1108636152 / — / no baseline 0.86 / — / no baseline
tpch_q20/duckdb:vortex-compact 1005852301 / — / no baseline 1136976908 / — / no baseline 0.88 / — / no baseline
tpch_q21/duckdb:vortex-compact 2274274498 / — / no baseline 2220495027 / — / no baseline 1.02 / — / no baseline
tpch_q22/duckdb:vortex-compact 416705106 / — / no baseline 613099879 / — / no baseline 0.68 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 454570786 / — / no baseline 335288375 / — / no baseline 1.36 / — / no baseline
tpch_q02/duckdb:parquet 549033655 / — / no baseline 643547257 / — / no baseline 0.85 / — / no baseline
tpch_q03/duckdb:parquet 538328028 / — / no baseline 711022420 / — / no baseline 0.76 / — / no baseline
tpch_q04/duckdb:parquet 380824765 / — / no baseline 462553870 / — / no baseline 0.82 / — / no baseline
tpch_q05/duckdb:parquet 691597806 / — / no baseline 817671469 / — / no baseline 0.85 / — / no baseline
tpch_q06/duckdb:parquet 255992262 / — / no baseline 322201064 / — / no baseline 0.79 / — / no baseline
tpch_q07/duckdb:parquet 890350423 / — / no baseline 966432235 / — / no baseline 0.92 / — / no baseline
tpch_q08/duckdb:parquet 997084097 / — / no baseline 1014355132 / — / no baseline 0.98 / — / no baseline
tpch_q09/duckdb:parquet 1024544423 / — / no baseline 1066227732 / — / no baseline 0.96 / — / no baseline
tpch_q10/duckdb:parquet 898255956 / — / no baseline 958222792 / — / no baseline 0.94 / — / no baseline
tpch_q11/duckdb:parquet 351983984 / — / no baseline 366978756 / — / no baseline 0.96 / — / no baseline
tpch_q12/duckdb:parquet 410705058 / — / no baseline 534231450 / — / no baseline 0.77 / — / no baseline
tpch_q13/duckdb:parquet 587480465 / — / no baseline 1035634054 / — / no baseline 0.57 / — / no baseline
tpch_q14/duckdb:parquet 462783237 / — / no baseline 485315601 / — / no baseline 0.95 / — / no baseline
tpch_q15/duckdb:parquet 470880978 / — / no baseline 445152510 / — / no baseline 1.06 / — / no baseline
tpch_q16/duckdb:parquet 317439114 / — / no baseline 359701148 / — / no baseline 0.88 / — / no baseline
tpch_q17/duckdb:parquet 441501324 / — / no baseline 512112371 / — / no baseline 0.86 / — / no baseline
tpch_q18/duckdb:parquet 510026267 / — / no baseline 541152469 / — / no baseline 0.94 / — / no baseline
tpch_q19/duckdb:parquet 566196189 / — / no baseline 604925840 / — / no baseline 0.94 / — / no baseline
tpch_q20/duckdb:parquet 828313569 / — / no baseline 765669779 / — / no baseline 1.08 / — / no baseline
tpch_q21/duckdb:parquet 718091374 / — / no baseline 1495476657 / — / no baseline 0.48 / — / no baseline
tpch_q22/duckdb:parquet 553906147 / — / no baseline 590438285 / — / no baseline 0.94 / — / no baseline

@github-actions

Copy link
Copy Markdown
Contributor

Benchmarks: String Encoding 📖

Commits: PR 8cc24be6 vs base none

No baseline is available for this benchmark yet; PR measurements are shown without comparison.


vortex / vortex-file-compressed / ms (no group data, 0↑ 0↓)
name ms (PR / base / %diff)
read/amazon/book_reviews/fsst 41.516488 / — / no baseline
read/amazon/book_reviews/onpair-12 30.504325 / — / no baseline
read/amazon/book_reviews/onpair-16 34.121561 / — / no baseline
read/amazon/book_titles/fsst 3.427409 / — / no baseline
read/amazon/book_titles/onpair-12 3.119967 / — / no baseline
read/amazon/book_titles/onpair-16 3.047017 / — / no baseline
read/clickbench/URL/shard-0/fsst 31.798607 / — / no baseline
read/clickbench/URL/shard-0/onpair-12 19.112774 / — / no baseline
read/clickbench/URL/shard-0/onpair-16 18.206694 / — / no baseline
read/fineweb/text/fsst 10.371709 / — / no baseline
read/fineweb/text/onpair-12 9.687093 / — / no baseline
read/fineweb/text/onpair-16 8.481855 / — / no baseline
read/news/headlines/fsst 17.665048 / — / no baseline
read/news/headlines/onpair-12 16.971438 / — / no baseline
read/news/headlines/onpair-16 16.027047 / — / no baseline
read/tpch/l_comment/fsst 50.760338 / — / no baseline
read/tpch/l_comment/onpair-12 42.968367 / — / no baseline
read/tpch/l_comment/onpair-16 42.803035 / — / no baseline
read/twitter/sentiment140/fsst 36.883285 / — / no baseline
read/twitter/sentiment140/onpair-12 33.686328 / — / no baseline
read/twitter/sentiment140/onpair-16 33.5634 / — / no baseline
write/amazon/book_reviews/fsst 555.02921 / — / no baseline
write/amazon/book_reviews/onpair-12 986.691201 / — / no baseline
write/amazon/book_reviews/onpair-16 991.859682 / — / no baseline
write/amazon/book_titles/fsst 57.86647 / — / no baseline
write/amazon/book_titles/onpair-12 89.516658 / — / no baseline
write/amazon/book_titles/onpair-16 92.131127 / — / no baseline
write/clickbench/URL/shard-0/fsst 433.743967 / — / no baseline
write/clickbench/URL/shard-0/onpair-12 610.167197 / — / no baseline
write/clickbench/URL/shard-0/onpair-16 617.550317 / — / no baseline
write/fineweb/text/fsst 213.207847 / — / no baseline
write/fineweb/text/onpair-12 511.601629 / — / no baseline
write/fineweb/text/onpair-16 519.928592 / — / no baseline
write/news/headlines/fsst 335.367946 / — / no baseline
write/news/headlines/onpair-12 472.81364 / — / no baseline
write/news/headlines/onpair-16 483.626689 / — / no baseline
write/tpch/l_comment/fsst 1070.99604 / — / no baseline
write/tpch/l_comment/onpair-12 1044.68437 / — / no baseline
write/tpch/l_comment/onpair-16 1058.59934 / — / no baseline
write/twitter/sentiment140/fsst 557.029761 / — / no baseline
write/twitter/sentiment140/onpair-12 955.144569 / — / no baseline
write/twitter/sentiment140/onpair-16 1042.8637 / — / no baseline
vortex / vortex-file-compressed / % (no group data, 0↑ 0↓)
name % (PR / base / %diff)
size/amazon/book_reviews/fsst 52.0930347 / — / no baseline
size/amazon/book_reviews/onpair-12 38.2296018 / — / no baseline
size/amazon/book_reviews/onpair-16 37.9344893 / — / no baseline
size/amazon/book_titles/fsst 50.7761502 / — / no baseline
size/amazon/book_titles/onpair-12 44.523188 / — / no baseline
size/amazon/book_titles/onpair-16 45.7126126 / — / no baseline
size/clickbench/URL/shard-0/fsst 47.2483856 / — / no baseline
size/clickbench/URL/shard-0/onpair-12 28.3410912 / — / no baseline
size/clickbench/URL/shard-0/onpair-16 28.6930427 / — / no baseline
size/fineweb/text/fsst 55.9870004 / — / no baseline
size/fineweb/text/onpair-12 44.3831317 / — / no baseline
size/fineweb/text/onpair-16 40.1615928 / — / no baseline
size/news/headlines/fsst 43.8563445 / — / no baseline
size/news/headlines/onpair-12 37.7865234 / — / no baseline
size/news/headlines/onpair-16 38.4681637 / — / no baseline
size/tpch/l_comment/fsst 30.1175516 / — / no baseline
size/tpch/l_comment/onpair-12 23.0414971 / — / no baseline
size/tpch/l_comment/onpair-16 23.0560113 / — / no baseline
size/twitter/sentiment140/fsst 51.8200304 / — / no baseline
size/twitter/sentiment140/onpair-12 44.1539243 / — / no baseline
size/twitter/sentiment140/onpair-16 46.0837528 / — / no baseline

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR c3a54a8e vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

The baseline could not be read from the benchmarks database; PR measurements are shown without comparison.


datafusion / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 222550264 / — / no baseline 762033779 / — / no baseline 0.29 / — / no baseline
tpch_q02/datafusion:vortex-compact 320679336 / — / no baseline 673797064 / — / no baseline 0.48 / — / no baseline
tpch_q03/datafusion:vortex-compact 314808604 / — / no baseline 694328652 / — / no baseline 0.45 / — / no baseline
tpch_q04/datafusion:vortex-compact 161195417 / — / no baseline 414374164 / — / no baseline 0.39 / — / no baseline
tpch_q05/datafusion:vortex-compact 420745709 / — / no baseline 524256132 / — / no baseline 0.80 / — / no baseline
tpch_q06/datafusion:vortex-compact 180526444 / — / no baseline 354097960 / — / no baseline 0.51 / — / no baseline
tpch_q07/datafusion:vortex-compact 391795997 / — / no baseline 587375314 / — / no baseline 0.67 / — / no baseline
tpch_q08/datafusion:vortex-compact 398163702 / — / no baseline 591144684 / — / no baseline 0.67 / — / no baseline
tpch_q09/datafusion:vortex-compact 344869149 / — / no baseline 656304646 / — / no baseline 0.53 / — / no baseline
tpch_q10/datafusion:vortex-compact 337391192 / — / no baseline 480665551 / — / no baseline 0.70 / — / no baseline
tpch_q11/datafusion:vortex-compact 265620491 / — / no baseline 449108656 / — / no baseline 0.59 / — / no baseline
tpch_q12/datafusion:vortex-compact 167774760 / — / no baseline 391987519 / — / no baseline 0.43 / — / no baseline
tpch_q13/datafusion:vortex-compact 107486661 / — / no baseline 292277320 / — / no baseline 0.37 / — / no baseline
tpch_q14/datafusion:vortex-compact 171684548 / — / no baseline 355231524 / — / no baseline 0.48 / — / no baseline
tpch_q15/datafusion:vortex-compact 311124293 / — / no baseline 549809677 / — / no baseline 0.57 / — / no baseline
tpch_q16/datafusion:vortex-compact 134117730 / — / no baseline 285452960 / — / no baseline 0.47 / — / no baseline
tpch_q17/datafusion:vortex-compact 222900218 / — / no baseline 453615825 / — / no baseline 0.49 / — / no baseline
tpch_q18/datafusion:vortex-compact 225818135 / — / no baseline 460405737 / — / no baseline 0.49 / — / no baseline
tpch_q19/datafusion:vortex-compact 281023665 / — / no baseline 380141520 / — / no baseline 0.74 / — / no baseline
tpch_q20/datafusion:vortex-compact 279639150 / — / no baseline 443696510 / — / no baseline 0.63 / — / no baseline
tpch_q21/datafusion:vortex-compact 416150067 / — / no baseline 754279557 / — / no baseline 0.55 / — / no baseline
tpch_q22/datafusion:vortex-compact 173498934 / — / no baseline 350226205 / — / no baseline 0.50 / — / no baseline
datafusion / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 157869524 / — / no baseline 526322368 / — / no baseline 0.30 / — / no baseline
tpch_q02/datafusion:parquet 272609638 / — / no baseline 529559392 / — / no baseline 0.51 / — / no baseline
tpch_q03/datafusion:parquet 254313395 / — / no baseline 661918738 / — / no baseline 0.38 / — / no baseline
tpch_q04/datafusion:parquet 145993417 / — / no baseline 330101941 / — / no baseline 0.44 / — / no baseline
tpch_q05/datafusion:parquet 356972528 / — / no baseline 495760429 / — / no baseline 0.72 / — / no baseline
tpch_q06/datafusion:parquet 119505035 / — / no baseline 259654132 / — / no baseline 0.46 / — / no baseline
tpch_q07/datafusion:parquet 330482884 / — / no baseline 433313852 / — / no baseline 0.76 / — / no baseline
tpch_q08/datafusion:parquet 408982743 / — / no baseline 568614128 / — / no baseline 0.72 / — / no baseline
tpch_q09/datafusion:parquet 466380989 / — / no baseline 807200338 / — / no baseline 0.58 / — / no baseline
tpch_q10/datafusion:parquet 325746095 / — / no baseline 452865724 / — / no baseline 0.72 / — / no baseline
tpch_q11/datafusion:parquet 248514019 / — / no baseline 404842451 / — / no baseline 0.61 / — / no baseline
tpch_q12/datafusion:parquet 159632046 / — / no baseline 354625891 / — / no baseline 0.45 / — / no baseline
tpch_q13/datafusion:parquet 280083427 / — / no baseline 497967782 / — / no baseline 0.56 / — / no baseline
tpch_q14/datafusion:parquet 150046827 / — / no baseline 293926819 / — / no baseline 0.51 / — / no baseline
tpch_q15/datafusion:parquet 305715370 / — / no baseline 522581057 / — / no baseline 0.59 / — / no baseline
tpch_q16/datafusion:parquet 101352361 / — / no baseline 198878017 / — / no baseline 0.51 / — / no baseline
tpch_q17/datafusion:parquet 281076988 / — / no baseline 426424836 / — / no baseline 0.66 / — / no baseline
tpch_q18/datafusion:parquet 349999683 / — / no baseline 510219204 / — / no baseline 0.69 / — / no baseline
tpch_q19/datafusion:parquet 156331132 / — / no baseline 294565220 / — / no baseline 0.53 / — / no baseline
tpch_q20/datafusion:parquet 234650815 / — / no baseline 377906933 / — / no baseline 0.62 / — / no baseline
tpch_q21/datafusion:parquet 300574403 / — / no baseline 443898268 / — / no baseline 0.68 / — / no baseline
tpch_q22/datafusion:parquet 150876602 / — / no baseline 311780704 / — / no baseline 0.48 / — / no baseline
duckdb / vortex-compact / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 180720117 / — / no baseline 196889017 / — / no baseline 0.92 / — / no baseline
tpch_q02/duckdb:vortex-compact 386787894 / — / no baseline 625350727 / — / no baseline 0.62 / — / no baseline
tpch_q03/duckdb:vortex-compact 362428909 / — / no baseline 607245495 / — / no baseline 0.60 / — / no baseline
tpch_q04/duckdb:vortex-compact 209422267 / — / no baseline 261028575 / — / no baseline 0.80 / — / no baseline
tpch_q05/duckdb:vortex-compact 494602097 / — / no baseline 626844273 / — / no baseline 0.79 / — / no baseline
tpch_q06/duckdb:vortex-compact 147076018 / — / no baseline 202495822 / — / no baseline 0.73 / — / no baseline
tpch_q07/duckdb:vortex-compact 416562851 / — / no baseline 383321425 / — / no baseline 1.09 / — / no baseline
tpch_q08/duckdb:vortex-compact 525742787 / — / no baseline 645086727 / — / no baseline 0.81 / — / no baseline
tpch_q09/duckdb:vortex-compact 388678396 / — / no baseline 431471255 / — / no baseline 0.90 / — / no baseline
tpch_q10/duckdb:vortex-compact 467538060 / — / no baseline 513633729 / — / no baseline 0.91 / — / no baseline
tpch_q11/duckdb:vortex-compact 313476531 / — / no baseline 295997488 / — / no baseline 1.06 / — / no baseline
tpch_q12/duckdb:vortex-compact 213240969 / — / no baseline 238047709 / — / no baseline 0.90 / — / no baseline
tpch_q13/duckdb:vortex-compact 259279755 / — / no baseline 251222265 / — / no baseline 1.03 / — / no baseline
tpch_q14/duckdb:vortex-compact 210871504 / — / no baseline 259896237 / — / no baseline 0.81 / — / no baseline
tpch_q15/duckdb:vortex-compact 235254635 / — / no baseline 286378977 / — / no baseline 0.82 / — / no baseline
tpch_q16/duckdb:vortex-compact 197814408 / — / no baseline 208460633 / — / no baseline 0.95 / — / no baseline
tpch_q17/duckdb:vortex-compact 313306820 / — / no baseline 325232353 / — / no baseline 0.96 / — / no baseline
tpch_q18/duckdb:vortex-compact 298151930 / — / no baseline 357175384 / — / no baseline 0.83 / — / no baseline
tpch_q19/duckdb:vortex-compact 276599832 / — / no baseline 403707320 / — / no baseline 0.69 / — / no baseline
tpch_q20/duckdb:vortex-compact 366643353 / — / no baseline 420386398 / — / no baseline 0.87 / — / no baseline
tpch_q21/duckdb:vortex-compact 550793525 / — / no baseline 637619132 / — / no baseline 0.86 / — / no baseline
tpch_q22/duckdb:vortex-compact 231319730 / — / no baseline 268266365 / — / no baseline 0.86 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 208842419 / — / no baseline 282435708 / — / no baseline 0.74 / — / no baseline
tpch_q02/duckdb:parquet 437975319 / — / no baseline 438227061 / — / no baseline 1.00 / — / no baseline
tpch_q03/duckdb:parquet 429201353 / — / no baseline 519751982 / — / no baseline 0.83 / — / no baseline
tpch_q04/duckdb:parquet 250750670 / — / no baseline 338587899 / — / no baseline 0.74 / — / no baseline
tpch_q05/duckdb:parquet 562597055 / — / no baseline 1112459840 / — / no baseline 0.51 / — / no baseline
tpch_q06/duckdb:parquet 161237190 / — / no baseline 189936603 / — / no baseline 0.85 / — / no baseline
tpch_q07/duckdb:parquet 411897714 / — / no baseline 479805584 / — / no baseline 0.86 / — / no baseline
tpch_q08/duckdb:parquet 614811957 / — / no baseline 684724016 / — / no baseline 0.90 / — / no baseline
tpch_q09/duckdb:parquet 567557564 / — / no baseline 566634810 / — / no baseline 1.00 / — / no baseline
tpch_q10/duckdb:parquet 616864219 / — / no baseline 643249374 / — / no baseline 0.96 / — / no baseline
tpch_q11/duckdb:parquet 300399064 / — / no baseline 336234437 / — / no baseline 0.89 / — / no baseline
tpch_q12/duckdb:parquet 282536259 / — / no baseline 345194887 / — / no baseline 0.82 / — / no baseline
tpch_q13/duckdb:parquet 391529410 / — / no baseline 501325884 / — / no baseline 0.78 / — / no baseline
tpch_q14/duckdb:parquet 334997397 / — / no baseline 392136736 / — / no baseline 0.85 / — / no baseline
tpch_q15/duckdb:parquet 220218150 / — / no baseline 282457862 / — / no baseline 0.78 / — / no baseline
tpch_q16/duckdb:parquet 274651422 / — / no baseline 286269106 / — / no baseline 0.96 / — / no baseline
tpch_q17/duckdb:parquet 335624059 / — / no baseline 372599194 / — / no baseline 0.90 / — / no baseline
tpch_q18/duckdb:parquet 339746442 / — / no baseline 464516425 / — / no baseline 0.73 / — / no baseline
tpch_q19/duckdb:parquet 232050777 / — / no baseline 309665702 / — / no baseline 0.75 / — / no baseline
tpch_q20/duckdb:parquet 467486756 / — / no baseline 527484313 / — / no baseline 0.89 / — / no baseline
tpch_q21/duckdb:parquet 457246329 / — / no baseline 497085459 / — / no baseline 0.92 / — / no baseline
tpch_q22/duckdb:parquet 295056856 / — / no baseline 383042310 / — / no baseline 0.77 / — / no baseline

- SQL rows keep the `tpch_q01/engine:format` names of the results JSON; the
  scale factor and variant move to the dataset join key.
- When the baseline cannot be read (no database credential), the comment
  says so instead of claiming the benchmark has no baseline yet.
- File sizes have no baseline in the database, so the comment no longer
  prints a file-size section that can never compare anything.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBBtX1DUban9Fda2Edh
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added action/bench-random-access Run only the random-access benchmark on this PR action/bench-compress Run only the compression benchmark on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-string Run only the string encoding benchmark on this PR action/bench-random-access-s3 labels Oct 30, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-random-access Run only the random-access benchmark on this PR action/bench-compress Run only the compression benchmark on this PR action/bench-string Run only the string encoding benchmark on this PR action/bench-gpu-compress Run only the GPU compression benchmark on this PR action/bench-random-access-s3 labels Oct 30, 2026
#10997 set exclude-newer = "7 days" for the workspace. NVIDIA's index
publishes no upload dates, so uv filtered out every cudf-cu12 wheel and
the GPU compression benchmark failed to install cuDF. The cuDF venv is
standalone, so install into it with --no-config.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBBtX1DUban9Fda2Edh
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added the action/bench-gpu-compress Run only the GPU compression benchmark on this PR label Oct 30, 2026 — with Claude
@github-actions github-actions Bot removed the action/bench-gpu-compress Run only the GPU compression benchmark on this PR label Oct 30, 2026
Composite actions cannot read the vars context, so GitHub rejected the
action file. Callers pass the role, region, endpoint and database in;
the record paths keep their defaults.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Claude-Session: https://claude.ai/code/session_01UeniBBtX1DUban9Fda2Edh
Signed-off-by: Joe Isaacs <[email protected]>
@joseph-isaacs joseph-isaacs added action/bench-gpu-compress Run only the GPU compression benchmark on this PR action/bench-random-access Run only the random-access benchmark on this PR action/bench-compress Run only the compression benchmark on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR action/bench-string Run only the string encoding benchmark on this PR action/bench-random-access-s3 labels Oct 30, 2026 — with Claude
@github-actions github-actions Bot removed action/bench-compress Run only the compression benchmark on this PR action/bench-random-access-s3 action/bench-string Run only the string encoding benchmark on this PR action/bench-random-access Run only the random-access benchmark on this PR action/bench-gpu-compress Run only the GPU compression benchmark on this PR action/bench-sql-compact Run only Vortex Compact SQL benchmarks on this PR labels Oct 30, 2026
@joseph-isaacs
joseph-isaacs merged commit 05fd248 into develop Oct 30, 2026
229 of 242 checks passed
@joseph-isaacs
joseph-isaacs deleted the ji/bench-baseline-postgres branch October 30, 2026 13:19
lwwmanning added a commit that referenced this pull request Oct 30, 2026
Keep develop's branch argument to build_commit (#10987) and this
branch's retried write around connect and ingest.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Signed-off-by: Will Manning <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants