CI takes hours to start

Describe the bug

Created more for visibility to others. CI now takes a long time to start across many PRs, both on push and in the merge queue. This seems to have started sometime between 2026-09-08 07:30 and 08:44 UTC.

Examples:
https://github.com/apache/datafusion/actions/runs/34238609607/job/102102700226?pr=25081
#25081
https://github.com/apache/datafusion/actions/runs/34238609420

Additional context

I believe that's ASF issue, https://issues.apache.org/jira/browse/INFRA-28374

I think that is related to other ASF projects too:

I hit a bunch of timeouts when trying to merge PRs using the merge queue in arrow-rs-object-store:

chore: Bump version to 0.63.0 and add changelog datafusion-sqlparser-rs#2481

The root cause appears to be our DataFusion github runner usage is consuming all the github runners:

Reduce GitHub Actions usage (DataFusion is currently the top ASF consumer of GHA minutes) #25148

This has been happening again a lot recently (taking hours to start running)

I have been exploring what apache projects are consuming jobs and Claude came up with this one

gh api --paginate "repos/apache/airflow/actions/runs?status=in_progress&per_page=100" \
  --jq '.workflow_runs[] | select(.head_repository.full_name == "apache/airflow") | "\(.id) \(.head_sha) \(.html_url)"' \
| while read -r id sha runurl; do
    link=$(gh api "repos/apache/airflow/commits/$sha/pulls" --jq '.[0].html_url // empty' 2>/dev/null)
    gh api --paginate "repos/apache/airflow/actions/runs/$id/jobs?per_page=100" \
      --jq '.jobs[] | select(.status=="in_progress") | select((.labels|join(","))|test("self-hosted")|not) | "\(.labels|join(","))\t\(.started_at)\t\(.workflow_name) / \(.name)"' \
    | sed "s|^|${link:-$runurl}\t|"
  done | sort -t$'\t' -k1,1 -k3,3

The current output is

  done | sort -t$'\t' -k1,1 -k3,3
https://github.com/apache/airflow/pull/74789	ubuntu-22.04	2026-10-20T17:32:54Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:API...CLI
https://github.com/apache/airflow/pull/74789	ubuntu-22.04	2026-10-20T17:32:54Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74789	ubuntu-22.04	2026-10-20T17:33:09Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74789	ubuntu-22.04	2026-10-20T17:33:09Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74789	ubuntu-22.04	2026-10-20T17:33:10Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74789	ubuntu-22.04	2026-10-20T17:33:42Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:32:51Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:API...CLI
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:32:57Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:32:58Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:32:58Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:06Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:06Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:06Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:API...CLI
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:06Z	Tests (AMD) / Non-DB tests: providers / Non-DB-prov::3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:07Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:27Z	Tests (AMD) / Provider distributions tests / Compat 2.11.1:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:27Z	Tests (AMD) / Provider distributions tests / Compat 3.0.6:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:27Z	Tests (AMD) / Provider distributions tests / Compat 3.2.2:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:27Z	Tests (AMD) / Provider distributions tests / Compat 3.3.2:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:33:42Z	Tests (AMD) / Provider distributions tests / Compat 3.1.8:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74790	ubuntu-22.04	2026-10-20T17:47:29Z	Tests (AMD) / Build PROD images / Build PROD Regular image 3.11
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:12Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:12Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:18Z	Tests (AMD) / CI image checks / Static checks
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:21Z	Tests (AMD) / Provider distributions tests / Compat 3.2.2:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:39Z	Tests (AMD) / Provider distributions tests / Compat 3.0.6:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:39Z	Tests (AMD) / Provider distributions tests / Compat 3.3.2:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:47Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:48Z	Tests (AMD) / Provider distributions tests / Compat 2.11.1:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:48Z	Tests (AMD) / Provider distributions tests / Compat 3.1.8:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:50Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:33:53Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:API...CLI
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:34:00Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:34:00Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:34:03Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:API...CLI
https://github.com/apache/airflow/pull/74791	ubuntu-22.04	2026-10-20T17:48:54Z	Tests (AMD) / Build PROD images / Build PROD Regular image 3.11
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:16Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:26Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:26Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:26Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:32Z	Tests (AMD) / Provider distributions tests / Compat 3.2.2:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:39Z	Tests (AMD) / Provider distributions tests / Compat 3.0.6:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:39Z	Tests (AMD) / Provider distributions tests / Compat 3.1.8:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:39Z	Tests (AMD) / Provider distributions tests / Providers wheel tests
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:40Z	Tests (AMD) / Provider distributions tests / Compat 3.3.2:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:42:59Z	Tests (AMD) / CI image checks / Static checks
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:13Z	Tests (AMD) / Provider distributions tests / Compat 2.11.1:P3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:16Z	Tests (AMD) / Postgres tests: providers / DB-prov:Postgres:14:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:17Z	Tests (AMD) / CI image checks / Build documentation
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:19Z	Tests (AMD) / MySQL tests: providers / DB-prov:MySQL:8.0:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:19Z	Tests (AMD) / Sqlite tests: providers / DB-prov:Sqlite:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:26Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:32Z	Tests (AMD) / Low dep tests: providers / prov:LowestDeps:14:3.11:samba...zendesk
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:32Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:35Z	Tests (AMD) / Low dep tests: providers / prov:LowestDeps:14:3.11:apprise...duckdb
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:39Z	Tests (AMD) / Generate constraints / Generate constraints for 3.11 on linux/amd64
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:52Z	Tests (AMD) / Low dep tests: providers / prov:LowestDeps:14:3.11:airbyte...apache.tinker
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:43:52Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:14Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:31Z	Tests (AMD) / Low dep tests: providers / prov:LowestDeps:14:3.11:microsoft.psr...salesforce
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:43Z	Tests (AMD) / Low dep tests: providers / prov:LowestDeps:14:3.11:edge3...microsoft.mss
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:43Z	Tests (AMD) / Special tests / Latest SQLAlchemy test: core / DB-core:LatestSQLAlchemy-Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:43Z	Tests (AMD) / Special tests / Min SQLAlchemy test: providers / DB-prov:MinSQLAlchemy-Postgres:14:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:44Z	Tests (AMD) / Special tests / Latest SQLAlchemy test: core / DB-core:LatestSQLAlchemy-Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:50Z	Tests (AMD) / Special tests / Min SQLAlchemy test: core / DB-core:MinSQLAlchemy-Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:53Z	Tests (AMD) / Special tests / Latest Boto test: providers / prov:LatestBoto-Postgres:14:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:44:53Z	Tests (AMD) / Special tests / Pendulum2 test: core / core:Pendulum2-Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:02Z	Tests (AMD) / Special tests / Latest Boto test: core / core:LatestBoto-Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:02Z	Tests (AMD) / Special tests / Latest Boto test: core / core:LatestBoto-Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:02Z	Tests (AMD) / Special tests / Pendulum2 test: core / core:Pendulum2-Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:18Z	Tests (AMD) / Special tests / Latest SQLAlchemy test: providers / DB-prov:LatestSQLAlchemy-Postgres:14:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:18Z	Tests (AMD) / Special tests / Min SQLAlchemy test: core / DB-core:MinSQLAlchemy-Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:18Z	Tests (AMD) / Special tests / Pendulum2 test: providers / prov:Pendulum2-Postgres:14:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:18Z	Tests (AMD) / Special tests / Quarantined test: providers / Qrnt-prov:Postgres:14:3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74793	ubuntu-22.04	2026-10-20T17:45:23Z	Tests (AMD) / Non-DB tests: providers / Non-DB-prov::3.11:-amazon,celer...standard
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:41:10Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:API...CLI
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:41:10Z	Tests (AMD) / MySQL tests: core / DB-core:MySQL:8.0:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:41:12Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:41:27Z	Tests (AMD) / Low dep tests:core / core:LowestDeps:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:41:37Z	Tests (AMD) / Provider distributions tests / Providers wheel tests
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:42:22Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:Core...Serialization
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:42:23Z	Tests (AMD) / Postgres tests: core / DB-core:Postgres:14:3.11:API...CLI
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:42:23Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:API...CLI
https://github.com/apache/airflow/pull/74794	ubuntu-22.04	2026-10-20T17:42:23Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:Core...Serialization
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T16:59:23Z	Tests (AMD) / Sqlite tests: core / DB-core:Sqlite:3.11:Core...Serialization
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:41:30Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.12-v1.32.11-true
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:41:40Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.14-v1.34.11-true
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:41:43Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.12-v1.32.11-false
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:41:48Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.11-v1.31.12-false
https://github.com/apache/airflow/pull/75231	ubuntu-22.04-arm	2026-10-20T17:42:52Z	Tests (ARM) / Kubernetes tests / K8S System:LocalExecutor-3.13-v1.37.0-false
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:43:54Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.14-v1.34.11-false
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:44:14Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.11-v1.35.8-false
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:50:59Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.12-v1.36.4-false
https://github.com/apache/airflow/pull/75231	ubuntu-22.04	2026-10-20T17:50:59Z	Tests (AMD) / Kubernetes tests / K8S System:LocalExecutor-3.13-v1.37.0-false

It looks like a few PRs consumed a lot of the runner time (each launches 14 jobs via some matrix)

The TLDR of my poking around is that some projects have many queued jobs (often from matrix'd runs) that are consuming significant numbers of runners and the DataFusion (and arrow-rs backlogs) are queued.

I'll ask the projects politely if there is some way to reduce the runner usage

I'll ask the projects politely if there is some way to reduce the runner usage

Thank you!

Current queue across projects

Queued jobs, repos with 10+ queued runs (jobs are what the runner pool actually serves):

┌──────────────────────────────┬─────────────┬─────────────┬──────────────────┐
│             Repo             │ Queued jobs │ Queued runs │ In-progress runs │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ datafusion                   │ 537         │ 108         │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ nuttx                        │ 349         │ 75          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ gravitino                    │ 280         │ 220         │ 2                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ spark                        │ 223         │ 30          │ 3                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ shenyu                       │ 200         │ 62          │ 3                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ arrow-rs                     │ 192         │ 30          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ datafusion-sqlparser-rs      │ 187         │ 61          │ 1                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ iceberg-go                   │ 154         │ 91          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ druid                        │ 130         │ 31          │ 14               │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ shardingsphere               │ 120         │ 89          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ mahout                       │ 118         │ 103         │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ skywalking-banyandb          │ 100         │ 15          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ doris                        │ 99          │ 100         │ 17               │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ grails-core                  │ 97          │ 44          │ 13               │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ ossie                        │ 92          │ 33          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ paimon                       │ 88          │ 18          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ rocketmq-dashboard           │ 85          │ 17          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ maven                        │ 80          │ 18          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ tomcat                       │ 76          │ 51          │ 2                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ gluten                       │ 70          │ 55          │ 25               │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ nuttx-apps                   │ 68          │ 22          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ pinot                        │ 68          │ 40          │ 1                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ superset-kubernetes-operator │ 64          │ 29          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ seatunnel                    │ 60          │ 57          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ texera                       │ 59          │ 62          │ 1                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ hudi                         │ 54          │ 30          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ mynewt-core                  │ 49          │ 12          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ maven-resolver               │ 45          │ 10          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ iceberg-python               │ 44          │ 16          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ camel                        │ 32          │ 25          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ ignite                       │ 30          │ 10          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ datafusion-ballista          │ 27          │ 12          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ accumulo                     │ 25          │ 10          │ 1                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ hbase                        │ 23          │ 10          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ aries                        │ 21          │ 17          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ fluss                        │ 20          │ 12          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ iceberg                      │ 16          │ 16          │ 3                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ hop                          │ 13          │ 10          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ iggy                         │ 10          │ 10          │ 0                │
├──────────────────────────────┼─────────────┼─────────────┼──────────────────┤
│ superset                     │ 9           │ 16          │ 85               │
└──────────────────────────────┴─────────────┴─────────────┴──────────────────┘

Over on Tika, we're also seeing > hour long queues. It felt like there was a change a bit more than two weeks ago. The lengthy queues cannot be attributed to post Community Over Code exuberance.

This is not good.

Thank you for opening this ticket.

Over on Tika, we're also seeing > hour long queues. It felt like there was a change a bit more than two weeks ago. The lengthy queues cannot be attributed to post Community Over Code exuberance.

I suspect it may be the fact that it is far easier than ever to make PRs via ai agents, and each PR often starts large amounts of CI

Also the new github stacks feature was released around Oct 6 (approximately the right timeline): https://github.blog/changelog/2026-10-06-stacked-pull-requests-generally-available/

And I found at least one example where a stack of PRs ended up running the full CI suite for each stacked PR each time the stack got rebased:

Add HTTP publication to the Dag processor manager airflow#74793

I don't have more data to back up that yet, but will keep searching

Here is another snapshot

Runner usage and queue across apache repos, snapshot 2026-10-21 12:45 UTC
(jobs are what the runner pool serves; a run fans out into many jobs)

┌─────────────────────────┬──────────────┬─────────────┬──────────────┬─────────────┐
│ Repo                    │ Running jobs │ Queued jobs │ Running runs │ Queued runs │
├─────────────────────────┼──────────────┼─────────────┼──────────────┼─────────────┤
│ airflow                 │ 188          │ ?           │ 15           │ 4           │
│ kvrocks                 │ 67           │ 0           │ 3            │ 0           │
│ fineract                │ 60           │ ?           │ 2            │ 1           │
│ iotdb                   │ 50           │ ?           │ 20           │ 7           │
│ dubbo                   │ 46           │ 0           │ 1            │ 0           │
│ gravitino               │ 40           │ 200         │ 29           │ 173         │
│ beam                    │ 39           │ ?           │ 22           │ 8           │
│ cloudstack              │ 30           │ ?           │ 9            │ 6           │
│ superset                │ 22           │ 8           │ 21           │ 13          │
│ kafka                   │ 21           │ ?           │ 9            │ 3           │
│ activemq                │ 20           │ ?           │ 13           │ 6           │
│ ozone                   │ 19           │ ?           │ 4            │ 1           │
│ datafusion-comet        │ 19           │ 0           │ 2            │ 0           │
│ paimon                  │ 15           │ 80          │ 3            │ 17          │
│ druid                   │ 13           │ 210         │ 2            │ 43          │
│ flink                   │ 11           │ 0           │ 1            │ 0           │
│ nifi                    │ 11           │ 0           │ 5            │ 0           │
│ groovy                  │ 10           │ 20          │ 3            │ 10          │
│ arrow                   │ 9            │ 0           │ 5            │ 0           │
│ spark                   │ 6            │ 147         │ 1            │ 25          │
│ gluten                  │ 6            │ 29          │ 6            │ 21          │
│ flink-agents            │ 6            │ ?           │ 1            │ 5           │
│ tika                    │ 5            │ 52          │ 6            │ 35          │
│ yunikorn-k8shim         │ 5            │ 0           │ 1            │ 0           │
│ doris                   │ 4            │ 439         │ 2            │ 428         │
│ grails-core             │ 4            │ 47          │ 6            │ 20          │
│ incubator-kie           │ 4            │ 19          │ 2            │ 14          │
│ doris-flink-connector   │ 4            │ ?           │ 3            │ 9           │
│ hop                     │ 3            │ 18          │ 2            │ 14          │
│ brpc                    │ 3            │ ?           │ 1            │ 9           │
│ camel                   │ 2            │ 107         │ 1            │ 70          │
│ fluss                   │ 2            │ 105         │ 2            │ 43          │
│ datafusion              │ 1            │ 123         │ 2            │ 61          │
│ tomcat                  │ 1            │ 64          │ 1            │ 43          │
│ hudi                    │ 1            │ 46          │ 1            │ 27          │
│ incubator-kie-tools     │ 1            │ 13          │ 1            │ 11          │
│ nuttx                   │ 0            │ 577         │ 1            │ 103         │
│ arrow-rs                │ 0            │ 446         │ 0            │ 160         │
│ opendal                 │ 0            │ 288         │ 0            │ 57          │
│ texera                  │ 0            │ 243         │ 1            │ 201         │
│ shenyu                  │ 0            │ 235         │ 0            │ 144         │
│ shardingsphere          │ 0            │ 144         │ 2            │ 63          │
│ iceberg-go              │ 0            │ 81          │ 0            │ 52          │
│ hugegraph-ai            │ 0            │ 78          │ 0            │ 32          │
│ ossie                   │ 0            │ 76          │ 0            │ 36          │
│ nuttx-apps              │ 0            │ 75          │ 0            │ 19          │
│ devlake                 │ 0            │ 69          │ 0            │ 55          │
│ datafusion-sqlparser-rs │ 0            │ 51          │ 0            │ 17          │
│ calcite                 │ 0            │ 50          │ 0            │ 10          │
│ ossie-converters        │ 0            │ 41          │ 1            │ 26          │
│ pinot                   │ 0            │ 40          │ 0            │ 26          │
│ syncope                 │ 0            │ 34          │ 0            │ 33          │
│ seatunnel               │ 0            │ 32          │ 0            │ 31          │
│ cassandra               │ 0            │ 31          │ 0            │ 19          │
│ hertzbeat               │ 0            │ 23          │ 0            │ 18          │
│ ofbiz-framework         │ 0            │ 21          │ 0            │ 16          │
│ rocketmq-clients        │ 0            │ 20          │ 0            │ 17          │
│ poi                     │ 0            │ ?           │ 0            │ 5           │
│ logging-log4j2          │ 0            │ ?           │ 0            │ 5           │
│ ignite                  │ 0            │ ?           │ 0            │ 9           │
│ tinkerpop               │ 0            │ ?           │ 0            │ 5           │
│ netbeans                │ 0            │ ?           │ 0            │ 7           │
│ streampipes             │ 0            │ ?           │ 0            │ 6           │
│ skywalking-banyandb     │ 0            │ ?           │ 0            │ 9           │
│ reqsign                 │ 0            │ ?           │ 0            │ 9           │
│ amoro                   │ 0            │ ?           │ 0            │ 6           │
│ fesod                   │ 0            │ ?           │ 0            │ 6           │
└─────────────────────────┴──────────────┴─────────────┴──────────────┴─────────────┘
Not shown: 96 repos with <5 running jobs, <10 queued jobs and <5 queued runs,
holding 13 running jobs and 186 queued runs in total.
Totals: running jobs 761 | queued jobs in scanned repos 4382 | queued runs 2515 | running runs 230

I spent some time on some more analytics this morning on how many runner minutes are used by different projects

Here is the data + script I used: Archive.zip

Note this only includes the github hosted runners (not the RunsOn runners):

My numbers show that airflow has used used 77.2 days of runner time in the last 17h

1000 runs of apache/airflow created between 2026-10-20T22:20:11Z and 2026-10-21T15:10:08Z (16.8 h window)
jobs loaded: 900 runs from cache, 98 from the API, 2 failed  (cache: gh-runner-usage-cache)

conclusion     jobs  share runner-min runner-days
success       12235  57.1%     111218        77.2
skipped        7424  34.7%          0         0.0
cancelled      1234   5.8%       5745         4.0
in_progress     274   1.3%          0         0.0
failure         186   0.9%       2304         1.6
queued           65   0.3%          0         0.0
total         21418            119267        82.8

average concurrent jobs over the window: 118

By comparison DataFusion only used 11.7 days of runner time in the last 2 days

1000 runs of apache/arrow-rs created between 2026-10-19T10:20:44Z and 2026-10-21T15:06:27Z (52.8 h window)
jobs loaded: 0 runs from cache, 1000 from the API, 0 failed  (cache: gh-runner-usage-cache)

conclusion     jobs  share runner-min runner-days
success        3492  69.7%      16846        11.7
skipped         913  18.2%          0         0.0
queued          327   6.5%          0         0.0
failure         141   2.8%        853         0.6
cancelled       125   2.5%       1946         1.4
in_progress      12   0.2%          0         0.0
total          5010             19645        13.6

average concurrent jobs over the window: 6

arrow-rs used 2.7 days over 17 hours

1000 runs of apache/datafusion created between 2026-10-20T22:07:51Z and 2026-10-21T15:13:03Z (17.1 h window)
warning: jobs for run 39541706327 failed: gh: Server Error (HTTP 502)
jobs loaded: 69 runs from cache, 930 from the API, 1 failed  (cache: gh-runner-usage-cache)

conclusion     jobs  share runner-min runner-days
skipped        1757  48.8%          0         0.0
success        1410  39.2%       3943         2.7
queued          212   5.9%          0         0.0
cancelled       184   5.1%       2762         1.9
failure          24   0.7%        140         0.1
neutral           7   0.2%          0         0.0
in_progress       5   0.1%          0         0.0
total          3599              6845         4.8

average concurrent jobs over the window: 7

There are also some great discussions in the ASF slack
https://the-asf.slack.com/archives/CBX4TSBQ8/p1792591324182189?thread_ts=1792520326.623569&cid=CBX4TSBQ8

That have come to the same conclusion

Thing that concerns me is https://docs.github.com/en/actions/reference/security/securely-using-pull_request_target#default-policy-for-pull_request_target

that disables pull_request_target even on public repos, which I believe also applicable for contributor forks

This is a migration example apache/spark-connect-swift#615

I wonder if GitHub will start blocking this pattern. Surely we're not only ones with so many PRs.

Yes, I see. We are feeling something similar in Arrow and DataFusion.

DataFusion only has 1200 contributors, but recently we have seen a deluge of PRs. Each new PR (including AI dumps) consumes a lot of PR time on the Apache shared runners Oh absolutely. This is what I proposed, including the design and 5-stacked PR implementing weeks ago only to get some PMC members respond, "if it's about saving time to others we do not care". And since then I spent a lot of time convincing people and pushing my way through so that it gets accepted - to the point that I **just** sent lazy consensus result about it. You can track the whole discussion there: https://lists.apache.org/thread.html/krl1bzszlfgfz70m494rm8jq1ph6dr01 Unfortunately, during the last few days while I was waiting for the lazy consensus to pass, we were somewhat frequently nudged, added to the mailing list threads, pointed in slakc and some issues were created. That was quite distracting to our work because we constantly had to constantly respond to such nudges, despite my explicit explanation to the people nudging us that we were working on it. This led me to worry that objectors might break the lazy consensus, further delaying things. It's sometimes very unproductive to try to motivate motivated people by nudging them. Each of us has an example of the manager coming every hour and asking "Are we there yet"? That distracts people and de-focuses them as we all know. Bad idea in general, especially if you tell "Working on it". And yet we have not seen any apology for those distractions. Luckily the consensus was not broken and we can proceed now.

left a comment (apache/datafusion#25088) <#25088 (comment)> On arrow <https://github.com/apache/arrow> we limit non-collaborators to 3 PR at a time. Will merge apache/arrow#55164 <apache/arrow#55164> once apache/infrastructure-asfyaml#135 <apache/infrastructure-asfyaml#135> is complete.

Oh absolutely again - I have proposed (or rather my Magpie skill that I created for that very purpose) in https://lists.apache.org/thread.html/6bgpcflsqow9b9b3r022yyf135m63352 - that you could replace your custom pull_request_target workfow with .asfyaml feature - that I not only contributed so that others (not only us) could use it but also developed and contributed the whole testing framework to infra that infra or anyone else can use to test .ASF YAML changes: apache/infrastructure-asfyaml#111 and apache/infrastructure-asfyaml#133 - because my PR for that waited for weeks. And yes - we limited PRs to 5 in Airflow. Some of our contributors had 30 PRs, but I convinced others in Airflow and drove the change (including closing 200 PRs that were exceessive and taking the pain of it). If not that pre-emptive move, we would likely have 15x more traffic today. Luckily - we acted on that without any nudging, because we care. And yes it also required getting to consensus: You can see lazy consensus here - and earlier discussions I had to navigate: https://lists.apache.org/thread.html/901dt9qdqjtqrh7ow5cdnd8sp0dl3llp BTW. My (or rather my skill's proposal that I sent yesterday) might help Arrow to use 30% - 40% less of ASF resources - and rather quickly. It also proposes you to get rid of pull_request targets. You can also implement more optimizations by following the infra page I just got merged today when I described all kinds of optimizations with examples (and links to the Magpie SKILL that will help your agent to do those optimizations very quickly) : https://infra.apache.org/github-actions-optimization.html. Some of those optimizations are basic and simple - and the 30% - 40% optimisation is mostly driven by switching push "complete builds" to "scheduled" canary builds we use in Airflow for 2 years now - this is one single optimization that helps busy repos like ours a lot. And yes you **MUST** get rid of all pull_request_target workflow by the end of November as they will just **stop working** ASF infra will **not** enable it for the organisation. It's far too dangerous of a footgun.. You can also refer to another document I wrote - where I explained one of the ways you can replace pull_request_target with much safer workflow: https://infra.apache.org/github-actions-policy.html - see "Safer replacement for pull_request_target" and examples - again, taken from Magpie where I tested and perfected it. I am glad we are all working in the same direction. And I think it would benefit all of us if we share finding easler - and not in the form "You are using too much resources - fix it immediately" repeated 7 times in a day when we are pretty advanced in solving that very problem, documenting it for others to follow - and hack - even developing tools that others can use to make their life easier, BTW. I REALLY heartily invite everyone to use Magpie - the "repo-health" family of skills - which includes "workflow optimisation skill" - does all the analysis and prepares improvement proposals that you can ask the agent to do for you. HEARTILY RECOMMEND. J, —

…

Reply to this email directly, view it on GitHub <#25088?email_source=notifications&email_token=AAERMI7KX53VPBTG6EYKNZD5VPABNA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTMMZXGQ2DMNRYHE4KM4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-6374466898>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAERMI645RHIZOVJ7QWE5TL5VPABNAVCNFSNUABFKJSXA33TNF2G64TZHMZTKOBZGE3TGMJYHNEXG43VMU5TKMZYHE2DEMBQGY4KC5QC> . You are receiving this because you were mentioned. On Fri, Oct 23, 2026 at 11:01 PM Oleks V ***@***.***> wrote: *comphead* left a comment (apache/datafusion#25088) <#25088 (comment)> Thing that concerns me is https://docs.github.com/en/actions/reference/security/securely-using-pull_request_target#default-policy-for-pull_request_target that disables pull_request_target even on public repos, which I believe also applicable for contributor forks — Reply to this email directly, view it on GitHub <#25088?email_source=notifications&email_token=AAERMI4HECYIR7BYVY4MEWD5VPBIZA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTMMZXGQ3DIMZUGI42M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-6374643429>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAERMI4FRWQ5YRLSCB5DQXL5VPBIZAVCNFSNUABFKJSXA33TNF2G64TZHMZTKOBZGE3TGMJYHNEXG43VMU5TKMZYHE2DEMBQGY4KC5QC> . You are receiving this because you were mentioned.Message ID: ***@***.***>

draft to migrate to workflow_run similar to what Apache Spark currently has #26683

draft to migrate to workflow_run similar to what Apache Spark currently

has #26683 <#26683> Yep. That is implementation of the design pattern from https://infra.apache.org/github-actions-policy.html I proposed :). I am happy it spreads organically :D J.

…

On Fri, Oct 23, 2026 at 11:25 PM Oleks V ***@***.***> wrote: *comphead* left a comment (apache/datafusion#25088) <#25088 (comment)> draft to migrate to workflow_run similar to what Apache Spark currently has #26683 <#26683> — Reply to this email directly, view it on GitHub <#25088?email_source=notifications&email_token=AAERMI2OLAPZMZXXY65ZGST5VPEGPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTMMZXGUYDINRSGA32M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-6375046207>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAERMI2SZDPH3LTWNWQOORD5VPEGPAVCNFSNUABFKJSXA33TNF2G64TZHMZTKOBZGE3TGMJYHNEXG43VMU5TKMZYHE2DEMBQGY4KC5QC> . You are receiving this because you were mentioned.Message ID: ***@***.***>

And I just realised I missed one 0... We have 4000 contributors :D

…

On Fri, Oct 23, 2026 at 11:28 PM Jarek Potiuk ***@***.***> wrote: > draft to migrate to workflow_run similar to what Apache Spark currently has #26683 <#26683> Yep. That is implementation of the design pattern from https://infra.apache.org/github-actions-policy.html I proposed :). I am happy it spreads organically :D J. On Fri, Oct 23, 2026 at 11:25 PM Oleks V ***@***.***> wrote: > *comphead* left a comment (apache/datafusion#25088) > <#25088 (comment)> > > draft to migrate to workflow_run similar to what Apache Spark currently > has #26683 <#26683> > > — > Reply to this email directly, view it on GitHub > <#25088?email_source=notifications&email_token=AAERMI2OLAPZMZXXY65ZGST5VPEGPA5CNFSNUABFM5UWIORPF5TWS5BNNB2WEL2JONZXKZKDN5WW2ZLOOQXTMMZXGUYDINRSGA32M4TFMFZW63VHNVSW45DJN5XKKZLWMVXHJLDGN5XXIZLSL5RWY2LDNM#issuecomment-6375046207>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AAERMI2SZDPH3LTWNWQOORD5VPEGPAVCNFSNUABFKJSXA33TNF2G64TZHMZTKOBZGE3TGMJYHNEXG43VMU5TKMZYHE2DEMBQGY4KC5QC> > . > You are receiving this because you were mentioned.Message ID: > ***@***.***> >

This morning it looks like the airflow usage is down significantly and we are able to merge PRs much more quickly in DataFusion; This is feeling better

andrewlamb@Andrews-MacBook-Pro-3:~/Downloads$ python3 usage.py --time 1d apache/airflow
859 runs of apache/airflow created since 2026-10-23T11:37:49Z (24.0 h window)
warning: jobs for run 39999413864 failed: gh: Server Error (HTTP 502)
jobs loaded: 640 runs from cache, 218 from the API, 1 failed  (cache: gh-runner-usage-cache)

                             github               self-hosted
conclusion     jobs   share     mins (days)   share     mins (days)
success        8530   96.8%    73603 (51.1)       -         0 (0.0)
failure          61    1.1%       815 (0.6)       -         0 (0.0)
in_progress      36    0.0%         0 (0.0)       -         0 (0.0)
queued            2    0.0%         0 (0.0)       -         0 (0.0)
cancelled       818    2.1%      1589 (1.1)       -         0 (0.0)
skipped        6846    0.0%         0 (0.0)       -         0 (0.0)
total         16293            76008 (52.8)                 0 (0.0)

@shahar1

Yes. During the weekend we have significantly less PRs from maintainers - and we do not have that much release work happening.

Also some improvements we have been working on are already in place - we just now wait for https://issues.apache.org/jira/browse/INFRA-28575 (or https://issues.apache.org/jira/browse/INFRA-28572 which @shahar1 created yesterday needs to be solved. We do not have an option in .asf.yaml to enable immutable ids for repos - and our repo was created 10 years ago so we need to enable it - and it's more secure to have it. I created and tested apache/infrastructure-asfyaml#141 to allow to self-manage it as well.

Upvotes / comments in the JIRA are highly appreciated.

BTW. Our (stacked - 5 PRS) "Your PR, Your CI" is also going through last round of reviews apache/airflow#74825 and I hope we merge it today and start piloting moving some volunteer contributors to be switched to it to test things out (after our testing of course). I believe Arrow had (and still has ?) some issues with their CI after they switched to "use runners of contributors" so we definitely do not want to rush it with 400 PRs a week.

@sdf-jkl

I believe Arrow had (and still has ?) some issues with their CI after they switched to "use runners of contributors" so we definitely do not want to rush it with 400 PRs a week.

The DataFusion version is working well for the last week or so (though it took us a while to refine it)

ci: run the Rust workflow for fork pull requests on the fork #25591

I do think @sdf-jkl is still refining our arrow-rs PR:

Run fork PR test suites in contributor forks arrow-rs#11788 (comment)

Our version in Airflow (and one that will hopefully turn into reusable action set) - is way more sophisticated. We aim for practically no change in the workflow from the maintainer / contributor point of view:

we will post instructions for the contributors who have their fork workflow's disabled (which is the default) - when they do not have tehme
we automatically will approve workflow for external contributors that are safe - but those workflow will do nothing for them - they will just quit after first check and succeed
however we have a scheduled workflow that will monitor the remotely run "push" actions and will mirror their statuses to the PR - so the PR will look as if the PR is running - also links from those status messages will link to the jobs running in the contributor's workflows.
We will be able to control who can and who cannot use the runners in ASF - by default, Airflow maintainers, but we will also enable our stakeholders who use their own "organisation" forks to use them + we will be able to selectively give access to specific users.

The PR's status will be also set depending on the status of the fork run.

This all will be done via scheduled workflow that will check and update status for such open PRs. Generally we aim for practically 0 change in how you interact with GH PRs via UI. This all shoudl work - no need (such as in rust workflow) for contributors to post their workflow run links - and even know that something changed.

Once they enable the workflows in their fork - things will work for them "as usual" (with little delay on refreshing status of their jobs to the PR).

Once I get it into reusable action, maybe you could try to switch to it. I will post it here once I have it.

We aim for practically no change in the workflow from the maintainer / contributor point of view:

i think this is basically what arrow and datafusion have also achieved. The only difference is the contributor needs to enable workflows on their fork

@alamb

Cool - I saw workflow-runs not started - but possibly it was before

So maybe @alamb -> YOU would like to make it a shared action from datafusion - I am happy to review and approve new actions in https://github.com/apache/infrastructure-actions - where shared actions for ASF projects are added.

People seem to be interested - and you seem to have quite a bit more generic option in your PR that will be easier to make generic?

I think that would help others.

I did it for the "pull_request_target" replacement (doc-only) and few other actions and it seems that other ASF projects are picking it up - so it might be a good idea to use the opportunity when they need it.

Happy to promote it among others.

Navigation Menu

Repository navigation

CI takes hours to start #25088

Describe the bug

Additional context

19 remaining items

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

CI takes hours to start #25088

Description

Describe the bug

Additional context

Activity

blaginin commented on Sep 8, 2026

alamb commented on Sep 8, 2026

alamb commented on Sep 10, 2026

alamb commented on Oct 20, 2026

alamb commented on Oct 20, 2026

mbutrovich commented on Oct 20, 2026

alamb commented on Oct 20, 2026

tballison commented on Oct 21, 2026

alamb commented on Oct 21, 2026

alamb commented on Oct 21, 2026

alamb commented on Oct 21, 2026

alamb commented on Oct 21, 2026

19 remaining items

comphead commented on Oct 23, 2026

comphead commented on Oct 23, 2026

rok commented on Oct 23, 2026

potiuk commented on Oct 23, 2026

comphead commented on Oct 23, 2026

potiuk commented on Oct 23, 2026

potiuk commented on Oct 23, 2026

alamb commented on Oct 24, 2026

potiuk commented on Oct 24, 2026

potiuk commented on Oct 24, 2026

alamb commented on Oct 24, 2026

potiuk commented on Oct 24, 2026

alamb commented on Oct 24, 2026

potiuk commented on Oct 24, 2026

potiuk commented on Oct 24, 2026

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions