Skip to content

[SPARK-56710][INFRA] branch-4.x and branch-4.2 scheduled CI, snapshots, and build_and_test Python split#55662

Closed
HyukjinKwon wants to merge 1 commit into
apache:masterfrom
HyukjinKwon:SPARK-56710
Closed

[SPARK-56710][INFRA] branch-4.x and branch-4.2 scheduled CI, snapshots, and build_and_test Python split#55662
HyukjinKwon wants to merge 1 commit into
apache:masterfrom
HyukjinKwon:SPARK-56710

Conversation

@HyukjinKwon
Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Scheduled GitHub workflows for branch-4.x and branch-4.2, snapshot matrix + README badges, build_and_test for (branch-4.2/branch-4.x vs branch-4.1), small merge_spark_pr.py updates.

Why are the changes needed?

Spark 4 cut new integration/maintenance branches; CI and snapshots should track them without hand-editing workflow inputs.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Manually tested some logics. CI will be monitored separately.

Was this patch authored or co-authored using generative AI tooling?

No,

@HyukjinKwon HyukjinKwon requested review from LuciferYang, dongjoon-hyun, huaxingao and zhengruifeng and removed request for LuciferYang and dongjoon-hyun May 3, 2026 22:50
@HyukjinKwon HyukjinKwon force-pushed the SPARK-56710 branch 3 times, most recently from 3fa6323 to 3930e48 Compare May 3, 2026 22:55
@HyukjinKwon
Copy link
Copy Markdown
Member Author

Will merge and see how things go

@HyukjinKwon
Copy link
Copy Markdown
Member Author

Merged to master.

# under the License.
#

name: "Build / Python-only (branch-4.2, PyPy 3.10)"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems that this was mistakenly because PyPy retired at Spark 4.2.0 officially.

# under the License.
#

name: "Build / Python-only (branch-4.x, PyPy 3.10)"
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dongjoon-hyun
Copy link
Copy Markdown
Member

@HyukjinKwon
Copy link
Copy Markdown
Member Author

thanks!

dongjoon-hyun added a commit that referenced this pull request May 17, 2026
…3.10.yml`

### What changes were proposed in this pull request?

This PR aims to remove PyPy from `branch-4.x` and `branch-4.2` CIs because we retired it at Apache Spark 4.2.0 already.
- #54988

### Why are the changes needed?

These two CIs seem to be added later to follow `branch-4.1` style, but `branch-4.x` and `branch-4.2` should be consistent from `master` branch when it comes to `PyPy`.
- #55662

We don't need this test coverage from Apache Spark 4.2+. This removal will save our test infra resources.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Manual review.

### Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Code

Closes #55918 from dongjoon-hyun/SPARK-56710.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants