GH-47923: [CI] Use macos-15-intel instead of macos-13 for macOS x86 runner #47690

kevinjqliu · 2025-10-03T04:02:30Z

Rationale for this change

macos-13 github runners are https://github.blog/changelog/2025-09-19-github-actions-macos-13-runner-image-is-closing-down/

This PR replaces macos-13 with macos-15-intel based on recommendations here

What changes are included in this PR?

Change all references of macos-13 to macos-15-intel

Are these changes tested?

Yes, CI

Are there any user-facing changes?

No.

GitHub Issue: [CI] GitHub is deprecating macos-13 runners #47923

github-actions · 2025-10-03T04:03:06Z

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

See also:

raulcd

Thanks @kevinjqliu for giving this a try!

raulcd · 2025-10-03T14:32:33Z

dev/tasks/r/github.packages.yml

      matrix:
        platform:
-          - { runs_on: macos-13, arch: "x86_64" }
+          - { runs_on: macos-latest, arch: "arm64" }


we still want to test with x86_64 architecture we probably should use the new macos-15-intel runners, see:
https://github.com/actions/runner-images?tab=readme-ov-file#available-images

yes good catch! ty

raulcd · 2025-10-13T14:28:14Z

@github-actions crossbow submit wheel-macos-monterey-*-amd64 verify-rc-source-macos

github-actions · 2025-10-13T14:36:36Z

Revision: a9ffb5b

Submitted crossbow builds: ursacomputing/crossbow @ actions-9c62fc0d9f

Task	Status
verify-rc-source-cpp-macos-amd64
verify-rc-source-cpp-macos-arm64
verify-rc-source-cpp-macos-conda-amd64
verify-rc-source-integration-macos-amd64
verify-rc-source-integration-macos-arm64
verify-rc-source-integration-macos-conda-amd64
verify-rc-source-python-macos-amd64
verify-rc-source-python-macos-arm64
verify-rc-source-python-macos-conda-amd64
verify-rc-source-ruby-macos-amd64
verify-rc-source-ruby-macos-arm64
wheel-macos-monterey-cp310-cp310-amd64
wheel-macos-monterey-cp311-cp311-amd64
wheel-macos-monterey-cp312-cp312-amd64
wheel-macos-monterey-cp313-cp313-amd64
wheel-macos-monterey-cp313-cp313t-amd64

raulcd · 2025-10-23T16:42:24Z

The macOS wheels seem to be failing due to mono being missing:

 error: Could not fetch mono. You may be able to install this tool via your system package manager (brew install mono).
note: updating vcpkg by rerunning bootstrap-vcpkg may resolve this failure.
arrow/ci/scripts/install_vcpkg.sh: line 79: Successfully: command not found

We could try adding mono here, even though we probably want to fix it on the ci/scripts/install_vcpkg.sh script:

diff --git a/dev/tasks/python-wheels/github.osx.yml b/dev/tasks/python-wheels/github.osx.yml
index ef8e90f412..9493dc1c3d 100644
--- a/dev/tasks/python-wheels/github.osx.yml
+++ b/dev/tasks/python-wheels/github.osx.yml
@@ -51,7 +51,7 @@ jobs:
 
       - name: Install System Dependencies
         run: |
-          brew install bash bison coreutils ninja
+          brew install bash bison coreutils ninja mono
           echo "$(brew --prefix bison)/bin" >> $GITHUB_PATH
 
       - name: Homebrew packages

There are also some Python failures which I am unsure if they are related or they were fixed in the past. Could you rebase and I'll trigger again the verify-rc-source-python-macos-* jobs?

raulcd

Thanks @kevinjqliu for this. Will you have some time to follow up the CI failures? Otherwise I can try to take some time later on

github-actions · 2025-10-23T16:44:36Z

⚠️ GitHub issue #47923 has been automatically assigned in GitHub to PR creator.

kevinjqliu · 2025-10-25T22:16:33Z

Failed to verify release candidate. See /tmp/arrow-22.0.0.Zix5U for details.

for the 2 failed "Verify RC / APIT" tests

The C++ and Python failures are due to 1 failed test

raulcd · 2025-10-27T09:06:29Z

@github-actions crossbow submit verify-rc-source-python-macos-*

raulcd · 2025-10-27T09:06:49Z

@github-actions crossbow submit wheel-macos-monterey-cp310-cp310-amd64

kou

Hmm... They aren't failed on main: https://lists.apache.org/thread/svj4vv6ot6yj9b5qgydcjrbzps3g957z

verify-rc-source-python-macos-amd64
https://github.com/ursacomputing/crossbow/actions/runs/18908687876/job/53973259662

verify-rc-source-python-macos-arm64
https://github.com/ursacomputing/crossbow/actions/runs/18908688967/job/53973263778

Could you rebase on main?

And could you update the PR description before we merge this? We'll use the PR description for commit message.

dev/tasks/python-wheels/github.osx.yml

kevinjqliu · 2025-10-30T02:23:32Z

rebased origin/main and updated the PR description

github-actions · 2025-10-30T02:23:32Z

⚠️ GitHub issue #47923 has been automatically assigned in GitHub to PR creator.

raulcd · 2025-10-30T11:10:42Z

@github-actions crossbow submit verify-rc-source-python-macos-*

github-actions · 2025-10-30T11:13:19Z

Revision: 6bdc0cf

Submitted crossbow builds: ursacomputing/crossbow @ actions-e7168bd48b

Task	Status
verify-rc-source-python-macos-amd64
verify-rc-source-python-macos-arm64
verify-rc-source-python-macos-conda-amd64

raulcd

I found what the problem is on those jobs and is unrelated to the changes. The problem is with the fork.
PyArrow is being generated with the wrong version (hence triggering some old behavior on pandas). See:
pyarrow-12.0.0.dev5006+g6bdc0cf07
This is because the fork is missing the tags for the newer Arrow releases and it's unable to generate the correct version.

This is related to:

#44803

I realized when I created a different PR to try and understand the failure. I decided to cherry-pick the exact same 4 commits that are on this PR on top of current main and my testing PR was able to run all the verification jobs successfully:
#48007

That's when I tried to understand what was the difference with the remote.

I am happy to merge this.

kou · 2025-10-31T21:24:30Z

Ah, it make sense.

@kevinjqliu Could you push tags in apache/arrow to your fork by git push --tags origin? Then we'll re-run the failed jobs.

Co-authored-by: Sutou Kouhei <[email protected]>

kevinjqliu · 2025-11-02T00:33:59Z

pushed all the tags to my fork, rebased one more time for good measure. thanks!

kou · 2025-11-02T05:19:00Z

@github-actions crossbow submit verify-rc-source-python-macos-*

github-actions · 2025-11-02T05:21:18Z

Revision: e274f39

Submitted crossbow builds: ursacomputing/crossbow @ actions-5df507d974

Task	Status
verify-rc-source-python-macos-amd64
verify-rc-source-python-macos-arm64
verify-rc-source-python-macos-conda-amd64

kou

+1

Passed. Let's merge this.

github-actions · 2025-11-02T06:38:36Z

⚠️ GitHub issue #47923 has been automatically assigned in GitHub to PR creator.

conbench-apache-arrow · 2025-11-02T15:18:44Z

After merging your PR, Conbench analyzed the 0 benchmarking runs that have been run so far on merge-commit 44f82a4.

None of the specified runs were found on the Conbench server.

The full Conbench report has more details.

kevinjqliu requested review from assignUser, jonkeane, kou and raulcd as code owners October 3, 2025 04:02

github-actions bot added the awaiting review Awaiting review label Oct 3, 2025

raulcd reviewed Oct 3, 2025

View reviewed changes

github-actions bot added awaiting changes Awaiting changes and removed awaiting review Awaiting review labels Oct 3, 2025

kevinjqliu force-pushed the kevinjqliu/macos-13-is-deprecated branch from a3e410b to c61c40c Compare October 4, 2025 21:44

kevinjqliu requested a review from raulcd October 4, 2025 21:45

github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Oct 4, 2025

kevinjqliu force-pushed the kevinjqliu/macos-13-is-deprecated branch from c61c40c to a9ffb5b Compare October 4, 2025 21:46

raulcd mentioned this pull request Oct 23, 2025

[CI] GitHub is deprecating macos-13 runners #47923

Closed

raulcd reviewed Oct 23, 2025

View reviewed changes

raulcd changed the title ~~infra: macos-13 is deprecated~~ GH-47923: [CI] macos-13 runners are deprecated Oct 23, 2025

github-actions bot added awaiting changes Awaiting changes and removed awaiting change review Awaiting change review labels Oct 23, 2025

kevinjqliu force-pushed the kevinjqliu/macos-13-is-deprecated branch from a9ffb5b to 8990f06 Compare October 25, 2025 00:31

github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Oct 25, 2025

kevinjqliu force-pushed the kevinjqliu/macos-13-is-deprecated branch from 8990f06 to 3c4b2a4 Compare October 25, 2025 16:40

github-actions bot added the awaiting merge Awaiting merge label Oct 29, 2025

kou reviewed Oct 30, 2025

View reviewed changes

dev/tasks/python-wheels/github.osx.yml Outdated Show resolved Hide resolved

github-actions bot added awaiting changes Awaiting changes and removed awaiting merge Awaiting merge labels Oct 30, 2025

kevinjqliu force-pushed the kevinjqliu/macos-13-is-deprecated branch from 324171a to 6bdc0cf Compare October 30, 2025 02:19

github-actions bot added awaiting change review Awaiting change review and removed awaiting changes Awaiting changes labels Oct 30, 2025

raulcd approved these changes Oct 31, 2025

View reviewed changes

github-actions bot added awaiting merge Awaiting merge and removed awaiting change review Awaiting change review labels Oct 31, 2025

kevinjqliu and others added 4 commits November 1, 2025 17:33

replace macos-13 with macos-15-intel

91b75f6

macos-version, 13 -> 15-intel

a71312f

add mono

5beab2d

Update dev/tasks/python-wheels/github.osx.yml

e274f39

Co-authored-by: Sutou Kouhei <[email protected]>

kevinjqliu force-pushed the kevinjqliu/macos-13-is-deprecated branch from 6bdc0cf to e274f39 Compare November 2, 2025 00:33

kou approved these changes Nov 2, 2025

View reviewed changes

kou changed the title ~~GH-47923: [CI] macos-13 runners are deprecated~~ GH-47923: [CI] Use macos-15-intel instead of macos-13 for macOS x86 runner Nov 2, 2025

kou merged commit 44f82a4 into apache:main Nov 2, 2025
38 of 43 checks passed

kou removed the awaiting merge Awaiting merge label Nov 2, 2025

kevinjqliu deleted the kevinjqliu/macos-13-is-deprecated branch November 3, 2025 01:14

GH-47923: [CI] Use macos-15-intel instead of macos-13 for macOS x86 runner #47690

GH-47923: [CI] Use macos-15-intel instead of macos-13 for macOS x86 runner #47690

Uh oh!

Conversation

kevinjqliu commented Oct 3, 2025 • edited by kou Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Uh oh!

github-actions bot commented Oct 3, 2025

Uh oh!

raulcd left a comment

Choose a reason for hiding this comment

Uh oh!

raulcd Oct 3, 2025

Choose a reason for hiding this comment

Uh oh!

kevinjqliu Oct 4, 2025

Choose a reason for hiding this comment

Uh oh!

raulcd commented Oct 13, 2025

Uh oh!

github-actions bot commented Oct 13, 2025

Uh oh!

raulcd commented Oct 23, 2025

Uh oh!

raulcd left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot commented Oct 23, 2025

Uh oh!

kevinjqliu commented Oct 25, 2025

Uh oh!

raulcd commented Oct 27, 2025

Uh oh!

raulcd commented Oct 27, 2025

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kevinjqliu commented Oct 30, 2025

Uh oh!

github-actions bot commented Oct 30, 2025

Uh oh!

raulcd commented Oct 30, 2025

Uh oh!

github-actions bot commented Oct 30, 2025

Uh oh!

raulcd left a comment

Choose a reason for hiding this comment

Uh oh!

kou commented Oct 31, 2025

Uh oh!

kevinjqliu commented Nov 2, 2025

Uh oh!

kou commented Nov 2, 2025

Uh oh!

github-actions bot commented Nov 2, 2025

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot commented Nov 2, 2025

Uh oh!

conbench-apache-arrow bot commented Nov 2, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

kevinjqliu commented Oct 3, 2025 •

edited by kou

Loading