latest macos-14-arm64 image regressed our build

[mlfarrell]

Description

Build environment broken. We currently have no mitigation for this.

New errors in a dependency that is pinned. Was building fine on previous image just today

In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.cpp:44:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.h:46:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/GenericProperty.h:50:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/Hash.h:51:
  /opt/homebrew/bin/../include/c++/v1/cmath:544:5: error: use of undeclared identifier '__promote'
      __promote<_A1, _A2, _A3>
      ^
  /opt/homebrew/bin/../include/c++/v1/cmath:548:22: error: no template named '__promote'
      typedef typename __promote<_A1, _A2, _A3>::type __result_type;
                       ^
  /opt/homebrew/bin/../include/c++/v1/cmath:552:12: error: call to 'hypot' is ambiguous
      return hypot((__result_type)__lcpp_x, (__result_type)__lcpp_y, (__result_type)__lcpp_z);
             ^~~~~
  /opt/homebrew/bin/../include/c++/v1/cmath:533:46: note: candidate function
  inline _LIBCPP_INLINE_VISIBILITY float       hypot(       float __x,       float __y,       float __z ) { return sqrt(__x*__x + __y*__y + __z*__z); }
                                               ^
  /opt/homebrew/bin/../include/c++/v1/cmath:534:46: note: candidate function
  inline _LIBCPP_INLINE_VISIBILITY double      hypot(      double __x,      double __y,      double __z ) { return sqrt(__x*__x + __y*__y + __z*__z); }
                                               ^
  /opt/homebrew/bin/../include/c++/v1/cmath:535:46: note: candidate function
  inline _LIBCPP_INLINE_VISIBILITY long double hypot( long double __x, long double __y, long double __z ) { return sqrt(__x*__x + __y*__y + __z*__z); }
                                               ^
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.cpp:44:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.h:46:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/GenericProperty.h:50:
  /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/Hash.h:99:25: error: use of undeclared identifier 'abs'; did you mean 'fabs'?
                  hash ^= abs(data[sizeof(uint16_t)]) << 18;
                          ^
  /Applications/Xcode_15.4.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/math.h:418:15: note: 'fabs' declared here
  extern double fabs(double);

Platforms affected

• Azure DevOps
• GitHub Actions - Standard Runners
• GitHub Actions - Larger Runners

Runner images affected

• Ubuntu 22.04
• Ubuntu 24.04
• Ubuntu Slim
• macOS 14
• macOS 14 Arm64
• macOS 15
• macOS 15 Arm64
• macOS 26
• macOS 26 Arm64
• Windows Server 2022
• Windows Server 2025
• Windows Server 2025 with Visual Studio 2026

Image version and build link

private repo

Is it regression?

yes

Expected behavior

Build does not fail

Actual behavior

In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.cpp:44:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.h:46:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/GenericProperty.h:50:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/Hash.h:51:
  /opt/homebrew/bin/../include/c++/v1/cmath:544:5: error: use of undeclared identifier '__promote'
      __promote<_A1, _A2, _A3>
      ^
  /opt/homebrew/bin/../include/c++/v1/cmath:548:22: error: no template named '__promote'
      typedef typename __promote<_A1, _A2, _A3>::type __result_type;
                       ^
  /opt/homebrew/bin/../include/c++/v1/cmath:552:12: error: call to 'hypot' is ambiguous
      return hypot((__result_type)__lcpp_x, (__result_type)__lcpp_y, (__result_type)__lcpp_z);
             ^~~~~
  /opt/homebrew/bin/../include/c++/v1/cmath:533:46: note: candidate function
  inline _LIBCPP_INLINE_VISIBILITY float       hypot(       float __x,       float __y,       float __z ) { return sqrt(__x*__x + __y*__y + __z*__z); }
                                               ^
  /opt/homebrew/bin/../include/c++/v1/cmath:534:46: note: candidate function
  inline _LIBCPP_INLINE_VISIBILITY double      hypot(      double __x,      double __y,      double __z ) { return sqrt(__x*__x + __y*__y + __z*__z); }
                                               ^
  /opt/homebrew/bin/../include/c++/v1/cmath:535:46: note: candidate function
  inline _LIBCPP_INLINE_VISIBILITY long double hypot( long double __x, long double __y, long double __z ) { return sqrt(__x*__x + __y*__y + __z*__z); }
                                               ^
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.cpp:44:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/code/Common/BaseProcess.h:46:
  In file included from /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/GenericProperty.h:50:
  /Users/runner/work/engine/engine/target/_deps/assimp/include/assimp/Hash.h:99:25: error: use of undeclared identifier 'abs'; did you mean 'fabs'?
                  hash ^= abs(data[sizeof(uint16_t)]) << 18;
                          ^
  /Applications/Xcode_15.4.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX.sdk/usr/include/math.h:418:15: note: 'fabs' declared here
  extern double fabs(double);

Repro steps

private repo. no reprod. sorry

[sfod]

Similar issues are happening in our CI. On the latest versions of macos-14 and macos-14-arm64 we have compilation errors that Security Framework entities are not declared:

aws-c-io/aws-c-io/source/darwin/darwin_pki_utils.c:65:9:
        error: use of undeclared identifier 'SecExternalFormat'

, even with the required header file directly included (so, it's not a transitive dependency issue).

On the previous image versions, the default compiler was /usr/bin/clang (I assume it's xcode provided).
In the new images it's /usr/local/bin/clang on macos-14 and /opt/homebrew/bin/clang on macos-14-arm64. I.e. installed via homebrew.
Probably that's the cause.

Edit: seems related to #13827

[mlfarrell]

Yea something looked off to me when I saw it not using Xcode’s clang

[Benjamin-Dobell]

Also seeing similar issues on macos-latest i.e. incorrectly using Homebrew's clang:
https://github.com/godotjs/GodotJS/actions/runs/23306814318/job/67783283596

EDIT: It's working now. Were new runners deployed?

[v-GeorgyPuzakov]

Hi @mlfarrell,
Probably, it is retailed with new version. We will check and will back to you

[HMRWork42]

Yes, I found similar issue in my follow up to #13817 (which is related to and marked as duplicate as #13827 ) - the runners aren't the same, I was relaunching 3, and two picked up the older image, while a 3rd got the newer/broken image. re-running the 3rd picked up the older image. I don't know how many runner instances there are, but they seem not be identical... i.e. if you re-run after a while, you might get lucky.