macOS multi-machine pool: shadow fails with errno 65

[Katie Markovich]

Hello,

I am not new to HTCondor as a user, but this is my first time setting up HTCondor. I have several Mac Minis (Apple silicon, so having to run HTCondor 25.11.0 x86_64 using Rosetta) that I want to build a multi-machine pool with. I set up a head node (CM + submit) and one worker on a private LAN and attempted to run a test job. 

Collector, negotiator, and schedd communication work normally. The shadow starts and communicates with schedd fine, but then it gets the following error: 

attempt to connect to <ip:port> failed: No route to host (connect errno = 65).

nc and bash /dev/tcp both connect successfully from head node to worker as root and as condor user. The routing table shows correct route and there are no firewall rules. Is this a known issue with Rosetta? Is there a workaround or a native ARM build planned?

Any help would be greatly appreciated. 

Thanks,

Katie

[Jaime Frey]

A networking failure in the shadow is odd. That means the startd on the worker is able to connect to the head node (to advertise to the collector) and the schedd on the head node is able to connect to the startd on the worker (to claim the slot before launching the shadow). Do both the IP address and port number in the error message match that of the startd on the worker?

I’d be surprised if this is an issue with Rosetta. We haven’t heard of any issues in that regard.
A native ARM release is on our todo list, but with no schedule. The code builds on ARM just fine, if you want to try producing your own binaries for testing.

- Jaime

[Luehring, Frederick C]

Hey Jaime,

Apple is ending Rosetta support - see https://support.apple.com/en-us/102527. The bottom line is that after the next major release (MacOS 27 / Golden Gate), Rosetta will be largely no longer supported except for a few game apps.

So ARM binaries probably need to be bumped up in priority...

Fred

--
Frederick Luehring lueh...@iu.edu +1 812 855 1025 IU
Indiana U. HEP Fred.L...@cern.ch +41 22 767 11 66 CERN

[Katherine Markovich]

Thanks for the heads up, Fred. And thanks Jaime for the tip that ARM builds fine from source. I was able to build my own bins and everything is running smoothly now! (I am not sure what was causing that shadow error, as it resolved prior to the ARM build).

Thanks,

Katie

--
Archives for older messages are found at https://www-auth.cs.wisc.edu/lists/htcondor-users/
---
You received this message because you are subscribed to a topic in the Google Groups "HTCondor Users" group.
To unsubscribe from this topic, visit https://groups.google.com/a/g-groups.wisc.edu/d/topic/htcondor-users/vsM0VsiDhVY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to htcondor-user...@g-groups.wisc.edu.
To view this discussion visit https://groups.google.com/a/g-groups.wisc.edu/d/msgid/htcondor-users/2571fd81-cd84-455e-9ad2-d4d789480ae0%40iu.edu.