Salt 3007.1 minion reporting sync errors (timeouts)

[Jeff Vincent]

I have recently deployed using terraform two ubuntu 22.04 salt minions in Google cloud.  Both are running salt v3007.1 as is the salt master. 

On one of the minions, when I run a state.highstate, I see the errors below.  I've manually removed and reinstalled salt-minion/salt-common and have fully patched the OS but continue to see these issues.  

It doesn't happen on the other minion and I'm stumped and could used some other ideas of what to look for.  Thanks!

[ERROR   ] Failed to sync clouds module: File client timed out after 180 seconds
[ERROR   ] Failed to sync beacons module: File client timed out after 180 seconds
[ERROR   ] Failed to sync modules module: File client timed out after 180 seconds
[ERROR   ] Failed to sync states module: File client timed out after 180 seconds
[ERROR   ] Failed to sync sdb module: File client timed out after 180 seconds
[ERROR   ] Failed to sync grains module: File client timed out after 180 seconds
[ERROR   ] Failed to sync renderers module: File client timed out after 180 seconds
[ERROR   ] Failed to sync returners module: File client timed out after 180 seconds
[ERROR   ] Failed to sync output module: File client timed out after 180 seconds
[ERROR   ] Failed to sync utils module: File client timed out after 180 seconds
[ERROR   ] Failed to sync log_handlers module: File client timed out after 180 seconds
[ERROR   ] Failed to sync executors module: File client timed out after 180 seconds
[ERROR   ] Failed to sync proxy module: File client timed out after 180 seconds
[ERROR   ] Failed to sync engines module: File client timed out after 180 seconds
[ERROR   ] Failed to sync thorium module: File client timed out after 180 seconds
[ERROR   ] Failed to sync serializers module: File client timed out after 180 seconds
[ERROR   ] Failed to sync matchers module: File client timed out after 180 seconds

[Jeff]

It may go without saying, but the highstate call takes forever with all these 180 second timeouts.

--
You received this message because you are subscribed to the Google Groups "Salt-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to salt-users+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/salt-users/34e94295-4e56-4c38-99f1-0831dbd1e7dbn%40googlegroups.com.

[Phipps, Thomas]

Check the /var/cache/salt/minion directory and make sure the minion can read/write from it. or if you have cachedir pointed somewhere else make sure it is read/writable by the minion.

also. turn up the logging. since the minion is failing at something so big try salt-call -l all state.apply

--