Experience with very slow SaltStack performance, solution and propose to preventive fix

[Oleg Tsarev]

Hello guys,

I investigated reason of very slow SaltStack works.
As result I changed

time salt '*' state.highstate from 4 minutes (!!!) to 8 seconds.

Reason was very unoptimal work with DNS.
I made error in config for dnscache, as result all request to my internal development zone walk over dnscache => root DNS server => registrator => my gateway with DNS proxy => tinydns

After fix query walk over dnscache => tinydns (local networks).

What interesting: option "dns_cache: False" in salt minion and master does NOT help.

Salt everycase lookup FQDN over DNS.

I propose to investigate reason of very slow SaltStack work.

So, reproduction is simple: just hack your DNS to works slowly and see dramatically performance degradation.

Best regards, Oleg

[ol...@oleg.sh]

https://github.com/saltstack/salt/issues/12246

[Colton Myers]

Thanks for filing the issue!

--

Colton Myers

--
You received this message because you are subscribed to the Google Groups "Salt-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to salt-users+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.