Hello,
I have started using salt, and when I try to perform a yum update from the master to the targeted minion, I do not get any response from either the minion or the master. Can you guys please help me on this?
Also I run the master and the minion on AWS.
Minion Version: salt-minion 2015.5.8 (Lithium)
Master Version: salt-master 2015.5.9 (Lithium)
Attaching Salt Debug logs:-
#####################################################
[DEBUG ] Reading configuration from /etc/salt/minion
[DEBUG ] Including configuration from '/etc/salt/minion.d/_schedule.conf'
[DEBUG ] Reading configuration from /etc/salt/minion.d/_schedule.conf
[DEBUG ] Configuration file path: /etc/salt/minion
[WARNING ] Insecure logging configuration detected! Sensitive data may be logged.
[INFO ] Setting up the Salt Minion "i-xxxxxxx"
[DEBUG ] Created pidfile: /var/run/salt-minion.pid
[DEBUG ] Reading configuration from /etc/salt/minion
[DEBUG ] Including configuration from '/etc/salt/minion.d/_schedule.conf'
[DEBUG ] Reading configuration from /etc/salt/minion.d/_schedule.conf
[DEBUG ] The `dmidecode` binary is not available on the system. GPU grains will not be available.
[DEBUG ] Attempting to authenticate with the Salt Master at 10.0.x.x
[DEBUG ] Initializing new SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG ] Decrypting the current master AES key
[DEBUG ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG ] Decrypting the current master AES key
[DEBUG ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG ] Reading configuration from /etc/salt/minion
[DEBUG ] Including configuration from '/etc/salt/minion.d/_schedule.conf'
[DEBUG ] Reading configuration from /etc/salt/minion.d/_schedule.conf
[DEBUG ] The `dmidecode` binary is not available on the system. GPU grains will not be available.
[DEBUG ] LazyLoaded timezone.get_offset
[DEBUG ] LazyLoaded cmd.run
[INFO ] Executing command ['date', '+%z'] in directory '/root'
[DEBUG ] output: +0000
[DEBUG ] LazyLoaded config.merge
[DEBUG ] LazyLoaded mine.update
[INFO ] Added mine.update to scheduler
[INFO ] Updating job settings for scheduled job: __mine_interval
[INFO ] I am i-xxxxxxx and I am not supposed to start any proxies. (Likely not a problem)
[INFO ] The salt minion is starting up
[INFO ] Minion is starting as user 'root'
[DEBUG ] Minion 'i-xxxxxxx' trying to tune in
[DEBUG ] Minion PUB socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pub.ipc
[DEBUG ] Minion PULL socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pull.ipc
[INFO ] Starting pub socket on ipc:///var/run/salt/minion/minion_event_db5818b311_pub.ipc
[INFO ] Starting pull socket on ipc:///var/run/salt/minion/minion_event_db5818b311_pull.ipc
[DEBUG ] Generated random reconnect delay between '1000ms' and '11000ms' (3778)
[DEBUG ] Setting zmq_reconnect_ivl to '3778ms'
[DEBUG ] Setting zmq_reconnect_ivl_max to '11000ms'
[DEBUG ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[INFO ] Minion is ready to receive requests!
[INFO ] Running scheduled job: __mine_interval
[DEBUG ] schedule: This job was scheduled with jid_include, adding to cache (jid_include defaults to True)
[DEBUG ] schedule: This job was scheduled with a max number of 2
[DEBUG ] schedule.handle_func: adding this job to the jobcache with data {'fun': 'mine.update', 'jid': '20160609162922789098', 'pid': 26273, 'id': 'i-xxxxxxx', 'schedule': '__mine_interval'}
[DEBUG ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG ] MinionEvent PUB socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pub.ipc
[DEBUG ] MinionEvent PULL socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pull.ipc
[DEBUG ] Sending event - data = {'_stamp': '2016-06-09T16:29:22.897491'}
[DEBUG ] Handling event 'salt/event/new_client\n\n\x81\xa6_stamp\xba2016-06-09T16:29:22.897491'
[DEBUG ] Sending event - data = {'_stamp': '2016-06-09T16:29:22.911461', 'clear': False, 'cmd': '_mine', 'tok': 'K\xf0u*\x85\x96B\x81\xbb\xc9\xcc^U\xbcJ3Z\xf4\x99\xf2\xc2\xd7h\x9f\xd5\x1b3\x16\xba\x8b\xf3\xc3\x07\xb7\xaf\r\xe0H(\x06\x9e\x9a6\xfa\xe6\n\xc3G2\xb1{KD\x0e\xb0\x14>\x83\xa5\x86\xc7h\xdbH\x07B\x82\x85,I\xe9\xef(\xcb\xd5\xfaq\xaagt\x1f\xec_e\xb0\x1aQ$\xb9_\x98(\xceM"h,-\xb2\xe6e\xda\xafDN\x19\xc5\xdd\xfc\x85)\xf6\xcc\xba\xf9\xb7/\xa1\xa8b+tUT\x82$p\xf9\xc2\xac\xeb\x91|@*\xed\xb8,\xd3M"A9J\x9e\x90,\xd9\x90_\xebF\x1d\x02\xe4\xb4,\xfbl\x8ct\xadJ\xb8Z\x1d\xd0%\x16\x05\x86\xee\xfc\xb8;Y\xf7U\x16\x08Wr\xda\xc6\xd8\x05`\x7f\x8fY\xb7\xbb\x10&\xd5fp|\x00\xc2\xb5\xae]\x82yFG\xa6\xfb\xec\xceMQ\xe2\xb5\x83\xaf\x16\x91\x91*4\'\x0b\xc2\xcd`U\x8a\xb7\x84\xebb1\xbbK\t\x94\xce\xc9\xbfK\xd3(\xbe+\xa2\xba\xfa\x83\x87\x80\xb4\xf3\xe1I\xecu\xeb\x11\x8d\nU\xed\x1d\x9fs\xaaa;\xd3C\x97RK\xc2\xe0b\x01\xd2\x9b\xe5+\x81\xfc\x0e\x1c4\xe4T\x9euZ"\xd3\xa2\x08\x0c\xc6i\xc0\xd2\xecL?\x7fR\xebc7\xa6A\xce\x99c\xa7!\t{u\x92a\xb6\xc1\xf4.\xd1%+\xef\xfc\x92]\xe4\x14I\xe8qn+\xbb$\x18V*\x1f0\x1aV\xa6\xb8p_\xb3P\xa6h\xea\x1be\n\x8d\xa03\r\xd6\xb5\xe7\x93\x99zwyFJ*\xb0 \xa0\xe3w3\xfeFv\xc9\xa8\xd9Y3\xf86cF\x83\x04\x0f\xe8|i\xf3N7\xf6\x9c\x82\xc4\x82\x9bz\x85\x80}\xbe\xce\x15\xe5\x9fD1\x08\x05\x01f\xee%ZR?\xf3d\xbb%\x9e\x863\x9a\'r\xaa~\x84k\xbe\xd0\x1bi\x86T`\xed\xb8f7\x84\x16\xf2<\xa8\xa1\x93D\xec;h\xebK\x02;\x92\xfc\xfc\xbc\x1c\x90q\xf4\xcf*Q\x81K\xe9\xd8T\xf2\xcb\x96sO\xd6\xc5%\xbd\x1e\xe7/\xba+\x91\x9e3\x8eJn9\xa0\xe0\x1b\xa8}\x84', 'data': {}, 'id': 'i-xxxxxxx'}
[DEBUG ] Handling event '_minion_mine\n\n\x86\xa6_stamp\xba2016-06-09T16:29:22.911461\xa5clear\xc2\xa3cmd\xa5_mine\xa3tok\xda\x02\x00K\xf0u*\x85\x96B\x81\xbb\xc9\xcc^U\xbcJ3Z\xf4\x99\xf2\xc2\xd7h\x9f\xd5\x1b3\x16\xba\x8b\xf3\xc3\x07\xb7\xaf\r\xe0H(\x06\x9e\x9a6\xfa\xe6\n\xc3G2\xb1{KD\x0e\xb0\x14>\x83\xa5\x86\xc7h\xdbH\x07B\x82\x85,I\xe9\xef(\xcb\xd5\xfaq\xaagt\x1f\xec_e\xb0\x1aQ$\xb9_\x98(\xceM"h,-\xb2\xe6e\xda\xafDN\x19\xc5\xdd\xfc\x85)\xf6\xcc\xba\xf9\xb7/\xa1\xa8b+tUT\x82$p\xf9\xc2\xac\xeb\x91|@*\xed\xb8,\xd3M"A9J\x9e\x90,\xd9\x90_\xebF\x1d\x02\xe4\xb4,\xfbl\x8ct\xadJ\xb8Z\x1d\xd0%\x16\x05\x86\xee\xfc\xb8;Y\xf7U\x16\x08Wr\xda\xc6\xd8\x05`\x7f\x8fY\xb7\xbb\x10&\xd5fp|\x00\xc2\xb5\xae]\x82yFG\xa6\xfb\xec\xceMQ\xe2\xb5\x83\xaf\x16\x91\x91*4\'\x0b\xc2\xcd`U\x8a\xb7\x84\xebb1\xbbK\t\x94\xce\xc9\xbfK\xd3(\xbe+\xa2\xba\xfa\x83\x87\x80\xb4\xf3\xe1I\xecu\xeb\x11\x8d\nU\xed\x1d\x9fs\xaaa;\xd3C\x97RK\xc2\xe0b\x01\xd2\x9b\xe5+\x81\xfc\x0e\x1c4\xe4T\x9euZ"\xd3\xa2\x08\x0c\xc6i\xc0\xd2\xecL?\x7fR\xebc7\xa6A\xce\x99c\xa7!\t{u\x92a\xb6\xc1\xf4.\xd1%+\xef\xfc\x92]\xe4\x14I\xe8qn+\xbb$\x18V*\x1f0\x1aV\xa6\xb8p_\xb3P\xa6h\xea\x1be\n\x8d\xa03\r\xd6\xb5\xe7\x93\x99zwyFJ*\xb0 \xa0\xe3w3\xfeFv\xc9\xa8\xd9Y3\xf86cF\x83\x04\x0f\xe8|i\xf3N7\xf6\x9c\x82\xc4\x82\x9bz\x85\x80}\xbe\xce\x15\xe5\x9fD1\x08\x05\x01f\xee%ZR?\xf3d\xbb%\x9e\x863\x9a\'r\xaa~\x84k\xbe\xd0\x1bi\x86T`\xed\xb8f7\x84\x16\xf2<\xa8\xa1\x93D\xec;h\xebK\x02;\x92\xfc\xfc\xbc\x1c\x90q\xf4\xcf*Q\x81K\xe9\xd8T\xf2\xcb\x96sO\xd6\xc5%\xbd\x1e\xe7/\xba+\x91\x9e3\x8eJn9\xa0\xe0\x1b\xa8}\x84\xa4data\x80\xa2id\xaai-xxxxxxx'
[DEBUG ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
##########################################################################################################################################################################################
Attaching the minion logs:-
2016-06-09 16:22:43,141 [salt.minion ][INFO ][26133] Starting a new job with PID 26133
2016-06-09 16:22:43,155 [salt.loaded.int.module.cmdmod ][INFO ][26133] Executing command 'yum update' in directory '/root'
2016-06-09 16:22:48,141 [salt.minion ][INFO ][2667] User root Executing command saltutil.find_job with jid 20160609162247048969
2016-06-09 16:22:48,142 [salt.minion ][DEBUG ][2667] Command details {'tgt_type': 'glob', 'jid': '20160609162247048969', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job'}
2016-06-09 16:22:48,191 [salt.minion ][INFO ][26137] Starting a new job with PID 26137
2016-06-09 16:22:48,222 [salt.utils.lazy ][DEBUG ][26137] LazyLoaded saltutil.find_job
2016-06-09 16:22:48,224 [salt.minion ][DEBUG ][26137] Minion return retry timer set to 6 seconds (randomized)
2016-06-09 16:22:48,224 [salt.minion ][INFO ][26137] Returning information for job: 20160609162247048969
2016-06-09 16:22:48,224 [salt.crypt ][DEBUG ][26137] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
2016-06-09 16:22:58,180 [salt.minion ][INFO ][2667] User root Executing command saltutil.find_job with jid 20160609162257083934
2016-06-09 16:22:58,180 [salt.minion ][DEBUG ][2667] Command details {'tgt_type': 'glob', 'jid': '20160609162257083934', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job'}
###########################################################################################################################
Attaching Salt Master logs:-
2016-06-09 16:22:42,010 [salt.utils.event ][DEBUG ][2135] Sending event - data = {'_stamp': '2016-06-09T16:22:42.009618', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:42,010 [salt.utils.event ][DEBUG ][2135] Sending event - data = {'tgt_type': 'glob', 'jid': '20160609162242009374', 'tgt': 'i-xxxxxxx', '_stamp': '2016-06-09T16:22:42.009869', 'user': 'root', 'arg': ['yum update'], 'fun': 'cmd.run', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:42,011 [salt.master ][DEBUG ][2135] Published command details {'tgt_type': 'glob', 'jid': '20160609162242009374', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['yum update'], 'fun': 'cmd.run'}
2016-06-09 16:22:42,028 [salt.client ][DEBUG ][15914] get_iter_returns for jid 20160609162242009374 sent to set(['i-xxxxxxx']) will timeout at 16:22:47.028044
2016-06-09 16:22:47,058 [salt.utils.event ][DEBUG ][2141] Sending event - data = {'_stamp': '2016-06-09T16:22:47.057552', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:47,058 [salt.utils.event ][DEBUG ][2141] Sending event - data = {'tgt_type': 'glob', 'jid': '20160609162247048969', 'tgt': 'i-xxxxxxx', '_stamp': '2016-06-09T16:22:47.057807', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:47,059 [salt.master ][DEBUG ][2141] Published command details {'tgt_type': 'glob', 'jid': '20160609162247048969', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job'}
###########################################################################################################################
Could you guys please help me on troubleshooting this issue. Any suggestions/help would be really helpful.
Thanks in Advance,
Aadesh.K