Yum Update fails in Salt-minion

96 views
Skip to first unread message

Aadesh Rao

unread,
Jun 9, 2016, 12:39:02 PM6/9/16
to Salt-users
Hello,

I have started using salt, and when I try to perform a yum update from the master to the targeted minion, I do not get any response from either the minion or the master. Can you guys please help me on this?
Also I run the master and the minion on AWS.

Minion Version: salt-minion 2015.5.8 (Lithium)
Master Version: salt-master 2015.5.9 (Lithium)

Attaching Salt Debug logs:-
#####################################################

[DEBUG   ] Reading configuration from /etc/salt/minion
[DEBUG   ] Including configuration from '/etc/salt/minion.d/_schedule.conf'
[DEBUG   ] Reading configuration from /etc/salt/minion.d/_schedule.conf
[DEBUG   ] Configuration file path: /etc/salt/minion
[WARNING ] Insecure logging configuration detected! Sensitive data may be logged.
[INFO    ] Setting up the Salt Minion "i-xxxxxxx"
[DEBUG   ] Created pidfile: /var/run/salt-minion.pid
[DEBUG   ] Reading configuration from /etc/salt/minion
[DEBUG   ] Including configuration from '/etc/salt/minion.d/_schedule.conf'
[DEBUG   ] Reading configuration from /etc/salt/minion.d/_schedule.conf
[DEBUG   ] The `dmidecode` binary is not available on the system. GPU grains will not be available.
[DEBUG   ] Attempting to authenticate with the Salt Master at 10.0.x.x
[DEBUG   ] Initializing new SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG   ] Decrypting the current master AES key
[DEBUG   ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG   ] Decrypting the current master AES key
[DEBUG   ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG   ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG   ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG   ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG   ] Reading configuration from /etc/salt/minion
[DEBUG   ] Including configuration from '/etc/salt/minion.d/_schedule.conf'
[DEBUG   ] Reading configuration from /etc/salt/minion.d/_schedule.conf
[DEBUG   ] The `dmidecode` binary is not available on the system. GPU grains will not be available.
[DEBUG   ] LazyLoaded timezone.get_offset
[DEBUG   ] LazyLoaded cmd.run
[INFO    ] Executing command ['date', '+%z'] in directory '/root'
[DEBUG   ] output: +0000
[DEBUG   ] LazyLoaded config.merge
[DEBUG   ] LazyLoaded mine.update
[INFO    ] Added mine.update to scheduler
[INFO    ] Updating job settings for scheduled job: __mine_interval
[INFO    ] I am i-xxxxxxx and I am not supposed to start any proxies. (Likely not a problem)
[INFO    ] The salt minion is starting up
[INFO    ] Minion is starting as user 'root'
[DEBUG   ] Minion 'i-xxxxxxx' trying to tune in
[DEBUG   ] Minion PUB socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pub.ipc
[DEBUG   ] Minion PULL socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pull.ipc
[INFO    ] Starting pub socket on ipc:///var/run/salt/minion/minion_event_db5818b311_pub.ipc
[INFO    ] Starting pull socket on ipc:///var/run/salt/minion/minion_event_db5818b311_pull.ipc
[DEBUG   ] Generated random reconnect delay between '1000ms' and '11000ms' (3778)
[DEBUG   ] Setting zmq_reconnect_ivl to '3778ms'
[DEBUG   ] Setting zmq_reconnect_ivl_max to '11000ms'
[DEBUG   ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG   ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[INFO    ] Minion is ready to receive requests!
[INFO    ] Running scheduled job: __mine_interval
[DEBUG   ] schedule: This job was scheduled with jid_include, adding to cache (jid_include defaults to True)
[DEBUG   ] schedule: This job was scheduled with a max number of 2
[DEBUG   ] schedule.handle_func: adding this job to the jobcache with data {'fun': 'mine.update', 'jid': '20160609162922789098', 'pid': 26273, 'id': 'i-xxxxxxx', 'schedule': '__mine_interval'}
[DEBUG   ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG   ] Loaded minion key: /etc/salt/pki/minion/minion.pem
[DEBUG   ] MinionEvent PUB socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pub.ipc
[DEBUG   ] MinionEvent PULL socket URI: ipc:///var/run/salt/minion/minion_event_db5818b311_pull.ipc
[DEBUG   ] Sending event - data = {'_stamp': '2016-06-09T16:29:22.897491'}
[DEBUG   ] Handling event 'salt/event/new_client\n\n\x81\xa6_stamp\xba2016-06-09T16:29:22.897491'
[DEBUG   ] Sending event - data = {'_stamp': '2016-06-09T16:29:22.911461', 'clear': False, 'cmd': '_mine', 'tok': 'K\xf0u*\x85\x96B\x81\xbb\xc9\xcc^U\xbcJ3Z\xf4\x99\xf2\xc2\xd7h\x9f\xd5\x1b3\x16\xba\x8b\xf3\xc3\x07\xb7\xaf\r\xe0H(\x06\x9e\x9a6\xfa\xe6\n\xc3G2\xb1{KD\x0e\xb0\x14>\x83\xa5\x86\xc7h\xdbH\x07B\x82\x85,I\xe9\xef(\xcb\xd5\xfaq\xaagt\x1f\xec_e\xb0\x1aQ$\xb9_\x98(\xceM"h,-\xb2\xe6e\xda\xafDN\x19\xc5\xdd\xfc\x85)\xf6\xcc\xba\xf9\xb7/\xa1\xa8b+tUT\x82$p\xf9\xc2\xac\xeb\x91|@*\xed\xb8,\xd3M"A9J\x9e\x90,\xd9\x90_\xebF\x1d\x02\xe4\xb4,\xfbl\x8ct\xadJ\xb8Z\x1d\xd0%\x16\x05\x86\xee\xfc\xb8;Y\xf7U\x16\x08Wr\xda\xc6\xd8\x05`\x7f\x8fY\xb7\xbb\x10&\xd5fp|\x00\xc2\xb5\xae]\x82yFG\xa6\xfb\xec\xceMQ\xe2\xb5\x83\xaf\x16\x91\x91*4\'\x0b\xc2\xcd`U\x8a\xb7\x84\xebb1\xbbK\t\x94\xce\xc9\xbfK\xd3(\xbe+\xa2\xba\xfa\x83\x87\x80\xb4\xf3\xe1I\xecu\xeb\x11\x8d\nU\xed\x1d\x9fs\xaaa;\xd3C\x97RK\xc2\xe0b\x01\xd2\x9b\xe5+\x81\xfc\x0e\x1c4\xe4T\x9euZ"\xd3\xa2\x08\x0c\xc6i\xc0\xd2\xecL?\x7fR\xebc7\xa6A\xce\x99c\xa7!\t{u\x92a\xb6\xc1\xf4.\xd1%+\xef\xfc\x92]\xe4\x14I\xe8qn+\xbb$\x18V*\x1f0\x1aV\xa6\xb8p_\xb3P\xa6h\xea\x1be\n\x8d\xa03\r\xd6\xb5\xe7\x93\x99zwyFJ*\xb0 \xa0\xe3w3\xfeFv\xc9\xa8\xd9Y3\xf86cF\x83\x04\x0f\xe8|i\xf3N7\xf6\x9c\x82\xc4\x82\x9bz\x85\x80}\xbe\xce\x15\xe5\x9fD1\x08\x05\x01f\xee%ZR?\xf3d\xbb%\x9e\x863\x9a\'r\xaa~\x84k\xbe\xd0\x1bi\x86T`\xed\xb8f7\x84\x16\xf2<\xa8\xa1\x93D\xec;h\xebK\x02;\x92\xfc\xfc\xbc\x1c\x90q\xf4\xcf*Q\x81K\xe9\xd8T\xf2\xcb\x96sO\xd6\xc5%\xbd\x1e\xe7/\xba+\x91\x9e3\x8eJn9\xa0\xe0\x1b\xa8}\x84', 'data': {}, 'id': 'i-xxxxxxx'}
[DEBUG   ] Handling event '_minion_mine\n\n\x86\xa6_stamp\xba2016-06-09T16:29:22.911461\xa5clear\xc2\xa3cmd\xa5_mine\xa3tok\xda\x02\x00K\xf0u*\x85\x96B\x81\xbb\xc9\xcc^U\xbcJ3Z\xf4\x99\xf2\xc2\xd7h\x9f\xd5\x1b3\x16\xba\x8b\xf3\xc3\x07\xb7\xaf\r\xe0H(\x06\x9e\x9a6\xfa\xe6\n\xc3G2\xb1{KD\x0e\xb0\x14>\x83\xa5\x86\xc7h\xdbH\x07B\x82\x85,I\xe9\xef(\xcb\xd5\xfaq\xaagt\x1f\xec_e\xb0\x1aQ$\xb9_\x98(\xceM"h,-\xb2\xe6e\xda\xafDN\x19\xc5\xdd\xfc\x85)\xf6\xcc\xba\xf9\xb7/\xa1\xa8b+tUT\x82$p\xf9\xc2\xac\xeb\x91|@*\xed\xb8,\xd3M"A9J\x9e\x90,\xd9\x90_\xebF\x1d\x02\xe4\xb4,\xfbl\x8ct\xadJ\xb8Z\x1d\xd0%\x16\x05\x86\xee\xfc\xb8;Y\xf7U\x16\x08Wr\xda\xc6\xd8\x05`\x7f\x8fY\xb7\xbb\x10&\xd5fp|\x00\xc2\xb5\xae]\x82yFG\xa6\xfb\xec\xceMQ\xe2\xb5\x83\xaf\x16\x91\x91*4\'\x0b\xc2\xcd`U\x8a\xb7\x84\xebb1\xbbK\t\x94\xce\xc9\xbfK\xd3(\xbe+\xa2\xba\xfa\x83\x87\x80\xb4\xf3\xe1I\xecu\xeb\x11\x8d\nU\xed\x1d\x9fs\xaaa;\xd3C\x97RK\xc2\xe0b\x01\xd2\x9b\xe5+\x81\xfc\x0e\x1c4\xe4T\x9euZ"\xd3\xa2\x08\x0c\xc6i\xc0\xd2\xecL?\x7fR\xebc7\xa6A\xce\x99c\xa7!\t{u\x92a\xb6\xc1\xf4.\xd1%+\xef\xfc\x92]\xe4\x14I\xe8qn+\xbb$\x18V*\x1f0\x1aV\xa6\xb8p_\xb3P\xa6h\xea\x1be\n\x8d\xa03\r\xd6\xb5\xe7\x93\x99zwyFJ*\xb0 \xa0\xe3w3\xfeFv\xc9\xa8\xd9Y3\xf86cF\x83\x04\x0f\xe8|i\xf3N7\xf6\x9c\x82\xc4\x82\x9bz\x85\x80}\xbe\xce\x15\xe5\x9fD1\x08\x05\x01f\xee%ZR?\xf3d\xbb%\x9e\x863\x9a\'r\xaa~\x84k\xbe\xd0\x1bi\x86T`\xed\xb8f7\x84\x16\xf2<\xa8\xa1\x93D\xec;h\xebK\x02;\x92\xfc\xfc\xbc\x1c\x90q\xf4\xcf*Q\x81K\xe9\xd8T\xf2\xcb\x96sO\xd6\xc5%\xbd\x1e\xe7/\xba+\x91\x9e3\x8eJn9\xa0\xe0\x1b\xa8}\x84\xa4data\x80\xa2id\xaai-xxxxxxx'
[DEBUG   ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
[DEBUG   ] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
##########################################################################################################################################################################################

Attaching the minion logs:-

2016-06-09 16:22:43,141 [salt.minion                              ][INFO    ][26133] Starting a new job with PID 26133
2016-06-09 16:22:43,155 [salt.loaded.int.module.cmdmod            ][INFO    ][26133] Executing command 'yum update' in directory '/root'
2016-06-09 16:22:48,141 [salt.minion                              ][INFO    ][2667] User root Executing command saltutil.find_job with jid 20160609162247048969
2016-06-09 16:22:48,142 [salt.minion                              ][DEBUG   ][2667] Command details {'tgt_type': 'glob', 'jid': '20160609162247048969', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job'}
2016-06-09 16:22:48,191 [salt.minion                              ][INFO    ][26137] Starting a new job with PID 26137
2016-06-09 16:22:48,222 [salt.utils.lazy                          ][DEBUG   ][26137] LazyLoaded saltutil.find_job
2016-06-09 16:22:48,224 [salt.minion                              ][DEBUG   ][26137] Minion return retry timer set to 6 seconds (randomized)
2016-06-09 16:22:48,224 [salt.minion                              ][INFO    ][26137] Returning information for job: 20160609162247048969
2016-06-09 16:22:48,224 [salt.crypt                               ][DEBUG   ][26137] Re-using SAuth for ('/etc/salt/pki/minion', 'i-xxxxxxx', 'tcp://10.0.x.x:4506')
2016-06-09 16:22:58,180 [salt.minion                              ][INFO    ][2667] User root Executing command saltutil.find_job with jid 20160609162257083934
2016-06-09 16:22:58,180 [salt.minion                              ][DEBUG   ][2667] Command details {'tgt_type': 'glob', 'jid': '20160609162257083934', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job'}

###########################################################################################################################

Attaching Salt Master logs:-

2016-06-09 16:22:42,010 [salt.utils.event                         ][DEBUG   ][2135] Sending event - data = {'_stamp': '2016-06-09T16:22:42.009618', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:42,010 [salt.utils.event                         ][DEBUG   ][2135] Sending event - data = {'tgt_type': 'glob', 'jid': '20160609162242009374', 'tgt': 'i-xxxxxxx', '_stamp': '2016-06-09T16:22:42.009869', 'user': 'root', 'arg': ['yum update'], 'fun': 'cmd.run', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:42,011 [salt.master                              ][DEBUG   ][2135] Published command details {'tgt_type': 'glob', 'jid': '20160609162242009374', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['yum update'], 'fun': 'cmd.run'}
2016-06-09 16:22:42,028 [salt.client      ][DEBUG   ][15914] get_iter_returns for jid 20160609162242009374 sent to set(['i-xxxxxxx']) will timeout at 16:22:47.028044
2016-06-09 16:22:47,058 [salt.utils.event                         ][DEBUG   ][2141] Sending event - data = {'_stamp': '2016-06-09T16:22:47.057552', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:47,058 [salt.utils.event                         ][DEBUG   ][2141] Sending event - data = {'tgt_type': 'glob', 'jid': '20160609162247048969', 'tgt': 'i-xxxxxxx', '_stamp': '2016-06-09T16:22:47.057807', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job', 'minions': ['i-xxxxxxx']}
2016-06-09 16:22:47,059 [salt.master                              ][DEBUG   ][2141] Published command details {'tgt_type': 'glob', 'jid': '20160609162247048969', 'tgt': 'i-xxxxxxx', 'ret': '', 'user': 'root', 'arg': ['20160609162242009374'], 'fun': 'saltutil.find_job'}
###########################################################################################################################

Could you guys please help me on troubleshooting this issue. Any suggestions/help would be really helpful.
Thanks in Advance,
Aadesh.K

Loren Gordon

unread,
Jun 9, 2016, 12:59:31 PM6/9/16
to Salt-users
It appears you attempted to use the cmd.run function to execute 'yum update'? That is interactive by default, so the cmd is probably hanging and waiting for input. Try changing the command to 'yum -y update'.

-Loren

Aadesh Rao

unread,
Jun 10, 2016, 6:31:58 AM6/10/16
to salt-...@googlegroups.com
Hi Loren,

Thanks for the turnaround, I did try the cmd.run with the "-y" parameter. It worked as a charm. On certain instances I still had the minion returning with an error code just displaying the packages to be updated and installed. I was expecting the same from every other instance. Thanks a Ton!

Regards,
Aadesh.K


--
You received this message because you are subscribed to a topic in the Google Groups "Salt-users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/salt-users/YrWHxch_g7g/unsubscribe.
To unsubscribe from this group and all its topics, send an email to salt-users+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply all
Reply to author
Forward
0 new messages