Node Discovery Problem

[Soheil Eizadi]

I found an issue today, if it is new I can post it on the waffle board.

Instead of installing OpenCrowbar and re-running all the Node Roles. I loaded a new development distribution  and built a new system.

I had a Node that was discovered previously by the old OpenCrowbar server and was running sledgehammer. After I brought up the new OpenCrowbar server I rebooted the Node by logging in and typing "reboot".

The Node got discovered and showed up as a node w/ number

d00-8c-fa-03-a5-9c

I am not sure where this number comes from, it seems like it should use the primary NIC MAC or SysID something that makes it unique? As you see later the same hardware Node has a new number in the system.

I had the system stuck in the chef-client state, (error log for it below.) I debugged this to a problem with the SSH keys. It seems when the Node was discovered, it was not re-imaged and the SSH keys were from the old OpenCrowbar installation. I loaded the new SSH Keys into the Node and reboot it again. This time I got a new node w/ number:

d00-8c-fa-03-b9-b4

This time it went through the whole deployment with all green check marks. Let me know if you want me to look at any more information from the orphaned Node on OpenCrowbar otherwise I was planning to remove it using crowbar CLI.

-Soheil

Error from chef-client not very informative:

d00-8c-fa-03-a5-9c.crowbar....com Chef Client

Log Capture (from last run)

/tmp/scriptjig-PlShU6/runner@5(): shopt -s nullglob extglob globstar
/tmp/scriptjig-PlShU6/runner@6(): export TMPDIR=/tmp/scriptjig-PlShU6
/tmp/scriptjig-PlShU6/runner@6(): TMPDIR=/tmp/scriptjig-PlShU6
/tmp/scriptjig-PlShU6/runner@7(): export ROLE=chef-client
/tmp/scriptjig-PlShU6/runner@7(): ROLE=chef-client
/tmp/scriptjig-PlShU6/runner@10(): export DEBIAN_FRONTEND=noninteractive DEBCONF_NONINTERACTIVE_SEEN=true
/tmp/scriptjig-PlShU6/runner@10(): DEBIAN_FRONTEND=noninteractive
/tmp/scriptjig-PlShU6/runner@10(): DEBCONF_NONINTERACTIVE_SEEN=true
/tmp/scriptjig-PlShU6/runner@11(): export LC_ALL=C LANGUAGE=C LANG=C
/tmp/scriptjig-PlShU6/runner@11(): LC_ALL=C
/tmp/scriptjig-PlShU6/runner@11(): LANGUAGE=C
/tmp/scriptjig-PlShU6/runner@11(): LANG=C
/tmp/scriptjig-PlShU6/runner@54(): mkdir -p /tmp/scriptjig-PlShU6/attrs
/tmp/scriptjig-PlShU6/runner@55(): mkdir -p /tmp/scriptjig-PlShU6/logs
/tmp/scriptjig-PlShU6/runner@57(): for script in '"$TMPDIR/$ROLE/"*.sh'
/tmp/scriptjig-PlShU6/runner@58(): . /tmp/scriptjig-PlShU6/chef-client/01-install-client.sh
/tmp/scriptjig-PlShU6/runner@58(): tee /tmp/scriptjig-PlShU6/logs/01-install-client.sh.log
//tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@3(): which chef-client
/usr/bin/chef-client
//tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@18(): mkdir -p /etc/chef
///tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@19(): read_attribute chefjig/server/url
///tmp/scriptjig-PlShU6/runner@28(read_attribute): [[ -f /tmp/scriptjig-PlShU6/attrs/chefjig/server/url/attr ]]
///tmp/scriptjig-PlShU6/runner@29(read_attribute): cat /tmp/scriptjig-PlShU6/attrs/chefjig/server/url/attr
//tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@19(): url=http://10.49.12.20:4646
///tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@20(): read_attribute chefjig/client/name
///tmp/scriptjig-PlShU6/runner@28(read_attribute): [[ -f /tmp/scriptjig-PlShU6/attrs/chefjig/client/name/attr ]]
///tmp/scriptjig-PlShU6/runner@29(read_attribute): cat /tmp/scriptjig-PlShU6/attrs/chefjig/client/name/attr
//tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@20(): clientname=d00-8c-fa-03-a5-9c.crowbar.atg.inca.infoblox.com
//tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@21(): cat
//tmp/scriptjig-PlShU6/chef-client/01-install-client.sh@29(): read_attribute chefjig/client/key
//tmp/scriptjig-PlShU6/runner@28(read_attribute): [[ -f /tmp/scriptjig-PlShU6/attrs/chefjig/client/key/attr ]]
//tmp/scriptjig-PlShU6/runner@29(read_attribute): cat /tmp/scriptjig-PlShU6/attrs/chefjig/client/key/attr
/tmp/scriptjig-PlShU6/runner@60(): exit 0