farm continually brings up nodes "Initializing" then tags them as "Pending terminate" and brings up more

56 views
Skip to first unread message

Aatxe Urrutia

unread,
Feb 7, 2014, 9:35:15 PM2/7/14
to scalr-...@googlegroups.com


vms come up and seem to get configured but its like there is some lifecycle of a couple min or something


from Servers>>View I see "Initializing" spinning icon, I see the Remote IP and Local IP I see DNS green Checkmark and then Agent & Actions Icons, all icons work while node is initiializing I can ssh in via java client from that window I can look at usage window ( although its blank at the momemt) however nodes are set  to "Pending terminate" without ever going to a tagged "running" state in the UI.


The instances never get terminated in the UI, i.e. they just continue to keep spinning up so eventually i have to terminate the farm to avoid new nodes comming up but I can login and extract logs. example below.


2014-02-07 19:48:56,970 - DEBUG - scalarizr.messaging.p2p.consumer - Received message 'HostInit' (message_id: 1123, format: json)
2014-02-07 19:48:57,004 - DEBUG - scalarizr.messaging.p2p - Commiting put_ingoing
2014-02-07 19:48:57,005 - DEBUG - scalarizr.messaging.p2p - Commited put_ingoing
2014-02-07 19:48:57,010 - DEBUG - scalarizr.messaging.p2p.consumer - Going to handle_one_message. Thread: MessageHandler
2014-02-07 19:48:57,010 - DEBUG - scalarizr.messaging.p2p.consumer - Notify message listeners (message_id: 123)
2014-02-07 19:48:57,010 - DEBUG - scalarizr.messaging.p2p.consumer - "POST /control HTTP/1.1" 201 -
2014-02-07 19:48:57,011 - DEBUG - scalarizr.handlers - Handle 'HostInit'
2014-02-07 19:48:57,012 - DEBUG - scalarizr.handlers - Scalr version: (4, 5, 0)
2014-02-07 19:48:57,013 - DEBUG - scalarizr.handlers - Call handler ScriptExecutor
2014-02-07 19:48:57,013 - DEBUG - scalarizr.handlers.script_executor - Scalr notified me that 'HostInit' fired
2014-02-07 19:48:57,014 - DEBUG - scalarizr.handlers - Empty scripts list. Breaking
2014-02-07 19:48:57,014 - DEBUG - scalarizr.messaging.p2p.consumer - Mark message (message_id: 123) as handled
2014-02-07 19:48:57,038 - DEBUG - scalarizr.messaging.p2p.consumer - Completed handle_one_message. Thread: MessageHandler
2014-02-07 19:48:57,038 - DEBUG - scalarizr.messaging.p2p.consumer - Fired message acknowledge event: HostInit
2014-02-07 19:48:57,038 - INFO - scalarizr.config - State: initializing
2014-02-07 19:48:57,039 - DEBUG - scalarizr.handlers.hooks - Hook on 'host_init'() {}
2014-02-07 19:48:57,039 - DEBUG - scalarizr.handlers.script_executor - Starting log_rotate routine
2014-02-07 19:48:57,042 - DEBUG - scalarizr.handlers.script_executor - STATE[script_executor.in_progress]: None
2014-02-07 19:48:57,045 - DEBUG - scalarizr.handlers.script_executor - Restoring 0 in-progress scripts
2014-02-07 19:48:57,045 - DEBUG - scalarizr.handlers.hooks - Hook on 'start'() {}
2014-02-07 19:48:58,570 - DEBUG - scalarizr.messaging.p2p.consumer - Received ingoing message in queue: 'control'
2014-02-07 19:48:58,570 - DEBUG - scalarizr.messaging.p2p.security - Decrypting message
2014-02-07 19:48:58,576 - DEBUG - scalarizr.messaging.p2p.consumer - Decoding message: {

ideas? I've termd the farm and am looking more but help would be appreciated thanks in advance


These nodes are on ec2 and using Redhat 6.3 x86_64

Thomas Orozco

unread,
Feb 9, 2014, 6:18:51 AM2/9/14
to scalr-...@googlegroups.com
Hi there,


Can you let me know what timezone your Scalr host is using (input "date" at your command prompt), and which timezone you're using for PHP (date.timezone setting)?

The PHP timezone may be undefined, too. Let me know if that's the case, too.


How did you install Scalr? Did you use the installer?

Cheers, 

Aatxe Urrutia

unread,
Feb 10, 2014, 8:15:56 PM2/10/14
to scalr-...@googlegroups.com
Kaixo Thomas!

I think originally I installed it without a timezone correct but I brought up another instance using a snapshot & used PST time zone Los Angeles and it still failed so I went back to the config.yml and took the fqdn of the master host that is associated with an Elastic IP and put that in & restarted scalr.

It actually is working now & I am looking at integrating it with Puppet and the other internal tools. I used the latest stabile zip download from github.


Now that I have that running I can get my projects more underway and take time posting back if I need something I'm really stumped on thanks for the help!

Cheers,
~
Untsa habiatu den lana, erdi akabirik.
Reply all
Reply to author
Forward
0 new messages