bosh deploy cloud foundry in openstack : timeout while compile packages

[张婕]

I use bosh to deploy cloud foundry on openstack, and got timeout error while doing "bosh deploy",below is my error log:

Compiling packages

  buildpack_cache/9: Timed out pinging to 8ce427bf-ac96-45ef-8058-b13fbe368d65 after 600 seconds (00:10:55)

  buildpack_python/155496.1-dev: Timed out pinging to 9229677f-60bf-4ce3-9289-2fb34f860a51 after 600 seconds (00:10:56)

  buildpack_php/7.1-dev: Timed out pinging to 686a6fee-4ecb-4dc4-9d69-f0de6784d038 after 600 seconds (00:10:56)

  buildpack_go/80.1-dev: Timed out pinging to 5195489b-3273-4c4a-910c-e08064c1f192 after 600 seconds (00:11:00)

  rootfs_lucid64/73610.1-dev: Timed out pinging to afe54882-4ba2-4a22-bea5-c0a7d544dec6 after 600 seconds (00:11:08)

  buildpack_nodejs/4.1-dev: Timed out pinging to 0ffea176-3c32-436e-9d6e-42528ec9e2ae after 600 seconds (00:11:09)

Error                   6/26 00:11:09                                                               

Error 450002: Timed out pinging to 8ce427bf-ac96-45ef-8058-b13fbe368d65 after 600 seconds

------------

I checked error log in director, and get a lot logs, I looked into the ruby code in director , and find that director ping vm failed . 

something useful below: 

DEBUG -- DirectorJobRunner: Worker thread raised exception: Timed out pinging to c2b8af9a-96a6-4a56-aa78-4fb8e95bdfff after 600 seconds - /var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/agent_client.rb:130:in `rescue in wait_until_ready'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/agent_client.rb:136:in `wait_until_ready'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:162:in `prepare_vm'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:80:in `block in compile_package'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/lock_helper.rb:89:in `block in with_compile_lock'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/lock.rb:58:in `lock'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/lock_helper.rb:89:in `with_compile_lock'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:73:in `compile_package'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:300:in `block (2 levels) in process_task'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/event_log.rb:97:in `call'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/event_log.rb:97:in `advance_and_track'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/event_log.rb:50:in `track'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:298:in `block in process_task'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh_common-1.0000.0/lib/common/thread_formatter.rb:49:in `with_thread_name'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:294:in `process_task'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/package_compiler.rb:254:in `block (4 levels) in compile_packages'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh_common-1.0000.0/lib/common/thread_pool.rb:77:in `call'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh_common-1.0000.0/lib/common/thread_pool.rb:77:in `block (2 levels) in create_thread'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh_common-1.0000.0/lib/common/thread_pool.rb:63:in `loop'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh_common-1.0000.0/lib/common/thread_pool.rb:63:in `block in create_thread'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `call'

/var/vcap/packages/director/gem_home/ruby/2.1.0/gems/logging-1.8.2/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'

D, [2014-12-20 14:06:03 #4919] [] DEBUG -- DirectorJobRunner: Thread is no longer needed, cleaning up

  ----------------

in file /var/vcap/packages/director/gem_home/ruby/2.1.0/gems/bosh-director-1.0000.0/lib/bosh/director/agent_client.rb , line 130 gave the error, below is related ruby code,

can anybody explain what does 'ping' do here ? I guess it is a method, but I did not find the definition of 'ping'.

I really need some help, anything will do, thank you.

def wait_until_ready(deadline = 600)

      old_timeout = @timeout

      @timeout = 1.0

      @deadline = Time.now.to_i + deadline

      begin

        ping

      rescue RpcTimeout

        retry if @deadline - Time.now.to_i > 0

        raise RpcTimeout, "Timed out pinging to #{@client_id} after #{deadline} seconds"

      rescue RpcRemoteException => e

        retry if e.message =~ /^restarting agent/ && @deadline - Time.now.to_i > 0

        raise e

      ensure

        @timeout = old_timeout

      end

    end