executor is deleting my diego containers

33 views
Skip to first unread message

jfra...@gmail.com

unread,
Feb 2, 2015, 10:44:27 AM2/2/15
to vcap...@cloudfoundry.org
Greetings,  I have been playing around with diego and very close to getting a simple tomcat application to deploy.
cf release = 195
diego release (currently) = 0.823
stemcell = bosh-openstack-kvm-ubuntu-trusty-go_agent , version 2811
cf client = cf version 6.9.0-5781f81-2015-01-27T02:06:47+00:00
openstack = icehouse

diego executor is deleting my containers and I do not know why.. any help would be great.

cf push shows:
requested state: started
instances: 1/1
usage: 512M x 1 instances
urls: tomcatsample.cf-ice.fmr.com
last uploaded: Mon Feb 2 15:20:45 UTC 2015

executor log shows for container:
/var/vcap/sys/log/executor
{"timestamp":"1422890477.913835764" "message":"executor.request.depot-client.run-container.run.started"
{"timestamp":"1422890477.914981365" "message":"executor.request.depot-client.run-container.run.run-step-process.started"
{"timestamp":"1422890477.915354729" "message":"executor.request.depot-client.run-container.run.stored-step-process"
{"timestamp":"1422890477.915542126" "message":"executor.request.depot-client.run-container.run.finished"
{"timestamp":"1422890477.915716887" "message":"executor.request.depot-client.run-container.run.download-step.fetch-starting"
{"timestamp":"1422890478.235062361" "message":"executor.request.depot-client.run-container.run.download-step.fetch-complete"
{"timestamp":"1422890478.235309124" "message":"executor.request.depot-client.run-container.run.download-step.stream-in-starting"
{"timestamp":"1422890478.295194864" "message":"executor.request.depot-client.run-container.run.download-step.stream-in-complete"
{"timestamp":"1422890478.295575619" "message":"executor.request.depot-client.run-container.run.download-step.fetch-starting"
{"timestamp":"1422890481.670143127" "message":"executor.request.depot-client.run-container.run.download-step.fetch-complete"
{"timestamp":"1422890481.670304775" "message":"executor.request.depot-client.run-container.run.download-step.stream-in-starting"
{"timestamp":"1422890482.091060638" "message":"executor.request.depot-client.run-container.run.download-step.stream-in-complete"
{"timestamp":"1422890482.091620922" "message":"executor.request.depot-client.run-container.run.run-step.running"
{"timestamp":"1422890482.091900349" "message":"executor.request.depot-client.run-container.run.run-step.creating-process"
{"timestamp":"1422890482.103362560" "message":"executor.request.depot-client.run-container.run.run-step.successful-process-create"
{"timestamp":"1422890482.592745543" "message":"executor.request.depot-client.run-container.run.run-step.running"
{"timestamp":"1422890482.592962742" "message":"executor.request.depot-client.run-container.run.run-step.creating-process"
{"timestamp":"1422890482.603172779" "message":"executor.request.depot-client.run-container.run.run-step.successful-process-create"
{"timestamp":"1422890482.639506340" "message":"executor.request.depot-client.run-container.run.run-step.process-exit"
{"timestamp":"1422890483.069710732" "message":"executor.request.serving"
{"timestamp":"1422890483.089599848" "message":"executor.request.done"
{"timestamp":"1422890483.154116869" "message":"executor.request.depot-client.run-container.run.run-step.running"
{"timestamp":"1422890483.154316902" "message":"executor.request.depot-client.run-container.run.run-step.creating-process"
{"timestamp":"1422890483.163006306" "message":"executor.request.depot-client.run-container.run.run-step.successful-process-create"
{"timestamp":"1422890483.170269012" "message":"executor.request.depot-client.run-container.run.run-step.process-exit"
{"timestamp":"1422890483.684602261" "message":"executor.request.depot-client.run-container.run.run-step.running"
{"timestamp":"1422890483.684916973" "message":"executor.request.depot-client.run-container.run.run-step.creating-process"
{"timestamp":"1422890483.697738171" "message":"executor.request.depot-client.run-container.run.run-step.successful-process-create"
{"timestamp":"1422890483.709121943" "message":"executor.request.depot-client.run-container.run.run-step.process-exit"
{"timestamp":"1422890483.709404707" "message":"executor.request.depot-client.run-container.run.monitor.monitor-step.transitioned-to-healthy"
{"timestamp":"1422890483.709558964" "message":"executor.request.depot-client.run-container.run.run-step-process.transitioning-to-running"
{"timestamp":"1422890483.733681679" "message":"executor.request.depot-client.run-container.run.run-step-process.succeeded-transitioning-to-running"
{"timestamp":"1422890483.736843109" "message":"executor.request.serving"
{"timestamp":"1422890483.754939556" "message":"executor.request.done"
{"timestamp":"1422890488.867894173" "message":"executor.request.serving"
{"timestamp":"1422890488.868122339" "message":"executor.request.depot-client.stop-container.stop.started"
{"timestamp":"1422890488.868168592" "message":"executor.request.depot-client.stop-container.stop.freeing-step-process.started"
{"timestamp":"1422890488.868206739" "message":"executor.request.depot-client.stop-container.stop.freeing-step-process.interrupting-process"
{"timestamp":"1422890488.868241310" "message":"executor.request.depot-client.stop-container.stop.freeing-step-process.finished"
{"timestamp":"1422890488.868282795" "message":"executor.request.depot-client.run-container.run.run-step-process.signaled"
{"timestamp":"1422890488.921942234" "message":"executor.request.depot-client.run-container.run.run-step.process-exit"
{"timestamp":"1422890488.922131062" "message":"executor.request.depot-client.run-container.run.run-step-process.step-cancelled"
{"timestamp":"1422890488.922185183" "message":"executor.request.depot-client.run-container.run.run-step-process.transitioning-to-complete"
{"timestamp":"1422890488.941730261" "message":"executor.request.depot-client.run-container.run.run-step-process.succeeded-transitioning-to-complete"
{"timestamp":"1422890488.941942692" "message":"executor.request.depot-client.run-container.run.run-step-process.finished"
{"timestamp":"1422890488.943026066" "message":"executor.request.depot-client.stop-container.stop.finished"
{"timestamp":"1422890488.943290949" "message":"executor.request.done"
{"timestamp":"1422890488.945337296" "message":"executor.request.serving"
{"timestamp":"1422890488.965391636" "message":"executor.request.done"
{"timestamp":"1422890488.972497940" "message":"executor.request.serving"
{"timestamp":"1422890488.972629070" "message":"executor.request.depot-client.delete-container.destroy.started"
{"timestamp":"1422890488.972661018" "message":"executor.request.depot-client.delete-container.destroy.freeing-step-process.started"
{"timestamp":"1422890488.972686291" "message":"executor.request.depot-client.delete-container.destroy.freeing-step-process.finished"
{"timestamp":"1422890489.252308130" "message":"executor.request.depot-client.delete-container.destroy.succeeded"
{"timestamp":"1422890489.252540350" "message":"executor.request.done"

Onsi Fakhouri

unread,
Feb 2, 2015, 1:16:00 PM2/2/15
to vcap...@cloudfoundry.org
There’s a parallel thread on vcap-dev where this exact issue was reported.  I replied there with:

>>>
Hey Dave,

Diego’s moving fast.  You’re going to need to upgrade to the latest CF-Release.

In general: Diego publishes a bosh final-release with *every* green build of our pipeline.  CF-Release is published with a substantially slower cadence.  Thus there are no strong guarantees that the latest Diego build will work with the latest CF-Release build.

As Diego approaches release we’ll have some more process around communicating which version of Diego-Release and CF-Release are compatible.

If you’d like to understand the behavior you’re seeing, here’s an explanation.  The set of applications that should be running (the Desired State) resides in CC.  Diego periodically compares the Desired State in CC with the Desired State it is aware of and ensure the two are in sync.  We recently performed a round of optimizations that changed the CC side of this equation - since Diego isn’t out of alpha yet we haven’t been trying to maintain backward compatibility as we make these kinds of changes.

The result is what you are seeing: when you start an application Diego receives a directed message and takes action (eventually brining your app up).  Eventually Diego checks with the CC to ensure the Desired State is up-to-date.  At this point the version mismatch occurs and Diego is told that there should not be any applications.  It proceeds to dutifully shut down your apps :)

Hope that helps,
Onsi
--
You received this message because you are subscribed to the Google Groups "Cloud Foundry Developers" group.
To view this discussion on the web visit https://groups.google.com/a/cloudfoundry.org/d/msgid/vcap-dev/dea0cea6-3ff4-41d6-8778-0cb3f19a51d8%40cloudfoundry.org.
To unsubscribe from this group and stop receiving emails from it, send an email to vcap-dev+u...@cloudfoundry.org.

jfra...@gmail.com

unread,
Feb 2, 2015, 7:12:42 PM2/2/15
to vcap...@cloudfoundry.org, ofak...@pivotal.io
Hi Onsi,

Thanks for the reply.  I downloaded the latest stemcell, cf release and diego release..
it seems my simple tomcat app after all the upgrades is staying up in the container and not getting 'dutifully shut down'  :-)

Thanks for the reply.
-Jacob
Reply all
Reply to author
Forward
0 new messages