Issue 30229 in chromium-os: stumpy hung on install during BVT run

[chrom...@googlecode.com]

Status: Assigned
Owner: sco...@chromium.org
Labels: Type-Bug Pri-1 Area-Lab

New issue 30229 by sco...@chromium.org: stumpy hung on install during BVT
run
http://code.google.com/p/chromium-os/issues/detail?id=30229

Looks like one of the stumpys hung on install:
http://cautotest/afe/#tab_id=view_job&object_id=201627

I am currently digging for information on the system. This looks more like
an autotest race issue rather than a Chrome OS issue.

host:chromeos-rack2-host2

[chrom...@googlecode.com]

Comment #1 on issue 30229 by sco...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

This is happening during the sysinfo gathering phase before the autoupdate
test starts.

We may have missed our fifo write for some reason, which would deadlock us.
open("/tmp/sysinfo/autoserv-tOuFAi/tmp/_autotmp__PspTGharness-fifo/autoserv.fifo",
O_RDONLY^C
<unfinished ...>

When I ran echo B >
/tmp/sysinfo/autoserv-tOuFAi/tmp/_autotmp__PspTGharness-fifo/autoserv.fifo
we moved along fine. There is a race hiding in here somewhere but it is not
yet clear where.

[chrom...@googlecode.com]

Comment #2 on issue 30229 by sco...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

This happened again on a Kaen.

CHROMEOS_RELEASE_APPID={79F9F354-A2E3-4643-9B72-327B3721DF9F}
CHROMEOS_RELEASE_BOARD=tegra2_kaen
CHROMEOS_RELEASE_DESCRIPTION=2227.0.0 (Official Build) dev-channel
tegra2_kaen test
CHROMEOS_RELEASE_NAME=Chrome OS
CHROMEOS_RELEASE_TRACK=testimage-channel
CHROMEOS_RELEASE_VERSION=2227.0.0
GOOGLE_RELEASE=2227.0.0
CHROMEOS_AUSERVER=https://tools.google.com/service/update2
CHROMEOS_DEVSERVER=
localhost autoserv-nPKr82 # uname -a
Linux localhost 3.2.7 #1 SMP Tue May 1 04:45:43 PDT 2012 armv7l ARMv7
Processor rev 0 (v7l) kaen GNU/Linux

[chrom...@googlecode.com]

Updates:
Owner: so...@chromium.org
Cc: sco...@chromium.org

Comment #3 on issue 30229 by sco...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

Here is the issue I was seeing with sysinfo hangs. I am assigning it to you
in general and if we see another one ill ping it and lock the machine.

Thanks

[chrom...@googlecode.com]

Comment #4 on issue 30229 by sco...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

chromeos-rack2-host2 is showing this behavior now. If you can take a look
at it soon that would be great!.

[chrom...@googlecode.com]

Updates:
Status: WontFix

Comment #5 on issue 30229 by so...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

Marking as wontfix as it hasn't been reported in a while

[chrom...@googlecode.com]

Updates:
Status: Assigned

Comment #6 on issue 30229 by sco...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

START autoupdate autoupdate timestamp=1340914063 localtime=Jun 28 13:07:43
START ---- ---- timestamp=1340914068 localtime=Jun 28 13:07:48
GOOD ---- sysinfo.before timestamp=1340914069 localtime=Jun 28 13:07:49
END GOOD ---- ---- timestamp=1340914069 localtime=Jun 28 13:07:49
START ---- ---- timestamp=1340914078 localtime=Jun 28 13:07:58
GOOD ---- sysinfo.iteration.before timestamp=1340914079 localtime=Jun 28
13:07:59
END GOOD ---- ---- timestamp=1340914079 localtime=Jun 28 13:07:59
START ---- reboot timestamp=1340914230 localtime=Jun 28 13:10:30
GOOD ---- reboot.start timestamp=1340914230 localtime=Jun 28 13:10:30
GOOD ---- reboot.verify timestamp=1340914276 localtime=Jun 28 13:11:16
END GOOD ---- reboot kernel=3.4.0 localtime=Jun 28 13:11:16
timestamp=1340914276
START ---- ---- timestamp=1340914299 localtime=Jun 28 13:11:39
GOOD ---- sysinfo.iteration.after timestamp=1340919173 localtime=Jun 28
14:32:53
END GOOD ---- ---- timestamp=1340919173 localtime=Jun 28 14:32:53
START ---- ---- timestamp=1340919178 localtime=Jun 28 14:32:58
GOOD ---- sysinfo.after timestamp=1340919178 localtime=Jun 28 14:32:58
END GOOD ---- ---- timestamp=1340919178 localtime=Jun 28 14:32:58
GOOD autoupdate autoupdate timestamp=1340919183 localtime=Jun 28 14:33:03
completed successfully
END GOOD autoupdate autoupdate timestamp=1340919183 localtime=Jun 28
14:33:03


This happened again. The machine is not in a state we can check anymore but
I had to bump it. Reopening...

[chrom...@googlecode.com]

Comment #7 on issue 30229 by so...@chromium.org: stumpy hung on install

during BVT run
http://code.google.com/p/chromium-os/issues/detail?id=30229

I do not have enough information to do something with this bug.

How do I find machines in this state so that I can debug them?