syzkaller: make target failed: failed to run ["make" "target"]: exit status 2

syzbot

unread,

May 21, 2019, 8:03:06 AM5/21/19

to syzkaller-...@googlegroups.com

Hello,

syzbot found the following crash on:

HEAD commit:
git tree: https://github.com/google/syzkaller.git master
console output: https://syzkaller.appspot.com/x/log.txt?x=16e650c4a00000
dashboard link: https://syzkaller.appspot.com/bug?extid=9dd17b8a26382c0c1851
compiler: go version go1.10.8 linux/amd64

Unfortunately, I don't have any reproducer for this crash yet.

IMPORTANT: if you fix the bug, please add the following tag to the commit:
Reported-by: syzbot+9dd17b...@syzkaller.appspotmail.com

---
This bug is generated by a bot. It may contain errors.
See https://goo.gl/tpsmEJ for more information about syzbot.
syzbot engineers can be reached at syzk...@googlegroups.com.

syzbot will keep track of this bug report. See:
https://goo.gl/tpsmEJ#status for how to communicate with syzbot.

Dmitry Vyukov

unread,

May 21, 2019, 8:23:48 AM5/21/19

to syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski, Siddharth Muralee

On Tue, May 21, 2019 at 2:03 PM syzbot
<syzbot+9dd17b...@syzkaller.appspotmail.com> wrote:
>
> Hello,
>
> syzbot found the following crash on:
>
> HEAD commit:
> git tree: https://github.com/google/syzkaller.git master
> console output: https://syzkaller.appspot.com/x/log.txt?x=16e650c4a00000
> dashboard link: https://syzkaller.appspot.com/bug?extid=9dd17b8a26382c0c1851
> compiler: go version go1.10.8 linux/amd64
>
> Unfortunately, I don't have any reproducer for this crash yet.
>
> IMPORTANT: if you fix the bug, please add the following tag to the commit:
> Reported-by: syzbot+9dd17b...@syzkaller.appspotmail.com

I will try to regenerate the distribution used for build.

Siddharth Muralee

unread,

May 21, 2019, 9:38:32 AM5/21/19

to Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Hey,

I see two more possible issues.

We also need to add the KCOV build option in the pkg/build netbsd.go file so that the kernel copied is compiled with code coverage. (I still haven't tested kcov + kasan - I will do that shortly).

Also the image wouldn't have the /dev/kcov file present there. So we should probably add it either to the pkg/build file with the commands or have the node pre-made in the image. Which do you think is better?

Dmitry Vyukov

unread,

May 21, 2019, 9:44:56 AM5/21/19

to Siddharth Muralee, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

On Tue, May 21, 2019 at 3:38 PM Siddharth Muralee
<siddhart...@gmail.com> wrote:
>
> Hey,
> I see two more possible issues.
> We also need to add the KCOV build option in the pkg/build netbsd.go file so that the kernel copied is compiled with code coverage. (I still haven't tested kcov + kasan - I will do that shortly).
>
> Also the image wouldn't have the /dev/kcov file present there. So we should probably add it either to the pkg/build file with the commands or have the node pre-made in the image. Which do you think is better?

Doing this in pkg/build will be simpler for now.
You will need to touch it to change kernel build config anyway, so add
node creation while you are there too.

Siddharth Muralee

unread,

May 21, 2019, 9:59:38 AM5/21/19

to Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Okay.. I will add a pull request with the same shortly.

Siddharth Muralee

unread,

May 21, 2019, 1:51:40 PM5/21/19

to Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

I am getting a kernel crash on running KASAN and KCOV together. I will discuss with Kamil and get the fix ready tomorrow.

--

Regards,

Siddharth M
Third Year B.Tech (CSE) Student,
Amrita School of Engineering, Kollam

Blog

---------------------------------------

“Most people get ahead during the time that others waste."

Dmitry Vyukov

unread,

May 22, 2019, 9:59:53 AM5/22/19

to Siddharth Muralee, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Doh! I rebuilt dest and tools (which now contains kcov.h) but now
executor doesn't start:
https://syzkaller.appspot.com/text?tag=CrashLog&x=1395a282a00000
I did not rebuild the image, so maybe image and tools conflict? I
don't know which image release I need to use.

Siddharth, could you please provide a new image+key built according to
these instructions:
https://github.com/google/syzkaller/tree/master/docs/netbsd#setting-up-a-netbsd-vm-with-qemu
and dest/tools compatible with the image?
Looking at the previous thing that I used I had dest, tools and src
dir. Now sure if we need the src. sys/targets/targets.go seems to only
use dest and tools. But can save a round-trip if you also package src.

On Tue, May 21, 2019 at 7:51 PM Siddharth Muralee

> --
> You received this message because you are subscribed to the Google Groups "syzkaller-netbsd-bugs" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to syzkaller-netbsd...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/CAB5-aq6VkOLKuQ9sK_6FCogzhiLtUi-uNoF%3DyjxCQDcFmpg5DQ%40mail.gmail.com.
> For more options, visit https://groups.google.com/d/optout.

Siddharth Muralee

unread,

May 22, 2019, 10:05:57 AM5/22/19

to Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Hey,

I was actually stuck on this error for a while. The netbsd version keeps detecting the executor binary as a data instead of a elf.

You would have to use a newer image. I think it was caused due to some relocation of libraries. I used a iso which I build from netbsd-current.

To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/CACT4Y%2Ba0_V_57AeZwAxap4jCWkyZ_d8vo5D88Lm5hx7XeKxQ5g%40mail.gmail.com.

Siddharth Muralee

unread,

May 29, 2019, 2:12:51 AM5/29/19

to Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Hey Dmitry,

I have worked on writing a script which would automate creating a bootable NetBSD image with ssh keys also. I have made it for a ubuntu distribution.

You can get the script from - https://github.com/R3x/netbsd-fuzzing-aids

The script always takes the latest NetBSD-HEAD to build the image - so that in case we face similar issues it would be able to solve them. Let me know if you have any issues with the script.

We recently pushed some changes for KCOV so you might have to rebuild the distribution again to get the changes there.

Dmitry Vyukov

unread,

May 29, 2019, 3:17:04 AM5/29/19

to Siddharth Muralee, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Thanks! This is helpful. Trying now.

Is it possible to add postfix=NO to /etc/rc.conf in this script? If
yes, please do. Postfix causes these assorted corrupted bug reports.

We need this script in dashboard/config/netbsd/ dir and mentioned
somewhere in docs/netbsd/

Dmitry Vyukov

unread,

May 29, 2019, 3:24:08 AM5/29/19

to Siddharth Muralee, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

My system was missing pip, so we need "sudo apt-get install
python-pip" mentioned somewhere in comments or in a separate target
that will install prerequisites.

After I installed pip, the script failed because anita dir already
existed, so it would be nice to have
rm -rf anita
in the beginning of -s

Also:
sed -i -e 's_#!/usr/pkg/bin/python2.4_#!/usr/bin/python_' anita/anita
will do this in-place and then we don't need mv/chmod/etc.

Dmitry Vyukov

unread,

May 29, 2019, 3:24:52 AM5/29/19

to Siddharth Muralee, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

So far -i failed with:

...
Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/binary/sets/tests.tar.xz...
OK
genisoimage \
-r \
-o \
./install_tmp.iso \
/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/download
I: -input-charset not specified, using utf-8 (detected in locale settings)
4.79% done, estimate finish Wed May 29 09:21:36 2019
9.56% done, estimate finish Wed May 29 09:21:36 2019
14.35% done, estimate finish Wed May 29 09:21:36 2019
19.12% done, estimate finish Wed May 29 09:21:36 2019
23.91% done, estimate finish Wed May 29 09:21:36 2019
28.69% done, estimate finish Wed May 29 09:21:36 2019
33.48% done, estimate finish Wed May 29 09:21:36 2019
38.25% done, estimate finish Wed May 29 09:21:36 2019
43.04% done, estimate finish Wed May 29 09:21:36 2019
47.81% done, estimate finish Wed May 29 09:21:36 2019
52.60% done, estimate finish Wed May 29 09:21:36 2019
57.37% done, estimate finish Wed May 29 09:21:36 2019
62.16% done, estimate finish Wed May 29 09:21:36 2019
66.93% done, estimate finish Wed May 29 09:21:36 2019
71.72% done, estimate finish Wed May 29 09:21:36 2019
76.50% done, estimate finish Wed May 29 09:21:36 2019
81.28% done, estimate finish Wed May 29 09:21:36 2019
86.06% done, estimate finish Wed May 29 09:21:36 2019
90.84% done, estimate finish Wed May 29 09:21:36 2019
95.63% done, estimate finish Wed May 29 09:21:36 2019
Total translation table size: 0
Total rockridge attributes bytes: 3981
Total directory bytes: 18432
Path table size(bytes): 120
Max brk space used 23000
104582 extents written (204 MB)
Creating hard disk image... done.
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \
128 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic \
-drive \
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on
\
-drive \
file=./install_tmp.iso,format=raw,media=cdrom,readonly=on \
-boot \
d
child pid is 200306
qemu-system-x86_64: -drive
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on:
Could not open './/download/amd64/installation/cdrom/boot-com.iso': No
such file or directory
Traceback (most recent call last):
File "./anita/anita", line 144, in <module>
status = main()
File "./anita/anita", line 125, in main
a.install()
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 1886, in install
self._install()
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 1144, in _install
self._install_using_sysinst()
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 1285, in _install_using_sysinst
"(Installation medium to load the additional utilities from: )|"
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 181, in expect
r = pexpect.spawn.expect(self, pattern, *args, **kwargs)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 341, in expect
timeout, searchwindowsize, async_)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 369, in expect_list
return exp.expect_loop(timeout)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 117, in expect_loop
return self.eof(e)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 63, in eof
raise EOF(msg)
pexpect.exceptions.EOF: End Of File (EOF). Exception style platform.
<anita.pexpect_spawn_log object at 0x7f21cf592910>
command: /usr/bin/qemu-system-x86_64
args: ['/usr/bin/qemu-system-x86_64', '-m', '128', '-drive',
'file=./wd0.img,format=raw,media=disk,snapshot=off', '-nographic',
'-drive', 'file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on',
'-drive', 'file=./install_tmp.iso,format=raw,media=cdrom,readonly=on',
'-boot', 'd']
buffer (last 100 chars): ''
before (last 100 chars): "=on: Could not open
'.//download/amd64/installation/cdrom/boot-com.iso': No such file or
directory\r\n"
after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True
pid: 200306
child_fd: 8
closed: False
timeout: 600
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None
logfile_read: <anita.multifile object at 0x7f21cf551290>
logfile_send: <open file '/dev/null', mode 'w' at 0x7f21cf87af60>
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 30.0
delayafterterminate: 30.0
searcher: searcher_re:
0: re.compile('(insert disk (\\d+), and press
return...)|(Installation messages in English|Installation auf
Deutsch)|(Terminal type)|(Installation medium to load the additional
utilities from: )|(1. Install NetBSD)')
Generating public/private rsa key pair.
Your identification has been saved in key.
Your public key has been saved in key.pub.
The key fingerprint is:
SHA256:LK65Qj7PAWHaOL1GG3UUCHYcTqXwxhUhBuszPJAYuw0
dvy...@dvyukov-desk.muc.corp.google.com
The key's randomart image is:
+---[RSA 2048]----+
|. =+*+B+ |
|.= Xo= |
|E + B . |
| & + . . |
|= & . S |
| o.O . . |
| o+ . . |
| .+. + |
| +*. |
+----[SHA256]-----+
This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \
'--run=echo -e '"'"'dhcpcd=YES\nsshd=YES'"'"' >> /etc/rc.conf;
mkdir .ssh; echo ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDcOFxxdMXoVe/ZwPEwU1gUibOO5LHyL4m/v4YChfj7dvsDgwe+D3gxKPeP2F0DtzYC0sChKEWNYqI88d2jiuQp+QKj7xBFdZ96LlWhB/JdHmqSfcQleGUi9sdgt+sQJEK2E6s455697uS2+MWZ9MbOhkG/qAgSbNUvgdfKmALJ9c6hgy9KYWYnLtsYSi0UyFbrJhY9eldvn1yDgneKFR9yvQRsnWJ1UfxQOChOm9IAfe3RRuH9sCuvkwGPUgbkmm5Rf+UK4ekzZzMgp9FTwSeRL9HTfLl7gSj9e6snZs6Km839CfKEwnE0Q3ICa60dvtO6DnYaxlEweEiWG7UPHOl3
dvy...@dvyukov-desk.muc.corp.google.com > .ssh/authorized_keys; sed
-e '"'"'s/^#PermitRootLogin [a-z][a-z-]*$/PermitRootLogin yes/'"'"'
/etc/ssh/sshd_config > sshd_config; mv sshd_config
/etc/ssh/sshd_config; poweroff; ' \
--persist \
--no-install \
--workdir=./ \
interact \
http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \
128 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic
child pid is 200408
qemu-system-x86_64: -drive
file=./wd0.img,format=raw,media=disk,snapshot=off: Could not open
'./wd0.img': No such file or directory
Traceback (most recent call last):
File "./anita/anita", line 144, in <module>
status = main()
File "./anita/anita", line 131, in main
a.boot()
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 1934, in boot
self.child.expect("login:")
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 181, in expect
r = pexpect.spawn.expect(self, pattern, *args, **kwargs)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 341, in expect
timeout, searchwindowsize, async_)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 369, in expect_list
return exp.expect_loop(timeout)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 117, in expect_loop
return self.eof(e)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 63, in eof
raise EOF(msg)
pexpect.exceptions.EOF: End Of File (EOF). Exception style platform.
<anita.pexpect_spawn_log object at 0x7ff5fe4153d0>
command: /usr/bin/qemu-system-x86_64
args: ['/usr/bin/qemu-system-x86_64', '-m', '128', '-drive',
'file=./wd0.img,format=raw,media=disk,snapshot=off', '-nographic']
buffer (last 100 chars): ''
before (last 100 chars): "/wd0.img,format=raw,media=disk,snapshot=off:
Could not open './wd0.img': No such file or directory\r\n"
after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True
pid: 200408
child_fd: 8
closed: False
timeout: 600
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None
logfile_read: <anita.multifile object at 0x7ff5fbd20750>
logfile_send: <open file '/dev/null', mode 'w' at 0x7ff5fc00fed0>
maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 30.0
delayafterterminate: 30.0
searcher: searcher_re:
0: re.compile('login:')
mv: cannot stat 'wd0.img': No such file or directory

Kamil Rytarowski

unread,

May 29, 2019, 3:38:41 AM5/29/19

to Dmitry Vyukov, Siddharth Muralee, syzbot, syzkaller-netbsd-bugs

On 29.05.2019 09:16, 'Dmitry Vyukov' via syzkaller-netbsd-bugs wrote:
> Thanks! This is helpful. Trying now.
>
> Is it possible to add postfix=NO to /etc/rc.conf in this script? If
> yes, please do. Postfix causes these assorted corrupted bug reports.
>

Yes, it is possible.

We might disable also other things, that are enabled, like cron scripts.

Siddarth please check `service -e` to list all of the enabled ones and
disable unneeded services.

> We need this script in dashboard/config/netbsd/ dir and mentioned
> somewhere in docs/netbsd/
>

I report that we have finally sorted out all the kUBSan reports from
dmesg(8) and we will follow up with enabling this sanitizer on syzbot.

Our plan is as follows:

- add build time switch to mark all kernel sanitizer reports fatal
- enable kUBSan + kASan + KCOV on syzbot
- set sysctl(7): ddb.onpanic=1
- extract all the information about a crash from debugger (bt,
panicstring, ...) and use this information to construct.

Maxime got some progress on Kernel MSan. Our main blocker is a
regression in LLVM that needs to be sorted out by upstream LLVM devs.

Personally I'm looking forward to Kernel TSan... but we will likely just
wait for Linux kernel here.

signature.asc

Siddharth Muralee

unread,

May 29, 2019, 4:04:54 AM5/29/19

to Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs, Kamil Rytarowski

Hmm.. Looks like it's failing to download the iso for some reason. Can you run just the install command again.

Line number 37 in my script.

Dmitry Vyukov

unread,

May 29, 2019, 4:06:10 AM5/29/19

to Kamil Rytarowski, Siddharth Muralee, syzbot, syzkaller-netbsd-bugs

More sanitizers - sounds good!

kUBSan + kASan can run together, right? But presumably kMSan will need
a separate config?
If so, we will need some changes to pkg/build and have separate configs a-la:
https://github.com/google/syzkaller/blob/master/dashboard/config/openbsd-syzkaller.mp
https://github.com/google/syzkaller/blob/master/dashboard/config/openbsd-syzkaller.sp
But this may wait utill we have kMSan.

Do we need any changes to the host tools+dest for this? Because I am
just started building a new one and it kinda takes time :)

Kamil Rytarowski

unread,

May 29, 2019, 4:17:08 AM5/29/19

to Dmitry Vyukov, Siddharth Muralee, syzbot, syzkaller-netbsd-bugs

There are still some conflicts to be resolved and we will try to get
them fixed soon. Hopefully a rule that prevents instrumentation of
sanitizer runtimes will be sufficient.

> But presumably kMSan will need
> a separate config?

Yes.

> If so, we will need some changes to pkg/build and have separate configs a-la:
> https://github.com/google/syzkaller/blob/master/dashboard/config/openbsd-syzkaller.mp
> https://github.com/google/syzkaller/blob/master/dashboard/config/openbsd-syzkaller.sp
> But this may wait utill we have kMSan.
>

kMSan is a long term plan, certainly after GSoC. Siddharth just started
full-time work on syzkaller as a GSoC student.

> Do we need any changes to the host tools+dest for this? Because I am
> just started building a new one and it kinda takes time :)
>

No need to interrupt the rebuild of tools/dest/distr.

We will try to maximize the utility of a single setup.

signature.asc

Dmitry Vyukov

unread,

May 29, 2019, 4:31:08 AM5/29/19

to Kamil Rytarowski, Siddharth Muralee, syzbot, syzkaller-netbsd-bugs

ack

I re-run anita install line alone and it indeed progressed much
further now (see full output below).

netbsd$ ./anita/anita --workdir=./ install
http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/

This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \

Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/binary/sets/tests.tar.xz...
OK
genisoimage \
-r \
-o \
./install_tmp.iso \
/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/download
I: -input-charset not specified, using utf-8 (detected in locale settings)

2.25% done, estimate finish Wed May 29 10:07:54 2019
4.48% done, estimate finish Wed May 29 10:07:54 2019
6.73% done, estimate finish Wed May 29 10:07:54 2019
8.96% done, estimate finish Wed May 29 10:07:54 2019
11.21% done, estimate finish Wed May 29 10:07:54 2019
13.45% done, estimate finish Wed May 29 10:07:54 2019
15.69% done, estimate finish Wed May 29 10:07:54 2019
17.93% done, estimate finish Wed May 29 10:07:54 2019
20.17% done, estimate finish Wed May 29 10:07:54 2019
22.41% done, estimate finish Wed May 29 10:07:54 2019
24.65% done, estimate finish Wed May 29 10:07:54 2019
26.89% done, estimate finish Wed May 29 10:07:54 2019
29.14% done, estimate finish Wed May 29 10:07:54 2019
31.37% done, estimate finish Wed May 29 10:07:54 2019
33.62% done, estimate finish Wed May 29 10:07:54 2019
35.86% done, estimate finish Wed May 29 10:07:54 2019
38.10% done, estimate finish Wed May 29 10:07:56 2019
40.34% done, estimate finish Wed May 29 10:07:56 2019
42.58% done, estimate finish Wed May 29 10:07:56 2019
44.82% done, estimate finish Wed May 29 10:07:56 2019
47.06% done, estimate finish Wed May 29 10:07:56 2019
49.30% done, estimate finish Wed May 29 10:07:56 2019
51.54% done, estimate finish Wed May 29 10:07:55 2019
53.79% done, estimate finish Wed May 29 10:07:55 2019
56.02% done, estimate finish Wed May 29 10:07:55 2019
58.27% done, estimate finish Wed May 29 10:07:55 2019
60.51% done, estimate finish Wed May 29 10:07:55 2019
62.75% done, estimate finish Wed May 29 10:07:55 2019
64.99% done, estimate finish Wed May 29 10:07:55 2019
67.23% done, estimate finish Wed May 29 10:07:55 2019
69.47% done, estimate finish Wed May 29 10:07:55 2019
71.71% done, estimate finish Wed May 29 10:07:55 2019
73.95% done, estimate finish Wed May 29 10:07:55 2019
76.20% done, estimate finish Wed May 29 10:07:55 2019
78.43% done, estimate finish Wed May 29 10:07:55 2019
80.68% done, estimate finish Wed May 29 10:07:55 2019
82.92% done, estimate finish Wed May 29 10:07:55 2019
85.16% done, estimate finish Wed May 29 10:07:55 2019
87.40% done, estimate finish Wed May 29 10:07:55 2019
89.64% done, estimate finish Wed May 29 10:07:55 2019
91.88% done, estimate finish Wed May 29 10:07:55 2019
94.12% done, estimate finish Wed May 29 10:07:55 2019
96.37% done, estimate finish Wed May 29 10:07:55 2019
98.60% done, estimate finish Wed May 29 10:07:55 2019

Total translation table size: 0

Total rockridge attributes bytes: 3965

Total directory bytes: 18432
Path table size(bytes): 120
Max brk space used 23000

223118 extents written (435 MB)

Creating hard disk image... done.
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \
128 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic \
-drive \
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on
\
-drive \
file=./install_tmp.iso,format=raw,media=cdrom,readonly=on \
-boot \
d

child pid is 83532

>> NetBSD/x86 BIOS Boot, Revision 5.11 (Tue May 28 16:43:24 UTC 2019) (from NetBSD 8.99.41)
>> Memory: 639/129920 k

1. Boot normally
2. Boot single user
3. Drop to boot prompt

Choose an option; RETURN for default; SPACE to stop countdown.
Option 1 will be chosen in 0 seconds.
command(s): rndseed /var/db/entropy-file;boot
default boot twice, skipping...
20945096+662048+1435104 [1310160+927856+17850]=0x1827730
WARNING: couldn't open /var/db/entropy-file
Loading /stand/amd64/8.99.41/modules/cd9660/cd9660.kmod
WARNING: 1 module failed to load
[ 1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002,
2003, 2004, 2005,
[ 1.0000000] 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013,
2014, 2015, 2016, 2017,
[ 1.0000000] 2018, 2019 The NetBSD Foundation, Inc. All rights reserved.
[ 1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[ 1.0000000] The Regents of the University of California. All
rights reserved.

[ 1.0000000] NetBSD 8.99.41 (GENERIC) #0: Tue May 28 16:43:24 UTC 2019
[ 1.0000000] mkr...@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC
[ 1.0000000] total memory = 127 MB
[ 1.0000000] avail memory = 98 MB
[ 1.0000000] WARNING: module error: module `cd9660' pushed by boot
loader already exists
[ 1.0000000] running cgd selftest aes-xts-256 aes-xts-512 done
[ 1.0000030] mainbus0 (root)
[ 1.0000030] ACPI: RSDP 0x00000000000F68D0 000014 (v00 BOCHS )
[ 1.0000030] ACPI: RSDT 0x0000000007FE156F 000030 (v01 BOCHS
BXPCRSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACP 0x0000000007FE144B 000074 (v01 BOCHS
BXPCFACP 00000001 BXPC 00000001)
[ 1.0000030] ACPI: DSDT 0x0000000007FE0040 00140B (v01 BOCHS
BXPCDSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACS 0x0000000007FE0000 000040
[ 1.0000030] ACPI: APIC 0x0000000007FE14BF 000078 (v01 BOCHS
BXPCAPIC 00000001 BXPC 00000001)
[ 1.0000030] ACPI: HPET 0x0000000007FE1537 000038 (v01 BOCHS
BXPCHPET 00000001 BXPC 00000001)
[ 1.0000030] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 1.0000030] ioapic0 at mainbus0 apid 0
[ 1.0000030] cpu0 at mainbus0 apid 0
[ 1.0000030] cpu0: QEMU Virtual CPU version 2.5+, id 0x663
[ 1.0000030] cpu0: package 0, core 0, smt 0
[ 1.0000030] acpi0 at mainbus0: Intel ACPICA 20190405
[ 1.0000030] acpi0: fixed power button present
[ 1.0123339] hpet0 at acpi0: high precision event timer (mem
0xfed00000-0xfed00400)
[ 1.0133893] pckbc1 at acpi0 (KBD, PNP0303) (kbd port): io 0x60,0x64 irq 1
[ 1.0133893] pckbc2 at acpi0 (MOU, PNP0F13) (aux port): irq 12
[ 1.0133893] FDC0 (PNP0700) at acpi0 not configured
[ 1.0133893] LPT (PNP0400) at acpi0 not configured
[ 1.0133893] COM1 (PNP0501) at acpi0 not configured
[ 1.0133893] qemufwcfg0 at acpi0 (FWCF, QEMU0002): io 0x510-0x51b
[ 1.0133893] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 1.0133893] pckbd0 at pckbc1 (kbd slot)
[ 1.0133893] pckbc1: using irq 1 for kbd slot
[ 1.0133893] wskbd0 at pckbd0 mux 1
[ 1.0133893] pms0 at pckbc1 (aux slot)
[ 1.0133893] pckbc1: using irq 12 for aux slot
[ 1.0133893] wsmouse0 at pms0 mux 0
[ 1.0133893] pci0 at mainbus0 bus 0: configuration mode 1
[ 1.0133893] pchb0 at pci0 dev 0 function 0: vendor 8086 product
1237 (rev. 0x02)
[ 1.0133893] pcib0 at pci0 dev 1 function 0: vendor 8086 product
7000 (rev. 0x00)
[ 1.0133893] piixide0 at pci0 dev 1 function 1: Intel 82371SB IDE
Interface (PIIX3) (rev. 0x00)
[ 1.0133893] piixide0: primary channel interrupting at ioapic0 pin 14
[ 1.0133893] atabus0 at piixide0 channel 0
[ 1.0133893] piixide0: secondary channel interrupting at ioapic0 pin 15
[ 1.0133893] atabus1 at piixide0 channel 1
[ 1.0133893] piixpm0 at pci0 dev 1 function 3: vendor 8086 product
7113 (rev. 0x03)
[ 1.0133893] piixpm0: 24-bit timer
[ 1.0133893] piixpm0: interrupting at ioapic0 pin 9
[ 1.0133893] iic0 at piixpm0: I2C bus
[ 1.0133893] vga0 at pci0 dev 2 function 0: vendor 1234 product 1111
(rev. 0x02)
[ 1.0133893] wsdisplay0 at vga0 kbdmux 1
[ 1.0133893] drm at vga0 not configured
[ 1.0133893] wm0 at pci0 dev 3 function 0: Intel i82540EM 1000BASE-T
Ethernet (rev. 0x03)
[ 1.0133893] wm0: interrupting at ioapic0 pin 11
[ 1.0133893] wm0: Ethernet address 52:54:00:12:34:56
[ 1.0133893] makphy0 at wm0 phy 1: Marvell 88E1011 Gigabit PHY, rev. 0
[ 1.0133893] makphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
[ 1.0133893] isa0 at pcib0
[ 1.0133893] lpt0 at isa0 port 0x378-0x37b irq 7
[ 1.0133893] com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
[ 1.0133893] com0: console
[ 1.0133893] attimer0 at isa0 port 0x40-0x43
[ 1.0133893] pcppi0 at isa0 port 0x61
[ 1.0133893] spkr0 at pcppi0: PC Speaker
[ 1.0133893] wsbell at spkr0 not configured
[ 1.0133893] midi0 at pcppi0: PC speaker
[ 1.0133893] sysbeep0 at pcppi0
[ 1.0133893] fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
[ 1.0133893] attimer0: attached to pcppi0
[ 1.0133893] acpicpu0 at cpu0: ACPI CPU
[ 1.9155908] fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
[ 1.9253416] atapibus0 at atabus0: 2 targets
[ 1.9253416] cd0 at atapibus0 drive 1: <QEMU DVD-ROM, QM00002, 2.5+>
cdrom removable
[ 1.9354439] wd0 at atabus0 drive 0
[ 1.9354439] wd0: <QEMU HARDDISK>
[ 1.9354439] wd0: 1536 MB, 3120 cyl, 16 head, 63 sec, 512 bytes/sect
x 3145728 sectors
[ 4.9688583] atapibus1 at atabus1: 2 targets
[ 4.9787840] cd1 at atapibus1 drive 0: <QEMU DVD-ROM, QM00003, 2.5+>
cdrom removable
[ 4.9887475] boot device: cd0
[ 4.9989119] root on cd0a dumps on cd0b
[ 4.9989119] root file system type: cd9660
[ 5.0088108] kern.module.path=/stand/amd64/8.99.41/modules
[ 5.0088108] clock: unknown CMOS layout

You are using a serial console, we do not know your terminal emulation.
Please select one, typical values are:

vt100
ansi
xterm

Terminal type (just hit ENTER for 'vt220'): xterm

To return to the installer, quit this shell by typing 'exit' or ^D.
# halt
halt: halted by root
netbsd$

Dmitry Vyukov

unread,

May 29, 2019, 4:37:18 AM5/29/19

to Kamil Rytarowski, Siddharth Muralee, syzbot, syzkaller-netbsd-bugs

Wait, the script tried to use key.pub, but I don't have it anymore.
Because the previous run of the whole script did:
mv key* out/

It would be nice to (1) do "set -eu", (2) remove old leftovers at the
beginning and allow it to run again from clean state. Something like
"rm -rf out key key.pub" before "mkdir out" (it currently fails on
second run).

Also please rename out/netbsd.img to out/image, that's what pkg/build expects.

Siddharth Muralee

unread,

May 29, 2019, 4:55:12 AM5/29/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

Okay.. I will make the changes you have mentioned and update the script in a while.

Anita tends to have network issues sometimes, I assume that's what happened last time.

Do we have the image ready now? or are we still having issues?

Dmitry Vyukov

unread,

May 29, 2019, 4:57:38 AM5/29/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

On Wed, May 29, 2019 at 10:55 AM Siddharth Muralee
<siddhart...@gmail.com> wrote:
>
> Okay.. I will make the changes you have mentioned and update the script in a while.
>
> Anita tends to have network issues sometimes, I assume that's what happened last time.
> Do we have the image ready now? or are we still having issues?

I have the image now. Still rebuilding dest to test it

Siddharth Muralee

unread,

May 29, 2019, 5:01:06 AM5/29/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

Cool.. ssh works right?

Dmitry Vyukov

unread,

May 29, 2019, 9:20:57 AM5/29/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

We alive and kicking again!

And even got a new bug immediately:
https://syzkaller.appspot.com/bug?extid=ef4d928035235c13f317

The image and dest that syzbot uses are available here:
https://storage.googleapis.com/syzkaller/netbsd-image.raw
https://storage.googleapis.com/syzkaller/netbsd-image.key
https://storage.googleapis.com/syzkaller/netbsd-dest.tar.gz
(may be worth mentioning somewhere in docs too).

... but no, when I enabled coverage, manager failed:

2019/05/29 13:07:11 machine check: program execution failed: executor 0: EOF
open of /dev/kcov failed (errno 2)

This part in pkg/build/netbsd.go is problematic:

outc, errc, err := inst.Run(time.Minute, nil, strings.Join(commands, ";"))

it silently ignores all errors. So probably mknod /dev/kcov failed
with some error, but we don't see why/how.

On Wed, May 29, 2019 at 11:01 AM Siddharth Muralee

Kamil Rytarowski

unread,

May 29, 2019, 9:53:33 AM5/29/19

to Dmitry Vyukov, Siddharth Muralee, syzbot, syzkaller-netbsd-bugs

On 29.05.2019 15:20, 'Dmitry Vyukov' via syzkaller-netbsd-bugs wrote:
> We alive and kicking again!
>
> And even got a new bug immediately:
> https://syzkaller.appspot.com/bug?extid=ef4d928035235c13f317
>
> The image and dest that syzbot uses are available here:
> https://storage.googleapis.com/syzkaller/netbsd-image.raw
> https://storage.googleapis.com/syzkaller/netbsd-image.key
> https://storage.googleapis.com/syzkaller/netbsd-dest.tar.gz
> (may be worth mentioning somewhere in docs too).
>
> ... but no, when I enabled coverage, manager failed:
>
> 2019/05/29 13:07:11 machine check: program execution failed: executor 0: EOF
> open of /dev/kcov failed (errno 2)
>
> This part in pkg/build/netbsd.go is problematic:
>
> outc, errc, err := inst.Run(time.Minute, nil, strings.Join(commands, ";"))
>
> it silently ignores all errors. So probably mknod /dev/kcov failed
> with some error, but we don't see why/how.
>

Errno 2 is for ENOENT.

2 ENOENT No such file or directory. A component of a specified pathname
did not exist, or the pathname was an empty string.

-- errno(2)

We will have a look!

signature.asc

Siddharth Muralee

unread,

May 29, 2019, 1:43:55 PM5/29/19

to Kamil Rytarowski, Dmitry Vyukov, syzbot, syzkaller-netbsd-bugs

Hey Dmitry,

I have made the necessary changes to the script.

Can you share your config file you are using for running syz-manager.

Regarding pkg/build/netbsd.go - is there another approach you would suggest to run those commands? We can also make the node on the image itself in our script.

--
You received this message because you are subscribed to the Google Groups "syzkaller-netbsd-bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to syzkaller-netbsd...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/88b9fee8-e4cc-21a2-b95a-13363c31fe79%40gmx.com.

For more options, visit https://groups.google.com/d/optout.

Siddharth Muralee

unread,

May 31, 2019, 12:42:54 AM5/31/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

Hey Dmitry,

We were planning to add a ddb shell and print out the important parts with it like openBSD does it. This might need us to actually change the regex expressions - so we can expect a change to maybe all the testdata we have - should we start the testdata from scratch again?

PS. Would be helpful if you could share your syz-manager config. I am having some trouble with it.

Dmitry Vyukov

unread,

May 31, 2019, 11:38:26 AM5/31/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

On Wed, May 29, 2019 at 7:43 PM Siddharth Muralee
<siddhart...@gmail.com> wrote:
>
> Hey Dmitry,
> I have made the necessary changes to the script.
>
> Can you share your config file you are using for running syz-manager.

Here is the config syzbot uses (without hub/dashboard settings):

{
"name": "netbsd",
"target": "netbsd/amd64",
"http": ":12345",
"workdir": "/syzkaller/managers/netbsd/workdir",
"kernel_obj": "/syzkaller/managers/netbsd/current/obj",
"kernel_src": "/syzkaller/managers/netbsd/kernel",
"tag": "37f7c13cfe3d9e7805311d08cbcfae308b7b482e",
"image": "/syzkaller/managers/netbsd/current/image",
"sshkey": "/syzkaller/managers/netbsd/current/key",
"syzkaller": "/syzkaller/syzkaller/current",
"procs": 6,
"sandbox": "none",
"cover": true,
"reproduce": true,
"type": "gce",
"vm": {
"count": 10,
"gcs_path": "syzkaller",
"machine_type": "n1-standard-2",
"preemptible": true

}
}

> Regarding pkg/build/netbsd.go - is there another approach you would suggest to run those commands? We can also make the node on the image itself in our script.

I would start by replacing ; with && so that it does not ignore
failures silently. Then we will at least know if it succeeded of
failed to mknod.

> To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/CAB5-aq6gM0SDc5-vpF5%3D_Ee4J1aiNKPSMe_SLf%3D9T4Ci7SMdjg%40mail.gmail.com.

Dmitry Vyukov

unread,

May 31, 2019, 11:40:27 AM5/31/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

On Fri, May 31, 2019 at 6:42 AM Siddharth Muralee
<siddhart...@gmail.com> wrote:
>
> Hey Dmitry,
>
> We were planning to add a ddb shell and print out the important parts with it like openBSD does it. This might need us to actually change the regex expressions - so we can expect a change to maybe all the testdata we have - should we start the testdata from scratch again?

If the old ones won't be parsed anymore, then I guess we need to start
from scratch.
We don't do that for linux because we actually support 5-year old
kernels and their output. But if we care only about tip for netbsd,
then starting from scratch should be fine.

Siddharth Muralee

unread,

Jun 4, 2019, 6:10:54 AM6/4/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

Hey Dmitry,

Syz-manager now works fine for me with the image. Is code coverage still not working on the syzbot instance?

I have moved the - 'touch /fastboot' and 'mknod /dev/kcov c 346 0' to my image building script[1] - I will work with Kamil to optimize is as much as possible in the coming weeks.

If we have any errors on the image building scripting it will be seen in the log - and I guess it makes more sense to have it there.

I have also increased disk-size since I noticed that currently it is pretty less.

I have also added and tested the ddb commands. And they are also added to the image build script.

Can you take a look at it?

[1]https://github.com/R3x/netbsd-fuzzing-aids

Dmitry Vyukov

unread,

Jun 4, 2019, 7:32:59 AM6/4/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

It now hangs at this point for me. I wait for minutes, but nothing happens...

$ ./install.sh -i
Installing a NetBSD image

This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \
--workdir=./ \

--disk-size=8G \
--memory-size=1024M \
install \
http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/

genisoimage \
-r \
-o \
./install_tmp.iso \
/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/download
I: -input-charset not specified, using utf-8 (detected in locale settings)

Using MODUL000.MIS;1 for
/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/download/amd64/binary/sets/modules.tgz.MISSING
(modules.tar.xz.MISSING)
3.28% done, estimate finish Tue Jun 4 13:22:23 2019
98.30% done, estimate finish Tue Jun 4 13:22:23 2019

Total translation table size: 0

Total rockridge attributes bytes: 4250

Total directory bytes: 18432
Path table size(bytes): 120
Max brk space used 23000

152601 extents written (298 MB)

Creating hard disk image... done.
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \

1024 \

-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic \
-drive \
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on
\
-drive \
file=./install_tmp.iso,format=raw,media=cdrom,readonly=on \
-boot \
d

child pid is 176599

Dmitry Vyukov

unread,

Jun 4, 2019, 7:58:28 AM6/4/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

When I deleted downloads dir and restarted I got this new error:
https://gist.githubusercontent.com/dvyukov/4feada390f02ff99964e4d32d3cbf434/raw/eeaffc8d4cc8b50b0bf322ad68f29abe847e1e63/gistfile1.txt

Dmitry Vyukov

unread,

Jun 4, 2019, 9:13:20 AM6/4/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

This was fixed in netbsd image:

#syz invalid

Siddharth Muralee

unread,

Jun 4, 2019, 10:52:50 AM6/4/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

That's strange it works perfectly fine for me.

When I deleted downloads dir and restarted I got this new error:
https://gist.githubusercontent.com/dvyukov/4feada390f02ff99964e4d32d3cbf434/raw/eeaffc8d4cc8b50b0bf322ad68f29abe847e1e63/gistfile1.txt

This error looks like its trying to load some existing image. is there a wd0.img in the same directory?

Dmitry Vyukov

unread,

Jun 6, 2019, 4:37:23 AM6/6/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

No, there is no wd0.img.

New day, new failure mode:

netbsd$ ./install.sh -i
+ '[' 1 -eq 0 ']'
+ getopts si opt
+ case "${opt}" in
+ echo 'Installing a NetBSD image'
Installing a NetBSD image
+ rm -rf out
+ mkdir out/
+ ./anita/anita --workdir=./ --disk-size=2G --memory-size=1G install
http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/

This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \
--workdir=./ \

--disk-size=2G \
--memory-size=1G \

Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/installation/misc/pxeboot_ia32.bin...
OK
Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/binary/kernel/netbsd-INSTALL.gz...

missing but optional, so that's OK

genisoimage \
-r \
-o \
./install_tmp.iso \
/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/download
I: -input-charset not specified, using utf-8 (detected in locale settings)

4.78% done, estimate finish Thu Jun 6 10:35:06 2019

Total translation table size: 0

Total rockridge attributes bytes: 3981

Total directory bytes: 18432
Path table size(bytes): 120
Max brk space used 23000

104746 extents written (204 MB)

Creating hard disk image... done.
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \
1024 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic \
-drive \
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on
\
-drive \
file=./install_tmp.iso,format=raw,media=cdrom,readonly=on \
-boot \
d

child pid is 27792

<anita.pexpect_spawn_log object at 0x7f7f340d8b50>
command: /usr/bin/qemu-system-x86_64
args: ['/usr/bin/qemu-system-x86_64', '-m', '1024', '-drive',

'file=./wd0.img,format=raw,media=disk,snapshot=off', '-nographic',
'-drive', 'file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on',
'-drive', 'file=./install_tmp.iso,format=raw,media=cdrom,readonly=on',
'-boot', 'd']
buffer (last 100 chars): ''
before (last 100 chars): "=on: Could not open
'.//download/amd64/installation/cdrom/boot-com.iso': No such file or
directory\r\n"
after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True

pid: 27792

child_fd: 8
closed: False
timeout: 600
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None

logfile_read: <anita.multifile object at 0x7f7f34098510>
logfile_send: <open file '/dev/null', mode 'w' at 0x7f7f343c7ed0>

maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 30.0
delayafterterminate: 30.0
searcher: searcher_re:
0: re.compile('(insert disk (\\d+), and press
return...)|(Installation messages in English|Installation auf
Deutsch)|(Terminal type)|(Installation medium to load the additional
utilities from: )|(1. Install NetBSD)')

^C

Dmitry Vyukov

unread,

Jun 6, 2019, 4:39:33 AM6/6/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/installation/cdrom/boot-com.iso...
missing but optional, so that's OK

No, you are wrong!

Is it expected that it always spews python stacks meaningless for
user, then ignores the errors and then produces even more confusing
failure modes? ;)

Dmitry Vyukov

unread,

Jun 6, 2019, 4:45:02 AM6/6/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

It would be nice it would also try to re-download missing files on
subsequent runs.
Deleting everything and restarting several times, it now seems to be
doing something that looks like image installation. Fingers crossed.
If this attempt won't work, I will have to ask you to just give me a
working image+tools+dest (and please make the image 2GB if that's
enough).

Dmitry Vyukov

unread,

Jun 7, 2019, 7:54:14 AM6/7/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

On Thu, Jun 6, 2019 at 10:44 AM Dmitry Vyukov <dvy...@google.com> wrote:
>
> It would be nice it would also try to re-download missing files on
> subsequent runs.
> Deleting everything and restarting several times, it now seems to be
> doing something that looks like image installation. Fingers crossed.
> If this attempt won't work, I will have to ask you to just give me a
> working image+tools+dest (and please make the image 2GB if that's
> enough).

No, it keeps failing with different errors at different stages. The last one:

netbsd$ rm -rf wd0.img key key.pub out download
^[[A^[[A./install.sh -i

+ '[' 1 -eq 0 ']'
+ getopts si opt
+ case "${opt}" in
+ echo 'Installing a NetBSD image'
Installing a NetBSD image
+ rm -rf out
+ mkdir out/

+ ./anita/anita --workdir=./ --disk-size=8G --memory-size=1G install

http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/
This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \
--workdir=./ \

--disk-size=8G \

OK
Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/installation/misc/pxeboot_ia32.bin...
OK
Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/binary/kernel/netbsd-INSTALL.gz...

2.24% done, estimate finish Thu Jun 6 17:55:09 2019
4.48% done, estimate finish Thu Jun 6 17:55:09 2019
6.72% done, estimate finish Thu Jun 6 17:55:09 2019
8.96% done, estimate finish Thu Jun 6 17:55:09 2019
11.20% done, estimate finish Thu Jun 6 17:55:09 2019
13.44% done, estimate finish Thu Jun 6 17:55:09 2019
15.68% done, estimate finish Thu Jun 6 17:55:09 2019
17.91% done, estimate finish Thu Jun 6 17:55:09 2019
20.16% done, estimate finish Thu Jun 6 17:55:09 2019
22.39% done, estimate finish Thu Jun 6 17:55:09 2019
24.64% done, estimate finish Thu Jun 6 17:55:09 2019
26.87% done, estimate finish Thu Jun 6 17:55:09 2019
29.11% done, estimate finish Thu Jun 6 17:55:09 2019
31.35% done, estimate finish Thu Jun 6 17:55:09 2019
33.59% done, estimate finish Thu Jun 6 17:55:09 2019
35.83% done, estimate finish Thu Jun 6 17:55:09 2019
38.07% done, estimate finish Thu Jun 6 17:55:09 2019
40.31% done, estimate finish Thu Jun 6 17:55:09 2019
42.55% done, estimate finish Thu Jun 6 17:55:09 2019
44.79% done, estimate finish Thu Jun 6 17:55:09 2019
47.03% done, estimate finish Thu Jun 6 17:55:09 2019
49.26% done, estimate finish Thu Jun 6 17:55:09 2019
51.51% done, estimate finish Thu Jun 6 17:55:09 2019
53.74% done, estimate finish Thu Jun 6 17:55:09 2019
55.99% done, estimate finish Thu Jun 6 17:55:09 2019
58.22% done, estimate finish Thu Jun 6 17:55:09 2019
60.46% done, estimate finish Thu Jun 6 17:55:09 2019
62.70% done, estimate finish Thu Jun 6 17:55:09 2019
64.94% done, estimate finish Thu Jun 6 17:55:09 2019
67.18% done, estimate finish Thu Jun 6 17:55:09 2019
69.42% done, estimate finish Thu Jun 6 17:55:09 2019
71.66% done, estimate finish Thu Jun 6 17:55:09 2019
73.90% done, estimate finish Thu Jun 6 17:55:09 2019
76.13% done, estimate finish Thu Jun 6 17:55:09 2019
78.38% done, estimate finish Thu Jun 6 17:55:09 2019
80.61% done, estimate finish Thu Jun 6 17:55:09 2019
82.86% done, estimate finish Thu Jun 6 17:55:09 2019
85.09% done, estimate finish Thu Jun 6 17:55:09 2019
87.33% done, estimate finish Thu Jun 6 17:55:09 2019
89.57% done, estimate finish Thu Jun 6 17:55:09 2019
91.81% done, estimate finish Thu Jun 6 17:55:09 2019
94.05% done, estimate finish Thu Jun 6 17:55:09 2019
96.29% done, estimate finish Thu Jun 6 17:55:09 2019
98.53% done, estimate finish Thu Jun 6 17:55:09 2019

Total translation table size: 0

Total rockridge attributes bytes: 3965

Total directory bytes: 18432
Path table size(bytes): 120
Max brk space used 23000

223291 extents written (436 MB)

Creating hard disk image... done.
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \
1024 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic \
-drive \
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on
\
-drive \
file=./install_tmp.iso,format=raw,media=cdrom,readonly=on \
-boot \
d

child pid is 144561

>> NetBSD/x86 BIOS Boot, Revision 5.11 (Wed Jun 5 07:22:49 UTC 2019) (from NetBSD 8.99.42)
>> Memory: 639/1047424 k

1. Boot normally
2. Boot single user
3. Drop to boot prompt

Choose an option; RETURN for default; SPACE to stop countdown.
Option 1 will be chosen in 0 seconds.
command(s): rndseed /var/db/entropy-file;boot
default boot twice, skipping...

20945936+662048+1435104 [1310256+928206+17850]=0x18278f0

WARNING: couldn't open /var/db/entropy-file

Loading /stand/amd64/8.99.42/modules/cd9660/cd9660.kmod

WARNING: 1 module failed to load
[ 1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002,
2003, 2004, 2005,
[ 1.0000000] 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013,
2014, 2015, 2016, 2017,
[ 1.0000000] 2018, 2019 The NetBSD Foundation, Inc. All rights reserved.
[ 1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[ 1.0000000] The Regents of the University of California. All
rights reserved.

[ 1.0000000] NetBSD 8.99.42 (GENERIC) #0: Wed Jun 5 07:22:49 UTC 2019
[ 1.0000000] mkr...@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC
[ 1.0000000] total memory = 1023 MB
[ 1.0000000] avail memory = 968 MB

[ 1.0000000] WARNING: module error: module `cd9660' pushed by boot
loader already exists
[ 1.0000000] running cgd selftest aes-xts-256 aes-xts-512 done
[ 1.0000030] mainbus0 (root)
[ 1.0000030] ACPI: RSDP 0x00000000000F68D0 000014 (v00 BOCHS )

[ 1.0000030] ACPI: RSDT 0x000000003FFE156F 000030 (v01 BOCHS
BXPCRSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACP 0x000000003FFE144B 000074 (v01 BOCHS
BXPCFACP 00000001 BXPC 00000001)
[ 1.0000030] ACPI: DSDT 0x000000003FFE0040 00140B (v01 BOCHS
BXPCDSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACS 0x000000003FFE0000 000040
[ 1.0000030] ACPI: APIC 0x000000003FFE14BF 000078 (v01 BOCHS
BXPCAPIC 00000001 BXPC 00000001)
[ 1.0000030] ACPI: HPET 0x000000003FFE1537 000038 (v01 BOCHS

BXPCHPET 00000001 BXPC 00000001)
[ 1.0000030] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 1.0000030] ioapic0 at mainbus0 apid 0
[ 1.0000030] cpu0 at mainbus0 apid 0
[ 1.0000030] cpu0: QEMU Virtual CPU version 2.5+, id 0x663
[ 1.0000030] cpu0: package 0, core 0, smt 0
[ 1.0000030] acpi0 at mainbus0: Intel ACPICA 20190405
[ 1.0000030] acpi0: fixed power button present

[ 1.0324767] hpet0 at acpi0: high precision event timer (mem
0xfed00000-0xfed00400)
[ 1.0335282] pckbc1 at acpi0 (KBD, PNP0303) (kbd port): io 0x60,0x64 irq 1
[ 1.0335282] pckbc2 at acpi0 (MOU, PNP0F13) (aux port): irq 12
[ 1.0335282] FDC0 (PNP0700) at acpi0 not configured
[ 1.0335282] LPT (PNP0400) at acpi0 not configured
[ 1.0335282] COM1 (PNP0501) at acpi0 not configured
[ 1.0335282] qemufwcfg0 at acpi0 (FWCF, QEMU0002): io 0x510-0x51b
[ 1.0335282] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 1.0335282] pckbd0 at pckbc1 (kbd slot)
[ 1.0335282] pckbc1: using irq 1 for kbd slot
[ 1.0335282] wskbd0 at pckbd0 mux 1
[ 1.0335282] pms0 at pckbc1 (aux slot)
[ 1.0335282] pckbc1: using irq 12 for aux slot
[ 1.0335282] wsmouse0 at pms0 mux 0
[ 1.0335282] pci0 at mainbus0 bus 0: configuration mode 1
[ 1.0335282] pchb0 at pci0 dev 0 function 0: vendor 8086 product
1237 (rev. 0x02)
[ 1.0335282] pcib0 at pci0 dev 1 function 0: vendor 8086 product
7000 (rev. 0x00)
[ 1.0335282] piixide0 at pci0 dev 1 function 1: Intel 82371SB IDE
Interface (PIIX3) (rev. 0x00)
[ 1.0335282] piixide0: primary channel interrupting at ioapic0 pin 14
[ 1.0335282] atabus0 at piixide0 channel 0
[ 1.0335282] piixide0: secondary channel interrupting at ioapic0 pin 15
[ 1.0335282] atabus1 at piixide0 channel 1
[ 1.0335282] piixpm0 at pci0 dev 1 function 3: vendor 8086 product
7113 (rev. 0x03)
[ 1.0335282] piixpm0: 24-bit timer
[ 1.0335282] piixpm0: interrupting at ioapic0 pin 9
[ 1.0335282] iic0 at piixpm0: I2C bus
[ 1.0335282] vga0 at pci0 dev 2 function 0: vendor 1234 product 1111
(rev. 0x02)
[ 1.0335282] wsdisplay0 at vga0 kbdmux 1
[ 1.0335282] drm at vga0 not configured
[ 1.0335282] wm0 at pci0 dev 3 function 0: Intel i82540EM 1000BASE-T
Ethernet (rev. 0x03)
[ 1.0335282] wm0: interrupting at ioapic0 pin 11
[ 1.0335282] wm0: Ethernet address 52:54:00:12:34:56
[ 1.0335282] makphy0 at wm0 phy 1: Marvell 88E1011 Gigabit PHY, rev. 0
[ 1.0335282] makphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
[ 1.0335282] isa0 at pcib0
[ 1.0335282] lpt0 at isa0 port 0x378-0x37b irq 7
[ 1.0335282] com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
[ 1.0335282] com0: console
[ 1.0335282] attimer0 at isa0 port 0x40-0x43
[ 1.0335282] pcppi0 at isa0 port 0x61
[ 1.0335282] spkr0 at pcppi0: PC Speaker
[ 1.0335282] wsbell at spkr0 not configured
[ 1.0335282] midi0 at pcppi0: PC speaker
[ 1.0335282] sysbeep0 at pcppi0
[ 1.0335282] fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
[ 1.0335282] attimer0: attached to pcppi0
[ 1.0335282] acpicpu0 at cpu0: ACPI CPU
[ 1.9447680] fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
[ 1.9447680] atapibus0 at atabus0: 2 targets
[ 1.9547720] cd0 at atapibus0 drive 1: <QEMU DVD-ROM, QM00002, 2.5+>
cdrom removable
[ 1.9547720] wd0 at atabus0 drive 0
[ 1.9547720] wd0: <QEMU HARDDISK>
[ 1.9547720] wd0: 8192 MB, 16644 cyl, 16 head, 63 sec, 512
bytes/sect x 16777216 sectors
[ 5.2784307] atapibus1 at atabus1: 2 targets
[ 5.2884032] cd1 at atapibus1 drive 0: <QEMU DVD-ROM, QM00003, 2.5+>
cdrom removable
[ 5.2984115] boot device: cd0
[ 5.3083258] root on cd0a dumps on cd0b
[ 5.3185023] root file system type: cd9660
[ 5.3185023] kern.module.path=/stand/amd64/8.99.42/modules
[ 5.3185023] clock: unknown CMOS layout

You are using a serial console, we do not know your terminal emulation.
Please select one, typical values are:

vt100
ansi
xterm

Terminal type (just hit ENTER for 'vt220'): xterm

To return to the installer, quit this shell by typing 'exit' or ^D.
# halt
halt: halted by root

+ ssh-keygen -t rsa -f key -N ''

Generating public/private rsa key pair.
Your identification has been saved in key.
Your public key has been saved in key.pub.
The key fingerprint is:

SHA256:rtTBVKYUsgernmThRXZycq6YnARi/a1A0rUMkIb0Sto

dvy...@dvyukov-desk.muc.corp.google.com
The key's randomart image is:
+---[RSA 2048]----+

|++*...B *.o |
|o=.=oo.& + |
|..o.+o= = |
|o..= O * |
|..E @ o S |
| + o o . |
| o . o |
| . . |
| . |
+----[SHA256]-----+
++ cat key.pub
+ SSHKEY='ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzvfpIub2Ie81K6V1mONFvgGb9O/yjZEcGjDKhMvsACvWvsnt9XeQeKdCUwcPD5zoqgXJ66EkwT2GfwCPLtxPAwc6zRdhIXPgppd+yqPjFw+yILGsIOG1yqJN8VGaocQBYLQA+rSvOKyQT+NZbacqMqIVYbZju+LN0XMdjdbWtMqPilpzMMJYDW1DZlvwXdKeiqOv0Rah1WG2hi2Sz97RdKhnMBkO8sYORzeATvUJD3O9qJAkGmgksmVj1awJvslxWsJxpmJMzw+xjgGPQ1EfNGr931HUQbfsRpTMP9c7oNCfhGOdstxlt6UVSbAnl1pGew7IgeMlJ8qB7c7OS35b
dvy...@dvyukov-desk.muc.corp.google.com'
+ ./anita/anita '--run=echo -e
'\''dhcpcd=YES\nsshd=YES\npostfix=NO'\'' >> /etc/rc.conf; touch
/fastboot; mkdir .ssh; echo ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzvfpIub2Ie81K6V1mONFvgGb9O/yjZEcGjDKhMvsACvWvsnt9XeQeKdCUwcPD5zoqgXJ66EkwT2GfwCPLtxPAwc6zRdhIXPgppd+yqPjFw+yILGsIOG1yqJN8VGaocQBYLQA+rSvOKyQT+NZbacqMqIVYbZju+LN0XMdjdbWtMqPilpzMMJYDW1DZlvwXdKeiqOv0Rah1WG2hi2Sz97RdKhnMBkO8sYORzeATvUJD3O9qJAkGmgksmVj1awJvslxWsJxpmJMzw+xjgGPQ1EfNGr931HUQbfsRpTMP9c7oNCfhGOdstxlt6UVSbAnl1pGew7IgeMlJ8qB7c7OS35b
dvy...@dvyukov-desk.muc.corp.google.com > .ssh/authorized_keys; sed
-i -e '\''s/^#PermitRootLogin [a-z][a-z-]*$/PermitRootLogin yes/'\''
/etc/ssh/sshd_config; sed -i -e
'\''s/^ddb.onpanic?=0/ddb.onpanic=1/'\'' /etc/sysctl.conf; echo -e
'\''ddb.commandonenter="show panic;bt;show registers;ps;show all
locks;show all pages;show all pools"\nddb.lines=0\nddb.maxwidth=0'\''
>> /etc/sysctl.conf; mknod -rR /dev/kcov c 346 0; poweroff; '
--persist --no-install --workdir=./ interact

http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/
This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \

'--run=echo -e '"'"'dhcpcd=YES\nsshd=YES\npostfix=NO'"'"' >>
/etc/rc.conf; touch /fastboot; mkdir .ssh; echo ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzvfpIub2Ie81K6V1mONFvgGb9O/yjZEcGjDKhMvsACvWvsnt9XeQeKdCUwcPD5zoqgXJ66EkwT2GfwCPLtxPAwc6zRdhIXPgppd+yqPjFw+yILGsIOG1yqJN8VGaocQBYLQA+rSvOKyQT+NZbacqMqIVYbZju+LN0XMdjdbWtMqPilpzMMJYDW1DZlvwXdKeiqOv0Rah1WG2hi2Sz97RdKhnMBkO8sYORzeATvUJD3O9qJAkGmgksmVj1awJvslxWsJxpmJMzw+xjgGPQ1EfNGr931HUQbfsRpTMP9c7oNCfhGOdstxlt6UVSbAnl1pGew7IgeMlJ8qB7c7OS35b
dvy...@dvyukov-desk.muc.corp.google.com > .ssh/authorized_keys; sed
-i -e '"'"'s/^#PermitRootLogin [a-z][a-z-]*$/PermitRootLogin yes/'"'"'
/etc/ssh/sshd_config; sed -i -e
'"'"'s/^ddb.onpanic?=0/ddb.onpanic=1/'"'"' /etc/sysctl.conf; echo -e
'"'"'ddb.commandonenter="show panic;bt;show registers;ps;show all
locks;show all pages;show all pools"\nddb.lines=0\nddb.maxwidth=0'"'"'
>> /etc/sysctl.conf; mknod -rR /dev/kcov c 346 0; poweroff; ' \

--persist \
--no-install \
--workdir=./ \
interact \
http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/

QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \

128 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic
child pid is 146639

>> NetBSD/x86 BIOS Boot, Revision 5.11 (Wed Jun 5 07:22:49 UTC 2019) (from NetBSD 8.99.42)

>> Memory: 639/129920 k

1. Boot normally
2. Boot single user
3. Drop to boot prompt

Choose an option; RETURN for default; SPACE to stop countdown.
Option 1 will be chosen in 0 seconds.
command(s): rndseed /var/db/entropy-file;boot
default boot twice, skipping...

20945936+662048+1435104 [1310256+928206+17850]=0x18278f0
Loading /var/db/entropy-file

[ 1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002,
2003, 2004, 2005,
[ 1.0000000] 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013,
2014, 2015, 2016, 2017,
[ 1.0000000] 2018, 2019 The NetBSD Foundation, Inc. All rights reserved.
[ 1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[ 1.0000000] The Regents of the University of California. All
rights reserved.

[ 1.0000000] NetBSD 8.99.42 (GENERIC) #0: Wed Jun 5 07:22:49 UTC 2019

[ 1.0000000] mkr...@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC
[ 1.0000000] total memory = 127 MB
[ 1.0000000] avail memory = 98 MB

[ 1.0000000] rnd: seeded with 128 bits

[ 1.0000000] running cgd selftest aes-xts-256 aes-xts-512 done
[ 1.0000030] mainbus0 (root)
[ 1.0000030] ACPI: RSDP 0x00000000000F68D0 000014 (v00 BOCHS )
[ 1.0000030] ACPI: RSDT 0x0000000007FE156F 000030 (v01 BOCHS
BXPCRSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACP 0x0000000007FE144B 000074 (v01 BOCHS
BXPCFACP 00000001 BXPC 00000001)
[ 1.0000030] ACPI: DSDT 0x0000000007FE0040 00140B (v01 BOCHS
BXPCDSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACS 0x0000000007FE0000 000040
[ 1.0000030] ACPI: APIC 0x0000000007FE14BF 000078 (v01 BOCHS
BXPCAPIC 00000001 BXPC 00000001)
[ 1.0000030] ACPI: HPET 0x0000000007FE1537 000038 (v01 BOCHS
BXPCHPET 00000001 BXPC 00000001)
[ 1.0000030] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 1.0000030] ioapic0 at mainbus0 apid 0
[ 1.0000030] cpu0 at mainbus0 apid 0
[ 1.0000030] cpu0: QEMU Virtual CPU version 2.5+, id 0x663
[ 1.0000030] cpu0: package 0, core 0, smt 0
[ 1.0000030] acpi0 at mainbus0: Intel ACPICA 20190405
[ 1.0000030] acpi0: fixed power button present

[ 1.0399231] hpet0 at acpi0: high precision event timer (mem
0xfed00000-0xfed00400)
[ 1.0413144] pckbc1 at acpi0 (KBD, PNP0303) (kbd port): io 0x60,0x64 irq 1
[ 1.0413144] pckbc2 at acpi0 (MOU, PNP0F13) (aux port): irq 12
[ 1.0413144] FDC0 (PNP0700) at acpi0 not configured
[ 1.0413144] LPT (PNP0400) at acpi0 not configured
[ 1.0413144] COM1 (PNP0501) at acpi0 not configured
[ 1.0413144] qemufwcfg0 at acpi0 (FWCF, QEMU0002): io 0x510-0x51b
[ 1.0413144] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 1.0413144] pckbd0 at pckbc1 (kbd slot)
[ 1.0413144] pckbc1: using irq 1 for kbd slot
[ 1.0413144] wskbd0 at pckbd0 mux 1
[ 1.0413144] pms0 at pckbc1 (aux slot)
[ 1.0413144] pckbc1: using irq 12 for aux slot
[ 1.0413144] wsmouse0 at pms0 mux 0
[ 1.0413144] pci0 at mainbus0 bus 0: configuration mode 1
[ 1.0413144] pchb0 at pci0 dev 0 function 0: vendor 8086 product
1237 (rev. 0x02)
[ 1.0413144] pcib0 at pci0 dev 1 function 0: vendor 8086 product
7000 (rev. 0x00)
[ 1.0413144] piixide0 at pci0 dev 1 function 1: Intel 82371SB IDE
Interface (PIIX3) (rev. 0x00)
[ 1.0413144] piixide0: primary channel interrupting at ioapic0 pin 14
[ 1.0413144] atabus0 at piixide0 channel 0
[ 1.0413144] piixide0: secondary channel interrupting at ioapic0 pin 15
[ 1.0413144] atabus1 at piixide0 channel 1
[ 1.0413144] piixpm0 at pci0 dev 1 function 3: vendor 8086 product
7113 (rev. 0x03)
[ 1.0413144] piixpm0: 24-bit timer
[ 1.0413144] piixpm0: interrupting at ioapic0 pin 9
[ 1.0413144] iic0 at piixpm0: I2C busnetbsd$ rm -rf wd0.img key
key.pub out download
^[[A^[[A./install.sh -i

+ '[' 1 -eq 0 ']'
+ getopts si opt
+ case "${opt}" in
+ echo 'Installing a NetBSD image'
Installing a NetBSD image
+ rm -rf out
+ mkdir out/

+ ./anita/anita --workdir=./ --disk-size=8G --memory-size=1G install

http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/
This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \
--workdir=./ \

--disk-size=8G \

OK
Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/installation/misc/pxeboot_ia32.bin...
OK
Downloading http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/binary/kernel/netbsd-INSTALL.gz...

2.24% done, estimate finish Thu Jun 6 17:55:09 2019
4.48% done, estimate finish Thu Jun 6 17:55:09 2019
6.72% done, estimate finish Thu Jun 6 17:55:09 2019
8.96% done, estimate finish Thu Jun 6 17:55:09 2019
11.20% done, estimate finish Thu Jun 6 17:55:09 2019
13.44% done, estimate finish Thu Jun 6 17:55:09 2019
15.68% done, estimate finish Thu Jun 6 17:55:09 2019
17.91% done, estimate finish Thu Jun 6 17:55:09 2019
20.16% done, estimate finish Thu Jun 6 17:55:09 2019
22.39% done, estimate finish Thu Jun 6 17:55:09 2019
24.64% done, estimate finish Thu Jun 6 17:55:09 2019
26.87% done, estimate finish Thu Jun 6 17:55:09 2019
29.11% done, estimate finish Thu Jun 6 17:55:09 2019
31.35% done, estimate finish Thu Jun 6 17:55:09 2019
33.59% done, estimate finish Thu Jun 6 17:55:09 2019
35.83% done, estimate finish Thu Jun 6 17:55:09 2019
38.07% done, estimate finish Thu Jun 6 17:55:09 2019
40.31% done, estimate finish Thu Jun 6 17:55:09 2019
42.55% done, estimate finish Thu Jun 6 17:55:09 2019
44.79% done, estimate finish Thu Jun 6 17:55:09 2019
47.03% done, estimate finish Thu Jun 6 17:55:09 2019
49.26% done, estimate finish Thu Jun 6 17:55:09 2019
51.51% done, estimate finish Thu Jun 6 17:55:09 2019
53.74% done, estimate finish Thu Jun 6 17:55:09 2019
55.99% done, estimate finish Thu Jun 6 17:55:09 2019
58.22% done, estimate finish Thu Jun 6 17:55:09 2019
60.46% done, estimate finish Thu Jun 6 17:55:09 2019
62.70% done, estimate finish Thu Jun 6 17:55:09 2019
64.94% done, estimate finish Thu Jun 6 17:55:09 2019
67.18% done, estimate finish Thu Jun 6 17:55:09 2019
69.42% done, estimate finish Thu Jun 6 17:55:09 2019
71.66% done, estimate finish Thu Jun 6 17:55:09 2019
73.90% done, estimate finish Thu Jun 6 17:55:09 2019
76.13% done, estimate finish Thu Jun 6 17:55:09 2019
78.38% done, estimate finish Thu Jun 6 17:55:09 2019
80.61% done, estimate finish Thu Jun 6 17:55:09 2019
82.86% done, estimate finish Thu Jun 6 17:55:09 2019
85.09% done, estimate finish Thu Jun 6 17:55:09 2019
87.33% done, estimate finish Thu Jun 6 17:55:09 2019
89.57% done, estimate finish Thu Jun 6 17:55:09 2019
91.81% done, estimate finish Thu Jun 6 17:55:09 2019
94.05% done, estimate finish Thu Jun 6 17:55:09 2019
96.29% done, estimate finish Thu Jun 6 17:55:09 2019
98.53% done, estimate finish Thu Jun 6 17:55:09 2019

Total translation table size: 0

Total rockridge attributes bytes: 3965

Total directory bytes: 18432
Path table size(bytes): 120
Max brk space used 23000

223291 extents written (436 MB)

Creating hard disk image... done.
QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \
1024 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic \
-drive \
file=.//download/amd64/installation/cdrom/boot-com.iso,format=raw,media=cdrom,readonly=on
\
-drive \
file=./install_tmp.iso,format=raw,media=cdrom,readonly=on \
-boot \
d

child pid is 144561

>> NetBSD/x86 BIOS Boot, Revision 5.11 (Wed Jun 5 07:22:49 UTC 2019) (from NetBSD 8.99.42)
>> Memory: 639/1047424 k

1. Boot normally
2. Boot single user
3. Drop to boot prompt

Choose an option; RETURN for default; SPACE to stop countdown.
Option 1 will be chosen in 0 seconds.
command(s): rndseed /var/db/entropy-file;boot
default boot twice, skipping...

20945936+662048+1435104 [1310256+928206+17850]=0x18278f0

WARNING: couldn't open /var/db/entropy-file

Loading /stand/amd64/8.99.42/modules/cd9660/cd9660.kmod

WARNING: 1 module failed to load
[ 1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002,
2003, 2004, 2005,
[ 1.0000000] 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013,
2014, 2015, 2016, 2017,
[ 1.0000000] 2018, 2019 The NetBSD Foundation, Inc. All rights reserved.
[ 1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[ 1.0000000] The Regents of the University of California. All
rights reserved.

[ 1.0000000] NetBSD 8.99.42 (GENERIC) #0: Wed Jun 5 07:22:49 UTC 2019
[ 1.0000000] mkr...@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC
[ 1.0000000] total memory = 1023 MB
[ 1.0000000] avail memory = 968 MB

[ 1.0000000] WARNING: module error: module `cd9660' pushed by boot
loader already exists
[ 1.0000000] running cgd selftest aes-xts-256 aes-xts-512 done
[ 1.0000030] mainbus0 (root)
[ 1.0000030] ACPI: RSDP 0x00000000000F68D0 000014 (v00 BOCHS )

[ 1.0000030] ACPI: RSDT 0x000000003FFE156F 000030 (v01 BOCHS
BXPCRSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACP 0x000000003FFE144B 000074 (v01 BOCHS
BXPCFACP 00000001 BXPC 00000001)
[ 1.0000030] ACPI: DSDT 0x000000003FFE0040 00140B (v01 BOCHS
BXPCDSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACS 0x000000003FFE0000 000040
[ 1.0000030] ACPI: APIC 0x000000003FFE14BF 000078 (v01 BOCHS
BXPCAPIC 00000001 BXPC 00000001)
[ 1.0000030] ACPI: HPET 0x000000003FFE1537 000038 (v01 BOCHS

BXPCHPET 00000001 BXPC 00000001)
[ 1.0000030] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 1.0000030] ioapic0 at mainbus0 apid 0
[ 1.0000030] cpu0 at mainbus0 apid 0
[ 1.0000030] cpu0: QEMU Virtual CPU version 2.5+, id 0x663
[ 1.0000030] cpu0: package 0, core 0, smt 0
[ 1.0000030] acpi0 at mainbus0: Intel ACPICA 20190405
[ 1.0000030] acpi0: fixed power button present

[ 1.0324767] hpet0 at acpi0: high precision event timer (mem
0xfed00000-0xfed00400)
[ 1.0335282] pckbc1 at acpi0 (KBD, PNP0303) (kbd port): io 0x60,0x64 irq 1
[ 1.0335282] pckbc2 at acpi0 (MOU, PNP0F13) (aux port): irq 12
[ 1.0335282] FDC0 (PNP0700) at acpi0 not configured
[ 1.0335282] LPT (PNP0400) at acpi0 not configured
[ 1.0335282] COM1 (PNP0501) at acpi0 not configured
[ 1.0335282] qemufwcfg0 at acpi0 (FWCF, QEMU0002): io 0x510-0x51b
[ 1.0335282] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 1.0335282] pckbd0 at pckbc1 (kbd slot)
[ 1.0335282] pckbc1: using irq 1 for kbd slot
[ 1.0335282] wskbd0 at pckbd0 mux 1
[ 1.0335282] pms0 at pckbc1 (aux slot)
[ 1.0335282] pckbc1: using irq 12 for aux slot
[ 1.0335282] wsmouse0 at pms0 mux 0
[ 1.0335282] pci0 at mainbus0 bus 0: configuration mode 1
[ 1.0335282] pchb0 at pci0 dev 0 function 0: vendor 8086 product
1237 (rev. 0x02)
[ 1.0335282] pcib0 at pci0 dev 1 function 0: vendor 8086 product
7000 (rev. 0x00)
[ 1.0335282] piixide0 at pci0 dev 1 function 1: Intel 82371SB IDE
Interface (PIIX3) (rev. 0x00)
[ 1.0335282] piixide0: primary channel interrupting at ioapic0 pin 14
[ 1.0335282] atabus0 at piixide0 channel 0
[ 1.0335282] piixide0: secondary channel interrupting at ioapic0 pin 15
[ 1.0335282] atabus1 at piixide0 channel 1
[ 1.0335282] piixpm0 at pci0 dev 1 function 3: vendor 8086 product
7113 (rev. 0x03)
[ 1.0335282] piixpm0: 24-bit timer
[ 1.0335282] piixpm0: interrupting at ioapic0 pin 9
[ 1.0335282] iic0 at piixpm0: I2C bus
[ 1.0335282] vga0 at pci0 dev 2 function 0: vendor 1234 product 1111
(rev. 0x02)
[ 1.0335282] wsdisplay0 at vga0 kbdmux 1
[ 1.0335282] drm at vga0 not configured
[ 1.0335282] wm0 at pci0 dev 3 function 0: Intel i82540EM 1000BASE-T
Ethernet (rev. 0x03)
[ 1.0335282] wm0: interrupting at ioapic0 pin 11
[ 1.0335282] wm0: Ethernet address 52:54:00:12:34:56
[ 1.0335282] makphy0 at wm0 phy 1: Marvell 88E1011 Gigabit PHY, rev. 0
[ 1.0335282] makphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
[ 1.0335282] isa0 at pcib0
[ 1.0335282] lpt0 at isa0 port 0x378-0x37b irq 7
[ 1.0335282] com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
[ 1.0335282] com0: console
[ 1.0335282] attimer0 at isa0 port 0x40-0x43
[ 1.0335282] pcppi0 at isa0 port 0x61
[ 1.0335282] spkr0 at pcppi0: PC Speaker
[ 1.0335282] wsbell at spkr0 not configured
[ 1.0335282] midi0 at pcppi0: PC speaker
[ 1.0335282] sysbeep0 at pcppi0
[ 1.0335282] fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
[ 1.0335282] attimer0: attached to pcppi0
[ 1.0335282] acpicpu0 at cpu0: ACPI CPU
[ 1.9447680] fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
[ 1.9447680] atapibus0 at atabus0: 2 targets
[ 1.9547720] cd0 at atapibus0 drive 1: <QEMU DVD-ROM, QM00002, 2.5+>
cdrom removable
[ 1.9547720] wd0 at atabus0 drive 0
[ 1.9547720] wd0: <QEMU HARDDISK>
[ 1.9547720] wd0: 8192 MB, 16644 cyl, 16 head, 63 sec, 512
bytes/sect x 16777216 sectors
[ 5.2784307] atapibus1 at atabus1: 2 targets
[ 5.2884032] cd1 at atapibus1 drive 0: <QEMU DVD-ROM, QM00003, 2.5+>
cdrom removable
[ 5.2984115] boot device: cd0
[ 5.3083258] root on cd0a dumps on cd0b
[ 5.3185023] root file system type: cd9660
[ 5.3185023] kern.module.path=/stand/amd64/8.99.42/modules
[ 5.3185023] clock: unknown CMOS layout

You are using a serial console, we do not know your terminal emulation.
Please select one, typical values are:

vt100
ansi
xterm

Terminal type (just hit ENTER for 'vt220'): xterm

To return to the installer, quit this shell by typing 'exit' or ^D.
# halt
halt: halted by root

+ ssh-keygen -t rsa -f key -N ''

Generating public/private rsa key pair.
Your identification has been saved in key.
Your public key has been saved in key.pub.
The key fingerprint is:

SHA256:rtTBVKYUsgernmThRXZycq6YnARi/a1A0rUMkIb0Sto

dvy...@dvyukov-desk.muc.corp.google.com
The key's randomart image is:
+---[RSA 2048]----+

|++*...B *.o |
|o=.=oo.& + |
|..o.+o= = |
|o..= O * |
|..E @ o S |
| + o o . |
| o . o |
| . . |
| . |
+----[SHA256]-----+
++ cat key.pub
+ SSHKEY='ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzvfpIub2Ie81K6V1mONFvgGb9O/yjZEcGjDKhMvsACvWvsnt9XeQeKdCUwcPD5zoqgXJ66EkwT2GfwCPLtxPAwc6zRdhIXPgppd+yqPjFw+yILGsIOG1yqJN8VGaocQBYLQA+rSvOKyQT+NZbacqMqIVYbZju+LN0XMdjdbWtMqPilpzMMJYDW1DZlvwXdKeiqOv0Rah1WG2hi2Sz97RdKhnMBkO8sYORzeATvUJD3O9qJAkGmgksmVj1awJvslxWsJxpmJMzw+xjgGPQ1EfNGr931HUQbfsRpTMP9c7oNCfhGOdstxlt6UVSbAnl1pGew7IgeMlJ8qB7c7OS35b
dvy...@dvyukov-desk.muc.corp.google.com'
+ ./anita/anita '--run=echo -e
'\''dhcpcd=YES\nsshd=YES\npostfix=NO'\'' >> /etc/rc.conf; touch
/fastboot; mkdir .ssh; echo ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzvfpIub2Ie81K6V1mONFvgGb9O/yjZEcGjDKhMvsACvWvsnt9XeQeKdCUwcPD5zoqgXJ66EkwT2GfwCPLtxPAwc6zRdhIXPgppd+yqPjFw+yILGsIOG1yqJN8VGaocQBYLQA+rSvOKyQT+NZbacqMqIVYbZju+LN0XMdjdbWtMqPilpzMMJYDW1DZlvwXdKeiqOv0Rah1WG2hi2Sz97RdKhnMBkO8sYORzeATvUJD3O9qJAkGmgksmVj1awJvslxWsJxpmJMzw+xjgGPQ1EfNGr931HUQbfsRpTMP9c7oNCfhGOdstxlt6UVSbAnl1pGew7IgeMlJ8qB7c7OS35b
dvy...@dvyukov-desk.muc.corp.google.com > .ssh/authorized_keys; sed
-i -e '\''s/^#PermitRootLogin [a-z][a-z-]*$/PermitRootLogin yes/'\''
/etc/ssh/sshd_config; sed -i -e
'\''s/^ddb.onpanic?=0/ddb.onpanic=1/'\'' /etc/sysctl.conf; echo -e
'\''ddb.commandonenter="show panic;bt;show registers;ps;show all
locks;show all pages;show all pools"\nddb.lines=0\nddb.maxwidth=0'\''
>> /etc/sysctl.conf; mknod -rR /dev/kcov c 346 0; poweroff; '
--persist --no-install --workdir=./ interact

http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/
This is anita version 1.47a
Using pexpect version 4.7.0
./anita/anita \

'--run=echo -e '"'"'dhcpcd=YES\nsshd=YES\npostfix=NO'"'"' >>
/etc/rc.conf; touch /fastboot; mkdir .ssh; echo ssh-rsa
AAAAB3NzaC1yc2EAAAADAQABAAABAQDLzvfpIub2Ie81K6V1mONFvgGb9O/yjZEcGjDKhMvsACvWvsnt9XeQeKdCUwcPD5zoqgXJ66EkwT2GfwCPLtxPAwc6zRdhIXPgppd+yqPjFw+yILGsIOG1yqJN8VGaocQBYLQA+rSvOKyQT+NZbacqMqIVYbZju+LN0XMdjdbWtMqPilpzMMJYDW1DZlvwXdKeiqOv0Rah1WG2hi2Sz97RdKhnMBkO8sYORzeATvUJD3O9qJAkGmgksmVj1awJvslxWsJxpmJMzw+xjgGPQ1EfNGr931HUQbfsRpTMP9c7oNCfhGOdstxlt6UVSbAnl1pGew7IgeMlJ8qB7c7OS35b
dvy...@dvyukov-desk.muc.corp.google.com > .ssh/authorized_keys; sed
-i -e '"'"'s/^#PermitRootLogin [a-z][a-z-]*$/PermitRootLogin yes/'"'"'
/etc/ssh/sshd_config; sed -i -e
'"'"'s/^ddb.onpanic?=0/ddb.onpanic=1/'"'"' /etc/sysctl.conf; echo -e
'"'"'ddb.commandonenter="show panic;bt;show registers;ps;show all
locks;show all pages;show all pools"\nddb.lines=0\nddb.maxwidth=0'"'"'
>> /etc/sysctl.conf; mknod -rR /dev/kcov c 346 0; poweroff; ' \

--persist \
--no-install \
--workdir=./ \
interact \
http://nycdn.netbsd.org/pub/NetBSD-daily/HEAD/latest/amd64/

QEMU emulator version 3.1.0 (Debian 1:3.1+dfsg-7)
Copyright (c) 2003-2018 Fabrice Bellard and the QEMU Project developers
not reversing virtio devices
qemu-system-x86_64 \
-m \

128 \
-drive \
file=./wd0.img,format=raw,media=disk,snapshot=off \
-nographic
child pid is 146639

>> NetBSD/x86 BIOS Boot, Revision 5.11 (Wed Jun 5 07:22:49 UTC 2019) (from NetBSD 8.99.42)

>> Memory: 639/129920 k

1. Boot normally
2. Boot single user
3. Drop to boot prompt

Choose an option; RETURN for default; SPACE to stop countdown.
Option 1 will be chosen in 0 seconds.
command(s): rndseed /var/db/entropy-file;boot
default boot twice, skipping...

20945936+662048+1435104 [1310256+928206+17850]=0x18278f0
Loading /var/db/entropy-file

[ 1.0000000] Copyright (c) 1996, 1997, 1998, 1999, 2000, 2001, 2002,
2003, 2004, 2005,
[ 1.0000000] 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013,
2014, 2015, 2016, 2017,
[ 1.0000000] 2018, 2019 The NetBSD Foundation, Inc. All rights reserved.
[ 1.0000000] Copyright (c) 1982, 1986, 1989, 1991, 1993
[ 1.0000000] The Regents of the University of California. All
rights reserved.

[ 1.0000000] NetBSD 8.99.42 (GENERIC) #0: Wed Jun 5 07:22:49 UTC 2019

[ 1.0000000] mkr...@mkrepro.NetBSD.org:/usr/src/sys/arch/amd64/compile/GENERIC
[ 1.0000000] total memory = 127 MB
[ 1.0000000] avail memory = 98 MB

[ 1.0000000] rnd: seeded with 128 bits

[ 1.0000000] running cgd selftest aes-xts-256 aes-xts-512 done
[ 1.0000030] mainbus0 (root)
[ 1.0000030] ACPI: RSDP 0x00000000000F68D0 000014 (v00 BOCHS )
[ 1.0000030] ACPI: RSDT 0x0000000007FE156F 000030 (v01 BOCHS
BXPCRSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACP 0x0000000007FE144B 000074 (v01 BOCHS
BXPCFACP 00000001 BXPC 00000001)
[ 1.0000030] ACPI: DSDT 0x0000000007FE0040 00140B (v01 BOCHS
BXPCDSDT 00000001 BXPC 00000001)
[ 1.0000030] ACPI: FACS 0x0000000007FE0000 000040
[ 1.0000030] ACPI: APIC 0x0000000007FE14BF 000078 (v01 BOCHS
BXPCAPIC 00000001 BXPC 00000001)
[ 1.0000030] ACPI: HPET 0x0000000007FE1537 000038 (v01 BOCHS
BXPCHPET 00000001 BXPC 00000001)
[ 1.0000030] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 1.0000030] ioapic0 at mainbus0 apid 0
[ 1.0000030] cpu0 at mainbus0 apid 0
[ 1.0000030] cpu0: QEMU Virtual CPU version 2.5+, id 0x663
[ 1.0000030] cpu0: package 0, core 0, smt 0
[ 1.0000030] acpi0 at mainbus0: Intel ACPICA 20190405
[ 1.0000030] acpi0: fixed power button present

[ 1.0399231] hpet0 at acpi0: high precision event timer (mem
0xfed00000-0xfed00400)
[ 1.0413144] pckbc1 at acpi0 (KBD, PNP0303) (kbd port): io 0x60,0x64 irq 1
[ 1.0413144] pckbc2 at acpi0 (MOU, PNP0F13) (aux port): irq 12
[ 1.0413144] FDC0 (PNP0700) at acpi0 not configured
[ 1.0413144] LPT (PNP0400) at acpi0 not configured
[ 1.0413144] COM1 (PNP0501) at acpi0 not configured
[ 1.0413144] qemufwcfg0 at acpi0 (FWCF, QEMU0002): io 0x510-0x51b
[ 1.0413144] ACPI: Enabled 2 GPEs in block 00 to 0F
[ 1.0413144] pckbd0 at pckbc1 (kbd slot)
[ 1.0413144] pckbc1: using irq 1 for kbd slot
[ 1.0413144] wskbd0 at pckbd0 mux 1
[ 1.0413144] pms0 at pckbc1 (aux slot)
[ 1.0413144] pckbc1: using irq 12 for aux slot
[ 1.0413144] wsmouse0 at pms0 mux 0
[ 1.0413144] pci0 at mainbus0 bus 0: configuration mode 1
[ 1.0413144] pchb0 at pci0 dev 0 function 0: vendor 8086 product
1237 (rev. 0x02)
[ 1.0413144] pcib0 at pci0 dev 1 function 0: vendor 8086 product
7000 (rev. 0x00)
[ 1.0413144] piixide0 at pci0 dev 1 function 1: Intel 82371SB IDE
Interface (PIIX3) (rev. 0x00)
[ 1.0413144] piixide0: primary channel interrupting at ioapic0 pin 14
[ 1.0413144] atabus0 at piixide0 channel 0
[ 1.0413144] piixide0: secondary channel interrupting at ioapic0 pin 15
[ 1.0413144] atabus1 at piixide0 channel 1
[ 1.0413144] piixpm0 at pci0 dev 1 function 3: vendor 8086 product
7113 (rev. 0x03)
[ 1.0413144] piixpm0: 24-bit timer
[ 1.0413144] piixpm0: interrupting at ioapic0 pin 9
[ 1.0413144] iic0 at piixpm0: I2C bus
[ 1.0413144] vga0 at pci0 dev 2 function 0: vendor 1234 product 1111
(rev. 0x02)
[ 1.0413144] wsdisplay0 at vga0 kbdmux 1
[ 1.0413144] drm at vga0 not configured
[ 1.0413144] wm0 at pci0 dev 3 function 0: Intel i82540EM 1000BASE-T
Ethernet (rev. 0x03)
[ 1.0413144] wm0: interrupting at ioapic0 pin 11
[ 1.0413144] wm0: Ethernet address 52:54:00:12:34:56
[ 1.0413144] makphy0 at wm0 phy 1: Marvell 88E1011 Gigabit PHY, rev. 0
[ 1.0413144] makphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
[ 1.0413144] isa0 at pcib0
[ 1.0413144] lpt0 at isa0 port 0x378-0x37b irq 7
[ 1.0413144] com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
[ 1.0413144] com0: console
[ 1.0413144] attimer0 at isa0 port 0x40-0x43
[ 1.0413144] pcppi0 at isa0 port 0x61
[ 1.0413144] spkr0 at pcppi0: PC Speaker
[ 1.0413144] wsbell at spkr0 not configured
[ 1.0413144] midi0 at pcppi0: PC speaker
[ 1.0413144] sysbeep0 at pcppi0
[ 1.0413144] fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
[ 1.0413144] attimer0: attached to pcppi0
[ 1.0413144] acpicpu0 at cpu0: ACPI CPU
[ 1.9410969] fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
[ 4.9649442] wd0 at atabus0 drive 0
[ 4.9649442] wd0: <QEMU HARDDISK>
[ 4.9649442] wd0: 8192 MB, 16644 cyl, 16 head, 63 sec, 512
bytes/sect x 16777216 sectors
[ 4.9842455] atapibus0 at atabus1: 2 targets
[ 4.9943426] cd0 at atapibus0 drive 0: <QEMU DVD-ROM, QM00003, 2.5+>
cdrom removable
[ 5.0044993] boot device: wd0
[ 5.0044993] root on wd0a dumps on wd0b
[ 5.0142769] root file system type: ffs
[ 5.0142769] kern.module.path=/stand/amd64/8.99.42/modules
[ 5.0142769] clock: unknown CMOS layout
Thu Jun 6 16:05:15 UTC 2019
Starting root file system check:
/dev/rwd0a: file system is clean; not checking
swapctl: setting dump device to /dev/wd0b
swapctl: adding /dev/wd0b as swap device at priority 0
Starting file system checks:
Loaded entropy from /var/db/entropy-file.
Setting tty flags.
Setting sysctl variables:
ddb.onpanic: 1 -> 0
Starting network.
/etc/rc: WARNING: $hostname not set.
IPv6 mode: host
Configuring network interfaces:.
Adding interface aliases:.
Waiting for DAD to complete for statically configured addresses...
Building databases: dev, utmp, utmpx, services.
Starting syslogd.
Mounting all file systems...
Clearing temporary files.
Checking quotas: done.
swapctl: setting dump device to /dev/wd0b
Starting virecover.
Checking for core dump...
savecore: no core dump
Starting local daemons:.
Updating motd.
Starting powerd.
/usr/sbin/postconf: warning: valid_hostname: empty hostname
/usr/sbin/postconf: fatal: unable to use my own hostname
Jun 6 16:05:25 postfix[331]: fatal: unable to use my own hostname
/etc/rc.d/postfix exited with code 1
Starting inetd.
Starting cron.
The following components reported failures:
/etc/rc.d/postfix
See /var/run/rc.log for more information.
Thu Jun 6 16:05:26 UTC 2019

NetBSD/amd64 (Amnesiac) (console)

login:

NetBSD/amd64 (Amnesiac) (console)

login: root
Jun 6 16:05:29 login: ROOT LOGIN (root) on tty console

2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017,

NetBSD 8.99.42 (GENERIC) #0: Wed Jun 5 07:22:49 UTC 2019

Welcome to NetBSD!

This system is running a development snapshot of the NetBSD operating system,
also known as NetBSD-current. It is very possible that it has serious bugs,
regressions, broken features or other problems. Please bear this in mind
and use the system with care.

ctl.conf; mknod -rR /dev/kcov c 346 0; poweroff; .0\nddb.maxwidth=0' >> /etc/sys
echo exit_status=$?=
Jun 6 16:05:30 poweroff: powered off by root
Jun 6 16:05:30 syslogd[156]: Exiting on signal 15
[ 27.8204759] syncing disks... done
[ 27.9505826] cd0: detached
[ 27.9505826] sysbeep0: detached
[ 27.9505826] midi0: detached
[ 27.9505826] atapibus0: detached
[ 27.9505826] iic0: detached
[ 27.9505826] atabus1: detached
[ 27.9505826] makphy0: detached
[ 27.9605578] wm0: detached
[ 27.9605578] pchb0: detached
[ 28.0006526] acpi0: entering state S5

Traceback (most recent call last):
File "./anita/anita", line 144, in <module>
status = main()

File "./anita/anita", line 132, in main
status = maybe_run_command(a)
File "./anita/anita", line 111, in maybe_run_command
return a.shell_cmd(options.run, options.run_timeout)
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 2096, in shell_cmd
return shell_cmd(self.child, cmd, timeout)
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 2169, in shell_cmd
child.expect("exit_status=(\d+)=")

File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 181, in expect
r = pexpect.spawn.expect(self, pattern, *args, **kwargs)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 341, in expect
timeout, searchwindowsize, async_)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 369, in expect_list
return exp.expect_loop(timeout)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 117, in expect_loop
return self.eof(e)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 63, in eof
raise EOF(msg)
pexpect.exceptions.EOF: End Of File (EOF). Exception style platform.

<anita.pexpect_spawn_log object at 0x7fd6dd7543d0>
command: /usr/bin/qemu-system-x86_64
args: ['/usr/bin/qemu-system-x86_64', '-m', '128', '-drive',
'file=./wd0.img,format=raw,media=disk,snapshot=off', '-nographic']
buffer (last 100 chars): ''
before (last 100 chars): '9605578] wm0: detached\r\r\n[ 27.9605578]
pchb0: detached\r\r\n[ 28.0006526] acpi0: entering state S5\r\r\n'

after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True

pid: 146639

child_fd: 8
closed: False
timeout: 600
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None

logfile_read: <anita.multifile object at 0x7fd6db05f750>
logfile_send: <open file '/dev/null', mode 'w' at 0x7fd6db34eed0>

maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 30.0
delayafterterminate: 30.0
searcher: searcher_re:

0: re.compile('exit_status=(\\d+)=')

[ 1.0413144] vga0 at pci0 dev 2 function 0: vendor 1234 product 1111
(rev. 0x02)
[ 1.0413144] wsdisplay0 at vga0 kbdmux 1
[ 1.0413144] drm at vga0 not configured
[ 1.0413144] wm0 at pci0 dev 3 function 0: Intel i82540EM 1000BASE-T
Ethernet (rev. 0x03)
[ 1.0413144] wm0: interrupting at ioapic0 pin 11
[ 1.0413144] wm0: Ethernet address 52:54:00:12:34:56
[ 1.0413144] makphy0 at wm0 phy 1: Marvell 88E1011 Gigabit PHY, rev. 0
[ 1.0413144] makphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
[ 1.0413144] isa0 at pcib0
[ 1.0413144] lpt0 at isa0 port 0x378-0x37b irq 7
[ 1.0413144] com0 at isa0 port 0x3f8-0x3ff irq 4: ns16550a, working fifo
[ 1.0413144] com0: console
[ 1.0413144] attimer0 at isa0 port 0x40-0x43
[ 1.0413144] pcppi0 at isa0 port 0x61
[ 1.0413144] spkr0 at pcppi0: PC Speaker
[ 1.0413144] wsbell at spkr0 not configured
[ 1.0413144] midi0 at pcppi0: PC speaker
[ 1.0413144] sysbeep0 at pcppi0
[ 1.0413144] fdc0 at isa0 port 0x3f0-0x3f7 irq 6 drq 2
[ 1.0413144] attimer0: attached to pcppi0
[ 1.0413144] acpicpu0 at cpu0: ACPI CPU
[ 1.9410969] fd0 at fdc0 drive 0: 1.44MB, 80 cyl, 2 head, 18 sec
[ 4.9649442] wd0 at atabus0 drive 0
[ 4.9649442] wd0: <QEMU HARDDISK>
[ 4.9649442] wd0: 8192 MB, 16644 cyl, 16 head, 63 sec, 512
bytes/sect x 16777216 sectors
[ 4.9842455] atapibus0 at atabus1: 2 targets
[ 4.9943426] cd0 at atapibus0 drive 0: <QEMU DVD-ROM, QM00003, 2.5+>
cdrom removable
[ 5.0044993] boot device: wd0
[ 5.0044993] root on wd0a dumps on wd0b
[ 5.0142769] root file system type: ffs
[ 5.0142769] kern.module.path=/stand/amd64/8.99.42/modules
[ 5.0142769] clock: unknown CMOS layout
Thu Jun 6 16:05:15 UTC 2019
Starting root file system check:
/dev/rwd0a: file system is clean; not checking
swapctl: setting dump device to /dev/wd0b
swapctl: adding /dev/wd0b as swap device at priority 0
Starting file system checks:
Loaded entropy from /var/db/entropy-file.
Setting tty flags.
Setting sysctl variables:
ddb.onpanic: 1 -> 0
Starting network.
/etc/rc: WARNING: $hostname not set.
IPv6 mode: host
Configuring network interfaces:.
Adding interface aliases:.
Waiting for DAD to complete for statically configured addresses...
Building databases: dev, utmp, utmpx, services.
Starting syslogd.
Mounting all file systems...
Clearing temporary files.
Checking quotas: done.
swapctl: setting dump device to /dev/wd0b
Starting virecover.
Checking for core dump...
savecore: no core dump
Starting local daemons:.
Updating motd.
Starting powerd.
/usr/sbin/postconf: warning: valid_hostname: empty hostname
/usr/sbin/postconf: fatal: unable to use my own hostname
Jun 6 16:05:25 postfix[331]: fatal: unable to use my own hostname
/etc/rc.d/postfix exited with code 1
Starting inetd.
Starting cron.
The following components reported failures:
/etc/rc.d/postfix
See /var/run/rc.log for more information.
Thu Jun 6 16:05:26 UTC 2019

NetBSD/amd64 (Amnesiac) (console)

login:

NetBSD/amd64 (Amnesiac) (console)

login: root
Jun 6 16:05:29 login: ROOT LOGIN (root) on tty console

2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015, 2016, 2017,

NetBSD 8.99.42 (GENERIC) #0: Wed Jun 5 07:22:49 UTC 2019

Welcome to NetBSD!

This system is running a development snapshot of the NetBSD operating system,
also known as NetBSD-current. It is very possible that it has serious bugs,
regressions, broken features or other problems. Please bear this in mind
and use the system with care.

ctl.conf; mknod -rR /dev/kcov c 346 0; poweroff; .0\nddb.maxwidth=0' >> /etc/sys
echo exit_status=$?=
Jun 6 16:05:30 poweroff: powered off by root
Jun 6 16:05:30 syslogd[156]: Exiting on signal 15
[ 27.8204759] syncing disks... done
[ 27.9505826] cd0: detached
[ 27.9505826] sysbeep0: detached
[ 27.9505826] midi0: detached
[ 27.9505826] atapibus0: detached
[ 27.9505826] iic0: detached
[ 27.9505826] atabus1: detached
[ 27.9505826] makphy0: detached
[ 27.9605578] wm0: detached
[ 27.9605578] pchb0: detached
[ 28.0006526] acpi0: entering state S5

Traceback (most recent call last):
File "./anita/anita", line 144, in <module>
status = main()

File "./anita/anita", line 132, in main
status = maybe_run_command(a)
File "./anita/anita", line 111, in maybe_run_command
return a.shell_cmd(options.run, options.run_timeout)
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 2096, in shell_cmd
return shell_cmd(self.child, cmd, timeout)
File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 2169, in shell_cmd
child.expect("exit_status=(\d+)=")

File "/usr/local/google/home/dvyukov/src/gopath/src/github.com/google/syzkaller/local/netbsd/anita/anita.py",
line 181, in expect
r = pexpect.spawn.expect(self, pattern, *args, **kwargs)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 341, in expect
timeout, searchwindowsize, async_)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/spawnbase.py",
line 369, in expect_list
return exp.expect_loop(timeout)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 117, in expect_loop
return self.eof(e)
File "/usr/local/google/home/dvyukov/.local/lib/python2.7/site-packages/pexpect/expect.py",
line 63, in eof
raise EOF(msg)
pexpect.exceptions.EOF: End Of File (EOF). Exception style platform.

<anita.pexpect_spawn_log object at 0x7fd6dd7543d0>
command: /usr/bin/qemu-system-x86_64
args: ['/usr/bin/qemu-system-x86_64', '-m', '128', '-drive',
'file=./wd0.img,format=raw,media=disk,snapshot=off', '-nographic']
buffer (last 100 chars): ''
before (last 100 chars): '9605578] wm0: detached\r\r\n[ 27.9605578]
pchb0: detached\r\r\n[ 28.0006526] acpi0: entering state S5\r\r\n'

after: <class 'pexpect.exceptions.EOF'>
match: None
match_index: None
exitstatus: None
flag_eof: True

pid: 146639

child_fd: 8
closed: False
timeout: 600
delimiter: <class 'pexpect.exceptions.EOF'>
logfile: None

logfile_read: <anita.multifile object at 0x7fd6db05f750>
logfile_send: <open file '/dev/null', mode 'w' at 0x7fd6db34eed0>

maxread: 2000
ignorecase: False
searchwindowsize: None
delaybeforesend: 0.05
delayafterclose: 30.0
delayafterterminate: 30.0
searcher: searcher_re:

0: re.compile('exit_status=(\\d+)=')

Siddharth Muralee

unread,

Jun 7, 2019, 9:49:11 AM6/7/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

Hey Dmitry,

It looks like somehow the download of the boot-com.iso is not happening. This is really strange since this doesn't happen with me in my machine or the AWS cloud servers that I am using. (5/5 tests on each were successful)

I have anyway gone through the anita code and added a small patch which should prevent the download of boot-com.iso from being optional. I will push the patch as a part of my script for the time being.

So far there is no proper handling for poweroff. I think that prints the error at the end. The final run looks like it succeeded. Did you get the image?

I would have done something better if I had a reproducable error.

--
You received this message because you are subscribed to the Google Groups "syzkaller-netbsd-bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to syzkaller-netbsd...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/CACT4Y%2BZnTwLbv86yxWDQ%3Dn1WiKFQ2wTed1fHTrWPArA1-d_4YA%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

Dmitry Vyukov

unread,

Jun 7, 2019, 12:31:58 PM6/7/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

On Fri, Jun 7, 2019 at 3:49 PM Siddharth Muralee
<siddhart...@gmail.com> wrote:
>
> Hey Dmitry,
> It looks like somehow the download of the boot-com.iso is not happening. This is really strange since this doesn't happen with me in my machine or the AWS cloud servers that I am using. (5/5 tests on each were successful)
> I have anyway gone through the anita code and added a small patch which should prevent the download of boot-com.iso from being optional. I will push the patch as a part of my script for the time being.
>
> So far there is no proper handling for poweroff. I think that prints the error at the end. The final run looks like it succeeded. Did you get the image?
> I would have done something better if I had a reproducable error.

I don't have anything in out/, but I have wd0.img. I've added set -eux
to the script to not debug consequences of it silently ignores errors,
so anita seemed to fail. But maybe it still created a proper image? If
it expected that it both fails and creates an image?
I've upload the current result to
https://storage.googleapis.com/syzkaller/netbsd-image.raw.tar.gz

> To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/CAB5-aq4KxbiXuyLc8pAgMKXvEJHHwt5mNfaE5bZrr9L-NUvcSw%40mail.gmail.com.

Dmitry Vyukov

unread,

Jun 7, 2019, 12:33:38 PM6/7/19

to Siddharth Muralee, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

On Fri, Jun 7, 2019 at 6:31 PM Dmitry Vyukov <dvy...@google.com> wrote:
>
> On Fri, Jun 7, 2019 at 3:49 PM Siddharth Muralee
> <siddhart...@gmail.com> wrote:
> >
> > Hey Dmitry,
> > It looks like somehow the download of the boot-com.iso is not happening. This is really strange since this doesn't happen with me in my machine or the AWS cloud servers that I am using. (5/5 tests on each were successful)
> > I have anyway gone through the anita code and added a small patch which should prevent the download of boot-com.iso from being optional. I will push the patch as a part of my script for the time being.
> >
> > So far there is no proper handling for poweroff. I think that prints the error at the end. The final run looks like it succeeded. Did you get the image?
> > I would have done something better if I had a reproducable error.
>
> I don't have anything in out/, but I have wd0.img. I've added set -eux
> to the script to not debug consequences of it silently ignores errors,
> so anita seemed to fail. But maybe it still created a proper image? If
> it expected that it both fails and creates an image?
> I've upload the current result to
> https://storage.googleapis.com/syzkaller/netbsd-image.raw.tar.gz

Nope, now kernel build is broken with some errors:
https://syzkaller.appspot.com/bug?id=a2751ff4b3d014ac7dc168c9848c4ada8cd12537

Siddharth Muralee

unread,

Jun 7, 2019, 12:42:34 PM6/7/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

I think we might have to clean build tools directory. Can you remove managers/netbsd/tools.

Issue happened probably because we are doing a incremental build.

--
You received this message because you are subscribed to the Google Groups "syzkaller-netbsd-bugs" group.
To unsubscribe from this group and stop receiving emails from it, send an email to syzkaller-netbsd...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/syzkaller-netbsd-bugs/CACT4Y%2BbrLGnn--owOq-tAY_Lh9NgWVuMtXEO32A%2BUZhnpEZDhw%40mail.gmail.com.

Siddharth Muralee

unread,

Jun 8, 2019, 12:11:20 AM6/8/19

to Dmitry Vyukov, Kamil Rytarowski, syzbot, syzkaller-netbsd-bugs

I checked the image that you had sent. It works totally fine and has all the changes that we made.

Reply all

Reply to author

Forward