CoreOS Cluster on OpenStack

[Arash Kaffamanesh]

I'd like to know if someone was able to build CoreOS Clusters on top of OpenStack and got it work as designed and could share some insights about it. 

Thanks!

[Darren Shepherd]

I haven't specifically tried it, but have you looked at https://coreos.com/docs/running-coreos/platforms/openstack/

Darren

[Arash Kaffamanesh]

Hi Darren,

Thanks, yes, I could launch the CoreOS cluster on our RDO based OpenStack environment as described on that page, but the cluster members couldn't reach each other, I guess since CoreOS is in heavy development and still in alpha, it doesn't work as designed on OpenStack (or even on bare metal?).

I've asked this question directly on the CoreOS Google group and would await the feedback from them here:

https://groups.google.com/forum/#!topic/coreos-dev/INnx4AOpoYc

Thanks again,

Arash

[Alex Polvi]

Arash, CoreOS should be working fine on OpenStack. If you are encountering a bug, please let us know. Are you able to ssh to the instances that you launched?

Thank you,

-Alex

[Rob Szumski]

One thing to note: running the metadata service is the easiest way to get your cloud-config onto instances. The Openstack docs on the CoreOS website assume the metadata service is running.

 - Rob

[Arash Kaffamanesh]

Thanks Alex, Rob,

yes, I can ssh into instances.

I'm boot a 2 node CoreOS cluster on a RDO based 3 node OpenStack environment using neutron with vlan with the following command:

nova boot --user-data ./cloud-config.yaml --image 44ab8ef1-2cf9-46e3-966d-14beb83d0305 --key-name mytenantkey --flavor m1.small --num-instances 2 --security-groups default --nic net-id=3fddd9b7-fa46-4418-ac12-aff7451e5da8 coreos

I can ssh to each node, but if I try to set a key message, then I get "Cannot sync with the cluster":

core@host-10-0-0-13 ~ $ etcdctl set /message Hello

Cannot sync with the cluster

The cloud-config.yaml looks like this:

cat cloud-config.yaml 

#cloud-config

coreos:

  etcd:

    # generate a new token for each unique cluster from https://discovery.etcd.io/new

    discovery: https://discovery.etcd.io/bf37f04db8fe7d68b0b9b3885a6770b1

    # multi-region and multi-cloud deployments need to use $public_ipv4

    # addr: $private_ipv4:4001

    # peer-addr: $private_ipv4:7001

  units:

    - name: etcd.service

      command: start

    - name: fleet.service

      command: start

ssh_authorized_keys:

  # include one or more SSH public keys

    - ssh-rsa AAAAB3NzaC1yc2EAAA.....

So, I guess since others can run their cluster on top of OpenStack, something must going wrong on my OpenStack environment.

Regarding the metadata service as Rob kindly mentioned, I checked that to, if I run:

core@host-10-0-0-13 ~ $ curl http://169.254.169.254/openstack/2012-08-10/user_data

I'll get my cloud-config back as desired.

Thanks for any hints or ideas how to dig deeper in the log files :-)

-Arash

[Alex Polvi]

Arash, just for debugging, enable the public_ipv4 (per below), generate a new discovery token, then launch the cluster again:

#cloud-config

coreos:

  etcd:

    # generate a new token for each unique cluster from https://discovery.etcd.io/new

    discovery: https://discovery.etcd.io/<NEW TOKEN>

    # multi-region and multi-cloud deployments need to use $public_ipv4

    addr: $private_ipv4:4001

    peer-addr: $private_ipv4:7001

  units:

    - name: etcd.service

      command: start

    - name: fleet.service

      command: start

ssh_authorized_keys:

    - ssh-rsa AAAAB3NzaC1yc2EAAA....

Let us know how that goes.

-Alex

[Arash Kaffamanesh]

Thanks Alex, I tried that several times before and now tried it again, but I'm still getting the cannot sync message.

By the way, the routing table looks like this:

core@host-10-0-0-15 ~ $ route -n

Kernel IP routing table

Destination     Gateway         Genmask         Flags Metric Ref    Use Iface

0.0.0.0         10.0.0.1        0.0.0.0         UG    0      0        0 ens3

10.0.0.0        0.0.0.0         255.255.255.0   U     0      0        0 ens3

On other VMs I've an additional entry:

169.254.169.254 10.0.0.1        255.255.255.255 UGH   0      0        0 eth0

I tried to add the route like this on both machines:

host-10-0-0-13 ~ # ip route add 169.254.169.254/32 via 10.0.0.1

host-10-0-0-13 ~ # etcdctl set /message Hello

Cannot sync with the cluster

host-10-0-0-13 ~ # route -n

Kernel IP routing table

Destination     Gateway         Genmask         Flags Metric Ref    Use Iface

default         10.0.0.1        0.0.0.0         UG    0      0        0 ens3

10.0.0.0        *               255.255.255.0   U     0      0        0 ens3

169.254.169.254 10.0.0.1        255.255.255.255 UGH   0      0        0 ens3

Another question, if I try to change the core user's password to be able to ssh from the other cluster node to it, I'm getting:

host-10-0-0-15 ~ # passwd core

Enter new UNIX password: 

Retype new UNIX password: 

passwd: Authentication token lock busy

passwd: password unchanged

is that normal?

-Arash

[Alex Polvi]

Arash, after you add the route by hand, does your networking work like normal? We are debugging an OpenStack related networking issue, but we have not been able to reproduce in our lab. Any chance you could share more information on how quantum is configured in your OpenStack deployment?

-Alex

[Arash Kaffamanesh]

Thank you Alex, yes, the networking still works after adding the route by hand, but the "Cannot sync with the cluster" message remains.

I'm using Neutron + VLAN on a 3 node RDO based OpenStack deployment on CentOS 6.5 with one controller and 2 compute nodes. The CoreOS VMs are running on 2 different compute nodes, I even managed to have them on the same compute node, but got the same result. The security group has the ports 4001 and 7001 opened.

I also created new ssh keys, so that the core user can ssh passwordless into another instance, and disabled iptables, etc.. but it didn't help.

Could you please provide some info about your OpenStack lab environment, are you using Neutron with VLAN?

Thanks,

-Arash

Mit freundlichen Grüßen,
Arash Kaffamanesh

Like | Follow | Build your CloudSite with OpenCms OCCX on ProfitBricks

____________________________    

Arash Kaffamanesh
Clouds Sky GmbH

Im Mediapark 4C

50760 Köln

T.:  +49 221 379 90 680
M.: +49 177 880 77 34
www.cloudssky.com
____________________________

[Arash Kaffamanesh]

I'm doing some progress :-)

If I run systemctl restart fleet etcd the "Cannot sync" message doesn't show up anymore:

core@host-10-0-0-11 ~ $ sudo systemctl restart fleet etcd

core@host-10-0-0-11 ~ $ etcdctl set /message Hello

Hello

But I would expect to see both machines by running fleetctl list-machines, right?

core@host-10-0-0-11 ~ $ fleetctl list-machines

MACHINE IP METADATA

81d1a06a... 10.0.0.11 -

Thanks,

-Arash

[Alex Polvi]

Arash, it is likely because the cluster has not come up correctly. On your second machine, can you do an: etcdctl get /message ?

Thank you-

-Alex

[Arash Kaffamanesh]

Alex, you're right the cluster has not come up correctly:

On the first machine I'm getting as expected:

core@host-10-0-0-11 ~ $ etcdctl get /message

Hello

on the second machine:

core@host-10-0-0-13 ~ $ etcdctl get /message

Error: 100: Key not found (/message) [643]

One question: how can I build a new CoreOS VM image for OpenStack from scratch?

Thanks,

-Arash

Meetup: OpenStack Docker CoreOS Meetup

[Alex Polvi]

On Thu, Apr 10, 2014 at 1:46 PM, Arash Kaffamanesh <a...@cloudssky.com> wrote:

One question: how can I build a new CoreOS VM image for OpenStack from scratch?

coreos.com/docs/openstack

should have everything you need.

-Alex

[Jim Walters]

I'm having a problem getting logged into an Openstack based image (alpha) and would like to recreate the image but set a standard password for the core user. I suspect #cloud-config isn't working but can't confirm because its a Catch-22 of not being able to log in to confirm that suspicion.

[brian.ha...@coreos.com]

Jim,

That would be the case here.  Rather than trying to boot with a full cloud-config can you just set the ssh key using the --key-name option to nova boot?  Additionally, if you grab me on IRC (red_beard) I can take a look at your cloud-config and help you troubleshoot it.

--Brian 'redbeard' Harrington

[Jim Walters]

This is what I tried (mostly concerned about just getting logged in via SSH):

#cloud-config

coreos:

  etcd:

    # generate a new token for each unique cluster from https://discovery.etcd.io/new

    discovery: https://discovery.etcd.io/<token>

    # multi-region and multi-cloud deployments need to use $public_ipv4

    addr: $private_ipv4:4001

    peer-addr: $private_ipv4:7001

  units:

    - name: etcd.service

      command: start

    - name: fleet.service

      command: start

ssh_authorized_keys:

  # include one or more SSH public keys

  - ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6U1QM6Sg/WC3x8s6S52PWSzBwbEOpUUYhdA4ZdVg2mOBlXJSOUbaXzqJfjsq4iaVGuNit7ZdIrW4+XsnjWPBzeegxokHuXCTJPsGIbzmOJkccWHx966Bp3D1n2b5jxAoaiPPNuGdXJxInRVJg5tCO+L1CGQnhz8Uw+4SMSpQWxFZMEBGtTzO3B0NBlEzatcrzvs7x0MMSd3ZKGfyL6g5Mym6UErWuXDPwi1PIRaRCOgN4NXc0oAfDOWaNZkMhedUDqQ4dS44kpdxcOfufKEXwfP5Ye3nk7EoeGKxQtoR+swuNO08KV3uTrKTKeQF3oFZt+VO8W9VpVb5Q7SQHkaRX core

[brian.ha...@coreos.com]

Jim,

I confirmed that your cloud-config is completely fine.  I just did a copy/paste (and added my key right below yours) and booted the instance with the following command:

 nova boot --flavor m1.tiny --image 7e0c1ad7-14e9-46e4-9788-d88aac1d4d78   --nic net-id=216d58f2-1fe1-4401-9feb-142a4c1e67b3 --security-groups default --user-data ~/mailing_list.yaml    --poll boottest

Of course the image and network uuids will be different, but everything else looked fine.  

Can you confirm the security groups and your ssh key?  In addition i put up a gist of a known working config which creates two users (setting the password for both to "coreos"):

https://gist.githubusercontent.com/brianredbeard/1a4a83df93d84ab61f5d/raw/coreos.yaml

Feel free to download it and use it for testing.

[Paul O'Neil]

If you have root access to the compute host, then you can usually access
the VM directly and see what's going on. Virutual machines can log
information to /var/lib/nova/instances/<uuid>/console.log, or you can
use the tools associated with your particular hypervisor. With KVM &
libvirt, for example, you can run virt-manager and get a window with the
VM display in it.

Paul

> coreos.com/docs/openstack <http://coreos.com/docs/openstack>

[Jim Walters]

I'm going to try Paul's suggestion. Horizon gives me console and console log but I'm not seeing anything in there that looks like cloud-config.

[Jim Walters]

Hmmm. No luck. Here is what I did and know:

I whittled down the cloud config file to just add a user (core) with the password you had and a public key from my Openstack cloud. Then I used a cloud config enabled centos image and confirmed that cloud config created a "core" user. ssh with pem key worked on that image to the "core" user. So that confirmed Openstack cloud config worked with the config drive.

Then I did the same thing with the coreos alpha image. (Just pulled today.). The image comes up and is running sshd. But neither the public key nor the subsequent password prompt worked. At this point I'm at a loss to diagnose further.

[Brian Harrington]

Jim,

Rewinding back a bit, let's verify everything.  Try putting your cloud-config through a YAML linter.  I know we confirmed that it was fine previously, but we'll check everything.  Here's the one I generally use: http://yamllint.com/

Next up, can you verify you're using the openstack image specifically?

 $ cat /etc/oem-release 

ID=openstack

VERSION_ID=

NAME="Openstack"

HOME_URL="https://www.openstack.org/"

BUG_REPORT_URL="https://github.com/coreos/bugs/issues"

I ask because we perform different actions for different hypervisor providers.

--Brian

[Jim Walters]

OK, I'll lint the YAML:

#cloud-config

# this is a sample cloud-config which is known working on OpenStack

# the definition starts etcd & fleet, and creates a user 'core' with

# password 'coreos' 

users:

  - name: core

    passwd: $1$WEcH/2xY$H6XiwyUpcnZ5Mvcu0YqQD0

    ssh-authorized-keys:

      - ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCobfm/jGSrZ4aABl+JAXwTYZjWAklBtFfr+TiVJCGXqt2Rs1L8B6K36i0vWyOqQWfrkveiF8/DderPgOb4BvGNyP+IROXPfSJqi0lN6zlfQSswKdXPzefohn5uO2JJtdEfftuR3Lxc63ZBLh1fg6zCBaqOrEilcRIU1kAitQec8VoMP9nqHwRcBiW5YlodNoubDKz6Ic4Ps3NH0UHHivPHUxCcZ2YBP0AV/GJIQQGWkDXYcRGNZa3cci1I/3icV/rnThn2wWWQIPMr3yucHxT/7Y7zTi0O1BJJ5hYz1hJbqtqORzeHmcrD+KIg4arBQwPOXE7Tb5Wyn0D/vXSgKnvl Generated by Nova 

Valid YAML!

I'm assuming you want me to cat the /etc/oem-release that exists within the image. And I can't log into the image to see the file system. I tried guestfish at the start of this adventure to see if I could set a password, but under guestfish all I could see was the boot partition.

[Jim Walters]

I checked the bz2 image downloaded with the sha1 hash listed in http://storage.core-os.net/coreos/amd64-usr/alpha/coreos_production_openstack.DIGESTS.asc

They matched.

[Alexander Kellett]

I’m a complete newbie so I may be way off base but in my local configurations I’m not creating core as it’s already built by coreos. I use a ssh-authorized-keys at the top level rather than inside a core user definition.

Trimis de la Windows Mail

De la: Jim Walters
Trimis: ‎vineri‎, ‎9‎ ‎mai‎ ‎2014 ‎0‎:‎45
Către: coreo...@googlegroups.com

[Brian Harrington]

Alexander,

There are two things happening.  Jim is defining the core user explicitly because he needs to set the password to get around ssh-authorized-keys.  It is technically valid to have ssh-authorized-keys as well outside of the users definition, but this has to be a top level declaration in the YAML file.  This is where you would set the password is set for the default non-root user on an image (think "ec2-user" on older Amazon AMIs).

--Brian "Redbeard" Harrington

[Jim Walters]

Brian. May not be the most help, but got the console log from the booting instance. Anything in here look wrong?

SYSLINUX 3.86 2010-04-01  Copyright (C) 1994-2010 H. Peter Anvin et al

Loading vmlinuz-boot_kernel...............................................................................................................................................................................................................................................................................................................................ready.

[    0.000000] Initializing cgroup subsys cpuset

[    0.000000] Initializing cgroup subsys cpu

[    0.000000] Initializing cgroup subsys cpuacct

[    0.000000] Linux version 3.13.6+ (buildbot@ip-10-245-113-56) (gcc version 4.6.3 (Gentoo Hardened 4.6.3 p1.13, pie-0.5.2) ) #2 SMP Wed Mar 12 23:17:11 UTC 2014

[    0.000000] Command line: console=ttyS0,115200n8 console=tty0 ro noswap cros_legacy root=gptprio: BOOT_IMAGE=vmlinuz-boot_kernel 

[    0.000000] e820: BIOS-provided physical RAM map:

[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable

[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000dfffdfff] usable

[    0.000000] BIOS-e820: [mem 0x00000000dfffe000-0x00000000dfffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000011fffffff] usable

[    0.000000] NX (Execute Disable) protection: active

[    0.000000] SMBIOS 2.4 present.

[    0.000000] Hypervisor detected: KVM

[    0.000000] No AGP bridge found

[    0.000000] e820: last_pfn = 0x120000 max_arch_pfn = 0x400000000

[    0.000000] x86 PAT enabled: cpu 0, old 0x70406, new 0x7010600070106

[    0.000000] e820: last_pfn = 0xdfffe max_arch_pfn = 0x400000000

[    0.000000] Using GB pages for direct mapping

[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]

[    0.000000] init_memory_mapping: [mem 0x11fe00000-0x11fffffff]

[    0.000000] init_memory_mapping: [mem 0x11c000000-0x11fdfffff]

[    0.000000] init_memory_mapping: [mem 0x100000000-0x11bffffff]

[    0.000000] init_memory_mapping: [mem 0x00100000-0xdfffdfff]

[    0.000000] ACPI: RSDP 00000000000f1410 000014 (v00 BOCHS )

[    0.000000] ACPI: RSDT 00000000dfffe3f0 000034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)

[    0.000000] ACPI: FACP 00000000dfffff80 000074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)

[    0.000000] ACPI: DSDT 00000000dfffe430 001137 (v01   BXPC   BXDSDT 00000001 INTL 20100528)

[    0.000000] ACPI: FACS 00000000dfffff40 000040

[    0.000000] ACPI: SSDT 00000000dffff6a0 000899 (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)

[    0.000000] ACPI: APIC 00000000dffff5b0 000080 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)

[    0.000000] ACPI: HPET 00000000dffff570 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)

[    0.000000] No NUMA configuration found

[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000011fffffff]

[    0.000000] Initmem setup node 0 [mem 0x00000000-0x11fffffff]

[    0.000000]   NODE_DATA [mem 0x11fff7000-0x11fffdfff]

[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00

[    0.000000] kvm-clock: cpu 0, msr 1:1fff5001, boot clock

[    0.000000] Zone ranges:

[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]

[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]

[    0.000000]   Normal   [mem 0x100000000-0x11fffffff]

[    0.000000] Movable zone start for each node

[    0.000000] Early memory node ranges

[    0.000000]   node   0: [mem 0x00001000-0x0009efff]

[    0.000000]   node   0: [mem 0x00100000-0xdfffdfff]

[    0.000000]   node   0: [mem 0x100000000-0x11fffffff]

[    0.000000] ACPI: PM-Timer IO Port: 0xb008

[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)

[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)

[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])

[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])

[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)

[    0.000000] Using ACPI (MADT) for SMP configuration information

[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000

[    0.000000] smpboot: Allowing 2 CPUs, 0 hotplug CPUs

[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]

[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]

[    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]

[    0.000000] PM: Registered nosave memory: [mem 0xdfffe000-0xdfffffff]

[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xfeffbfff]

[    0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]

[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff]

[    0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff]

[    0.000000] e820: [mem 0xe0000000-0xfeffbfff] available for PCI devices

[    0.000000] Booting paravirtualized kernel on KVM

[    0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:2 nr_node_ids:1

[    0.000000] PERCPU: Embedded 28 pages/cpu @ffff88011fc00000 s84736 r8192 d21760 u1048576

[    0.000000] kvm-clock: cpu 0, msr 1:1fff5001, primary cpu clock

[    0.000000] KVM setup async PF for cpu 0

[    0.000000] kvm-stealtime: cpu 0, msr 11fc0de00

[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 1032071

[    0.000000] Policy zone: Normal

[    0.000000] Kernel command line: root=gptprio: init=/usr/lib/systemd/systemd console=ttyS0,115200n8 console=tty0 ro noswap cros_legacy root=gptprio: BOOT_IMAGE=vmlinuz-boot_kernel 

[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)

[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340

[    0.000000] Checking aperture...

[    0.000000] No AGP bridge found

[    0.000000] Memory: 4031876K/4193904K available (4982K kernel code, 844K rwdata, 2104K rodata, 17640K init, 1052K bss, 162028K reserved)

[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1

[    0.000000] Hierarchical RCU implementation.

[    0.000000] RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=2.

[    0.000000] NR_IRQS:8448 nr_irqs:512 16

[    0.000000] Console: colour VGA+ 80x25

[    0.000000] console [tty0] enabled

[    0.000000] console [ttyS0] enabled

[    0.000000] allocated 16777216 bytes of page_cgroup

[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups

[    0.000000] tsc: Detected 2000.026 MHz processor

[    0.002000] Calibrating delay loop (skipped) preset value.. 4000.05 BogoMIPS (lpj=2000026)

[    0.003004] pid_max: default: 32768 minimum: 301

[    0.005009] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)

[    0.008005] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)

[    0.010059] Mount-cache hash table entries: 256

[    0.011100] Initializing cgroup subsys memory

[    0.011955] Initializing cgroup subsys devices

[    0.012004] Initializing cgroup subsys freezer

[    0.013014] Initializing cgroup subsys blkio

[    0.014006] Initializing cgroup subsys perf_event

[    0.015080] mce: CPU supports 10 MCE banks

[    0.016050] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.016050] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.016050] tlb_flushall_shift: 5

[    0.017162] Freeing SMP alternatives memory: 20K (ffffffff82c0f000 - ffffffff82c14000)

[    0.021732] ACPI: Core revision 20131115

[    0.023118] ACPI: All ACPI Tables successfully acquired

[    0.024028] ftrace: allocating 19054 entries in 75 pages

[    0.029241] Enabling x2apic

[    0.029877] Enabled x2apic

[    0.030004] Switched APIC routing to physical x2apic.

[    0.032739] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1

[    0.033002] smpboot: CPU0: Intel Xeon E312xx (Sandy Bridge) (fam: 06, model: 2a, stepping: 01)

[    0.038755] Performance Events: unsupported p6 CPU model 42 no PMU driver, software events only.

[    0.040919] NMI watchdog: disabled (cpu0): hardware events not enabled

[    0.041078] x86: Booting SMP configuration:

[    0.041995] .... node  #0, CPUs:      #1[    0.002000] kvm-clock: cpu 1, msr 1:1fff5041, secondary cpu clock

[    0.054025] x86: Booted up 1 node, 2 CPUs

[    0.054031] KVM setup async PF for cpu 1

[    0.054034] kvm-stealtime: cpu 1, msr 11fd0de00

[    0.055004] smpboot: Total of 2 processors activated (8000.10 BogoMIPS)

[    0.056349] devtmpfs: initialized

[    0.059544] NET: Registered protocol family 16

[    0.060063] cpuidle: using governor ladder

[    0.060819] cpuidle: using governor menu

[    0.061172] ACPI: bus type PCI registered

[    0.061925] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5

[    0.062034] dca service started, version 1.12.1

[    0.062896] PCI: Using configuration type 1 for base access

[    0.063361] bio: create slab <bio-0> at 0

[    0.064521] ACPI: Added _OSI(Module Device)

[    0.065004] ACPI: Added _OSI(Processor Device)

[    0.065796] ACPI: Added _OSI(3.0 _SCP Extensions)

[    0.066004] ACPI: Added _OSI(Processor Aggregator Device)

[    0.068600] ACPI: Interpreter enabled

[    0.069008] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20131115/hwxface-580)

[    0.070522] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20131115/hwxface-580)

[    0.072018] ACPI: (supports S0 S3 S4 S5)

[    0.072745] ACPI: Using IOAPIC for interrupt routing

[    0.073014] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug

[    0.076275] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])

[    0.077007] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]

[    0.078008] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM

[    0.079068] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

[    0.080239] acpiphp: Slot [3] registered

[    0.080983] acpiphp: Slot [4] registered

[    0.081025] acpiphp: Slot [5] registered

[    0.081767] acpiphp: Slot [6] registered

[    0.082022] acpiphp: Slot [7] registered

[    0.082779] acpiphp: Slot [8] registered

[    0.083022] acpiphp: Slot [9] registered

[    0.083763] acpiphp: Slot [10] registered

[    0.084022] acpiphp: Slot [11] registered

[    0.084781] acpiphp: Slot [12] registered

[    0.085022] acpiphp: Slot [13] registered

[    0.085776] acpiphp: Slot [14] registered

[    0.086022] acpiphp: Slot [15] registered

[    0.086797] acpiphp: Slot [16] registered

[    0.087022] acpiphp: Slot [17] registered

[    0.087771] acpiphp: Slot [18] registered

[    0.088023] acpiphp: Slot [19] registered

[    0.088778] acpiphp: Slot [20] registered

[    0.089023] acpiphp: Slot [21] registered

[    0.089791] acpiphp: Slot [22] registered

[    0.090022] acpiphp: Slot [23] registered

[    0.090775] acpiphp: Slot [24] registered

[    0.091022] acpiphp: Slot [25] registered

[    0.091772] acpiphp: Slot [26] registered

[    0.092024] acpiphp: Slot [27] registered

[    0.092778] acpiphp: Slot [28] registered

[    0.093026] acpiphp: Slot [29] registered

[    0.093776] acpiphp: Slot [30] registered

[    0.094021] acpiphp: Slot [31] registered

[    0.094764] PCI host bridge to bus 0000:00

[    0.095005] pci_bus 0000:00: root bus resource [bus 00-ff]

[    0.095922] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7]

[    0.096004] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]

[    0.097004] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]

[    0.098005] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xfebfffff]

[    0.109887] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI

[    0.110013] pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB

[    0.154669] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)

[    0.155894] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)

[    0.156885] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)

[    0.157881] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)

[    0.158838] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)

[    0.159887] ACPI: Enabled 16 GPEs in block 00 to 0F

[    0.160093] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none

[    0.161013] vgaarb: loaded

[    0.162009] vgaarb: bridge control possible 0000:00:02.0

[    0.163074] PCI: Using ACPI for IRQ routing

[    0.164545] HPET: 3 timers in total, 0 timers will be used for per-cpu timer

[    0.165051] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0

[    0.167004] hpet0: 3 comparators, 64-bit 100.000000 MHz counter

[    0.173027] Switched to clocksource kvm-clock

[    0.177829] pnp: PnP ACPI init

[    0.178524] ACPI: bus type PNP registered

[    0.179758] pnp: PnP ACPI: found 7 devices

[    0.180570] ACPI: bus type PNP unregistered

[    0.189035] NET: Registered protocol family 2

[    0.189983] TCP established hash table entries: 32768 (order: 6, 262144 bytes)

[    0.191458] TCP bind hash table entries: 32768 (order: 7, 524288 bytes)

[    0.192603] TCP: Hash tables configured (established 32768 bind 32768)

[    0.193702] TCP: reno registered

[    0.194387] UDP hash table entries: 2048 (order: 4, 65536 bytes)

[    0.195415] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)

[    0.196527] NET: Registered protocol family 1

[    0.197346] pci 0000:00:00.0: Limiting direct PCI/PCI transfers

[    0.198361] pci 0000:00:01.0: PIIX3: Enabling Passive Release

[    0.199365] pci 0000:00:01.0: Activating ISA DMA hang workarounds

[    0.200633] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11

[    0.459534] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)

[    0.460696] software IO TLB [mem 0xdbffe000-0xdfffe000] (64MB) mapped at [ffff8800dbffe000-ffff8800dfffdfff]

[    0.462910] Initialise system trusted keyring

[    0.465699] HugeTLB registered 2 MB page size, pre-allocated 0 pages

[    0.471545] VFS: Disk quotas dquot_6.5.2

[    0.473454] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)

[    0.476277] aufs 3.13

[    0.477562] msgmni has been set to 7874

[    0.479251] alg: No test for stdrng (krng)

[    0.480078] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)

[    0.481531] io scheduler noop registered

[    0.482299] io scheduler deadline registered

[    0.483137] io scheduler cfq registered (default)

[    0.484043] pci_hotplug: PCI Hot Plug PCI Core version: 0.5

[    0.485031] pciehp: PCI Express Hot Plug Controller Driver version: 0.4

[    0.486242] GHES: HEST is not enabled!

[    0.486984] ioatdma: Intel(R) QuickData Technology Driver 4.00

[    0.488051] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled

[    0.510556] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A

[    0.533410] 00:05: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A

[    0.535094] libphy: Fixed MDIO Bus: probed

[    0.535893] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12

[    0.538114] serio: i8042 KBD port at 0x60,0x64 irq 1

[    0.539939] serio: i8042 AUX port at 0x60,0x64 irq 12

[    0.542635] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0

[    0.546548] rtc_cmos 00:00: RTC can wake from S4

[    0.549187] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0

[    0.551113] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet irqs

[    0.552332] TCP: cubic registered

[    0.553077] NET: Registered protocol family 10

[    0.554033] NET: Registered protocol family 17

[    0.555410] Loading compiled-in X.509 certificates

[    0.556311] registered taskstats version 1

[    0.557642] rtc_cmos 00:00: setting system clock to 2014-05-12 15:10:18 UTC (1399907418)

[    0.564267] Freeing unused kernel memory: 17640K (ffffffff81ad5000 - ffffffff82c0f000)

[    0.565797] Write protecting the kernel read-only data: 10240k

[    0.569505] Freeing unused kernel memory: 1152K (ffff8800014e0000 - ffff880001600000)

[    0.574895] Freeing unused kernel memory: 1992K (ffff88000180e000 - ffff880001a00000)

[    0.578054] random: systemd urandom read with 1 bits of entropy available

[    0.581287] systemd[1]: systemd 211 running in system mode. (+PAM -LIBWRAP -AUDIT -SELINUX +IMA -SYSVINIT -LIBCRYPTSETUP -GCRYPT -ACL -XZ +SECCOMP -APPARMOR)

[    0.586487] systemd[1]: Detected virtualization 'kvm'.

[    0.587457] systemd[1]: Detected architecture 'x86-64'.

[    0.588411] systemd[1]: Running in initial RAM disk.

[    0.591039] systemd[1]: Inserted module 'autofs4'

[    0.592219] systemd[1]: No hostname configured.

[    0.593267] systemd[1]: Set hostname to <localhost>.

[    0.594416] systemd[1]: Initializing machine ID from KVM UUID.

[    0.603970] systemd[1]: Starting Timers.

[    0.606778] systemd[1]: Reached target Timers.

[    0.608652] systemd[1]: Starting -.slice.

[    0.613996] systemd[1]: Created slice -.slice.

[    0.615028] systemd[1]: Starting udev Kernel Socket.

[    0.616807] systemd[1]: Listening on udev Kernel Socket.

[    0.617875] systemd[1]: Starting Journal Socket.

[    0.619784] systemd[1]: Listening on Journal Socket.

[    0.620851] systemd[1]: Starting System Slice.

[    0.622789] systemd[1]: Created slice System Slice.

[    0.623945] systemd[1]: Starting dracut cmdline hook...

[    0.626142] systemd[1]: Started Load Kernel Modules.

[    0.627347] systemd[1]: Starting Create list of required static device nodes for the current kernel...

[    0.630676] systemd[1]: Starting Journal Service...

[    0.634108] systemd[1]: Started Journal Service.

[    0.647050] systemd[1]: Starting Slices.

[    0.647223] dracut-cmdline[39]: dracut-dracut-034-r1

[    0.651764] systemd[1]: Reached target Slices.

[    0.652878] systemd[1]: Starting udev Control Socket.

[    0.654042] systemd[1]: Listening on udev Control Socket.

[    0.655212] systemd[1]: Starting Sockets.

[    0.656151] systemd[1]: Reached target Sockets.

[    0.657200] systemd[1]: Starting Dispatch Password Requests to Console Directory Watch.

[    0.663458] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.

[    0.668167] systemd[1]: Starting Paths.

[    0.669119] systemd[1]: Reached target Paths.

[    0.670120] systemd[1]: Starting Swap.

[    0.671086] systemd[1]: Reached target Swap.

[    0.672041] systemd[1]: Starting Local File Systems.

[    0.673235] systemd[1]: Reached target Local File Systems.

[    0.674664] systemd[1]: Started Create list of required static device nodes for the current kernel.

[    0.676604] systemd[1]: Starting Create Static Device Nodes in /dev...

[    0.677978] systemd[1]: Started Create Static Device Nodes in /dev.

[    0.679433] dracut-cmdline[39]: bootengine: waiting on CoreOS ROOT partitions

[    0.694625] systemd[1]: Started dracut cmdline hook.

[    0.695897] systemd[1]: Starting dracut pre-udev hook...

[    0.736131] systemd[1]: Started dracut pre-udev hook.

[    0.736472] systemd[1]: Starting udev Kernel Device Manager...

[    0.745521] systemd-udevd[132]: starting version 211

[    0.748894] systemd-udevd[132]: specified group 'tty' unknown

[    0.752176] systemd-udevd[132]: specified group 'uucp' unknown

[    0.754922] systemd-udevd[132]: specified group 'kmem' unknown

[    0.755240] systemd-udevd[132]: specified group 'video' unknown

[    0.755502] systemd-udevd[132]: specified group 'audio' unknown

[    0.755755] systemd-udevd[132]: specified group 'lp' unknown

[    0.756059] systemd-udevd[132]: specified group 'disk' unknown

[    0.767165] systemd[1]: Started udev Kernel Device Manager.

[    0.769900] systemd[1]: Started dracut pre-trigger hook.

[    0.770226] systemd[1]: Starting udev Coldplug all Devices...

[    0.794582] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2

[    0.794585] ACPI: Power Button [PWRF]

[    0.797515] systemd[1]: Started udev Coldplug all Devices.

[    0.799257] SCSI subsystem initialized

[    0.799272] systemd[1]: Starting dracut initqueue hook...

[    0.804191] systemd[1]: Starting System Initialization.

[    0.805416] systemd[1]: Reached target System Initialization.

[    0.806750] systemd[1]: Starting Basic System.

[    0.807847] systemd[1]: Reached target Basic System.

[    0.814701] ACPI: bus type USB registered

[    0.814772] scsi0 : ata_piix

[    0.814828] scsi1 : ata_piix

[    0.814853] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0a0 irq 14

[    0.814854] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0a8 irq 15

[    0.820546] usbcore: registered new interface driver usbfs

[    0.821749] usbcore: registered new interface driver hub

[    0.825339] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10

[    0.827653] usbcore: registered new device driver usb

[    0.828500] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0xb100, revision 0

[    0.832130] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver

[    0.832247] systemd[1]: Reloading.

[    0.840881] uhci_hcd: USB Universal Host Controller Interface driver

[    0.843984] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10

[    0.847991] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3

[    0.856528] microcode: CPU0 sig=0x206a1, pf=0x1, revision=0x1

[    0.859431] platform microcode: Direct firmware load failed with error -2

[    0.860721] platform microcode: Falling back to user helper

[    0.862022] microcode: CPU1 sig=0x206a1, pf=0x1, revision=0x1

[    0.865242] platform microcode: Direct firmware load failed with error -2

[    0.866633] platform microcode: Falling back to user helper

[    0.869570] uhci_hcd 0000:00:01.2: UHCI Host Controller

[    0.869586] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1

[    0.869781] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c080

[    0.870314] hub 1-0:1.0: USB hub found

[    0.870325] hub 1-0:1.0: 2 ports detected

[    0.877879] microcode: Microcode Update Driver: v2.00 <tig...@aivazian.fsnet.co.uk>, Peter Oruba

[    0.885645] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)

[    1.235597] ata2.01: ATAPI: QEMU DVD-ROM, 1.5.0, max UDMA/100

[    1.237349] ata2.01: configured for MWDMA2

[    1.239178] scsi 1:0:1:0: CD-ROM            QEMU     QEMU DVD-ROM     1.5. PQ: 0 ANSI: 5

[    1.245527] blk-mq: CPU -> queue map

[    1.247189]   CPU 0 -> Queue 0

[    1.248121]   CPU 1 -> Queue 0

[    1.300076] mousedev: PS/2 mouse device common for all mice

[    1.327820] sr0: scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray

[    1.329111] cdrom: Uniform CD-ROM driver Revision: 3.20

[    1.335374] GPT:Primary header thinks Alt. header is not at the end of the disk.

[    1.340284] GPT:11145215 != 83886079

[    1.342471] GPT:Alternate GPT header not at the end of the disk.

[    1.345863] GPT:11145215 != 83886079

[    1.348013] GPT: Use GNU Parted to correct GPT errors.

[    1.350311]  vda: vda1 vda2 vda3 vda4 vda6 vda9

[    1.438067] usb 1-1: new full-speed USB device number 2 using uhci_hcd

[    1.464094] tsc: Refined TSC clocksource calibration: 2000.028 MHz

[    1.540667] systemd[1]: Started dracut initqueue hook.

[    1.543477] systemd[1]: Starting dracut pre-mount hook...

[    1.574166] systemd[1]: Started dracut pre-mount hook.

[    1.575269] systemd[1]: Starting Initrd Root File System.

[    1.576947] systemd[1]: Reached target Initrd Root File System.

[    1.577101] systemd[1]: Starting Reload Configuration from the Real Root...

[    1.582841] systemd[1]: Reloading.

[    1.604476] usbcore: registered new interface driver usbhid

[    1.606692] usbhid: USB HID core driver

[    1.608255] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/input/input4

[    1.610488] hid-generic 0003:0627:0001.0001: input: USB HID v0.01 Pointer [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0

[    1.619154] systemd[1]: Started Reload Configuration from the Real Root.

[    1.621400] systemd[1]: Starting Initrd File Systems.

[    1.623213] systemd[1]: Reached target Initrd File Systems.

[    1.624447] systemd[1]: Starting dracut mount hook...

[    1.652460] dracut-mount[220]: ERROR: cgpt next: GptSanityCheck() returned 4: GPT_ERROR_INVALID_SECTOR_SIZE

[    1.755537] dracut-mount[220]: bootengine: selected PARTUUID 7130c94a-213a-4e5a-8e26-6cce9662f132

[    1.759843] dracut-mount[220]: bootengine: mounting /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132 to /sysroot

[    1.816124] EXT4-fs (vda3): mounted filesystem without journal. Opts: (null)

[    1.946116] dracut-mount[220]: bootengine: loading kernel from /sysroot/boot/vmlinuz...

[    2.739440] waiting module removal not supported: please upgrade

[    2.742205] waiting module removal not supported: please upgradewaiting module removal not supported: please upgrade

[    2.764296] waiting module removal not supported: please upgradewaiting module removal not supported: please upgrade

[    2.774179] waiting module removal not supported: please upgradedracut-mount[220]: bootengine: attempting to exec new kernel!

[    2.779548] Unregister pv shared memory for cpu 0

[    2.782115] Unregister pv shared memory for cpu 1

[    2.783171] kvm: exiting hardware virtualization

[    2.786264] Starting new kernel

[    0.000000] Initializing cgroup subsys cpuset

[    0.000000] Initializing cgroup subsys cpu

[    0.000000] Initializing cgroup subsys cpuacct

[    0.000000] Linux version 3.13.6+ (buildbot@ip-10-245-113-56) (gcc version 4.6.3 (Gentoo Hardened 4.6.3 p1.13, pie-0.5.2) ) #2 SMP Wed Mar 12 23:17:11 UTC 2014

[    0.000000] Command line: root=gptprio: init=/usr/lib/systemd/systemd console=ttyS0,115200n8 console=tty0 ro noswap cros_legacy root=gptprio:  root=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132

[    0.000000] e820: BIOS-provided physical RAM map:

[    0.000000] BIOS-e820: [mem 0x0000000000000100-0x000000000009fbff] usable

[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000dfffdfff] usable

[    0.000000] BIOS-e820: [mem 0x00000000dfffe000-0x00000000dfffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved

[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved

[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000011fffffff] usable

[    0.000000] NX (Execute Disable) protection: active

[    0.000000] SMBIOS 2.4 present.

[    0.000000] Hypervisor detected: KVM

[    0.000000] No AGP bridge found

[    0.000000] e820: last_pfn = 0x120000 max_arch_pfn = 0x400000000

[    0.000000] x86 PAT enabled: cpu 0, old 0x70106, new 0x7010600070106

[    0.000000] x2apic enabled by BIOS, switching to x2apic ops

[    0.000000] e820: last_pfn = 0xdfffe max_arch_pfn = 0x400000000

[    0.000000] Using GB pages for direct mapping

[    0.000000] init_memory_mapping: [mem 0x00000000-0x000fffff]

[    0.000000] init_memory_mapping: [mem 0x11fe00000-0x11fffffff]

[    0.000000] init_memory_mapping: [mem 0x11c000000-0x11fdfffff]

[    0.000000] init_memory_mapping: [mem 0x100000000-0x11bffffff]

[    0.000000] init_memory_mapping: [mem 0x00100000-0xdfffdfff]

[    0.000000] ACPI: RSDP 00000000000f1410 000014 (v00 BOCHS )

[    0.000000] ACPI: RSDT 00000000dfffe3f0 000034 (v01 BOCHS  BXPCRSDT 00000001 BXPC 00000001)

[    0.000000] ACPI: FACP 00000000dfffff80 000074 (v01 BOCHS  BXPCFACP 00000001 BXPC 00000001)

[    0.000000] ACPI: DSDT 00000000dfffe430 001137 (v01   BXPC   BXDSDT 00000001 INTL 20100528)

[    0.000000] ACPI: FACS 00000000dfffff40 000040

[    0.000000] ACPI: SSDT 00000000dffff6a0 000899 (v01 BOCHS  BXPCSSDT 00000001 BXPC 00000001)

[    0.000000] ACPI: APIC 00000000dffff5b0 000080 (v01 BOCHS  BXPCAPIC 00000001 BXPC 00000001)

[    0.000000] ACPI: HPET 00000000dffff570 000038 (v01 BOCHS  BXPCHPET 00000001 BXPC 00000001)

[    0.000000] Setting APIC routing to cluster x2apic.

[    0.000000] No NUMA configuration found

[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000011fffffff]

[    0.000000] Initmem setup node 0 [mem 0x00000000-0x11fffffff]

[    0.000000]   NODE_DATA [mem 0x11fff9000-0x11fffffff]

[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00

[    0.000000] kvm-clock: cpu 0, msr 1:1fff7001, boot clock

[    0.000000] Zone ranges:

[    0.000000]   DMA      [mem 0x00001000-0x00ffffff]

[    0.000000]   DMA32    [mem 0x01000000-0xffffffff]

[    0.000000]   Normal   [mem 0x100000000-0x11fffffff]

[    0.000000] Movable zone start for each node

[    0.000000] Early memory node ranges

[    0.000000]   node   0: [mem 0x00001000-0x0009efff]

[    0.000000]   node   0: [mem 0x00100000-0xdfffdfff]

[    0.000000]   node   0: [mem 0x100000000-0x11fffffff]

[    0.000000] ACPI: PM-Timer IO Port: 0xb008

[    0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)

[    0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)

[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])

[    0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])

[    0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)

[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)

[    0.000000] Using ACPI (MADT) for SMP configuration information

[    0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000

[    0.000000] smpboot: Allowing 2 CPUs, 0 hotplug CPUs

[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]

[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000effff]

[    0.000000] PM: Registered nosave memory: [mem 0x000f0000-0x000fffff]

[    0.000000] PM: Registered nosave memory: [mem 0xdfffe000-0xdfffffff]

[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xfeffbfff]

[    0.000000] PM: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]

[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xfffbffff]

[    0.000000] PM: Registered nosave memory: [mem 0xfffc0000-0xffffffff]

[    0.000000] e820: [mem 0xe0000000-0xfeffbfff] available for PCI devices

[    0.000000] Booting paravirtualized kernel on KVM

[    0.000000] setup_percpu: NR_CPUS:128 nr_cpumask_bits:128 nr_cpu_ids:2 nr_node_ids:1

[    0.000000] PERCPU: Embedded 28 pages/cpu @ffff88011fc00000 s84736 r8192 d21760 u1048576

[    0.000000] kvm-clock: cpu 0, msr 1:1fff7001, primary cpu clock

[    0.000000] KVM setup async PF for cpu 0

[    0.000000] kvm-stealtime: cpu 0, msr 11fc0de00

[    0.000000] Built 1 zonelists in Node order, mobility grouping on.  Total pages: 1032071

[    0.000000] Policy zone: Normal

[    0.000000] Kernel command line: root=gptprio: init=/usr/lib/systemd/systemd root=gptprio: init=/usr/lib/systemd/systemd console=ttyS0,115200n8 console=tty0 ro noswap cros_legacy root=gptprio:  root=PARTUUID=7130c94a-213a-4e5a-8e26-6cce9662f132

[    0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)

[    0.000000] xsave: enabled xstate_bv 0x7, cntxt size 0x340

[    0.000000] Checking aperture...

[    0.000000] No AGP bridge found

[    0.000000] Memory: 4031884K/4193904K available (4982K kernel code, 844K rwdata, 2104K rodata, 17640K init, 1052K bss, 162020K reserved)

[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1

[    0.000000] Hierarchical RCU implementation.

[    0.000000] RCU restricting CPUs from NR_CPUS=128 to nr_cpu_ids=2.

[    0.000000] NR_IRQS:8448 nr_irqs:512 16

[    0.000000] Console: colour VGA+ 80x25

[    0.000000] console [tty0] enabled

[    0.000000] console [ttyS0] enabled

[    0.000000] allocated 16777216 bytes of page_cgroup

[    0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups

[    0.000000] tsc: Detected 2000.026 MHz processor

[    0.001000] Calibrating delay loop (skipped) preset value.. 4000.05 BogoMIPS (lpj=2000026)

[    0.001000] pid_max: default: 32768 minimum: 301

[    0.001000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)

[    0.001000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)

[    0.001000] Mount-cache hash table entries: 256

[    0.001000] Initializing cgroup subsys memory

[    0.001000] Initializing cgroup subsys devices

[    0.001000] Initializing cgroup subsys freezer

[    0.001000] Initializing cgroup subsys blkio

[    0.001000] Initializing cgroup subsys perf_event

[    0.001000] mce: CPU supports 10 MCE banks

[    0.001000] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.001000] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0

[    0.001000] tlb_flushall_shift: 5

[    0.001000] Freeing SMP alternatives memory: 20K (ffffffff82c0f000 - ffffffff82c14000)

[    0.001000] ACPI: Core revision 20131115

[    0.001000] ACPI: All ACPI Tables successfully acquired

[    0.001000] ftrace: allocating 19054 entries in 75 pages

[    0.001000] Switched APIC routing to physical x2apic.

[    0.001000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1

[    0.001004] smpboot: CPU0: Intel Xeon E312xx (Sandy Bridge) (fam: 06, model: 2a, stepping: 01)

[    0.006710] Performance Events: unsupported p6 CPU model 42 no PMU driver, software events only.

[    0.008846] NMI watchdog: disabled (cpu0): hardware events not enabled

[    0.009075] x86: Booting SMP configuration:

[    0.009877] .... node  #0, CPUs:      #1[    0.001000] Enabling x2apic

[    0.001000] kvm-clock: cpu 1, msr 1:1fff7041, secondary cpu clock

[    0.022025] x86: Booted up 1 node, 2 CPUs

[    0.022016] KVM setup async PF for cpu 1

[    0.022016] kvm-stealtime: cpu 1, msr 11fd0de00

[    0.023004] smpboot: Total of 2 processors activated (8000.10 BogoMIPS)

[    0.024426] devtmpfs: initialized

[    0.027598] NET: Registered protocol family 16

[    0.028066] cpuidle: using governor ladder

[    0.028844] cpuidle: using governor menu

[    0.029306] ACPI: bus type PCI registered

[    0.030004] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5

[    0.031034] dca service started, version 1.12.1

[    0.031949] PCI: Using configuration type 1 for base access

[    0.032383] bio: create slab <bio-0> at 0

[    0.033073] ACPI: Added _OSI(Module Device)

[    0.034004] ACPI: Added _OSI(Processor Device)

[    0.034825] ACPI: Added _OSI(3.0 _SCP Extensions)

[    0.035004] ACPI: Added _OSI(Processor Aggregator Device)

[    0.037701] ACPI: Interpreter enabled

[    0.038007] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S1_] (20131115/hwxface-580)

[    0.039519] ACPI Exception: AE_NOT_FOUND, While evaluating Sleep State [\_S2_] (20131115/hwxface-580)

[    0.041012] ACPI: (supports S0 S3 S4 S5)

[    0.041741] ACPI: Using IOAPIC for interrupt routing

[    0.042015] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug

[    0.045336] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])

[    0.046007] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI]

[    0.047009] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM

[    0.048068] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.

[    0.049247] acpiphp: Slot [3] registered

[    0.050025] acpiphp: Slot [4] registered

[    0.050799] acpiphp: Slot [5] registered

[    0.051023] acpiphp: Slot [6] registered

[    0.051796] acpiphp: Slot [7] registered

[    0.052022] acpiphp: Slot [8] registered

[    0.052775] acpiphp: Slot [9] registered

[    0.053022] acpiphp: Slot [10] registered

[    0.053831] acpiphp: Slot [11] registered

[    0.054025] acpiphp: Slot [12] registered

[    0.054781] acpiphp: Slot [13] registered

[    0.055027] acpiphp: Slot [14] registered

[    0.055785] acpiphp: Slot [15] registered

[    0.056022] acpiphp: Slot [16] registered

[    0.056787] acpiphp: Slot [17] registered

[    0.057022] acpiphp: Slot [18] registered

[    0.057782] acpiphp: Slot [19] registered

[    0.058023] acpiphp: Slot [20] registered

[    0.058791] acpiphp: Slot [21] registered

[    0.059022] acpiphp: Slot [22] registered

[    0.059778] acpiphp: Slot [23] registered

[    0.060022] acpiphp: Slot [24] registered

[    0.061023] acpiphp: Slot [25] registered

[    0.061778] acpiphp: Slot [26] registered

[    0.062026] acpiphp: Slot [27] registered

[    0.062783] acpiphp: Slot [28] registered

[    0.063028] acpiphp: Slot [29] registered

[    0.063785] acpiphp: Slot [30] registered

[    0.064022] acpiphp: Slot [31] registered

[    0.064766] PCI host bridge to bus 0000:00

[    0.065005] pci_bus 0000:00: root bus resource [bus 00-ff]

[    0.065934] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7]

[    0.066005] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff]

[    0.067004] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff]

[    0.068004] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xfebfffff]

[    0.077470] pci 0000:00:01.3: quirk: [io  0xb000-0xb03f] claimed by PIIX4 ACPI

[    0.078013] pci 0000:00:01.3: quirk: [io  0xb100-0xb10f] claimed by PIIX4 SMB

[    0.111941] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)

[    0.112787] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 10 11) *0, disabled.

[    0.114077] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 *10 11)

[    0.115451] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)

[    0.116736] ACPI: PCI Interrupt Link [LNKS] (IRQs *9)

[    0.117800] ACPI: Enabled 16 GPEs in block 00 to 0F

[    0.118112] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none

[    0.119004] vgaarb: loaded

[    0.119602] vgaarb: bridge control possible 0000:00:02.0

[    0.120040] PCI: Using ACPI for IRQ routing

[    0.121151] HPET: 3 timers in total, 0 timers will be used for per-cpu timer

[    0.122026] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0

[    0.123004] hpet0: 3 comparators, 64-bit 100.000000 MHz counter

[    0.127048] Switched to clocksource kvm-clock

[    0.132586] pnp: PnP ACPI init

[    0.133271] ACPI: bus type PNP registered

[    0.134565] pnp: PnP ACPI: found 7 devices

[    0.135363] ACPI: bus type PNP unregistered

[    0.144874] NET: Registered protocol family 2

[    0.147069] TCP established hash table entries: 32768 (order: 6, 262144 bytes)

[    0.150341] TCP bind hash table entries: 32768 (order: 7, 524288 bytes)

[    0.153040] TCP: Hash tables configured (established 32768 bind 32768)

[    0.155597] TCP: reno registered

[    0.156486] UDP hash table entries: 2048 (order: 4, 65536 bytes)

[    0.157624] UDP-Lite hash table entries: 2048 (order: 4, 65536 bytes)

[    0.158874] NET: Registered protocol family 1

[    0.159737] pci 0000:00:00.0: Limiting direct PCI/PCI transfers

[    0.160798] pci 0000:00:01.0: Activating ISA DMA hang workarounds

[    0.162158] ACPI: PCI Interrupt Link [LNKD] enabled at IRQ 11

[    0.433687] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)

[    0.434857] software IO TLB [mem 0xdbffe000-0xdfffe000] (64MB) mapped at [ffff8800dbffe000-ffff8800dfffdfff]

[    0.437147] Initialise system trusted keyring

[    0.440083] HugeTLB registered 2 MB page size, pre-allocated 0 pages

[    0.444679] VFS: Disk quotas dquot_6.5.2

[    0.445482] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)

[    0.446719] aufs 3.13

[    0.447294] msgmni has been set to 7874

[    0.448689] alg: No test for stdrng (krng)

[    0.449548] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)

[    0.450982] io scheduler noop registered

[    0.451773] io scheduler deadline registered

[    0.452622] io scheduler cfq registered (default)

[    0.453560] pci_hotplug: PCI Hot Plug PCI Core version: 0.5

[    0.454531] pciehp: PCI Express Hot Plug Controller Driver version: 0.4

[    0.455827] GHES: HEST is not enabled!

[    0.456559] ioatdma: Intel(R) QuickData Technology Driver 4.00

[    0.457600] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled

[    0.480547] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A

[    0.503647] 00:05: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A

[    0.505448] libphy: Fixed MDIO Bus: probed

[    0.506254] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12

[    0.508396] serio: i8042 KBD port at 0x60,0x64 irq 1

[    0.509326] serio: i8042 AUX port at 0x60,0x64 irq 12

[    0.510520] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input0

[    0.512879] rtc_cmos 00:00: RTC can wake from S4

[    0.515397] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0

[    0.516781] rtc_cmos 00:00: alarms up to one day, 114 bytes nvram, hpet irqs

[    0.517986] TCP: cubic registered

[    0.518718] NET: Registered protocol family 10

[    0.519681] NET: Registered protocol family 17

[    0.521234] Loading compiled-in X.509 certificates

[    0.522116] registered taskstats version 1

[    0.523509] rtc_cmos 00:00: setting system clock to 2014-05-12 15:10:22 UTC (1399907422)

[    0.531052] Freeing unused kernel memory: 17640K (ffffffff81ad5000 - ffffffff82c0f000)

[    0.532862] Write protecting the kernel read-only data: 10240k

[    0.536415] Freeing unused kernel memory: 1152K (ffff88011d4e0000 - ffff88011d600000)

[    0.541962] Freeing unused kernel memory: 1992K (ffff88011d80e000 - ffff88011da00000)

[    0.546733] random: systemd urandom read with 1 bits of entropy available

[    0.550419] systemd[1]: systemd 211 running in system mode. (+PAM -LIBWRAP -AUDIT -SELINUX +IMA -SYSVINIT -LIBCRYPTSETUP -GCRYPT -ACL -XZ +SECCOMP -APPARMOR)

[    0.553552] systemd[1]: Detected virtualization 'kvm'.

[    0.554480] systemd[1]: Detected architecture 'x86-64'.

[    0.555453] systemd[1]: Running in initial RAM disk.

[    0.558158] systemd[1]: Inserted module 'autofs4'

[    0.559132] systemd[1]: No hostname configured.

[    0.560327] systemd[1]: Set hostname to <localhost>.

[    0.562383] systemd[1]: Initializing machine ID from KVM UUID.

[    0.568752] systemd[1]: Expecting device dev-disk-by\x2dpartuuid-7130c94a\x2d213a\x2d4e5a\x2d8e26\x2d6cce9662f132.device...

[    0.571296] systemd[1]: Starting Timers.

[    0.572774] systemd[1]: Reached target Timers.

[    0.573672] systemd[1]: Starting -.slice.

[    0.577709] systemd[1]: Created slice -.slice.

[    0.578655] systemd[1]: Starting udev Kernel Socket.

[    0.580267] systemd[1]: Listening on udev Kernel Socket.

[    0.581250] systemd[1]: Starting Journal Socket.

[    0.582978] systemd[1]: Listening on Journal Socket.

[    0.583889] systemd[1]: Starting System Slice.

[    0.585534] systemd[1]: Created slice System Slice.

[    0.586466] systemd[1]: Starting system-systemd\x2dfsck.slice.

[    0.588314] systemd[1]: Created slice system-systemd\x2dfsck.slice.

[    0.589522] systemd[1]: Starting dracut cmdline hook...

[    0.591430] systemd[1]: Started Load Kernel Modules.

[    0.592459] systemd[1]: Starting Create list of required static device nodes for the current kernel...

[    0.595096] systemd[1]: Starting Journal Service...

[    0.598163] systemd[1]: Started Journal Service.

[    0.613801] systemd[1]: Starting Slices.

[    0.615860] systemd[1]: Reached target Slices.

[    0.617588] systemd[1]: Starting udev Control Socket.

[    0.620041] systemd[1]: Listening on udev Control Socket.

[    0.622322] systemd[1]: Starting Sockets.

[    0.623283] systemd[1]: Reached target Sockets.

[    0.624377] systemd[1]: Starting Dispatch Password Requests to Console Directory Watch.

[    0.626035] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.

[    0.627665] systemd[1]: Starting Paths.

[    0.628611] systemd[1]: Reached target Paths.

[    0.629586] systemd[1]: Starting Swap.

[    0.630480] systemd[1]: Starting Local File Systems.

[    0.631535] systemd[1]: Reached target Local File Systems.

[    0.632702] systemd[1]: Started Create list of required static device nodes for the current kernel.

[    0.634581] systemd[1]: Starting Create Static Device Nodes in /dev...

[    0.635935] systemd[1]: Started Create Static Device Nodes in /dev.

[    0.637245] dracut-cmdline[39]: dracut-dracut-034-r1

[    0.645952] systemd[1]: Started dracut cmdline hook.

[    0.647426] systemd[1]: Starting dracut pre-udev hook...

[    0.694173] systemd[1]: Started dracut pre-udev hook.

[    0.694524] systemd[1]: Starting udev Kernel Device Manager...

[    0.699252] systemd-udevd[122]: starting version 211

[    0.701779] systemd-udevd[122]: specified group 'tty' unknown

[    0.704098] systemd-udevd[122]: specified group 'uucp' unknown

[    0.704225] systemd-udevd[122]: specified group 'kmem' unknown

[    0.704342] systemd-udevd[122]: specified group 'video' unknown

[    0.704455] systemd-udevd[122]: specified group 'audio' unknown

[    0.704567] systemd-udevd[122]: specified group 'lp' unknown

[    0.704683] systemd-udevd[122]: specified group 'disk' unknown

[    0.712278] systemd[1]: Started udev Kernel Device Manager.

[    0.713478] systemd[1]: Started dracut pre-trigger hook.

[    0.713601] systemd[1]: Starting udev Coldplug all Devices...

[    0.726552] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input2

[    0.729785] ACPI: Power Button [PWRF]

[    0.730719] systemd[1]: Started udev Coldplug all Devices.

[    0.731934] systemd[1]: Starting dracut initqueue hook...

[    0.736794] systemd[1]: Starting System Initialization.

[    0.737927] systemd[1]: Reached target System Initialization.

[    0.739129] systemd[1]: Starting Basic System.

[    0.740211] systemd[1]: Reached target Basic System.

[    0.747369] SCSI subsystem initialized

[    0.750634] ACPI: PCI Interrupt Link [LNKC] enabled at IRQ 10

[    0.755445] systemd[1]: Reloading.

[    0.757237] microcode: CPU0 sig=0x206a1, pf=0x1, revision=0x1

[    0.758312] platform microcode: Direct firmware load failed with error -2

[    0.759474] platform microcode: Falling back to user helper

[    0.760537] microcode: CPU1 sig=0x206a1, pf=0x1, revision=0x1

[    0.764876] platform microcode: Direct firmware load failed with error -2

[    0.766091] platform microcode: Falling back to user helper

[    0.766240] ACPI: bus type USB registered

[    0.766260] usbcore: registered new interface driver usbfs

[    0.766269] usbcore: registered new interface driver hub

[    0.766373] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0xb100, revision 0

[    0.771577] usbcore: registered new device driver usb

[    0.774204] input: ImExPS/2 Generic Explorer Mouse as /devices/platform/i8042/serio1/input/input3

[    0.776472] ACPI: PCI Interrupt Link [LNKA] enabled at IRQ 10

[    0.780464] microcode: Microcode Update Driver: v2.00 <tig...@aivazian.fsnet.co.uk>, Peter Oruba

[    0.786157] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver

[    0.790864] uhci_hcd: USB Universal Host Controller Interface driver

[    0.801418] mousedev: PS/2 mouse device common for all mice

[    0.801618] scsi0 : ata_piix

[    1.076414] scsi1 : ata_piix

[    1.077135] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc0a0 irq 14

[    1.078316] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc0a8 irq 15

[    1.080534] blk-mq: CPU -> queue map

[    1.082235] uhci_hcd 0000:00:01.2: UHCI Host Controller

[    1.082241] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1

[    1.082401] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c080

[    1.082563] hub 1-0:1.0: USB hub found

[    1.082569] hub 1-0:1.0: 2 ports detected

[    1.087781]   CPU 0 -> Queue 0

[    1.088447]   CPU 1 -> Queue 0

[    1.090190] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)

[    1.101940] GPT:Primary header thinks Alt. header is not at the end of the disk.

[    1.103380] GPT:11145215 != 83886079

[    1.104592] GPT:Alternate GPT header not at the end of the disk.

[    1.106741] GPT:11145215 != 83886079

[    1.108157] GPT: Use GNU Parted to correct GPT errors.

[    1.109971]  vda: vda1 vda2 vda3 vda4 vda6 vda9

[    1.183190] systemd[1]: Found device /dev/disk/by-partlabel/ROOT-A.

[    1.186612] systemd[1]: Found device /dev/disk/by-label/ROOT-A.

[    1.188678] systemd[1]: Found device /dev/vda3.

[    1.189872] systemd[1]: Found device /sys/devices/pci0000:00/0000:00:04.0/virtio1/block/vda/vda3.

[    1.191858] systemd[1]: Starting File System Check on /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132...

[    1.205925] systemd-fsck[190]: fsck: /etc/fstab: failed to parse fstab: No such file or directory

[    1.231289] ata2.01: ATAPI: QEMU DVD-ROM, 1.5.0, max UDMA/100

[    1.234084] ata2.01: configured for MWDMA2

[    1.236334] scsi 1:0:1:0: CD-ROM            QEMU     QEMU DVD-ROM     1.5. PQ: 0 ANSI: 5

[    1.243319] sr0: scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray

[    1.246089] cdrom: Uniform CD-ROM driver Revision: 3.20

[    1.283235] systemd[1]: Started dracut initqueue hook.

[    1.284770] systemd[1]: Starting dracut pre-mount hook...

[    1.306207] systemd[1]: Started dracut pre-mount hook.

[    1.321301] systemd-fsck[190]: /dev/vda3 has unsupported feature(s): FEATURE_R24 FEATURE_R25 FEATURE_R26 FEATURE_R27 FEATURE_R28 FEATURE_R29 FEATURE_R30 FEATURE_R31

[    1.333261] systemd-fsck[190]: e2fsck: Get a newer version of e2fsck!

[    1.341595] systemd-fsck[190]: fsck failed with error code 8.

[    1.341731] systemd-fsck[190]: Ignoring error.

[    1.341905] systemd[1]: Started File System Check on /dev/disk/by-partuuid/7130c94a-213a-4e5a-8e26-6cce9662f132.

[    1.342317] systemd[1]: Mounting /sysroot...

[    1.389101] usb 1-1: new full-speed USB device number 2 using uhci_hcd

[    1.395366] EXT4-fs (vda3): mounted filesystem without journal. Opts: (null)

[    1.398242] systemd[1]: Mounted /sysroot.

[    1.399182] systemd[1]: Starting Initrd Root File System.

[    1.402097] systemd[1]: Reached target Initrd Root File System.

[    1.402242] systemd[1]: Starting Reload Configuration from the Real Root...

[    1.410954] systemd[1]: Reloading.

[    1.439155] tsc: Refined TSC clocksource calibration: 2000.028 MHz

[    1.477566] systemd[1]: Started Reload Configuration from the Real Root.

[    1.478954] systemd[1]: Starting Initrd File Systems.

[    1.482487] systemd[1]: Reached target Initrd File Systems.

[    1.483627] systemd[1]: Starting dracut mount hook...

[    1.515230] systemd[1]: Started dracut mount hook.

[    1.519642] systemd[1]: Starting Initrd Default Target.

[    1.523829] systemd[1]: Reached target Initrd Default Target.

[    1.526595] systemd[1]: Starting dracut pre-pivot and cleanup hook...

[    1.543183] systemd[1]: Started dracut pre-pivot and cleanup hook.

[    1.546227] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...

[    1.549690] systemd[1]: Stopped Cleaning Up and Shutting Down Daemons.

[    1.555031] systemd[1]: Stopping dracut pre-pivot and cleanup hook...

[    1.557470] usbcore: registered new interface driver usbhid

[    1.557471] usbhid: USB HID core driver

[    1.561317] systemd[1]: Stopped dracut pre-pivot and cleanup hook.

[    1.562775] systemd[1]: Stopping Initrd Default Target.

[    1.563393] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:01.2/usb1/1-1/1-1:1.0/input/input4

[    1.566148] hid-generic 0003:0627:0001.0001: input: USB HID v0.01 Pointer [QEMU QEMU USB Tablet] on usb-0000:00:01.2-1/input0

[    1.566537] systemd[1]: Stopped target Initrd Default Target.

[    1.566693] systemd[1]: Stopping dracut mount hook...

[    1.566852] systemd[1]: Stopped dracut mount hook.

[    1.566998] systemd[1]: Stopping dracut pre-mount hook...

[    1.567159] systemd[1]: Stopped dracut pre-mount hook.

[    1.567303] systemd[1]: Stopping dracut initqueue hook...

[    1.567441] systemd[1]: Stopped dracut initqueue hook.

[    1.567584] systemd[1]: Stopping Basic System.

[    1.567723] systemd[1]: Stopped target Basic System.

[    1.567893] systemd[1]: Stopping Slices.

[    1.568226] systemd[1]: Stopped target Slices.

[    1.568376] systemd[1]: Stopping Paths.

[    1.568515] systemd[1]: Stopped target Paths.

[    1.568653] systemd[1]: Stopping Dispatch Password Requests to Console Directory Watch.

[    1.568790] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.

[    1.568930] systemd[1]: Stopping Timers.

[    1.570872] systemd[1]: Stopped target Timers.

[    1.571029] systemd[1]: Stopping Sockets.

[    1.571154] systemd[1]: Stopped target Sockets.

[    1.571277] systemd[1]: Stopping System Initialization.

[    1.571395] systemd[1]: Stopped target System Initialization.

[    1.571512] systemd[1]: Stopping udev Coldplug all Devices...

[    1.571627] systemd[1]: Stopped udev Coldplug all Devices.

[    1.571743] systemd[1]: Stopping Swap.

[    1.571908] systemd[1]: Stopped target Swap.

[    1.572048] systemd[1]: Stopping Local File Systems.

[    1.572166] systemd[1]: Stopped target Local File Systems.

[    1.572281] systemd[1]: Stopping udev Kernel Device Manager...

[    1.598520] systemd-udevd[122]: worker [125] did not accept message -1 (Connection refused), kill it

[    1.602370] systemd-udevd[122]: worker [126] did not accept message -1 (Connection refused), kill it

[    1.608206] systemd-udevd[122]: worker [127] did not accept message -1 (Connection refused), kill it

[    1.609990] systemd-udevd[122]: worker [128] did not accept message -1 (Connection refused), kill it

[    1.611853] systemd-udevd[122]: worker [129] did not accept message -1 (Connection refused), kill it

[    1.613631] systemd-udevd[122]: worker [130] did not accept message -1 (Connection refused), kill it

[    1.615630] systemd-udevd[122]: worker [131] did not accept message -1 (Connection refused), kill it

[    1.617468] systemd-udevd[122]: worker [133] did not accept message -1 (Connection refused), kill it

[    1.619416] systemd-udevd[122]: worker [134] did not accept message -1 (Connection refused), kill it

[    1.621232] systemd-udevd[122]: worker [135] did not accept message -1 (Connection refused), kill it

[    1.622948] systemd-udevd[122]: worker [136] did not accept message -1 (Connection refused), kill it

[    1.624814] systemd-udevd[122]: worker [137] did not accept message -1 (Connection refused), kill it

[    1.626573] systemd[1]: Stopped udev Kernel Device Manager.

[    1.627742] systemd[1]: Stopping dracut pre-udev hook...

[    1.629837] systemd[1]: Stopped dracut pre-udev hook.

[    1.631297] systemd[1]: Stopping dracut cmdline hook...

[    1.632495] systemd[1]: Stopped dracut cmdline hook.

[    1.633607] systemd[1]: Stopping Create Static Device Nodes in /dev...

[    1.636070] systemd[1]: Stopped Create Static Device Nodes in /dev.

[    1.639465] systemd[1]: Stopping Create list of required static device nodes for the current kernel...

[    1.641661] systemd[1]: Stopped Create list of required static device nodes for the current kernel.

[    1.643637] systemd[1]: Stopping udev Control Socket.

[    1.644933] systemd[1]: Closed udev Control Socket.

[    1.646373] systemd[1]: Stopping udev Kernel Socket.

[    1.647637] systemd[1]: Closed udev Kernel Socket.

[    1.648732] systemd[1]: Starting Cleanup udevd DB...

[    1.649831] systemd[1]: Started Cleanup udevd DB.

[    1.650898] systemd[1]: Starting Switch Root.

[    1.651939] systemd[1]: Reached target Switch Root.

[    1.653224] systemd[1]: Starting Switch Root...

[    1.656543] systemd[1]: Switching root.

[    1.658617] systemd-journald[45]: Received SIGTERM from PID 1 (n/a).

[    1.995725] LVM: Failed to initialize library context for activation generator.

[    2.294784] NMI watchdog: disabled (cpu0): hardware events not enabled

[    2.397220] systemd-udevd[276]: starting version 211

[    2.578120] systemd-udevd[279]: renamed network interface eth0 to ens3[    2.697375] EXT4-fs (vda6): mounted filesystem with ordered data mode. Opts: commit=600

[    5.374441] EXT4-fs (vda9): mounted filesystem with ordered data mode. Opts: commit=600,data=ordered

[    5.433633] systemd-journald[265]: Received request to flush runtime journal from PID 1

This is host-96-119-0-145.unknown_domain (Linux x86_64 3.13.6+) 15:16:07

SSH host key: 58:c4:3f:c2:85:98:1c:e6:b2:84:0c:79:e1:e6:a6:b3 (RSA)

SSH host key: e2:48:d6:d4:6a:21:7e:43:97:26:5b:71:ed:b8:2f:2a (DSA)

ens3: 96.119.0.145 2001:558:fc00:100:f816:3eff:fe19:6698

lo: 127.0.0.1 ::1

host-96-119-0-145 login:

[Brian Harrington]

Jim,

Actually, that was a bit helpful.

Can you re-download the image and load it into glance.  Here's why:  In a normal situation (As Ivan was finding out) CoreOS will be auto-updating itself.  We're in a position where myself (and others) not have been matched up on versions in testing our cloud-configs.  Information on our versions can (as of this week) be found here at the following link.  It looks like that image is (at the newest) version 286 - https://coreos.com/releases/#286.0.0.  As you can see we've not only fixed a lot of bugs since then, but also opened up our beta channel (for users who don't want the fast paced updates of our alpha channel).  Either up to date alpha or beta would be great.  Also, I've found that I like to name the images in glance the version that they were at the time of download.  My cron jobs which monitor images and load them into glance do a combination of checking headers on:

http://storage.core-os.net/coreos/amd64-usr/alpha/coreos_production_openstack_image.img.bz2

and using the content inside of:

http://storage.core-os.net/coreos/amd64-usr/alpha/version.txt

to generate the name and load them into glance.

I really don't want to give up on this and would like to see that cloud-config boot properly!  Let me know how this works.

--Brian 'redbeard' Harrington

<d

...

[Arash Kaffamanesh]

Hi,

I just tried the beta image on OpenStack Havana form here:

http://storage.core-os.net/coreos/amd64-usr/beta/coreos_production_openstack_image.img.bz2

and could start a cluster with:

nova boot --user-data ./cloud-config.yaml --image <beta image id> --key-name secretkey --flavor m1.small --num-instances 2 --security-groups default --nic net-id=<my  nic uuid> coreos

2 machines start nicely, but after logging into the first instance I'm getting a nice blinking in pink:

sh-3.2# ssh -i secretkey.pem co...@10.0.0.13

Last login: Sat May 17 19:19:45 2014 from 10.0.0.2

CoreOS (beta)

Failed Units: 1

  ec2-cloudinit.service

core@host-10-0-0-13 ~ $ 

How can I fix this?

P.S: I'm using RDO Havana version 2013.2.1-0.35

my cloud-config.yaml  looks like:

[root@csg1 ~(secret_admin)]# cat cloud-config.yaml 

#cloud-config

coreos:

  etcd:

    # generate a new token for each unique cluster from https://discovery.etcd.io/new

    discovery: https://discovery.etcd.io/c910a06771023a16cff867cf24222f04

    # multi-region and multi-cloud deployments need to use $public_ipv4

     addr: $private_ipv4:4001

     peer-addr: $private_ipv4:7001

  units:

    - name: etcd.service

      command: start

    - name: fleet.service

      command: start

ssh_authorized_keys:

  # include one or more SSH public keys

    - ssh-rsa AAAAB3NzaC1yc2EAAasasauqaqtXm2HHfQUy6v8CE8MUzjv1oh/Ae+AVNH2JGxH0ATVasasasaPLhDNnaErKYYE1+NlPzNwx1SHoGibGCVubzC85ULp7jKDFHedu1yAG7MGasasasas5ybvDUKdoUbuC/zAWUxJ8tpgI6nEygfh88+efp/NuuNITmtBqNxjf3SzsMLw8p4dtYMNXQ4P/PDVyuTfsDqwCgxZRo4H1t7n94t4YylFM6sUn6NV+sasav4Y5uvhYw54gqNrOcjMrPol7oKlgS02UPqw==

Any ideas? your help is much appreciated.

Thanks,

-Arash

[Brian Harrington]

Arash,

The "ec2-cloudinit.service" error isn't a problem if you booted using cloud-config (via the configdrive or meta-data service).  Feel free to ignore!  One tip though, in order to gain consensus on etcd you should have three nodes.  One is great, three is perfect, but with only two there are problems getting quorum.  Other than that you're looking good.

--Brian 'redbeard' Harrington

...

[Arash Kaffamanesh]

Brian, thanks!

I ran a 3 node cluster, but if I run this:

core@host-10-0-0-13 ~ $ etcdctl set /message Hello

I'm still getting:

Cannot sync with the cluster

and:

host-10-0-0-13 ~ # journalctl -u ec2-cloudinit 

-- Logs begin at Mon 2014-05-19 16:48:48 UTC, end at Mon 2014-05-19 17:03:48 UTC. --

May 19 16:48:53 host-10-0-0-13 systemd[1]: Starting Cloudinit from EC2-style metadata...

May 19 16:48:53 host-10-0-0-13 coreos-cloudinit[3917]: 2014/05/19 16:48:53 Fetching user-data from datasource of type "metadata-service"

May 19 16:48:53 host-10-0-0-13 coreos-cloudinit[3917]: 2014/05/19 16:48:53 Parsing user-data as cloud-config

May 19 16:48:53 host-10-0-0-13 coreos-cloudinit[3917]: 2014/05/19 16:48:53 YAML error: line 7: did not find expected key

May 19 16:48:53 host-10-0-0-13 systemd[1]: ec2-cloudinit.service: main process exited, code=exited, status=1/FAILURE

May 19 16:48:53 host-10-0-0-13 systemd[1]: Failed to start Cloudinit from EC2-style metadata.

May 19 16:48:53 host-10-0-0-13 systemd[1]: Unit ec2-cloudinit.service entered failed state.

and my ec2-cloudinit.service looks like:

host-10-0-0-13 ~ # cat /run/systemd/system/ec2-cloudinit.service

[Unit]

Description=Cloudinit from EC2-style metadata

Requires=coreos-setup-environment.service

After=coreos-setup-environment.service

[Service]

Type=oneshot

EnvironmentFile=/etc/environment

ExecStart=/usr/bin/coreos-cloudinit -ignore-failure=true -from-url=http://169.254.169.254/latest/user-data

Any ideas?

Thanks,

-Arash

[Brian Harrington]

As far as etcd goes, you're not actually getting quorum on your cluster.  Verify that you're using a brand new etcd discovery url.  Tear down your existing cluster, generate a new etcd discovery URL, update the cloud-config, and then boot three machines with the cloud-config.  Everything should be online at that point.  If you have a problem setting an etcd key, grab the journals (on all three machines) with the following command:  journalctl -n 1000  -b -u etcd.service

In regards to ec2-cloudinit.service, like I said in the last email:

The "ec2-cloudinit.service" error isn't a problem if you booted using cloud-config (via the configdrive or meta-data service).  Feel free to ignore!

--Brian 'redbeard' Harrington

[Jim Walters]

Will gladly try it again, but I thought I did pull from the URL you gave. Stay tuned...

...

[Jim Walters]

OK, I think its the same May 15th image I tried previously and which generated that console log.

...

[Arash Kaffamanesh]

I'd already created a new etcd discovery URL and booted the tree machines, but I'm still getting the sync problem and it seems that the node discovery doesn't work.

One question: which protocol is used for node discovery, UDP? does the discovery work over tcp6 and the IPv6 address of the nodes?

Thanks,

-Arash

[Brandon Philips]

On Tue, May 20, 2014 at 10:21 PM, Arash Kaffamanesh <a...@cloudssky.com> wrote:
> I'd already created a new etcd discovery URL and booted the tree machines,
> but I'm still getting the sync problem and it seems that the node discovery
> doesn't work.

Can you gist what isn't working?

> One question: which protocol is used for node discovery, UDP? does the
> discovery work over tcp6 and the IPv6 address of the nodes?

The discovery protocol goes over the public internet to an IPv4
address. It should register the IPv6 addresses. You can check by
curling the discovery token and checking out the JSON inside of it.

Brandon

[Thomas Kujawski]

I got exactly the same problem. 

- Spawning coreos instances according to https://coreos.com/docs/running-coreos/platforms/openstack/

- Giving user-data script

- see instance spawning up with Kernel Version 3.14.4

[    0.000000] Linux version 3.14.4+ (buildbot@ip-10-221-137-94) (gcc version 4.6.3 (Gentoo Hardened 4.6.3 p1.13, pie-0.5.2) ) #2 SMP Wed May 14 02:38:49 UTC 2014

- tailing nova-api.log, noticing user-data is being requested

BUT

- no settings being set, no authkeys, no messages in console telling me anything about user-data. boot log looks like Jims!

I had "echo Welcome" in the yaml, so I should at least see this on the console right?

Any hints?

Cheers Thomas

...

[Brian Harrington]

Can you post the cloud-config? (And run it through  http://yamllint.com/)

If the cloud-config is not valid YAML it will fail to parse.  In addition there is a known state right now where things like specifying invalid groups will cause everything _after_ that point to fail.

--Brian 'redbeard' Harrington

[Kujawski, Thomas]

I validated that previously already, the YAML is valid, has been copied from the documentation and I just replaced the key.

The instance boots up perfectly to the root login, I tried passing this as a yaml file as parameter for --user-data as well as copy/paste it into the horizon field for custom scripts. 

Here you go (cloaked the token):

#cloud-config

coreos:

  etcd:

    # generate a new token for each unique cluster from https://discovery.etcd.io/new

    discovery: https://discovery.etcd.io/7fxxxx03xxxxc1657caaxxxxbefxxxxe

    # multi-region and multi-cloud deployments need to use $public_ipv4

    addr: $private_ipv4:4001

    peer-addr: $private_ipv4:7001

  units:

    - name: etcd.service

      command: start

    - name: fleet.service

      command: start

ssh_authorized_keys:

  # include one or more SSH public keys

  ssh-rsa AAAAB3NzaC1yc2EA...

​2​

[Arash Kaffamanesh]

Hello together,

The cluster is now working fine with the CoreOS Beta image for OpenStack, but please don't ask me why it wasn't working before, one thing which I did was, that I cleaned up the cloud-config.yaml file from those lines which was commented out and deleted also the line breaks, created a new discovery key and ran nova boot as described in one of my posts above and suddenly I could get:

core@host-10-0-0-18 ~ $ fleetctl list-machines

MACHINE IP METADATA

b2746bb6... 10.0.0.13 -

652149d4... 10.0.0.16 -

b84263b0... 10.0.0.15 -

d0dee508... 10.0.0.17 -

e0f41ad3... 10.0.0.18 -

set a key on one machine and got the key on other machines.

After that I tried the whole thing with the first yaml file, with commented lines and line breaks to see why it was not working, but it worked and I can't reproduce the cluster sync problem.

One thing which was fixed so magically is the ec2-metadata service:

host-10-0-0-15 ~ # journalctl -u ec2-cloudinit

-- Logs begin at Sat 2014-05-24 13:25:44 UTC, end at Sat 2014-05-24 13:26:39 UTC. --

May 24 13:25:49 host-10-0-0-15 systemd[1]: Starting Cloudinit from EC2-style metadata...

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Fetching user-data from datasource of type "metadata-servic

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Parsing user-data as cloud-config

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Wrote etcd config file to filesystem

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Calling unit command 'start etcd.service'

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Result of 'start etcd.service': done

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Calling unit command 'start fleet.service'

May 24 13:25:49 host-10-0-0-15 coreos-cloudinit[4026]: 2014/05/24 13:25:49 Result of 'start fleet.service': done

May 24 13:25:49 host-10-0-0-15 systemd[1]: Started Cloudinit from EC2-style metadata.

May 24 13:25:49 host-10-0-0-15 systemd[1]: Starting Cloudinit from EC2-style metadata...

The yaml file which I changed looks like this:

[root@csky03 ~]# cat cloud-config-works.yaml

#cloud-config

coreos:

  etcd:

     discovery: https://discovery.etcd.io/f9f5c6dd7e92b2e7sasasasa

     addr: $private_ipv4:4001

     peer-addr: $private_ipv4:7001

  units:

    - name: etcd.service

      command: start

    - name: fleet.service

      command: start

  ssh_authorized_keys:

    - ssh-rsa AAAAB3NzaC1yc2EAAA

Now that the cluster is working, my next problem is how to reproduce the failure which I got before :-)

Now I'll try the whole thing with the alpha image and let you know if it'd work with the same yaml file and a new discovery token.

One note, now I understand why a new discovery token must be created each time booting up a cluster and learned to never give up and believe on self healing  :-)

Thanks,

-Arash

[Arash Kaffamanesh]

Hi again,

yes the same yaml file works also with CoreOS alpha:

   ______                ____  _____

  / ____/___  ________  / __ \/ ___/

 / /   / __ \/ ___/ _ \/ / / /\__ \

/ /___/ /_/ / /  /  __/ /_/ /___/ /

\____/\____/_/   \___/\____//____/

core@host-10-0-0-17 ~ $ fleetctl list-machines

MACHINE IP METADATA

2a25087b... 10.0.0.15 -

ac84a918... 10.0.0.13 -

74d73eb1... 10.0.0.17 -

7057014a... 10.0.0.16 -

5f54d75c... 10.0.0.18 -

core@host-10-0-0-17 ~ $ etcdctl set /love coreos

coreos

core@host-10-0-0-16 ~ $ etcdctl get /love

coreos

[Kevin Yi]

Hi Arash,

I got exactly same issue with cloud-init and it was due to the wrong format of ssh_authorized_keys  in cloud.yaml  . When booting with broken ssh_key , coreos will show some error message saying the key xxxxxx....xxxxx is not public key format . then the rest of thing are all same with yours .you can clarify the message by journalctl  command in coreos. 

I believe you should reproduce the issue by a broken ssh_authorized_keys in yaml (for example , cut the content partially ), then boot the instance in openstack

Kev