Re: Switchd-VMD

On 29.01.2018 17:28, Mike Larkin wrote:

> On Mon, Jan 29, 2018 at 03:07:49PM -0700, Scott Seekamp wrote:
>
>> I'm attempting to set up an OpenBSD virtualized environment and
>> running into
>> issues.
>>
>> OpenBSD 6.2 AMD64 hypervisor
>>
>> vm.conf:
>>
>> vm "vm1" {
>> disable
>> memory 1g
>> disk "/vmm/vm1.img"
>> interface { switch "uplink" }
>> }
>>
>> vm "vm2" {
>> disable
>> memory 1g
>> disk "/vmm/vm2.img"
>> interface { switch "uplink" }
>> }
>>
>> vm "vm3" {
>> disable
>> memory 1g
>> disk "/vmm/vm3.img"
>> interface { switch "uplink" }
>> }
>>
>> switch "uplink" {
>> interface switch0
>> add vlan50
>> }
>>
>> I let vmd bring up the switch and once up it shows:
>>
>> switch0: flags=41<UP,RUNNING>
>> description: switch1-uplink
>> index 108 llprio 3
>> groups: switch
>> datapath 0x6393eae0ca8447fb maxflow 10000 maxgroup 1000
>> vlan50 flags=0<>
>> port 10 ifpriority 0 ifcost 0
>> tap3 flags=0<>
>> port 112 ifpriority 0 ifcost 0
>> vether0 flags=1000<LOCAL>
>> port 4294967294 ifpriority 0 ifcost 0
>> tap1 flags=0<>
>> port 115 ifpriority 0 ifcost 0
>> tap2 flags=0<>
>> port 116 ifpriority 0 ifcost 0
>>
>> vether0 defined as:
>>
>> vether0: flags=41<UP,RUNNING> mtu 1500
>> lladdr fe:e1:ba:df:57:3b
>> index 113 priority 0 llprio 3
>> groups: vether egress
>> media: Ethernet autoselect
>> status: active
>> inet 172.50.7.254 netmask 0xfffff800
>>
>> vlan50 is a vlan on top of a trunk (2 em's LACP to a switch):
>>
>> vlan50: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu
>> 1500
>> lladdr 00:25:90:0c:78:42
>> description: Lab
>> index 10 priority 0 llprio 3
>> encap: vnetid 50 parent trunk0
>> groups: vlan
>> media: Ethernet autoselect
>> status: active
>>
>> I have 3 vm's as defined above:
>>
>> ID PID VCPUS MAXMEM CURMEM TTY OWNER NAME
>> 2 11840 1 1.0G 450M ttyp6 root vm1
>> 1 14496 1 1.0G 560M ttyp2 root vm2
>> 3 48053 1 1.0G 450M ttyp7 root vm3
>>
>> The vm's are configured with sequential IP's in the vlan50 network
>> such as:
>>
>> vio0:
>> flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
>> mtu 1500
>> lladdr fe:e1:bb:d1:58:82
>> index 1 priority 0 llprio 3
>> groups: egress
>> media: Ethernet autoselect
>> status: active
>> inet 172.50.0.6 netmask 0xfffff800 broadcast 172.50.7.255
>>
>> The problem:
>>
>> I can ping from vm -> vm
>> I can ping from vm -> vether0 IP
>> I can ping from vether0 to vm
>>
>> I cannot communicate out of the VM to the rest of the environment
>> reliably.
>>
>> tcpdump on the tap interface shows:
>>
>> tcpdump -i tap2
>> tcpdump: listening on tap2, link-type EN10MB
>> 14:58:54.507948 172.50.0.6 > 172.50.0.1: icmp: echo request
>> 14:58:56.527958 172.50.0.6 > 172.50.0.1: icmp: echo request
>>
>> tcpdump on the vlan interface shows the traffic gets out and tries to
>> come
>> back:
>>
>> tcpdump -i vlan50
>> tcpdump: listening on vlan50, link-type EN10MB
>> 15:02:23.657480 172.50.0.6 > 172.50.0.1: icmp: echo request
>> 15:02:23.657656 172.50.0.1 > 172.50.0.6: icmp: echo reply
>> 15:02:25.667671 172.50.0.6 > 172.50.0.1: icmp: echo request
>> 15:02:25.667864 172.50.0.1 > 172.50.0.6: icmp: echo reply
>>
>> I'm using the out of the box pf rules on both the hypervisor box and
>> vm's.
>>
>> I can see the macs of the vm's in the switch table:
>>
>> switchctl show sum
>> Switch Port Type Name Info
>> 1 switch /dev/switch0
>> 1 10 mac 00:0d:b9:42:d0:fc age
>> 135s
>> 1 115 mac fe:e1:bb:d1:1c:f5 age
>> 135s
>> 1 116 mac fe:e1:bb:d1:58:82 age
>> 201s
>> 1 112 mac fe:e1:bb:d1:6d:f4 age
>> 201s
>>
>> What am I missing? What would block the incoming traffic from getting
>> back
>> to the vm from the host level?
>>
>> Thanks
>> Scott
>
> Can you try adding pass rules for the tapX interfaces to /etc/pf.conf
> (don't
> forget to reload the rules). And maybe the vether too. (Mine contains a
> sequence of "pass on tap0" "pass on tap1" , etc, lines).
>
> I was having similar issues until I did that; I could never figure out
> what
> rule was blocking it but that seemed to fix it.
>
> Also, not sure if you need net.inet.ip.forwarding=1 in your sysctl
> config
> in this environment?
>
> -ml
>

Mike you are my hero - I can't believe I didn't try that. Looks like I'm
in business thank you!

Scott

>> OpenBSD 6.2 (GENERIC.MP) #2: Sun Dec 10 21:14:42 CET 2017
>> root@syspatch-62-amd64.openbsd.org:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>> real mem = 85873721344 (81895MB)
>> avail mem = 83264139264 (79406MB)
>> mpath0 at root
>> scsibus0 at mpath0: 256 targets
>> mainbus0 at root
>> bios0 at mainbus0: SMBIOS rev. 2.6 @ 0x99c00 (81 entries)
>> bios0: vendor American Megatrends Inc. version "2.1c" date 08/03/2012
>> bios0: Supermicro X8DTU
>> acpi0 at bios0: rev 2
>> acpi0: sleep states S0 S1 S4 S5
>> acpi0: tables DSDT FACP APIC MCFG SLIT OEMB SRAT HPET DMAR SSDT
>> acpi0: wakeup devices NPE1(S4) NPE2(S4) NPE3(S4) NPE4(S4) NPE5(S4)
>> NPE6(S4) NPE7(S4) NPE8(S4) NPE9(S4) NPEA(S4) P0P1(S4) USB0(S4)
>> USB1(S4) USB2(S4) USB5(S4) EUSB(S4) [...]
>> acpitimer0 at acpi0: 3579545 Hz, 24 bits
>> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
>> cpu0 at mainbus0: apid 0 (boot processor)
>> cpu0: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.40 MHz
>> cpu0:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu0: 256KB 64b/line 8-way L2 cache
>> cpu0: TSC frequency 2400404120 Hz
>> cpu0: smt 0, core 0, package 0
>> mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
>> cpu0: apic clock running at 133MHz
>> cpu0: mwait min=64, max=64, C-substates=0.2.1.1, IBE
>> cpu1 at mainbus0: apid 2 (application processor)
>> cpu1: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu1:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu1: 256KB 64b/line 8-way L2 cache
>> cpu1: smt 0, core 1, package 0
>> cpu2 at mainbus0: apid 18 (application processor)
>> cpu2: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu2:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu2: 256KB 64b/line 8-way L2 cache
>> cpu2: smt 0, core 9, package 0
>> cpu3 at mainbus0: apid 20 (application processor)
>> cpu3: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu3:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu3: 256KB 64b/line 8-way L2 cache
>> cpu3: smt 0, core 10, package 0
>> cpu4 at mainbus0: apid 32 (application processor)
>> cpu4: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu4:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
>> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu4: 256KB 64b/line 8-way L2 cache
>> cpu4: smt 0, core 0, package 1
>> cpu5 at mainbus0: apid 34 (application processor)
>> cpu5: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2416.51 MHz
>> cpu5:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
>> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu5: 256KB 64b/line 8-way L2 cache
>> cpu5: smt 0, core 1, package 1
>> cpu6 at mainbus0: apid 50 (application processor)
>> cpu6: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu6:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
>> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu6: 256KB 64b/line 8-way L2 cache
>> cpu6: smt 0, core 9, package 1
>> cpu7 at mainbus0: apid 52 (application processor)
>> cpu7: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu7:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
>> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu7: 256KB 64b/line 8-way L2 cache
>> cpu7: smt 0, core 10, package 1
>> cpu8 at mainbus0: apid 1 (application processor)
>> cpu8: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu8:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
>> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu8: 256KB 64b/line 8-way L2 cache
>> cpu8: smt 1, core 0, package 0
>> cpu9 at mainbus0: apid 3 (application processor)
>> cpu9: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu9:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,ES
>> T,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu9: 256KB 64b/line 8-way L2 cache
>> cpu9: smt 1, core 1, package 0
>> cpu10 at mainbus0: apid 19 (application processor)
>> cpu10: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu10:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
>> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu10: 256KB 64b/line 8-way L2 cache
>> cpu10: smt 1, core 9, package 0
>> cpu11 at mainbus0: apid 21 (application processor)
>> cpu11: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu11:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
>> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu11: 256KB 64b/line 8-way L2 cache
>> cpu11: smt 1, core 10, package 0
>> cpu12 at mainbus0: apid 33 (application processor)
>> cpu12: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu12:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
>> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu12: 256KB 64b/line 8-way L2 cache
>> cpu12: smt 1, core 0, package 1
>> cpu13 at mainbus0: apid 35 (application processor)
>> cpu13: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu13:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
>> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu13: 256KB 64b/line 8-way L2 cache
>> cpu13: smt 1, core 1, package 1
>> cpu14 at mainbus0: apid 51 (application processor)
>> cpu14: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu14:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,E
>> ST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu14: 256KB 64b/line 8-way L2 cache
>> cpu14: smt 1, core 9, package 1
>> cpu15 at mainbus0: apid 53 (application processor)
>> cpu15: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz, 2400.09 MHz
>> cpu15:
>> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,PAGE1GB,RDTSCP,LONG,LAHF,PERF,ITSC,SENSOR,ARAT
>> cpu15: 256KB 64b/line 8-way L2 cache
>> cpu15: smt 1, core 10, package 1
>> ioapic0 at mainbus0: apid 6 pa 0xfec00000, version 20, 24 pins
>> , remapped to apid 6
>> ioapic1 at mainbus0: apid 7 pa 0xfec8a000, version 20, 24 pins
>> , remapped to apid 7
>> acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
>> acpihpet0 at acpi0: 14318179 Hz
>> acpiprt0 at acpi0: bus 0 (PCI0)
>> acpiprt1 at acpi0: bus 1 (NPE1)
>> acpiprt2 at acpi0: bus 2 (NPE3)
>> acpiprt3 at acpi0: bus -1 (NPE4)
>> acpiprt4 at acpi0: bus 3 (NPE5)
>> acpiprt5 at acpi0: bus -1 (NPE6)
>> acpiprt6 at acpi0: bus 4 (NPE7)
>> acpiprt7 at acpi0: bus -1 (NPE8)
>> acpiprt8 at acpi0: bus 5 (NPE9)
>> acpiprt9 at acpi0: bus -1 (NPEA)
>> acpiprt10 at acpi0: bus 6 (P0P1)
>> acpiprt11 at acpi0: bus -1 (P0P4)
>> acpiprt12 at acpi0: bus -1 (P0P5)
>> acpiprt13 at acpi0: bus -1 (P0P6)
>> acpiprt14 at acpi0: bus -1 (P0P7)
>> acpiprt15 at acpi0: bus -1 (P0P8)
>> acpiprt16 at acpi0: bus -1 (P0P9)
>> acpicpu0 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu1 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu2 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu3 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu4 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu5 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu6 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu7 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu8 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu9 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205 mwait.3@0x10),
>> C1(1000@3 halt), PSS
>> acpicpu10 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205
>> mwait.3@0x10), C1(1000@3 halt), PSS
>> acpicpu11 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205
>> mwait.3@0x10), C1(1000@3 halt), PSS
>> acpicpu12 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205
>> mwait.3@0x10), C1(1000@3 halt), PSS
>> acpicpu13 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205
>> mwait.3@0x10), C1(1000@3 halt), PSS
>> acpicpu14 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205
>> mwait.3@0x10), C1(1000@3 halt), PSS
>> acpicpu15 at acpi0: C3(350@245 mwait.3@0x20), C3(750@205
>> mwait.3@0x10), C1(1000@3 halt), PSS
>> acpibtn0 at acpi0: PWRB
>> ipmi at mainbus0 not configured
>> cpu0: Enhanced SpeedStep 2400 MHz: speeds: 2401, 2400, 2267, 2133,
>> 2000, 1867, 1733, 1600 MHz
>> pci0 at mainbus0 bus 0
>> pchb0 at pci0 dev 0 function 0 "Intel 5520 Host" rev 0x22
>> ppb0 at pci0 dev 1 function 0 "Intel X58 PCIE" rev 0x22: msi
>> pci1 at ppb0 bus 1
>> em0 at pci1 dev 0 function 0 "Intel 82576" rev 0x01: msi, address
>> 00:25:90:0c:78:42
>> em1 at pci1 dev 0 function 1 "Intel 82576" rev 0x01: msi, address
>> 00:25:90:0c:78:43
>> ppb1 at pci0 dev 3 function 0 "Intel X58 PCIE" rev 0x22: msi
>> pci2 at ppb1 bus 2
>> ppb2 at pci0 dev 5 function 0 "Intel X58 PCIE" rev 0x22: msi
>> pci3 at ppb2 bus 3
>> ppb3 at pci0 dev 7 function 0 "Intel X58 PCIE" rev 0x22: msi
>> pci4 at ppb3 bus 4
>> ppb4 at pci0 dev 9 function 0 "Intel X58 PCIE" rev 0x22: msi
>> pci5 at ppb4 bus 5
>> "Intel X58 IOxAPIC" rev 0x22 at pci0 dev 19 function 0 not configured
>> "Intel X58 Misc" rev 0x22 at pci0 dev 20 function 0 not configured
>> "Intel X58 GPIO" rev 0x22 at pci0 dev 20 function 1 not configured
>> "Intel X58 RAS" rev 0x22 at pci0 dev 20 function 2 not configured
>> "Intel X58 Throttle" rev 0x22 at pci0 dev 20 function 3 not configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 0 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 1 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 2 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 3 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 4 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 5 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 6 not
>> configured
>> "Intel X58 QuickData" rev 0x22 at pci0 dev 22 function 7 not
>> configured
>> uhci0 at pci0 dev 26 function 0 "Intel 82801JI USB" rev 0x00: apic 6
>> int 16
>> uhci1 at pci0 dev 26 function 1 "Intel 82801JI USB" rev 0x00: apic 6
>> int 21
>> uhci2 at pci0 dev 26 function 2 "Intel 82801JI USB" rev 0x00: apic 6
>> int 19
>> ehci0 at pci0 dev 26 function 7 "Intel 82801JI USB" rev 0x00: apic 6
>> int 18
>> usb0 at ehci0: USB revision 2.0
>> uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
>> 2.00/1.00 addr 1
>> uhci3 at pci0 dev 29 function 0 "Intel 82801JI USB" rev 0x00: apic 6
>> int 23
>> uhci4 at pci0 dev 29 function 1 "Intel 82801JI USB" rev 0x00: apic 6
>> int 19
>> uhci5 at pci0 dev 29 function 2 "Intel 82801JI USB" rev 0x00: apic 6
>> int 18
>> ehci1 at pci0 dev 29 function 7 "Intel 82801JI USB" rev 0x00: apic 6
>> int 23
>> usb1 at ehci1: USB revision 2.0
>> uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
>> 2.00/1.00 addr 1
>> ppb5 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x90
>> pci6 at ppb5 bus 6
>> vga1 at pci6 dev 1 function 0 "Matrox MGA G200eW" rev 0x0a
>> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
>> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
>> pcib0 at pci0 dev 31 function 0 "Intel 82801JIR LPC" rev 0x00
>> ahci0 at pci0 dev 31 function 2 "Intel 82801JI AHCI" rev 0x00: msi,
>> AHCI 1.2
>> ahci0: port 0: 1.5Gb/s
>> ahci0: port 1: 3.0Gb/s
>> scsibus1 at ahci0: 32 targets
>> cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, DVDRAM GT20N, CQ02> ATAPI
>> 5/cdrom removable
>> sd0 at scsibus1 targ 1 lun 0: <ATA, INTEL SSDSA2M160, 2CV1> SCSI3
>> 0/direct fixed naa.500151795947ee3e
>> sd0: 152627MB, 512 bytes/sector, 312581808 sectors, thin
>> ichiic0 at pci0 dev 31 function 3 "Intel 82801JI SMBus" rev 0x00: apic
>> 6 int 18
>> iic0 at ichiic0
>> sdtemp0 at iic0 addr 0x18: mcp98243
>> sdtemp1 at iic0 addr 0x19: mcp98243
>> sdtemp2 at iic0 addr 0x1a: mcp98243
>> sdtemp3 at iic0 addr 0x1b: mcp98243
>> sdtemp4 at iic0 addr 0x1c: mcp98243
>> sdtemp5 at iic0 addr 0x1d: stts2002
>> iic0: addr 0x2e 00=40 words 00=4040 01=0000 02=0000 03=0000 04=0000
>> 05=0000 06=0000 07=0000
>> nvt0 at iic0 addr 0x2f: W83795ADG
>> spdmem0 at iic0 addr 0x50: 8GB DDR3 SDRAM registered ECC PC3-12800
>> with thermal sensor
>> spdmem1 at iic0 addr 0x51: 8GB DDR3 SDRAM registered ECC PC3-12800
>> with thermal sensor
>> spdmem2 at iic0 addr 0x52: 8GB DDR3 SDRAM registered ECC PC3-12800
>> with thermal sensor
>> spdmem3 at iic0 addr 0x53: 8GB DDR3 SDRAM registered ECC PC3-12800
>> with thermal sensor
>> spdmem4 at iic0 addr 0x54: 8GB DDR3 SDRAM registered ECC PC3-12800
>> with thermal sensor
>> spdmem5 at iic0 addr 0x55: 8GB DDR3 SDRAM registered ECC PC3-12800
>> with thermal sensor
>> usb2 at uhci0: USB revision 1.0
>> uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev
>> 1.00/1.00 addr 1
>> usb3 at uhci1: USB revision 1.0
>> uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev
>> 1.00/1.00 addr 1
>> usb4 at uhci2: USB revision 1.0
>> uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev
>> 1.00/1.00 addr 1
>> usb5 at uhci3: USB revision 1.0
>> uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev
>> 1.00/1.00 addr 1
>> usb6 at uhci4: USB revision 1.0
>> uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev
>> 1.00/1.00 addr 1
>> usb7 at uhci5: USB revision 1.0
>> uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev
>> 1.00/1.00 addr 1
>> isa0 at pcib0
>> isadma0 at isa0
>> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
>> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
>> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
>> pckbd0 at pckbc0 (kbd slot)
>> wskbd0 at pckbd0: console keyboard, using wsdisplay0
>> pcppi0 at isa0 port 0x61
>> spkr0 at pcppi0
>> wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
>> lm1 at wbsio0 port 0xa10/8: W83627DHG
>> vmm0 at mainbus0: VMX/EPT
>> uhidev0 at uhub3 port 1 configuration 1 interface 0 "American
>> Megatrends Inc. Virtual Keyboard and Mouse" rev 1.10/1.00 addr 2
>> uhidev0: iclass 3/1
>> ukbd0 at uhidev0: 8 variable keys, 6 key codes
>> wskbd1 at ukbd0 mux 1
>> wskbd1: connecting to wsdisplay0
>> uhidev1 at uhub3 port 1 configuration 1 interface 1 "American
>> Megatrends Inc. Virtual Keyboard and Mouse" rev 1.10/1.00 addr 2
>> uhidev1: iclass 3/1
>> ums0 at uhidev1: 3 buttons
>> wsmouse0 at ums0 mux 0
>> vscsi0 at root
>> scsibus2 at vscsi0: 256 targets
>> softraid0 at root
>> scsibus3 at softraid0: 256 targets
>> root on sd0a (d75aaa14b0711a78.a) swap on sd0b dump on sd0b