second cpu not online on Vsphere 6.0 if smt is disabled

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

second cpu not online on Vsphere 6.0 if smt is disabled

Giovanni Bechis-7
>Synopsis: if hw.smt=0 hw.ncpuonline=1 even if hw.ncpufound=2
>Category: kernel
>Environment:
        System      : OpenBSD 6.4
        Details     : OpenBSD 6.4 (GENERIC.MP) #3: Thu Dec 20 19:19:32 CET 2018
                         [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP

        Architecture: OpenBSD.amd64
        Machine     : amd64
>Description:
        On Vsphere 6.0 an OpenBSD guest does recognizes the second cpu but it cannot put it online
        The host uses an AMD cpu
>How-To-Repeat:
        Start a vm on Vsphere 6.0 with smt disabled
>Fix:
        setting hw.smt=1 is a workaround, a reboot is not needed


dmesg:
OpenBSD 6.4 (GENERIC.MP) #3: Thu Dec 20 19:19:32 CET 2018
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 8573091840 (8175MB)
avail mem = 8303992832 (7919MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0010 (556 entries)
bios0: vendor Phoenix Technologies LTD version "6.00" date 09/21/2015
bios0: VMware, Inc. VMware Virtual Platform
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP BOOT APIC MCFG SRAT HPET WAET
acpi0: wakeup devices PCI0(S3) USB_(S1) P2P0(S3) S1F0(S3) S2F0(S3) S8F0(S3) S16F(S3) S17F(S3) S18F(S3) S22F(S3) S23F(S3) S24F(S3) S25F(S3) PE40(S3) S1F0(S3) PE50(S3) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: AMD Opteron(tm) Processor 4386, 3100.71 MHz, 15-10-00
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,F16C,HV,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,XOP,FMA4,TBM,ITSC,BMI1
cpu0: 64KB 64b/line 2-way I-cache, 16KB 64b/line 4-way D-cache, 2MB 64b/line 16-way L2 cache, 6MB 64b/line 64-way L3 cache
cpu0: ITLB 48 4KB entries fully associative, 24 4MB entries fully associative
cpu0: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 65MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: AMD Opteron(tm) Processor 4386, 3100.73 MHz, 15-10-00
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,F16C,HV,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,XOP,FMA4,TBM,ITSC,BMI1
cpu1: 64KB 64b/line 2-way I-cache, 16KB 64b/line 4-way D-cache, 2MB 64b/line 16-way L2 cache, 6MB 64b/line 64-way L3 cache
cpu1: ITLB 48 4KB entries fully associative, 24 4MB entries fully associative
cpu1: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
cpu1: smt 1, core 0, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 24 pins
acpimcfg0 at acpi0
acpimcfg0: addr 0xf0000000, bus 0-127
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpicpu0 at acpi0: C1(@1 halt!)
acpicpu1 at acpi0: C1(@1 halt!)
acpicmos0 at acpi0
"PNP0A05" at acpi0 not configured
acpiac0 at acpi0: AC unit online
pvbus0 at mainbus0: VMware
vmt0 at pvbus0
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 82443BX AGP" rev 0x01
ppb0 at pci0 dev 1 function 0 "Intel 82443BX AGP" rev 0x01
pci1 at ppb0 bus 1
pcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x08
pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
pciide0: channel 0 disabled (no drives)
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <NECVMWar, VMware IDE CDR10, 1.00> ATAPI 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
piixpm0 at pci0 dev 7 function 3 "Intel 82371AB Power" rev 0x08: SMBus disabled
"VMware VMCI" rev 0x10 at pci0 dev 7 function 7 not configured
vga1 at pci0 dev 15 function 0 "VMware SVGA II" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
mpi0 at pci0 dev 16 function 0 "Symbios Logic 53c1030" rev 0x01: apic 2 int 17
mpi0: 0, firmware 1.3.41.32
scsibus2 at mpi0: 16 targets, initiator 7
sd0 at scsibus2 targ 0 lun 0: <VMware, Virtual disk, 1.0> SCSI2 0/direct fixed
sd0: 30720MB, 512 bytes/sector, 62914560 sectors
mpi0: target 0 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1
ppb1 at pci0 dev 17 function 0 "VMware PCI" rev 0x02
pci2 at ppb1 bus 2
ppb2 at pci0 dev 21 function 0 "VMware PCIE" rev 0x01
pci3 at ppb2 bus 3
vmx0 at pci3 dev 0 function 0 "VMware VMXNET3" rev 0x01: apic 2 int 18, address 00:50:56:b0:35:a6
ppb3 at pci0 dev 21 function 1 "VMware PCIE" rev 0x01
pci4 at ppb3 bus 4
ppb4 at pci0 dev 21 function 2 "VMware PCIE" rev 0x01
pci5 at ppb4 bus 5
ppb5 at pci0 dev 21 function 3 "VMware PCIE" rev 0x01
pci6 at ppb5 bus 6
ppb6 at pci0 dev 21 function 4 "VMware PCIE" rev 0x01
pci7 at ppb6 bus 7
ppb7 at pci0 dev 21 function 5 "VMware PCIE" rev 0x01
pci8 at ppb7 bus 8
ppb8 at pci0 dev 21 function 6 "VMware PCIE" rev 0x01
pci9 at ppb8 bus 9
ppb9 at pci0 dev 21 function 7 "VMware PCIE" rev 0x01
pci10 at ppb9 bus 10
ppb10 at pci0 dev 22 function 0 "VMware PCIE" rev 0x01
pci11 at ppb10 bus 11
ppb11 at pci0 dev 22 function 1 "VMware PCIE" rev 0x01
pci12 at ppb11 bus 12
ppb12 at pci0 dev 22 function 2 "VMware PCIE" rev 0x01
pci13 at ppb12 bus 13
ppb13 at pci0 dev 22 function 3 "VMware PCIE" rev 0x01
pci14 at ppb13 bus 14
ppb14 at pci0 dev 22 function 4 "VMware PCIE" rev 0x01
pci15 at ppb14 bus 15
ppb15 at pci0 dev 22 function 5 "VMware PCIE" rev 0x01
pci16 at ppb15 bus 16
ppb16 at pci0 dev 22 function 6 "VMware PCIE" rev 0x01
pci17 at ppb16 bus 17
ppb17 at pci0 dev 22 function 7 "VMware PCIE" rev 0x01
pci18 at ppb17 bus 18
ppb18 at pci0 dev 23 function 0 "VMware PCIE" rev 0x01
pci19 at ppb18 bus 19
ppb19 at pci0 dev 23 function 1 "VMware PCIE" rev 0x01
pci20 at ppb19 bus 20
ppb20 at pci0 dev 23 function 2 "VMware PCIE" rev 0x01
pci21 at ppb20 bus 21
ppb21 at pci0 dev 23 function 3 "VMware PCIE" rev 0x01
pci22 at ppb21 bus 22
ppb22 at pci0 dev 23 function 4 "VMware PCIE" rev 0x01
pci23 at ppb22 bus 23
ppb23 at pci0 dev 23 function 5 "VMware PCIE" rev 0x01
pci24 at ppb23 bus 24
ppb24 at pci0 dev 23 function 6 "VMware PCIE" rev 0x01
pci25 at ppb24 bus 25
ppb25 at pci0 dev 23 function 7 "VMware PCIE" rev 0x01
pci26 at ppb25 bus 26
ppb26 at pci0 dev 24 function 0 "VMware PCIE" rev 0x01
pci27 at ppb26 bus 27
ppb27 at pci0 dev 24 function 1 "VMware PCIE" rev 0x01
pci28 at ppb27 bus 28
ppb28 at pci0 dev 24 function 2 "VMware PCIE" rev 0x01
pci29 at ppb28 bus 29
ppb29 at pci0 dev 24 function 3 "VMware PCIE" rev 0x01
pci30 at ppb29 bus 30
ppb30 at pci0 dev 24 function 4 "VMware PCIE" rev 0x01
pci31 at ppb30 bus 31
ppb31 at pci0 dev 24 function 5 "VMware PCIE" rev 0x01
pci32 at ppb31 bus 32
ppb32 at pci0 dev 24 function 6 "VMware PCIE" rev 0x01
pci33 at ppb32 bus 33
ppb33 at pci0 dev 24 function 7 "VMware PCIE" rev 0x01
pci34 at ppb33 bus 34
isa0 at pcib0
isadma0 at isa0
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on sd0a (3d6dc0b98d2077c7.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec

usbdevs:
usbdevs: no USB controllers found

pcidump:
Domain /dev/pci0:
 0:0:0: Intel 82443BX AGP
        0x0000: Vendor ID: 8086 Product ID: 7190
        0x0004: Command: 0006 Status: 0200
        0x0008: Class: 06 Subclass: 00 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: BAR empty (00000000)
        0x001c: BAR empty (00000000)
        0x0020: BAR empty (00000000)
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
        0x0000: 71908086 02000006 06000001 00000000
        0x0010: 00000000 00000000 00000000 00000000
        0x0020: 00000000 00000000 00000000 197615ad
        0x0030: 00000000 00000000 00000000 00000000
        0x0040: 0000fce1 fe800008 00000000 00000000
        0x0050: ff008008 00000000 01111003 11333000
        0x0060: 00800080 00800080 00000000 00000000
        0x0070: 00080000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000013 f0000003 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00200000
 0:1:0: Intel 82443BX AGP
        0x0000: Vendor ID: 8086 Product ID: 7191
        0x0004: Command: 011f Status: 0220
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 01 Latency Timer: 00 Cache Line Size: 00
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 1 Subordinate Bus: 1
                Secondary Latency Timer: 40
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 02a0
        0x0020: Memory Base: fff0 Memory Limit: 0000
        0x0024: Prefetch Memory Base: fff0 Prefetch Memory Limit: 0000
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: 00 Bridge Control: 0004
        0x0000: 71918086 0220011f 06040001 00010000
        0x0010: 00000000 00000000 40010100 02a000f0
        0x0020: 0000fff0 0000fff0 00000000 00000000
        0x0030: 00000000 00000000 00000000 00040000
        0x0040: 00000000 00000000 00000000 00000000
        0x0050: 00000000 00000000 00000000 00000000
        0x0060: 00000000 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:7:0: Intel 82371AB PIIX4 ISA
        0x0000: Vendor ID: 8086 Product ID: 7110
        0x0004: Command: 0007 Status: 0280
        0x0008: Class: 06 Subclass: 01 Interface: 00 Revision: 08
        0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line Size: 00
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: BAR empty (00000000)
        0x001c: BAR empty (00000000)
        0x0020: BAR empty (00000000)
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
        0x0000: 71108086 02800007 06010008 00800000
        0x0010: 00000000 00000000 00000000 00000000
        0x0020: 00000000 00000000 00000000 197615ad
        0x0030: 00000000 00000000 00000000 00000000
        0x0040: 00000000 00000000 00000000 00100000
        0x0050: 00000000 00000000 00000000 00000000
        0x0060: 800a0b09 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:7:1: Intel 82371AB IDE
        0x0000: Vendor ID: 8086 Product ID: 7111
        0x0004: Command: 0005 Status: 0280
        0x0008: Class: 01 Subclass: 01 Interface: 8a Revision: 01
        0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 00
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: BAR empty (00000000)
        0x001c: BAR empty (00000000)
        0x0020: BAR io addr: 0x00001060/0x0010
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Min Gnt: 00 Max Lat: 00
        0x0000: 71118086 02800005 01018a01 00004000
        0x0010: 00000000 00000000 00000000 00000000
        0x0020: 00001061 00000000 00000000 197615ad
        0x0030: 00000000 00000000 00000000 000000ff
        0x0040: a3070000 00000000 00000004 00000000
        0x0050: 00000000 00000000 00000000 00000000
        0x0060: 00000000 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:7:3: Intel 82371AB Power
        0x0000: Vendor ID: 8086 Product ID: 7113
        0x0004: Command: 0001 Status: 0280
        0x0008: Class: 06 Subclass: 80 Interface: 00 Revision: 08
        0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line Size: 00
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: BAR empty (00000000)
        0x001c: BAR empty (00000000)
        0x0020: BAR empty (00000000)
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
        0x0000: 71138086 02800001 06800008 00800000
        0x0010: 00000000 00000000 00000000 00000000
        0x0020: 00000000 00000000 00000000 197615ad
        0x0030: 00000000 00000000 00000000 00000000
        0x0040: 00001001 00000000 00000000 00000000
        0x0050: 00001000 00000000 02000077 00000000
        0x0060: 20000000 00210cf0 00000000 00000000
        0x0070: 00000000 00000000 00000000 0001002e
        0x0080: 00000001 00000000 00000000 00000000
        0x0090: 00001041 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:7:7: VMware VMCI
        0x0000: Vendor ID: 15ad Product ID: 0740
        0x0004: Command: 0003 Status: 0290
        0x0008: Class: 08 Subclass: 80 Interface: 00 Revision: 10
        0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 00
        0x0010: BAR io addr: 0x00001080/0x0040
        0x0014: BAR mem 64bit addr: 0x00000000febfe000/0x00002000
        0x001c: BAR empty (00000000)
        0x0020: BAR empty (00000000)
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 0740
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 06 Max Lat: ff
        0x0040: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0058: Capability 0x11: Extended Message Signalled Interrupts (MSI-X)
        0x0000: 074015ad 02900003 08800010 00004000
        0x0010: 00001081 febfe004 00000000 00000000
        0x0020: 00000000 00000000 00000000 074015ad
        0x0030: 00000000 00000040 00000000 ff060109
        0x0040: 00805805 00000000 00000000 00000000
        0x0050: 00000000 00000000 00010011 00000001
        0x0060: 00001001 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:15:0: VMware SVGA II
        0x0000: Vendor ID: 15ad Product ID: 0405
        0x0004: Command: 0007 Status: 0290
        0x0008: Class: 03 Subclass: 00 Interface: 00 Revision: 00
        0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 08
        0x0010: BAR io addr: 0x00001070/0x0010
        0x0014: BAR mem prefetchable 32bit addr: 0xe8000000/0x08000000
        0x0018: BAR mem 32bit addr: 0xfe000000/0x00800000
        0x001c: BAR empty (00000000)
        0x0020: BAR empty (00000000)
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 0405
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 00 Max Lat: 00
        0x0040: Capability 0x09: Vendor Specific
        0x0044: Capability 0x13: PCI Advanced Features
        0x0000: 040515ad 02900007 03000000 00004008
        0x0010: 00001071 e8000008 fe000000 00000000
        0x0020: 00000000 00000000 00000000 040515ad
        0x0030: 00000000 00000040 00000000 00000109
        0x0040: 00004409 03060013 00000000 00000000
        0x0050: 00000000 00000000 00000000 00000000
        0x0060: 00000000 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:16:0: Symbios Logic 53c1030
        0x0000: Vendor ID: 1000 Product ID: 0030
        0x0004: Command: 0007 Status: 0290
        0x0008: Class: 01 Subclass: 00 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 00
        0x0010: BAR io addr: 0x00001400/0x0100
        0x0014: BAR mem 64bit addr: 0x00000000feba0000/0x00020000
        0x001c: BAR mem 64bit addr: 0x00000000febc0000/0x00020000
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 01 Line: 0b Min Gnt: 06 Max Lat: ff
        0x00f8: Capability 0x13: PCI Advanced Features
        0x0000: 00301000 02900007 01000001 00004000
        0x0010: 00001401 feba0004 00000000 febc0004
        0x0020: 00000000 00000000 00000000 197615ad
        0x0030: 00000000 000000f8 00000000 ff06010b
        0x0040: 00000000 00000000 00000000 00000000
        0x0050: 00000000 00000000 00000000 00000000
        0x0060: 00000000 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 03060013 00000000
 0:17:0: VMware PCI
        0x0000: Vendor ID: 15ad Product ID: 0790
        0x0004: Command: 0007 Status: 0290
        0x0008: Class: 06 Subclass: 04 Interface: 01 Revision: 02
        0x000c: BIST: 00 Header Type: 01 Latency Timer: 40 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 2 Subordinate Bus: 2
                Secondary Latency Timer: 44
        0x001c: I/O Base: 20 I/O Limit: 30 Secondary Status: 0280
        0x0020: Memory Base: fd60 Memory Limit: fdf0
        0x0024: Prefetch Memory Base: e7b1 Prefetch Memory Limit: e7f1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0000: 079015ad 02900007 06040102 00014008
        0x0010: 00000000 00000000 44020200 02803020
        0x0020: fdf0fd60 e7f1e7b1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000000d 079015ad 00000000 00000000
        0x0050: 00000000 00000000 00000000 00000000
        0x0060: 00000000 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 00000000
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:0: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 3 Subordinate Bus: 3
                Secondary Latency Timer: 00
        0x001c: I/O Base: 40 I/O Limit: 40 Secondary Status: 0000
        0x0020: Memory Base: fd50 Memory Limit: fd50
        0x0024: Prefetch Memory Base: fff1 Prefetch Memory Limit: 0001
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00030300 00004040
        0x0020: fd50fd50 0001fff1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 22020000 05047843 01480000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:1: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 4 Subordinate Bus: 4
                Secondary Latency Timer: 00
        0x001c: I/O Base: 80 I/O Limit: 80 Secondary Status: 0000
        0x0020: Memory Base: fd10 Memory Limit: fd10
        0x0024: Prefetch Memory Base: e771 Prefetch Memory Limit: e771
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00040400 00008080
        0x0020: fd10fd10 e771e771 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 050c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:2: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 5 Subordinate Bus: 5
                Secondary Latency Timer: 00
        0x001c: I/O Base: c0 I/O Limit: c0 Secondary Status: 0000
        0x0020: Memory Base: fcd0 Memory Limit: fcd0
        0x0024: Prefetch Memory Base: e731 Prefetch Memory Limit: e731
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00050500 0000c0c0
        0x0020: fcd0fcd0 e731e731 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 05147843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:3: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 6 Subordinate Bus: 6
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc90 Memory Limit: fc90
        0x0024: Prefetch Memory Base: e6f1 Prefetch Memory Limit: e6f1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00060600 000000f0
        0x0020: fc90fc90 e6f1e6f1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 051c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:4: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 7 Subordinate Bus: 7
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc50 Memory Limit: fc50
        0x0024: Prefetch Memory Base: e6b1 Prefetch Memory Limit: e6b1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00070700 000000f0
        0x0020: fc50fc50 e6b1e6b1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 05247843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:5: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 8 Subordinate Bus: 8
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc10 Memory Limit: fc10
        0x0024: Prefetch Memory Base: e671 Prefetch Memory Limit: e671
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00080800 000000f0
        0x0020: fc10fc10 e671e671 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 052c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:6: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 9 Subordinate Bus: 9
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fbd0 Memory Limit: fbd0
        0x0024: Prefetch Memory Base: e631 Prefetch Memory Limit: e631
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00090900 000000f0
        0x0020: fbd0fbd0 e631e631 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 05347843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:21:7: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 10 Subordinate Bus: 10
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fb90 Memory Limit: fb90
        0x0024: Prefetch Memory Base: e5f1 Prefetch Memory Limit: e5f1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 000a0a00 000000f0
        0x0020: fb90fb90 e5f1e5f1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 053c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:0: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 11 Subordinate Bus: 11
                Secondary Latency Timer: 00
        0x001c: I/O Base: 50 I/O Limit: 50 Secondary Status: 0000
        0x0020: Memory Base: fd40 Memory Limit: fd40
        0x0024: Prefetch Memory Base: e7a1 Prefetch Memory Limit: e7a1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 000b0b00 00005050
        0x0020: fd40fd40 e7a1e7a1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 06047843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:1: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 12 Subordinate Bus: 12
                Secondary Latency Timer: 00
        0x001c: I/O Base: 90 I/O Limit: 90 Secondary Status: 0000
        0x0020: Memory Base: fd00 Memory Limit: fd00
        0x0024: Prefetch Memory Base: e761 Prefetch Memory Limit: e761
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 000c0c00 00009090
        0x0020: fd00fd00 e761e761 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 060c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:2: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 13 Subordinate Bus: 13
                Secondary Latency Timer: 00
        0x001c: I/O Base: d0 I/O Limit: d0 Secondary Status: 0000
        0x0020: Memory Base: fcc0 Memory Limit: fcc0
        0x0024: Prefetch Memory Base: e721 Prefetch Memory Limit: e721
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 000d0d00 0000d0d0
        0x0020: fcc0fcc0 e721e721 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 06147843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:3: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 14 Subordinate Bus: 14
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc80 Memory Limit: fc80
        0x0024: Prefetch Memory Base: e6e1 Prefetch Memory Limit: e6e1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 000e0e00 000000f0
        0x0020: fc80fc80 e6e1e6e1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 061c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:4: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 15 Subordinate Bus: 15
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc40 Memory Limit: fc40
        0x0024: Prefetch Memory Base: e6a1 Prefetch Memory Limit: e6a1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 000f0f00 000000f0
        0x0020: fc40fc40 e6a1e6a1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 06247843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:5: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 16 Subordinate Bus: 16
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc00 Memory Limit: fc00
        0x0024: Prefetch Memory Base: e661 Prefetch Memory Limit: e661
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00101000 000000f0
        0x0020: fc00fc00 e661e661 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 062c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:6: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 17 Subordinate Bus: 17
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fbc0 Memory Limit: fbc0
        0x0024: Prefetch Memory Base: e621 Prefetch Memory Limit: e621
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00111100 000000f0
        0x0020: fbc0fbc0 e621e621 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 06347843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:22:7: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 18 Subordinate Bus: 18
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fb80 Memory Limit: fb80
        0x0024: Prefetch Memory Base: e5e1 Prefetch Memory Limit: e5e1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00121200 000000f0
        0x0020: fb80fb80 e5e1e5e1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 063c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:0: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 19 Subordinate Bus: 19
                Secondary Latency Timer: 00
        0x001c: I/O Base: 60 I/O Limit: 60 Secondary Status: 0000
        0x0020: Memory Base: fd30 Memory Limit: fd30
        0x0024: Prefetch Memory Base: e791 Prefetch Memory Limit: e791
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00131300 00006060
        0x0020: fd30fd30 e791e791 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 07047843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:1: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 20 Subordinate Bus: 20
                Secondary Latency Timer: 00
        0x001c: I/O Base: a0 I/O Limit: a0 Secondary Status: 0000
        0x0020: Memory Base: fcf0 Memory Limit: fcf0
        0x0024: Prefetch Memory Base: e751 Prefetch Memory Limit: e751
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00141400 0000a0a0
        0x0020: fcf0fcf0 e751e751 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 070c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:2: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 21 Subordinate Bus: 21
                Secondary Latency Timer: 00
        0x001c: I/O Base: e0 I/O Limit: e0 Secondary Status: 0000
        0x0020: Memory Base: fcb0 Memory Limit: fcb0
        0x0024: Prefetch Memory Base: e711 Prefetch Memory Limit: e711
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00151500 0000e0e0
        0x0020: fcb0fcb0 e711e711 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 07147843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:3: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 22 Subordinate Bus: 22
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc70 Memory Limit: fc70
        0x0024: Prefetch Memory Base: e6d1 Prefetch Memory Limit: e6d1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00161600 000000f0
        0x0020: fc70fc70 e6d1e6d1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 071c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:4: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 23 Subordinate Bus: 23
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc30 Memory Limit: fc30
        0x0024: Prefetch Memory Base: e691 Prefetch Memory Limit: e691
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00171700 000000f0
        0x0020: fc30fc30 e691e691 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 07247843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:5: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 24 Subordinate Bus: 24
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fbf0 Memory Limit: fbf0
        0x0024: Prefetch Memory Base: e651 Prefetch Memory Limit: e651
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00181800 000000f0
        0x0020: fbf0fbf0 e651e651 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 072c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:6: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 25 Subordinate Bus: 25
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fbb0 Memory Limit: fbb0
        0x0024: Prefetch Memory Base: e611 Prefetch Memory Limit: e611
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00191900 000000f0
        0x0020: fbb0fbb0 e611e611 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 07347843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:23:7: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 26 Subordinate Bus: 26
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fb70 Memory Limit: fb70
        0x0024: Prefetch Memory Base: e5d1 Prefetch Memory Limit: e5d1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 001a1a00 000000f0
        0x0020: fb70fb70 e5d1e5d1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 073c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:0: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 27 Subordinate Bus: 27
                Secondary Latency Timer: 00
        0x001c: I/O Base: 70 I/O Limit: 70 Secondary Status: 0000
        0x0020: Memory Base: fd20 Memory Limit: fd20
        0x0024: Prefetch Memory Base: e781 Prefetch Memory Limit: e781
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 001b1b00 00007070
        0x0020: fd20fd20 e781e781 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 08047843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:1: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 28 Subordinate Bus: 28
                Secondary Latency Timer: 00
        0x001c: I/O Base: b0 I/O Limit: b0 Secondary Status: 0000
        0x0020: Memory Base: fce0 Memory Limit: fce0
        0x0024: Prefetch Memory Base: e741 Prefetch Memory Limit: e741
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 001c1c00 0000b0b0
        0x0020: fce0fce0 e741e741 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 080c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:2: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 29 Subordinate Bus: 29
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fca0 Memory Limit: fca0
        0x0024: Prefetch Memory Base: e701 Prefetch Memory Limit: e701
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 001d1d00 000000f0
        0x0020: fca0fca0 e701e701 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 08147843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:3: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 30 Subordinate Bus: 30
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc60 Memory Limit: fc60
        0x0024: Prefetch Memory Base: e6c1 Prefetch Memory Limit: e6c1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 001e1e00 000000f0
        0x0020: fc60fc60 e6c1e6c1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 081c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:4: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 31 Subordinate Bus: 31
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fc20 Memory Limit: fc20
        0x0024: Prefetch Memory Base: e681 Prefetch Memory Limit: e681
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 001f1f00 000000f0
        0x0020: fc20fc20 e681e681 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 08247843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:5: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 32 Subordinate Bus: 32
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fbe0 Memory Limit: fbe0
        0x0024: Prefetch Memory Base: e641 Prefetch Memory Limit: e641
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00202000 000000f0
        0x0020: fbe0fbe0 e641e641 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 082c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:6: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 33 Subordinate Bus: 33
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fba0 Memory Limit: fba0
        0x0024: Prefetch Memory Base: e601 Prefetch Memory Limit: e601
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00212100 000000f0
        0x0020: fba0fba0 e601e601 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 08347843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 0:24:7: VMware PCIE
        0x0000: Vendor ID: 15ad Product ID: 07a0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR empty (00000000)
        0x0014: BAR empty (00000000)
        0x0018: Primary Bus: 0 Secondary Bus: 34 Subordinate Bus: 34
                Secondary Latency Timer: 00
        0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
        0x0020: Memory Base: fb60 Memory Limit: fb60
        0x0024: Prefetch Memory Base: e5c1 Prefetch Memory Limit: e5c1
        0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
        0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
        0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
        0x0038: Expansion ROM Base Address: 00000000
        0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
        0x0040: Capability 0x0d: PCI-PCI
        0x0048: Capability 0x01: Power Management
                State: D0
        0x0050: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x00: Unknown
        0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
        0x0000: 07a015ad 00100007 06040001 00810008
        0x0010: 00000000 00000000 00222200 000000f0
        0x0020: fb60fb60 e5c1e5c1 00000000 00000000
        0x0030: 00000000 00000040 00000000 000400ff
        0x0040: 0000480d 07a015ad c8035001 00000000
        0x0050: 01428c10 00000000 00000000 00100602
        0x0060: 02020000 083c7843 00000400 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00000000 00000000 01800005
        0x0090: 00000000 00000000 00000000 00000000
        0x00a0: 00000000 00000000 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000
 3:0:0: VMware VMXNET3
        0x0000: Vendor ID: 15ad Product ID: 07b0
        0x0004: Command: 0007 Status: 0010
        0x0008: Class: 02 Subclass: 00 Interface: 00 Revision: 01
        0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 08
        0x0010: BAR mem 32bit addr: 0xfd5fc000/0x00001000
        0x0014: BAR mem 32bit addr: 0xfd5fd000/0x00001000
        0x0018: BAR mem 32bit addr: 0xfd5fe000/0x00002000
        0x001c: BAR io addr: 0x00004000/0x0010
        0x0020: BAR empty (00000000)
        0x0024: BAR empty (00000000)
        0x0028: Cardbus CIS: 00000000
        0x002c: Subsystem Vendor ID: 15ad Product ID: 07b0
        0x0030: Expansion ROM Base Address: 00000000
        0x0038: 00000000
        0x003c: Interrupt Pin: 01 Line: 0a Min Gnt: 00 Max Lat: 00
        0x0040: Capability 0x01: Power Management
                State: D0
        0x0048: Capability 0x10: PCI Express
                Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
        0x0100: Enhanced Capability 0x03: Device Serial Number
        0x0084: Capability 0x05: Message Signalled Interrupts (MSI)
        0x009c: Capability 0x11: Extended Message Signalled Interrupts (MSI-X)
        0x0000: 07b015ad 00100007 02000001 00000008
        0x0010: fd5fc000 fd5fd000 fd5fe000 00004001
        0x0020: 00000000 00000000 00000000 07b015ad
        0x0030: 00000000 00000040 00000000 0000010a
        0x0040: fe034801 00000000 00028410 00000000
        0x0050: 00000000 00000602 02020000 00000000
        0x0060: 00000000 00000000 00000000 00000000
        0x0070: 00000000 00000000 00000000 00000000
        0x0080: 00000000 00809c05 00000000 00000000
        0x0090: 00000000 00000000 00000000 00180011
        0x00a0: 00000002 00001002 00000000 00000000
        0x00b0: 00000000 00000000 00000000 00000000
        0x00c0: 00000000 00000000 00000000 00000000
        0x00d0: 00000000 00000000 00000000 00000000
        0x00e0: 00000000 00000000 00000000 00000000
        0x00f0: 00000000 00000000 00000000 00000000

Reply | Threaded
Open this post in threaded view
|

Re: second cpu not online on Vsphere 6.0 if smt is disabled

Mike Larkin
On Mon, Jan 21, 2019 at 09:27:59PM +0100, [hidden email] wrote:

> >Synopsis: if hw.smt=0 hw.ncpuonline=1 even if hw.ncpufound=2
> >Category: kernel
> >Environment:
> System      : OpenBSD 6.4
> Details     : OpenBSD 6.4 (GENERIC.MP) #3: Thu Dec 20 19:19:32 CET 2018
> [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>
> Architecture: OpenBSD.amd64
> Machine     : amd64
> >Description:
> On Vsphere 6.0 an OpenBSD guest does recognizes the second cpu but it cannot put it online
>         The host uses an AMD cpu
> >How-To-Repeat:
> Start a vm on Vsphere 6.0 with smt disabled
> >Fix:
> setting hw.smt=1 is a workaround, a reboot is not needed
>
>

Looks like the hypervisor is presenting us with a topology of 1 core 2 threads.

We don't enable smt by default anymore. Search the lists and you'll find out why.

-ml

> dmesg:
> OpenBSD 6.4 (GENERIC.MP) #3: Thu Dec 20 19:19:32 CET 2018
>     [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> real mem = 8573091840 (8175MB)
> avail mem = 8303992832 (7919MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.4 @ 0xe0010 (556 entries)
> bios0: vendor Phoenix Technologies LTD version "6.00" date 09/21/2015
> bios0: VMware, Inc. VMware Virtual Platform
> acpi0 at bios0: rev 2
> acpi0: sleep states S0 S1 S4 S5
> acpi0: tables DSDT FACP BOOT APIC MCFG SRAT HPET WAET
> acpi0: wakeup devices PCI0(S3) USB_(S1) P2P0(S3) S1F0(S3) S2F0(S3) S8F0(S3) S16F(S3) S17F(S3) S18F(S3) S22F(S3) S23F(S3) S24F(S3) S25F(S3) PE40(S3) S1F0(S3) PE50(S3) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: AMD Opteron(tm) Processor 4386, 3100.71 MHz, 15-10-00
> cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,F16C,HV,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,XOP,FMA4,TBM,ITSC,BMI1
> cpu0: 64KB 64b/line 2-way I-cache, 16KB 64b/line 4-way D-cache, 2MB 64b/line 16-way L2 cache, 6MB 64b/line 64-way L3 cache
> cpu0: ITLB 48 4KB entries fully associative, 24 4MB entries fully associative
> cpu0: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
> cpu0: apic clock running at 65MHz
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: AMD Opteron(tm) Processor 4386, 3100.73 MHz, 15-10-00
> cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,PCLMUL,SSSE3,FMA3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,AES,XSAVE,AVX,F16C,HV,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,OSVW,XOP,FMA4,TBM,ITSC,BMI1
> cpu1: 64KB 64b/line 2-way I-cache, 16KB 64b/line 4-way D-cache, 2MB 64b/line 16-way L2 cache, 6MB 64b/line 64-way L3 cache
> cpu1: ITLB 48 4KB entries fully associative, 24 4MB entries fully associative
> cpu1: DTLB 64 4KB entries fully associative, 64 4MB entries fully associative
> cpu1: smt 1, core 0, package 0
> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 24 pins
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xf0000000, bus 0-127
> acpihpet0 at acpi0: 14318179 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpicpu0 at acpi0: C1(@1 halt!)
> acpicpu1 at acpi0: C1(@1 halt!)
> acpicmos0 at acpi0
> "PNP0A05" at acpi0 not configured
> acpiac0 at acpi0: AC unit online
> pvbus0 at mainbus0: VMware
> vmt0 at pvbus0
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 82443BX AGP" rev 0x01
> ppb0 at pci0 dev 1 function 0 "Intel 82443BX AGP" rev 0x01
> pci1 at ppb0 bus 1
> pcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x08
> pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
> pciide0: channel 0 disabled (no drives)
> atapiscsi0 at pciide0 channel 1 drive 0
> scsibus1 at atapiscsi0: 2 targets
> cd0 at scsibus1 targ 0 lun 0: <NECVMWar, VMware IDE CDR10, 1.00> ATAPI 5/cdrom removable
> cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
> piixpm0 at pci0 dev 7 function 3 "Intel 82371AB Power" rev 0x08: SMBus disabled
> "VMware VMCI" rev 0x10 at pci0 dev 7 function 7 not configured
> vga1 at pci0 dev 15 function 0 "VMware SVGA II" rev 0x00
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> mpi0 at pci0 dev 16 function 0 "Symbios Logic 53c1030" rev 0x01: apic 2 int 17
> mpi0: 0, firmware 1.3.41.32
> scsibus2 at mpi0: 16 targets, initiator 7
> sd0 at scsibus2 targ 0 lun 0: <VMware, Virtual disk, 1.0> SCSI2 0/direct fixed
> sd0: 30720MB, 512 bytes/sector, 62914560 sectors
> mpi0: target 0 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1
> ppb1 at pci0 dev 17 function 0 "VMware PCI" rev 0x02
> pci2 at ppb1 bus 2
> ppb2 at pci0 dev 21 function 0 "VMware PCIE" rev 0x01
> pci3 at ppb2 bus 3
> vmx0 at pci3 dev 0 function 0 "VMware VMXNET3" rev 0x01: apic 2 int 18, address 00:50:56:b0:35:a6
> ppb3 at pci0 dev 21 function 1 "VMware PCIE" rev 0x01
> pci4 at ppb3 bus 4
> ppb4 at pci0 dev 21 function 2 "VMware PCIE" rev 0x01
> pci5 at ppb4 bus 5
> ppb5 at pci0 dev 21 function 3 "VMware PCIE" rev 0x01
> pci6 at ppb5 bus 6
> ppb6 at pci0 dev 21 function 4 "VMware PCIE" rev 0x01
> pci7 at ppb6 bus 7
> ppb7 at pci0 dev 21 function 5 "VMware PCIE" rev 0x01
> pci8 at ppb7 bus 8
> ppb8 at pci0 dev 21 function 6 "VMware PCIE" rev 0x01
> pci9 at ppb8 bus 9
> ppb9 at pci0 dev 21 function 7 "VMware PCIE" rev 0x01
> pci10 at ppb9 bus 10
> ppb10 at pci0 dev 22 function 0 "VMware PCIE" rev 0x01
> pci11 at ppb10 bus 11
> ppb11 at pci0 dev 22 function 1 "VMware PCIE" rev 0x01
> pci12 at ppb11 bus 12
> ppb12 at pci0 dev 22 function 2 "VMware PCIE" rev 0x01
> pci13 at ppb12 bus 13
> ppb13 at pci0 dev 22 function 3 "VMware PCIE" rev 0x01
> pci14 at ppb13 bus 14
> ppb14 at pci0 dev 22 function 4 "VMware PCIE" rev 0x01
> pci15 at ppb14 bus 15
> ppb15 at pci0 dev 22 function 5 "VMware PCIE" rev 0x01
> pci16 at ppb15 bus 16
> ppb16 at pci0 dev 22 function 6 "VMware PCIE" rev 0x01
> pci17 at ppb16 bus 17
> ppb17 at pci0 dev 22 function 7 "VMware PCIE" rev 0x01
> pci18 at ppb17 bus 18
> ppb18 at pci0 dev 23 function 0 "VMware PCIE" rev 0x01
> pci19 at ppb18 bus 19
> ppb19 at pci0 dev 23 function 1 "VMware PCIE" rev 0x01
> pci20 at ppb19 bus 20
> ppb20 at pci0 dev 23 function 2 "VMware PCIE" rev 0x01
> pci21 at ppb20 bus 21
> ppb21 at pci0 dev 23 function 3 "VMware PCIE" rev 0x01
> pci22 at ppb21 bus 22
> ppb22 at pci0 dev 23 function 4 "VMware PCIE" rev 0x01
> pci23 at ppb22 bus 23
> ppb23 at pci0 dev 23 function 5 "VMware PCIE" rev 0x01
> pci24 at ppb23 bus 24
> ppb24 at pci0 dev 23 function 6 "VMware PCIE" rev 0x01
> pci25 at ppb24 bus 25
> ppb25 at pci0 dev 23 function 7 "VMware PCIE" rev 0x01
> pci26 at ppb25 bus 26
> ppb26 at pci0 dev 24 function 0 "VMware PCIE" rev 0x01
> pci27 at ppb26 bus 27
> ppb27 at pci0 dev 24 function 1 "VMware PCIE" rev 0x01
> pci28 at ppb27 bus 28
> ppb28 at pci0 dev 24 function 2 "VMware PCIE" rev 0x01
> pci29 at ppb28 bus 29
> ppb29 at pci0 dev 24 function 3 "VMware PCIE" rev 0x01
> pci30 at ppb29 bus 30
> ppb30 at pci0 dev 24 function 4 "VMware PCIE" rev 0x01
> pci31 at ppb30 bus 31
> ppb31 at pci0 dev 24 function 5 "VMware PCIE" rev 0x01
> pci32 at ppb31 bus 32
> ppb32 at pci0 dev 24 function 6 "VMware PCIE" rev 0x01
> pci33 at ppb32 bus 33
> ppb33 at pci0 dev 24 function 7 "VMware PCIE" rev 0x01
> pci34 at ppb33 bus 34
> isa0 at pcib0
> isadma0 at isa0
> fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0: console keyboard, using wsdisplay0
> pms0 at pckbc0 (aux slot)
> wsmouse0 at pms0 mux 0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> vscsi0 at root
> scsibus3 at vscsi0: 256 targets
> softraid0 at root
> scsibus4 at softraid0: 256 targets
> root on sd0a (3d6dc0b98d2077c7.a) swap on sd0b dump on sd0b
> WARNING: / was not properly unmounted
> fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
>
> usbdevs:
> usbdevs: no USB controllers found
>
> pcidump:
> Domain /dev/pci0:
>  0:0:0: Intel 82443BX AGP
> 0x0000: Vendor ID: 8086 Product ID: 7190
> 0x0004: Command: 0006 Status: 0200
> 0x0008: Class: 06 Subclass: 00 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 00
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: BAR empty (00000000)
> 0x001c: BAR empty (00000000)
> 0x0020: BAR empty (00000000)
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
> 0x0000: 71908086 02000006 06000001 00000000
> 0x0010: 00000000 00000000 00000000 00000000
> 0x0020: 00000000 00000000 00000000 197615ad
> 0x0030: 00000000 00000000 00000000 00000000
> 0x0040: 0000fce1 fe800008 00000000 00000000
> 0x0050: ff008008 00000000 01111003 11333000
> 0x0060: 00800080 00800080 00000000 00000000
> 0x0070: 00080000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000013 f0000003 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00200000
>  0:1:0: Intel 82443BX AGP
> 0x0000: Vendor ID: 8086 Product ID: 7191
> 0x0004: Command: 011f Status: 0220
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 01 Latency Timer: 00 Cache Line Size: 00
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 1 Subordinate Bus: 1
>        Secondary Latency Timer: 40
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 02a0
> 0x0020: Memory Base: fff0 Memory Limit: 0000
> 0x0024: Prefetch Memory Base: fff0 Prefetch Memory Limit: 0000
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: 00 Bridge Control: 0004
> 0x0000: 71918086 0220011f 06040001 00010000
> 0x0010: 00000000 00000000 40010100 02a000f0
> 0x0020: 0000fff0 0000fff0 00000000 00000000
> 0x0030: 00000000 00000000 00000000 00040000
> 0x0040: 00000000 00000000 00000000 00000000
> 0x0050: 00000000 00000000 00000000 00000000
> 0x0060: 00000000 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:7:0: Intel 82371AB PIIX4 ISA
> 0x0000: Vendor ID: 8086 Product ID: 7110
> 0x0004: Command: 0007 Status: 0280
> 0x0008: Class: 06 Subclass: 01 Interface: 00 Revision: 08
> 0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line Size: 00
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: BAR empty (00000000)
> 0x001c: BAR empty (00000000)
> 0x0020: BAR empty (00000000)
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
> 0x0000: 71108086 02800007 06010008 00800000
> 0x0010: 00000000 00000000 00000000 00000000
> 0x0020: 00000000 00000000 00000000 197615ad
> 0x0030: 00000000 00000000 00000000 00000000
> 0x0040: 00000000 00000000 00000000 00100000
> 0x0050: 00000000 00000000 00000000 00000000
> 0x0060: 800a0b09 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:7:1: Intel 82371AB IDE
> 0x0000: Vendor ID: 8086 Product ID: 7111
> 0x0004: Command: 0005 Status: 0280
> 0x0008: Class: 01 Subclass: 01 Interface: 8a Revision: 01
> 0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 00
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: BAR empty (00000000)
> 0x001c: BAR empty (00000000)
> 0x0020: BAR io addr: 0x00001060/0x0010
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Min Gnt: 00 Max Lat: 00
> 0x0000: 71118086 02800005 01018a01 00004000
> 0x0010: 00000000 00000000 00000000 00000000
> 0x0020: 00001061 00000000 00000000 197615ad
> 0x0030: 00000000 00000000 00000000 000000ff
> 0x0040: a3070000 00000000 00000004 00000000
> 0x0050: 00000000 00000000 00000000 00000000
> 0x0060: 00000000 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:7:3: Intel 82371AB Power
> 0x0000: Vendor ID: 8086 Product ID: 7113
> 0x0004: Command: 0001 Status: 0280
> 0x0008: Class: 06 Subclass: 80 Interface: 00 Revision: 08
> 0x000c: BIST: 00 Header Type: 80 Latency Timer: 00 Cache Line Size: 00
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: BAR empty (00000000)
> 0x001c: BAR empty (00000000)
> 0x0020: BAR empty (00000000)
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 00 Line: 00 Min Gnt: 00 Max Lat: 00
> 0x0000: 71138086 02800001 06800008 00800000
> 0x0010: 00000000 00000000 00000000 00000000
> 0x0020: 00000000 00000000 00000000 197615ad
> 0x0030: 00000000 00000000 00000000 00000000
> 0x0040: 00001001 00000000 00000000 00000000
> 0x0050: 00001000 00000000 02000077 00000000
> 0x0060: 20000000 00210cf0 00000000 00000000
> 0x0070: 00000000 00000000 00000000 0001002e
> 0x0080: 00000001 00000000 00000000 00000000
> 0x0090: 00001041 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:7:7: VMware VMCI
> 0x0000: Vendor ID: 15ad Product ID: 0740
> 0x0004: Command: 0003 Status: 0290
> 0x0008: Class: 08 Subclass: 80 Interface: 00 Revision: 10
> 0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 00
> 0x0010: BAR io addr: 0x00001080/0x0040
> 0x0014: BAR mem 64bit addr: 0x00000000febfe000/0x00002000
> 0x001c: BAR empty (00000000)
> 0x0020: BAR empty (00000000)
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 0740
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 06 Max Lat: ff
> 0x0040: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0058: Capability 0x11: Extended Message Signalled Interrupts (MSI-X)
> 0x0000: 074015ad 02900003 08800010 00004000
> 0x0010: 00001081 febfe004 00000000 00000000
> 0x0020: 00000000 00000000 00000000 074015ad
> 0x0030: 00000000 00000040 00000000 ff060109
> 0x0040: 00805805 00000000 00000000 00000000
> 0x0050: 00000000 00000000 00010011 00000001
> 0x0060: 00001001 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:15:0: VMware SVGA II
> 0x0000: Vendor ID: 15ad Product ID: 0405
> 0x0004: Command: 0007 Status: 0290
> 0x0008: Class: 03 Subclass: 00 Interface: 00 Revision: 00
> 0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 08
> 0x0010: BAR io addr: 0x00001070/0x0010
> 0x0014: BAR mem prefetchable 32bit addr: 0xe8000000/0x08000000
> 0x0018: BAR mem 32bit addr: 0xfe000000/0x00800000
> 0x001c: BAR empty (00000000)
> 0x0020: BAR empty (00000000)
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 0405
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 01 Line: 09 Min Gnt: 00 Max Lat: 00
> 0x0040: Capability 0x09: Vendor Specific
> 0x0044: Capability 0x13: PCI Advanced Features
> 0x0000: 040515ad 02900007 03000000 00004008
> 0x0010: 00001071 e8000008 fe000000 00000000
> 0x0020: 00000000 00000000 00000000 040515ad
> 0x0030: 00000000 00000040 00000000 00000109
> 0x0040: 00004409 03060013 00000000 00000000
> 0x0050: 00000000 00000000 00000000 00000000
> 0x0060: 00000000 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:16:0: Symbios Logic 53c1030
> 0x0000: Vendor ID: 1000 Product ID: 0030
> 0x0004: Command: 0007 Status: 0290
> 0x0008: Class: 01 Subclass: 00 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 00 Latency Timer: 40 Cache Line Size: 00
> 0x0010: BAR io addr: 0x00001400/0x0100
> 0x0014: BAR mem 64bit addr: 0x00000000feba0000/0x00020000
> 0x001c: BAR mem 64bit addr: 0x00000000febc0000/0x00020000
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 1976
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 01 Line: 0b Min Gnt: 06 Max Lat: ff
> 0x00f8: Capability 0x13: PCI Advanced Features
> 0x0000: 00301000 02900007 01000001 00004000
> 0x0010: 00001401 feba0004 00000000 febc0004
> 0x0020: 00000000 00000000 00000000 197615ad
> 0x0030: 00000000 000000f8 00000000 ff06010b
> 0x0040: 00000000 00000000 00000000 00000000
> 0x0050: 00000000 00000000 00000000 00000000
> 0x0060: 00000000 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 03060013 00000000
>  0:17:0: VMware PCI
> 0x0000: Vendor ID: 15ad Product ID: 0790
> 0x0004: Command: 0007 Status: 0290
> 0x0008: Class: 06 Subclass: 04 Interface: 01 Revision: 02
> 0x000c: BIST: 00 Header Type: 01 Latency Timer: 40 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 2 Subordinate Bus: 2
>        Secondary Latency Timer: 44
> 0x001c: I/O Base: 20 I/O Limit: 30 Secondary Status: 0280
> 0x0020: Memory Base: fd60 Memory Limit: fdf0
> 0x0024: Prefetch Memory Base: e7b1 Prefetch Memory Limit: e7f1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0000: 079015ad 02900007 06040102 00014008
> 0x0010: 00000000 00000000 44020200 02803020
> 0x0020: fdf0fd60 e7f1e7b1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000000d 079015ad 00000000 00000000
> 0x0050: 00000000 00000000 00000000 00000000
> 0x0060: 00000000 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:0: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 3 Subordinate Bus: 3
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: 40 I/O Limit: 40 Secondary Status: 0000
> 0x0020: Memory Base: fd50 Memory Limit: fd50
> 0x0024: Prefetch Memory Base: fff1 Prefetch Memory Limit: 0001
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00030300 00004040
> 0x0020: fd50fd50 0001fff1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 22020000 05047843 01480000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:1: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 4 Subordinate Bus: 4
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: 80 I/O Limit: 80 Secondary Status: 0000
> 0x0020: Memory Base: fd10 Memory Limit: fd10
> 0x0024: Prefetch Memory Base: e771 Prefetch Memory Limit: e771
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00040400 00008080
> 0x0020: fd10fd10 e771e771 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 050c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:2: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 5 Subordinate Bus: 5
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: c0 I/O Limit: c0 Secondary Status: 0000
> 0x0020: Memory Base: fcd0 Memory Limit: fcd0
> 0x0024: Prefetch Memory Base: e731 Prefetch Memory Limit: e731
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00050500 0000c0c0
> 0x0020: fcd0fcd0 e731e731 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 05147843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:3: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 6 Subordinate Bus: 6
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc90 Memory Limit: fc90
> 0x0024: Prefetch Memory Base: e6f1 Prefetch Memory Limit: e6f1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00060600 000000f0
> 0x0020: fc90fc90 e6f1e6f1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 051c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:4: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 7 Subordinate Bus: 7
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc50 Memory Limit: fc50
> 0x0024: Prefetch Memory Base: e6b1 Prefetch Memory Limit: e6b1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00070700 000000f0
> 0x0020: fc50fc50 e6b1e6b1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 05247843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:5: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 8 Subordinate Bus: 8
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc10 Memory Limit: fc10
> 0x0024: Prefetch Memory Base: e671 Prefetch Memory Limit: e671
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00080800 000000f0
> 0x0020: fc10fc10 e671e671 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 052c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:6: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 9 Subordinate Bus: 9
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fbd0 Memory Limit: fbd0
> 0x0024: Prefetch Memory Base: e631 Prefetch Memory Limit: e631
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00090900 000000f0
> 0x0020: fbd0fbd0 e631e631 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 05347843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:21:7: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 10 Subordinate Bus: 10
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fb90 Memory Limit: fb90
> 0x0024: Prefetch Memory Base: e5f1 Prefetch Memory Limit: e5f1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 000a0a00 000000f0
> 0x0020: fb90fb90 e5f1e5f1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 053c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:0: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 11 Subordinate Bus: 11
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: 50 I/O Limit: 50 Secondary Status: 0000
> 0x0020: Memory Base: fd40 Memory Limit: fd40
> 0x0024: Prefetch Memory Base: e7a1 Prefetch Memory Limit: e7a1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 000b0b00 00005050
> 0x0020: fd40fd40 e7a1e7a1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 06047843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:1: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 12 Subordinate Bus: 12
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: 90 I/O Limit: 90 Secondary Status: 0000
> 0x0020: Memory Base: fd00 Memory Limit: fd00
> 0x0024: Prefetch Memory Base: e761 Prefetch Memory Limit: e761
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 000c0c00 00009090
> 0x0020: fd00fd00 e761e761 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 060c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:2: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 13 Subordinate Bus: 13
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: d0 I/O Limit: d0 Secondary Status: 0000
> 0x0020: Memory Base: fcc0 Memory Limit: fcc0
> 0x0024: Prefetch Memory Base: e721 Prefetch Memory Limit: e721
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 000d0d00 0000d0d0
> 0x0020: fcc0fcc0 e721e721 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 06147843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:3: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 14 Subordinate Bus: 14
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc80 Memory Limit: fc80
> 0x0024: Prefetch Memory Base: e6e1 Prefetch Memory Limit: e6e1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 000e0e00 000000f0
> 0x0020: fc80fc80 e6e1e6e1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 061c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:4: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 15 Subordinate Bus: 15
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc40 Memory Limit: fc40
> 0x0024: Prefetch Memory Base: e6a1 Prefetch Memory Limit: e6a1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 000f0f00 000000f0
> 0x0020: fc40fc40 e6a1e6a1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 06247843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:5: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 16 Subordinate Bus: 16
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc00 Memory Limit: fc00
> 0x0024: Prefetch Memory Base: e661 Prefetch Memory Limit: e661
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00101000 000000f0
> 0x0020: fc00fc00 e661e661 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 062c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:6: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 17 Subordinate Bus: 17
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fbc0 Memory Limit: fbc0
> 0x0024: Prefetch Memory Base: e621 Prefetch Memory Limit: e621
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00111100 000000f0
> 0x0020: fbc0fbc0 e621e621 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 06347843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:22:7: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 18 Subordinate Bus: 18
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fb80 Memory Limit: fb80
> 0x0024: Prefetch Memory Base: e5e1 Prefetch Memory Limit: e5e1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00121200 000000f0
> 0x0020: fb80fb80 e5e1e5e1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 063c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:0: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 19 Subordinate Bus: 19
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: 60 I/O Limit: 60 Secondary Status: 0000
> 0x0020: Memory Base: fd30 Memory Limit: fd30
> 0x0024: Prefetch Memory Base: e791 Prefetch Memory Limit: e791
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00131300 00006060
> 0x0020: fd30fd30 e791e791 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 07047843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:1: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 20 Subordinate Bus: 20
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: a0 I/O Limit: a0 Secondary Status: 0000
> 0x0020: Memory Base: fcf0 Memory Limit: fcf0
> 0x0024: Prefetch Memory Base: e751 Prefetch Memory Limit: e751
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00141400 0000a0a0
> 0x0020: fcf0fcf0 e751e751 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 070c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:2: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 21 Subordinate Bus: 21
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: e0 I/O Limit: e0 Secondary Status: 0000
> 0x0020: Memory Base: fcb0 Memory Limit: fcb0
> 0x0024: Prefetch Memory Base: e711 Prefetch Memory Limit: e711
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00151500 0000e0e0
> 0x0020: fcb0fcb0 e711e711 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 07147843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:3: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 22 Subordinate Bus: 22
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc70 Memory Limit: fc70
> 0x0024: Prefetch Memory Base: e6d1 Prefetch Memory Limit: e6d1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00161600 000000f0
> 0x0020: fc70fc70 e6d1e6d1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 071c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:4: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 23 Subordinate Bus: 23
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc30 Memory Limit: fc30
> 0x0024: Prefetch Memory Base: e691 Prefetch Memory Limit: e691
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00171700 000000f0
> 0x0020: fc30fc30 e691e691 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 07247843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:5: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 24 Subordinate Bus: 24
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fbf0 Memory Limit: fbf0
> 0x0024: Prefetch Memory Base: e651 Prefetch Memory Limit: e651
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00181800 000000f0
> 0x0020: fbf0fbf0 e651e651 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 072c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:6: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 25 Subordinate Bus: 25
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fbb0 Memory Limit: fbb0
> 0x0024: Prefetch Memory Base: e611 Prefetch Memory Limit: e611
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00191900 000000f0
> 0x0020: fbb0fbb0 e611e611 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 07347843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:23:7: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 26 Subordinate Bus: 26
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fb70 Memory Limit: fb70
> 0x0024: Prefetch Memory Base: e5d1 Prefetch Memory Limit: e5d1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 001a1a00 000000f0
> 0x0020: fb70fb70 e5d1e5d1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 073c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:0: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 27 Subordinate Bus: 27
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: 70 I/O Limit: 70 Secondary Status: 0000
> 0x0020: Memory Base: fd20 Memory Limit: fd20
> 0x0024: Prefetch Memory Base: e781 Prefetch Memory Limit: e781
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 001b1b00 00007070
> 0x0020: fd20fd20 e781e781 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 08047843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:1: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 28 Subordinate Bus: 28
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: b0 I/O Limit: b0 Secondary Status: 0000
> 0x0020: Memory Base: fce0 Memory Limit: fce0
> 0x0024: Prefetch Memory Base: e741 Prefetch Memory Limit: e741
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 001c1c00 0000b0b0
> 0x0020: fce0fce0 e741e741 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 080c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:2: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 29 Subordinate Bus: 29
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fca0 Memory Limit: fca0
> 0x0024: Prefetch Memory Base: e701 Prefetch Memory Limit: e701
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 001d1d00 000000f0
> 0x0020: fca0fca0 e701e701 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 08147843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:3: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 30 Subordinate Bus: 30
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc60 Memory Limit: fc60
> 0x0024: Prefetch Memory Base: e6c1 Prefetch Memory Limit: e6c1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 001e1e00 000000f0
> 0x0020: fc60fc60 e6c1e6c1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 081c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:4: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 31 Subordinate Bus: 31
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fc20 Memory Limit: fc20
> 0x0024: Prefetch Memory Base: e681 Prefetch Memory Limit: e681
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 001f1f00 000000f0
> 0x0020: fc20fc20 e681e681 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 08247843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:5: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 32 Subordinate Bus: 32
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fbe0 Memory Limit: fbe0
> 0x0024: Prefetch Memory Base: e641 Prefetch Memory Limit: e641
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00202000 000000f0
> 0x0020: fbe0fbe0 e641e641 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 082c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:6: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 33 Subordinate Bus: 33
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fba0 Memory Limit: fba0
> 0x0024: Prefetch Memory Base: e601 Prefetch Memory Limit: e601
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00212100 000000f0
> 0x0020: fba0fba0 e601e601 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 08347843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  0:24:7: VMware PCIE
> 0x0000: Vendor ID: 15ad Product ID: 07a0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 06 Subclass: 04 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 81 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR empty (00000000)
> 0x0014: BAR empty (00000000)
> 0x0018: Primary Bus: 0 Secondary Bus: 34 Subordinate Bus: 34
>        Secondary Latency Timer: 00
> 0x001c: I/O Base: f0 I/O Limit: 00 Secondary Status: 0000
> 0x0020: Memory Base: fb60 Memory Limit: fb60
> 0x0024: Prefetch Memory Base: e5c1 Prefetch Memory Limit: e5c1
> 0x0028: Prefetch Memory Base Upper 32 Bits: 00000000
> 0x002c: Prefetch Memory Limit Upper 32 Bits: 00000000
> 0x0030: I/O Base Upper 16 Bits: 0000 I/O Limit Upper 16 Bits: 0000
> 0x0038: Expansion ROM Base Address: 00000000
> 0x003c: Interrupt Pin: 00 Line: ff Bridge Control: 0004
> 0x0040: Capability 0x0d: PCI-PCI
> 0x0048: Capability 0x01: Power Management
> State: D0
> 0x0050: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x00: Unknown
> 0x008c: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x0000: 07a015ad 00100007 06040001 00810008
> 0x0010: 00000000 00000000 00222200 000000f0
> 0x0020: fb60fb60 e5c1e5c1 00000000 00000000
> 0x0030: 00000000 00000040 00000000 000400ff
> 0x0040: 0000480d 07a015ad c8035001 00000000
> 0x0050: 01428c10 00000000 00000000 00100602
> 0x0060: 02020000 083c7843 00000400 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00000000 00000000 01800005
> 0x0090: 00000000 00000000 00000000 00000000
> 0x00a0: 00000000 00000000 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>  3:0:0: VMware VMXNET3
> 0x0000: Vendor ID: 15ad Product ID: 07b0
> 0x0004: Command: 0007 Status: 0010
> 0x0008: Class: 02 Subclass: 00 Interface: 00 Revision: 01
> 0x000c: BIST: 00 Header Type: 00 Latency Timer: 00 Cache Line Size: 08
> 0x0010: BAR mem 32bit addr: 0xfd5fc000/0x00001000
> 0x0014: BAR mem 32bit addr: 0xfd5fd000/0x00001000
> 0x0018: BAR mem 32bit addr: 0xfd5fe000/0x00002000
> 0x001c: BAR io addr: 0x00004000/0x0010
> 0x0020: BAR empty (00000000)
> 0x0024: BAR empty (00000000)
> 0x0028: Cardbus CIS: 00000000
> 0x002c: Subsystem Vendor ID: 15ad Product ID: 07b0
> 0x0030: Expansion ROM Base Address: 00000000
> 0x0038: 00000000
> 0x003c: Interrupt Pin: 01 Line: 0a Min Gnt: 00 Max Lat: 00
> 0x0040: Capability 0x01: Power Management
> State: D0
> 0x0048: Capability 0x10: PCI Express
>        Link Speed: 5.0 / 5.0 GT/s Link Width: x32 / x32
> 0x0100: Enhanced Capability 0x03: Device Serial Number
> 0x0084: Capability 0x05: Message Signalled Interrupts (MSI)
> 0x009c: Capability 0x11: Extended Message Signalled Interrupts (MSI-X)
> 0x0000: 07b015ad 00100007 02000001 00000008
> 0x0010: fd5fc000 fd5fd000 fd5fe000 00004001
> 0x0020: 00000000 00000000 00000000 07b015ad
> 0x0030: 00000000 00000040 00000000 0000010a
> 0x0040: fe034801 00000000 00028410 00000000
> 0x0050: 00000000 00000602 02020000 00000000
> 0x0060: 00000000 00000000 00000000 00000000
> 0x0070: 00000000 00000000 00000000 00000000
> 0x0080: 00000000 00809c05 00000000 00000000
> 0x0090: 00000000 00000000 00000000 00180011
> 0x00a0: 00000002 00001002 00000000 00000000
> 0x00b0: 00000000 00000000 00000000 00000000
> 0x00c0: 00000000 00000000 00000000 00000000
> 0x00d0: 00000000 00000000 00000000 00000000
> 0x00e0: 00000000 00000000 00000000 00000000
> 0x00f0: 00000000 00000000 00000000 00000000
>

Reply | Threaded
Open this post in threaded view
|

Re: second cpu not online on Vsphere 6.0 if smt is disabled

Giovanni Bechis-7
On Mon, Jan 21, 2019 at 04:28:53PM -0800, Mike Larkin wrote:

> On Mon, Jan 21, 2019 at 09:27:59PM +0100, [hidden email] wrote:
> > >Synopsis: if hw.smt=0 hw.ncpuonline=1 even if hw.ncpufound=2
> > >Category: kernel
> > >Environment:
> > System      : OpenBSD 6.4
> > Details     : OpenBSD 6.4 (GENERIC.MP) #3: Thu Dec 20 19:19:32 CET 2018
> > [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> >
> > Architecture: OpenBSD.amd64
> > Machine     : amd64
> > >Description:
> > On Vsphere 6.0 an OpenBSD guest does recognizes the second cpu but it cannot put it online
> >         The host uses an AMD cpu
> > >How-To-Repeat:
> > Start a vm on Vsphere 6.0 with smt disabled
> > >Fix:
> > setting hw.smt=1 is a workaround, a reboot is not needed
> >
> >
>
> Looks like the hypervisor is presenting us with a topology of 1 core 2 threads.
>
> We don't enable smt by default anymore. Search the lists and you'll find out why.
>
> -ml
>
I am aware of the reason why smt is disabled by default, this was more a warning for users then
a real bug report, it just surprised me that the second cpu was not online even with GENERIC.MP.
 Giovanni

Reply | Threaded
Open this post in threaded view
|

Re: second cpu not online on Vsphere 6.0 if smt is disabled

Stuart Henderson
In reply to this post by Giovanni Bechis-7
On 2019/01/21 21:27, [hidden email] wrote:

>
> Architecture: OpenBSD.amd64
> Machine     : amd64
> >Description:
> On Vsphere 6.0 an OpenBSD guest does recognizes the second cpu but it cannot put it online
>         The host uses an AMD cpu
> >How-To-Repeat:
> Start a vm on Vsphere 6.0 with smt disabled
> >Fix:
> setting hw.smt=1 is a workaround, a reboot is not needed

By "with smt disabled" are you talking about disabling vmware's smt support
(System, Advanced System Settings, VMkernel.Boot.hyperthreading) or are you
talking about changing the settings for the individual vm (Configure,
Hardware, Processors, and set as multiple cores *not* multiple "logical
processors")?

The former affects vmware's scheduler, the latter affects how the virtual
cpu layout is presented to the guest.

> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: AMD Opteron(tm) Processor 4386, 3100.71 MHz, 15-10-00
..
> cpu0: smt 0, core 0, package 0
..
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: AMD Opteron(tm) Processor 4386, 3100.73 MHz, 15-10-00
..
> cpu1: smt 1, core 0, package 0

On AMD we can't retrieve a "logical processor id" from the cpu, all we
get is the core/package number and have to imply that a second "cpu"
showing up with the same core/package number is an smt "cpu".
(On intel the relevant cpuid instruction *does* give an "smt id").

If vmware is setting this up wrong by default then you might be able to
get around it by changing the advanced option cpuid.coresPerSocket
to have them show up with a different package id (socket = package).
But make sure you're swtting them as cores/sockets not logical
processors first.

Reply | Threaded
Open this post in threaded view
|

Re: second cpu not online on Vsphere 6.0 if smt is disabled

Giovanni Bechis-7
On 1/22/19 9:37 AM, Stuart Henderson wrote:

> On 2019/01/21 21:27, [hidden email] wrote:
>>
>> Architecture: OpenBSD.amd64
>> Machine     : amd64
>>> Description:
>> On Vsphere 6.0 an OpenBSD guest does recognizes the second cpu but it cannot put it online
>>         The host uses an AMD cpu
>>> How-To-Repeat:
>> Start a vm on Vsphere 6.0 with smt disabled
>>> Fix:
>> setting hw.smt=1 is a workaround, a reboot is not needed
>
> By "with smt disabled" are you talking about disabling vmware's smt support
> (System, Advanced System Settings, VMkernel.Boot.hyperthreading) or are you
> talking about changing the settings for the individual vm (Configure,
> Hardware, Processors, and set as multiple cores *not* multiple "logical
> processors")?
>
VMkernel.Boot.hyperthreading is enabled on Vsphere, I tried setting both 2 cores with 1 logical processor and 1 core with 2 logical processor
but it acts the same.

 Giovanni

> The former affects vmware's scheduler, the latter affects how the virtual
> cpu layout is presented to the guest.
>
>> cpu0 at mainbus0: apid 0 (boot processor)
>> cpu0: AMD Opteron(tm) Processor 4386, 3100.71 MHz, 15-10-00
> ..
>> cpu0: smt 0, core 0, package 0
> ..
>> cpu1 at mainbus0: apid 1 (application processor)
>> cpu1: AMD Opteron(tm) Processor 4386, 3100.73 MHz, 15-10-00
> ..
>> cpu1: smt 1, core 0, package 0
>
> On AMD we can't retrieve a "logical processor id" from the cpu, all we
> get is the core/package number and have to imply that a second "cpu"
> showing up with the same core/package number is an smt "cpu".
> (On intel the relevant cpuid instruction *does* give an "smt id").
>
> If vmware is setting this up wrong by default then you might be able to
> get around it by changing the advanced option cpuid.coresPerSocket
> to have them show up with a different package id (socket = package).
> But make sure you're swtting them as cores/sockets not logical
> processors first.
>

Reply | Threaded
Open this post in threaded view
|

Re: second cpu not online on Vsphere 6.0 if smt is disabled

Stuart Henderson
On 2019/01/22 09:53, Giovanni Bechis wrote:

> >>> Description:
> >> On Vsphere 6.0 an OpenBSD guest does recognizes the second cpu but it cannot put it online
> >>         The host uses an AMD cpu
> >>> How-To-Repeat:
> >> Start a vm on Vsphere 6.0 with smt disabled
> >>> Fix:
> >> setting hw.smt=1 is a workaround, a reboot is not needed
> >
> > By "with smt disabled" are you talking about disabling vmware's smt support
> > (System, Advanced System Settings, VMkernel.Boot.hyperthreading) or are you
> > talking about changing the settings for the individual vm (Configure,
> > Hardware, Processors, and set as multiple cores *not* multiple "logical
> > processors")?
> >
> VMkernel.Boot.hyperthreading is enabled on Vsphere, I tried setting both 2 cores with 1 logical processor and 1 core with 2 logical processor
> but it acts the same.

Thanks, that does seem like a vmware bug then.

It's worth trying changing it to 1 core per socket, this seems more
likely to work (to my eyes it is a hack for changing the topology
presented to guest OS to "help" people with per-socket-licensed
software, so I guess vmware paying customers are more likely to
whine if it's broken ;-)