LDOM commands return Device not configured

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

LDOM commands return Device not configured

Jamie Luck

Hello,
I have a fresh install of OpenBSD/sparc64 6.7 on a Sun T1000. I
cannot use any LDOM-related commands because the hardware
device is not configured. Here are some examples:

# ldomctl list
ldomctl: cannot open /dev/hvctl: Device not configured
# ldomctl dump
ldomctl: cannot open /dev/hvctl: Device not configured

I chose default boot options for everything except the sets,
which I did not install any X11. I've been searching for other
dmesg from Sun T1-based processors on OpenBSD to see if the hardware
device is missing from my dmesg, but the only ones I can find are
from when the port was first started, nothing recent.

Here's my dmesg:

console is /virtual-devices@100/console@1
Copyright (c) 1982, 1986, 1989, 1991, 1993
        The Regents of the University of California.  All rights reserved.
Copyright (c) 1995-2020 OpenBSD. All rights reserved.  https://www.OpenBSD.org

OpenBSD 6.7 (GENERIC.MP) #310: Thu May  7 18:41:00 MDT 2020
    [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC.MP
real mem = 4286578688 (4088MB)
avail mem = 4190060544 (3995MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root: Sun Fire(TM) T1000
cpu0 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu1 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu2 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu3 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu4 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu5 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu6 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu7 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu8 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu9 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu10 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu11 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu12 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu13 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu14 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu15 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu16 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu17 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu18 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu19 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu20 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu21 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu22 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
cpu23 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
vbus0 at mainbus0
"nvram" at vbus0 not configured
vcons0 at vbus0: ivec 0x111, console
"ncp" at vbus0 not configured
vrtc0 at vbus0
"loop" at vbus0 not configured
"loop" at vbus0 not configured
"echo" at vbus0 not configured
"fma" at vbus0 not configured
"sunvts" at vbus0 not configured
"sunmc" at vbus0 not configured
"explorer" at vbus0 not configured
"led" at vbus0 not configured
"flashupdate" at vbus0 not configured
"flashprom" at vbus0 not configured
"system-management" at vbus0 not configured
vpci0 at mainbus0: bus 2 to 2, dvma map 80000000-ffffffff
pci0 at vpci0
nep0 at pci0 dev 0 function 0 "Sun Neptune" rev 0x01: msi, address 00:21:28:42:ae:1a
brgphy0 at nep0 phy 13: BCM5464 10/100/1000baseT PHY, rev. 1
nep1 at pci0 dev 0 function 1 "Sun Neptune" rev 0x01: msi, address 00:21:28:42:ae:1b
brgphy1 at nep1 phy 12: BCM5464 10/100/1000baseT PHY, rev. 1
nep2 at pci0 dev 0 function 2 "Sun Neptune" rev 0x01: msi, address 00:21:28:42:ae:1c
brgphy2 at nep2 phy 11: BCM5464 10/100/1000baseT PHY, rev. 1
nep3 at pci0 dev 0 function 3 "Sun Neptune" rev 0x01: msi, address 00:21:28:42:ae:1d
brgphy3 at nep3 phy 10: BCM5464 10/100/1000baseT PHY, rev. 1
vpci1 at mainbus0: bus 2 to 4, dvma map 80000000-ffffffff
pci1 at vpci1
ppb0 at pci1 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xb5
pci2 at ppb0 bus 3
bge0 at pci2 dev 4 function 0 "Broadcom BCM5714" rev 0xa3, BCM5715 A3 (0x9003): ivec 0x7d4, address 00:14:4f:cb:a3:e0
brgphy4 at bge0 phy 1: BCM5714 10/100/1000baseT/SX PHY, rev. 0
bge1 at pci2 dev 4 function 1 "Broadcom BCM5714" rev 0xa3, BCM5715 A3 (0x9003): ivec 0x7d5, address 00:14:4f:cb:a3:e1
brgphy5 at bge1 phy 1: BCM5714 10/100/1000baseT/SX PHY, rev. 0
ppb1 at pci2 dev 8 function 0 "ServerWorks HT-1000 PCIX" rev 0xb4
pci3 at ppb1 bus 4
bge2 at pci3 dev 1 function 0 "Broadcom BCM5704C" rev 0x10, BCM5704 B0 (0x2100): ivec 0x7c2, address 00:14:4f:cb:a3:e2
brgphy6 at bge2 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
bge3 at pci3 dev 1 function 1 "Broadcom BCM5704C" rev 0x10, BCM5704 B0 (0x2100): ivec 0x7c1, address 00:14:4f:cb:a3:e3
brgphy7 at bge3 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
mpi0 at pci3 dev 2 function 0 "Symbios Logic SAS1064" rev 0x02: msi
mpi0: UNUSED, firmware 1.10.0.0
scsibus1 at mpi0: 63 targets
sym0 at scsibus1 targ 0 lun 0: <SEAGATE, ST914603SSUN146G, 0768> naa.5000c5001328e417
sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST914603SSUN146G, 0768> naa.5000c5001328e417
sd0: 140009MB, 512 bytes/sector, 286739329 sectors
ebus0 at mainbus0
com0 at ebus0 addr c2c000-c2c007 ivec 0xa: st16650, 32 byte fifo
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
bootpath: /pci@7c0,0/pci@0,0/pci@8,0/scsi@2,0/disk@0,0
root on sd0a (60da55c27811b5e2.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted

Reply | Threaded
Open this post in threaded view
|

Re: LDOM commands return Device not configured

Andrew Grillet
Check to see if your device tree is messed up.

I found it was necessary to use OBSD 6.3 or earlier to create LDOM configs
on my T1000
You will need to restore to the factory-default config first if this is the
case.

After that you can run current versions in the Primary and all guests.

Unfortunately, in doing this, I over-wrote the evidence, and I urgently
needed the machine, so I did not go back and repeat it to obtain
debugging info.



On Fri, 31 Jul 2020 at 01:25, Jamie Luck <[hidden email]> wrote:

>
> Hello,
> I have a fresh install of OpenBSD/sparc64 6.7 on a Sun T1000. I
> cannot use any LDOM-related commands because the hardware
> device is not configured. Here are some examples:
>
> # ldomctl list
> ldomctl: cannot open /dev/hvctl: Device not configured
> # ldomctl dump
> ldomctl: cannot open /dev/hvctl: Device not configured
>
> I chose default boot options for everything except the sets,
> which I did not install any X11. I've been searching for other
> dmesg from Sun T1-based processors on OpenBSD to see if the hardware
> device is missing from my dmesg, but the only ones I can find are
> from when the port was first started, nothing recent.
>
> Here's my dmesg:
>
> console is /virtual-devices@100/console@1
> Copyright (c) 1982, 1986, 1989, 1991, 1993
>         The Regents of the University of California.  All rights reserved.
> Copyright (c) 1995-2020 OpenBSD. All rights reserved.
> https://www.OpenBSD.org
>
> OpenBSD 6.7 (GENERIC.MP) #310: Thu May  7 18:41:00 MDT 2020
>     [hidden email]:/usr/src/sys/arch/sparc64/compile/
> GENERIC.MP
> real mem = 4286578688 (4088MB)
> avail mem = 4190060544 (3995MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root: Sun Fire(TM) T1000
> cpu0 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu1 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu2 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu3 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu4 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu5 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu6 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu7 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu8 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu9 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu10 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu11 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu12 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu13 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu14 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu15 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu16 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu17 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu18 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu19 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu20 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu21 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu22 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> cpu23 at mainbus0: SUNW,UltraSPARC-T1 (rev 0.0) @ 1000 MHz
> vbus0 at mainbus0
> "nvram" at vbus0 not configured
> vcons0 at vbus0: ivec 0x111, console
> "ncp" at vbus0 not configured
> vrtc0 at vbus0
> "loop" at vbus0 not configured
> "loop" at vbus0 not configured
> "echo" at vbus0 not configured
> "fma" at vbus0 not configured
> "sunvts" at vbus0 not configured
> "sunmc" at vbus0 not configured
> "explorer" at vbus0 not configured
> "led" at vbus0 not configured
> "flashupdate" at vbus0 not configured
> "flashprom" at vbus0 not configured
> "system-management" at vbus0 not configured
> vpci0 at mainbus0: bus 2 to 2, dvma map 80000000-ffffffff
> pci0 at vpci0
> nep0 at pci0 dev 0 function 0 "Sun Neptune" rev 0x01: msi, address
> 00:21:28:42:ae:1a
> brgphy0 at nep0 phy 13: BCM5464 10/100/1000baseT PHY, rev. 1
> nep1 at pci0 dev 0 function 1 "Sun Neptune" rev 0x01: msi, address
> 00:21:28:42:ae:1b
> brgphy1 at nep1 phy 12: BCM5464 10/100/1000baseT PHY, rev. 1
> nep2 at pci0 dev 0 function 2 "Sun Neptune" rev 0x01: msi, address
> 00:21:28:42:ae:1c
> brgphy2 at nep2 phy 11: BCM5464 10/100/1000baseT PHY, rev. 1
> nep3 at pci0 dev 0 function 3 "Sun Neptune" rev 0x01: msi, address
> 00:21:28:42:ae:1d
> brgphy3 at nep3 phy 10: BCM5464 10/100/1000baseT PHY, rev. 1
> vpci1 at mainbus0: bus 2 to 4, dvma map 80000000-ffffffff
> pci1 at vpci1
> ppb0 at pci1 dev 0 function 0 "ServerWorks PCIE-PCIX" rev 0xb5
> pci2 at ppb0 bus 3
> bge0 at pci2 dev 4 function 0 "Broadcom BCM5714" rev 0xa3, BCM5715 A3
> (0x9003): ivec 0x7d4, address 00:14:4f:cb:a3:e0
> brgphy4 at bge0 phy 1: BCM5714 10/100/1000baseT/SX PHY, rev. 0
> bge1 at pci2 dev 4 function 1 "Broadcom BCM5714" rev 0xa3, BCM5715 A3
> (0x9003): ivec 0x7d5, address 00:14:4f:cb:a3:e1
> brgphy5 at bge1 phy 1: BCM5714 10/100/1000baseT/SX PHY, rev. 0
> ppb1 at pci2 dev 8 function 0 "ServerWorks HT-1000 PCIX" rev 0xb4
> pci3 at ppb1 bus 4
> bge2 at pci3 dev 1 function 0 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
> (0x2100): ivec 0x7c2, address 00:14:4f:cb:a3:e2
> brgphy6 at bge2 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
> bge3 at pci3 dev 1 function 1 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
> (0x2100): ivec 0x7c1, address 00:14:4f:cb:a3:e3
> brgphy7 at bge3 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
> mpi0 at pci3 dev 2 function 0 "Symbios Logic SAS1064" rev 0x02: msi
> mpi0: UNUSED, firmware 1.10.0.0
> scsibus1 at mpi0: 63 targets
> sym0 at scsibus1 targ 0 lun 0: <SEAGATE, ST914603SSUN146G, 0768>
> naa.5000c5001328e417
> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST914603SSUN146G, 0768>
> naa.5000c5001328e417
> sd0: 140009MB, 512 bytes/sector, 286739329 sectors
> ebus0 at mainbus0
> com0 at ebus0 addr c2c000-c2c007 ivec 0xa: st16650, 32 byte fifo
> vscsi0 at root
> scsibus2 at vscsi0: 256 targets
> softraid0 at root
> scsibus3 at softraid0: 256 targets
> bootpath: /pci@7c0,0/pci@0,0/pci@8,0/scsi@2,0/disk@0,0
> root on sd0a (60da55c27811b5e2.a) swap on sd0b dump on sd0b
> WARNING: / was not properly unmounted
>
>
Reply | Threaded
Open this post in threaded view
|

Re: LDOM commands return Device not configured

Jamie Luck
Hey Andrew, thanks for the reply.

> I found it was necessary to use OBSD 6.3 or earlier to create LDOM configs on my T1000
> You will need to restore to the factory-default config first if this is the case.

I gave OpenBSD 6.3 a try, but I got the same results as with 6.7:

# ldomctl dump
ldomctl: cannot open /dev/hvctl: Device not configured
# ldomctl list
ldomctl: cannot open /dev/hvctl: Device not configured
# uname -a
OpenBSD terminator.local 6.3 GENERIC.MP#486 sparc64

Do you know of a more low-level way to read the contents of the
NVRAM? I've tried to reset it a few times but it doesn't seem
to have have an effect.

I'm also curious about how to probe the device for the presence
of the sun4v hypervisor hardware- it doesn't report any faults
from extended POST so I'm sure it's there, just not being
recognized.