sunfire v120 gem interfaces

classic Classic list List threaded Threaded
11 messages Options
Reply | Threaded
Open this post in threaded view
|

sunfire v120 gem interfaces

Ryan Freeman
Hey tech@,

At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
Quite excited to have some non x86 hardware, I set it up as a router.

However, for some reason after sometimes mere hours -- othertimes days at a
time,  the gem0 interface needs to be cycled:

ifconfig gem0 down
ifconfig gem0 up
dhclient gem0

no packets pass until that has been done.   At first I have been placing the
blame squarely on the Hitron modem we have in the house from shaw cable,
but now I've noticed the issue happen twice on the internal interface as well,
gem1.  All VLANs I have setup stop responding until gem1 is cycled.

gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
immediately after interface gem1 down/up.

I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
has been nothing of interest there.   Dmesg attached,  starting to wonder
if this machine is at its EOL and the network ports are dying :(

This issue occurred with the 5.7 release as well.

dmesg:
console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
Copyright (c) 1982, 1986, 1989, 1991, 1993
        The Regents of the University of California.  All rights reserved.
Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org

OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
    [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
real mem = 1073741824 (1024MB)
avail mem = 1039228928 (991MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
psycho0: bus range 0-2, PCI bus 0
psycho0: dvma map c0000000-dfffffff
pci0 at psycho0
ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
pci1 at ppb0 bus 1
ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
"flashprom" at ebus0 addr 0-fffff not configured
clock1 at ebus0 addr 0-1fff: mk48t59
lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
iic0 at alipm0
"max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
power0 at ebus1 addr 2000-2007 ivec 0x25
com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
com0: console
com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
pciide0: using ivec 0x7cc for native-PCI interrupt
atapiscsi0 at pciide0 channel 0 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
pciide0: channel 1 disabled (no drives)
gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
usb0 at ohci0: USB revision 1.0
uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
usb1 at ohci1: USB revision 1.0
uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
pci2 at ppb1 bus 2
siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
scsibus2 at siop0: 16 targets, initiator 7
sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
sd0: 34732MB, 512 bytes/sector, 71132959 sectors
probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
    SENSE KEY: Hardware Error
     ASC/ASCQ: Defect List Error
     FRU CODE: 0x7
sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
scsibus3 at siop1: 16 targets, initiator 7
siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
vscsi0 at root
scsibus4 at vscsi0: 256 targets
softraid0 at root
scsibus5 at softraid0: 256 targets
siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

David Gwynne-5
can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?

cheers,
dlg

> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
>
> Hey tech@,
>
> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
> Quite excited to have some non x86 hardware, I set it up as a router.
>
> However, for some reason after sometimes mere hours -- othertimes days at a
> time,  the gem0 interface needs to be cycled:
>
> ifconfig gem0 down
> ifconfig gem0 up
> dhclient gem0
>
> no packets pass until that has been done.   At first I have been placing the
> blame squarely on the Hitron modem we have in the house from shaw cable,
> but now I've noticed the issue happen twice on the internal interface as well,
> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
>
> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
> immediately after interface gem1 down/up.
>
> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
> has been nothing of interest there.   Dmesg attached,  starting to wonder
> if this machine is at its EOL and the network ports are dying :(
>
> This issue occurred with the 5.7 release as well.
>
> dmesg:
> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
> Copyright (c) 1982, 1986, 1989, 1991, 1993
>        The Regents of the University of California.  All rights reserved.
> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
>
> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
>    [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
> real mem = 1073741824 (1024MB)
> avail mem = 1039228928 (991MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
> psycho0: bus range 0-2, PCI bus 0
> psycho0: dvma map c0000000-dfffffff
> pci0 at psycho0
> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
> pci1 at ppb0 bus 1
> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
> "flashprom" at ebus0 addr 0-fffff not configured
> clock1 at ebus0 addr 0-1fff: mk48t59
> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
> iic0 at alipm0
> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
> power0 at ebus1 addr 2000-2007 ivec 0x25
> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
> com0: console
> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
> pciide0: using ivec 0x7cc for native-PCI interrupt
> atapiscsi0 at pciide0 channel 0 drive 0
> scsibus1 at atapiscsi0: 2 targets
> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
> pciide0: channel 1 disabled (no drives)
> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
> usb0 at ohci0: USB revision 1.0
> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> usb1 at ohci1: USB revision 1.0
> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
> pci2 at ppb1 bus 2
> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> scsibus2 at siop0: 16 targets, initiator 7
> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
>    SENSE KEY: Hardware Error
>     ASC/ASCQ: Defect List Error
>     FRU CODE: 0x7
> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> scsibus3 at siop1: 16 targets, initiator 7
> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> vscsi0 at root
> scsibus4 at vscsi0: 256 targets
> softraid0 at root
> scsibus5 at softraid0: 256 targets
> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Ryan Freeman
On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
>
> cheers,
> dlg

Thanks David,

I have setup a script to try and capture this immediately when it happens.

FWIW here is the output as it is now, working:

16:35 ryan@void:~$ ifconfig
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
        priority: 0
        groups: lo
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
        inet6 ::1 prefixlen 128
        inet 127.0.0.1 netmask 0xff000000
gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:70
        priority: 0
        groups: egress
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:71
        priority: 0
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
        inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
        inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
        inet6 2001:470:b:6cf::1 prefixlen 64
enc0: flags=0<>
        priority: 0
        groups: enc
        status: active
vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:71
        description: servers
        priority: 0
        vlan: 100 parent interface: gem1
        groups: vlan
        status: active
        inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
        inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
        inet6 2001:470:eac8:666::1 prefixlen 64
vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:71
        description: workstations
        priority: 0
        vlan: 101 parent interface: gem1
        groups: vlan
        status: active
        inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
        inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
        inet6 2001:470:eac8:a::1 prefixlen 64
vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:71
        description: wireless
        priority: 0
        vlan: 102 parent interface: gem1
        groups: vlan
        status: active
        inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
        inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
        inet6 2001:470:eac8:b::1 prefixlen 64
vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:71
        description: transit
        priority: 0
        vlan: 2 parent interface: gem1
        groups: vlan
        status: active
        inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
        priority: 0
        groups: tun
        status: down
        inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
        priority: 0
        groups: gif egress
        tunnel: inet 96.54.13.103 -> 216.218.226.238
        inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
        inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
pflow0: flags=41<UP,RUNNING> mtu 1492
        priority: 0
        pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
        groups: pflow
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
        priority: 0
        groups: pflog

16:36 ryan@void:~$ systat -b mb
    8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015

IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
System                    0   256    48         129                            
                             2048    24        1025                            
lo0                                                                            
gem0                         2048    11     4   124    11                      
gem1                         2048    12     4   124    12                      
enc0                                                                            
vlan100                                                                        
vlan101                                                                        
vlan102                                                                        
vlan2                                                                          
tun0                                                                            
gif0                                                                            
pflow0                                                                          
pflog0  

>
> > On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
> >
> > Hey tech@,
> >
> > At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
> > Quite excited to have some non x86 hardware, I set it up as a router.
> >
> > However, for some reason after sometimes mere hours -- othertimes days at a
> > time,  the gem0 interface needs to be cycled:
> >
> > ifconfig gem0 down
> > ifconfig gem0 up
> > dhclient gem0
> >
> > no packets pass until that has been done.   At first I have been placing the
> > blame squarely on the Hitron modem we have in the house from shaw cable,
> > but now I've noticed the issue happen twice on the internal interface as well,
> > gem1.  All VLANs I have setup stop responding until gem1 is cycled.
> >
> > gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
> > immediately after interface gem1 down/up.
> >
> > I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
> > has been nothing of interest there.   Dmesg attached,  starting to wonder
> > if this machine is at its EOL and the network ports are dying :(
> >
> > This issue occurred with the 5.7 release as well.
> >
> > dmesg:
> > console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
> > Copyright (c) 1982, 1986, 1989, 1991, 1993
> >        The Regents of the University of California.  All rights reserved.
> > Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
> >
> > OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
> >    [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
> > real mem = 1073741824 (1024MB)
> > avail mem = 1039228928 (991MB)
> > mpath0 at root
> > scsibus0 at mpath0: 256 targets
> > mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
> > cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
> > cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
> > psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
> > psycho0: bus range 0-2, PCI bus 0
> > psycho0: dvma map c0000000-dfffffff
> > pci0 at psycho0
> > ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
> > pci1 at ppb0 bus 1
> > ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
> > "flashprom" at ebus0 addr 0-fffff not configured
> > clock1 at ebus0 addr 0-1fff: mk48t59
> > lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
> > alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
> > iic0 at alipm0
> > "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
> > spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
> > spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
> > ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
> > power0 at ebus1 addr 2000-2007 ivec 0x25
> > com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
> > com0: console
> > com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
> > gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
> > ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> > ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
> > pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
> > pciide0: using ivec 0x7cc for native-PCI interrupt
> > atapiscsi0 at pciide0 channel 0 drive 0
> > scsibus1 at atapiscsi0: 2 targets
> > cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
> > cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
> > pciide0: channel 1 disabled (no drives)
> > gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
> > ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> > ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
> > usb0 at ohci0: USB revision 1.0
> > uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> > usb1 at ohci1: USB revision 1.0
> > uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> > ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
> > pci2 at ppb1 bus 2
> > siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> > scsibus2 at siop0: 16 targets, initiator 7
> > sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> > sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> > sd0: 34732MB, 512 bytes/sector, 71132959 sectors
> > probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
> >    SENSE KEY: Hardware Error
> >     ASC/ASCQ: Defect List Error
> >     FRU CODE: 0x7
> > sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> > sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> > siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> > scsibus3 at siop1: 16 targets, initiator 7
> > siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> > vscsi0 at root
> > scsibus4 at vscsi0: 256 targets
> > softraid0 at root
> > scsibus5 at softraid0: 256 targets
> > siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> > bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
> > root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
> >
>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Alexander Hall
In reply to this post by Ryan Freeman
I had problems with my dual AC200 carp setup, in that the interfaces would periodically stop receiving packets. Transmission still worked though, so the carp wouldn't fail over...

Machines are retired now, but I believe details exist in the archives somewhere. I also believe henning@ had similar issues in the past.

/Alexander

On November 9, 2015 12:36:33 AM GMT+01:00, Ryan Freeman <[hidden email]> wrote:

>Hey tech@,
>
>At my wits end here, I recently got a sunfire v120 from work for pretty
>cheap.
>Quite excited to have some non x86 hardware, I set it up as a router.
>
>However, for some reason after sometimes mere hours -- othertimes days
>at a
>time,  the gem0 interface needs to be cycled:
>
>ifconfig gem0 down
>ifconfig gem0 up
>dhclient gem0
>
>no packets pass until that has been done.   At first I have been
>placing the
>blame squarely on the Hitron modem we have in the house from shaw
>cable,
>but now I've noticed the issue happen twice on the internal interface
>as well,
>gem1.  All VLANs I have setup stop responding until gem1 is cycled.
>
>gem1 is just used by a collection of vlan(4) interfaces, so traffic
>resumes
>immediately after interface gem1 down/up.
>
>I've tried to turn on ifconfig gem0 debug to catch anything wierd, but
>there
>has been nothing of interest there.   Dmesg attached,  starting to
>wonder
>if this machine is at its EOL and the network ports are dying :(
>
>This issue occurred with the 5.7 release as well.
>
>dmesg:
>console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
>Copyright (c) 1982, 1986, 1989, 1991, 1993
>     The Regents of the University of California.  All rights reserved.
>Copyright (c) 1995-2015 OpenBSD. All rights reserved.
>http://www.OpenBSD.org
>
>OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
>    [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
>real mem = 1073741824 (1024MB)
>avail mem = 1039228928 (991MB)
>mpath0 at root
>scsibus0 at mpath0: 256 targets
>mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
>cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
>cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K
>external (64 b/l)
>psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
>psycho0: bus range 0-2, PCI bus 0
>psycho0: dvma map c0000000-dfffffff
>pci0 at psycho0
>ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
>pci1 at ppb0 bus 1
>ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
>"flashprom" at ebus0 addr 0-fffff not configured
>clock1 at ebus0 addr 0-1fff: mk48t59
>lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
>alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz
>clock
>iic0 at alipm0
>"max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
>spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
>spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
>ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
>power0 at ebus1 addr 2000-2007 ivec 0x25
>com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
>com0: console
>com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
>gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6,
>address 00:03:ba:2b:47:70
>ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI
>0x0010dd, model 0x0002
>ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version
>1.0, legacy support
>pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3:
>DMA, channel 0 configured to native-PCI, channel 1 configured to
>native-PCI
>pciide0: using ivec 0x7cc for native-PCI interrupt
>atapiscsi0 at pciide0 channel 0 drive 0
>scsibus1 at atapiscsi0: 2 targets
>cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom
>removable
>cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
>pciide0: channel 1 disabled (no drives)
>gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc,
>address 00:03:ba:2b:47:71
>ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI
>0x0010dd, model 0x0002
>ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version
>1.0, legacy support
>usb0 at ohci0: USB revision 1.0
>uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
>usb1 at ohci1: USB revision 1.0
>uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
>ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
>pci2 at ppb1 bus 2
>siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec
>0x7e0, using 8K of on-board RAM
>scsibus2 at siop0: 16 targets, initiator 7
>sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3
>0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
>sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3
>0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
>sd0: 34732MB, 512 bytes/sector, 71132959 sectors
>probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
>    SENSE KEY: Hardware Error
>     ASC/ASCQ: Defect List Error
>     FRU CODE: 0x7
>sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3
>0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
>sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3
>0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
>siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec
>0x7e0, using 8K of on-board RAM
>scsibus3 at siop1: 16 targets, initiator 7
>siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset
>xfers
>vscsi0 at root
>scsibus4 at vscsi0: 256 targets
>softraid0 at root
>scsibus5 at softraid0: 256 targets
>siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset
>xfers
>bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
>root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Christian Weisgerber
In reply to this post by Ryan Freeman
Ryan Freeman:

> However, for some reason after sometimes mere hours -- othertimes days at a
> time,  the gem0 interface needs to be cycled: [...] starting to wonder
> if this machine is at its EOL and the network ports are dying :(

I see the same problem with the gem in my Blade 150.

--
Christian "naddy" Weisgerber                          [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

David Gwynne-5
In reply to this post by Ryan Freeman
any joy? i mean, failure?

> On 9 Nov 2015, at 10:40 AM, Ryan Freeman <[hidden email]> wrote:
>
> On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
>> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
>>
>> cheers,
>> dlg
>
> Thanks David,
>
> I have setup a script to try and capture this immediately when it happens.
>
> FWIW here is the output as it is now, working:
>
> 16:35 ryan@void:~$ ifconfig
> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
>        priority: 0
>        groups: lo
>        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
>        inet6 ::1 prefixlen 128
>        inet 127.0.0.1 netmask 0xff000000
> gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:03:ba:2b:47:70
>        priority: 0
>        groups: egress
>        media: Ethernet autoselect (100baseTX full-duplex)
>        status: active
>        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
> gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:03:ba:2b:47:71
>        priority: 0
>        media: Ethernet autoselect (100baseTX full-duplex)
>        status: active
>        inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
>        inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
>        inet6 2001:470:b:6cf::1 prefixlen 64
> enc0: flags=0<>
>        priority: 0
>        groups: enc
>        status: active
> vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:03:ba:2b:47:71
>        description: servers
>        priority: 0
>        vlan: 100 parent interface: gem1
>        groups: vlan
>        status: active
>        inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
>        inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
>        inet6 2001:470:eac8:666::1 prefixlen 64
> vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:03:ba:2b:47:71
>        description: workstations
>        priority: 0
>        vlan: 101 parent interface: gem1
>        groups: vlan
>        status: active
>        inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
>        inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
>        inet6 2001:470:eac8:a::1 prefixlen 64
> vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:03:ba:2b:47:71
>        description: wireless
>        priority: 0
>        vlan: 102 parent interface: gem1
>        groups: vlan
>        status: active
>        inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
>        inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
>        inet6 2001:470:eac8:b::1 prefixlen 64
> vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:03:ba:2b:47:71
>        description: transit
>        priority: 0
>        vlan: 2 parent interface: gem1
>        groups: vlan
>        status: active
>        inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
> tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
>        priority: 0
>        groups: tun
>        status: down
>        inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
> gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
>        priority: 0
>        groups: gif egress
>        tunnel: inet 96.54.13.103 -> 216.218.226.238
>        inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
>        inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
> pflow0: flags=41<UP,RUNNING> mtu 1492
>        priority: 0
>        pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
>        groups: pflow
> pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
>        priority: 0
>        groups: pflog
>
> 16:36 ryan@void:~$ systat -b mb
>    8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015
>
> IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
> System                    0   256    48         129                            
>                             2048    24        1025                            
> lo0                                                                            
> gem0                         2048    11     4   124    11                      
> gem1                         2048    12     4   124    12                      
> enc0                                                                            
> vlan100                                                                        
> vlan101                                                                        
> vlan102                                                                        
> vlan2                                                                          
> tun0                                                                            
> gif0                                                                            
> pflow0                                                                          
> pflog0  
>
>>
>>> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
>>>
>>> Hey tech@,
>>>
>>> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
>>> Quite excited to have some non x86 hardware, I set it up as a router.
>>>
>>> However, for some reason after sometimes mere hours -- othertimes days at a
>>> time,  the gem0 interface needs to be cycled:
>>>
>>> ifconfig gem0 down
>>> ifconfig gem0 up
>>> dhclient gem0
>>>
>>> no packets pass until that has been done.   At first I have been placing the
>>> blame squarely on the Hitron modem we have in the house from shaw cable,
>>> but now I've noticed the issue happen twice on the internal interface as well,
>>> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
>>>
>>> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
>>> immediately after interface gem1 down/up.
>>>
>>> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
>>> has been nothing of interest there.   Dmesg attached,  starting to wonder
>>> if this machine is at its EOL and the network ports are dying :(
>>>
>>> This issue occurred with the 5.7 release as well.
>>>
>>> dmesg:
>>> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
>>> Copyright (c) 1982, 1986, 1989, 1991, 1993
>>>       The Regents of the University of California.  All rights reserved.
>>> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
>>>
>>> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
>>>   [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
>>> real mem = 1073741824 (1024MB)
>>> avail mem = 1039228928 (991MB)
>>> mpath0 at root
>>> scsibus0 at mpath0: 256 targets
>>> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
>>> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
>>> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
>>> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
>>> psycho0: bus range 0-2, PCI bus 0
>>> psycho0: dvma map c0000000-dfffffff
>>> pci0 at psycho0
>>> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
>>> pci1 at ppb0 bus 1
>>> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
>>> "flashprom" at ebus0 addr 0-fffff not configured
>>> clock1 at ebus0 addr 0-1fff: mk48t59
>>> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
>>> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
>>> iic0 at alipm0
>>> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
>>> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
>>> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
>>> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
>>> power0 at ebus1 addr 2000-2007 ivec 0x25
>>> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
>>> com0: console
>>> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
>>> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
>>> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
>>> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
>>> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
>>> pciide0: using ivec 0x7cc for native-PCI interrupt
>>> atapiscsi0 at pciide0 channel 0 drive 0
>>> scsibus1 at atapiscsi0: 2 targets
>>> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
>>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
>>> pciide0: channel 1 disabled (no drives)
>>> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
>>> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
>>> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
>>> usb0 at ohci0: USB revision 1.0
>>> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
>>> usb1 at ohci1: USB revision 1.0
>>> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
>>> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
>>> pci2 at ppb1 bus 2
>>> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
>>> scsibus2 at siop0: 16 targets, initiator 7
>>> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
>>> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
>>> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
>>> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
>>>   SENSE KEY: Hardware Error
>>>    ASC/ASCQ: Defect List Error
>>>    FRU CODE: 0x7
>>> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
>>> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
>>> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
>>> scsibus3 at siop1: 16 targets, initiator 7
>>> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
>>> vscsi0 at root
>>> scsibus4 at vscsi0: 256 targets
>>> softraid0 at root
>>> scsibus5 at softraid0: 256 targets
>>> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
>>> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
>>> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
>>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Ryan Freeman
On Tue, Nov 10, 2015 at 08:27:36PM +1000, David Gwynne wrote:
> any joy? i mean, failure?

Last night my script triggered three times, hooray ;)

unfortunately my eyes do not even notice much of a difference outside of
system load values in the systat output :(

gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:70
        priority: 0
        groups: egress
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:70
        priority: 0
        groups: egress
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:03:ba:2b:47:70
        priority: 0
        groups: egress
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
#

    8 users    Load 0.69 0.43 0.29                     Mon Nov  9 20:31:11 2015

IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
System                    0   256    56         129                            
                             2048    32        1025                            
lo0                                                                            
gem0                         2048    18     4   124    18                      
gem1                         2048    12     4   124    12                      
enc0                                                                            
vlan100                                                                        
vlan101                                                                        
vlan102                                                                        
vlan2                                                                          
tun0                                                                            
gif0                                                                            
pflow0                                                                          
pflog0                                                                          


    8 users    Load 0.44 0.39 0.29                     Mon Nov  9 20:32:11 2015

IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
System                    0   256    52         129                            
                             2048    25        1025                            
lo0                                                                            
gem0                         2048    11     4   124    11                      
gem1                         2048    12     4   124    12                      
enc0                                                                            
vlan100                                                                        
vlan101                                                                        
vlan102                                                                        
vlan2                                                                          
tun0                                                                            
gif0                                                                            
pflow0                                                                          
pflog0                                                                          


    8 users    Load 0.11 0.18 0.16                     Mon Nov  9 21:54:11 2015

IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
System                    0   256    55         129                            
                             2048    28        1025                            
lo0                                                                            
gem0                         2048    18     4   124    18                      
gem1                         2048    10     4   124    10                      
enc0                                                                            
vlan100                                                                        
vlan101                                                                        
vlan102                                                                        
vlan2                                                                          
tun0                                                                            
gif0                                                                            
pflow0                                                                          
pflog0      

>
> > On 9 Nov 2015, at 10:40 AM, Ryan Freeman <[hidden email]> wrote:
> >
> > On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
> >> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
> >>
> >> cheers,
> >> dlg
> >
> > Thanks David,
> >
> > I have setup a script to try and capture this immediately when it happens.
> >
> > FWIW here is the output as it is now, working:
> >
> > 16:35 ryan@void:~$ ifconfig
> > lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
> >        priority: 0
> >        groups: lo
> >        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
> >        inet6 ::1 prefixlen 128
> >        inet 127.0.0.1 netmask 0xff000000
> > gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:70
> >        priority: 0
> >        groups: egress
> >        media: Ethernet autoselect (100baseTX full-duplex)
> >        status: active
> >        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
> > gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        priority: 0
> >        media: Ethernet autoselect (100baseTX full-duplex)
> >        status: active
> >        inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
> >        inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
> >        inet6 2001:470:b:6cf::1 prefixlen 64
> > enc0: flags=0<>
> >        priority: 0
> >        groups: enc
> >        status: active
> > vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: servers
> >        priority: 0
> >        vlan: 100 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
> >        inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
> >        inet6 2001:470:eac8:666::1 prefixlen 64
> > vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: workstations
> >        priority: 0
> >        vlan: 101 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
> >        inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
> >        inet6 2001:470:eac8:a::1 prefixlen 64
> > vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: wireless
> >        priority: 0
> >        vlan: 102 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
> >        inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
> >        inet6 2001:470:eac8:b::1 prefixlen 64
> > vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: transit
> >        priority: 0
> >        vlan: 2 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
> > tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
> >        priority: 0
> >        groups: tun
> >        status: down
> >        inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
> > gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
> >        priority: 0
> >        groups: gif egress
> >        tunnel: inet 96.54.13.103 -> 216.218.226.238
> >        inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
> >        inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
> > pflow0: flags=41<UP,RUNNING> mtu 1492
> >        priority: 0
> >        pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
> >        groups: pflow
> > pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
> >        priority: 0
> >        groups: pflog
> >
> > 16:36 ryan@void:~$ systat -b mb
> >    8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015
> >
> > IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
> > System                    0   256    48         129                            
> >                             2048    24        1025                            
> > lo0                                                                            
> > gem0                         2048    11     4   124    11                      
> > gem1                         2048    12     4   124    12                      
> > enc0                                                                            
> > vlan100                                                                        
> > vlan101                                                                        
> > vlan102                                                                        
> > vlan2                                                                          
> > tun0                                                                            
> > gif0                                                                            
> > pflow0                                                                          
> > pflog0  
> >
> >>
> >>> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
> >>>
> >>> Hey tech@,
> >>>
> >>> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
> >>> Quite excited to have some non x86 hardware, I set it up as a router.
> >>>
> >>> However, for some reason after sometimes mere hours -- othertimes days at a
> >>> time,  the gem0 interface needs to be cycled:
> >>>
> >>> ifconfig gem0 down
> >>> ifconfig gem0 up
> >>> dhclient gem0
> >>>
> >>> no packets pass until that has been done.   At first I have been placing the
> >>> blame squarely on the Hitron modem we have in the house from shaw cable,
> >>> but now I've noticed the issue happen twice on the internal interface as well,
> >>> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
> >>>
> >>> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
> >>> immediately after interface gem1 down/up.
> >>>
> >>> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
> >>> has been nothing of interest there.   Dmesg attached,  starting to wonder
> >>> if this machine is at its EOL and the network ports are dying :(
> >>>
> >>> This issue occurred with the 5.7 release as well.
> >>>
> >>> dmesg:
> >>> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
> >>> Copyright (c) 1982, 1986, 1989, 1991, 1993
> >>>       The Regents of the University of California.  All rights reserved.
> >>> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
> >>>
> >>> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
> >>>   [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
> >>> real mem = 1073741824 (1024MB)
> >>> avail mem = 1039228928 (991MB)
> >>> mpath0 at root
> >>> scsibus0 at mpath0: 256 targets
> >>> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
> >>> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
> >>> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
> >>> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
> >>> psycho0: bus range 0-2, PCI bus 0
> >>> psycho0: dvma map c0000000-dfffffff
> >>> pci0 at psycho0
> >>> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
> >>> pci1 at ppb0 bus 1
> >>> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
> >>> "flashprom" at ebus0 addr 0-fffff not configured
> >>> clock1 at ebus0 addr 0-1fff: mk48t59
> >>> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
> >>> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
> >>> iic0 at alipm0
> >>> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
> >>> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
> >>> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
> >>> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
> >>> power0 at ebus1 addr 2000-2007 ivec 0x25
> >>> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
> >>> com0: console
> >>> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
> >>> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
> >>> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
> >>> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
> >>> pciide0: using ivec 0x7cc for native-PCI interrupt
> >>> atapiscsi0 at pciide0 channel 0 drive 0
> >>> scsibus1 at atapiscsi0: 2 targets
> >>> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
> >>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
> >>> pciide0: channel 1 disabled (no drives)
> >>> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
> >>> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
> >>> usb0 at ohci0: USB revision 1.0
> >>> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>> usb1 at ohci1: USB revision 1.0
> >>> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
> >>> pci2 at ppb1 bus 2
> >>> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>> scsibus2 at siop0: 16 targets, initiator 7
> >>> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
> >>> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
> >>>   SENSE KEY: Hardware Error
> >>>    ASC/ASCQ: Defect List Error
> >>>    FRU CODE: 0x7
> >>> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>> scsibus3 at siop1: 16 targets, initiator 7
> >>> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>> vscsi0 at root
> >>> scsibus4 at vscsi0: 256 targets
> >>> softraid0 at root
> >>> scsibus5 at softraid0: 256 targets
> >>> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
> >>> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
> >>>
> >>
>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Ryan Freeman
In reply to this post by David Gwynne-5
On Tue, Nov 10, 2015 at 08:27:36PM +1000, David Gwynne wrote:
> any joy? i mean, failure?

Well I got something different.  I've noticed the failures only seem to happen
when my roommates arrive home.  I can use my stuff remotely all day from work
without a hitch, roommates come home and usually within an hr there is an
internet complaint.

Since I started using the little scripts to detect connection failure
and down/up the iface in question, things had been pretty good simply in the
fact that nobody could really notice before it fixed itself.

Today the machine dropped to ddb>!  of course i couldn't remember a damn
thing to type :(  i got trace, terribly sorry it wasn't more...

ddb> trace
extent_free(400012600c0, 0, 0, 0, 1fe0000f078, 800012fa00000000) at extent_free
+0x174
iommu_dvmamap_unload(40001266300, 0, 4000129f080, 0, 0, 2) at iommu_dvmamap_unl
oad+0x74
gem_rint(400014ac000, 40016ff0000, 7fff0000, e0017c48, 4000000000000000, 800000
00) at gem_rint+0x160
gem_intr(400014ac000, c00ca000, 2000, 0, 0, 80000000) at gem_intr+0x154
intr_handler(e0017ec8, 4000117ae00, 4bca3020, 0, 800, 2) at intr_handler+0xc
sparc_interrupt(0, 400014b0000, 80206910, 400171b7c60, 40009ec0810, 0) at sparc
_interrupt+0x298
gem_ioctl(400014ac048, 400014ac000, 400171b7c60, 400171b7c60, 0, 40009b73c10) a
t gem_ioctl+0x19c
ifioctl(0, 80206910, 400171b7c60, 40009b73c10, 1012d74, 0) at ifioctl+0x38c
sys_ioctl(0, 400171b7db8, 400171b7df8, 0, 0, 14b) at sys_ioctl+0x190
syscall(400171b7ed0, 436, bec8920888, bec892088c, 0, 0) at syscall+0x3c4
softtrap(3, 80206910, fffffffffffe3018, 0, 0, 1ff7fff6df8) at softtrap+0x19c
ddb>



>
> > On 9 Nov 2015, at 10:40 AM, Ryan Freeman <[hidden email]> wrote:
> >
> > On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
> >> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
> >>
> >> cheers,
> >> dlg
> >
> > Thanks David,
> >
> > I have setup a script to try and capture this immediately when it happens.
> >
> > FWIW here is the output as it is now, working:
> >
> > 16:35 ryan@void:~$ ifconfig
> > lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
> >        priority: 0
> >        groups: lo
> >        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
> >        inet6 ::1 prefixlen 128
> >        inet 127.0.0.1 netmask 0xff000000
> > gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:70
> >        priority: 0
> >        groups: egress
> >        media: Ethernet autoselect (100baseTX full-duplex)
> >        status: active
> >        inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
> > gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        priority: 0
> >        media: Ethernet autoselect (100baseTX full-duplex)
> >        status: active
> >        inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
> >        inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
> >        inet6 2001:470:b:6cf::1 prefixlen 64
> > enc0: flags=0<>
> >        priority: 0
> >        groups: enc
> >        status: active
> > vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: servers
> >        priority: 0
> >        vlan: 100 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
> >        inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
> >        inet6 2001:470:eac8:666::1 prefixlen 64
> > vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: workstations
> >        priority: 0
> >        vlan: 101 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
> >        inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
> >        inet6 2001:470:eac8:a::1 prefixlen 64
> > vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: wireless
> >        priority: 0
> >        vlan: 102 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
> >        inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
> >        inet6 2001:470:eac8:b::1 prefixlen 64
> > vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >        lladdr 00:03:ba:2b:47:71
> >        description: transit
> >        priority: 0
> >        vlan: 2 parent interface: gem1
> >        groups: vlan
> >        status: active
> >        inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
> > tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
> >        priority: 0
> >        groups: tun
> >        status: down
> >        inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
> > gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
> >        priority: 0
> >        groups: gif egress
> >        tunnel: inet 96.54.13.103 -> 216.218.226.238
> >        inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
> >        inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
> > pflow0: flags=41<UP,RUNNING> mtu 1492
> >        priority: 0
> >        pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
> >        groups: pflow
> > pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
> >        priority: 0
> >        groups: pflog
> >
> > 16:36 ryan@void:~$ systat -b mb
> >    8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015
> >
> > IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
> > System                    0   256    48         129                            
> >                             2048    24        1025                            
> > lo0                                                                            
> > gem0                         2048    11     4   124    11                      
> > gem1                         2048    12     4   124    12                      
> > enc0                                                                            
> > vlan100                                                                        
> > vlan101                                                                        
> > vlan102                                                                        
> > vlan2                                                                          
> > tun0                                                                            
> > gif0                                                                            
> > pflow0                                                                          
> > pflog0  
> >
> >>
> >>> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
> >>>
> >>> Hey tech@,
> >>>
> >>> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
> >>> Quite excited to have some non x86 hardware, I set it up as a router.
> >>>
> >>> However, for some reason after sometimes mere hours -- othertimes days at a
> >>> time,  the gem0 interface needs to be cycled:
> >>>
> >>> ifconfig gem0 down
> >>> ifconfig gem0 up
> >>> dhclient gem0
> >>>
> >>> no packets pass until that has been done.   At first I have been placing the
> >>> blame squarely on the Hitron modem we have in the house from shaw cable,
> >>> but now I've noticed the issue happen twice on the internal interface as well,
> >>> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
> >>>
> >>> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
> >>> immediately after interface gem1 down/up.
> >>>
> >>> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
> >>> has been nothing of interest there.   Dmesg attached,  starting to wonder
> >>> if this machine is at its EOL and the network ports are dying :(
> >>>
> >>> This issue occurred with the 5.7 release as well.
> >>>
> >>> dmesg:
> >>> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
> >>> Copyright (c) 1982, 1986, 1989, 1991, 1993
> >>>       The Regents of the University of California.  All rights reserved.
> >>> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
> >>>
> >>> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
> >>>   [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
> >>> real mem = 1073741824 (1024MB)
> >>> avail mem = 1039228928 (991MB)
> >>> mpath0 at root
> >>> scsibus0 at mpath0: 256 targets
> >>> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
> >>> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
> >>> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
> >>> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
> >>> psycho0: bus range 0-2, PCI bus 0
> >>> psycho0: dvma map c0000000-dfffffff
> >>> pci0 at psycho0
> >>> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
> >>> pci1 at ppb0 bus 1
> >>> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
> >>> "flashprom" at ebus0 addr 0-fffff not configured
> >>> clock1 at ebus0 addr 0-1fff: mk48t59
> >>> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
> >>> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
> >>> iic0 at alipm0
> >>> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
> >>> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
> >>> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
> >>> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
> >>> power0 at ebus1 addr 2000-2007 ivec 0x25
> >>> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
> >>> com0: console
> >>> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
> >>> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
> >>> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
> >>> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
> >>> pciide0: using ivec 0x7cc for native-PCI interrupt
> >>> atapiscsi0 at pciide0 channel 0 drive 0
> >>> scsibus1 at atapiscsi0: 2 targets
> >>> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
> >>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
> >>> pciide0: channel 1 disabled (no drives)
> >>> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
> >>> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
> >>> usb0 at ohci0: USB revision 1.0
> >>> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>> usb1 at ohci1: USB revision 1.0
> >>> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
> >>> pci2 at ppb1 bus 2
> >>> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>> scsibus2 at siop0: 16 targets, initiator 7
> >>> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
> >>> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
> >>>   SENSE KEY: Hardware Error
> >>>    ASC/ASCQ: Defect List Error
> >>>    FRU CODE: 0x7
> >>> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>> scsibus3 at siop1: 16 targets, initiator 7
> >>> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>> vscsi0 at root
> >>> scsibus4 at vscsi0: 256 targets
> >>> softraid0 at root
> >>> scsibus5 at softraid0: 256 targets
> >>> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
> >>> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
> >>>
> >>
>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

David Gwynne-5

> On 13 Nov 2015, at 12:16, Ryan Freeman <[hidden email]> wrote:
>
> On Tue, Nov 10, 2015 at 08:27:36PM +1000, David Gwynne wrote:
>> any joy? i mean, failure?
>
> Well I got something different.  I've noticed the failures only seem to happen
> when my roommates arrive home.  I can use my stuff remotely all day from work
> without a hitch, roommates come home and usually within an hr there is an
> internet complaint.
>
> Since I started using the little scripts to detect connection failure
> and down/up the iface in question, things had been pretty good simply in the
> fact that nobody could really notice before it fixed itself.
>
> Today the machine dropped to ddb>!  of course i couldn't remember a damn
> thing to type :(  i got trace, terribly sorry it wasn't more...
>
> ddb> trace
> extent_free(400012600c0, 0, 0, 0, 1fe0000f078, 800012fa00000000) at extent_free
> +0x174
> iommu_dvmamap_unload(40001266300, 0, 4000129f080, 0, 0, 2) at iommu_dvmamap_unl
> oad+0x74
> gem_rint(400014ac000, 40016ff0000, 7fff0000, e0017c48, 4000000000000000, 800000
> 00) at gem_rint+0x160
> gem_intr(400014ac000, c00ca000, 2000, 0, 0, 80000000) at gem_intr+0x154
> intr_handler(e0017ec8, 4000117ae00, 4bca3020, 0, 800, 2) at intr_handler+0xc
> sparc_interrupt(0, 400014b0000, 80206910, 400171b7c60, 40009ec0810, 0) at sparc
> _interrupt+0x298
> gem_ioctl(400014ac048, 400014ac000, 400171b7c60, 400171b7c60, 0, 40009b73c10) a
> t gem_ioctl+0x19c
> ifioctl(0, 80206910, 400171b7c60, 40009b73c10, 1012d74, 0) at ifioctl+0x38c
> sys_ioctl(0, 400171b7db8, 400171b7df8, 0, 0, 14b) at sys_ioctl+0x190
> syscall(400171b7ed0, 436, bec8920888, bec892088c, 0, 0) at syscall+0x3c4
> softtrap(3, 80206910, fffffffffffe3018, 0, 0, 1ff7fff6df8) at softtrap+0x19c
> ddb>

that is interesting. if you're still in ddb, can you go sh panic?

if not, not biggy.

my gut feeling is our ring accounting is wonky. mpi@ and jmatthew@ have tweaks to gem(4) for mpsafety which might fix this. ill poke them to see if they would share.

dlg

>
>
>
>>
>>> On 9 Nov 2015, at 10:40 AM, Ryan Freeman <[hidden email]> wrote:
>>>
>>> On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
>>>> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
>>>>
>>>> cheers,
>>>> dlg
>>>
>>> Thanks David,
>>>
>>> I have setup a script to try and capture this immediately when it happens.
>>>
>>> FWIW here is the output as it is now, working:
>>>
>>> 16:35 ryan@void:~$ ifconfig
>>> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
>>>       priority: 0
>>>       groups: lo
>>>       inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
>>>       inet6 ::1 prefixlen 128
>>>       inet 127.0.0.1 netmask 0xff000000
>>> gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>>>       lladdr 00:03:ba:2b:47:70
>>>       priority: 0
>>>       groups: egress
>>>       media: Ethernet autoselect (100baseTX full-duplex)
>>>       status: active
>>>       inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
>>> gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
>>>       lladdr 00:03:ba:2b:47:71
>>>       priority: 0
>>>       media: Ethernet autoselect (100baseTX full-duplex)
>>>       status: active
>>>       inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
>>>       inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
>>>       inet6 2001:470:b:6cf::1 prefixlen 64
>>> enc0: flags=0<>
>>>       priority: 0
>>>       groups: enc
>>>       status: active
>>> vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>>>       lladdr 00:03:ba:2b:47:71
>>>       description: servers
>>>       priority: 0
>>>       vlan: 100 parent interface: gem1
>>>       groups: vlan
>>>       status: active
>>>       inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
>>>       inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
>>>       inet6 2001:470:eac8:666::1 prefixlen 64
>>> vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>>>       lladdr 00:03:ba:2b:47:71
>>>       description: workstations
>>>       priority: 0
>>>       vlan: 101 parent interface: gem1
>>>       groups: vlan
>>>       status: active
>>>       inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
>>>       inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
>>>       inet6 2001:470:eac8:a::1 prefixlen 64
>>> vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>>>       lladdr 00:03:ba:2b:47:71
>>>       description: wireless
>>>       priority: 0
>>>       vlan: 102 parent interface: gem1
>>>       groups: vlan
>>>       status: active
>>>       inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
>>>       inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
>>>       inet6 2001:470:eac8:b::1 prefixlen 64
>>> vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>>>       lladdr 00:03:ba:2b:47:71
>>>       description: transit
>>>       priority: 0
>>>       vlan: 2 parent interface: gem1
>>>       groups: vlan
>>>       status: active
>>>       inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
>>> tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
>>>       priority: 0
>>>       groups: tun
>>>       status: down
>>>       inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
>>> gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
>>>       priority: 0
>>>       groups: gif egress
>>>       tunnel: inet 96.54.13.103 -> 216.218.226.238
>>>       inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
>>>       inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
>>> pflow0: flags=41<UP,RUNNING> mtu 1492
>>>       priority: 0
>>>       pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
>>>       groups: pflow
>>> pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
>>>       priority: 0
>>>       groups: pflog
>>>
>>> 16:36 ryan@void:~$ systat -b mb
>>>   8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015
>>>
>>> IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
>>> System                    0   256    48         129                            
>>>                            2048    24        1025                            
>>> lo0                                                                            
>>> gem0                         2048    11     4   124    11                      
>>> gem1                         2048    12     4   124    12                      
>>> enc0                                                                            
>>> vlan100                                                                        
>>> vlan101                                                                        
>>> vlan102                                                                        
>>> vlan2                                                                          
>>> tun0                                                                            
>>> gif0                                                                            
>>> pflow0                                                                          
>>> pflog0  
>>>
>>>>
>>>>> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
>>>>>
>>>>> Hey tech@,
>>>>>
>>>>> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
>>>>> Quite excited to have some non x86 hardware, I set it up as a router.
>>>>>
>>>>> However, for some reason after sometimes mere hours -- othertimes days at a
>>>>> time,  the gem0 interface needs to be cycled:
>>>>>
>>>>> ifconfig gem0 down
>>>>> ifconfig gem0 up
>>>>> dhclient gem0
>>>>>
>>>>> no packets pass until that has been done.   At first I have been placing the
>>>>> blame squarely on the Hitron modem we have in the house from shaw cable,
>>>>> but now I've noticed the issue happen twice on the internal interface as well,
>>>>> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
>>>>>
>>>>> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
>>>>> immediately after interface gem1 down/up.
>>>>>
>>>>> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
>>>>> has been nothing of interest there.   Dmesg attached,  starting to wonder
>>>>> if this machine is at its EOL and the network ports are dying :(
>>>>>
>>>>> This issue occurred with the 5.7 release as well.
>>>>>
>>>>> dmesg:
>>>>> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
>>>>> Copyright (c) 1982, 1986, 1989, 1991, 1993
>>>>>      The Regents of the University of California.  All rights reserved.
>>>>> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
>>>>>
>>>>> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
>>>>>  [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
>>>>> real mem = 1073741824 (1024MB)
>>>>> avail mem = 1039228928 (991MB)
>>>>> mpath0 at root
>>>>> scsibus0 at mpath0: 256 targets
>>>>> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
>>>>> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
>>>>> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
>>>>> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
>>>>> psycho0: bus range 0-2, PCI bus 0
>>>>> psycho0: dvma map c0000000-dfffffff
>>>>> pci0 at psycho0
>>>>> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
>>>>> pci1 at ppb0 bus 1
>>>>> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
>>>>> "flashprom" at ebus0 addr 0-fffff not configured
>>>>> clock1 at ebus0 addr 0-1fff: mk48t59
>>>>> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
>>>>> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
>>>>> iic0 at alipm0
>>>>> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
>>>>> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
>>>>> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
>>>>> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
>>>>> power0 at ebus1 addr 2000-2007 ivec 0x25
>>>>> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
>>>>> com0: console
>>>>> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
>>>>> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
>>>>> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
>>>>> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
>>>>> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
>>>>> pciide0: using ivec 0x7cc for native-PCI interrupt
>>>>> atapiscsi0 at pciide0 channel 0 drive 0
>>>>> scsibus1 at atapiscsi0: 2 targets
>>>>> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
>>>>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
>>>>> pciide0: channel 1 disabled (no drives)
>>>>> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
>>>>> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
>>>>> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
>>>>> usb0 at ohci0: USB revision 1.0
>>>>> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
>>>>> usb1 at ohci1: USB revision 1.0
>>>>> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
>>>>> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
>>>>> pci2 at ppb1 bus 2
>>>>> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
>>>>> scsibus2 at siop0: 16 targets, initiator 7
>>>>> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
>>>>> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
>>>>> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
>>>>> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
>>>>>  SENSE KEY: Hardware Error
>>>>>   ASC/ASCQ: Defect List Error
>>>>>   FRU CODE: 0x7
>>>>> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
>>>>> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
>>>>> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
>>>>> scsibus3 at siop1: 16 targets, initiator 7
>>>>> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
>>>>> vscsi0 at root
>>>>> scsibus4 at vscsi0: 256 targets
>>>>> softraid0 at root
>>>>> scsibus5 at softraid0: 256 targets
>>>>> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
>>>>> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
>>>>> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
>>>>>
>>>>
>>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Ryan Freeman
On Fri, Nov 13, 2015 at 12:36:40PM +1000, David Gwynne wrote:

>
> > On 13 Nov 2015, at 12:16, Ryan Freeman <[hidden email]> wrote:
> >
> > On Tue, Nov 10, 2015 at 08:27:36PM +1000, David Gwynne wrote:
> >> any joy? i mean, failure?
> >
> > Well I got something different.  I've noticed the failures only seem to happen
> > when my roommates arrive home.  I can use my stuff remotely all day from work
> > without a hitch, roommates come home and usually within an hr there is an
> > internet complaint.
> >
> > Since I started using the little scripts to detect connection failure
> > and down/up the iface in question, things had been pretty good simply in the
> > fact that nobody could really notice before it fixed itself.
> >
> > Today the machine dropped to ddb>!  of course i couldn't remember a damn
> > thing to type :(  i got trace, terribly sorry it wasn't more...
> >
> > ddb> trace
> > extent_free(400012600c0, 0, 0, 0, 1fe0000f078, 800012fa00000000) at extent_free
> > +0x174
> > iommu_dvmamap_unload(40001266300, 0, 4000129f080, 0, 0, 2) at iommu_dvmamap_unl
> > oad+0x74
> > gem_rint(400014ac000, 40016ff0000, 7fff0000, e0017c48, 4000000000000000, 800000
> > 00) at gem_rint+0x160
> > gem_intr(400014ac000, c00ca000, 2000, 0, 0, 80000000) at gem_intr+0x154
> > intr_handler(e0017ec8, 4000117ae00, 4bca3020, 0, 800, 2) at intr_handler+0xc
> > sparc_interrupt(0, 400014b0000, 80206910, 400171b7c60, 40009ec0810, 0) at sparc
> > _interrupt+0x298
> > gem_ioctl(400014ac048, 400014ac000, 400171b7c60, 400171b7c60, 0, 40009b73c10) a
> > t gem_ioctl+0x19c
> > ifioctl(0, 80206910, 400171b7c60, 40009b73c10, 1012d74, 0) at ifioctl+0x38c
> > sys_ioctl(0, 400171b7db8, 400171b7df8, 0, 0, 14b) at sys_ioctl+0x190
> > syscall(400171b7ed0, 436, bec8920888, bec892088c, 0, 0) at syscall+0x3c4
> > softtrap(3, 80206910, fffffffffffe3018, 0, 0, 1ff7fff6df8) at softtrap+0x19c
> > ddb>
>
> that is interesting. if you're still in ddb, can you go sh panic?
>
> if not, not biggy.

Sadly, I am not.  as it is my router, I had to reboot to get back online to
send the mail.  If it triggers again I will make sure I include that.

> my gut feeling is our ring accounting is wonky. mpi@ and jmatthew@ have tweaks to gem(4) for mpsafety which might fix this. ill poke them to see if they would share.

I am willing to try anything! :)  I will reiterate that I am just running 5.8
stable (with mtier binpatches for errata); if it requires me to bump up to
-current, no biggie :)

>
> dlg
>
> >
> >
> >
> >>
> >>> On 9 Nov 2015, at 10:40 AM, Ryan Freeman <[hidden email]> wrote:
> >>>
> >>> On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
> >>>> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
> >>>>
> >>>> cheers,
> >>>> dlg
> >>>
> >>> Thanks David,
> >>>
> >>> I have setup a script to try and capture this immediately when it happens.
> >>>
> >>> FWIW here is the output as it is now, working:
> >>>
> >>> 16:35 ryan@void:~$ ifconfig
> >>> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
> >>>       priority: 0
> >>>       groups: lo
> >>>       inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
> >>>       inet6 ::1 prefixlen 128
> >>>       inet 127.0.0.1 netmask 0xff000000
> >>> gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:70
> >>>       priority: 0
> >>>       groups: egress
> >>>       media: Ethernet autoselect (100baseTX full-duplex)
> >>>       status: active
> >>>       inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
> >>> gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       priority: 0
> >>>       media: Ethernet autoselect (100baseTX full-duplex)
> >>>       status: active
> >>>       inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
> >>>       inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
> >>>       inet6 2001:470:b:6cf::1 prefixlen 64
> >>> enc0: flags=0<>
> >>>       priority: 0
> >>>       groups: enc
> >>>       status: active
> >>> vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: servers
> >>>       priority: 0
> >>>       vlan: 100 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
> >>>       inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
> >>>       inet6 2001:470:eac8:666::1 prefixlen 64
> >>> vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: workstations
> >>>       priority: 0
> >>>       vlan: 101 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
> >>>       inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
> >>>       inet6 2001:470:eac8:a::1 prefixlen 64
> >>> vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: wireless
> >>>       priority: 0
> >>>       vlan: 102 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
> >>>       inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
> >>>       inet6 2001:470:eac8:b::1 prefixlen 64
> >>> vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: transit
> >>>       priority: 0
> >>>       vlan: 2 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
> >>> tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
> >>>       priority: 0
> >>>       groups: tun
> >>>       status: down
> >>>       inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
> >>> gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
> >>>       priority: 0
> >>>       groups: gif egress
> >>>       tunnel: inet 96.54.13.103 -> 216.218.226.238
> >>>       inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
> >>>       inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
> >>> pflow0: flags=41<UP,RUNNING> mtu 1492
> >>>       priority: 0
> >>>       pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
> >>>       groups: pflow
> >>> pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
> >>>       priority: 0
> >>>       groups: pflog
> >>>
> >>> 16:36 ryan@void:~$ systat -b mb
> >>>   8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015
> >>>
> >>> IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
> >>> System                    0   256    48         129                            
> >>>                            2048    24        1025                            
> >>> lo0                                                                            
> >>> gem0                         2048    11     4   124    11                      
> >>> gem1                         2048    12     4   124    12                      
> >>> enc0                                                                            
> >>> vlan100                                                                        
> >>> vlan101                                                                        
> >>> vlan102                                                                        
> >>> vlan2                                                                          
> >>> tun0                                                                            
> >>> gif0                                                                            
> >>> pflow0                                                                          
> >>> pflog0  
> >>>
> >>>>
> >>>>> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
> >>>>>
> >>>>> Hey tech@,
> >>>>>
> >>>>> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
> >>>>> Quite excited to have some non x86 hardware, I set it up as a router.
> >>>>>
> >>>>> However, for some reason after sometimes mere hours -- othertimes days at a
> >>>>> time,  the gem0 interface needs to be cycled:
> >>>>>
> >>>>> ifconfig gem0 down
> >>>>> ifconfig gem0 up
> >>>>> dhclient gem0
> >>>>>
> >>>>> no packets pass until that has been done.   At first I have been placing the
> >>>>> blame squarely on the Hitron modem we have in the house from shaw cable,
> >>>>> but now I've noticed the issue happen twice on the internal interface as well,
> >>>>> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
> >>>>>
> >>>>> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
> >>>>> immediately after interface gem1 down/up.
> >>>>>
> >>>>> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
> >>>>> has been nothing of interest there.   Dmesg attached,  starting to wonder
> >>>>> if this machine is at its EOL and the network ports are dying :(
> >>>>>
> >>>>> This issue occurred with the 5.7 release as well.
> >>>>>
> >>>>> dmesg:
> >>>>> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
> >>>>> Copyright (c) 1982, 1986, 1989, 1991, 1993
> >>>>>      The Regents of the University of California.  All rights reserved.
> >>>>> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
> >>>>>
> >>>>> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
> >>>>>  [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
> >>>>> real mem = 1073741824 (1024MB)
> >>>>> avail mem = 1039228928 (991MB)
> >>>>> mpath0 at root
> >>>>> scsibus0 at mpath0: 256 targets
> >>>>> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
> >>>>> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
> >>>>> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
> >>>>> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
> >>>>> psycho0: bus range 0-2, PCI bus 0
> >>>>> psycho0: dvma map c0000000-dfffffff
> >>>>> pci0 at psycho0
> >>>>> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
> >>>>> pci1 at ppb0 bus 1
> >>>>> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
> >>>>> "flashprom" at ebus0 addr 0-fffff not configured
> >>>>> clock1 at ebus0 addr 0-1fff: mk48t59
> >>>>> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
> >>>>> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
> >>>>> iic0 at alipm0
> >>>>> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
> >>>>> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
> >>>>> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
> >>>>> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
> >>>>> power0 at ebus1 addr 2000-2007 ivec 0x25
> >>>>> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
> >>>>> com0: console
> >>>>> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
> >>>>> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
> >>>>> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>>>> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
> >>>>> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
> >>>>> pciide0: using ivec 0x7cc for native-PCI interrupt
> >>>>> atapiscsi0 at pciide0 channel 0 drive 0
> >>>>> scsibus1 at atapiscsi0: 2 targets
> >>>>> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
> >>>>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
> >>>>> pciide0: channel 1 disabled (no drives)
> >>>>> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
> >>>>> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>>>> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
> >>>>> usb0 at ohci0: USB revision 1.0
> >>>>> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>>>> usb1 at ohci1: USB revision 1.0
> >>>>> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>>>> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
> >>>>> pci2 at ppb1 bus 2
> >>>>> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>>>> scsibus2 at siop0: 16 targets, initiator 7
> >>>>> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>>>> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>>>> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
> >>>>> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
> >>>>>  SENSE KEY: Hardware Error
> >>>>>   ASC/ASCQ: Defect List Error
> >>>>>   FRU CODE: 0x7
> >>>>> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>>>> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>>>> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>>>> scsibus3 at siop1: 16 targets, initiator 7
> >>>>> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>>>> vscsi0 at root
> >>>>> scsibus4 at vscsi0: 256 targets
> >>>>> softraid0 at root
> >>>>> scsibus5 at softraid0: 256 targets
> >>>>> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>>>> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
> >>>>> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
> >>>>>
> >>>>
> >>
>

Reply | Threaded
Open this post in threaded view
|

Re: sunfire v120 gem interfaces

Ryan Freeman
In reply to this post by David Gwynne-5
On Fri, Nov 13, 2015 at 12:36:40PM +1000, David Gwynne wrote:

>
> > On 13 Nov 2015, at 12:16, Ryan Freeman <[hidden email]> wrote:
> >
> > On Tue, Nov 10, 2015 at 08:27:36PM +1000, David Gwynne wrote:
> >> any joy? i mean, failure?
> >
> > Well I got something different.  I've noticed the failures only seem to happen
> > when my roommates arrive home.  I can use my stuff remotely all day from work
> > without a hitch, roommates come home and usually within an hr there is an
> > internet complaint.
> >
> > Since I started using the little scripts to detect connection failure
> > and down/up the iface in question, things had been pretty good simply in the
> > fact that nobody could really notice before it fixed itself.
> >
> > Today the machine dropped to ddb>!  of course i couldn't remember a damn
> > thing to type :(  i got trace, terribly sorry it wasn't more...
> >
> > ddb> trace
> > extent_free(400012600c0, 0, 0, 0, 1fe0000f078, 800012fa00000000) at extent_free
> > +0x174
> > iommu_dvmamap_unload(40001266300, 0, 4000129f080, 0, 0, 2) at iommu_dvmamap_unl
> > oad+0x74
> > gem_rint(400014ac000, 40016ff0000, 7fff0000, e0017c48, 4000000000000000, 800000
> > 00) at gem_rint+0x160
> > gem_intr(400014ac000, c00ca000, 2000, 0, 0, 80000000) at gem_intr+0x154
> > intr_handler(e0017ec8, 4000117ae00, 4bca3020, 0, 800, 2) at intr_handler+0xc
> > sparc_interrupt(0, 400014b0000, 80206910, 400171b7c60, 40009ec0810, 0) at sparc
> > _interrupt+0x298
> > gem_ioctl(400014ac048, 400014ac000, 400171b7c60, 400171b7c60, 0, 40009b73c10) a
> > t gem_ioctl+0x19c
> > ifioctl(0, 80206910, 400171b7c60, 40009b73c10, 1012d74, 0) at ifioctl+0x38c
> > sys_ioctl(0, 400171b7db8, 400171b7df8, 0, 0, 14b) at sys_ioctl+0x190
> > syscall(400171b7ed0, 436, bec8920888, bec892088c, 0, 0) at syscall+0x3c4
> > softtrap(3, 80206910, fffffffffffe3018, 0, 0, 1ff7fff6df8) at softtrap+0x19c
> > ddb>
>
> that is interesting. if you're still in ddb, can you go sh panic?
>
> if not, not biggy.
>
> my gut feeling is our ring accounting is wonky. mpi@ and jmatthew@ have tweaks to gem(4) for mpsafety which might fix this. ill poke them to see if they would share.

I scraped some more stuff from another panic, not running w/ the jmatthew patch yet
though...


Connected to /dev/cuaU0 (speed 9600)

ddb> trace
extent_free(400012600c0, 0, 0, 0, 1fe0000f078, 800006fc00000000) at extent_free
+0x174                                                                        
iommu_dvmamap_unload(40001266300, 0, 4000129f080, 0, 0, 2) at iommu_dvmamap_unl
oad+0x74                                                                      
gem_rint(400014ac000, 40016ff0000, 7fff0000, e0017c48, 4000000000000000, 800000
00) at gem_rint+0x160                                                          
gem_intr(400014ac000, c0050000, 2000, 0, 0, 80000000) at gem_intr+0x154
intr_handler(e0017ec8, 4000117ae00, 1b5e78e1, 0, 800, 2) at intr_handler+0xc
sparc_interrupt(0, 400014b0000, 80206910, 40017d87c60, 40009f34cb0, 0) at sparc
_interrupt+0x298                                                              
gem_ioctl(400014ac048, 400014ac000, 40017d87c60, 40017d87c60, 0, 400096ca950) a
t gem_ioctl+0x19c                                                              
ifioctl(0, 80206910, 40017d87c60, 400096ca950, 1012d74, 0) at ifioctl+0x38c
sys_ioctl(0, 40017d87db8, 40017d87df8, 0, 0, 14b) at sys_ioctl+0x190      
syscall(40017d87ed0, 436, 198ac20888, 198ac2088c, 0, 0) at syscall+0x3c4
softtrap(3, 80206910, fffffffffffd8138, 0, 0, 1ff7fff6df8) at softtrap+0x19c
ddb> sh panic                                                              
extent_free: extent `psycho0 dvma', region not within extent
ddb> ps                                                    
   PID   PPID   PGRP    UID  S       FLAGS  WAIT          COMMAND
*22395   2599  32097      0  7         0x2                ifconfig
  2599  32097  32097      0  3        0x8a  pause         sh      
 32097   1585  32097      0  3        0x8a  pause         sh
  1585  27132  27132      0  3        0x80  piperd        cron
 21846      1  21846     77  2        0x90                dhclient
 13160      1  13160      0  3        0x80  poll          dhclient
  5578   7747   5578   1000  3        0x83  ttyin         ksh    
  7747  16002  16002   1000  3        0x90  select        sshd
 16002  28625  16002      0  3        0x92  poll          sshd
  4106    195    195      0  3        0x83  poll          pftop
   195  24715    195   1000  3        0x8b  pause         ksh  
 24715   5976   5976   1000  3        0x90  select        sshd
  5976  28625   5976      0  3        0x92  poll          sshd
 28625      1  28625      0  3        0x80  select        sshd
 29463  19386  29463   1000  3        0x83  kqread        tail
 19386  24409  19386   1000  3        0x8b  pause         ksh
 24409   7564   7564   1000  3        0x90  select        sshd
  7564      1   7564      0  3        0x92  poll          sshd
 17023  21189  17023      0  3        0x83  kqread        tail
 32259  21189  32259      0  3        0x83  kqread        tail
   337  21189    337      0  3        0x83  kqread        tail
  8441  21189   8441      0  3        0x83  kqread        tail
 21189  25435   3428      0  3        0x83  select        multitail
 25435   3428   3428   1000  3        0x8b  pause         sh      
  3428  26820   3428   1000  3        0x8b  pause         ksh
 26820   7525   7525   1000  3        0x90  select        sshd
 21191  32741  32741   1000  3        0x83  poll          systat
 32741  12107  32741   1000  3        0x8b  pause         ksh  
 16450  15816  15816   1000  3        0x83  kqread        tmux
 15816   3067  15816   1000  3        0x8b  pause         ksh
 20033  19327  19327   1000  3        0x83  poll          top
 12107  10816  10816   1000  3        0x90  select        sshd
 19327  14989  19327   1000  3        0x8b  pause         ksh
  3067  20922  20922   1000  3        0x90  select        sshd
 14989   6421   6421   1000  3        0x90  select        sshd
 20757   7930   7930   1000  3        0x83  kqread        tmux
  7930  10988   7930   1000  3        0x8b  pause         ksh
 10988  10908  10908   1000  3        0x90  select        sshd
 10816      1  10816      0  3        0x92  poll          sshd
  7525      1   7525      0  3        0x92  poll          sshd
  6421      1   6421      0  3        0x92  poll          sshd
 10908      1  10908      0  3        0x92  poll          sshd
 20922      1  20922      0  3        0x92  poll          sshd
 31951      1  31951      0  3        0x83  ttyin         getty
 10130  13736  10130   1000  3        0x83  nanosleep     slurm
 13736  10376  13736   1000  3        0x8b  pause         ksh  
 10376      1  10376   1000  3        0x80  kqread        tmux
 27132      1  27132      0  3        0x80  poll          cron
 28902      1  28902      0  3        0x80  nanosleep     sensorsd
 16311  23961  23961     67  3        0x90  netcon        php-fpm-5.6
  9319  23961  23961     67  3        0x90  netcon        php-fpm-5.6
 23961      1  23961      0  3        0x80  kqread        php-fpm-5.6
 30575      1  30575    717  3        0x80  nanosleep     uptimed    
  3406      1   9828      0  3        0x80  bpf           arpwatch
 32154      1  32154     99  3        0x90  poll          sndiod  
  5100   2973   2973     67  3        0x90  kqread        httpd
  2623   2973   2973     67  3        0x90  kqread        httpd
   157  18163    157     67  3        0x90  kqread        httpd
  2973  18163   2973     67  3        0x90  kqread        httpd
 18163      1  18163      0  3        0x80  kqread        httpd
  6604      1   6604     67  3        0x90  kqread        slowcgi
 32126  16736  16736     95  3        0x90  kqread        smtpd  
 15947  16736  16736     95  3        0x90  kqread        smtpd
 31447  16736  16736     95  3        0x90  kqread        smtpd
 21136  16736  16736     95  3        0x90  kqread        smtpd
 14913  16736  16736     95  3        0x90  kqread        smtpd
 17860  16736  16736    103  3        0x90  kqread        smtpd
 16736      1  16736      0  3        0x80  kqread        smtpd
  9310      1   9310     92  2        0x90                rtadvd
 15772      1  15772      0  2        0x80                route6d
   664      1    664     77  3        0x90  poll          dhcpd  
 23477  29588   2853     83  3        0x90  poll          ntpd
 29588   2853   2853     83  3        0x90  poll          ntpd
  2853      1   2853      0  3        0x80  poll          ntpd
 13903  29420  29420     53  3        0x90  kqread        unbound
 14033  29420  29420     53  3        0x90  kqread        unbound
 14991  29420  29420     53  3        0x90  kqread        unbound
 29420      1  29420     53  3        0x90  kqread        unbound
 16430  31701  15944     97  3        0x90  kqread        nsd    
 31701  15944  15944     97  3        0x90  select        nsd
 15944      1  15944     97  3        0x90  kqread        nsd
 32446  29991  29991     73  2        0x90                syslogd
 29991      1  29991      0  3        0x80  netio         syslogd
 19391      0      0      0  2     0x14200                zerothread
  7318      0      0      0  3     0x14200  aiodoned      aiodoned  
 13193      0      0      0  3     0x14200  syncer        update  
  7528      0      0      0  3     0x14200  cleaner       cleaner
 32082      0      0      0  3     0x14200  reaper        reaper
 29877      0      0      0  3     0x14200  pgdaemon      pagedaemon
  5829      0      0      0  3     0x14200  bored         crypto    
 23191      0      0      0  3     0x14200  pftm          pfpurge
 14951      0      0      0  3     0x14200  usbtsk        usbtask
 29061      0      0      0  3     0x14200  usbatsk       usbatsk
 20913      0      0      0  3     0x14200  bored         sensors
 31532      0      0      0  2     0x14200                softnet
 20708      0      0      0  3     0x14200  bored         systqmp
  5149      0      0      0  3     0x14200  bored         systq  
  5084      0      0      0  3  0x40014200                idle0
 18253      0      0      0  3     0x14200  kmalloc       kmthread
     1      0      1      0  3        0x82  wait          init    
     0     -1      0      0  3     0x10200  scheduler     swapper
ddb> sh registers                                                
tstate                    0x1d000600
pc                         0x155f788    Debugger+0x8
npc                        0x155f78c    Debugger+0xc
ipl                              0xf                
y                            0x5bab7
g0                                 0
g1                         0x180e000    memname+0x450
g2                               0x1                
g3                               0x1
g4                                 0
g5                               0x1
g6                 0x300000000000000
g7                        0xe0018000
o0                               0x1
o1                        0xe0017a70
o2                         0x1833098    __guard_local
o3                         0x180e000    memname+0x450
o4                                 0                
o5                               0x1
o6                        0xe0017049
o7                         0x11b1758    panic+0xb8
l0                         0x1836170    obd+0x30d0
l1                                 0              
l2                             0x5ea
l3                                 0
l4                             0x5ea
l5                         0x1833098    __guard_local
l6                        0xe00179b0                
l7                             0x800
i0                                 0
i1                                 0
i2                                 0
i3                                 0
i4                                 0
i5                                 0
i6                                 0
i7                                 0
f0                0x3fa800000004b000
f2                0xffffffffffffffff
f4                0xffffffffffffffff
f6                0xffffffffffffffff
f8                        0x41200000
f10               0x4b8e3dc848c95ee0
f12               0x423533debd490000
f14               0x3dc0bab0c0000000
f16               0x4074f3b000000000
f18               0x4024000000000000
f20               0xffffffffffffffff
f22               0xffffffffffffffff
f24               0xffffffffffffffff
f26               0xffffffffffffffff
f28               0xffffffffffffffff
f30               0xffffffffffffffff
f32                                0
f34                                0
f36                                0
f38                                0
f40                                0
f42                                0
f44                                0
f46                                0
f48                                0
f50                                0
f52                                0
f54                                0
f56                                0
f58                                0
f60                                0
f62                                0
fsr                     0x2900000820
gsr                                0
Debugger+0x8:   nop                
ddb> sh malloc    
           Type InUse  MemUse  HighUse   Limit  Requests Type Lim Kern Lim
         devbuf  5602   5594K    5658K  78643K      6549        0        0
            pcb   115     34K      42K  78643K      3053        0        0
       routetbl   441     32K      33K  78643K   1349562        0        0
         ifaddr   111     29K      29K  78643K       127        0        0
         sysctl     2      0K       0K  78643K         2        0        0
       ioctlops     0      0K       4K  78643K    122676        0        0
            iov     0      0K       2K  78643K        32        0        0
          mount     9      9K       9K  78643K         9        0        0
         vnodes  1104     69K      83K  78643K     20369        0        0
      UFS quota     1     32K      32K  78643K         1        0        0
      UFS mount    37     72K      72K  78643K        37        0        0
            shm     2      1K       9K  78643K         8        0        0
         VM map     2      0K       0K  78643K         2        0        0
            sem     2      0K       0K  78643K         4        0        0
        dirhash   369     74K      74K  78643K       375        0        0
           file     0      0K       2K  78643K         1        0        0
      file desc    12     20K      22K  78643K        24        0        0
           proc    21     10K      10K  78643K        21        0        0
        subproc    56     56K      62K  78643K    102624        0        0
    VFS cluster     0      0K       0K  78643K        27        0        0
    NFS srvsock     1      0K       0K  78643K         1        0        0
     NFS daemon     1     16K      16K  78643K         1        0        0
    ip_moptions     2      0K       0K  78643K         2        0        0
       in_multi   100      6K       6K  78643K       106        0        0
    ether_multi    30      1K       1K  78643K        36        0        0
    ISOFS mount     1     32K      32K  78643K         1        0        0
  MSDOSFS mount     1     16K      16K  78643K         1        0        0
           ttys   384    285K     285K  78643K       384        0        0
           exec     0      0K       3K  78643K    258851        0        0
     pfkey data     1      0K       0K  78643K         2        0        0
     xform_data     0      0K       3K  78643K       674        0        0
        pagedep     1      4K       4K  78643K         1        0        0
       inodedep     1     32K      32K  78643K         1        0        0
         newblk     1      0K       0K  78643K         1        0        0
        VM swap     7     58K      58K  78643K         7        0        0
       UVM amap 11065    533K     566K  78643K   6745764        0        0
       UVM aobj     2      2K       2K  78643K         3        0        0
            USB    19      1K       1K  78643K        19        0        0
     USB device     6      0K       0K  78643K         6        0        0
    crypto data     1      1K       1K  78643K         1        0        0
    ip6_options     4      1K      86K  78643K    262191        0        0
            NDP    22      3K       4K  78643K        31        0        0
           temp   174     91K     171K  78643K   2862411        0        0
ddb>  

>
> dlg
>
> >
> >
> >
> >>
> >>> On 9 Nov 2015, at 10:40 AM, Ryan Freeman <[hidden email]> wrote:
> >>>
> >>> On Mon, Nov 09, 2015 at 10:07:31AM +1000, David Gwynne wrote:
> >>>> can you get the ifconfig output when its locked up? and a copy of what systat mb is showing?
> >>>>
> >>>> cheers,
> >>>> dlg
> >>>
> >>> Thanks David,
> >>>
> >>> I have setup a script to try and capture this immediately when it happens.
> >>>
> >>> FWIW here is the output as it is now, working:
> >>>
> >>> 16:35 ryan@void:~$ ifconfig
> >>> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
> >>>       priority: 0
> >>>       groups: lo
> >>>       inet6 fe80::1%lo0 prefixlen 64 scopeid 0x4
> >>>       inet6 ::1 prefixlen 128
> >>>       inet 127.0.0.1 netmask 0xff000000
> >>> gem0: flags=8867<UP,BROADCAST,DEBUG,NOTRAILERS,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:70
> >>>       priority: 0
> >>>       groups: egress
> >>>       media: Ethernet autoselect (100baseTX full-duplex)
> >>>       status: active
> >>>       inet 96.54.13.103 netmask 0xfffffc00 broadcast 96.54.15.255
> >>> gem1: flags=8b63<UP,BROADCAST,NOTRAILERS,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       priority: 0
> >>>       media: Ethernet autoselect (100baseTX full-duplex)
> >>>       status: active
> >>>       inet 10.16.1.30 netmask 0xffffffe0 broadcast 10.16.1.31
> >>>       inet6 fe80::203:baff:fe2b:4771%gem1 prefixlen 64 scopeid 0x2
> >>>       inet6 2001:470:b:6cf::1 prefixlen 64
> >>> enc0: flags=0<>
> >>>       priority: 0
> >>>       groups: enc
> >>>       status: active
> >>> vlan100: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: servers
> >>>       priority: 0
> >>>       vlan: 100 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 10.21.1.30 netmask 0xffffffe0 broadcast 10.21.1.31
> >>>       inet6 fe80::203:baff:fe2b:4771%vlan100 prefixlen 64 scopeid 0x5
> >>>       inet6 2001:470:eac8:666::1 prefixlen 64
> >>> vlan101: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: workstations
> >>>       priority: 0
> >>>       vlan: 101 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 10.21.8.254 netmask 0xffffff80 broadcast 10.21.8.255
> >>>       inet6 fe80::203:baff:fe2b:4771%vlan101 prefixlen 64 scopeid 0x6
> >>>       inet6 2001:470:eac8:a::1 prefixlen 64
> >>> vlan102: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: wireless
> >>>       priority: 0
> >>>       vlan: 102 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 10.21.9.254 netmask 0xffffff80 broadcast 10.21.9.255
> >>>       inet6 fe80::203:baff:fe2b:4771%vlan102 prefixlen 64 scopeid 0x7
> >>>       inet6 2001:470:eac8:b::1 prefixlen 64
> >>> vlan2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
> >>>       lladdr 00:03:ba:2b:47:71
> >>>       description: transit
> >>>       priority: 0
> >>>       vlan: 2 parent interface: gem1
> >>>       groups: vlan
> >>>       status: active
> >>>       inet 172.21.1.2 netmask 0xfffffffc broadcast 172.21.1.3
> >>> tun0: flags=51<UP,POINTOPOINT,RUNNING> mtu 1500
> >>>       priority: 0
> >>>       groups: tun
> >>>       status: down
> >>>       inet 10.21.2.1 --> 10.21.2.2 netmask 0xfffffffc
> >>> gif0: flags=8051<UP,POINTOPOINT,RUNNING,MULTICAST> mtu 1280
> >>>       priority: 0
> >>>       groups: gif egress
> >>>       tunnel: inet 96.54.13.103 -> 216.218.226.238
> >>>       inet6 fe80::203:baff:fe2b:4770%gif0 ->  prefixlen 64 scopeid 0xa
> >>>       inet6 2001:470:a:6cf::2 -> 2001:470:a:6cf::1 prefixlen 128
> >>> pflow0: flags=41<UP,RUNNING> mtu 1492
> >>>       priority: 0
> >>>       pflow: sender: 127.0.0.1 receiver: 127.0.0.1:9995 version: 5
> >>>       groups: pflow
> >>> pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33144
> >>>       priority: 0
> >>>       groups: pflog
> >>>
> >>> 16:36 ryan@void:~$ systat -b mb
> >>>   8 users    Load 0.21 0.25 0.26                     Sun Nov  8 16:37:12 2015
> >>>
> >>> IFACE             LIVELOCKS  SIZE ALIVE   LWM   HWM   CWM                      
> >>> System                    0   256    48         129                            
> >>>                            2048    24        1025                            
> >>> lo0                                                                            
> >>> gem0                         2048    11     4   124    11                      
> >>> gem1                         2048    12     4   124    12                      
> >>> enc0                                                                            
> >>> vlan100                                                                        
> >>> vlan101                                                                        
> >>> vlan102                                                                        
> >>> vlan2                                                                          
> >>> tun0                                                                            
> >>> gif0                                                                            
> >>> pflow0                                                                          
> >>> pflog0  
> >>>
> >>>>
> >>>>> On 9 Nov 2015, at 09:36, Ryan Freeman <[hidden email]> wrote:
> >>>>>
> >>>>> Hey tech@,
> >>>>>
> >>>>> At my wits end here, I recently got a sunfire v120 from work for pretty cheap.
> >>>>> Quite excited to have some non x86 hardware, I set it up as a router.
> >>>>>
> >>>>> However, for some reason after sometimes mere hours -- othertimes days at a
> >>>>> time,  the gem0 interface needs to be cycled:
> >>>>>
> >>>>> ifconfig gem0 down
> >>>>> ifconfig gem0 up
> >>>>> dhclient gem0
> >>>>>
> >>>>> no packets pass until that has been done.   At first I have been placing the
> >>>>> blame squarely on the Hitron modem we have in the house from shaw cable,
> >>>>> but now I've noticed the issue happen twice on the internal interface as well,
> >>>>> gem1.  All VLANs I have setup stop responding until gem1 is cycled.
> >>>>>
> >>>>> gem1 is just used by a collection of vlan(4) interfaces, so traffic resumes
> >>>>> immediately after interface gem1 down/up.
> >>>>>
> >>>>> I've tried to turn on ifconfig gem0 debug to catch anything wierd, but there
> >>>>> has been nothing of interest there.   Dmesg attached,  starting to wonder
> >>>>> if this machine is at its EOL and the network ports are dying :(
> >>>>>
> >>>>> This issue occurred with the 5.7 release as well.
> >>>>>
> >>>>> dmesg:
> >>>>> console is /pci@1f,0/pci@1,1/isa@7/serial@0,3f8
> >>>>> Copyright (c) 1982, 1986, 1989, 1991, 1993
> >>>>>      The Regents of the University of California.  All rights reserved.
> >>>>> Copyright (c) 1995-2015 OpenBSD. All rights reserved.  http://www.OpenBSD.org
> >>>>>
> >>>>> OpenBSD 5.8 (GENERIC) #0: Thu Oct 22 00:24:09 PDT 2015
> >>>>>  [hidden email]:/usr/src/sys/arch/sparc64/compile/GENERIC
> >>>>> real mem = 1073741824 (1024MB)
> >>>>> avail mem = 1039228928 (991MB)
> >>>>> mpath0 at root
> >>>>> scsibus0 at mpath0: 256 targets
> >>>>> mainbus0 at root: Sun Fire V120 (UltraSPARC-IIe 648MHz)
> >>>>> cpu0 at mainbus0: SUNW,UltraSPARC-IIe (rev 3.3) @ 648 MHz
> >>>>> cpu0: physical 16K instruction (32 b/l), 16K data (32 b/l), 512K external (64 b/l)
> >>>>> psycho0 at mainbus0: SUNW,sabre, impl 0, version 0, ign 7c0
> >>>>> psycho0: bus range 0-2, PCI bus 0
> >>>>> psycho0: dvma map c0000000-dfffffff
> >>>>> pci0 at psycho0
> >>>>> ppb0 at pci0 dev 1 function 1 "Sun Simba" rev 0x13
> >>>>> pci1 at ppb0 bus 1
> >>>>> ebus0 at pci1 dev 12 function 0 "Sun RIO EBus" rev 0x01
> >>>>> "flashprom" at ebus0 addr 0-fffff not configured
> >>>>> clock1 at ebus0 addr 0-1fff: mk48t59
> >>>>> lom0 at ebus0 addr 200000-200003 ivec 0x2a: LOMlite2 rev 3.12
> >>>>> alipm0 at pci1 dev 3 function 0 "Acer Labs M7101 Power" rev 0x00: 74KHz clock
> >>>>> iic0 at alipm0
> >>>>> "max1617" at alipm0 addr 0x18 skipped due to alipm0 bugs
> >>>>> spdmem0 at iic0 addr 0x54: 512MB SDRAM registered ECC PC133CL2
> >>>>> spdmem1 at iic0 addr 0x55: 512MB SDRAM registered ECC PC133CL2
> >>>>> ebus1 at pci1 dev 7 function 0 "Acer Labs M1533 ISA" rev 0x00
> >>>>> power0 at ebus1 addr 2000-2007 ivec 0x25
> >>>>> com0 at ebus1 addr 3f8-3ff ivec 0x2b: ns16550a, 16 byte fifo
> >>>>> com0: console
> >>>>> com1 at ebus1 addr 2e8-2ef ivec 0x2b: ns16550a, 16 byte fifo
> >>>>> gem0 at pci1 dev 12 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7c6, address 00:03:ba:2b:47:70
> >>>>> ukphy0 at gem0 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>>>> ohci0 at pci1 dev 12 function 3 "Sun USB" rev 0x01: ivec 0x7e4, version 1.0, legacy support
> >>>>> pciide0 at pci1 dev 13 function 0 "Acer Labs M5229 UDMA IDE" rev 0xc3: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
> >>>>> pciide0: using ivec 0x7cc for native-PCI interrupt
> >>>>> atapiscsi0 at pciide0 channel 0 drive 0
> >>>>> scsibus1 at atapiscsi0: 2 targets
> >>>>> cd0 at scsibus1 targ 0 lun 0: <TEAC, CD-224E, P.9A> ATAPI 5/cdrom removable
> >>>>> cd0(pciide0:0:0): using PIO mode 4, DMA mode 2
> >>>>> pciide0: channel 1 disabled (no drives)
> >>>>> gem1 at pci1 dev 5 function 1 "Sun ERI Ether" rev 0x01: ivec 0x7dc, address 00:03:ba:2b:47:71
> >>>>> ukphy1 at gem1 phy 1: Generic IEEE 802.3u media interface, rev. 1: OUI 0x0010dd, model 0x0002
> >>>>> ohci1 at pci1 dev 5 function 3 "Sun USB" rev 0x01: ivec 0x7e6, version 1.0, legacy support
> >>>>> usb0 at ohci0: USB revision 1.0
> >>>>> uhub0 at usb0 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>>>> usb1 at ohci1: USB revision 1.0
> >>>>> uhub1 at usb1 "Sun OHCI root hub" rev 1.00/1.00 addr 1
> >>>>> ppb1 at pci0 dev 1 function 0 "Sun Simba" rev 0x13
> >>>>> pci2 at ppb1 bus 2
> >>>>> siop0 at pci2 dev 8 function 0 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>>>> scsibus2 at siop0: 16 targets, initiator 7
> >>>>> sym0 at scsibus2 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>>>> sd0 at scsibus0 targ 0 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0DGN80000731804D9
> >>>>> sd0: 34732MB, 512 bytes/sector, 71132959 sectors
> >>>>> probe(siop0:1:0): Check Condition (error 0x70) on opcode 0x0
> >>>>>  SENSE KEY: Hardware Error
> >>>>>   ASC/ASCQ: Defect List Error
> >>>>>   FRU CODE: 0x7
> >>>>> sym1 at scsibus2 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>>>> sd1 at scsibus0 targ 1 lun 0: <SEAGATE, ST336607LSUN36G, 0207> SCSI3 0/direct fixed serial.SEAGATE_ST336607LSUN36G_3JA0BZL100002316NCUL
> >>>>> siop1 at pci2 dev 8 function 1 "Symbios Logic 53c896" rev 0x07: ivec 0x7e0, using 8K of on-board RAM
> >>>>> scsibus3 at siop1: 16 targets, initiator 7
> >>>>> siop0: target 0 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>>>> vscsi0 at root
> >>>>> scsibus4 at vscsi0: 256 targets
> >>>>> softraid0 at root
> >>>>> scsibus5 at softraid0: 256 targets
> >>>>> siop0: target 1 now using tagged 16 bit 40.0 MHz 31 REQ/ACK offset xfers
> >>>>> bootpath: /pci@1f,0/pci@1,0/scsi@8,0/disk@0,0
> >>>>> root on sd0a (dd2dc38974492ea6.a) swap on sd0b dump on sd0b
> >>>>>
> >>>>
> >>
>