Octeon crash. (May2 snap)

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Octeon crash. (May2 snap)

Janne Johansson-4
Tried to nfs mount and mount_nfs hung so I left it at that, came back to
a crashed box. 8-(

(From my ssh session)
oct3# mount_nfs -T -l -s -i -a 4 -r 8192 -w 8192
192.168.1.186:/home/src2 /usr
nfs server 192.168.1.186:/home/src2: not responding

^C
oct3# Shared connection to 192.168.1.84 closed.

and from the serial console:

OpenBSD/octeon (oct3.inet6.se) (console)

login: panic: Data modified on freelist: word 14 of object
0xc00000000006bc00 si
ze 0x400 previous type temp (0x0 != 0xdead4110)

Stopped at      0xffffffff810ab20c:     jr      ra
0xffffffff810ab210:      nop
    TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
*350396  75213      0         0x2          0    0K mtree
0xffffffff810ab208 (72f1684eb4828ebc,9001070000000208,208,0)  ra
0xffffffff8108
d4a8 sp 0x980000000de23d20, sz 0
0xffffffff8108d268 (72f1684eb4828ebc,9001070000000208,208,0)  ra 0x0 sp
0x98000
0000de23d20, sz 0
User-level: pid 75213
https://www.openbsd.org/ddb.html describes the minimum info required in bug
reports.  Insufficient info makes it difficult to find and fix bugs.
ddb{0}> ps
   PID     TID   PPID    UID  S       FLAGS  WAIT          COMMAND
*75213  350396   1366      0  7         0x2                mtree
  1366  130065  59234      0  3        0x82  piperd        perl
 59234  237938  52732      0  3    0x10008a  pause         sh
 52732   86824  89119      0  3    0x10008a  pause         sh
 89119  450618  72651      0  3    0x100090  piperd        cron
 50248  262970      0      0  3     0x14280  nfsidl        nfsio
 58392  173644      0      0  3     0x14280  nfsidl        nfsio
 96897  201333      0      0  3     0x14280  nfsidl        nfsio
 51954  209145      0      0  3     0x14280  nfsidl        nfsio
 71675  375437   3448      0  3    0x100083  ttyin         ksh
  3448  290239  81983      0  3        0x82  select        sshd
 38164  131315      1      0  3    0x100083  ttyin         getty
 72651  341550      1      0  3    0x100098  poll          cron
 56419  199304      1    110  3    0x100090  poll          sndiod
 42892  415893      1     99  3    0x100090  poll          sndiod
  3832   50070  29866     95  3    0x100092  kqread        smtpd
 88207  248867  29866    103  3    0x100092  kqread        smtpd
 88415  144634  29866     95  3    0x100092  kqread        smtpd
 87388  264217  29866     95  3    0x100092  kqread        smtpd
 53780  295157  29866     95  3    0x100092  kqread        smtpd
 67243  152362  29866     95  3    0x100092  kqread        smtpd
 29866  137458      1      0  3    0x100080  kqread        smtpd
 81983   24780      1      0  3        0x80  select        sshd
 85514  452634      1      0  3    0x100080  poll          ntpd
 16142  357184  49000     83  3    0x100092  poll          ntpd
 49000  229566      1     83  3    0x100092  poll          ntpd
 62712  346482  24485     74  3    0x100092  bpf           pflogd
 24485   25808      1      0  3        0x80  netio         pflogd
 77935   79061  56293     73  3    0x100090  kqread        syslogd
 56293  250536      1      0  3    0x100082  netio         syslogd
 42551  305002      1     77  3    0x100090  poll          dhclient
 14586  285039      1      0  3        0x80  poll          dhclient
 19712   74729  63788    115  3    0x100092  kqread        slaacd
 21541  230184  63788    115  3    0x100092  kqread        slaacd
 63788  350914      1      0  3    0x100080  kqread        slaacd
 38043  303479      1      0  3        0x80  mfsidl        mount_mfs
 29475  116041      0      0  7  0x40014200                idle1
 33504   10333      0      0  3     0x14200  pgzero        zerothread
 72967  268007      0      0  3     0x14200  aiodoned      aiodoned
 25601  346772      0      0  3     0x14200  syncer        update
 70600  359173      0      0  3     0x14200  cleaner       cleaner
 82498  227206      0      0  3     0x14200  reaper        reaper
 14914  332178      0      0  3     0x14200  pgdaemon      pagedaemon
 49198  154522      0      0  3     0x14200  bored         crynlk
 51361   39481      0      0  3     0x14200  bored         crypto
 93171  376847      0      0  3     0x14200  usbtsk        usbtask
 94419  267074      0      0  3     0x14200  usbatsk       usbatsk
 35599  362948      0      0  3     0x14200  bored         dwc2
 24825  304771      0      0  3     0x14200  bored         softnet
  7946  505053      0      0  3     0x14200  bored         systqmp
 23618  394744      0      0  3     0x14200  bored         systq
 93549  192361      0      0  3  0x40014200  bored         softclock
  1080  275374      0      0  3  0x40014200                idle0
 59080  243541      0      0  3     0x14200  bored         smr
     1  136007      0      0  3        0x82  wait          init
     0       0     -1      0  3     0x10200  scheduler     swapper
ddb{0}> ddb{0}> trace
0xffffffff810ab208 (72f1684eb4828ebc,9001070000000208,208,0)  ra
0xffffffff8108
d4a8 sp 0x980000000de23d20, sz 0
0xffffffff8108d268 (72f1684eb4828ebc,9001070000000208,208,0)  ra 0x0 sp
0x98000
0000de23d20, sz 0
User-level: pid 75213
ddb{0}> show bcstats
Current Buffer Cache status:
numbufs 3174 busymapped 0, delwri 25
kvaslots 797 avail kva slots 797
bufpages 3174, dmapages 3174, dirtypages 25
pendingreads 1, pendingwrites 0
highflips 0, highflops 0, dmaflips 0
ddb{0}> show nfsreq

Trap cause = 4 Frame 0x980000000de23778
Trap PC 0xffffffff81351f5c RA 0xffffffff81382e0c fault 0xffffffff810ab264
0xffffffff81351f04 (ffffffff810ab20c,3e00008,24020000,0)  ra
0xffffffff81382e0c
sp 0x980000000de238d0, sz 0
0xffffffff81382d40 (ffffffff810ab20c,3e00008,24020000,0)  ra 0x0 sp
0x980000000de238d0, sz 0
User-level: pid 75213
Caught exception in ddb.
ddb{0}> machine ddbcpu 1
Stopped at      0xffffffff810ab20c:     jr      ra
0xffffffff810ab210:      nop
0xffffffff810ab208 (4,1,688,1)  ra 0xffffffff810713c0 sp
0x980000000ffabb48, sz
 0
0xffffffff810713b8 (4,1,688,1)  ra 0x0 sp 0x980000000ffabb48, sz 0
User-level: pid 29475
ddb{1}> trace
0xffffffff810ab208 (4,1,688,1)  ra 0xffffffff810713c0 sp
0x980000000ffabb48, sz
 0
0xffffffff810713b8 (4,1,688,1)  ra 0x0 sp 0x980000000ffabb48, sz 0
User-level: pid 29475

Finally, the dmesg:
------------------
Copyright (c) 1982, 1986, 1989, 1991, 1993
        The Regents of the University of California.  All rights reserved.
Copyright (c) 1995-2019 OpenBSD. All rights reserved.
https://www.OpenBSD.org

OpenBSD 6.5-current (GENERIC.MP) #0: Thu May  2 18:43:09 UTC 2019
    visa@octeon:/usr/src/sys/arch/octeon/compile/GENERIC.MP
real mem = 536870912 (512MB)
avail mem = 523730944 (499MB)
mainbus0 at root: board 20002 rev 2.14
cpu0 at mainbus0: CN50xx CPU rev 0.1 500 MHz, Software FP emulation
cpu0: cache L1-I 32KB 4 way D 16KB 64 way, L2 128KB 8 way
cpu1 at mainbus0: CN50xx CPU rev 0.1 500 MHz, Software FP emulation
cpu1: cache L1-I 32KB 4 way D 16KB 64 way, L2 128KB 8 way
clock0 at mainbus0: int 5
octcrypto0 at mainbus0
iobus0 at mainbus0
simplebus0 at iobus0: "soc"
octciu0 at simplebus0
cn30xxsmi0 at simplebus0
com0 at simplebus0: ns16550a, 64 byte fifo
com0: console
dwctwo0 at iobus0 base 0x1180068000000 irq 56
usb0 at dwctwo0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Octeon DWC2 root hub" rev
2.00/1.00 addr 1
octrng0 at iobus0 base 0x1400000000000 irq 0
cn30xxgmx0 at iobus0 base 0x1180008000000
cnmac0 at cn30xxgmx0: RGMII, address dc:9f:db:28:fb:9f
atphy0 at cnmac0 phy 7: AR8035 10/100/1000 PHY, rev. 2
cnmac1 at cn30xxgmx0: RGMII, address dc:9f:db:28:fb:a0
atphy1 at cnmac1 phy 6: AR8035 10/100/1000 PHY, rev. 2
cnmac2 at cn30xxgmx0: RGMII, address dc:9f:db:28:fb:a1
atphy2 at cnmac2 phy 5: AR8035 10/100/1000 PHY, rev. 2
/dev/ksyms: Symbol table not valid.
umass0 at uhub0 port 1 configuration 1 interface 0 "Generic USB Storage"
rev 2.00/2.72 addr 2
umass0: using SCSI over Bulk-Only
scsibus0 at umass0: 2 targets, initiator 0
sd0 at scsibus0 targ 1 lun 0: <Generic, STORAGE DEVICE, 0272> SCSI0
0/direct removable serial.05e30736000000000272
sd0: 7580MB, 512 bytes/sector, 15523840 sectors
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
scsibus2 at softraid0: 256 targets
boot device: sd0
root on sd0a (08597329d0d8a9cd.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
WARNING: No TOD clock, believing file system.
WARNING: CHECK AND RESET THE DATE!