panic: kernel diagnostic assertion "m != NULL" failed: file "../../../../dev/pci/if_vio.c", line 987

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

panic: kernel diagnostic assertion "m != NULL" failed: file "../../../../dev/pci/if_vio.c", line 987

Matthew Martin-2
>Synopsis: panic: kernel diagnostic assertion "m != NULL" failed: file "../../../../dev/pci/if_vio.c", line 987
>Category: kernel
>Environment:
        System      : OpenBSD 5.7
        Details     : OpenBSD 5.7 (GENERIC) #0: Thu Apr 30 22:01:01 CEST 2015
                         [hidden email]:/binpatchng/work-binpatch57-amd64/src/sys/arch/amd64/compile/GENERIC

        Architecture: OpenBSD.amd64
        Machine     : amd64
>Description:
        This is a virtual machine under virtualbox I'm using to test changes
for a live site which runs under rhel/kvm. vbox reports Version 4.3.28
r100309

The site is happily chugging away and also uses vio/virtio but it also
has a gig of ram, 4 cpu cores, and only vio0. The crashed vbox also
has a vio1. It would have been using vio0 to pull down the data and is
running bsd.sp.

I'll try to reproduce it tonight and double check the panic message's
line# and ddb, I couldn't get it to save anything on its own (boot
dump and such reproduces the panic message).

ddb> trace
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
vio_rxeof() at vio_rxeof+0x1e4
vio_rx_intr() at vio_rx_intr+0x28
virtio_vq_intr() at virtio_vq_intr+0x8c
virtio_pci_intr() at intr_pci_handler+0x47
intr_handler() at intr_handler+0x28
Xintr_ioapic_level10() at Xintr_ioapic_level10+0xe1
--- interrupt ---
Bad frame pointer: 0xffff8000039eff10
end trace frame: 0xffff8000039eff10, count: -9
Xspllower+0xe:

ddb> ps
PID     PPID    PGRP    UID     S       FLAGS   WAIT    COMMAND
15148   4969    4969    1000    3       0x81    select  rsync
29265   4969    4969    1000    3       0x83    select  ssh
4969    13432   4969    1000    3       0x83    select  rsync
13432   20917   13432   1000    3       0x8b    pause   ksh
20917   1       20917   1000    3       0x80    kqread  tmux
27039   10496   27039   1000    3       0x83    kqread  tmux
10496   17023   10496   1000    3       0x8b    pause   ksh
17023   21364   21364   1000    3       0x90    select  sshd
21364   31493   21364   0       3       0x92    poll    sshd
[...] httpd, ldapd, php-fpm, mysql, postgresql...  [...]
3075    0       0       0       3       0x14200 pgzero  zerothread
3159    0       0       0       3       0x14200 aiodoned aiodoned
7049    0       0       0       3       0x14200 syncer  update
4021    0       0       0       3       0x14200 cleaner cleaner
24175   0       0       0       3       0x14200 reaper  reaper
26258   0       0       0       3       0x14200 pgdaemon pgdaemon
8341    0       0       0       3       0x14200 bored   crypto
32568   0       0       0       3       0x14200 pftm    pfpurge
9068    0       0       0       3       0x14200 usbtsk  usbtsk
30405   0       0       0       3       0x14200 usbatsk usbatsk
11455   0       0       0       3       0x40014200 acpi0 acpi0
28556   0       0       0       3       0x14200 bored   systqmp
23260   0       0       0       3       0x14200 bored   systq
*16910  0       0       0       7       0x40014200      idle0
1       0       1       0       3       0x82    wait    init
0       -1      0       0       3       0x10200 scheduler swapper

>How-To-Repeat:
        Let rsync run a few hours sucking down >10 gigs of data over a shoddy
link. I'm not sure how far it got this time but it's the second time
this has happened, and it was with the same panic message.
>Fix:
        Probably, don't use VirtualBox. The live site under rhel/kvm rsync'd
~80 gigs in under an hour with the same drivers.

dmesg:
OpenBSD 5.7 (GENERIC) #0: Thu Apr 30 22:01:01 CEST 2015
    [hidden email]:/binpatchng/work-binpatch57-amd64/src/sys/arch/amd64/compile/GENERIC
real mem = 117374976 (111MB)
avail mem = 110526464 (105MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xe1000 (10 entries)
bios0: vendor innotek GmbH version "VirtualBox" date 12/01/2006
bios0: innotek GmbH VirtualBox
acpi0 at bios0: rev 2
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP APIC SSDT
acpi0: wakeup devices
acpitimer0 at acpi0: 3579545 Hz, 32 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: AMD E2-6110 APU with AMD Radeon R2 Graphics, 1496.66 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,MWAIT,SSSE3,NXE,FFXSR,LONG,LAHF,AMCR8
cpu0: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 2MB
64b/line 16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
mtrr: CPU supports MTRRs but not enabled by BIOS
cpu0: apic clock running at 998MHz
ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpicpu0 at acpi0
acpibat0 at acpi0: BAT0 model "1" serial 0 type VBOX oem "innotek"
acpiac0 at acpi0: AC unit online
acpivideo0 at acpi0: GFX0
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02
pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00
pciide0 at pci0 dev 1 function 1 "Intel 82371AB IDE" rev 0x01: DMA,
channel 0 configured to compatibility, channel 1 configured to
compatibility
wd0 at pciide0 channel 0 drive 0: <VBOX HARDDISK>
wd0: 128-sector PIO, LBA, 92160MB, 188743680 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2
atapiscsi0 at pciide0 channel 1 drive 0
scsibus1 at atapiscsi0: 2 targets
cd0 at scsibus1 targ 0 lun 0: <VBOX, CD-ROM, 1.0> ATAPI 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
vga1 at pci0 dev 2 function 0 "InnoTek VirtualBox Graphics Adapter" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
virtio0 at pci0 dev 3 function 0 "Qumranet Virtio Network" rev 0x00:
Virtio Network Device
vio0 at virtio0: address 08:00:27:84:34:29
virtio0: apic 1 int 19
"InnoTek VirtualBox Guest Service" rev 0x00 at pci0 dev 4 function 0
not configured
auich0 at pci0 dev 5 function 0 "Intel 82801AA AC97" rev 0x01: apic 1
int 21, ICH AC97
ac97: codec id 0x83847600 (SigmaTel STAC9700)
audio0 at auich0
ohci0 at pci0 dev 6 function 0 "Apple Intrepid USB" rev 0x00: apic 1
int 22, version 1.0
piixpm0 at pci0 dev 7 function 0 "Intel 82371AB Power" rev 0x08: SMBus disabled
virtio1 at pci0 dev 8 function 0 "Qumranet Virtio Network" rev 0x00:
Virtio Network Device
vio1 at virtio1: address 08:00:27:6d:8c:5b
virtio1: apic 1 int 16
isa0 at pcib0
isadma0 at isa0
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
usb0 at ohci0: USB revision 1.0
uhub0 at usb0 "Apple OHCI root hub" rev 1.00/1.00 addr 1
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on wd0a (20305a8faedfcb24.a) swap on wd0b dump on wd0b

usbdevs:
Controller /dev/usb0:
addr 1: full speed, self powered, config 1, OHCI root hub(0x0000),
Apple(0x106b), rev 1.00
 port 1 powered
 port 2 powered
 port 3 powered
 port 4 powered
 port 5 powered
 port 6 powered
 port 7 powered
 port 8 powered