panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

classic Classic list List threaded Threaded
6 messages Options
Reply | Threaded
Open this post in threaded view
|

panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

Paul de Weerd
Yesterday I upgraded my home gateway to the latest snapshot available
from my local mirror.  After reboot, I get a panic as soon as
networking starts:

panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "../../../../net/pf.c", line 6569
Stopped at      Debugger+0x9:   leave
   TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
*28220  28220      0     0x14000      0x210    1  softnet
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
pf_test() at pf_test+0xe26
ipv4_input() at ipv4_input+0x240
ipintr() at ipintr+0x1e
netintr() at netintr+0x64
softintr_dispatch() at softintr_dispatch+0x8b
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: 6
taskq_thread+0x6c:
http://www.openbsd.org/ddb.html describes the minimum info required in bug
reports.  Insufficient info makes it difficult to find and fix bugs.
ddb{1}>

This machine is forwarding traffic for my local network.  v4 is
NATted with pf, v6 goes out over a SixXS tunnel (basically another
form of NAT ;)

I managed to restore service by copying a kernel from my laptop (which
runs a kernel I build myself due to a local diff to ahci.c).  This
kernel was built from source fetched on the 25th.

So, the crashing kernel is this:

OpenBSD 5.9-beta (GENERIC.MP) #1864: Mon Jan 25 19:11:29 MST 2016

Note that this kernel runs fine on other machines I have that are not
forwarding packets (e.g. my desktop workstation has pf enabled (by
default) but isn't a router).

The kernel that I currently run on my gateway is:

OpenBSD 5.9-beta (GENERIC.MP) #0: Mon Jan 25 21:18:59 CET 2016

It could be related to sashan's commit "plugging massive pf_state_key
leak" (http://marc.info/?l=openbsd-cvs&m=145374788727732&w=2), which I
don't have on my self-built kernel (yet).  The included dmesg output
below contains data from both kernels.

I'm at work now, but will try with more recent code tonight when I get
home.  Just wanted to make sure this is known.


In the attached serial console output, you'll also note some weird
behaviour after I try to reboot from ddb ("panic: sleep: softnet
failed insomnia").  Not sure what to make of that.

Script started on Sat Aug  8 10:52:57 2015
[weerd@rosti] $ cu -l /dev/cua00
Connected to /dev/cua00 (speed 9600)

ddb{1}>
ddb{1}>
ddb{1}> trace
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
pf_test() at pf_test+0xe26
ipv4_input() at ipv4_input+0x240
ipintr() at ipintr+0x1e
netintr() at netintr+0x64
softintr_dispatch() at softintr_dispatch+0x8b
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: -9
taskq_thread+0x6c:
ddb{1}> ps
   TID   PPID   PGRP    UID  S       FLAGS  WAIT          COMMAND
  1842  32003   1842      0  3    0x100083  ttyin         ksh
 26851  18843  29924      0  3        0x83  select        igmpproxy
 11900  24678  29924      0  3    0x1000b3  piperd        smtpctl
 18843  24678  29924      0  3    0x100089  pause         sh
 32003  10064  32003    864  3    0x10008b  pause         ksh
 19939  10064  19939    864  3    0x100083  ttyin         ksh
 10064      1  10064    864  3    0x100080  kqread        tmux
 24075   3564  24075    864  3    0x100083  kqread        tmux
 26814      1  26814    864  3    0x1000b0  select        ssh-agent
  3564      1   3564    864  3    0x10008b  pause         ksh
 21980      1  21980      0  3    0x100098  poll          cron
 24024      1  24024      0  3        0x80  kqread        apmd
 24522      1  24522    577  3        0x90  poll          openvpn
 24678  29924  29924      0  3    0x10008b  pause         sh
 29924  16930  29924      0  3    0x10008b  pause         ksh
 16930      1  16930      0  3    0x100080  kqread        tmux
 27740  10629  10629    593  3        0x90  kqread        nginx
 10629      1  10629      0  3        0x88  pause         nginx
 20379  32323  32323    606  3        0x90  kqread        ladvd
 32323      1  32323      0  3        0x80  kqread        ladvd
  3286      1   3286     79  3    0x100090  kqread        tftpd
  3822  26232  26232     95  3    0x100090  kqread        smtpd
 24766  26232  26232     95  3    0x100090  kqread        smtpd
 30534  26232  26232     95  3    0x100090  kqread        smtpd
 10305  26232  26232     95  3    0x100090  kqread        smtpd
 13623  26232  26232     95  3    0x100090  kqread        smtpd
 17997  26232  26232    103  3    0x100090  kqread        smtpd
 26232      1  26232      0  3    0x100080  kqread        smtpd
   613      1    613     92  3    0x100090  poll          rtadvd
 29514      1  29514     77  3    0x100090  poll          dhcpd
 17995      1  17995      0  3        0x80  select        sshd
 27249  21820  21820      0  3        0x80  nfsd          nfsd
 11323  21820  21820      0  3        0x80  nfsd          nfsd
 12530  21820  21820      0  3        0x80  nfsd          nfsd
 28521  21820  21820      0  3        0x80  nfsd          nfsd
 21820      1  21820      0  3        0x80  netcon        nfsd
 14435  22116  22116      0  3        0x80  poll          mountd
 22116      1  22116      0  3    0x100080  poll          mountd
  5092      1   5092     28  3    0x100090  poll          portmap
 12155  25340   7720     83  3    0x100090  poll          ntpd
 25340   7720   7720     83  3    0x100090  poll          ntpd
  7720      1   7720      0  3    0x100080  poll          ntpd
 28664      1  28664     53  3        0x90  kqread        unbound
   997   3869   9649     97  3    0x100090  kqread        nsd
  3869   9649   9649     97  3    0x100090  poll          nsd
  9649      1   9649     97  3    0x100090  kqread        nsd
 30372  29579  29579     73  3    0x100090  kqread        syslogd
 29579      1  29579      0  3    0x100080  netio         syslogd
  9990      1   9990     77  3    0x100090  poll          dhclient
 31344      1  31344      0  3        0x80  poll          dhclient
  2966      1   2966     77  3    0x100090  poll          dhclient
  7489      1   7489      0  3        0x80  poll          dhclient
  6621      0      0      0  3     0x14200  pgzero        zerothread
 30504      0      0      0  3     0x14200  aiodoned      aiodoned
 17596      0      0      0  3     0x14200  syncer        update
 24583      0      0      0  3     0x14200  cleaner       cleaner
 10324      0      0      0  3     0x14200  reaper        reaper
 21575      0      0      0  3     0x14200  pgdaemon      pagedaemon
   436      0      0      0  3     0x14200  bored         crypto
 23267      0      0      0  3     0x14200  pftm          pfpurge
  5132      0      0      0  3     0x14200  usbtsk        usbtask
  1236      0      0      0  3     0x14200  usbatsk       usbatsk
 14931      0      0      0  3     0x14200  bored         i915
 19412      0      0      0  3  0x40014200  acpi0         acpi0
  7117      0      0      0  7  0x40014200                idle3
 11845      0      0      0  7  0x40014200                idle2
 10343      0      0      0  3  0x40014200                idle1
 26313      0      0      0  3     0x14200  bored         sensors
*28220      0      0      0  7     0x14210                softnet
 25980      0      0      0  3     0x14200  bored         systqmp
 28371      0      0      0  3     0x14200  bored         systq
 25503      0      0      0  7  0x40014200                idle0
 29189      0      0      0  3     0x14200  bored         sbar
     1      0      1      0  3        0x82  wait          init
     0     -1      0      0  3     0x10200  scheduler     swapper
ddb{1}> show register
rdi                              0x1
rsi                            0x286
rbp               0xffff8000319f5a78
rbx               0xffffffff81717ef0    systqmp+0x2190
rdx                                0
rcx               0xffff800000078000
rax                              0x1
r8                0xffff8000319f5998
r9                                 0
r10               0xffff8000319f5948
r11                              0x8
r12                            0x100
r13               0xffff8000319f5a88
r14               0xffff8000000f3048
r15                              0x1
rip               0xffffffff81349e29    Debugger+0x9
cs                               0x8
rflags                         0x282
rsp               0xffff8000319f5a68
ss                              0x10
Debugger+0x9:   leave
ddb{1}> bo re
panic: sleep: softnet failed insomnia
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
panic() at panic+0xfe
sleep_setup() at sleep_setup+0xff
sched_barrier() at sched_barrier+0x9a
em_stop() at em_stop+0x42
em_ioctl() at em_ioctl+0x1b2
if_downall() at if_downall+0x8a
boot() at boot+0xe4
reboot() at reboot+0x26
db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
db_command() at db_command+0x13a
db_command_loop() at db_command_loop+0xb0
db_trap() at db_trap+0xe9
kdb_trap() at kdb_trap+0xc4
end trace frame: 0xffff8000319f5980, count: 0
ddb{1}> bo re
panic: sleep: softnet failed insomnia
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
panic() at panic+0xfe
sleep_setup() at sleep_setup+0xff
sched_barrier() at sched_barrier+0x9a
em_stop() at em_stop+0x42
em_ioctl() at em_ioctl+0x1b2
if_downall() at if_downall+0x8a
boot() at boot+0xe4
reboot() at reboot+0x26
db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
db_command() at db_command+0x13a
db_command_loop() at db_command_loop+0xb0
db_trap() at db_trap+0xe9
kdb_trap() at kdb_trap+0xc4
end trace frame: 0xffff8000319f5330, count: 0
ddb{1}> bo re
panic: sleep: softnet failed insomnia
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
panic() at panic+0xfe
sleep_setup() at sleep_setup+0xff
sched_barrier() at sched_barrier+0x9a
em_stop() at em_stop+0x42
em_ioctl() at em_ioctl+0x1b2
if_downall() at if_downall+0x8a
boot() at boot+0xe4
reboot() at reboot+0x26
db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
db_command() at db_command+0x13a
db_command_loop() at db_command_loop+0xb0
db_trap() at db_trap+0xe9
kdb_trap() at kdb_trap+0xc4
end trace frame: 0xffff8000319f4ce0, count: 0
ddb{1}> trace
Debugger() at Debugger+0x9
panic() at panic+0xfe
sleep_setup() at sleep_setup+0xff
sched_barrier() at sched_barrier+0x9a
em_stop() at em_stop+0x42
em_ioctl() at em_ioctl+0x1b2
if_downall() at if_downall+0x8a
boot() at boot+0xe4
reboot() at reboot+0x26
db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
db_command() at db_command+0x13a
db_command_loop() at db_command_loop+0xb0
db_trap() at db_trap+0xe9
kdb_trap() at kdb_trap+0xc4
trap() at trap+0x15d
--- trap (number 1) ---
Debugger() at Debugger+0x9
panic() at panic+0xfe
sleep_setup() at sleep_setup+0xff
sched_barrier() at sched_barrier+0x9a
em_stop() at em_stop+0x42
em_ioctl() at em_ioctl+0x1b2
if_downall() at if_downall+0x8a
boot() at boot+0xe4
reboot() at reboot+0x26
db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
db_command() at db_command+0x13a
db_command_loop() at db_command_loop+0xb0
db_trap() at db_trap+0xe9
kdb_trap() at kdb_trap+0xc4
trap() at trap+0x15d
--- trap (number 1) ---
Debugger() at Debugger+0x9
panic() at panic+0xfe
sleep_setup() at sleep_setup+0xff
sched_barrier() at sched_barrier+0x9a
em_stop() at em_stop+0x42
em_ioctl() at em_ioctl+0x1b2
if_downall() at if_downall+0x8a
boot() at boot+0xe4
reboot() at reboot+0x26
db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
db_command() at db_command+0x13a
db_command_loop() at db_command_loop+0xb0
db_trap() at db_trap+0xe9
kdb_trap() at kdb_trap+0xc4
trap() at trap+0x15d
--- trap (number 1) ---
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
pf_test() at pf_test+0xe26
ipv4_input() at ipv4_input+0x240
ipintr() at ipintr+0x1e
netintr() at netintr+0x64
softintr_dispatch() at softintr_dispatch+0x8b
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: -54
taskq_thread+0x6c:
ddb{1}> show panic
kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "
../../../../net/pf.c", line 6569
ddb{1}>
[EOT]
[weerd@rosti] $ ^D




OpenBSD 5.9-beta (GENERIC.MP) #1864: Mon Jan 25 19:11:29 MST 2016
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 2120876032 (2022MB)
avail mem = 2052464640 (1957MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xfc690 (23 entries)
bios0: vendor American Megatrends Inc. version "080015" date 09/15/2010
bios0: AXIOMTEK NA-320
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC MCFG OEMB GSCI SSDT
acpi0: wakeup devices P0P1(S4) PS2K(S4) PS2M(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4) EUSB(S4) P0P4(S4) P0P5(S4) P0P6(S4) P0P7(S4) P0P8(S4) P0P9(S4) USB4(S4) USB5(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.75 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu0: 512KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 166MHz
cpu0: mwait min=64, max=64, C-substates=0.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.51 MHz
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu1: 512KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.51 MHz
cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu2: 512KB 64b/line 8-way L2 cache
cpu2: smt 1, core 0, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.51 MHz
cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu3: 512KB 64b/line 8-way L2 cache
cpu3: smt 1, core 1, package 0
ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 1, remapped to apid 4
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (P0P4)
acpiprt2 at acpi0: bus 3 (P0P5)
acpiprt3 at acpi0: bus 4 (P0P6)
acpiprt4 at acpi0: bus 5 (P0P7)
acpiprt5 at acpi0: bus 6 (P0P8)
acpiprt6 at acpi0: bus 7 (P0P9)
acpicpu0 at acpi0: C1(1000@1 mwait.1)
acpicpu1 at acpi0: C1(1000@1 mwait.1)
acpicpu2 at acpi0: C1(@1 halt!)
acpicpu3 at acpi0: C1(@1 halt!)
acpibtn0 at acpi0: PWRB
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Pineview DMI" rev 0x02
inteldrm0 at pci0 dev 2 function 0 "Intel Pineview Video" rev 0x02
drm0 at inteldrm0
intagp0 at inteldrm0
agp0 at intagp0: aperture at 0xd0000000, size 0x10000000
inteldrm0: msi
Raw EDID:

00 00 00 00 00 00 00 00  01 01 01 01 01 01 01 01
03 03 03 03 03 03 03 03  07 07 07 07 07 07 07 07
0f 0f 0f 0f 0f 0f 0f 0f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

fc fc fc fc fc fc fc fc  f9 f9 f9 f9 f9 f9 f9 f9
f3 f3 f3 f3 f3 f3 f3 f3  e7 e7 e7 e7 e7 e7 e7 e7
cf cf cf cf cf cf cf cf  9f 9f 9f 9f 9f 9f 9f 9f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
drm:pid0:drm_do_get_edid *WARNING* VGA-1: EDID block 0 invalid.
inteldrm0: 1024x768
wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
ppb0 at pci0 dev 28 function 0 "Intel 82801H PCIE" rev 0x04: msi
pci1 at ppb0 bus 2
em0 at pci1 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:96
ppb1 at pci0 dev 28 function 1 "Intel 82801H PCIE" rev 0x04: msi
pci2 at ppb1 bus 3
em1 at pci2 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:97
ppb2 at pci0 dev 28 function 2 "Intel 82801H PCIE" rev 0x04: msi
pci3 at ppb2 bus 4
em2 at pci3 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:98
ppb3 at pci0 dev 28 function 3 "Intel 82801H PCIE" rev 0x04: msi
pci4 at ppb3 bus 5
em3 at pci4 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:99
ppb4 at pci0 dev 28 function 4 "Intel 82801H PCIE" rev 0x04: msi
pci5 at ppb4 bus 6
em4 at pci5 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9a
ppb5 at pci0 dev 28 function 5 "Intel 82801H PCIE" rev 0x04: msi
pci6 at ppb5 bus 7
em5 at pci6 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9b
uhci0 at pci0 dev 29 function 0 "Intel 82801H USB" rev 0x04: apic 4 int 23
uhci1 at pci0 dev 29 function 1 "Intel 82801H USB" rev 0x04: apic 4 int 19
uhci2 at pci0 dev 29 function 2 "Intel 82801H USB" rev 0x04: apic 4 int 18
ehci0 at pci0 dev 29 function 7 "Intel 82801H USB" rev 0x04: apic 4 int 23
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xf4
pci7 at ppb6 bus 1
pcib0 at pci0 dev 31 function 0 "Intel 82801HBM LPC" rev 0x04
pciide0 at pci0 dev 31 function 1 "Intel 82801HBM IDE" rev 0x04: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <SanDisk SDCFH-008G>
wd0: 1-sector PIO, LBA48, 7629MB, 15625216 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 4
pciide0: channel 1 ignored (disabled)
ahci0 at pci0 dev 31 function 2 "Intel 82801HBM AHCI" rev 0x04: msi, AHCI 1.1
scsibus1 at ahci0: 32 targets
ichiic0 at pci0 dev 31 function 3 "Intel 82801H SMBus" rev 0x04: apic 4 int 17
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 2GB DDR2 SDRAM non-parity PC2-6400CL6 SO-DIMM
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
lm1 at wbsio0 port 0xa00/8: W83627DHG
umass0 at uhub0 port 2 configuration 1 interface 0 "Western Digital My Passport 0748" rev 2.10/10.19 addr 2
umass0: using SCSI over Bulk-Only
scsibus2 at umass0: 2 targets, initiator 0
sd0 at scsibus2 targ 1 lun 0: <WD, My Passport 0748, 1019> SCSI4 0/direct fixed
sd0: 1907697MB, 512 bytes/sector, 3906963456 sectors
ses0 at scsibus2 targ 1 lun 1: <WD, SES Device, 1019> SCSI4 13/enclosure services fixed
ses0: unable to read enclosure configuration
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on wd0a (277347834ea1989b.a) swap on wd0b dump on wd0b
syncing disks... done
OpenBSD 5.9-beta (GENERIC.MP) #0: Mon Jan 25 21:18:59 CET 2016
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 2120876032 (2022MB)
avail mem = 2052435968 (1957MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xfc690 (23 entries)
bios0: vendor American Megatrends Inc. version "080015" date 09/15/2010
bios0: AXIOMTEK NA-320
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC MCFG OEMB GSCI SSDT
acpi0: wakeup devices P0P1(S4) PS2K(S4) PS2M(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4) EUSB(S4) P0P4(S4) P0P5(S4) P0P6(S4) P0P7(S4) P0P8(S4) P0P9(S4) USB4(S4) USB5(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.72 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu0: 512KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 166MHz
cpu0: mwait min=64, max=64, C-substates=0.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu1: 512KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu2: 512KB 64b/line 8-way L2 cache
cpu2: smt 1, core 0, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu3: 512KB 64b/line 8-way L2 cache
cpu3: smt 1, core 1, package 0
ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 1, remapped to apid 4
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (P0P4)
acpiprt2 at acpi0: bus 3 (P0P5)
acpiprt3 at acpi0: bus 4 (P0P6)
acpiprt4 at acpi0: bus 5 (P0P7)
acpiprt5 at acpi0: bus 6 (P0P8)
acpiprt6 at acpi0: bus 7 (P0P9)
acpicpu0 at acpi0: C1(1000@1 mwait.1)
acpicpu1 at acpi0: C1(1000@1 mwait.1)
acpicpu2 at acpi0: C1(@1 halt!)
acpicpu3 at acpi0: C1(@1 halt!)
acpibtn0 at acpi0: PWRB
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Pineview DMI" rev 0x02
inteldrm0 at pci0 dev 2 function 0 "Intel Pineview Video" rev 0x02
drm0 at inteldrm0
intagp0 at inteldrm0
agp0 at intagp0: aperture at 0xd0000000, size 0x10000000
inteldrm0: msi
Raw EDID:

00 00 00 00 00 00 00 00  01 01 01 01 01 01 01 01
03 03 03 03 03 03 03 03  07 07 07 07 07 07 07 07
0f 0f 0f 0f 0f 0f 0f 0f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
drm:pid0:drm_do_get_edid *WARNING* VGA-1: EDID block 0 invalid.
inteldrm0: 1024x768
wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
ppb0 at pci0 dev 28 function 0 "Intel 82801H PCIE" rev 0x04: msi
pci1 at ppb0 bus 2
em0 at pci1 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:96
ppb1 at pci0 dev 28 function 1 "Intel 82801H PCIE" rev 0x04: msi
pci2 at ppb1 bus 3
em1 at pci2 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:97
ppb2 at pci0 dev 28 function 2 "Intel 82801H PCIE" rev 0x04: msi
pci3 at ppb2 bus 4
em2 at pci3 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:98
ppb3 at pci0 dev 28 function 3 "Intel 82801H PCIE" rev 0x04: msi
pci4 at ppb3 bus 5
em3 at pci4 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:99
ppb4 at pci0 dev 28 function 4 "Intel 82801H PCIE" rev 0x04: msi
pci5 at ppb4 bus 6
em4 at pci5 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9a
ppb5 at pci0 dev 28 function 5 "Intel 82801H PCIE" rev 0x04: msi
pci6 at ppb5 bus 7
em5 at pci6 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9b
uhci0 at pci0 dev 29 function 0 "Intel 82801H USB" rev 0x04: apic 4 int 23
uhci1 at pci0 dev 29 function 1 "Intel 82801H USB" rev 0x04: apic 4 int 19
uhci2 at pci0 dev 29 function 2 "Intel 82801H USB" rev 0x04: apic 4 int 18
ehci0 at pci0 dev 29 function 7 "Intel 82801H USB" rev 0x04: apic 4 int 23
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xf4
pci7 at ppb6 bus 1
pcib0 at pci0 dev 31 function 0 "Intel 82801HBM LPC" rev 0x04
pciide0 at pci0 dev 31 function 1 "Intel 82801HBM IDE" rev 0x04: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <SanDisk SDCFH-008G>
wd0: 1-sector PIO, LBA48, 7629MB, 15625216 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 4
pciide0: channel 1 ignored (disabled)
ahci0 at pci0 dev 31 function 2 "Intel 82801HBM AHCI" rev 0x04: msi, AHCI 1.1
scsibus1 at ahci0: 32 targets
ichiic0 at pci0 dev 31 function 3 "Intel 82801H SMBus" rev 0x04: apic 4 int 17
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 2GB DDR2 SDRAM non-parity PC2-6400CL6 SO-DIMM
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
lm1 at wbsio0 port 0xa00/8: W83627DHG
vmm at mainbus0 not configured
umass0 at uhub0 port 2 configuration 1 interface 0 "Western Digital My Passport 0748" rev 2.10/10.19 addr 2
umass0: using SCSI over Bulk-Only
scsibus2 at umass0: 2 targets, initiator 0
sd0 at scsibus2 targ 1 lun 0: <WD, My Passport 0748, 1019> SCSI4 0/direct fixed
sd0: 1907697MB, 512 bytes/sector, 3906963456 sectors
ses0 at scsibus2 targ 1 lun 1: <WD, SES Device, 1019> SCSI4 13/enclosure services fixed
ses0: unable to read enclosure configuration
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on wd0a (277347834ea1989b.a) swap on wd0b dump on wd0b
sd1 at scsibus4 targ 1 lun 0: <OPENBSD, SR CRYPTO, 005> SCSI2 0/direct fixed
sd1: 1363155MB, 512 bytes/sector, 2791742978 sectors

--
>++++++++[<++++++++++>-]<+++++++.>+++[<------>-]<.>+++[<+
+++++++++++>-]<.>++[<------------>-]<+.--------------.[-]
                 http://www.weirdnet.nl/                 

Reply | Threaded
Open this post in threaded view
|

Re: panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

Paul de Weerd
I've just confirmed this still happens with the latest snap (OpenBSD
5.9-beta (GENERIC.MP) #1865: Thu Jan 28 20:18:15 MST 2016) and with a
kernel built from the latest sources (checkout from less than an hour
ago).


panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "../../../../net/pf.c", line 6569
Stopped at      Debugger+0x9:   leave
   TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
* 4209   4209      0     0x14000      0x210    2  softnet
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
pf_test() at pf_test+0xe26
ipv4_input() at ipv4_input+0x240
ipintr() at ipintr+0x1e
netintr() at netintr+0x64
softintr_dispatch() at softintr_dispatch+0x8b
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: 6
taskq_thread+0x6c:
http://www.openbsd.org/ddb.html describes the minimum info required in bug
reports.  Insufficient info makes it difficult to find and fix bugs.
ddb{2}> trace
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
pf_test() at pf_test+0xe26
ipv4_input() at ipv4_input+0x240
ipintr() at ipintr+0x1e
netintr() at netintr+0x64
softintr_dispatch() at softintr_dispatch+0x8b
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: -9
taskq_thread+0x6c:
ddb{2}> ps
   TID   PPID   PGRP    UID  S       FLAGS  WAIT          COMMAND
 15106  24221  15106      0  3    0x100083  ttyin         ksh
 27636      1  27636    864  3    0x1000b0  select        ssh-agent
 20306   6272  14576      0  3    0x100002  physio        fsck_ffs
 24221      1  24221    864  3    0x10008b  pause         ksh
  6272  14551  14576      0  3    0x100082  wait          fsck
 14551  14576  14576      0  3    0x10008a  pause         sh
 14576  28785  14576      0  3    0x10008a  pause         sh
 28785  13464  13464      0  3    0x100090  piperd        cron
 13464      1  13464      0  3    0x100098  poll          cron
 19397      1  19397      0  3        0x80  kqread        apmd
 31278      1  31278    577  3        0x90  poll          openvpn
 30775  22366  12214      0  3        0x83  select        igmpproxy
 12720  25665  12214      0  3    0x1000b3  piperd        smtpctl
 22366  25665  12214      0  3    0x100089  pause         sh
 25665  12214  12214      0  3    0x10008b  pause         sh
 12214  24512  12214      0  3    0x10008b  pause         ksh
 24512      1  24512      0  3    0x100080  kqread        tmux
 32450   4114   4114    593  3        0x90  kqread        nginx
  4114      1   4114      0  3        0x88  pause         nginx
 11249  11458  11458    606  3        0x90  kqread        ladvd
 11458      1  11458      0  3        0x80  kqread        ladvd
--db_more--            27742      1  27742     79  3    0x100090  kqread        tftpd
 22231  13616  13616     95  3    0x100090  kqread        smtpd
 20315  13616  13616     95  3    0x100090  kqread        smtpd
  6205  13616  13616     95  3    0x100090  kqread        smtpd
 18425  13616  13616     95  3    0x100090  kqread        smtpd
 30113  13616  13616     95  3    0x100090  kqread        smtpd
  6542  13616  13616    103  3    0x100090  kqread        smtpd
 13616      1  13616      0  3    0x100080  kqread        smtpd
 24439      1  24439     92  3    0x100090  poll          rtadvd
 10370      1  10370     77  3    0x100090  poll          dhcpd
   355      1    355      0  3        0x80  select        sshd
   714    113    113      0  3        0x80  nfsd          nfsd
  6345    113    113      0  3        0x80  nfsd          nfsd
 26495    113    113      0  3        0x80  nfsd          nfsd
 10070    113    113      0  3        0x80  nfsd          nfsd
   113      1    113      0  3        0x80  netcon        nfsd
   591   5654   5654      0  3        0x80  poll          mountd
  5654      1   5654      0  3    0x100080  poll          mountd
  2730      1   2730     28  3    0x100090  poll          portmap
 27951  26671  15507     83  3    0x100090  poll          ntpd
 26671  15507  15507     83  3    0x100090  poll          ntpd
 15507      1  15507      0  3    0x100080  poll          ntpd
  9828      1   9828     53  3        0x90  kqread        unbound
--db_more--            24431  24741  22053     97  3    0x100090  kqread        nsd
 24741  22053  22053     97  3    0x100090  poll          nsd
 22053      1  22053     97  3    0x100090  kqread        nsd
 13752   3638   3638     73  3    0x100090  kqread        syslogd
  3638      1   3638      0  3    0x100080  netio         syslogd
  3811      1   3811     77  3    0x100090  poll          dhclient
 21325      1  21325      0  3        0x80  poll          dhclient
 18503      1  18503     77  3    0x100090  poll          dhclient
    31      1     31      0  3        0x80  poll          dhclient
 29420      0      0      0  3     0x14200  pgzero        zerothread
  6174      0      0      0  3     0x14200  aiodoned      aiodoned
 26954      0      0      0  3     0x14200  syncer        update
  1307      0      0      0  3     0x14200  cleaner       cleaner
 26026      0      0      0  3     0x14200  reaper        reaper
 32154      0      0      0  3     0x14200  pgdaemon      pagedaemon
 22859      0      0      0  3     0x14200  bored         crypto
  2662      0      0      0  3     0x14200  pftm          pfpurge
 28255      0      0      0  3     0x14200  usbtsk        usbtask
  9400      0      0      0  3     0x14200  usbatsk       usbatsk
 28398      0      0      0  3     0x14200  bored         i915
 19451      0      0      0  3  0x40014200  acpi0         acpi0
  6603      0      0      0  7  0x40014200                idle3
  1106      0      0      0  3  0x40014200                idle2
--db_more--            15601      0      0      0  7  0x40014200                idle1
 16857      0      0      0  3     0x14200  bored         sensors
* 4209      0      0      0  7     0x14210                softnet
 31501      0      0      0  3     0x14200  bored         systqmp
   957      0      0      0  3     0x14200  bored         systq
 25766      0      0      0  7  0x40014200                idle0
 13939      0      0      0  3     0x14200  bored         sbar
     1      0      1      0  3        0x82  wait          init
     0     -1      0      0  3     0x10200  scheduler     swapper
ddb{2}> show register
rdi                              0x1
rsi                            0x286
rbp               0xffff8000319f5a78
rbx               0xffffffff8171ded0    systqmp+0x2190
rdx                                0
rcx               0xffff800000079000
rax                              0x1
r8                0xffff8000319f5998
r9                                 0
r10               0xffff8000319f5a08
r11               0xffffffff81088a00    comcnputc
r12                            0x100
r13               0xffff8000319f5a88
r14               0xffff8000000f3048
r15                              0x1
rip               0xffffffff81349c19    Debugger+0x9
cs                               0x8
rflags                         0x282
rsp               0xffff8000319f5a68
ss                              0x10
Debugger+0x9:   leave
ddb{2}> ddbcpu 0
No such command
ddb{2}> tr  ddbcpu 0
No such command
ddb{2}> mach ddbcpu 0
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
x86_ipi_handler() at x86_ipi_handler+0x76
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1c
--- interrupt ---
__mp_lock() at __mp_lock+0x42
softintr_dispatch() at softintr_dispatch+0x43
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: 9
0x8:
ddb{0}> mach ddbcpu 1
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
x86_ipi_handler() at x86_ipi_handler+0x76
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1c
--- interrupt ---
acpicpu_idle() at acpicpu_idle+0x22d
cpu_idle_cycle() at cpu_idle_cycle+0x10
end trace frame: 0x0, count: 10
ddb{1}> mach ddbcpu 2
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
panic() at panic+0xfe
__assert() at __assert+0x25
pf_test() at pf_test+0xe26
ipv4_input() at ipv4_input+0x240
ipintr() at ipintr+0x1e
netintr() at netintr+0x64
softintr_dispatch() at softintr_dispatch+0x8b
Xsoftnet() at Xsoftnet+0x1f
--- interrupt ---
end trace frame: 0x0, count: 6
taskq_thread+0x6c:
ddb{2}> mach ddbcpu 3
Stopped at      Debugger+0x9:   leave
Debugger() at Debugger+0x9
x86_ipi_handler() at x86_ipi_handler+0x76
Xresume_lapic_ipi() at Xresume_lapic_ipi+0x1c
--- interrupt ---
acpicpu_idle() at acpicpu_idle+0xdc
cpu_idle_cycle() at cpu_idle_cycle+0x10
end trace frame: 0x0, count: 10

Copyright (c) 1982, 1986, 1989, 1991, 1993
        The Regents of the University of California.  All rights reserved.
Copyright (c) 1995-2016 OpenBSD. All rights reserved.  http://www.OpenBSD.org

OpenBSD 5.9-beta (GENERIC.MP) #0: Fri Jan 29 20:14:05 CET 2016
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 2120876032 (2022MB)
avail mem = 2052431872 (1957MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xfc690 (23 entries)
bios0: vendor American Megatrends Inc. version "080015" date 09/15/2010
bios0: AXIOMTEK NA-320
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC MCFG OEMB GSCI SSDT
acpi0: wakeup devices P0P1(S4) PS2K(S4) PS2M(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4) EUSB(S4) P0P4(S4) P0P5(S4) P0P6(S4) P0P7(S4) P0P8(S4) P0P9(S4) USB4(S4) USB5(S4) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.72 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu0: 512KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 166MHz
cpu0: mwait min=64, max=64, C-substates=0.1, IBE
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu1: 512KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu2: 512KB 64b/line 8-way L2 cache
cpu2: smt 1, core 0, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
cpu3: 512KB 64b/line 8-way L2 cache
cpu3: smt 1, core 1, package 0
ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 1, remapped to apid 4
acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (P0P4)
acpiprt2 at acpi0: bus 3 (P0P5)
acpiprt3 at acpi0: bus 4 (P0P6)
acpiprt4 at acpi0: bus 5 (P0P7)
acpiprt5 at acpi0: bus 6 (P0P8)
acpiprt6 at acpi0: bus 7 (P0P9)
acpicpu0 at acpi0: C1(1000@1 mwait.1)
acpicpu1 at acpi0: C1(1000@1 mwait.1)
acpicpu2 at acpi0: C1(@1 halt!)
acpicpu3 at acpi0: C1(@1 halt!)
acpibtn0 at acpi0: PWRB
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel Pineview DMI" rev 0x02
inteldrm0 at pci0 dev 2 function 0 "Intel Pineview Video" rev 0x02
drm0 at inteldrm0
intagp0 at inteldrm0
agp0 at intagp0: aperture at 0xd0000000, size 0x10000000
inteldrm0: msi
Raw EDID:

00 00 00 00 00 00 00 00  01 01 01 01 01 01 01 01
03 03 03 03 03 03 03 03  07 07 07 07 07 07 07 07
0f 0f 0f 0f 0f 0f 0f 0f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
Raw EDID:

f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
drm:pid0:drm_do_get_edid *WARNING* VGA-1: EDID block 0 invalid.
inteldrm0: 1024x768
wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
wsdisplay0: screen 1-5 added (std, vt100 emulation)
ppb0 at pci0 dev 28 function 0 "Intel 82801H PCIE" rev 0x04: msi
pci1 at ppb0 bus 2
em0 at pci1 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:96
ppb1 at pci0 dev 28 function 1 "Intel 82801H PCIE" rev 0x04: msi
pci2 at ppb1 bus 3
em1 at pci2 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:97
ppb2 at pci0 dev 28 function 2 "Intel 82801H PCIE" rev 0x04: msi
pci3 at ppb2 bus 4
em2 at pci3 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:98
ppb3 at pci0 dev 28 function 3 "Intel 82801H PCIE" rev 0x04: msi
pci4 at ppb3 bus 5
em3 at pci4 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:99
ppb4 at pci0 dev 28 function 4 "Intel 82801H PCIE" rev 0x04: msi
pci5 at ppb4 bus 6
em4 at pci5 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9a
ppb5 at pci0 dev 28 function 5 "Intel 82801H PCIE" rev 0x04: msi
pci6 at ppb5 bus 7
em5 at pci6 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9b
uhci0 at pci0 dev 29 function 0 "Intel 82801H USB" rev 0x04: apic 4 int 23
uhci1 at pci0 dev 29 function 1 "Intel 82801H USB" rev 0x04: apic 4 int 19
uhci2 at pci0 dev 29 function 2 "Intel 82801H USB" rev 0x04: apic 4 int 18
ehci0 at pci0 dev 29 function 7 "Intel 82801H USB" rev 0x04: apic 4 int 23
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xf4
pci7 at ppb6 bus 1
pcib0 at pci0 dev 31 function 0 "Intel 82801HBM LPC" rev 0x04
pciide0 at pci0 dev 31 function 1 "Intel 82801HBM IDE" rev 0x04: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <SanDisk SDCFH-008G>
wd0: 1-sector PIO, LBA48, 7629MB, 15625216 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 4
pciide0: channel 1 ignored (disabled)
ahci0 at pci0 dev 31 function 2 "Intel 82801HBM AHCI" rev 0x04: msi, AHCI 1.1
scsibus1 at ahci0: 32 targets
ichiic0 at pci0 dev 31 function 3 "Intel 82801H SMBus" rev 0x04: apic 4 int 17
iic0 at ichiic0
spdmem0 at iic0 addr 0x50: 2GB DDR2 SDRAM non-parity PC2-6400CL6 SO-DIMM
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
lm1 at wbsio0 port 0xa00/8: W83627DHG
vmm at mainbus0 not configured
umass0 at uhub0 port 2 configuration 1 interface 0 "Western Digital My Passport 0748" rev 2.10/10.19 addr 2
umass0: using SCSI over Bulk-Only
scsibus2 at umass0: 2 targets, initiator 0
sd0 at scsibus2 targ 1 lun 0: <WD, My Passport 0748, 1019> SCSI4 0/direct fixed
sd0: 1907697MB, 512 bytes/sector, 3906963456 sectors
ses0 at scsibus2 targ 1 lun 1: <WD, SES Device, 1019> SCSI4 13/enclosure services fixed
ses0: unable to read enclosure configuration
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on wd0a (277347834ea1989b.a) swap on wd0b dump on wd0b

On Fri, Jan 29, 2016 at 12:31:24PM +0100, Paul de Weerd wrote:
| Yesterday I upgraded my home gateway to the latest snapshot available
| from my local mirror.  After reboot, I get a panic as soon as
| networking starts:
|
| panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "../../../../net/pf.c", line 6569
| Stopped at      Debugger+0x9:   leave
|    TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
| *28220  28220      0     0x14000      0x210    1  softnet
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| __assert() at __assert+0x25
| pf_test() at pf_test+0xe26
| ipv4_input() at ipv4_input+0x240
| ipintr() at ipintr+0x1e
| netintr() at netintr+0x64
| softintr_dispatch() at softintr_dispatch+0x8b
| Xsoftnet() at Xsoftnet+0x1f
| --- interrupt ---
| end trace frame: 0x0, count: 6
| taskq_thread+0x6c:
| http://www.openbsd.org/ddb.html describes the minimum info required in bug
| reports.  Insufficient info makes it difficult to find and fix bugs.
| ddb{1}>
|
| This machine is forwarding traffic for my local network.  v4 is
| NATted with pf, v6 goes out over a SixXS tunnel (basically another
| form of NAT ;)
|
| I managed to restore service by copying a kernel from my laptop (which
| runs a kernel I build myself due to a local diff to ahci.c).  This
| kernel was built from source fetched on the 25th.
|
| So, the crashing kernel is this:
|
| OpenBSD 5.9-beta (GENERIC.MP) #1864: Mon Jan 25 19:11:29 MST 2016
|
| Note that this kernel runs fine on other machines I have that are not
| forwarding packets (e.g. my desktop workstation has pf enabled (by
| default) but isn't a router).
|
| The kernel that I currently run on my gateway is:
|
| OpenBSD 5.9-beta (GENERIC.MP) #0: Mon Jan 25 21:18:59 CET 2016
|
| It could be related to sashan's commit "plugging massive pf_state_key
| leak" (http://marc.info/?l=openbsd-cvs&m=145374788727732&w=2), which I
| don't have on my self-built kernel (yet).  The included dmesg output
| below contains data from both kernels.
|
| I'm at work now, but will try with more recent code tonight when I get
| home.  Just wanted to make sure this is known.
|
|
| In the attached serial console output, you'll also note some weird
| behaviour after I try to reboot from ddb ("panic: sleep: softnet
| failed insomnia").  Not sure what to make of that.
|
| Script started on Sat Aug  8 10:52:57 2015
| [weerd@rosti] $ cu -l /dev/cua00
| Connected to /dev/cua00 (speed 9600)
|
| ddb{1}>
| ddb{1}>
| ddb{1}> trace
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| __assert() at __assert+0x25
| pf_test() at pf_test+0xe26
| ipv4_input() at ipv4_input+0x240
| ipintr() at ipintr+0x1e
| netintr() at netintr+0x64
| softintr_dispatch() at softintr_dispatch+0x8b
| Xsoftnet() at Xsoftnet+0x1f
| --- interrupt ---
| end trace frame: 0x0, count: -9
| taskq_thread+0x6c:
| ddb{1}> ps
|    TID   PPID   PGRP    UID  S       FLAGS  WAIT          COMMAND
|   1842  32003   1842      0  3    0x100083  ttyin         ksh
|  26851  18843  29924      0  3        0x83  select        igmpproxy
|  11900  24678  29924      0  3    0x1000b3  piperd        smtpctl
|  18843  24678  29924      0  3    0x100089  pause         sh
|  32003  10064  32003    864  3    0x10008b  pause         ksh
|  19939  10064  19939    864  3    0x100083  ttyin         ksh
|  10064      1  10064    864  3    0x100080  kqread        tmux
|  24075   3564  24075    864  3    0x100083  kqread        tmux
|  26814      1  26814    864  3    0x1000b0  select        ssh-agent
|   3564      1   3564    864  3    0x10008b  pause         ksh
|  21980      1  21980      0  3    0x100098  poll          cron
|  24024      1  24024      0  3        0x80  kqread        apmd
|  24522      1  24522    577  3        0x90  poll          openvpn
|  24678  29924  29924      0  3    0x10008b  pause         sh
|  29924  16930  29924      0  3    0x10008b  pause         ksh
|  16930      1  16930      0  3    0x100080  kqread        tmux
|  27740  10629  10629    593  3        0x90  kqread        nginx
|  10629      1  10629      0  3        0x88  pause         nginx
|  20379  32323  32323    606  3        0x90  kqread        ladvd
|  32323      1  32323      0  3        0x80  kqread        ladvd
|   3286      1   3286     79  3    0x100090  kqread        tftpd
|   3822  26232  26232     95  3    0x100090  kqread        smtpd
|  24766  26232  26232     95  3    0x100090  kqread        smtpd
|  30534  26232  26232     95  3    0x100090  kqread        smtpd
|  10305  26232  26232     95  3    0x100090  kqread        smtpd
|  13623  26232  26232     95  3    0x100090  kqread        smtpd
|  17997  26232  26232    103  3    0x100090  kqread        smtpd
|  26232      1  26232      0  3    0x100080  kqread        smtpd
|    613      1    613     92  3    0x100090  poll          rtadvd
|  29514      1  29514     77  3    0x100090  poll          dhcpd
|  17995      1  17995      0  3        0x80  select        sshd
|  27249  21820  21820      0  3        0x80  nfsd          nfsd
|  11323  21820  21820      0  3        0x80  nfsd          nfsd
|  12530  21820  21820      0  3        0x80  nfsd          nfsd
|  28521  21820  21820      0  3        0x80  nfsd          nfsd
|  21820      1  21820      0  3        0x80  netcon        nfsd
|  14435  22116  22116      0  3        0x80  poll          mountd
|  22116      1  22116      0  3    0x100080  poll          mountd
|   5092      1   5092     28  3    0x100090  poll          portmap
|  12155  25340   7720     83  3    0x100090  poll          ntpd
|  25340   7720   7720     83  3    0x100090  poll          ntpd
|   7720      1   7720      0  3    0x100080  poll          ntpd
|  28664      1  28664     53  3        0x90  kqread        unbound
|    997   3869   9649     97  3    0x100090  kqread        nsd
|   3869   9649   9649     97  3    0x100090  poll          nsd
|   9649      1   9649     97  3    0x100090  kqread        nsd
|  30372  29579  29579     73  3    0x100090  kqread        syslogd
|  29579      1  29579      0  3    0x100080  netio         syslogd
|   9990      1   9990     77  3    0x100090  poll          dhclient
|  31344      1  31344      0  3        0x80  poll          dhclient
|   2966      1   2966     77  3    0x100090  poll          dhclient
|   7489      1   7489      0  3        0x80  poll          dhclient
|   6621      0      0      0  3     0x14200  pgzero        zerothread
|  30504      0      0      0  3     0x14200  aiodoned      aiodoned
|  17596      0      0      0  3     0x14200  syncer        update
|  24583      0      0      0  3     0x14200  cleaner       cleaner
|  10324      0      0      0  3     0x14200  reaper        reaper
|  21575      0      0      0  3     0x14200  pgdaemon      pagedaemon
|    436      0      0      0  3     0x14200  bored         crypto
|  23267      0      0      0  3     0x14200  pftm          pfpurge
|   5132      0      0      0  3     0x14200  usbtsk        usbtask
|   1236      0      0      0  3     0x14200  usbatsk       usbatsk
|  14931      0      0      0  3     0x14200  bored         i915
|  19412      0      0      0  3  0x40014200  acpi0         acpi0
|   7117      0      0      0  7  0x40014200                idle3
|  11845      0      0      0  7  0x40014200                idle2
|  10343      0      0      0  3  0x40014200                idle1
|  26313      0      0      0  3     0x14200  bored         sensors
| *28220      0      0      0  7     0x14210                softnet
|  25980      0      0      0  3     0x14200  bored         systqmp
|  28371      0      0      0  3     0x14200  bored         systq
|  25503      0      0      0  7  0x40014200                idle0
|  29189      0      0      0  3     0x14200  bored         sbar
|      1      0      1      0  3        0x82  wait          init
|      0     -1      0      0  3     0x10200  scheduler     swapper
| ddb{1}> show register
| rdi                              0x1
| rsi                            0x286
| rbp               0xffff8000319f5a78
| rbx               0xffffffff81717ef0    systqmp+0x2190
| rdx                                0
| rcx               0xffff800000078000
| rax                              0x1
| r8                0xffff8000319f5998
| r9                                 0
| r10               0xffff8000319f5948
| r11                              0x8
| r12                            0x100
| r13               0xffff8000319f5a88
| r14               0xffff8000000f3048
| r15                              0x1
| rip               0xffffffff81349e29    Debugger+0x9
| cs                               0x8
| rflags                         0x282
| rsp               0xffff8000319f5a68
| ss                              0x10
| Debugger+0x9:   leave
| ddb{1}> bo re
| panic: sleep: softnet failed insomnia
| Stopped at      Debugger+0x9:   leave
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| sleep_setup() at sleep_setup+0xff
| sched_barrier() at sched_barrier+0x9a
| em_stop() at em_stop+0x42
| em_ioctl() at em_ioctl+0x1b2
| if_downall() at if_downall+0x8a
| boot() at boot+0xe4
| reboot() at reboot+0x26
| db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
| db_command() at db_command+0x13a
| db_command_loop() at db_command_loop+0xb0
| db_trap() at db_trap+0xe9
| kdb_trap() at kdb_trap+0xc4
| end trace frame: 0xffff8000319f5980, count: 0
| ddb{1}> bo re
| panic: sleep: softnet failed insomnia
| Stopped at      Debugger+0x9:   leave
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| sleep_setup() at sleep_setup+0xff
| sched_barrier() at sched_barrier+0x9a
| em_stop() at em_stop+0x42
| em_ioctl() at em_ioctl+0x1b2
| if_downall() at if_downall+0x8a
| boot() at boot+0xe4
| reboot() at reboot+0x26
| db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
| db_command() at db_command+0x13a
| db_command_loop() at db_command_loop+0xb0
| db_trap() at db_trap+0xe9
| kdb_trap() at kdb_trap+0xc4
| end trace frame: 0xffff8000319f5330, count: 0
| ddb{1}> bo re
| panic: sleep: softnet failed insomnia
| Stopped at      Debugger+0x9:   leave
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| sleep_setup() at sleep_setup+0xff
| sched_barrier() at sched_barrier+0x9a
| em_stop() at em_stop+0x42
| em_ioctl() at em_ioctl+0x1b2
| if_downall() at if_downall+0x8a
| boot() at boot+0xe4
| reboot() at reboot+0x26
| db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
| db_command() at db_command+0x13a
| db_command_loop() at db_command_loop+0xb0
| db_trap() at db_trap+0xe9
| kdb_trap() at kdb_trap+0xc4
| end trace frame: 0xffff8000319f4ce0, count: 0
| ddb{1}> trace
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| sleep_setup() at sleep_setup+0xff
| sched_barrier() at sched_barrier+0x9a
| em_stop() at em_stop+0x42
| em_ioctl() at em_ioctl+0x1b2
| if_downall() at if_downall+0x8a
| boot() at boot+0xe4
| reboot() at reboot+0x26
| db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
| db_command() at db_command+0x13a
| db_command_loop() at db_command_loop+0xb0
| db_trap() at db_trap+0xe9
| kdb_trap() at kdb_trap+0xc4
| trap() at trap+0x15d
| --- trap (number 1) ---
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| sleep_setup() at sleep_setup+0xff
| sched_barrier() at sched_barrier+0x9a
| em_stop() at em_stop+0x42
| em_ioctl() at em_ioctl+0x1b2
| if_downall() at if_downall+0x8a
| boot() at boot+0xe4
| reboot() at reboot+0x26
| db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
| db_command() at db_command+0x13a
| db_command_loop() at db_command_loop+0xb0
| db_trap() at db_trap+0xe9
| kdb_trap() at kdb_trap+0xc4
| trap() at trap+0x15d
| --- trap (number 1) ---
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| sleep_setup() at sleep_setup+0xff
| sched_barrier() at sched_barrier+0x9a
| em_stop() at em_stop+0x42
| em_ioctl() at em_ioctl+0x1b2
| if_downall() at if_downall+0x8a
| boot() at boot+0xe4
| reboot() at reboot+0x26
| db_boot_reboot_cmd() at db_boot_reboot_cmd+0x12
| db_command() at db_command+0x13a
| db_command_loop() at db_command_loop+0xb0
| db_trap() at db_trap+0xe9
| kdb_trap() at kdb_trap+0xc4
| trap() at trap+0x15d
| --- trap (number 1) ---
| Debugger() at Debugger+0x9
| panic() at panic+0xfe
| __assert() at __assert+0x25
| pf_test() at pf_test+0xe26
| ipv4_input() at ipv4_input+0x240
| ipintr() at ipintr+0x1e
| netintr() at netintr+0x64
| softintr_dispatch() at softintr_dispatch+0x8b
| Xsoftnet() at Xsoftnet+0x1f
| --- interrupt ---
| end trace frame: 0x0, count: -54
| taskq_thread+0x6c:
| ddb{1}> show panic
| kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "
| ../../../../net/pf.c", line 6569
| ddb{1}>
| [EOT]
| [weerd@rosti] $ ^D
|
|
|
|
| OpenBSD 5.9-beta (GENERIC.MP) #1864: Mon Jan 25 19:11:29 MST 2016
|     [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
| real mem = 2120876032 (2022MB)
| avail mem = 2052464640 (1957MB)
| mpath0 at root
| scsibus0 at mpath0: 256 targets
| mainbus0 at root
| bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xfc690 (23 entries)
| bios0: vendor American Megatrends Inc. version "080015" date 09/15/2010
| bios0: AXIOMTEK NA-320
| acpi0 at bios0: rev 2
| acpi0: sleep states S0 S1 S4 S5
| acpi0: tables DSDT FACP APIC MCFG OEMB GSCI SSDT
| acpi0: wakeup devices P0P1(S4) PS2K(S4) PS2M(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4) EUSB(S4) P0P4(S4) P0P5(S4) P0P6(S4) P0P7(S4) P0P8(S4) P0P9(S4) USB4(S4) USB5(S4) [...]
| acpitimer0 at acpi0: 3579545 Hz, 24 bits
| acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
| cpu0 at mainbus0: apid 0 (boot processor)
| cpu0: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.75 MHz
| cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu0: 512KB 64b/line 8-way L2 cache
| cpu0: smt 0, core 0, package 0
| mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
| cpu0: apic clock running at 166MHz
| cpu0: mwait min=64, max=64, C-substates=0.1, IBE
| cpu1 at mainbus0: apid 2 (application processor)
| cpu1: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.51 MHz
| cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu1: 512KB 64b/line 8-way L2 cache
| cpu1: smt 0, core 1, package 0
| cpu2 at mainbus0: apid 1 (application processor)
| cpu2: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.51 MHz
| cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu2: 512KB 64b/line 8-way L2 cache
| cpu2: smt 1, core 0, package 0
| cpu3 at mainbus0: apid 3 (application processor)
| cpu3: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.51 MHz
| cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu3: 512KB 64b/line 8-way L2 cache
| cpu3: smt 1, core 1, package 0
| ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
| ioapic0: misconfigured as apic 1, remapped to apid 4
| acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
| acpiprt0 at acpi0: bus 0 (PCI0)
| acpiprt1 at acpi0: bus 2 (P0P4)
| acpiprt2 at acpi0: bus 3 (P0P5)
| acpiprt3 at acpi0: bus 4 (P0P6)
| acpiprt4 at acpi0: bus 5 (P0P7)
| acpiprt5 at acpi0: bus 6 (P0P8)
| acpiprt6 at acpi0: bus 7 (P0P9)
| acpicpu0 at acpi0: C1(1000@1 mwait.1)
| acpicpu1 at acpi0: C1(1000@1 mwait.1)
| acpicpu2 at acpi0: C1(@1 halt!)
| acpicpu3 at acpi0: C1(@1 halt!)
| acpibtn0 at acpi0: PWRB
| pci0 at mainbus0 bus 0
| pchb0 at pci0 dev 0 function 0 "Intel Pineview DMI" rev 0x02
| inteldrm0 at pci0 dev 2 function 0 "Intel Pineview Video" rev 0x02
| drm0 at inteldrm0
| intagp0 at inteldrm0
| agp0 at intagp0: aperture at 0xd0000000, size 0x10000000
| inteldrm0: msi
| Raw EDID:
|
| 00 00 00 00 00 00 00 00  01 01 01 01 01 01 01 01
| 03 03 03 03 03 03 03 03  07 07 07 07 07 07 07 07
| 0f 0f 0f 0f 0f 0f 0f 0f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| Raw EDID:
|
| fc fc fc fc fc fc fc fc  f9 f9 f9 f9 f9 f9 f9 f9
| f3 f3 f3 f3 f3 f3 f3 f3  e7 e7 e7 e7 e7 e7 e7 e7
| cf cf cf cf cf cf cf cf  9f 9f 9f 9f 9f 9f 9f 9f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| Raw EDID:
|
| f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
| e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
| 8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| Raw EDID:
|
| f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
| e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
| 8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| drm:pid0:drm_do_get_edid *WARNING* VGA-1: EDID block 0 invalid.
| inteldrm0: 1024x768
| wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
| wsdisplay0: screen 1-5 added (std, vt100 emulation)
| ppb0 at pci0 dev 28 function 0 "Intel 82801H PCIE" rev 0x04: msi
| pci1 at ppb0 bus 2
| em0 at pci1 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:96
| ppb1 at pci0 dev 28 function 1 "Intel 82801H PCIE" rev 0x04: msi
| pci2 at ppb1 bus 3
| em1 at pci2 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:97
| ppb2 at pci0 dev 28 function 2 "Intel 82801H PCIE" rev 0x04: msi
| pci3 at ppb2 bus 4
| em2 at pci3 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:98
| ppb3 at pci0 dev 28 function 3 "Intel 82801H PCIE" rev 0x04: msi
| pci4 at ppb3 bus 5
| em3 at pci4 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:99
| ppb4 at pci0 dev 28 function 4 "Intel 82801H PCIE" rev 0x04: msi
| pci5 at ppb4 bus 6
| em4 at pci5 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9a
| ppb5 at pci0 dev 28 function 5 "Intel 82801H PCIE" rev 0x04: msi
| pci6 at ppb5 bus 7
| em5 at pci6 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9b
| uhci0 at pci0 dev 29 function 0 "Intel 82801H USB" rev 0x04: apic 4 int 23
| uhci1 at pci0 dev 29 function 1 "Intel 82801H USB" rev 0x04: apic 4 int 19
| uhci2 at pci0 dev 29 function 2 "Intel 82801H USB" rev 0x04: apic 4 int 18
| ehci0 at pci0 dev 29 function 7 "Intel 82801H USB" rev 0x04: apic 4 int 23
| usb0 at ehci0: USB revision 2.0
| uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
| ppb6 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xf4
| pci7 at ppb6 bus 1
| pcib0 at pci0 dev 31 function 0 "Intel 82801HBM LPC" rev 0x04
| pciide0 at pci0 dev 31 function 1 "Intel 82801HBM IDE" rev 0x04: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
| wd0 at pciide0 channel 0 drive 0: <SanDisk SDCFH-008G>
| wd0: 1-sector PIO, LBA48, 7629MB, 15625216 sectors
| wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 4
| pciide0: channel 1 ignored (disabled)
| ahci0 at pci0 dev 31 function 2 "Intel 82801HBM AHCI" rev 0x04: msi, AHCI 1.1
| scsibus1 at ahci0: 32 targets
| ichiic0 at pci0 dev 31 function 3 "Intel 82801H SMBus" rev 0x04: apic 4 int 17
| iic0 at ichiic0
| spdmem0 at iic0 addr 0x50: 2GB DDR2 SDRAM non-parity PC2-6400CL6 SO-DIMM
| usb1 at uhci0: USB revision 1.0
| uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
| usb2 at uhci1: USB revision 1.0
| uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
| usb3 at uhci2: USB revision 1.0
| uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
| isa0 at pcib0
| isadma0 at isa0
| com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
| com0: console
| com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
| pckbc0 at isa0 port 0x60/5 irq 1 irq 12
| pckbd0 at pckbc0 (kbd slot)
| wskbd0 at pckbd0: console keyboard, using wsdisplay0
| pcppi0 at isa0 port 0x61
| spkr0 at pcppi0
| wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
| lm1 at wbsio0 port 0xa00/8: W83627DHG
| umass0 at uhub0 port 2 configuration 1 interface 0 "Western Digital My Passport 0748" rev 2.10/10.19 addr 2
| umass0: using SCSI over Bulk-Only
| scsibus2 at umass0: 2 targets, initiator 0
| sd0 at scsibus2 targ 1 lun 0: <WD, My Passport 0748, 1019> SCSI4 0/direct fixed
| sd0: 1907697MB, 512 bytes/sector, 3906963456 sectors
| ses0 at scsibus2 targ 1 lun 1: <WD, SES Device, 1019> SCSI4 13/enclosure services fixed
| ses0: unable to read enclosure configuration
| vscsi0 at root
| scsibus3 at vscsi0: 256 targets
| softraid0 at root
| scsibus4 at softraid0: 256 targets
| root on wd0a (277347834ea1989b.a) swap on wd0b dump on wd0b
| syncing disks... done
| OpenBSD 5.9-beta (GENERIC.MP) #0: Mon Jan 25 21:18:59 CET 2016
|     [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
| real mem = 2120876032 (2022MB)
| avail mem = 2052435968 (1957MB)
| mpath0 at root
| scsibus0 at mpath0: 256 targets
| mainbus0 at root
| bios0 at mainbus0: SMBIOS rev. 2.6 @ 0xfc690 (23 entries)
| bios0: vendor American Megatrends Inc. version "080015" date 09/15/2010
| bios0: AXIOMTEK NA-320
| acpi0 at bios0: rev 2
| acpi0: sleep states S0 S1 S4 S5
| acpi0: tables DSDT FACP APIC MCFG OEMB GSCI SSDT
| acpi0: wakeup devices P0P1(S4) PS2K(S4) PS2M(S4) USB0(S4) USB1(S4) USB2(S4) USB3(S4) EUSB(S4) P0P4(S4) P0P5(S4) P0P6(S4) P0P7(S4) P0P8(S4) P0P9(S4) USB4(S4) USB5(S4) [...]
| acpitimer0 at acpi0: 3579545 Hz, 24 bits
| acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
| cpu0 at mainbus0: apid 0 (boot processor)
| cpu0: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.72 MHz
| cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu0: 512KB 64b/line 8-way L2 cache
| cpu0: smt 0, core 0, package 0
| mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
| cpu0: apic clock running at 166MHz
| cpu0: mwait min=64, max=64, C-substates=0.1, IBE
| cpu1 at mainbus0: apid 2 (application processor)
| cpu1: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
| cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu1: 512KB 64b/line 8-way L2 cache
| cpu1: smt 0, core 1, package 0
| cpu2 at mainbus0: apid 1 (application processor)
| cpu2: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
| cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu2: 512KB 64b/line 8-way L2 cache
| cpu2: smt 1, core 0, package 0
| cpu3 at mainbus0: apid 3 (application processor)
| cpu3: Intel(R) Atom(TM) CPU D510 @ 1.66GHz, 1662.50 MHz
| cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE,NXE,LONG,LAHF,PERF,SENSOR
| cpu3: 512KB 64b/line 8-way L2 cache
| cpu3: smt 1, core 1, package 0
| ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
| ioapic0: misconfigured as apic 1, remapped to apid 4
| acpimcfg0 at acpi0 addr 0xe0000000, bus 0-255
| acpiprt0 at acpi0: bus 0 (PCI0)
| acpiprt1 at acpi0: bus 2 (P0P4)
| acpiprt2 at acpi0: bus 3 (P0P5)
| acpiprt3 at acpi0: bus 4 (P0P6)
| acpiprt4 at acpi0: bus 5 (P0P7)
| acpiprt5 at acpi0: bus 6 (P0P8)
| acpiprt6 at acpi0: bus 7 (P0P9)
| acpicpu0 at acpi0: C1(1000@1 mwait.1)
| acpicpu1 at acpi0: C1(1000@1 mwait.1)
| acpicpu2 at acpi0: C1(@1 halt!)
| acpicpu3 at acpi0: C1(@1 halt!)
| acpibtn0 at acpi0: PWRB
| pci0 at mainbus0 bus 0
| pchb0 at pci0 dev 0 function 0 "Intel Pineview DMI" rev 0x02
| inteldrm0 at pci0 dev 2 function 0 "Intel Pineview Video" rev 0x02
| drm0 at inteldrm0
| intagp0 at inteldrm0
| agp0 at intagp0: aperture at 0xd0000000, size 0x10000000
| inteldrm0: msi
| Raw EDID:
|
| 00 00 00 00 00 00 00 00  01 01 01 01 01 01 01 01
| 03 03 03 03 03 03 03 03  07 07 07 07 07 07 07 07
| 0f 0f 0f 0f 0f 0f 0f 0f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| Raw EDID:
|
| f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
| e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
| 8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| Raw EDID:
|
| f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
| e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
| 8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| Raw EDID:
|
| f8 f8 f8 f8 f8 f8 f8 f8  f1 f1 f1 f1 f1 f1 f1 f1
| e3 e3 e3 e3 e3 e3 e3 e3  c7 c7 c7 c7 c7 c7 c7 c7
| 8f 8f 8f 8f 8f 8f 8f 8f  1f 1f 1f 1f 1f 1f 1f 1f
| 3f 3f 3f 3f 3f 3f 3f 3f  7f 7f 7f 7f 7f 7f 7f 7f
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| ff ff ff ff ff ff ff ff  ff ff ff ff ff ff ff ff
| drm:pid0:drm_do_get_edid *WARNING* VGA-1: EDID block 0 invalid.
| inteldrm0: 1024x768
| wsdisplay0 at inteldrm0 mux 1: console (std, vt100 emulation)
| wsdisplay0: screen 1-5 added (std, vt100 emulation)
| ppb0 at pci0 dev 28 function 0 "Intel 82801H PCIE" rev 0x04: msi
| pci1 at ppb0 bus 2
| em0 at pci1 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:96
| ppb1 at pci0 dev 28 function 1 "Intel 82801H PCIE" rev 0x04: msi
| pci2 at ppb1 bus 3
| em1 at pci2 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:97
| ppb2 at pci0 dev 28 function 2 "Intel 82801H PCIE" rev 0x04: msi
| pci3 at ppb2 bus 4
| em2 at pci3 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:98
| ppb3 at pci0 dev 28 function 3 "Intel 82801H PCIE" rev 0x04: msi
| pci4 at ppb3 bus 5
| em3 at pci4 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:99
| ppb4 at pci0 dev 28 function 4 "Intel 82801H PCIE" rev 0x04: msi
| pci5 at ppb4 bus 6
| em4 at pci5 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9a
| ppb5 at pci0 dev 28 function 5 "Intel 82801H PCIE" rev 0x04: msi
| pci6 at ppb5 bus 7
| em5 at pci6 dev 0 function 0 "Intel 82583V" rev 0x00: msi, address 00:60:e0:52:0f:9b
| uhci0 at pci0 dev 29 function 0 "Intel 82801H USB" rev 0x04: apic 4 int 23
| uhci1 at pci0 dev 29 function 1 "Intel 82801H USB" rev 0x04: apic 4 int 19
| uhci2 at pci0 dev 29 function 2 "Intel 82801H USB" rev 0x04: apic 4 int 18
| ehci0 at pci0 dev 29 function 7 "Intel 82801H USB" rev 0x04: apic 4 int 23
| usb0 at ehci0: USB revision 2.0
| uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
| ppb6 at pci0 dev 30 function 0 "Intel 82801BAM Hub-to-PCI" rev 0xf4
| pci7 at ppb6 bus 1
| pcib0 at pci0 dev 31 function 0 "Intel 82801HBM LPC" rev 0x04
| pciide0 at pci0 dev 31 function 1 "Intel 82801HBM IDE" rev 0x04: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
| wd0 at pciide0 channel 0 drive 0: <SanDisk SDCFH-008G>
| wd0: 1-sector PIO, LBA48, 7629MB, 15625216 sectors
| wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 4
| pciide0: channel 1 ignored (disabled)
| ahci0 at pci0 dev 31 function 2 "Intel 82801HBM AHCI" rev 0x04: msi, AHCI 1.1
| scsibus1 at ahci0: 32 targets
| ichiic0 at pci0 dev 31 function 3 "Intel 82801H SMBus" rev 0x04: apic 4 int 17
| iic0 at ichiic0
| spdmem0 at iic0 addr 0x50: 2GB DDR2 SDRAM non-parity PC2-6400CL6 SO-DIMM
| usb1 at uhci0: USB revision 1.0
| uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
| usb2 at uhci1: USB revision 1.0
| uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
| usb3 at uhci2: USB revision 1.0
| uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
| isa0 at pcib0
| isadma0 at isa0
| com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
| com0: console
| com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
| pckbc0 at isa0 port 0x60/5 irq 1 irq 12
| pckbd0 at pckbc0 (kbd slot)
| wskbd0 at pckbd0: console keyboard, using wsdisplay0
| pcppi0 at isa0 port 0x61
| spkr0 at pcppi0
| wbsio0 at isa0 port 0x2e/2: W83627DHG-P rev 0x73
| lm1 at wbsio0 port 0xa00/8: W83627DHG
| vmm at mainbus0 not configured
| umass0 at uhub0 port 2 configuration 1 interface 0 "Western Digital My Passport 0748" rev 2.10/10.19 addr 2
| umass0: using SCSI over Bulk-Only
| scsibus2 at umass0: 2 targets, initiator 0
| sd0 at scsibus2 targ 1 lun 0: <WD, My Passport 0748, 1019> SCSI4 0/direct fixed
| sd0: 1907697MB, 512 bytes/sector, 3906963456 sectors
| ses0 at scsibus2 targ 1 lun 1: <WD, SES Device, 1019> SCSI4 13/enclosure services fixed
| ses0: unable to read enclosure configuration
| vscsi0 at root
| scsibus3 at vscsi0: 256 targets
| softraid0 at root
| scsibus4 at softraid0: 256 targets
| root on wd0a (277347834ea1989b.a) swap on wd0b dump on wd0b
| sd1 at scsibus4 targ 1 lun 0: <OPENBSD, SR CRYPTO, 005> SCSI2 0/direct fixed
| sd1: 1363155MB, 512 bytes/sector, 2791742978 sectors
|
| --
| >++++++++[<++++++++++>-]<+++++++.>+++[<------>-]<.>+++[<+
| +++++++++++>-]<.>++[<------------>-]<+.--------------.[-]
|                  http://www.weirdnet.nl/                 
|

--
>++++++++[<++++++++++>-]<+++++++.>+++[<------>-]<.>+++[<+
+++++++++++>-]<.>++[<------------>-]<+.--------------.[-]
                 http://www.weirdnet.nl/                 

Reply | Threaded
Open this post in threaded view
|

Re: panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

Stuart Henderson-6
Replying to Paul's post and adding CCs, but Lars' post is also related
http://marc.info/?l=openbsd-bugs&m=145409292029625&w=2

Lars, and anyone else seeing this, what interface types do you have?
Any tunnels (gif gre tun vxlan, etc.) or anything else out of the ordinary
(bridges? don't know what else..)?

On 2016/01/30 01:09, Paul de Weerd wrote:

> I've just confirmed this still happens with the latest snap (OpenBSD
> 5.9-beta (GENERIC.MP) #1865: Thu Jan 28 20:18:15 MST 2016) and with a
> kernel built from the latest sources (checkout from less than an hour
> ago).
>
>
> panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "../../../../net/pf.c", line 6569
> Stopped at      Debugger+0x9:   leave
>    TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
> * 4209   4209      0     0x14000      0x210    2  softnet
> Debugger() at Debugger+0x9
> panic() at panic+0xfe
> __assert() at __assert+0x25
> pf_test() at pf_test+0xe26
> ipv4_input() at ipv4_input+0x240

So this is the code by the assert

6563         if (pd.dir == PF_IN && s && s->key[PF_SK_STACK]) {
6564                 /*
6565                  * ASSERT() below fires whenever caller forgets to call
6566                  * pf_pkt_addr_changed(). This might happen when we deal with
6567                  * IP tunnels.
6568                  */
6569                 KASSERT(pd.m->m_pkthdr.pf.statekey == NULL);
6570                 pd.m->m_pkthdr.pf.statekey =
6571                     pf_state_key_ref(s->key[PF_SK_STACK]);
6572         }

and pf_pkt_addr says

/*
 * must be called whenever any addressing information such as
 * address, port, protocol has changed
 */

ipv4_input isn't changing the packet address but maybe the 'IP tunnels'
comment is relevant, since I see openvpn is running on Paul's machine
which is going to either use tun(4) or tap(4).

However it is not running on Lars' machine.

igmpproxy is also running on Paul's so I am assuming there are likely to
be multicast packets floating around, probably with ip options. Don't
know if that is relevant.

We could do with figuring out what packets are triggering this.
Something like this before the KASSERT maybe,

if (pd.m->m_pkthdr.pf.statekey != NULL)
        printf("mbuf 0x%p\n", pd.m);

then "show mbuf 0x(addr)" in ddb...?

I have not yet run into this assert myself - I am running the 28 Jan
snapshot with vlan carp pppoe ipsec trunk..

Reply | Threaded
Open this post in threaded view
|

Re: panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

Paul de Weerd
On Sat, Jan 30, 2016 at 11:03:06AM +0000, Stuart Henderson wrote:
| Replying to Paul's post and adding CCs, but Lars' post is also related
| http://marc.info/?l=openbsd-bugs&m=145409292029625&w=2
|
| Lars, and anyone else seeing this, what interface types do you have?
| Any tunnels (gif gre tun vxlan, etc.) or anything else out of the ordinary
| (bridges? don't know what else..)?

I've got a bit more than the "just regular" home gateway setup:

em0, em1, em3: my home network
em2: upstream
bridge0: bridge for home network with em0, em1 and em3
bridge1: bridge for MAC address changing on vlan4 (only em2)
gif0: SixXS IPv6 tunnel
tun0: OpenVPN tunnel (remote end comes and goes)
vlan4: (parent em2) TV network from upstream (changed lladdr), DHCP
vlan34: (parent em2) internet access from upstream, DHCP

I NAT the home network out over vlan34.  The TV network needs the
igmpproxy to run, and indeed I have:

        pass on vlan4 proto igmp allow-opts

In my pf ruleset.  Of course, I also have multicast=YES in
/etc/rc.conf.local

| On 2016/01/30 01:09, Paul de Weerd wrote:
| > I've just confirmed this still happens with the latest snap (OpenBSD
| > 5.9-beta (GENERIC.MP) #1865: Thu Jan 28 20:18:15 MST 2016) and with a
| > kernel built from the latest sources (checkout from less than an hour
| > ago).
| >
| >
| > panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed: file "../../../../net/pf.c", line 6569
| > Stopped at      Debugger+0x9:   leave
| >    TID    PID    UID     PRFLAGS     PFLAGS  CPU  COMMAND
| > * 4209   4209      0     0x14000      0x210    2  softnet
| > Debugger() at Debugger+0x9
| > panic() at panic+0xfe
| > __assert() at __assert+0x25
| > pf_test() at pf_test+0xe26
| > ipv4_input() at ipv4_input+0x240
|
| So this is the code by the assert
|
| 6563         if (pd.dir == PF_IN && s && s->key[PF_SK_STACK]) {
| 6564                 /*
| 6565                  * ASSERT() below fires whenever caller forgets to call
| 6566                  * pf_pkt_addr_changed(). This might happen when we deal with
| 6567                  * IP tunnels.
| 6568                  */
| 6569                 KASSERT(pd.m->m_pkthdr.pf.statekey == NULL);
| 6570                 pd.m->m_pkthdr.pf.statekey =
| 6571                     pf_state_key_ref(s->key[PF_SK_STACK]);
| 6572         }
|
| and pf_pkt_addr says
|
| /*
|  * must be called whenever any addressing information such as
|  * address, port, protocol has changed
|  */
|
| ipv4_input isn't changing the packet address but maybe the 'IP tunnels'
| comment is relevant, since I see openvpn is running on Paul's machine
| which is going to either use tun(4) or tap(4).
|
| However it is not running on Lars' machine.
|
| igmpproxy is also running on Paul's so I am assuming there are likely to
| be multicast packets floating around, probably with ip options. Don't
| know if that is relevant.
|
| We could do with figuring out what packets are triggering this.
| Something like this before the KASSERT maybe,
|
| if (pd.m->m_pkthdr.pf.statekey != NULL)
| printf("mbuf 0x%p\n", pd.m);
|
| then "show mbuf 0x(addr)" in ddb...?
|
| I have not yet run into this assert myself - I am running the 28 Jan
| snapshot with vlan carp pppoe ipsec trunk..

--
>++++++++[<++++++++++>-]<+++++++.>+++[<------>-]<.>+++[<+
+++++++++++>-]<.>++[<------------>-]<+.--------------.[-]
                 http://www.weirdnet.nl/                 

Reply | Threaded
Open this post in threaded view
|

Re: panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

Dimitris Papastamos
In reply to this post by Stuart Henderson-6
On Sat, Jan 30, 2016 at 11:03:06AM +0000, Stuart Henderson wrote:
> Replying to Paul's post and adding CCs, but Lars' post is also related
> http://marc.info/?l=openbsd-bugs&m=145409292029625&w=2
>
> Lars, and anyone else seeing this, what interface types do you have?
> Any tunnels (gif gre tun vxlan, etc.) or anything else out of the ordinary
> (bridges? don't know what else..)?

I think I am also seeing this.  After remotely upgrading from source yesterday,
my router no longer boots.  I will be able to confirm in a week's time.

My setup is as follows.

* 1 physical external interface, re0
* 2 physical internal interfaces re1, axe0
* gif 6in4 tunnel with hurricane electric
* bridge with re1 + tap interfaces (tinc operates on tap)
* one tun interface (tinc on tun)
* pflow interface (sensor only, collector on another machine)

sysctl.conf

net.inet.ip.forwarding=0
net.inet6.ip6.forwarding=0

I cannot provide a dmesg or any details at the moment, so take this
with a grain of salt.  It could be unrelated.

Reply | Threaded
Open this post in threaded view
|

Re: panic: kernel diagnostic assertion "pd.m->m_pkthdr.pf.statekey == NULL" failed

Lars Noodén
In reply to this post by Stuart Henderson-6
On 1/30/16, Stuart Henderson <[hidden email]> wrote:
> Replying to Paul's post and adding CCs, but Lars' post is also related
> http://marc.info/?l=openbsd-bugs&m=145409292029625&w=2
>
> Lars, and anyone else seeing this, what interface types do you have?
> Any tunnels (gif gre tun vxlan, etc.) or anything else out of the ordinary
> (bridges? don't know what else..)?

One vether address and one bridge and one wireless card.  egress on
re0 which is a Traverse Viking card.  No outside net at the moment due
to power outages.

/Lars

lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 32768
        priority: 0
        groups: lo
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x7
        inet 127.0.0.1 netmask 0xff000000
vr0: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
mtu 1500
        lladdr 00:00:24:cb:a9:24
        description: Part of bridge0
        priority: 0
        media: Ethernet autoselect (none)
        status: no carrier
vr1: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
mtu 1500
        lladdr 00:00:24:cb:a9:25
        description: Part of bridge0
        priority: 0
        media: Ethernet autoselect (none)
        status: no carrier
vr2: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
mtu 1500
        lladdr 00:00:24:cb:a9:26
        description: Part of bridge0
        priority: 0
        media: Ethernet autoselect (none)
        status: no carrier
vr3: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
mtu 1500
        lladdr 00:00:24:cb:a9:27
        description: Part of bridge0
        priority: 0
        media: Ethernet autoselect (none)
        status: no carrier
re0: flags=18843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,MPSAFE> mtu 1500
        lladdr e4:7c:ce:cf:fd:b9
        priority: 0
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
enc0: flags=0<>
        priority: 0
        groups: enc
        status: active
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:12:0e:61:54:68
        priority: 4
        description: Part of bridge0
        priority: 0
        media: Ethernet autoselect (none)
        status: no carrier
vr3: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST>
mtu 1500
        lladdr 00:00:24:cb:a9:27
        description: Part of bridge0
        priority: 0
        media: Ethernet autoselect (none)
        status: no carrier
re0: flags=18843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,MPSAFE> mtu 1500
        lladdr e4:7c:ce:cf:fd:b9
        priority: 0
        media: Ethernet autoselect (100baseTX full-duplex)
        status: active
enc0: flags=0<>
        priority: 0
        groups: enc
        status: active
ral0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:12:0e:61:54:68
        priority: 4
        groups: wlan
        media: IEEE802.11 autoselect mode 11g hostap
        status: no network
        ieee80211: nwid x chan 11 bssid x wpakey x wpaprotos wpa1,wpa2
wpaakms psk wpaciphers tkip,ccmp wpagroupcipher tkip
        inet x netmask 0xffffff00 broadcast x
pflog1: flags=141<UP,RUNNING,PROMISC> mtu 33192
        priority: 0
        groups: pflog
vether0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr fe:e1:ba:d0:4e:44
        priority: 0
        groups: vether
        media: Ethernet autoselect
        status: active
        inet x netmask 0xffffff00 broadcast x
bridge0: flags=41<UP,RUNNING>
        groups: bridge
        priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto rstp
        vether0 flags=3<LEARNING,DISCOVER>
                port 10 ifpriority 0 ifcost 0
        vr0 flags=7<LEARNING,DISCOVER,BLOCKNONIP>
                port 1 ifpriority 0 ifcost 0
        vr1 flags=7<LEARNING,DISCOVER,BLOCKNONIP>
                port 2 ifpriority 0 ifcost 0
        vr2 flags=7<LEARNING,DISCOVER,BLOCKNONIP>
                port 3 ifpriority 0 ifcost 0
        vr3 flags=7<LEARNING,DISCOVER,BLOCKNONIP>
                port 4 ifpriority 0 ifcost 0
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33192
        priority: 0
        groups: pflog