Droping UDP traffic

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

Droping UDP traffic

Ivo Chutkin-2
Hello all,

I run small ISP. All routers and firewalls run OpenBSD.

Reticently, client started to complain that their Citrix based systems
started to drop connections.

After some research, they tested with iperf and clearly see droped UDP
packets between my routers.

After that, I made test lab, and the results are not very nice.

I tested with iperf between directly connected (via Juniper EX4200
switch) OpenBSD 6.7 amd64 MP, dmeseg of sender and server are below.

APU Sender--->Juniper EX4200 ---> Supermicro Server

iperf -c serverIP -u -t 60 -b 10M -p 5003 no drops

iperf -c serverIP -u -t 60 -b 20M -p 5003 average 2% drops

iperf -c serverIP -u -t 60 -b 30M -p 5003 avarage 15% drops

iperf -c serverIP -u -t 60 -b 40M -p 5003 avarage 20% drops

iperf -c serverIP -u -t 60 -b 50M -p 5003 between 25% drops


Also tested other lab with simmular results

APU Sender--->Juniper EX4200 ---> Supermicro Forwardig ----> TPlink
switch ----> Supermicro Server


Is this expected or know behavior?

Am I missing some tweaks?

Is the hardware not powerful enough?

Any ideas and suggestions are appreciated.

Thanks for your help,
Ivo


APU:
~ # dmesg
OpenBSD 6.7 (GENERIC.MP) #5: Tue Jul 21 13:50:07 MDT 2020
 
[hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4246003712 (4049MB)
avail mem = 4104691712 (3914MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xdf16d820 (7 entries)
bios0: vendor coreboot version "4.0" date 09/08/2014
bios0: PC Engines APU
acpi0 at bios0: ACPI 4.0
acpi0: sleep states S0 S1 S3 S4 S5
acpi0: tables DSDT FACP SPCR HPET APIC HEST SSDT SSDT SSDT
acpi0: wakeup devices AGPB(S4) HDMI(S4) PBR4(S4) PBR5(S4) PBR6(S4)
PBR7(S4) PE20(S4) PE21(S4) PE22(S4) PE23(S4) PIBR(S4) UOH1(S3) UOH2(S3)
UOH3(S3) UOH4(S3) UOH5(S3) [...]
acpitimer0 at acpi0: 3579545 Hz, 32 bits
acpihpet0 at acpi0: 14318180 Hz
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: AMD G-T40E Processor, 1000.14 MHz, 14-02-00
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
cpu0: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 512KB
64b/line 16-way L2 cache
cpu0: 8 4MB entries fully associative
cpu0: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
cpu0: apic clock running at 199MHz
cpu0: mwait min=64, max=64, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: AMD G-T40E Processor, 1000.01 MHz, 14-02-00
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
cpu1: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 512KB
64b/line 16-way L2 cache
cpu1: 8 4MB entries fully associative
cpu1: DTLB 40 4KB entries fully associative, 8 4MB entries fully associative
cpu1: smt 0, core 1, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 21, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus -1 (AGPB)
acpiprt2 at acpi0: bus -1 (HDMI)
acpiprt3 at acpi0: bus 1 (PBR4)
acpiprt4 at acpi0: bus 2 (PBR5)
acpiprt5 at acpi0: bus 3 (PBR6)
acpiprt6 at acpi0: bus -1 (PBR7)
acpiprt7 at acpi0: bus 5 (PE20)
acpiprt8 at acpi0: bus -1 (PE21)
acpiprt9 at acpi0: bus -1 (PE22)
acpiprt10 at acpi0: bus -1 (PE23)
acpiprt11 at acpi0: bus 4 (PIBR)
acpicpu0 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
acpicpu1 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
acpicmos0 at acpi0
acpibtn0 at acpi0: PWRB
cpu0: 1000 MHz: speeds: 1000 800 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "AMD 14h Host" rev 0x00
ppb0 at pci0 dev 4 function 0 "AMD 14h PCIE" rev 0x00: msi
pci1 at ppb0 bus 1
re0 at pci1 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
(0x2c00), msi, address 00:0d:b9:3d:ea:fc
rgephy0 at re0 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
ppb1 at pci0 dev 5 function 0 "AMD 14h PCIE" rev 0x00: msi
pci2 at ppb1 bus 2
re1 at pci2 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
(0x2c00), msi, address 00:0d:b9:3d:ea:fd
rgephy1 at re1 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
ppb2 at pci0 dev 6 function 0 "AMD 14h PCIE" rev 0x00: msi
pci3 at ppb2 bus 3
re2 at pci3 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
(0x2c00), msi, address 00:0d:b9:3d:ea:fe
rgephy2 at re2 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
ahci0 at pci0 dev 17 function 0 "ATI SBx00 SATA" rev 0x40: apic 2 int
19, AHCI 1.2
ahci0: port 0: 6.0Gb/s
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, ADATA SX300, 5.2.> naa.0000000000000000
sd0: 122104MB, 512 bytes/sector, 250069680 sectors, thin
ohci0 at pci0 dev 18 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
version 1.0, legacy support
ehci0 at pci0 dev 18 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "ATI EHCI root hub" rev
2.00/1.00 addr 1
ohci1 at pci0 dev 19 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
version 1.0, legacy support
ehci1 at pci0 dev 19 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "ATI EHCI root hub" rev
2.00/1.00 addr 1
piixpm0 at pci0 dev 20 function 0 "ATI SBx00 SMBus" rev 0x42: SMI
iic0 at piixpm0
pcib0 at pci0 dev 20 function 3 "ATI SB700 ISA" rev 0x40
ppb3 at pci0 dev 20 function 4 "ATI SB600 PCI" rev 0x40
pci4 at ppb3 bus 4
ohci2 at pci0 dev 20 function 5 "ATI SB700 USB" rev 0x00: apic 2 int 18,
version 1.0, legacy support
ppb4 at pci0 dev 21 function 0 "ATI SB800 PCIE" rev 0x00
pci5 at ppb4 bus 5
ohci3 at pci0 dev 22 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
version 1.0, legacy support
ehci2 at pci0 dev 22 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
usb2 at ehci2: USB revision 2.0
uhub2 at usb2 configuration 1 interface 0 "ATI EHCI root hub" rev
2.00/1.00 addr 1
pchb1 at pci0 dev 24 function 0 "AMD 14h Link Cfg" rev 0x43
pchb2 at pci0 dev 24 function 1 "AMD 14h Address Map" rev 0x00
pchb3 at pci0 dev 24 function 2 "AMD 14h DRAM Cfg" rev 0x00
km0 at pci0 dev 24 function 3 "AMD 14h Misc Cfg" rev 0x00
pchb4 at pci0 dev 24 function 4 "AMD 14h CPU Power" rev 0x00
pchb5 at pci0 dev 24 function 5 "AMD 14h Reserved" rev 0x00
pchb6 at pci0 dev 24 function 6 "AMD 14h NB Power" rev 0x00
pchb7 at pci0 dev 24 function 7 "AMD 14h Reserved" rev 0x00
usb3 at ohci0: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "ATI OHCI root hub" rev
1.00/1.00 addr 1
usb4 at ohci1: USB revision 1.0
uhub4 at usb4 configuration 1 interface 0 "ATI OHCI root hub" rev
1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
wbsio0 at isa0 port 0x2e/2: NCT5104D rev 0x52
usb5 at ohci2: USB revision 1.0
uhub5 at usb5 configuration 1 interface 0 "ATI OHCI root hub" rev
1.00/1.00 addr 1
usb6 at ohci3: USB revision 1.0
uhub6 at usb6 configuration 1 interface 0 "ATI OHCI root hub" rev
1.00/1.00 addr 1
vmm0 at mainbus0: SVM/RVI
umass0 at uhub2 port 1 configuration 1 interface 0 "Generic Flash Card
Reader/Writer" rev 2.01/1.00 addr 2
umass0: using SCSI over Bulk-Only
scsibus2 at umass0: 2 targets, initiator 0
sd1 at scsibus2 targ 1 lun 0: <Multiple, Card Reader, 1.00> removable
serial.058f6366058F63666485
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
scsibus4 at softraid0: 256 targets
root on sd0a (5ae321a3cf49f163.a) swap on sd0b dump on sd0b


Supermicro:

OpenBSD 6.7 (GENERIC.MP) #5: Tue Jul 21 13:50:07 MDT 2020
 
[hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 4276486144 (4078MB)
avail mem = 4134248448 (3942MB)
mpath0 at root
scsibus0 at mpath0: 256 targets
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xcfedf000 (39 entries)
bios0: vendor Phoenix Technologies LTD version "1.0b" date 07/24/2008
bios0: Supermicro X7SBi-LN4
acpi0 at bios0: ACPI 3.0
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP _MAR TCPA MCFG APIC BOOT SPCR ERST HEST BERT
EINJ SLIC SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT
acpi0: wakeup devices PXHA(S5) PEX_(S5) LAN_(S5) USB4(S5) USB5(S5)
USB7(S5) ESB2(S5) EXP1(S5) EXP2(S4) EXP3(S4) EXP4(S4) EXP5(S5) EXP6(S5)
USB1(S5) USB2(S5) USB3(S5) [...]
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimcfg0 at acpi0
acpimcfg0: addr 0xe0000000, bus 0-16
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.36 MHz, 06-0f-0b
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
cpu0: 4MB 64b/line 16-way L2 cache
cpu0: smt 0, core 0, package 0
mtrr: Pentium Pro MTRR support, 7 var ranges, 88 fixed ranges
cpu0: apic clock running at 265MHz
cpu0: mwait min=64, max=64, C-substates=0.2, IBE
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
cpu1: 4MB 64b/line 16-way L2 cache
cpu1: smt 0, core 1, package 0
cpu2 at mainbus0: apid 2 (application processor)
cpu2: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.02 MHz, 06-0f-0b
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
cpu2: 4MB 64b/line 16-way L2 cache
cpu2: smt 0, core 2, package 0
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
cpu3: 4MB 64b/line 16-way L2 cache
cpu3: smt 0, core 3, package 0
ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 5 pa 0xfecc0000, version 20, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 2 (PXHA)
acpiprt2 at acpi0: bus -1 (PEX_)
acpiprt3 at acpi0: bus 5 (EXP1)
acpiprt4 at acpi0: bus 7 (EXP2)
acpiprt5 at acpi0: bus 9 (EXP3)
acpiprt6 at acpi0: bus 11 (EXP4)
acpiprt7 at acpi0: bus -1 (EXP5)
acpiprt8 at acpi0: bus -1 (EXP6)
acpiprt9 at acpi0: bus 17 (PCIB)
acpicpu0 at acpi0: C1(@1 halt!), PSS
acpicpu1 at acpi0: C1(@1 halt!), PSS
acpicpu2 at acpi0: C1(@1 halt!), PSS
acpicpu3 at acpi0: C1(@1 halt!), PSS
acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
acpicmos0 at acpi0
"PNP0A05" at acpi0 not configured
acpibtn0 at acpi0: PWRB
acpivideo0 at acpi0: IGD0
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2394 MHz: speeds: 2400, 1600 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 3200/3210 Host" rev 0x01
ppb0 at pci0 dev 1 function 0 "Intel 3200/3210 PCIE" rev 0x01: msi
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel 6702PXH PCIE-PCIX" rev 0x09
pci2 at ppb1 bus 2
"Intel IOxAPIC" rev 0x09 at pci1 dev 0 function 1 not configured
uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 16
uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 17
uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 18
ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 18
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb2 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02: msi
pci3 at ppb2 bus 5
em0 at pci3 dev 0 function 0 "Intel 82573E" rev 0x03: msi, address
00:30:48:d4:8d:b8
ppb3 at pci0 dev 28 function 1 "Intel 82801I PCIE" rev 0x02: msi
pci4 at ppb3 bus 7
em1 at pci4 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
00:30:48:d4:8d:b9
ppb4 at pci0 dev 28 function 2 "Intel 82801I PCIE" rev 0x02: msi
pci5 at ppb4 bus 9
em2 at pci5 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
00:30:48:d4:8d:ba
ppb5 at pci0 dev 28 function 3 "Intel 82801I PCIE" rev 0x02: msi
pci6 at ppb5 bus 11
em3 at pci6 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
00:30:48:d4:8d:bb
uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 23
uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 22
uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 21
ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
2.00/1.00 addr 1
ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92
pci7 at ppb6 bus 17
radeondrm0 at pci7 dev 3 function 0 "ATI ES1000" rev 0x02
drm0 at radeondrm0
radeondrm0: apic 4 int 22
pciide0 at pci7 dev 4 function 0 "ITExpress IT8213F" rev 0x00: DMA
(unsupported), channel 0 wired to native-PCI, channel 1 wired to native-PCI
pciide0: using apic 4 int 23 for native-PCI interrupt
pciide0: channel 0 ignored (not responding; disabled or no drives?)
pciide0: channel 1 ignored (not responding; disabled or no drives?)
pcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02
pciide1 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA,
channel 0 configured to native-PCI, channel 1 configured to native-PCI
pciide1: using apic 4 int 17 for native-PCI interrupt
wd0 at pciide1 channel 0 drive 0: <TS32GSSD25S-M>
wd0: 1-sector PIO, LBA48, 30560MB, 62586880 sectors
wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: apic 4
int 17
iic0 at ichiic0
lm1 at iic0 addr 0x2d: W83627HF
wbng0 at iic0 addr 0x2f: w83793g
spdmem0 at iic0 addr 0x50: 1GB DDR2 SDRAM ECC PC2-5300CL5
spdmem1 at iic0 addr 0x51: 1GB DDR2 SDRAM ECC PC2-5300CL5
spdmem2 at iic0 addr 0x52: 1GB DDR2 SDRAM ECC PC2-5300CL5
spdmem3 at iic0 addr 0x53: 1GB DDR2 SDRAM ECC PC2-5300CL5
pciide2 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x02: DMA,
channel 0 wired to native-PCI, channel 1 wired to native-PCI
pciide2: using apic 4 int 18 for native-PCI interrupt
"Intel 82801I Thermal" rev 0x02 at pci0 dev 31 function 6 not configured
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb3 at uhci1: USB revision 1.0
uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb4 at uhci2: USB revision 1.0
uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb5 at uhci3: USB revision 1.0
uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb6 at uhci4: USB revision 1.0
uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
usb7 at uhci5: USB revision 1.0
uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev
1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5 irq 1 irq 12
pckbd0 at pckbc0 (kbd slot)
wskbd0 at pckbd0: console keyboard
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x41
lm2 at wbsio0 port 0x290/8: W83627HF
lm1: disabling sensors due to alias with lm2
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
scsibus2 at softraid0: 256 targets
root on wd0a (a310158b1ec5ebc2.a) swap on wd0b dump on wd0b
initializing kernel modesetting (RV100 0x1002:0x515E 0x15D9:0xD480 0x02).
radeondrm0: 1024x768, 16bpp
wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using wskbd0
wsdisplay0: screen 1-5 added (std, vt100 emulation)

Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Winter Paulson
Hey Ivo,

td;dr:

Some sysctl tuning might help, e. g.
https://calomel.org/network_performance.html

(first reference I found, maybe someone can provide other/better
suggestions).


Apart from that some more info would be helpfull:

- How fast is the connection and how fast does iperf get with UDP and
how fast with TCP compared to that? (to get an idea of what the machine
is able to push without packet loss. instead of tcp you could also test
with UDP and limit bandwidth till packetloss starts)

- Instead of hardware specs: how does the system perform when packet
loss happens (cpu load and so on)?

- What does the machine do, only routing or also firewalling
(statefull?) and other stuff (like DPI ;) )?

- Anything unusual in the logs?

Best,

Winter

On 30.07.20 15:10, Ivo Chutkin wrote:

> Hello all,
>
> I run small ISP. All routers and firewalls run OpenBSD.
>
> Reticently, client started to complain that their Citrix based systems
> started to drop connections.
>
> After some research, they tested with iperf and clearly see droped UDP
> packets between my routers.
>
> After that, I made test lab, and the results are not very nice.
>
> I tested with iperf between directly connected (via Juniper EX4200
> switch) OpenBSD 6.7 amd64 MP, dmeseg of sender and server are below.
>
> APU Sender--->Juniper EX4200 ---> Supermicro Server
>
> iperf -c serverIP -u -t 60 -b 10M -p 5003 no drops
>
> iperf -c serverIP -u -t 60 -b 20M -p 5003 average 2% drops
>
> iperf -c serverIP -u -t 60 -b 30M -p 5003 avarage 15% drops
>
> iperf -c serverIP -u -t 60 -b 40M -p 5003 avarage 20% drops
>
> iperf -c serverIP -u -t 60 -b 50M -p 5003 between 25% drops
>
>
> Also tested other lab with simmular results
>
> APU Sender--->Juniper EX4200 ---> Supermicro Forwardig ----> TPlink
> switch ----> Supermicro Server
>
>
> Is this expected or know behavior?
>
> Am I missing some tweaks?
>
> Is the hardware not powerful enough?
>
> Any ideas and suggestions are appreciated.
>
> Thanks for your help,
> Ivo
>
>
> APU:
> ~ # dmesg
> OpenBSD 6.7 (GENERIC.MP) #5: Tue Jul 21 13:50:07 MDT 2020
>
> [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>
> real mem = 4246003712 (4049MB)
> avail mem = 4104691712 (3914MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xdf16d820 (7 entries)
> bios0: vendor coreboot version "4.0" date 09/08/2014
> bios0: PC Engines APU
> acpi0 at bios0: ACPI 4.0
> acpi0: sleep states S0 S1 S3 S4 S5
> acpi0: tables DSDT FACP SPCR HPET APIC HEST SSDT SSDT SSDT
> acpi0: wakeup devices AGPB(S4) HDMI(S4) PBR4(S4) PBR5(S4) PBR6(S4)
> PBR7(S4) PE20(S4) PE21(S4) PE22(S4) PE23(S4) PIBR(S4) UOH1(S3) UOH2(S3)
> UOH3(S3) UOH4(S3) UOH5(S3) [...]
> acpitimer0 at acpi0: 3579545 Hz, 32 bits
> acpihpet0 at acpi0: 14318180 Hz
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: AMD G-T40E Processor, 1000.14 MHz, 14-02-00
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
>
> cpu0: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 512KB
> 64b/line 16-way L2 cache
> cpu0: 8 4MB entries fully associative
> cpu0: DTLB 40 4KB entries fully associative, 8 4MB entries fully
> associative
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
> cpu0: apic clock running at 199MHz
> cpu0: mwait min=64, max=64, IBE
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: AMD G-T40E Processor, 1000.01 MHz, 14-02-00
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
>
> cpu1: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 512KB
> 64b/line 16-way L2 cache
> cpu1: 8 4MB entries fully associative
> cpu1: DTLB 40 4KB entries fully associative, 8 4MB entries fully
> associative
> cpu1: smt 0, core 1, package 0
> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 21, 24 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus -1 (AGPB)
> acpiprt2 at acpi0: bus -1 (HDMI)
> acpiprt3 at acpi0: bus 1 (PBR4)
> acpiprt4 at acpi0: bus 2 (PBR5)
> acpiprt5 at acpi0: bus 3 (PBR6)
> acpiprt6 at acpi0: bus -1 (PBR7)
> acpiprt7 at acpi0: bus 5 (PE20)
> acpiprt8 at acpi0: bus -1 (PE21)
> acpiprt9 at acpi0: bus -1 (PE22)
> acpiprt10 at acpi0: bus -1 (PE23)
> acpiprt11 at acpi0: bus 4 (PIBR)
> acpicpu0 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
> acpicpu1 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> acpibtn0 at acpi0: PWRB
> cpu0: 1000 MHz: speeds: 1000 800 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "AMD 14h Host" rev 0x00
> ppb0 at pci0 dev 4 function 0 "AMD 14h PCIE" rev 0x00: msi
> pci1 at ppb0 bus 1
> re0 at pci1 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
> (0x2c00), msi, address 00:0d:b9:3d:ea:fc
> rgephy0 at re0 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
> ppb1 at pci0 dev 5 function 0 "AMD 14h PCIE" rev 0x00: msi
> pci2 at ppb1 bus 2
> re1 at pci2 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
> (0x2c00), msi, address 00:0d:b9:3d:ea:fd
> rgephy1 at re1 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
> ppb2 at pci0 dev 6 function 0 "AMD 14h PCIE" rev 0x00: msi
> pci3 at ppb2 bus 3
> re2 at pci3 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
> (0x2c00), msi, address 00:0d:b9:3d:ea:fe
> rgephy2 at re2 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
> ahci0 at pci0 dev 17 function 0 "ATI SBx00 SATA" rev 0x40: apic 2 int
> 19, AHCI 1.2
> ahci0: port 0: 6.0Gb/s
> scsibus1 at ahci0: 32 targets
> sd0 at scsibus1 targ 0 lun 0: <ATA, ADATA SX300, 5.2.> naa.0000000000000000
> sd0: 122104MB, 512 bytes/sector, 250069680 sectors, thin
> ohci0 at pci0 dev 18 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ehci0 at pci0 dev 18 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 configuration 1 interface 0 "ATI EHCI root hub" rev
> 2.00/1.00 addr 1
> ohci1 at pci0 dev 19 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ehci1 at pci0 dev 19 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "ATI EHCI root hub" rev
> 2.00/1.00 addr 1
> piixpm0 at pci0 dev 20 function 0 "ATI SBx00 SMBus" rev 0x42: SMI
> iic0 at piixpm0
> pcib0 at pci0 dev 20 function 3 "ATI SB700 ISA" rev 0x40
> ppb3 at pci0 dev 20 function 4 "ATI SB600 PCI" rev 0x40
> pci4 at ppb3 bus 4
> ohci2 at pci0 dev 20 function 5 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ppb4 at pci0 dev 21 function 0 "ATI SB800 PCIE" rev 0x00
> pci5 at ppb4 bus 5
> ohci3 at pci0 dev 22 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ehci2 at pci0 dev 22 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
> usb2 at ehci2: USB revision 2.0
> uhub2 at usb2 configuration 1 interface 0 "ATI EHCI root hub" rev
> 2.00/1.00 addr 1
> pchb1 at pci0 dev 24 function 0 "AMD 14h Link Cfg" rev 0x43
> pchb2 at pci0 dev 24 function 1 "AMD 14h Address Map" rev 0x00
> pchb3 at pci0 dev 24 function 2 "AMD 14h DRAM Cfg" rev 0x00
> km0 at pci0 dev 24 function 3 "AMD 14h Misc Cfg" rev 0x00
> pchb4 at pci0 dev 24 function 4 "AMD 14h CPU Power" rev 0x00
> pchb5 at pci0 dev 24 function 5 "AMD 14h Reserved" rev 0x00
> pchb6 at pci0 dev 24 function 6 "AMD 14h NB Power" rev 0x00
> pchb7 at pci0 dev 24 function 7 "AMD 14h Reserved" rev 0x00
> usb3 at ohci0: USB revision 1.0
> uhub3 at usb3 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> usb4 at ohci1: USB revision 1.0
> uhub4 at usb4 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com0: console
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> lpt0 at isa0 port 0x378/4 irq 7
> wbsio0 at isa0 port 0x2e/2: NCT5104D rev 0x52
> usb5 at ohci2: USB revision 1.0
> uhub5 at usb5 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> usb6 at ohci3: USB revision 1.0
> uhub6 at usb6 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> vmm0 at mainbus0: SVM/RVI
> umass0 at uhub2 port 1 configuration 1 interface 0 "Generic Flash Card
> Reader/Writer" rev 2.01/1.00 addr 2
> umass0: using SCSI over Bulk-Only
> scsibus2 at umass0: 2 targets, initiator 0
> sd1 at scsibus2 targ 1 lun 0: <Multiple, Card Reader, 1.00> removable
> serial.058f6366058F63666485
> vscsi0 at root
> scsibus3 at vscsi0: 256 targets
> softraid0 at root
> scsibus4 at softraid0: 256 targets
> root on sd0a (5ae321a3cf49f163.a) swap on sd0b dump on sd0b
>
>
> Supermicro:
>
> OpenBSD 6.7 (GENERIC.MP) #5: Tue Jul 21 13:50:07 MDT 2020
>
> [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>
> real mem = 4276486144 (4078MB)
> avail mem = 4134248448 (3942MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xcfedf000 (39 entries)
> bios0: vendor Phoenix Technologies LTD version "1.0b" date 07/24/2008
> bios0: Supermicro X7SBi-LN4
> acpi0 at bios0: ACPI 3.0
> acpi0: sleep states S0 S1 S4 S5
> acpi0: tables DSDT FACP _MAR TCPA MCFG APIC BOOT SPCR ERST HEST BERT
> EINJ SLIC SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT
> acpi0: wakeup devices PXHA(S5) PEX_(S5) LAN_(S5) USB4(S5) USB5(S5)
> USB7(S5) ESB2(S5) EXP1(S5) EXP2(S4) EXP3(S4) EXP4(S4) EXP5(S5) EXP6(S5)
> USB1(S5) USB2(S5) USB3(S5) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xe0000000, bus 0-16
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.36 MHz, 06-0f-0b
> cpu0:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>
> cpu0: 4MB 64b/line 16-way L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 7 var ranges, 88 fixed ranges
> cpu0: apic clock running at 265MHz
> cpu0: mwait min=64, max=64, C-substates=0.2, IBE
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
> cpu1:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>
> cpu1: 4MB 64b/line 16-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 2 (application processor)
> cpu2: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.02 MHz, 06-0f-0b
> cpu2:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>
> cpu2: 4MB 64b/line 16-way L2 cache
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 3 (application processor)
> cpu3: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
> cpu3:
> FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>
> cpu3: 4MB 64b/line 16-way L2 cache
> cpu3: smt 0, core 3, package 0
> ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
> ioapic1 at mainbus0: apid 5 pa 0xfecc0000, version 20, 24 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 2 (PXHA)
> acpiprt2 at acpi0: bus -1 (PEX_)
> acpiprt3 at acpi0: bus 5 (EXP1)
> acpiprt4 at acpi0: bus 7 (EXP2)
> acpiprt5 at acpi0: bus 9 (EXP3)
> acpiprt6 at acpi0: bus 11 (EXP4)
> acpiprt7 at acpi0: bus -1 (EXP5)
> acpiprt8 at acpi0: bus -1 (EXP6)
> acpiprt9 at acpi0: bus 17 (PCIB)
> acpicpu0 at acpi0: C1(@1 halt!), PSS
> acpicpu1 at acpi0: C1(@1 halt!), PSS
> acpicpu2 at acpi0: C1(@1 halt!), PSS
> acpicpu3 at acpi0: C1(@1 halt!), PSS
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> "PNP0A05" at acpi0 not configured
> acpibtn0 at acpi0: PWRB
> acpivideo0 at acpi0: IGD0
> ipmi at mainbus0 not configured
> cpu0: Enhanced SpeedStep 2394 MHz: speeds: 2400, 1600 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 3200/3210 Host" rev 0x01
> ppb0 at pci0 dev 1 function 0 "Intel 3200/3210 PCIE" rev 0x01: msi
> pci1 at ppb0 bus 1
> ppb1 at pci1 dev 0 function 0 "Intel 6702PXH PCIE-PCIX" rev 0x09
> pci2 at ppb1 bus 2
> "Intel IOxAPIC" rev 0x09 at pci1 dev 0 function 1 not configured
> uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 16
> uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 17
> uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 18
> ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 18
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
> 2.00/1.00 addr 1
> ppb2 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02: msi
> pci3 at ppb2 bus 5
> em0 at pci3 dev 0 function 0 "Intel 82573E" rev 0x03: msi, address
> 00:30:48:d4:8d:b8
> ppb3 at pci0 dev 28 function 1 "Intel 82801I PCIE" rev 0x02: msi
> pci4 at ppb3 bus 7
> em1 at pci4 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
> 00:30:48:d4:8d:b9
> ppb4 at pci0 dev 28 function 2 "Intel 82801I PCIE" rev 0x02: msi
> pci5 at ppb4 bus 9
> em2 at pci5 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
> 00:30:48:d4:8d:ba
> ppb5 at pci0 dev 28 function 3 "Intel 82801I PCIE" rev 0x02: msi
> pci6 at ppb5 bus 11
> em3 at pci6 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
> 00:30:48:d4:8d:bb
> uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 23
> uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 22
> uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 21
> ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 23
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
> 2.00/1.00 addr 1
> ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92
> pci7 at ppb6 bus 17
> radeondrm0 at pci7 dev 3 function 0 "ATI ES1000" rev 0x02
> drm0 at radeondrm0
> radeondrm0: apic 4 int 22
> pciide0 at pci7 dev 4 function 0 "ITExpress IT8213F" rev 0x00: DMA
> (unsupported), channel 0 wired to native-PCI, channel 1 wired to native-PCI
> pciide0: using apic 4 int 23 for native-PCI interrupt
> pciide0: channel 0 ignored (not responding; disabled or no drives?)
> pciide0: channel 1 ignored (not responding; disabled or no drives?)
> pcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02
> pciide1 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA,
> channel 0 configured to native-PCI, channel 1 configured to native-PCI
> pciide1: using apic 4 int 17 for native-PCI interrupt
> wd0 at pciide1 channel 0 drive 0: <TS32GSSD25S-M>
> wd0: 1-sector PIO, LBA48, 30560MB, 62586880 sectors
> wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
> ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: apic 4
> int 17
> iic0 at ichiic0
> lm1 at iic0 addr 0x2d: W83627HF
> wbng0 at iic0 addr 0x2f: w83793g
> spdmem0 at iic0 addr 0x50: 1GB DDR2 SDRAM ECC PC2-5300CL5
> spdmem1 at iic0 addr 0x51: 1GB DDR2 SDRAM ECC PC2-5300CL5
> spdmem2 at iic0 addr 0x52: 1GB DDR2 SDRAM ECC PC2-5300CL5
> spdmem3 at iic0 addr 0x53: 1GB DDR2 SDRAM ECC PC2-5300CL5
> pciide2 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x02: DMA,
> channel 0 wired to native-PCI, channel 1 wired to native-PCI
> pciide2: using apic 4 int 18 for native-PCI interrupt
> "Intel 82801I Thermal" rev 0x02 at pci0 dev 31 function 6 not configured
> usb2 at uhci0: USB revision 1.0
> uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb3 at uhci1: USB revision 1.0
> uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb4 at uhci2: USB revision 1.0
> uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb5 at uhci3: USB revision 1.0
> uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb6 at uhci4: USB revision 1.0
> uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb7 at uhci5: USB revision 1.0
> uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0: console keyboard
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x41
> lm2 at wbsio0 port 0x290/8: W83627HF
> lm1: disabling sensors due to alias with lm2
> vscsi0 at root
> scsibus1 at vscsi0: 256 targets
> softraid0 at root
> scsibus2 at softraid0: 256 targets
> root on wd0a (a310158b1ec5ebc2.a) swap on wd0b dump on wd0b
> initializing kernel modesetting (RV100 0x1002:0x515E 0x15D9:0xD480 0x02).
> radeondrm0: 1024x768, 16bpp
> wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using
> wskbd0
> wsdisplay0: screen 1-5 added (std, vt100 emulation)
>

Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Leslie
Winter Paulson <[hidden email]> wrote:
> Some sysctl tuning might help, e. g.
Check net.inet.udp.recvspace and net.inet.udp.sendspace.
Might be the only values that you have to adjust.

Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Tom Smyth
In reply to this post by Ivo Chutkin-2
Can you post your pf.conf...

If ur not using much filtering try pfctl -d  to diasble pf and repeat
testing

Run top -S  to see if sofnet is at 100%






On Thursday, 30 July 2020, Ivo Chutkin <[hidden email]> wrote:

> Hello all,
>
> I run small ISP. All routers and firewalls run OpenBSD.
>
> Reticently, client started to complain that their Citrix based systems
> started to drop connections.
>
> After some research, they tested with iperf and clearly see droped UDP
> packets between my routers.
>
> After that, I made test lab, and the results are not very nice.
>
> I tested with iperf between directly connected (via Juniper EX4200 switch)
> OpenBSD 6.7 amd64 MP, dmeseg of sender and server are below.
>
> APU Sender--->Juniper EX4200 ---> Supermicro Server
>
> iperf -c serverIP -u -t 60 -b 10M -p 5003 no drops
>
> iperf -c serverIP -u -t 60 -b 20M -p 5003 average 2% drops
>
> iperf -c serverIP -u -t 60 -b 30M -p 5003 avarage 15% drops
>
> iperf -c serverIP -u -t 60 -b 40M -p 5003 avarage 20% drops
>
> iperf -c serverIP -u -t 60 -b 50M -p 5003 between 25% drops
>
>
> Also tested other lab with simmular results
>
> APU Sender--->Juniper EX4200 ---> Supermicro Forwardig ----> TPlink switch
> ----> Supermicro Server
>
>
> Is this expected or know behavior?
>
> Am I missing some tweaks?
>
> Is the hardware not powerful enough?
>
> Any ideas and suggestions are appreciated.
>
> Thanks for your help,
> Ivo
>
>
> APU:
> ~ # dmesg
> OpenBSD 6.7 (GENERIC.MP) #5: Tue Jul 21 13:50:07 MDT 2020
>
> [hidden email]:/usr/src/sys/arch/amd64/compile/
> GENERIC.MP
> real mem = 4246003712 (4049MB)
> avail mem = 4104691712 (3914MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xdf16d820 (7 entries)
> bios0: vendor coreboot version "4.0" date 09/08/2014
> bios0: PC Engines APU
> acpi0 at bios0: ACPI 4.0
> acpi0: sleep states S0 S1 S3 S4 S5
> acpi0: tables DSDT FACP SPCR HPET APIC HEST SSDT SSDT SSDT
> acpi0: wakeup devices AGPB(S4) HDMI(S4) PBR4(S4) PBR5(S4) PBR6(S4)
> PBR7(S4) PE20(S4) PE21(S4) PE22(S4) PE23(S4) PIBR(S4) UOH1(S3) UOH2(S3)
> UOH3(S3) UOH4(S3) UOH5(S3) [...]
> acpitimer0 at acpi0: 3579545 Hz, 32 bits
> acpihpet0 at acpi0: 14318180 Hz
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: AMD G-T40E Processor, 1000.14 MHz, 14-02-00
> cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMO
> V,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,
> CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,
> CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
> cpu0: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 512KB
> 64b/line 16-way L2 cache
> cpu0: 8 4MB entries fully associative
> cpu0: DTLB 40 4KB entries fully associative, 8 4MB entries fully
> associative
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
> cpu0: apic clock running at 199MHz
> cpu0: mwait min=64, max=64, IBE
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: AMD G-T40E Processor, 1000.01 MHz, 14-02-00
> cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMO
> V,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,
> CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,
> CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
> cpu1: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache, 512KB
> 64b/line 16-way L2 cache
> cpu1: 8 4MB entries fully associative
> cpu1: DTLB 40 4KB entries fully associative, 8 4MB entries fully
> associative
> cpu1: smt 0, core 1, package 0
> ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 21, 24 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus -1 (AGPB)
> acpiprt2 at acpi0: bus -1 (HDMI)
> acpiprt3 at acpi0: bus 1 (PBR4)
> acpiprt4 at acpi0: bus 2 (PBR5)
> acpiprt5 at acpi0: bus 3 (PBR6)
> acpiprt6 at acpi0: bus -1 (PBR7)
> acpiprt7 at acpi0: bus 5 (PE20)
> acpiprt8 at acpi0: bus -1 (PE21)
> acpiprt9 at acpi0: bus -1 (PE22)
> acpiprt10 at acpi0: bus -1 (PE23)
> acpiprt11 at acpi0: bus 4 (PIBR)
> acpicpu0 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
> acpicpu1 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> acpibtn0 at acpi0: PWRB
> cpu0: 1000 MHz: speeds: 1000 800 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "AMD 14h Host" rev 0x00
> ppb0 at pci0 dev 4 function 0 "AMD 14h PCIE" rev 0x00: msi
> pci1 at ppb0 bus 1
> re0 at pci1 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
> (0x2c00), msi, address 00:0d:b9:3d:ea:fc
> rgephy0 at re0 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
> ppb1 at pci0 dev 5 function 0 "AMD 14h PCIE" rev 0x00: msi
> pci2 at ppb1 bus 2
> re1 at pci2 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
> (0x2c00), msi, address 00:0d:b9:3d:ea:fd
> rgephy1 at re1 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
> ppb2 at pci0 dev 6 function 0 "AMD 14h PCIE" rev 0x00: msi
> pci3 at ppb2 bus 3
> re2 at pci3 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
> (0x2c00), msi, address 00:0d:b9:3d:ea:fe
> rgephy2 at re2 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
> ahci0 at pci0 dev 17 function 0 "ATI SBx00 SATA" rev 0x40: apic 2 int 19,
> AHCI 1.2
> ahci0: port 0: 6.0Gb/s
> scsibus1 at ahci0: 32 targets
> sd0 at scsibus1 targ 0 lun 0: <ATA, ADATA SX300, 5.2.> naa.0000000000000000
> sd0: 122104MB, 512 bytes/sector, 250069680 sectors, thin
> ohci0 at pci0 dev 18 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ehci0 at pci0 dev 18 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 configuration 1 interface 0 "ATI EHCI root hub" rev
> 2.00/1.00 addr 1
> ohci1 at pci0 dev 19 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ehci1 at pci0 dev 19 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "ATI EHCI root hub" rev
> 2.00/1.00 addr 1
> piixpm0 at pci0 dev 20 function 0 "ATI SBx00 SMBus" rev 0x42: SMI
> iic0 at piixpm0
> pcib0 at pci0 dev 20 function 3 "ATI SB700 ISA" rev 0x40
> ppb3 at pci0 dev 20 function 4 "ATI SB600 PCI" rev 0x40
> pci4 at ppb3 bus 4
> ohci2 at pci0 dev 20 function 5 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ppb4 at pci0 dev 21 function 0 "ATI SB800 PCIE" rev 0x00
> pci5 at ppb4 bus 5
> ohci3 at pci0 dev 22 function 0 "ATI SB700 USB" rev 0x00: apic 2 int 18,
> version 1.0, legacy support
> ehci2 at pci0 dev 22 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
> usb2 at ehci2: USB revision 2.0
> uhub2 at usb2 configuration 1 interface 0 "ATI EHCI root hub" rev
> 2.00/1.00 addr 1
> pchb1 at pci0 dev 24 function 0 "AMD 14h Link Cfg" rev 0x43
> pchb2 at pci0 dev 24 function 1 "AMD 14h Address Map" rev 0x00
> pchb3 at pci0 dev 24 function 2 "AMD 14h DRAM Cfg" rev 0x00
> km0 at pci0 dev 24 function 3 "AMD 14h Misc Cfg" rev 0x00
> pchb4 at pci0 dev 24 function 4 "AMD 14h CPU Power" rev 0x00
> pchb5 at pci0 dev 24 function 5 "AMD 14h Reserved" rev 0x00
> pchb6 at pci0 dev 24 function 6 "AMD 14h NB Power" rev 0x00
> pchb7 at pci0 dev 24 function 7 "AMD 14h Reserved" rev 0x00
> usb3 at ohci0: USB revision 1.0
> uhub3 at usb3 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> usb4 at ohci1: USB revision 1.0
> uhub4 at usb4 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com0: console
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> lpt0 at isa0 port 0x378/4 irq 7
> wbsio0 at isa0 port 0x2e/2: NCT5104D rev 0x52
> usb5 at ohci2: USB revision 1.0
> uhub5 at usb5 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> usb6 at ohci3: USB revision 1.0
> uhub6 at usb6 configuration 1 interface 0 "ATI OHCI root hub" rev
> 1.00/1.00 addr 1
> vmm0 at mainbus0: SVM/RVI
> umass0 at uhub2 port 1 configuration 1 interface 0 "Generic Flash Card
> Reader/Writer" rev 2.01/1.00 addr 2
> umass0: using SCSI over Bulk-Only
> scsibus2 at umass0: 2 targets, initiator 0
> sd1 at scsibus2 targ 1 lun 0: <Multiple, Card Reader, 1.00> removable
> serial.058f6366058F63666485
> vscsi0 at root
> scsibus3 at vscsi0: 256 targets
> softraid0 at root
> scsibus4 at softraid0: 256 targets
> root on sd0a (5ae321a3cf49f163.a) swap on sd0b dump on sd0b
>
>
> Supermicro:
>
> OpenBSD 6.7 (GENERIC.MP) #5: Tue Jul 21 13:50:07 MDT 2020
>
> [hidden email]:/usr/src/sys/arch/amd64/compile/
> GENERIC.MP
> real mem = 4276486144 (4078MB)
> avail mem = 4134248448 (3942MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xcfedf000 (39 entries)
> bios0: vendor Phoenix Technologies LTD version "1.0b" date 07/24/2008
> bios0: Supermicro X7SBi-LN4
> acpi0 at bios0: ACPI 3.0
> acpi0: sleep states S0 S1 S4 S5
> acpi0: tables DSDT FACP _MAR TCPA MCFG APIC BOOT SPCR ERST HEST BERT EINJ
> SLIC SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT
> acpi0: wakeup devices PXHA(S5) PEX_(S5) LAN_(S5) USB4(S5) USB5(S5)
> USB7(S5) ESB2(S5) EXP1(S5) EXP2(S4) EXP3(S4) EXP4(S4) EXP5(S5) EXP6(S5)
> USB1(S5) USB2(S5) USB3(S5) [...]
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimcfg0 at acpi0
> acpimcfg0: addr 0xe0000000, bus 0-16
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.36 MHz, 06-0f-0b
> cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMO
> V,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,
> SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,
> NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
> cpu0: 4MB 64b/line 16-way L2 cache
> cpu0: smt 0, core 0, package 0
> mtrr: Pentium Pro MTRR support, 7 var ranges, 88 fixed ranges
> cpu0: apic clock running at 265MHz
> cpu0: mwait min=64, max=64, C-substates=0.2, IBE
> cpu1 at mainbus0: apid 1 (application processor)
> cpu1: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
> cpu1: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMO
> V,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,
> SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,
> NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
> cpu1: 4MB 64b/line 16-way L2 cache
> cpu1: smt 0, core 1, package 0
> cpu2 at mainbus0: apid 2 (application processor)
> cpu2: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.02 MHz, 06-0f-0b
> cpu2: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMO
> V,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,
> SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,
> NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
> cpu2: 4MB 64b/line 16-way L2 cache
> cpu2: smt 0, core 2, package 0
> cpu3 at mainbus0: apid 3 (application processor)
> cpu3: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
> cpu3: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMO
> V,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,
> SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,
> NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
> cpu3: 4MB 64b/line 16-way L2 cache
> cpu3: smt 0, core 3, package 0
> ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
> ioapic1 at mainbus0: apid 5 pa 0xfecc0000, version 20, 24 pins
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 2 (PXHA)
> acpiprt2 at acpi0: bus -1 (PEX_)
> acpiprt3 at acpi0: bus 5 (EXP1)
> acpiprt4 at acpi0: bus 7 (EXP2)
> acpiprt5 at acpi0: bus 9 (EXP3)
> acpiprt6 at acpi0: bus 11 (EXP4)
> acpiprt7 at acpi0: bus -1 (EXP5)
> acpiprt8 at acpi0: bus -1 (EXP6)
> acpiprt9 at acpi0: bus 17 (PCIB)
> acpicpu0 at acpi0: C1(@1 halt!), PSS
> acpicpu1 at acpi0: C1(@1 halt!), PSS
> acpicpu2 at acpi0: C1(@1 halt!), PSS
> acpicpu3 at acpi0: C1(@1 halt!), PSS
> acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> acpicmos0 at acpi0
> "PNP0A05" at acpi0 not configured
> acpibtn0 at acpi0: PWRB
> acpivideo0 at acpi0: IGD0
> ipmi at mainbus0 not configured
> cpu0: Enhanced SpeedStep 2394 MHz: speeds: 2400, 1600 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 3200/3210 Host" rev 0x01
> ppb0 at pci0 dev 1 function 0 "Intel 3200/3210 PCIE" rev 0x01: msi
> pci1 at ppb0 bus 1
> ppb1 at pci1 dev 0 function 0 "Intel 6702PXH PCIE-PCIX" rev 0x09
> pci2 at ppb1 bus 2
> "Intel IOxAPIC" rev 0x09 at pci1 dev 0 function 1 not configured
> uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 16
> uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 17
> uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 18
> ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 18
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
> 2.00/1.00 addr 1
> ppb2 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02: msi
> pci3 at ppb2 bus 5
> em0 at pci3 dev 0 function 0 "Intel 82573E" rev 0x03: msi, address
> 00:30:48:d4:8d:b8
> ppb3 at pci0 dev 28 function 1 "Intel 82801I PCIE" rev 0x02: msi
> pci4 at ppb3 bus 7
> em1 at pci4 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
> 00:30:48:d4:8d:b9
> ppb4 at pci0 dev 28 function 2 "Intel 82801I PCIE" rev 0x02: msi
> pci5 at ppb4 bus 9
> em2 at pci5 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
> 00:30:48:d4:8d:ba
> ppb5 at pci0 dev 28 function 3 "Intel 82801I PCIE" rev 0x02: msi
> pci6 at ppb5 bus 11
> em3 at pci6 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
> 00:30:48:d4:8d:bb
> uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 4 int 23
> uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 4 int 22
> uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 4 int 21
> ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 4 int 23
> usb1 at ehci1: USB revision 2.0
> uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
> 2.00/1.00 addr 1
> ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92
> pci7 at ppb6 bus 17
> radeondrm0 at pci7 dev 3 function 0 "ATI ES1000" rev 0x02
> drm0 at radeondrm0
> radeondrm0: apic 4 int 22
> pciide0 at pci7 dev 4 function 0 "ITExpress IT8213F" rev 0x00: DMA
> (unsupported), channel 0 wired to native-PCI, channel 1 wired to native-PCI
> pciide0: using apic 4 int 23 for native-PCI interrupt
> pciide0: channel 0 ignored (not responding; disabled or no drives?)
> pciide0: channel 1 ignored (not responding; disabled or no drives?)
> pcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02
> pciide1 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA,
> channel 0 configured to native-PCI, channel 1 configured to native-PCI
> pciide1: using apic 4 int 17 for native-PCI interrupt
> wd0 at pciide1 channel 0 drive 0: <TS32GSSD25S-M>
> wd0: 1-sector PIO, LBA48, 30560MB, 62586880 sectors
> wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
> ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02: apic 4
> int 17
> iic0 at ichiic0
> lm1 at iic0 addr 0x2d: W83627HF
> wbng0 at iic0 addr 0x2f: w83793g
> spdmem0 at iic0 addr 0x50: 1GB DDR2 SDRAM ECC PC2-5300CL5
> spdmem1 at iic0 addr 0x51: 1GB DDR2 SDRAM ECC PC2-5300CL5
> spdmem2 at iic0 addr 0x52: 1GB DDR2 SDRAM ECC PC2-5300CL5
> spdmem3 at iic0 addr 0x53: 1GB DDR2 SDRAM ECC PC2-5300CL5
> pciide2 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x02: DMA,
> channel 0 wired to native-PCI, channel 1 wired to native-PCI
> pciide2: using apic 4 int 18 for native-PCI interrupt
> "Intel 82801I Thermal" rev 0x02 at pci0 dev 31 function 6 not configured
> usb2 at uhci0: USB revision 1.0
> uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb3 at uhci1: USB revision 1.0
> uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb4 at uhci2: USB revision 1.0
> uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb5 at uhci3: USB revision 1.0
> uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb6 at uhci4: USB revision 1.0
> uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> usb7 at uhci5: USB revision 1.0
> uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev
> 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5 irq 1 irq 12
> pckbd0 at pckbc0 (kbd slot)
> wskbd0 at pckbd0: console keyboard
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x41
> lm2 at wbsio0 port 0x290/8: W83627HF
> lm1: disabling sensors due to alias with lm2
> vscsi0 at root
> scsibus1 at vscsi0: 256 targets
> softraid0 at root
> scsibus2 at softraid0: 256 targets
> root on wd0a (a310158b1ec5ebc2.a) swap on wd0b dump on wd0b
> initializing kernel modesetting (RV100 0x1002:0x515E 0x15D9:0xD480 0x02).
> radeondrm0: 1024x768, 16bpp
> wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation), using
> wskbd0
> wsdisplay0: screen 1-5 added (std, vt100 emulation)
>
>

--
Kindest regards,
Tom Smyth.
Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Ivo Chutkin-2
Hello guys,

Thanks for suggestions.

Tweacking sysctl

net.inet.udp.recvspace=131072
net.inet.udp.sendspace=131072

solved the problem.

Test between routers that started to drop packets over 10Mbit, now run
test at 100Mbit with less than 1% drops (over 50% before).

I run the folowing test:

APU 6.7 -->vlan-->Supermicro 6.7 (production)-->ospf over
vlan-->supermicro 6.4 (production)-->APU 6.4

softnet on supermicro 6.4 is about 22% and increses to 27-30% during the
test with 100Mbit.

On supermicro 6.7 it is about 2% and does not change during the tests.

Supermicro are identical sysytems as dmesg below, running 6.7 and 6.4.

To answer other questions, I do not do a lot filtering, just block ssh
on external interfaces. There is no noticable increase in cpu and momory
loads during the tests.

Routers run bgp and ospf but I do not think it is a problem.

After upgrading routers I will report back.

Thanks for your help.

Best regards,
Ivo



On 31.7.2020 г. 10:14 ч., Tom Smyth wrote:

> Can you post your pf.conf...
>
> If ur not using much filtering try pfctl -d  to diasble pf and repeat
> testing
>
> Run top -S  to see if sofnet is at 100%
>
>
>
>
>
>
> On Thursday, 30 July 2020, Ivo Chutkin <[hidden email]
> <mailto:[hidden email]>> wrote:
>
>     Hello all,
>
>     I run small ISP. All routers and firewalls run OpenBSD.
>
>     Reticently, client started to complain that their Citrix based
>     systems started to drop connections.
>
>     After some research, they tested with iperf and clearly see droped
>     UDP packets between my routers.
>
>     After that, I made test lab, and the results are not very nice.
>
>     I tested with iperf between directly connected (via Juniper EX4200
>     switch) OpenBSD 6.7 amd64 MP, dmeseg of sender and server are below.
>
>     APU Sender--->Juniper EX4200 ---> Supermicro Server
>
>     iperf -c serverIP -u -t 60 -b 10M -p 5003 no drops
>
>     iperf -c serverIP -u -t 60 -b 20M -p 5003 average 2% drops
>
>     iperf -c serverIP -u -t 60 -b 30M -p 5003 avarage 15% drops
>
>     iperf -c serverIP -u -t 60 -b 40M -p 5003 avarage 20% drops
>
>     iperf -c serverIP -u -t 60 -b 50M -p 5003 between 25% drops
>
>
>     Also tested other lab with simmular results
>
>     APU Sender--->Juniper EX4200 ---> Supermicro Forwardig ----> TPlink
>     switch ----> Supermicro Server
>
>
>     Is this expected or know behavior?
>
>     Am I missing some tweaks?
>
>     Is the hardware not powerful enough?
>
>     Any ideas and suggestions are appreciated.
>
>     Thanks for your help,
>     Ivo
>
>
>     APU:
>     ~ # dmesg
>     OpenBSD 6.7 (GENERIC.MP <http://GENERIC.MP>) #5: Tue Jul 21 13:50:07
>     MDT 2020
>
>     [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>     <http://GENERIC.MP>
>     real mem = 4246003712 (4049MB)
>     avail mem = 4104691712 (3914MB)
>     mpath0 at root
>     scsibus0 at mpath0: 256 targets
>     mainbus0 at root
>     bios0 at mainbus0: SMBIOS rev. 2.7 @ 0xdf16d820 (7 entries)
>     bios0: vendor coreboot version "4.0" date 09/08/2014
>     bios0: PC Engines APU
>     acpi0 at bios0: ACPI 4.0
>     acpi0: sleep states S0 S1 S3 S4 S5
>     acpi0: tables DSDT FACP SPCR HPET APIC HEST SSDT SSDT SSDT
>     acpi0: wakeup devices AGPB(S4) HDMI(S4) PBR4(S4) PBR5(S4) PBR6(S4)
>     PBR7(S4) PE20(S4) PE21(S4) PE22(S4) PE23(S4) PIBR(S4) UOH1(S3)
>     UOH2(S3) UOH3(S3) UOH4(S3) UOH5(S3) [...]
>     acpitimer0 at acpi0: 3579545 Hz, 32 bits
>     acpihpet0 at acpi0: 14318180 Hz
>     acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
>     cpu0 at mainbus0: apid 0 (boot processor)
>     cpu0: AMD G-T40E Processor, 1000.14 MHz, 14-02-00
>     cpu0:
>     FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
>     cpu0: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache,
>     512KB 64b/line 16-way L2 cache
>     cpu0: 8 4MB entries fully associative
>     cpu0: DTLB 40 4KB entries fully associative, 8 4MB entries fully
>     associative
>     cpu0: smt 0, core 0, package 0
>     mtrr: Pentium Pro MTRR support, 8 var ranges, 88 fixed ranges
>     cpu0: apic clock running at 199MHz
>     cpu0: mwait min=64, max=64, IBE
>     cpu1 at mainbus0: apid 1 (application processor)
>     cpu1: AMD G-T40E Processor, 1000.01 MHz, 14-02-00
>     cpu1:
>     FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,MWAIT,SSSE3,CX16,POPCNT,NXE,MMXX,FFXSR,PAGE1GB,RDTSCP,LONG,LAHF,CMPLEG,SVM,EAPICSP,AMCR8,ABM,SSE4A,MASSE,3DNOWP,IBS,SKINIT,ITSC
>     cpu1: 32KB 64b/line 2-way I-cache, 32KB 64b/line 8-way D-cache,
>     512KB 64b/line 16-way L2 cache
>     cpu1: 8 4MB entries fully associative
>     cpu1: DTLB 40 4KB entries fully associative, 8 4MB entries fully
>     associative
>     cpu1: smt 0, core 1, package 0
>     ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 21, 24 pins
>     acpiprt0 at acpi0: bus 0 (PCI0)
>     acpiprt1 at acpi0: bus -1 (AGPB)
>     acpiprt2 at acpi0: bus -1 (HDMI)
>     acpiprt3 at acpi0: bus 1 (PBR4)
>     acpiprt4 at acpi0: bus 2 (PBR5)
>     acpiprt5 at acpi0: bus 3 (PBR6)
>     acpiprt6 at acpi0: bus -1 (PBR7)
>     acpiprt7 at acpi0: bus 5 (PE20)
>     acpiprt8 at acpi0: bus -1 (PE21)
>     acpiprt9 at acpi0: bus -1 (PE22)
>     acpiprt10 at acpi0: bus -1 (PE23)
>     acpiprt11 at acpi0: bus 4 (PIBR)
>     acpicpu0 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
>     acpicpu1 at acpi0: C2(0@100 io@0x841), C1(@1 halt!), PSS
>     acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
>     acpicmos0 at acpi0
>     acpibtn0 at acpi0: PWRB
>     cpu0: 1000 MHz: speeds: 1000 800 MHz
>     pci0 at mainbus0 bus 0
>     pchb0 at pci0 dev 0 function 0 "AMD 14h Host" rev 0x00
>     ppb0 at pci0 dev 4 function 0 "AMD 14h PCIE" rev 0x00: msi
>     pci1 at ppb0 bus 1
>     re0 at pci1 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
>     (0x2c00), msi, address 00:0d:b9:3d:ea:fc
>     rgephy0 at re0 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
>     ppb1 at pci0 dev 5 function 0 "AMD 14h PCIE" rev 0x00: msi
>     pci2 at ppb1 bus 2
>     re1 at pci2 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
>     (0x2c00), msi, address 00:0d:b9:3d:ea:fd
>     rgephy1 at re1 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
>     ppb2 at pci0 dev 6 function 0 "AMD 14h PCIE" rev 0x00: msi
>     pci3 at ppb2 bus 3
>     re2 at pci3 dev 0 function 0 "Realtek 8168" rev 0x06: RTL8168E/8111E
>     (0x2c00), msi, address 00:0d:b9:3d:ea:fe
>     rgephy2 at re2 phy 7: RTL8169S/8110S/8211 PHY, rev. 4
>     ahci0 at pci0 dev 17 function 0 "ATI SBx00 SATA" rev 0x40: apic 2
>     int 19, AHCI 1.2
>     ahci0: port 0: 6.0Gb/s
>     scsibus1 at ahci0: 32 targets
>     sd0 at scsibus1 targ 0 lun 0: <ATA, ADATA SX300, 5.2.>
>     naa.0000000000000000
>     sd0: 122104MB, 512 bytes/sector, 250069680 sectors, thin
>     ohci0 at pci0 dev 18 function 0 "ATI SB700 USB" rev 0x00: apic 2 int
>     18, version 1.0, legacy support
>     ehci0 at pci0 dev 18 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
>     usb0 at ehci0: USB revision 2.0
>     uhub0 at usb0 configuration 1 interface 0 "ATI EHCI root hub" rev
>     2.00/1.00 addr 1
>     ohci1 at pci0 dev 19 function 0 "ATI SB700 USB" rev 0x00: apic 2 int
>     18, version 1.0, legacy support
>     ehci1 at pci0 dev 19 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
>     usb1 at ehci1: USB revision 2.0
>     uhub1 at usb1 configuration 1 interface 0 "ATI EHCI root hub" rev
>     2.00/1.00 addr 1
>     piixpm0 at pci0 dev 20 function 0 "ATI SBx00 SMBus" rev 0x42: SMI
>     iic0 at piixpm0
>     pcib0 at pci0 dev 20 function 3 "ATI SB700 ISA" rev 0x40
>     ppb3 at pci0 dev 20 function 4 "ATI SB600 PCI" rev 0x40
>     pci4 at ppb3 bus 4
>     ohci2 at pci0 dev 20 function 5 "ATI SB700 USB" rev 0x00: apic 2 int
>     18, version 1.0, legacy support
>     ppb4 at pci0 dev 21 function 0 "ATI SB800 PCIE" rev 0x00
>     pci5 at ppb4 bus 5
>     ohci3 at pci0 dev 22 function 0 "ATI SB700 USB" rev 0x00: apic 2 int
>     18, version 1.0, legacy support
>     ehci2 at pci0 dev 22 function 2 "ATI SB700 USB2" rev 0x00: apic 2 int 17
>     usb2 at ehci2: USB revision 2.0
>     uhub2 at usb2 configuration 1 interface 0 "ATI EHCI root hub" rev
>     2.00/1.00 addr 1
>     pchb1 at pci0 dev 24 function 0 "AMD 14h Link Cfg" rev 0x43
>     pchb2 at pci0 dev 24 function 1 "AMD 14h Address Map" rev 0x00
>     pchb3 at pci0 dev 24 function 2 "AMD 14h DRAM Cfg" rev 0x00
>     km0 at pci0 dev 24 function 3 "AMD 14h Misc Cfg" rev 0x00
>     pchb4 at pci0 dev 24 function 4 "AMD 14h CPU Power" rev 0x00
>     pchb5 at pci0 dev 24 function 5 "AMD 14h Reserved" rev 0x00
>     pchb6 at pci0 dev 24 function 6 "AMD 14h NB Power" rev 0x00
>     pchb7 at pci0 dev 24 function 7 "AMD 14h Reserved" rev 0x00
>     usb3 at ohci0: USB revision 1.0
>     uhub3 at usb3 configuration 1 interface 0 "ATI OHCI root hub" rev
>     1.00/1.00 addr 1
>     usb4 at ohci1: USB revision 1.0
>     uhub4 at usb4 configuration 1 interface 0 "ATI OHCI root hub" rev
>     1.00/1.00 addr 1
>     isa0 at pcib0
>     isadma0 at isa0
>     com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
>     com0: console
>     com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
>     pcppi0 at isa0 port 0x61
>     spkr0 at pcppi0
>     lpt0 at isa0 port 0x378/4 irq 7
>     wbsio0 at isa0 port 0x2e/2: NCT5104D rev 0x52
>     usb5 at ohci2: USB revision 1.0
>     uhub5 at usb5 configuration 1 interface 0 "ATI OHCI root hub" rev
>     1.00/1.00 addr 1
>     usb6 at ohci3: USB revision 1.0
>     uhub6 at usb6 configuration 1 interface 0 "ATI OHCI root hub" rev
>     1.00/1.00 addr 1
>     vmm0 at mainbus0: SVM/RVI
>     umass0 at uhub2 port 1 configuration 1 interface 0 "Generic Flash
>     Card Reader/Writer" rev 2.01/1.00 addr 2
>     umass0: using SCSI over Bulk-Only
>     scsibus2 at umass0: 2 targets, initiator 0
>     sd1 at scsibus2 targ 1 lun 0: <Multiple, Card Reader, 1.00>
>     removable serial.058f6366058F63666485
>     vscsi0 at root
>     scsibus3 at vscsi0: 256 targets
>     softraid0 at root
>     scsibus4 at softraid0: 256 targets
>     root on sd0a (5ae321a3cf49f163.a) swap on sd0b dump on sd0b
>
>
>     Supermicro:
>
>     OpenBSD 6.7 (GENERIC.MP <http://GENERIC.MP>) #5: Tue Jul 21 13:50:07
>     MDT 2020
>
>     [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
>     <http://GENERIC.MP>
>     real mem = 4276486144 (4078MB)
>     avail mem = 4134248448 (3942MB)
>     mpath0 at root
>     scsibus0 at mpath0: 256 targets
>     mainbus0 at root
>     bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xcfedf000 (39 entries)
>     bios0: vendor Phoenix Technologies LTD version "1.0b" date 07/24/2008
>     bios0: Supermicro X7SBi-LN4
>     acpi0 at bios0: ACPI 3.0
>     acpi0: sleep states S0 S1 S4 S5
>     acpi0: tables DSDT FACP _MAR TCPA MCFG APIC BOOT SPCR ERST HEST BERT
>     EINJ SLIC SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT SSDT
>     acpi0: wakeup devices PXHA(S5) PEX_(S5) LAN_(S5) USB4(S5) USB5(S5)
>     USB7(S5) ESB2(S5) EXP1(S5) EXP2(S4) EXP3(S4) EXP4(S4) EXP5(S5)
>     EXP6(S5) USB1(S5) USB2(S5) USB3(S5) [...]
>     acpitimer0 at acpi0: 3579545 Hz, 24 bits
>     acpimcfg0 at acpi0
>     acpimcfg0: addr 0xe0000000, bus 0-16
>     acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
>     cpu0 at mainbus0: apid 0 (boot processor)
>     cpu0: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.36 MHz, 06-0f-0b
>     cpu0:
>     FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>     cpu0: 4MB 64b/line 16-way L2 cache
>     cpu0: smt 0, core 0, package 0
>     mtrr: Pentium Pro MTRR support, 7 var ranges, 88 fixed ranges
>     cpu0: apic clock running at 265MHz
>     cpu0: mwait min=64, max=64, C-substates=0.2, IBE
>     cpu1 at mainbus0: apid 1 (application processor)
>     cpu1: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
>     cpu1:
>     FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>     cpu1: 4MB 64b/line 16-way L2 cache
>     cpu1: smt 0, core 1, package 0
>     cpu2 at mainbus0: apid 2 (application processor)
>     cpu2: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.02 MHz, 06-0f-0b
>     cpu2:
>     FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>     cpu2: 4MB 64b/line 16-way L2 cache
>     cpu2: smt 0, core 2, package 0
>     cpu3 at mainbus0: apid 3 (application processor)
>     cpu3: Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2394.00 MHz, 06-0f-0b
>     cpu3:
>     FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,DTES64,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,NXE,LONG,LAHF,PERF,SENSOR,MELTDOWN
>     cpu3: 4MB 64b/line 16-way L2 cache
>     cpu3: smt 0, core 3, package 0
>     ioapic0 at mainbus0: apid 4 pa 0xfec00000, version 20, 24 pins
>     ioapic1 at mainbus0: apid 5 pa 0xfecc0000, version 20, 24 pins
>     acpiprt0 at acpi0: bus 0 (PCI0)
>     acpiprt1 at acpi0: bus 2 (PXHA)
>     acpiprt2 at acpi0: bus -1 (PEX_)
>     acpiprt3 at acpi0: bus 5 (EXP1)
>     acpiprt4 at acpi0: bus 7 (EXP2)
>     acpiprt5 at acpi0: bus 9 (EXP3)
>     acpiprt6 at acpi0: bus 11 (EXP4)
>     acpiprt7 at acpi0: bus -1 (EXP5)
>     acpiprt8 at acpi0: bus -1 (EXP6)
>     acpiprt9 at acpi0: bus 17 (PCIB)
>     acpicpu0 at acpi0: C1(@1 halt!), PSS
>     acpicpu1 at acpi0: C1(@1 halt!), PSS
>     acpicpu2 at acpi0: C1(@1 halt!), PSS
>     acpicpu3 at acpi0: C1(@1 halt!), PSS
>     acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
>     acpicmos0 at acpi0
>     "PNP0A05" at acpi0 not configured
>     acpibtn0 at acpi0: PWRB
>     acpivideo0 at acpi0: IGD0
>     ipmi at mainbus0 not configured
>     cpu0: Enhanced SpeedStep 2394 MHz: speeds: 2400, 1600 MHz
>     pci0 at mainbus0 bus 0
>     pchb0 at pci0 dev 0 function 0 "Intel 3200/3210 Host" rev 0x01
>     ppb0 at pci0 dev 1 function 0 "Intel 3200/3210 PCIE" rev 0x01: msi
>     pci1 at ppb0 bus 1
>     ppb1 at pci1 dev 0 function 0 "Intel 6702PXH PCIE-PCIX" rev 0x09
>     pci2 at ppb1 bus 2
>     "Intel IOxAPIC" rev 0x09 at pci1 dev 0 function 1 not configured
>     uhci0 at pci0 dev 26 function 0 "Intel 82801I USB" rev 0x02: apic 4
>     int 16
>     uhci1 at pci0 dev 26 function 1 "Intel 82801I USB" rev 0x02: apic 4
>     int 17
>     uhci2 at pci0 dev 26 function 2 "Intel 82801I USB" rev 0x02: apic 4
>     int 18
>     ehci0 at pci0 dev 26 function 7 "Intel 82801I USB" rev 0x02: apic 4
>     int 18
>     usb0 at ehci0: USB revision 2.0
>     uhub0 at usb0 configuration 1 interface 0 "Intel EHCI root hub" rev
>     2.00/1.00 addr 1
>     ppb2 at pci0 dev 28 function 0 "Intel 82801I PCIE" rev 0x02: msi
>     pci3 at ppb2 bus 5
>     em0 at pci3 dev 0 function 0 "Intel 82573E" rev 0x03: msi, address
>     00:30:48:d4:8d:b8
>     ppb3 at pci0 dev 28 function 1 "Intel 82801I PCIE" rev 0x02: msi
>     pci4 at ppb3 bus 7
>     em1 at pci4 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
>     00:30:48:d4:8d:b9
>     ppb4 at pci0 dev 28 function 2 "Intel 82801I PCIE" rev 0x02: msi
>     pci5 at ppb4 bus 9
>     em2 at pci5 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
>     00:30:48:d4:8d:ba
>     ppb5 at pci0 dev 28 function 3 "Intel 82801I PCIE" rev 0x02: msi
>     pci6 at ppb5 bus 11
>     em3 at pci6 dev 0 function 0 "Intel 82573L" rev 0x00: msi, address
>     00:30:48:d4:8d:bb
>     uhci3 at pci0 dev 29 function 0 "Intel 82801I USB" rev 0x02: apic 4
>     int 23
>     uhci4 at pci0 dev 29 function 1 "Intel 82801I USB" rev 0x02: apic 4
>     int 22
>     uhci5 at pci0 dev 29 function 2 "Intel 82801I USB" rev 0x02: apic 4
>     int 21
>     ehci1 at pci0 dev 29 function 7 "Intel 82801I USB" rev 0x02: apic 4
>     int 23
>     usb1 at ehci1: USB revision 2.0
>     uhub1 at usb1 configuration 1 interface 0 "Intel EHCI root hub" rev
>     2.00/1.00 addr 1
>     ppb6 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x92
>     pci7 at ppb6 bus 17
>     radeondrm0 at pci7 dev 3 function 0 "ATI ES1000" rev 0x02
>     drm0 at radeondrm0
>     radeondrm0: apic 4 int 22
>     pciide0 at pci7 dev 4 function 0 "ITExpress IT8213F" rev 0x00: DMA
>     (unsupported), channel 0 wired to native-PCI, channel 1 wired to
>     native-PCI
>     pciide0: using apic 4 int 23 for native-PCI interrupt
>     pciide0: channel 0 ignored (not responding; disabled or no drives?)
>     pciide0: channel 1 ignored (not responding; disabled or no drives?)
>     pcib0 at pci0 dev 31 function 0 "Intel 82801IR LPC" rev 0x02
>     pciide1 at pci0 dev 31 function 2 "Intel 82801I SATA" rev 0x02: DMA,
>     channel 0 configured to native-PCI, channel 1 configured to native-PCI
>     pciide1: using apic 4 int 17 for native-PCI interrupt
>     wd0 at pciide1 channel 0 drive 0: <TS32GSSD25S-M>
>     wd0: 1-sector PIO, LBA48, 30560MB, 62586880 sectors
>     wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
>     ichiic0 at pci0 dev 31 function 3 "Intel 82801I SMBus" rev 0x02:
>     apic 4 int 17
>     iic0 at ichiic0
>     lm1 at iic0 addr 0x2d: W83627HF
>     wbng0 at iic0 addr 0x2f: w83793g
>     spdmem0 at iic0 addr 0x50: 1GB DDR2 SDRAM ECC PC2-5300CL5
>     spdmem1 at iic0 addr 0x51: 1GB DDR2 SDRAM ECC PC2-5300CL5
>     spdmem2 at iic0 addr 0x52: 1GB DDR2 SDRAM ECC PC2-5300CL5
>     spdmem3 at iic0 addr 0x53: 1GB DDR2 SDRAM ECC PC2-5300CL5
>     pciide2 at pci0 dev 31 function 5 "Intel 82801I SATA" rev 0x02: DMA,
>     channel 0 wired to native-PCI, channel 1 wired to native-PCI
>     pciide2: using apic 4 int 18 for native-PCI interrupt
>     "Intel 82801I Thermal" rev 0x02 at pci0 dev 31 function 6 not configured
>     usb2 at uhci0: USB revision 1.0
>     uhub2 at usb2 configuration 1 interface 0 "Intel UHCI root hub" rev
>     1.00/1.00 addr 1
>     usb3 at uhci1: USB revision 1.0
>     uhub3 at usb3 configuration 1 interface 0 "Intel UHCI root hub" rev
>     1.00/1.00 addr 1
>     usb4 at uhci2: USB revision 1.0
>     uhub4 at usb4 configuration 1 interface 0 "Intel UHCI root hub" rev
>     1.00/1.00 addr 1
>     usb5 at uhci3: USB revision 1.0
>     uhub5 at usb5 configuration 1 interface 0 "Intel UHCI root hub" rev
>     1.00/1.00 addr 1
>     usb6 at uhci4: USB revision 1.0
>     uhub6 at usb6 configuration 1 interface 0 "Intel UHCI root hub" rev
>     1.00/1.00 addr 1
>     usb7 at uhci5: USB revision 1.0
>     uhub7 at usb7 configuration 1 interface 0 "Intel UHCI root hub" rev
>     1.00/1.00 addr 1
>     isa0 at pcib0
>     isadma0 at isa0
>     com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
>     com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
>     pckbc0 at isa0 port 0x60/5 irq 1 irq 12
>     pckbd0 at pckbc0 (kbd slot)
>     wskbd0 at pckbd0: console keyboard
>     pcppi0 at isa0 port 0x61
>     spkr0 at pcppi0
>     wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x41
>     lm2 at wbsio0 port 0x290/8: W83627HF
>     lm1: disabling sensors due to alias with lm2
>     vscsi0 at root
>     scsibus1 at vscsi0: 256 targets
>     softraid0 at root
>     scsibus2 at softraid0: 256 targets
>     root on wd0a (a310158b1ec5ebc2.a) swap on wd0b dump on wd0b
>     initializing kernel modesetting (RV100 0x1002:0x515E 0x15D9:0xD480
>     0x02).
>     radeondrm0: 1024x768, 16bpp
>     wsdisplay0 at radeondrm0 mux 1: console (std, vt100 emulation),
>     using wskbd0
>     wsdisplay0: screen 1-5 added (std, vt100 emulation)
>
>
>
> --
> Kindest regards,
> Tom Smyth.

Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Stuart Henderson
On 2020-07-31, Ivo Chutkin <[hidden email]> wrote:

> Hello guys,
>
> Thanks for suggestions.
>
> Tweacking sysctl
>
> net.inet.udp.recvspace=131072
> net.inet.udp.sendspace=131072
>
> solved the problem.
>
> Test between routers that started to drop packets over 10Mbit, now run
> test at 100Mbit with less than 1% drops (over 50% before).

net.inet.udp.recvspace and net.inet.udp.sendspace only affect traffic
generated on a machine itself, they do not affect forwarded traffic.

Generating packets on the router itself isn't a good test for how well
they can forward packets.


Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Ivo Chutkin-2
On 1.8.2020 г. 14:43 ч., Stuart Henderson wrote:

> On 2020-07-31, Ivo Chutkin <[hidden email]> wrote:
>> Hello guys,
>>
>> Thanks for suggestions.
>>
>> Tweacking sysctl
>>
>> net.inet.udp.recvspace=131072
>> net.inet.udp.sendspace=131072
>>
>> solved the problem.
>>
>> Test between routers that started to drop packets over 10Mbit, now run
>> test at 100Mbit with less than 1% drops (over 50% before).
>
> net.inet.udp.recvspace and net.inet.udp.sendspace only affect traffic
> generated on a machine itself, they do not affect forwarded traffic.
>
> Generating packets on the router itself isn't a good test for how well
> they can forward packets.
>
>

Hi Stuart,

I have read it many times that increasing the values do not affect
forwarding performance. That is is why I was skeptical about calomel.org
solution.

Can you point some directions for increasing forwarding performance?

I upgraded all routers to 6.7 with patches and I think problem
disappears, using the same hardware.

Thanks for your help,
Ivo

Reply | Threaded
Open this post in threaded view
|

Re: Droping UDP traffic

Stuart Henderson
On 2020-08-02, Ivo Chutkin <[hidden email]> wrote:

> On 1.8.2020 г. 14:43 ч., Stuart Henderson wrote:
>> On 2020-07-31, Ivo Chutkin <[hidden email]> wrote:
>>> Hello guys,
>>>
>>> Thanks for suggestions.
>>>
>>> Tweacking sysctl
>>>
>>> net.inet.udp.recvspace=131072
>>> net.inet.udp.sendspace=131072
>>>
>>> solved the problem.
>>>
>>> Test between routers that started to drop packets over 10Mbit, now run
>>> test at 100Mbit with less than 1% drops (over 50% before).
>>
>> net.inet.udp.recvspace and net.inet.udp.sendspace only affect traffic
>> generated on a machine itself, they do not affect forwarded traffic.
>>
>> Generating packets on the router itself isn't a good test for how well
>> they can forward packets.
>>
>>
>
> Hi Stuart,
>
> I have read it many times that increasing the values do not affect
> forwarding performance. That is is why I was skeptical about calomel.org
> solution.

The suggestions on that website are a combination of things that may
possibly have been slightly relevant some years ago (and which may or may
not still be relevant), and things which are totally useless. Combined
with the lack of information about what anything does (if the author
even knows in the first place) it's a poor information source.

> Can you point some directions for increasing forwarding performance?

hmm. If you use PF, make sure your state limits are high enough.
There isn't really much else I'd consider tweaking "just in case it helps",
there are some tools that might help figure out why things aren't working
well enough in specific circumstances, but most need some prior knowledge
to figure out what to do with what they're showing. (things like
netstat -m, systat vmstat, systat mbuf, even just dmesg and top sometimes
give clues).

> I upgraded all routers to 6.7 with patches and I think problem
> disappears, using the same hardware.

I don't remember what changed when, but I think there may have been
some changes to how "livelock" was detected in that timeframe
which may have helped (the kernel tries to backoff on network
processing if it thinks it can't cope with the traffic)..

>
> Thanks for your help,
> Ivo
>
>