Support for Intel X520-T2 10GbaseT cards

classic Classic list List threaded Threaded
19 messages Options
Reply | Threaded
Open this post in threaded view
|

Support for Intel X520-T2 10GbaseT cards

Peter Hallin
Hi all,

After reading the manpages for ix(4) "Intel 82598/82599 PCI Express 10Gb
Ethernet device",
I drew the conclusion that the X520-T2
(http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-
t2-overview.htm)
would also be supported by the driver, so we took a shot and bought a pair for
our firewalls.

It is based on the 82599 chipset, so why wouldn't it? My mistake, is seems..

I get an "unknown product 0x151c" error in dmesg (see below).

So now we have a pair of these cards and the obvious question is of course,
will they be supported?

I realize that I should have checked this before I bought it,
but as Intel claims in the specs
(http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
it is supported by FreeBSD and I believe that's from where the driver was
ported.

I'm very grateful for any input.


Peter Hallin
Lund University


dmesg:

OpenBSD 4.8 (GENERIC.MP) #335: Mon Aug 16 09:09:20 MDT 2010
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
RTC BIOS diagnostic error 2
real mem = 2139598848 (2040MB)
avail mem = 2068819968 (1972MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fa32000 (60 entries)
bios0: vendor Intel Corporation version "S5000.86B.11.00.0096.011320091422"
date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST
EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5)
UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5)
PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.08 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu1: 6MB 64b/line 16-way L2 cache
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu2: 6MB 64b/line 16-way L2 cache
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu3: 6MB 64b/line 16-way L2 cache
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 9 (P32_)
acpiprt2 at acpi0: bus 8 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 6 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 5 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpicpu1 at acpi0: C2, C1, PSS
acpicpu2 at acpi0: C2, C1, PSS
acpicpu3 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2493 MHz: speeds: 2497, 1998 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 16
(irq 10)
pci3 at ppb2 bus 3
vendor "Intel", unknown product 0x151c (class network subclass ethernet, rev
0x01) at pci3 dev 0 function 0 not configured
vendor "Intel", unknown product 0x151c (class network subclass ethernet, rev
0x01) at pci3 dev 0 function 1 not configured
ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 17
(irq 11)
pci4 at ppb3 bus 4
vendor "Intel", unknown product 0x151c (class network subclass ethernet, rev
0x01) at pci4 dev 0 function 0 not configured
vendor "Intel", unknown product 0x151c (class network subclass ethernet, rev
0x01) at pci4 dev 0 function 1 not configured
ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
pci5 at ppb4 bus 5
em0 at pci5 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8
int 18 (irq 5), address 00:15:17:89:eb:fc
em1 at pci5 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8
int 19 (irq 11), address 00:15:17:89:eb:fd
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 6
ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
pci7 at ppb6 bus 7
"Intel I/OAT" rev 0xb1 at pci0 dev 8 function 0 not configured
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0xb1
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0xb1
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0xb1
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
ppb7 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09: apic 8 int 16
(irq 10)
pci8 at ppb7 bus 8
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
(irq 11)
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
(irq 5)
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
(irq 11)
uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
(irq 5)
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
(irq 11)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb8 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
pci9 at ppb8 bus 9
vga1 at pci9 dev 12 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: apic 8 int 17 (irq 11)
drm0 at radeondrm0
pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD2500AAJB-00J3A0>
wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
pciide0: channel 1 disabled (no drives)
pciide1 at pci0 dev 31 function 2 "Intel 6321ESB SATA" rev 0x09: DMA, channel
0 configured to native-PCI, channel 1 configured to native-PCI
pciide1: using apic 8 int 20 (irq 10) for native-PCI interrupt
atapiscsi0 at pciide1 channel 0 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223F, SB02> ATAPI 5/cdrom
removable
cd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev 0x09: apic 8 int
20 (irq 10)
iic0 at ichiic0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
mtrr: Pentium Pro MTRR support
softraid0 at root
root on wd0a swap on wd0b dump on wd0b

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Jonathan Gray
On Tue, Mar 15, 2011 at 05:02:38PM +0100, Peter Hallin wrote:

> Hi all,
>
> After reading the manpages for ix(4) "Intel 82598/82599 PCI Express 10Gb
> Ethernet device",
> I drew the conclusion that the X520-T2
> (http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-
> t2-overview.htm)
> would also be supported by the driver, so we took a shot and bought a pair for
> our firewalls.
>
> It is based on the 82599 chipset, so why wouldn't it? My mistake, is seems..
>
> I get an "unknown product 0x151c" error in dmesg (see below).
>
> So now we have a pair of these cards and the obvious question is of course,
> will they be supported?
>
> I realize that I should have checked this before I bought it,
> but as Intel claims in the specs
> (http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
> it is supported by FreeBSD and I believe that's from where the driver was
> ported.
>
> I'm very grateful for any input.

This is a diff against -current not 4.8 but perhaps it applies there as well:

you'll have to apply this from /usr/src/sys/dev/pci and then
run 'make' in the directory to regenerate the pcidevs headers

Index: pcidevs
===================================================================
RCS file: /cvs/src/sys/dev/pci/pcidevs,v
retrieving revision 1.1590
diff -u -p -r1.1590 pcidevs
--- pcidevs 26 Jan 2011 07:09:09 -0000 1.1590
+++ pcidevs 15 Mar 2011 17:31:38 -0000
@@ -2492,6 +2492,7 @@ product INTEL 82580_SGMII 0x1511 82580 S
 product INTEL 82580_COPPER_DUAL 0x1516 I340-T2 (82580)
 product INTEL 82599_KX4_MEZZ 0x1514 10GbE KX4 (82599)
 product INTEL 82576_NS_SERDES 0x1518 82576NS SerDes
+product INTEL 82599_T3_LOM 0x151c 82599 T3
 product INTEL 82576_QUAD_CU_ET2 0x1526 PRO/1000 QP (82576)
 product INTEL 80960RP_ATU 0x1960 80960RP ATU
 product INTEL 82840_HB 0x1a21 82840 Host
Index: if_ix.c
===================================================================
RCS file: /cvs/src/sys/dev/pci/if_ix.c,v
retrieving revision 1.46
diff -u -p -r1.46 if_ix.c
--- if_ix.c 10 Nov 2010 15:23:25 -0000 1.46
+++ if_ix.c 15 Mar 2011 17:31:39 -0000
@@ -68,7 +68,8 @@ const struct pci_matchid ixgbe_devices[]
  { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_COMBO_BACKPLANE },
  { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_CX4 },
  { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP },
- { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM }
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM },
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_T3_LOM }
 };
 
 /*********************************************************************
@@ -1251,6 +1252,10 @@ ixgbe_identify_hardware(struct ix_softc
  case PCI_PRODUCT_INTEL_82598EB_XF_LR:
  sc->hw.mac.type = ixgbe_mac_82598EB;
  sc->optics = IFM_10G_LR;
+ break;
+ case PCI_PRODUCT_INTEL_82599_T3_LOM:
+ sc->hw.mac.type = ixgbe_mac_82599EB;
+ sc->optics = IFM_10G_T;
  break;
  case PCI_PRODUCT_INTEL_82598AT_DUAL:
  case PCI_PRODUCT_INTEL_82598AT:

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

roberth-5
On Wed, 16 Mar 2011 04:39:21 +1100
Jonathan Gray <[hidden email]> wrote:

> On Tue, Mar 15, 2011 at 05:02:38PM +0100, Peter Hallin wrote:
> > Hi all,
> >
> > After reading the manpages for ix(4) "Intel 82598/82599 PCI Express
> > 10Gb Ethernet device",
> > I drew the conclusion that the X520-T2
> > (http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-
> > t2-overview.htm)
> > would also be supported by the driver, so we took a shot and bought
> > a pair for our firewalls.
> >
> > It is based on the 82599 chipset, so why wouldn't it? My mistake,
> > is seems..
> >
> > I get an "unknown product 0x151c" error in dmesg (see below).
> >
> > So now we have a pair of these cards and the obvious question is of
> > course, will they be supported?
> >
> > I realize that I should have checked this before I bought it,
> > but as Intel claims in the specs
> > (http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
> > it is supported by FreeBSD and I believe that's from where the
> > driver was ported.
> >
> > I'm very grateful for any input.
>
> This is a diff against -current not 4.8 but perhaps it applies there
> as well:
>
> you'll have to apply this from /usr/src/sys/dev/pci and then
> run 'make' in the directory to regenerate the pcidevs headers
>
> Index: pcidevs
> ===================================================================
> RCS file: /cvs/src/sys/dev/pci/pcidevs,v
> retrieving revision 1.1590
> diff -u -p -r1.1590 pcidevs
> --- pcidevs 26 Jan 2011 07:09:09 -0000 1.1590
> +++ pcidevs 15 Mar 2011 17:31:38 -0000
> @@ -2492,6 +2492,7 @@ product INTEL 82580_SGMII 0x1511
> 82580 S product INTEL 82580_COPPER_DUAL 0x1516 I340-T2
> (82580) product INTEL 82599_KX4_MEZZ 0x1514 10GbE KX4
> (82599) product INTEL 82576_NS_SERDES 0x1518 82576NS
> SerDes +product INTEL 82599_T3_LOM 0x151c 82599 T3
>  product INTEL 82576_QUAD_CU_ET2 0x1526 PRO/1000 QP
> (82576) product INTEL 80960RP_ATU 0x1960 80960RP ATU
>  product INTEL 82840_HB 0x1a21 82840 Host
> Index: if_ix.c
> ===================================================================
> RCS file: /cvs/src/sys/dev/pci/if_ix.c,v
> retrieving revision 1.46
> diff -u -p -r1.46 if_ix.c
> --- if_ix.c 10 Nov 2010 15:23:25 -0000 1.46
> +++ if_ix.c 15 Mar 2011 17:31:39 -0000
> @@ -68,7 +68,8 @@ const struct pci_matchid ixgbe_devices[]
>   { PCI_VENDOR_INTEL,
> PCI_PRODUCT_INTEL_82599_COMBO_BACKPLANE }, { PCI_VENDOR_INTEL,
> PCI_PRODUCT_INTEL_82599_CX4 }, { PCI_VENDOR_INTEL,
> PCI_PRODUCT_INTEL_82599_SFP },
> - { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM }
> + { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM },
> + { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_T3_LOM }
>  };
>  
>  /*********************************************************************
> @@ -1251,6 +1252,10 @@ ixgbe_identify_hardware(struct ix_softc
>   case PCI_PRODUCT_INTEL_82598EB_XF_LR:
>   sc->hw.mac.type = ixgbe_mac_82598EB;
>   sc->optics = IFM_10G_LR;
> + break;
> + case PCI_PRODUCT_INTEL_82599_T3_LOM:
> + sc->hw.mac.type = ixgbe_mac_82599EB;
> + sc->optics = IFM_10G_T;
>   break;
>   case PCI_PRODUCT_INTEL_82598AT_DUAL:
>   case PCI_PRODUCT_INTEL_82598AT:
>

And this one here?

Index: ixgbe_82599.c
===================================================================
RCS file: /cvs/src/sys/dev/pci/ixgbe_82599.c,v
retrieving revision 1.2
diff -u -p -r1.2 ixgbe_82599.c
--- ixgbe_82599.c 25 Feb 2010 10:56:07 -0000 1.2
+++ ixgbe_82599.c 15 Mar 2011 17:27:55 -0000
@@ -416,6 +416,9 @@ enum ixgbe_media_type ixgbe_get_media_ty
  case IXGBE_DEV_ID_82599_CX4:
  media_type = ixgbe_media_type_cx4;
  break;
+ case IXGBE_DEV_ID_82599_T3_LOM:
+ media_type = ixgbe_media_type_copper;
+ break;
  default:
  media_type = ixgbe_media_type_unknown;
  break;

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Jonathan Gray
On Tue, Mar 15, 2011 at 06:56:24PM +0100, roberth wrote:
>
> And this one here?

This should be handled by the default case as the
start of the function, already.

>
> Index: ixgbe_82599.c
> ===================================================================
> RCS file: /cvs/src/sys/dev/pci/ixgbe_82599.c,v
> retrieving revision 1.2
> diff -u -p -r1.2 ixgbe_82599.c
> --- ixgbe_82599.c 25 Feb 2010 10:56:07 -0000 1.2
> +++ ixgbe_82599.c 15 Mar 2011 17:27:55 -0000
> @@ -416,6 +416,9 @@ enum ixgbe_media_type ixgbe_get_media_ty
>   case IXGBE_DEV_ID_82599_CX4:
>   media_type = ixgbe_media_type_cx4;
>   break;
> + case IXGBE_DEV_ID_82599_T3_LOM:
> + media_type = ixgbe_media_type_copper;
> + break;
>   default:
>   media_type = ixgbe_media_type_unknown;
>   break;

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

roberth-5
On Wed, 16 Mar 2011 06:26:20 +1100
Jonathan Gray <[hidden email]> wrote:

> On Tue, Mar 15, 2011 at 06:56:24PM +0100, roberth wrote:
> >
> > And this one here?
>
> This should be handled by the default case as the
> start of the function, already.

Sure, it is, the freebsd driver is checking this twice, my bad.

> >
> > Index: ixgbe_82599.c
> > ===================================================================
> > RCS file: /cvs/src/sys/dev/pci/ixgbe_82599.c,v
> > retrieving revision 1.2
> > diff -u -p -r1.2 ixgbe_82599.c
> > --- ixgbe_82599.c 25 Feb 2010 10:56:07 -0000 1.2
> > +++ ixgbe_82599.c 15 Mar 2011 17:27:55 -0000
> > @@ -416,6 +416,9 @@ enum ixgbe_media_type ixgbe_get_media_ty
> >   case IXGBE_DEV_ID_82599_CX4:
> >   media_type = ixgbe_media_type_cx4;
> >   break;
> > + case IXGBE_DEV_ID_82599_T3_LOM:
> > + media_type = ixgbe_media_type_copper;
> > + break;
> >   default:
> >   media_type = ixgbe_media_type_unknown;
> >   break;

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
In reply to this post by Jonathan Gray
Hello again and thanks for the patch.

I started out with a fresh install of 4.8 GENERIC (amd64, MP), applied the
patch and recompiled the kernel. The line numbers were not correct, but
otherwise it looked the same.

After reboot dmesg showed that the cards now have been found and I have the ix
interfaces in ifconfig.

Unfortunately the cards aren't too keen on talking to the network.

I can't ping other hosts on the same subnet, and if I try to ping from another
machine directly connected to the nic, all tcpdump shows me is this:

# tcpdump -i ix0
tcpdump: listening on ix0, link-type EN10MB
16:01:05.254579 Broadcast af:de:21:93:a6:3c ffff 60:
                         ffff ffff ffff ffff 4001 b955 c0a8 0002
                         c0a8 0001 0800 00cb 0b04 0003 99cf 804d
                         0000 0000 053e 0e00 0000 0000 1011
16:01:06.254355 Broadcast af:de:1d:b5:94:e1 ffff 60:
                         ffff ffff ffff ffff ff01 6cc0 c0a8 0001
                         c0a8 0002 0000 2ccb 0b04 0002 98cf 804d
                         0000 0000 e23e 0e00 0000 0000 1011

No echo requests or replies, nothing else. Seems arp is not resolving as it
should, "arp -a" just hangs at the console.

And if I try to show the routing table, with "route show" it also just hangs
there and won't show anything but if I take the interface down, the table
shows as it should.

I guess the driver may need some more work to get this card running and I
would be happy to see support for this in an upcoming release.

Best regards, Peter


ifconfig ix0:

ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:1b:21:93:a6:3c
        priority: 0
        media: Ethernet autoselect (1000baseT full-duplex)
        status: active
        inet6 fe80::21b:21ff:fe93:a63c%ix0 prefixlen 64 scopeid 0x1
        inet 192.168.0.1 netmask 0xffffff00 broadcast 255.255.255.0

dmesg:

OpenBSD 4.8 (GENERIC.MP) #0: Wed Mar 16 12:43:47 CET 2011
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
RTC BIOS diagnostic error 2
real mem = 2139598848 (2040MB)
avail mem = 2068819968 (1972MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fa32000 (60 entries)
bios0: vendor Intel Corporation version "S5000.86B.11.00.0096.011320091422"
date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST
EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5)
UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5)
PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.08 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu1 at mainbus0: apid 2 (application processor)
cpu1: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu1: 6MB 64b/line 16-way L2 cache
cpu2 at mainbus0: apid 1 (application processor)
cpu2: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu2:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu2: 6MB 64b/line 16-way L2 cache
cpu3 at mainbus0: apid 3 (application processor)
cpu3: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
cpu3:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu3: 6MB 64b/line 16-way L2 cache
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 9 (P32_)
acpiprt2 at acpi0: bus 8 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 6 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 5 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpicpu1 at acpi0: C2, C1, PSS
acpicpu2 at acpi0: C2, C1, PSS
acpicpu3 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2493 MHz: speeds: 2497, 1998 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 16
(irq 10)
pci3 at ppb2 bus 3
ix0 at pci3 dev 0 function 0 "Intel 82599 T3" rev 0x01: apic 8 int 17 (irq
11), address 00:1b:21:93:a6:3c
ix1 at pci3 dev 0 function 1 "Intel 82599 T3" rev 0x01: apic 8 int 16 (irq
10), address 00:1b:21:93:a6:3d
ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 17
(irq 11)
pci4 at ppb3 bus 4
ix2 at pci4 dev 0 function 0 "Intel 82599 T3" rev 0x01: apic 8 int 18 (irq 5),
address 00:1b:21:93:a6:40
ix3 at pci4 dev 0 function 1 "Intel 82599 T3" rev 0x01: apic 8 int 17 (irq
11), address 00:1b:21:93:a6:41
ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
pci5 at ppb4 bus 5
em0 at pci5 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8
int 18 (irq 5), address 00:15:17:89:eb:fc
em1 at pci5 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8
int 19 (irq 11), address 00:15:17:89:eb:fd
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 6
ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
pci7 at ppb6 bus 7
"Intel I/OAT" rev 0xb1 at pci0 dev 8 function 0 not configured
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0xb1
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0xb1
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0xb1
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
ppb7 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09: apic 8 int 16
(irq 10)
pci8 at ppb7 bus 8
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
(irq 11)
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
(irq 5)
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
(irq 11)
uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
(irq 5)
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
(irq 11)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb8 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
pci9 at ppb8 bus 9
vga1 at pci9 dev 12 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: apic 8 int 17 (irq 11)
drm0 at radeondrm0
pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD2500AAJB-00J3A0>
wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
pciide0: channel 1 disabled (no drives)
pciide1 at pci0 dev 31 function 2 "Intel 6321ESB SATA" rev 0x09: DMA, channel
0 configured to native-PCI, channel 1 configured to native-PCI
pciide1: using apic 8 int 20 (irq 10) for native-PCI interrupt
atapiscsi0 at pciide1 channel 0 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223F, SB02> ATAPI 5/cdrom
removable
cd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev 0x09: apic 8 int
20 (irq 10)
iic0 at ichiic0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
mtrr: Pentium Pro MTRR support
softraid0 at root
root on wd0a swap on wd0b dump on wd0b



On Tue, Mar 15, 2011 at 05:02:38PM +0100, Peter Hallin wrote:
> Hi all,
>
> After reading the manpages for ix(4) "Intel 82598/82599 PCI Express 10Gb
> Ethernet device",
> I drew the conclusion that the X520-T2
>
(http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-
> t2-overview.htm)
> would also be supported by the driver, so we took a shot and bought a pair
for
> our firewalls.
>
> It is based on the 82599 chipset, so why wouldn't it? My mistake, is
seems..

>
> I get an "unknown product 0x151c" error in dmesg (see below).
>
> So now we have a pair of these cards and the obvious question is of course,
> will they be supported?
>
> I realize that I should have checked this before I bought it,
> but as Intel claims in the specs
> (http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
> it is supported by FreeBSD and I believe that's from where the driver was
> ported.
>
> I'm very grateful for any input.

This is a diff against -current not 4.8 but perhaps it applies there as well:

you'll have to apply this from /usr/src/sys/dev/pci and then
run 'make' in the directory to regenerate the pcidevs headers

Index: pcidevs
===================================================================
RCS file: /cvs/src/sys/dev/pci/pcidevs,v
retrieving revision 1.1590
diff -u -p -r1.1590 pcidevs
--- pcidevs 26 Jan 2011 07:09:09 -0000 1.1590
+++ pcidevs 15 Mar 2011 17:31:38 -0000
@@ -2492,6 +2492,7 @@ product INTEL 82580_SGMII 0x1511 82580 S
 product INTEL 82580_COPPER_DUAL 0x1516 I340-T2 (82580)
 product INTEL 82599_KX4_MEZZ 0x1514 10GbE KX4 (82599)
 product INTEL 82576_NS_SERDES 0x1518 82576NS SerDes
+product INTEL 82599_T3_LOM 0x151c 82599 T3
 product INTEL 82576_QUAD_CU_ET2 0x1526 PRO/1000 QP (82576)
 product INTEL 80960RP_ATU 0x1960 80960RP ATU
 product INTEL 82840_HB 0x1a21 82840 Host
Index: if_ix.c
===================================================================
RCS file: /cvs/src/sys/dev/pci/if_ix.c,v
retrieving revision 1.46
diff -u -p -r1.46 if_ix.c
--- if_ix.c 10 Nov 2010 15:23:25 -0000 1.46
+++ if_ix.c 15 Mar 2011 17:31:39 -0000
@@ -68,7 +68,8 @@ const struct pci_matchid ixgbe_devices[]
  { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_COMBO_BACKPLANE },
  { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_CX4 },
  { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP },
- { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM }
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM },
+ { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_T3_LOM }
 };

 /*********************************************************************
@@ -1251,6 +1252,10 @@ ixgbe_identify_hardware(struct ix_softc
  case PCI_PRODUCT_INTEL_82598EB_XF_LR:
  sc->hw.mac.type = ixgbe_mac_82598EB;
  sc->optics = IFM_10G_LR;
+ break;
+ case PCI_PRODUCT_INTEL_82599_T3_LOM:
+ sc->hw.mac.type = ixgbe_mac_82599EB;
+ sc->optics = IFM_10G_T;
  break;
  case PCI_PRODUCT_INTEL_82598AT_DUAL:
  case PCI_PRODUCT_INTEL_82598AT:

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Pete Vickers-2
sounds like rDNS delay.

retry with arp -an and netstat -rn

/Pete


On 16. mars 2011, at 16.33, Peter Hallin wrote:

> Hello again and thanks for the patch.
>
> I started out with a fresh install of 4.8 GENERIC (amd64, MP), applied the
> patch and recompiled the kernel. The line numbers were not correct, but
> otherwise it looked the same.
>
> After reboot dmesg showed that the cards now have been found and I have the
ix
> interfaces in ifconfig.
>
> Unfortunately the cards aren't too keen on talking to the network.
>
> I can't ping other hosts on the same subnet, and if I try to ping from
another

> machine directly connected to the nic, all tcpdump shows me is this:
>
> # tcpdump -i ix0
> tcpdump: listening on ix0, link-type EN10MB
> 16:01:05.254579 Broadcast af:de:21:93:a6:3c ffff 60:
>                         ffff ffff ffff ffff 4001 b955 c0a8 0002
>                         c0a8 0001 0800 00cb 0b04 0003 99cf 804d
>                         0000 0000 053e 0e00 0000 0000 1011
> 16:01:06.254355 Broadcast af:de:1d:b5:94:e1 ffff 60:
>                         ffff ffff ffff ffff ff01 6cc0 c0a8 0001
>                         c0a8 0002 0000 2ccb 0b04 0002 98cf 804d
>                         0000 0000 e23e 0e00 0000 0000 1011
>
> No echo requests or replies, nothing else. Seems arp is not resolving as it
> should, "arp -a" just hangs at the console.
>
> And if I try to show the routing table, with "route show" it also just
hangs

> there and won't show anything but if I take the interface down, the table
> shows as it should.
>
> I guess the driver may need some more work to get this card running and I
> would be happy to see support for this in an upcoming release.
>
> Best regards, Peter
>
>
> ifconfig ix0:
>
> ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
>        lladdr 00:1b:21:93:a6:3c
>        priority: 0
>        media: Ethernet autoselect (1000baseT full-duplex)
>        status: active
>        inet6 fe80::21b:21ff:fe93:a63c%ix0 prefixlen 64 scopeid 0x1
>        inet 192.168.0.1 netmask 0xffffff00 broadcast 255.255.255.0
>
> dmesg:
>
> OpenBSD 4.8 (GENERIC.MP) #0: Wed Mar 16 12:43:47 CET 2011
>    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> RTC BIOS diagnostic error 2
> real mem = 2139598848 (2040MB)
> avail mem = 2068819968 (1972MB)
> mainbus0 at root
> bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x7fa32000 (60 entries)
> bios0: vendor Intel Corporation version "S5000.86B.11.00.0096.011320091422"
> date 01/13/2009
> bios0: Intel S5000VSA
> acpi0 at bios0: rev 2
> acpi0: sleep states S0 S1 S4 S5
> acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST
> EINJ
> acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5)
> UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5)
> PCIQ(S5)
> acpitimer0 at acpi0: 3579545 Hz, 24 bits
> acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> cpu0 at mainbus0: apid 0 (boot processor)
> cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.08 MHz
> cpu0:
>
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
>
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
> ,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
> cpu0: 6MB 64b/line 16-way L2 cache
> cpu0: apic clock running at 332MHz
> cpu1 at mainbus0: apid 2 (application processor)
> cpu1: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
> cpu1:
>
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
>
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
> ,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
> cpu1: 6MB 64b/line 16-way L2 cache
> cpu2 at mainbus0: apid 1 (application processor)
> cpu2: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
> cpu2:
>
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
>
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3
> ,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
> cpu2: 6MB 64b/line 16-way L2 cache
> cpu3 at mainbus0: apid 3 (application processor)
> cpu3: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2493.75 MHz
> cpu3:
>
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUS
>
H,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3

> ,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
> cpu3: 6MB 64b/line 16-way L2 cache
> ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
> ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
> acpihpet0 at acpi0: 14318179 Hz
> acpiprt0 at acpi0: bus 0 (PCI0)
> acpiprt1 at acpi0: bus 9 (P32_)
> acpiprt2 at acpi0: bus 8 (PEX0)
> acpiprt3 at acpi0: bus -1 (PEX1)
> acpiprt4 at acpi0: bus -1 (PEX2)
> acpiprt5 at acpi0: bus -1 (PEX3)
> acpiprt6 at acpi0: bus 1 (PCIE)
> acpiprt7 at acpi0: bus 6 (PCIE)
> acpiprt8 at acpi0: bus 2 (PCIW)
> acpiprt9 at acpi0: bus 3 (PCIO)
> acpiprt10 at acpi0: bus 4 (PCIP)
> acpiprt11 at acpi0: bus 5 (PCIQ)
> acpicpu0 at acpi0: C2, C1, PSS
> acpicpu1 at acpi0: C2, C1, PSS
> acpicpu2 at acpi0: C2, C1, PSS
> acpicpu3 at acpi0: C2, C1, PSS
> acpibtn0 at acpi0: SLPB
> ipmi at mainbus0 not configured
> cpu0: Enhanced SpeedStep 2493 MHz: speeds: 2497, 1998 MHz
> pci0 at mainbus0 bus 0
> pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1
> ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1
> pci1 at ppb0 bus 1
> ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
> pci2 at ppb1 bus 2
> ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 16
> (irq 10)
> pci3 at ppb2 bus 3
> ix0 at pci3 dev 0 function 0 "Intel 82599 T3" rev 0x01: apic 8 int 17 (irq
> 11), address 00:1b:21:93:a6:3c
> ix1 at pci3 dev 0 function 1 "Intel 82599 T3" rev 0x01: apic 8 int 16 (irq
> 10), address 00:1b:21:93:a6:3d
> ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 17
> (irq 11)
> pci4 at ppb3 bus 4
> ix2 at pci4 dev 0 function 0 "Intel 82599 T3" rev 0x01: apic 8 int 18 (irq
5),
> address 00:1b:21:93:a6:40
> ix3 at pci4 dev 0 function 1 "Intel 82599 T3" rev 0x01: apic 8 int 17 (irq
> 11), address 00:1b:21:93:a6:41
> ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
> pci5 at ppb4 bus 5
> em0 at pci5 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic
8
> int 18 (irq 5), address 00:15:17:89:eb:fc
> em1 at pci5 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic
8

> int 19 (irq 11), address 00:15:17:89:eb:fd
> ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
> pci6 at ppb5 bus 6
> ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
> pci7 at ppb6 bus 7
> "Intel I/OAT" rev 0xb1 at pci0 dev 8 function 0 not configured
> pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0xb1
> pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0xb1
> pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0xb1
> pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
> pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
> pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
> pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
> ppb7 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09: apic 8 int 16
> (irq 10)
> pci8 at ppb7 bus 8
> uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
> (irq 11)
> uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
> (irq 5)
> uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
> (irq 11)
> uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
> (irq 5)
> ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
> (irq 11)
> usb0 at ehci0: USB revision 2.0
> uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
> ppb8 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
> pci9 at ppb8 bus 9
> vga1 at pci9 dev 12 function 0 "ATI ES1000" rev 0x02
> wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
> wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
> radeondrm0 at vga1: apic 8 int 17 (irq 11)
> drm0 at radeondrm0
> pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
> pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel
0
> configured to compatibility, channel 1 configured to compatibility
> wd0 at pciide0 channel 0 drive 0: <WDC WD2500AAJB-00J3A0>
> wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
> wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
> pciide0: channel 1 disabled (no drives)
> pciide1 at pci0 dev 31 function 2 "Intel 6321ESB SATA" rev 0x09: DMA,
channel
> 0 configured to native-PCI, channel 1 configured to native-PCI
> pciide1: using apic 8 int 20 (irq 10) for native-PCI interrupt
> atapiscsi0 at pciide1 channel 0 drive 0
> scsibus0 at atapiscsi0: 2 targets
> cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223F, SB02> ATAPI
5/cdrom
> removable
> cd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 5
> ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev 0x09: apic 8
int

> 20 (irq 10)
> iic0 at ichiic0
> usb1 at uhci0: USB revision 1.0
> uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> usb2 at uhci1: USB revision 1.0
> uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> usb3 at uhci2: USB revision 1.0
> uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> usb4 at uhci3: USB revision 1.0
> uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
> isa0 at pcib0
> isadma0 at isa0
> com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> pckbc0 at isa0 port 0x60/5
> pckbd0 at pckbc0 (kbd slot)
> pckbc0: using irq 1 for kbd slot
> wskbd0 at pckbd0: console keyboard, using wsdisplay0
> pcppi0 at isa0 port 0x61
> spkr0 at pcppi0
> mtrr: Pentium Pro MTRR support
> softraid0 at root
> root on wd0a swap on wd0b dump on wd0b
>
>
>
> On Tue, Mar 15, 2011 at 05:02:38PM +0100, Peter Hallin wrote:
>> Hi all,
>>
>> After reading the manpages for ix(4) "Intel 82598/82599 PCI Express 10Gb
>> Ethernet device",
>> I drew the conclusion that the X520-T2
>>
>
(http://www.intel.com/Products/Server/Adapters/esa-x520-t2/ethernet-esa-x520-

>> t2-overview.htm)
>> would also be supported by the driver, so we took a shot and bought a pair
> for
>> our firewalls.
>>
>> It is based on the 82599 chipset, so why wouldn't it? My mistake, is
> seems..
>>
>> I get an "unknown product 0x151c" error in dmesg (see below).
>>
>> So now we have a pair of these cards and the obvious question is of
course,

>> will they be supported?
>>
>> I realize that I should have checked this before I bought it,
>> but as Intel claims in the specs
>> (http://www.intel.com/Assets/PDF/prodbrief/318349-004.pdf)
>> it is supported by FreeBSD and I believe that's from where the driver was
>> ported.
>>
>> I'm very grateful for any input.
>
> This is a diff against -current not 4.8 but perhaps it applies there as
well:

>
> you'll have to apply this from /usr/src/sys/dev/pci and then
> run 'make' in the directory to regenerate the pcidevs headers
>
> Index: pcidevs
> ===================================================================
> RCS file: /cvs/src/sys/dev/pci/pcidevs,v
> retrieving revision 1.1590
> diff -u -p -r1.1590 pcidevs
> --- pcidevs 26 Jan 2011 07:09:09 -0000 1.1590
> +++ pcidevs 15 Mar 2011 17:31:38 -0000
> @@ -2492,6 +2492,7 @@ product INTEL 82580_SGMII 0x1511 82580 S
> product INTEL 82580_COPPER_DUAL 0x1516 I340-T2 (82580)
> product INTEL 82599_KX4_MEZZ 0x1514 10GbE KX4 (82599)
> product INTEL 82576_NS_SERDES 0x1518 82576NS SerDes
> +product INTEL 82599_T3_LOM 0x151c 82599 T3
> product INTEL 82576_QUAD_CU_ET2 0x1526 PRO/1000 QP (82576)
> product INTEL 80960RP_ATU 0x1960 80960RP ATU
> product INTEL 82840_HB 0x1a21 82840 Host
> Index: if_ix.c
> ===================================================================
> RCS file: /cvs/src/sys/dev/pci/if_ix.c,v
> retrieving revision 1.46
> diff -u -p -r1.46 if_ix.c
> --- if_ix.c 10 Nov 2010 15:23:25 -0000 1.46
> +++ if_ix.c 15 Mar 2011 17:31:39 -0000
> @@ -68,7 +68,8 @@ const struct pci_matchid ixgbe_devices[]
> { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_COMBO_BACKPLANE },
> { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_CX4 },
> { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP },
> - { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM }
> + { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_SFP_EM },
> + { PCI_VENDOR_INTEL, PCI_PRODUCT_INTEL_82599_T3_LOM }
> };
>
> /*********************************************************************
> @@ -1251,6 +1252,10 @@ ixgbe_identify_hardware(struct ix_softc
> case PCI_PRODUCT_INTEL_82598EB_XF_LR:
> sc->hw.mac.type = ixgbe_mac_82598EB;
> sc->optics = IFM_10G_LR;
> + break;
> + case PCI_PRODUCT_INTEL_82599_T3_LOM:
> + sc->hw.mac.type = ixgbe_mac_82599EB;
> + sc->optics = IFM_10G_T;
> break;
> case PCI_PRODUCT_INTEL_82598AT_DUAL:
> case PCI_PRODUCT_INTEL_82598AT:
>

Pete Vickers

[hidden email] |  +47 48 17 91 00

SystemNet AS

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
Thanks, I tried that and got the routing table, however still no packets
coming through. //Peter

> sounds like rDNS delay.
>
> retry with arp -an and netstat -rn
>
> /Pete

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Jonathan Gray
In reply to this post by Peter Hallin
Claudio has recently synced ix to a newer version of the Intel code,
if you can try again with -current this should work.

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
On 2011-06-15 04:26, Jonathan Gray wrote:
> Claudio has recently synced ix to a newer version of the Intel code,
> if you can try again with -current this should work.

Great, thanks. I tried it out today, but the performance wasn't exactly
what I had expected.

This is a dual port card, so I bridged ix0 with ix1 and ran iperf
between two hosts through the card. The hosts were connected with
1Gbase as I have no other 10Gbase cards.

It only got up to about 450 Mbit/s (standard TCP iperf test) and there
was an unbalance between ix0 and ix1 when it came to interrupts. ix1
only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when
monitoring live with systat vmstat). The CPU intr usage was around 50-60%.

Could this possibly be related to the ppb problems we've seen with em(4)
cards?

//Peter

vmstat -iz:

interrupt                       total     rate
irq0/clock                     345997      100
irq144/acpi0                        0        0
irq96/ppb2                          0        0
irq97/ix0                     1046011      302
irq96/ix1                      327045       94
irq97/ppb3                          0        0
irq112/em0                      52826       15
irq113/em1                          0        0
irq96/ppb7                          0        0
irq98/uhci0                       444        0
irq99/uhci1                         0        0
irq98/uhci2                         0        0
irq99/uhci3                         0        0
irq98/ehci0                         2        0
irq100/pciide0                   1462        0
irq101/ahci0                        1        0
irq101/ichiic0                      0        0
irq145/com0                         0        0
irq146/com1                         0        0
irq147/pckbc0                       0        0
Total                         1773788      513

dmesg:

OpenBSD 4.9-current (GENERIC) #0: Wed Jun 15 10:51:41 CEST 2011
    root@lab:/usr/src/sys/arch/amd64/compile/GENERIC
RTC BIOS diagnostic error 3
real mem = 1065857024 (1016MB)
avail mem = 1023438848 (976MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0x3fa32000 (58 entries)
bios0: vendor Intel Corporation version "S5000.86B.11.00.0096.011320091422" date 01/13/2009
bios0: Intel S5000VSA
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG SSDT SSDT SSDT HEST BERT ERST EINJ
acpi0: wakeup devices SLPB(S5) P32_(S5) PS2M(S1) PS2K(S1) UAR1(S5) UAR2(S5) UHC1(S1) UHC2(S1) UHC3(S1) UHC4(S1) EHCI(S1) PCIE(S5) PCIO(S5) PCIP(S5) PCIQ(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz, 2494.10 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,NXE,LONG
cpu0: 6MB 64b/line 16-way L2 cache
cpu0: apic clock running at 332MHz
cpu at mainbus0: not configured
cpu at mainbus0: not configured
cpu at mainbus0: not configured
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
ioapic1 at mainbus0: apid 9 pa 0xfec80000, version 20, 24 pins
acpihpet0 at acpi0: 14318179 Hz
acpimcfg0 at acpi0 addr 0xa0000000, bus 0-255
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 9 (P32_)
acpiprt2 at acpi0: bus 8 (PEX0)
acpiprt3 at acpi0: bus -1 (PEX1)
acpiprt4 at acpi0: bus -1 (PEX2)
acpiprt5 at acpi0: bus -1 (PEX3)
acpiprt6 at acpi0: bus 1 (PCIE)
acpiprt7 at acpi0: bus 6 (PCIE)
acpiprt8 at acpi0: bus 2 (PCIW)
acpiprt9 at acpi0: bus 3 (PCIO)
acpiprt10 at acpi0: bus 4 (PCIP)
acpiprt11 at acpi0: bus 5 (PCIQ)
acpicpu0 at acpi0: C2, C1, PSS
acpibtn0 at acpi0: SLPB
ipmi at mainbus0 not configured
cpu0: Enhanced SpeedStep 2494 MHz: speeds: 2497, 1998 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 5000V Host" rev 0xb1
ppb0 at pci0 dev 2 function 0 "Intel 5000 PCIE x8" rev 0xb1
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 16
pci3 at ppb2 bus 3
ix0 at pci3 dev 0 function 0 "Intel 82599 T3" rev 0x01: apic 8 int 17, address 00:1b:21:93:a6:3c
ix1 at pci3 dev 0 function 1 "Intel 82599 T3" rev 0x01: apic 8 int 16, address 00:1b:21:93:a6:3d
ppb3 at pci2 dev 1 function 0 "Intel 6321ESB PCIE" rev 0x01: apic 8 int 17
pci4 at ppb3 bus 4
ppb4 at pci2 dev 2 function 0 "Intel 6321ESB PCIE" rev 0x01
pci5 at ppb4 bus 5
em0 at pci5 dev 0 function 0 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8 int 18, address 00:15:17:60:97:fc
em1 at pci5 dev 0 function 1 "Intel PRO/1000 PT (80003ES2)" rev 0x01: apic 8 int 19, address 00:15:17:60:97:fd
ppb5 at pci1 dev 0 function 3 "Intel 6321ESB PCIE-PCIX" rev 0x01
pci6 at ppb5 bus 6
ppb6 at pci0 dev 3 function 0 "Intel 5000 PCIE" rev 0xb1
pci7 at ppb6 bus 7
pchb1 at pci0 dev 16 function 0 "Intel 5000 Error Reporting" rev 0xb1
pchb2 at pci0 dev 16 function 1 "Intel 5000 Error Reporting" rev 0xb1
pchb3 at pci0 dev 16 function 2 "Intel 5000 Error Reporting" rev 0xb1
pchb4 at pci0 dev 17 function 0 "Intel 5000 Reserved" rev 0xb1
pchb5 at pci0 dev 19 function 0 "Intel 5000 Reserved" rev 0xb1
pchb6 at pci0 dev 21 function 0 "Intel 5000 FBD" rev 0xb1
pchb7 at pci0 dev 22 function 0 "Intel 5000 FBD" rev 0xb1
ppb7 at pci0 dev 28 function 0 "Intel 6321ESB PCIE" rev 0x09: apic 8 int 16
pci8 at ppb7 bus 8
uhci0 at pci0 dev 29 function 0 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
uhci1 at pci0 dev 29 function 1 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
uhci2 at pci0 dev 29 function 2 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
uhci3 at pci0 dev 29 function 3 "Intel 6321ESB USB" rev 0x09: apic 8 int 22
ehci0 at pci0 dev 29 function 7 "Intel 6321ESB USB" rev 0x09: apic 8 int 23
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb8 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xd9
pci9 at ppb8 bus 9
vga1 at pci9 dev 12 function 0 "ATI ES1000" rev 0x02
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
radeondrm0 at vga1: apic 8 int 17
drm0 at radeondrm0
pcib0 at pci0 dev 31 function 0 "Intel 6321ESB LPC" rev 0x09
pciide0 at pci0 dev 31 function 1 "Intel 6321ESB IDE" rev 0x09: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
wd0 at pciide0 channel 0 drive 0: <WDC WD2500JB-00REA0>
wd0: 16-sector PIO, LBA48, 238475MB, 488397168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 5
pciide0: channel 1 disabled (no drives)
ahci0 at pci0 dev 31 function 2 "Intel 6321ESB AHCI" rev 0x09: apic 8 int 20, AHCI 1.1
scsibus0 at ahci0: 32 targets
cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-S223L, SB01> ATAPI 5/cdrom removable
ichiic0 at pci0 dev 31 function 3 "Intel 6321ESB SMBus" rev 0x09: apic 8 int 20
iic0 at ichiic0
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci3: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
mtrr: Pentium Pro MTRR support
uhidev0 at uhub1 port 1 configuration 1 interface 0 "CHICONY HP Basic USB Keyboard" rev 1.10/3.00 addr 2
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
root on wd0a (f7c6f29cb29036dd.a) swap on wd0b dump on wd0b

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Jonathan Gray
On Wed, Jun 15, 2011 at 12:40:32PM +0200, Peter Hallin wrote:

> On 2011-06-15 04:26, Jonathan Gray wrote:
> > Claudio has recently synced ix to a newer version of the Intel code,
> > if you can try again with -current this should work.
>
> Great, thanks. I tried it out today, but the performance wasn't exactly
> what I had expected.
>
> This is a dual port card, so I bridged ix0 with ix1 and ran iperf
> between two hosts through the card. The hosts were connected with
> 1Gbase as I have no other 10Gbase cards.
>
> It only got up to about 450 Mbit/s (standard TCP iperf test) and there
> was an unbalance between ix0 and ix1 when it came to interrupts. ix1
> only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when
> monitoring live with systat vmstat). The CPU intr usage was around 50-60%.
>
> Could this possibly be related to the ppb problems we've seen with em(4)
> cards?

Yes this seems low indeed.  You could try use rdomains and route exec
with a cable between the two ports to make packets go over the interfaces
if you don't have another host with 10G interfaces.

If you've had ppb problems with em I'd imagine they would affect ix as well
if it is sitting behind the same ppb.

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

FRLinux-2
In reply to this post by Peter Hallin
On Wed, Jun 15, 2011 at 11:40 AM, Peter Hallin <[hidden email]> wrote:
> It only got up to about 450 Mbit/s (standard TCP iperf test) and there
> was an unbalance between ix0 and ix1 when it came to interrupts. ix1
> only got up to 4000 intr/s whereas ix1 got up to 13000 intr/s (when
> monitoring live with systat vmstat). The CPU intr usage was around 50-60%.

Just out of curiosity, which iperf settings did you use?

I know this is on a Linux box, but just out of interest, I get full
speed there:

iperf -c xxx.xxx.xxx.xxx -i 5
------------------------------------------------------------
Client connecting to xxx.xxx.xxx.xxx, TCP port 5001
TCP window size: 16.0 KByte (default)
------------------------------------------------------------
[  3] local xxx.xxx.xxx.xxx port 47035 connected with xxx.xxx.xxx.xxx port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 5.0 sec  5.47 GBytes  9.39 Gbits/sec
[  3]  0.0-10.0 sec  10.9 GBytes  9.40 Gbits/sec

Cards are:
Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network Connection (rev 01)
driver: ixgbe
version: 2.0.44-k2
firmware-version: 0.9-3
bus-info: 0000:05:00.0

Cheers,
Steph

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
On 2011-06-15 13:58, FRLinux wrote:
> Just out of curiosity, which iperf settings did you use?

Just standard TCP, iperf -c hostname

>
> I know this is on a Linux box, but just out of interest, I get full
> speed there:

Yeah, sure it works on Linux, but that's not what I'm running. Otherwise
it's almost the same card as yours, but with TP connectors.

//peter

>
> iperf -c xxx.xxx.xxx.xxx -i 5
> ------------------------------------------------------------
> Client connecting to xxx.xxx.xxx.xxx, TCP port 5001
> TCP window size: 16.0 KByte (default)
> ------------------------------------------------------------
> [  3] local xxx.xxx.xxx.xxx port 47035 connected with xxx.xxx.xxx.xxx port 5001
> [ ID] Interval       Transfer     Bandwidth
> [  3]  0.0- 5.0 sec  5.47 GBytes  9.39 Gbits/sec
> [  3]  0.0-10.0 sec  10.9 GBytes  9.40 Gbits/sec
>
> Cards are:
> Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network Connection (rev 01)
> driver: ixgbe
> version: 2.0.44-k2
> firmware-version: 0.9-3
> bus-info: 0000:05:00.0
>
> Cheers,
> Steph

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
In reply to this post by Jonathan Gray
On 2011-06-15 22:40, Jonathan Gray wrote:
>
> Yes this seems low indeed.  You could try use rdomains and route exec
> with a cable between the two ports to make packets go over the interfaces
> if you don't have another host with 10G interfaces.

I didn't get that far. When connecting the two ports to each other (tried
with a couple of TP cables) I only get 1000baseT full-duplex on ix0 and
ix1.

>
> If you've had ppb problems with em I'd imagine they would affect ix as well
> if it is sitting behind the same ppb.

I disabled the ppb hotplug interrupt in ppb.c as Claudio mentioned in
"Performance degradation after upgrade" and ran the same tests again.

This time it got up to 932 Mbit/s (close to theoretical maximum), but
the CPU usage was 100% intrs. However, the interfaces only generated
around 2000 intrs/s each (compared to 13000 in my last test).

I will not have more time to do additional testing in a while as i'm off
for vacation, but I hope my tests so far can give you some insight.

Thanks, Peter

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
On 2011-06-16 14:43, Peter Hallin wrote:
>
> I didn't get that far. When connecting the two ports to each other (tried
> with a couple of TP cables) I only get 1000baseT full-duplex on ix0 and
> ix1.

Nevermind that. After a reboot with the cables connected the interfaces
show up as 10GbaseT full-duplex. Will see if I have the time to do some
tests.

//Peter

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Peter Hallin
In reply to this post by Peter Hallin
On 2011-06-16 14:43, Peter Hallin wrote:

> On 2011-06-15 22:40, Jonathan Gray wrote:
> >
> > Yes this seems low indeed.  You could try use rdomains and route exec
> > with a cable between the two ports to make packets go over the interfaces
> > if you don't have another host with 10G interfaces.
>
> I didn't get that far. When connecting the two ports to each other (tried
> with a couple of TP cables) I only get 1000baseT full-duplex on ix0 and
> ix1.
>
> >
> > If you've had ppb problems with em I'd imagine they would affect ix as well
> > if it is sitting behind the same ppb.
>
> I disabled the ppb hotplug interrupt in ppb.c as Claudio mentioned in
> "Performance degradation after upgrade" and ran the same tests again.
>
> This time it got up to 932 Mbit/s (close to theoretical maximum), but
> the CPU usage was 100% intrs. However, the interfaces only generated
> around 2000 intrs/s each (compared to 13000 in my last test).
>
> I will not have more time to do additional testing in a while as i'm off
> for vacation, but I hope my tests so far can give you some insight.
>
> Thanks, Peter
>

Hello, I finally got some time to test this 10G stuff again and now I'm using
two machines with the same cards running 5.0 RELEASE (amd64/sp).

Problem is as before, when connected and in UP state, the media goes
down to 1000BaseT. If I take them both down, it goes back up to
10GbaseT. Weird. Tested with different (brand new cables) both cat 5E
and cat 6.

Good news is that the interrupt rate seems to be better, only about 15% CPU
when running at 1Gbit/s and around 1500 intrs/s.

These are two identical machines with the same hardware.

//Peter

dmesg:

OpenBSD 5.0 (GENERIC) #53: Wed Aug 17 10:07:52 MDT 2011
    [hidden email]:/usr/src/sys/arch/amd64/compile/GENERIC
RTC BIOS diagnostic error 80<clock_battery>
real mem = 3208368128 (3059MB)
avail mem = 3108941824 (2964MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xe4380 (23 entries)
bios0: vendor Intel Corp. version "BPX5810J.86B.0034.2010.0414.1511" date 04/14/2010
bios0: Intel Corporation WX58BP
acpi0 at bios0: rev 2
acpi0: sleep states S0 S1 S3 S4 S5
acpi0: tables DSDT FACP APIC WDDT MCFG ASF! HPET ASPT WDTx SSDT DMAR
acpi0: wakeup devices SLPB(S4) P32_(S4) ECIR(S4) UAR1(S4) ILAN(S4) PEG1(S4) PEG3(S4) PEG7(S4) PEX0(S5) PEX1(S5) PEX2(S5) PEX3(S5) PEX4(S5) PEX5(S5) UHC1(S3) UHC2(S3) UHC3(S3) UHC4(S3) EHCI(S3) EHC2(S3) UH42(S3) UHC5(S3) UHC6(S3) AZAL(S3)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Xeon(R) CPU W3690 @ 3.47GHz, 3467.31 MHz
cpu0: FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,PCLMUL,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,SSE4.2,POPCNT,AES,NXE,LONG
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: apic clock running at 133MHz
ioapic0 at mainbus0: apid 8 pa 0xfec00000, version 20, 24 pins
acpimadt0: unknown apic structure type 7f
acpimcfg0 at acpi0 addr 0xf8000000, bus 0-63
acpihpet0 at acpi0: 14318179 Hz
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 10 (P32_)
acpiprt2 at acpi0: bus 1 (PEG1)
acpiprt3 at acpi0: bus 5 (PEG3)
acpiprt4 at acpi0: bus 6 (PEG7)
acpiprt5 at acpi0: bus 7 (PEX0)
acpiprt6 at acpi0: bus 8 (PEX1)
acpiprt7 at acpi0: bus -1 (PEX3)
acpiprt8 at acpi0: bus 9 (PEX4)
acpicpu0 at acpi0: C1, PSS
acpibtn0 at acpi0: SLPB
cpu0: Enhanced SpeedStep 3467 MHz: speeds: 3459, 3458, 3325, 3192, 3059, 2926, 2793, 2660, 2527, 2394, 2261, 2128, 1995, 1862, 1729, 1596 MHz
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel X58 Host" rev 0x13
ppb0 at pci0 dev 1 function 0 "Intel X58 PCIE" rev 0x13: msi
pci1 at ppb0 bus 1
ppb1 at pci1 dev 0 function 0 "IDT 89HPES12N3A" rev 0x0c
pci2 at ppb1 bus 2
ppb2 at pci2 dev 2 function 0 "IDT 89HPES12N3A" rev 0x0c
pci3 at ppb2 bus 3
em0 at pci3 dev 0 function 0 "Intel PRO/1000 QP (82576)" rev 0x01: msi, address 00:1b:21:c8:8f:ac
em1 at pci3 dev 0 function 1 "Intel PRO/1000 QP (82576)" rev 0x01: msi, address 00:1b:21:c8:8f:ad
ppb3 at pci2 dev 4 function 0 "IDT 89HPES12N3A" rev 0x0c
pci4 at ppb3 bus 4
em2 at pci4 dev 0 function 0 "Intel PRO/1000 QP (82576)" rev 0x01: msi, address 00:1b:21:c8:8f:ae
em3 at pci4 dev 0 function 1 "Intel PRO/1000 QP (82576)" rev 0x01: msi, address 00:1b:21:c8:8f:af
ppb4 at pci0 dev 3 function 0 "Intel X58 PCIE" rev 0x13: msi
pci5 at ppb4 bus 5
vga1 at pci5 dev 0 function 0 "NVIDIA GeForce 210" rev 0xa2
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
azalia0 at pci5 dev 0 function 1 vendor "NVIDIA", unknown product 0x0be3 rev 0xa1: msi
azalia0: no supported codecs
ppb5 at pci0 dev 7 function 0 "Intel X58 PCIE" rev 0x13: msi
pci6 at ppb5 bus 6
ix0 at pci6 dev 0 function 0 "Intel 82599 T3" rev 0x01: msi, address 00:1b:21:93:a6:40
ix1 at pci6 dev 0 function 1 "Intel 82599 T3" rev 0x01: msi, address 00:1b:21:93:a6:41
"Intel X58 QuickPath" rev 0x13 at pci0 dev 16 function 0 not configured
"Intel X58 QuickPath" rev 0x13 at pci0 dev 16 function 1 not configured
"Intel X58 Misc" rev 0x13 at pci0 dev 20 function 0 not configured
"Intel X58 GPIO" rev 0x13 at pci0 dev 20 function 1 not configured
"Intel X58 RAS" rev 0x13 at pci0 dev 20 function 2 not configured
"Intel X58 Throttle" rev 0x13 at pci0 dev 20 function 3 not configured
em4 at pci0 dev 25 function 0 "Intel ICH10 R BM LM" rev 0x00: msi, address e0:69:95:69:aa:c7
uhci0 at pci0 dev 26 function 0 "Intel 82801JI USB" rev 0x00: apic 8 int 16
uhci1 at pci0 dev 26 function 1 "Intel 82801JI USB" rev 0x00: apic 8 int 21
uhci2 at pci0 dev 26 function 2 "Intel 82801JI USB" rev 0x00: apic 8 int 19
ehci0 at pci0 dev 26 function 7 "Intel 82801JI USB" rev 0x00: apic 8 int 18
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb6 at pci0 dev 28 function 0 "Intel 82801JI PCIE" rev 0x00
pci7 at ppb6 bus 7
ppb7 at pci0 dev 28 function 1 "Intel 82801JI PCIE" rev 0x00
pci8 at ppb7 bus 8
ppb8 at pci0 dev 28 function 4 "Intel 82801JI PCIE" rev 0x00
pci9 at ppb8 bus 9
uhci3 at pci0 dev 29 function 0 "Intel 82801JI USB" rev 0x00: apic 8 int 23
uhci4 at pci0 dev 29 function 1 "Intel 82801JI USB" rev 0x00: apic 8 int 19
uhci5 at pci0 dev 29 function 2 "Intel 82801JI USB" rev 0x00: apic 8 int 18
ehci1 at pci0 dev 29 function 7 "Intel 82801JI USB" rev 0x00: apic 8 int 23
usb1 at ehci1: USB revision 2.0
uhub1 at usb1 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb9 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0x90
pci10 at ppb9 bus 10
"TI TSB43AB22 FireWire" rev 0x00 at pci10 dev 3 function 0 not configured
pcib0 at pci0 dev 31 function 0 "Intel 82801JIR LPC" rev 0x00
pciide0 at pci0 dev 31 function 2 "Intel 82801JI SATA" rev 0x00: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
pciide0: using apic 8 int 19 for native-PCI interrupt
wd0 at pciide0 channel 0 drive 0: <WDC WD5000AADS-00M2B0>
wd0: 16-sector PIO, LBA48, 476940MB, 976773168 sectors
wd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 6
ichiic0 at pci0 dev 31 function 3 "Intel 82801JI SMBus" rev 0x00: apic 8 int 18
iic0 at ichiic0
iic0: addr 0x2e 1a=80 1b=80 1c=80 1d=04 1e=87 1f=10 20=56 21=6a 22=be 23=c5 24=c6 25=36 26=26 27=29 28=10 29=0c 2a=ff 2b=ff 2c=ff 2d=ff 2e=ff 2f=ff 30=33 31=80 32=80 33=bc 34=81 36=c5 38=ff 39=ff 3a=ff 3b=e2 3c=7a 3d=ef 3e=41 3f=6f 40=35 45=ff 47=ff 49=ff 4b=ff 4d=ff 4e=81 4f=7f 50=81 51=7f 52=81 53=7f 54=ff 55=ff 56=ff 57=ff 58=ff 59=ff 5a=ff 5b=ff 5c=0a 5d=22 5e=22 5f=7a 60=8a 61=8a 62=e8 63=aa 64=33 65=80 66=80 67=55 68=2d 69=2d 6a=67 6b=41 6c=41 6d=04 6e=42 76=ed 77=d5 78=f0 7b=55 7c=01 86=ff 87=ff 8a=fb 8b=64 8c=64 8d=64 91=5d 92=5d 93=5d words 00=00e5 01=00e5 02=00e5 03=00e5 04=00e5 05=00e5 06=00e5 07=00e5
spdmem0 at iic0 addr 0x50: 1GB DDR3 SDRAM PC3-10600
spdmem1 at iic0 addr 0x52: 1GB DDR3 SDRAM PC3-10600
spdmem2 at iic0 addr 0x54: 1GB DDR3 SDRAM PC3-10600
pciide1 at pci0 dev 31 function 5 "Intel 82801JI SATA" rev 0x00: DMA, channel 0 wired to native-PCI, channel 1 wired to native-PCI
pciide1: using apic 8 int 18 for native-PCI interrupt
atapiscsi0 at pciide1 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <TSSTcorp, CDDVDW SH-222AB, SB01> ATAPI 5/cdrom removable
cd0(pciide1:1:0): using PIO mode 4, Ultra-DMA mode 5
usb2 at uhci0: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci1: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb4 at uhci2: USB revision 1.0
uhub4 at usb4 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb5 at uhci3: USB revision 1.0
uhub5 at usb5 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb6 at uhci4: USB revision 1.0
uhub6 at usb6 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb7 at uhci5: USB revision 1.0
uhub7 at usb7 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at pcib0
isadma0 at isa0
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
mtrr: Pentium Pro MTRR support
uhidev0 at uhub7 port 2 configuration 1 interface 0 "CHICONY HP Basic USB Keyboard" rev 1.10/3.00 addr 2
uhidev0: iclass 3/1
ukbd0 at uhidev0: 8 modifier keys, 6 key codes
wskbd1 at ukbd0 mux 1
wskbd1: connecting to wsdisplay0
vscsi0 at root
scsibus1 at vscsi0: 256 targets
softraid0 at root
scsibus2 at softraid0: 256 targets
root on wd0a (83390ad02a1f706a.a) swap on wd0b dump on wd0b

Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Iordan Iordanov
Peter Hallin wrote
Hello, I finally got some time to test this 10G stuff again and now I'm using
two machines with the same cards running 5.0 RELEASE (amd64/sp).

Problem is as before, when connected and in UP state, the media goes
down to 1000BaseT. If I take them both down, it goes back up to
10GbaseT. Weird. Tested with different (brand new cables) both cat 5E
and cat 6.

Good news is that the interrupt rate seems to be better, only about 15% CPU
when running at 1Gbit/s and around 1500 intrs/s.

These are two identical machines with the same hardware.
Hi Peter, your post is of extreme interest to me, as I was about to purchase two of these adapters for testing to install into Supermicro servers with H8DGU-F motherboards. I was planning to use OpenBSD 5.0 just like you. Your problem will be a show stopper for me if unresolved! Can you please keep me in the loop for any developments?

Thanks!
Iordan
Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Iordan Iordanov
In reply to this post by Peter Hallin
Peter Hallin wrote
Hello, I finally got some time to test this 10G stuff again and now I'm using
two machines with the same cards running 5.0 RELEASE (amd64/sp).

Problem is as before, when connected and in UP state, the media goes
down to 1000BaseT. If I take them both down, it goes back up to
10GbaseT. Weird. Tested with different (brand new cables) both cat 5E
and cat 6.

Good news is that the interrupt rate seems to be better, only about 15% CPU
when running at 1Gbit/s and around 1500 intrs/s.

These are two identical machines with the same hardware.
Hi Peter, your post is of extreme interest to me, as I was about to purchase two of these adapters for testing to install into Supermicro servers with H8DGU-F motherboards. I was planning to use OpenBSD 5.0 just like you. Your problem will be a show stopper for me if unresolved! Can you please keep me in the loop for any developments?

Thanks!
Iordan
Reply | Threaded
Open this post in threaded view
|

Re: Support for Intel X520-T2 10GbaseT cards

Iordan Iordanov
In reply to this post by Peter Hallin
Peter Hallin wrote
Hello, I finally got some time to test this 10G stuff again and now I'm using
two machines with the same cards running 5.0 RELEASE (amd64/sp).

Problem is as before, when connected and in UP state, the media goes
down to 1000BaseT. If I take them both down, it goes back up to
10GbaseT. Weird. Tested with different (brand new cables) both cat 5E
and cat 6.

Good news is that the interrupt rate seems to be better, only about 15% CPU
when running at 1Gbit/s and around 1500 intrs/s.

These are two identical machines with the same hardware.
Hi Peter, your post is of extreme interest to me, as I was about to purchase two of these adapters for testing to install into Supermicro servers with H8DGU-F motherboards. I was planning to use OpenBSD 5.0 just like you. Your problem will be a show stopper for me if unresolved! Can you please keep me in the loop for any developments?

Thanks!
Iordan