ix? / Intel(R) PRO/10GbE

[Daniel Braniss]

I finally got a 10G card that is recognized by FreeBSD (9.1-stable):
..
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8> port
0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at device
0.0 on pci4
ix0: Using MSIX interrupts with 9 vectors
ix0: RX Descriptors exceed system mbuf max, using default instead!
ix0: Ethernet address: 90:e2:ba:29:c0:54
ix0: PCI Express Bus: Speed 5.0Gb/s Width x8
..
but it apperas as ix0/ix1, manuals only mention ixgb/e,
and ifconfig:

ix0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=401bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS
UM,TSO4,VLAN_HWTSO>
ether 90:e2:ba:29:c0:54
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
ix1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=401bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCS
UM,TSO4,VLAN_HWTSO>
ether 90:e2:ba:29:c0:55
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier

and pciconf:
ix0@pci0:4:0:0: class=0x020000 card=0x7a118086 chip=0x10fb8086 rev=0x01
hdr=0x00
vendor = 'Intel Corporation'
device = '82599EB 10-Gigabit SFI/SFP+ Network Connection'
class = network
subclass = ethernet

Secondly how is this fixable:
RX Descriptors exceed system mbuf max, using default instead!

thanks,
danny

_______________________________________________
freebsd...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-stable
To unsubscribe, send any mail to "freebsd-stabl...@freebsd.org"

[Luigi Rizzo]

ixgbe is the _driver name_, ix is the _interface name_ you
see in ifconfig. The latter is usually shorter.

Also there are overlaps, e.g. the lem, em and igb drivers
all map to "em" as interface name.

cheers
luigi

On Tue, Feb 12, 2013 at 7:21 AM, Daniel Braniss <da...@cs.huji.ac.il> wrote:

> I finally got a 10G card that is recognized by FreeBSD (9.1-stable):

> ...

> ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8> port
> 0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at
> device
> 0.0 on pci4
> ix0: Using MSIX interrupts with 9 vectors
> ix0: RX Descriptors exceed system mbuf max, using default instead!
> ix0: Ethernet address: 90:e2:ba:29:c0:54
> ix0: PCI Express Bus: Speed 5.0Gb/s Width x8

> ...

--
-----------------------------------------+-------------------------------
Prof. Luigi RIZZO, ri...@iet.unipi.it . Dip. di Ing. dell'Informazione
http://www.iet.unipi.it/~luigi/ . Universita` di Pisa
TEL +39-050-2211611 . via Diotisalvi 2
Mobile +39-338-6809875 . 56122 PISA (Italy)
-----------------------------------------+-------------------------------

[Teske, Devin]

On Tue, 12 Feb 2013, Daniel Braniss wrote:

> I finally got a 10G card that is recognized by FreeBSD (9.1-stable):

> ...

> ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8> port
> 0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at device
> 0.0 on pci4
> ix0: Using MSIX interrupts with 9 vectors
> ix0: RX Descriptors exceed system mbuf max, using default instead!
> ix0: Ethernet address: 90:e2:ba:29:c0:54
> ix0: PCI Express Bus: Speed 5.0Gb/s Width x8

> ...

From reading sys/dev/ixgbe/README:

echo "kern.ipc.nmbclusters=262144" >> /etc/sysctl.conf
echo "kern.ipc.nmbjumbop=262144" >> /etc/sysctl.conf
reboot
--
Devin

_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.

[Daniel Braniss]

thanks Luigi,
the 'confusion' could have been avoided if at least in the dmesg,
the fuller name was used, and yes, I hate apple/linux
just calling then eth0, eth1 :-)

danny

> --e89a8f2346bd28ba3c04d588ab1a
> Content-Type: text/html; charset=ISO-8859-1
> Content-Transfer-Encoding: quoted-printable
>
> <div dir=3D"ltr"><font face=3D"courier new,monospace">ixgbe is the _driver =
> name_, ix is the _interface name_ you</font><div><font face=3D"courier new,=
> monospace">see in ifconfig. The latter is usually shorter.</font></div><div=
> style>
> <br></div><div style><font face=3D"courier new, monospace">Also there are o=
> verlaps, e.g. the lem, em and igb drivers</font></div><div style><font face=
> =3D"courier new, monospace">all map to &quot;em&quot; as interface name.</f=
> ont></div>
> <div style><font face=3D"courier new, monospace"><br></font></div><div styl=
> e><font face=3D"courier new,monospace">cheers</font></div><div style><font =
> face=3D"courier new,monospace">luigi</font></div></div><div class=3D"gmail_=
> extra">
> <br><br><div class=3D"gmail_quote">On Tue, Feb 12, 2013 at 7:21 AM, Daniel =
> Braniss <span dir=3D"ltr">&lt;<a href=3D"mailto:da...@cs.huji.ac.il" target=
> =3D"_blank">da...@cs.huji.ac.il</a>&gt;</span> wrote:<br><blockquote class=
> =3D"gmail_quote" style=3D"margin:0 0 0 .8ex;border-left:1px #ccc solid;padd=
> ing-left:1ex">
> I finally got a 10G card that is recognized by FreeBSD (9.1-stable):<br>
> ...<br>
> ix0: &lt;Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8&gt;=
> port<br>
> 0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at dev=
> ice<br>
> 0.0 on pci4<br>
> ix0: Using MSIX interrupts with 9 vectors<br>
> ix0: RX Descriptors exceed system mbuf max, using default instead!<br>
> ix0: Ethernet address: 90:e2:ba:29:c0:54<br>
> ix0: PCI Express Bus: Speed 5.0Gb/s Width x8<br>
> ...<br>
> but it apperas as ix0/ix1, manuals only mention ixgb/e,<br>
> and ifconfig:<br>
> <br>
> ix0: flags=3D8802&lt;BROADCAST,SIMPLEX,MULTICAST&gt; metric 0 mtu 1500<br>
> =A0 =A0 =A0 =A0 options=3D401bb&lt;RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JU=
> MBO_MTU,VLAN_HWCS<br>
> UM,TSO4,VLAN_HWTSO&gt;<br>
> =A0 =A0 =A0 =A0 ether 90:e2:ba:29:c0:54<br>
> =A0 =A0 =A0 =A0 nd6 options=3D21&lt;PERFORMNUD,AUTO_LINKLOCAL&gt;<br>
> =A0 =A0 =A0 =A0 media: Ethernet autoselect<br>
> =A0 =A0 =A0 =A0 status: no carrier<br>
> ix1: flags=3D8802&lt;BROADCAST,SIMPLEX,MULTICAST&gt; metric 0 mtu 1500<br>
> =A0 =A0 =A0 =A0 options=3D401bb&lt;RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JU=
> MBO_MTU,VLAN_HWCS<br>
> UM,TSO4,VLAN_HWTSO&gt;<br>
> =A0 =A0 =A0 =A0 ether 90:e2:ba:29:c0:55<br>
> =A0 =A0 =A0 =A0 nd6 options=3D21&lt;PERFORMNUD,AUTO_LINKLOCAL&gt;<br>
> =A0 =A0 =A0 =A0 media: Ethernet autoselect<br>
> =A0 =A0 =A0 =A0 status: no carrier<br>
> <br>
> and pciconf:<br>
> ix0@pci0:4:0:0: class=3D0x020000 card=3D0x7a118086 chip=3D0x10fb8086 rev=3D=
> 0x01<br>
> hdr=3D0x00<br>
> =A0 =A0 vendor =A0 =A0 =3D &#39;Intel Corporation&#39;<br>
> =A0 =A0 device =A0 =A0 =3D &#39;82599EB 10-Gigabit SFI/SFP+ Network Connect=
> ion&#39;<br>
> =A0 =A0 class =A0 =A0 =A0=3D network<br>
> =A0 =A0 subclass =A0 =3D ethernet<br>
> <br>
> Secondly how is this fixable:<br>
> =A0 =A0 =A0 =A0 RX Descriptors exceed system mbuf max, using default instea=
> d!<br>
> <br>
> thanks,<br>
> =A0 =A0 =A0 =A0 danny<br>
> <br>
> _______________________________________________<br>
> <a href=3D"mailto:freebsd...@freebsd.org">freebsd...@freebsd.org</a=
> > mailing list<br>
> <a href=3D"http://lists.freebsd.org/mailman/listinfo/freebsd-stable" target=
> =3D"_blank">http://lists.freebsd.org/mailman/listinfo/freebsd-stable</a><br=
> >
> To unsubscribe, send any mail to &quot;<a href=3D"mailto:freebsd-stable-uns=
> ubsc...@freebsd.org">freebsd-stabl...@freebsd.org</a>&quot;<br>
> </blockquote></div><br><br clear=3D"all"><div><br></div>-- <br><font face=
> =3D"&#39;courier new&#39;, monospace">-------------------------------------=
> ----+-------------------------------<br> =A0Prof. Luigi RIZZO, <a href=3D"m=
> ailto:ri...@iet.unipi.it" target=3D"_blank">ri...@iet.unipi.it</a> =A0. Dip=
> . di Ing. dell&#39;Informazione<br>
> =A0<a href=3D"http://www.iet.unipi.it/~luigi/" target=3D"_blank">http://ww=
> w.iet.unipi.it/~luigi/</a> =A0 =A0 =A0 =A0. Universita` di Pisa<br> =A0TEL =
> =A0 =A0 =A0+39-050-2211611 =A0 =A0 =A0 =A0 =A0 =A0 =A0 . via Diotisalvi 2<b=
> r> =A0Mobile =A0 +39-338-6809875 =A0 =A0 =A0 =A0 =A0 =A0 =A0 . 56122 PISA (=
> Italy)<br>
> -----------------------------------------+-------------------------------</=
> font><br>
> </div>
>
> --e89a8f2346bd28ba3c04d588ab1a--

[Daniel Braniss]

> On Tue, 12 Feb 2013, Daniel Braniss wrote:
>
> > I finally got a 10G card that is recognized by FreeBSD (9.1-stable):
> > ...
> > ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8> port

> > 0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at d=evice

> > 0.0 on pci4
> > ix0: Using MSIX interrupts with 9 vectors
> > ix0: RX Descriptors exceed system mbuf max, using default instead!
>

> From reading sys/dev/ixgbe/README:
>
> echo "kern.ipc.nmbclusters=262144" >> /etc/sysctl.conf
> echo "kern.ipc.nmbjumbop=262144" >> /etc/sysctl.conf
> reboot
> --
> Devin
>

Hi Devin,
keep forgetting, 'may the source be with you' :-)

but this only works if the driver is loaded after
the sysctl is executed!
it's better to put it in /boot/loader.conf

thanks,
danny

[Teske, Devin]

On Tue, 12 Feb 2013, Daniel Braniss wrote:

> > On Tue, 12 Feb 2013, Daniel Braniss wrote:
> >
> > > I finally got a 10G card that is recognized by FreeBSD (9.1-stable):
> > > ...
> > > ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8> port
> > > 0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at d=evice
> > > 0.0 on pci4
> > > ix0: Using MSIX interrupts with 9 vectors
> > > ix0: RX Descriptors exceed system mbuf max, using default instead!
> >
> > From reading sys/dev/ixgbe/README:
> >
> > echo "kern.ipc.nmbclusters=262144" >> /etc/sysctl.conf
> > echo "kern.ipc.nmbjumbop=262144" >> /etc/sysctl.conf
> > reboot
>

> but this only works if the driver is loaded after
> the sysctl is executed!
> it's better to put it in /boot/loader.conf

Not necessarily, it depends when the driver grabs the mbufs. In the case of the igb/ixgb/ixgbe drivers, this happens when the interface is brought up (not when the driver is loaded, nor when the driver probes/attaches a PHY). In other words, you don't have to worry about mbuf exhaustion until you say "ifconfig ix0 up" (in the case of ixgbe, bringing up even a single interface is enough through the default mbufs and require more).

Since sysctl.conf is processed before the network is brought up, putting the parameters in sysctl.conf will be perfectly suitable for most needs (unless for some strange reason you need to "up" an interface before sysctl.conf is processed).

--
Devin

_____________
The information contained in this message is proprietary and/or confidential. If you are not the intended recipient, please: (i) delete the message and all copies; (ii) do not disclose, distribute or use the message in any manner; and (iii) notify the sender immediately. In addition, please be aware that any message addressed to our domain is subject to archiving and review by persons other than the intended recipient. Thank you.

[Steven Hartland]

----- Original Message -----
From: "Teske, Devin"

> On Tue, 12 Feb 2013, Daniel Braniss wrote:
>
>> > On Tue, 12 Feb 2013, Daniel Braniss wrote:
>> >
>> > > I finally got a 10G card that is recognized by FreeBSD (9.1-stable):
>> > > ...
>> > > ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.4.8> port
>> > > 0xecc0-0xecdf mem 0xd9e80000-0xd9efffff,0xd9ff8000-0xd9ffbfff irq 40 at d=evice
>> > > 0.0 on pci4
>> > > ix0: Using MSIX interrupts with 9 vectors
>> > > ix0: RX Descriptors exceed system mbuf max, using default instead!
>> >
>> > From reading sys/dev/ixgbe/README:
>> >
>> > echo "kern.ipc.nmbclusters=262144" >> /etc/sysctl.conf
>> > echo "kern.ipc.nmbjumbop=262144" >> /etc/sysctl.conf
>> > reboot
>>
>> but this only works if the driver is loaded after
>> the sysctl is executed!
>> it's better to put it in /boot/loader.conf
>
> Not necessarily, it depends when the driver grabs the mbufs. In the case of the igb/ixgb/ixgbe drivers, this happens when the
> interface is brought up (not when the driver is loaded, nor when the driver probes/attaches a PHY). In other words, you don't
> have to worry about mbuf exhaustion until you say "ifconfig ix0 up" (in the case of ixgbe, bringing up even a single interface
> is enough through the default mbufs and require more).
>
> Since sysctl.conf is processed before the network is brought up, putting the parameters in sysctl.conf will be perfectly
> suitable for most needs (unless for some strange reason you need to "up" an interface before sysctl.conf is processed).

That wasn't the case for ix for 8.3, not sure if its changed recently but
without setting it in loader.conf the interface would error.

Regards
Steve


================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it.

In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postm...@multiplay.co.uk.