Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

freebsd-net Digest, Vol 366, Issue 5

1 view
Skip to first unread message

freebsd-n...@freebsd.org

unread,
Apr 9, 2010, 8:00:19 AM4/9/10
to freeb...@freebsd.org
Send freebsd-net mailing list submissions to
freeb...@freebsd.org

To subscribe or unsubscribe via the World Wide Web, visit
http://lists.freebsd.org/mailman/listinfo/freebsd-net
or, via email, send a message with subject or body 'help' to
freebsd-n...@freebsd.org

You can reach the person managing the list at
freebsd-...@freebsd.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of freebsd-net digest..."


Today's Topics:

1. Re: kern/144917: Flowtable crashes system (Barney Cordoba)
2. Re: kern/144917: Flowtable crashes system (Vincent Hoffman)
3. Re: kern/144917: Flowtable crashes system (K. Macy)
4. Broadcom BCM5701 / HP NC6770 (Erich Jenkins, Fuujin Group Ltd)
5. Re: Broadcom BCM5701 / HP NC6770 (Evgenii Davidov)
6. Re: Broadcom BCM5701 / HP NC6770
(Erich Jenkins, Fuujin Group Ltd)


----------------------------------------------------------------------

Message: 1
Date: Thu, 8 Apr 2010 05:07:29 -0700 (PDT)
From: Barney Cordoba <barney_...@yahoo.com>
Subject: Re: kern/144917: Flowtable crashes system
To: Ilya Zhuravlev <il...@el-crane.net>, km...@freebsd.org
Cc: freeb...@freebsd.org, Evgenii Davidov <da...@korolev-net.ru>
Message-ID: <31285.6...@web63906.mail.re1.yahoo.com>
Content-Type: text/plain; charset=utf-8

--- On Fri, 4/2/10, K. Macy <km...@freebsd.org> wrote:

> From: K. Macy <km...@freebsd.org>
> Subject: Re: kern/144917: Flowtable crashes system
> To: "Ilya Zhuravlev" <il...@el-crane.net>
> Cc: freeb...@freebsd.org, "Evgenii Davidov" <da...@korolev-net.ru>
> Date: Friday, April 2, 2010, 11:07 PM
> Please try with the latest 8-STABLE
> and tell me if recent changes fix it.
>
> Thanks,
> Kip
>
> On Thu, Mar 25, 2010 at 8:32 AM, Ilya Zhuravlev <il...@el-crane.net>
> wrote:
> > On 21.03.2010 17:04, Evgenii Davidov wrote:
> >>
> >> Ð—Ð´Ñ€Ð°Ð²Ñ Ñ‚Ð²ÑƒÐ¹Ñ‚Ðµ,
> >>
> >> On Sat, Mar 20, 2010 at 11:06:35PM +0000, Doychin
> Dokov пишет:
> >>
> >>>> Description:
> >>>
> >>> It seems like flowtable has been merged and
> enabled by default in 8.0....
> >>> which is a really really bad idea.
> >>> On a system which handles two full BGP tables
> it makes one of the CPU
> >>> cores run at 100% right after most of the
> prefixes get installed in the
> >>> routing table.
> >>
> >> i saw the same effect with ospf
> >>
> >
> > 8.0-p2, 2 full-view with openbgpd
> > "tuning":
> > net.inet.tcp.blackhole=2
> > net.inet.udp.blackhole=1
> > net.inet.icmp.icmplim_output=0
> > net.inet.icmp.drop_redirect=1
> > net.inet.flowtable.nmbflows=32768
> >
> > 1 week uptime.Now I think only about increasing tx/rx
> descriptors to reduce
> > interrupts (default values was not changed)
> >
> >
> > netstat -w1 -Iigb0
> >            input         (igb0)        
>   output
> >   packets  errs      bytes    packets  errs  
>    bytes colls
> >     49100     0   12290513      23693     0
>   27268884     0
> >     48322     0   12688283      24332     0
>   28099404     0
> >     50602     0   12759620      24437     0
>   27698341     0
> >     47857     0   11354124      21410     0
>   23845155     0
> >
> > netstat -w1 -Iigb1
> >            input         (igb1)        
>   output
> >   packets  errs      bytes    packets  errs  
>    bytes colls
> >     32428     0   35027019      24562     0
>    5624934     0
> >     30621     0   33384339      23569     0
>    4456944     0
> >     28419     0   31014269      21571     0
>    3638083     0
> >     29409     0   32524760      22137     0
>    3503600     0
> >     30965     0   33532742      23973     0
>    5089231     0
> >
> > netstat -w1 -Iem0
> >            input          (em0)        
>   output
> >   packets  errs      bytes    packets  errs  
>    bytes colls
> >     17217     0    3929366      72741     0
>   46377762     0
> >     17412     0    3745112      75522     0
>   49338883     0
> >     18385     0    4014568      77444     0
>   50532101     0
> >     17142     0    3875518      77125     0
>   47646681     0
> >     16870     0    3528316      73188     0
>   47940959     0
> >     17069     0    3682891      80268     0
>   52904747     0
> >     17313     0    4101576      75586     0
>   51933330     0
> > _______________________________________________
> > freeb...@freebsd.org


How about telling us how to turn it off; or better yet how to not
compile it into the kernel at all. Thats the best solution.

As my Dad used to say on a regular basis, we need this like we
need a hole in our head. Is 8.0 the Kip Macy personal test bed?

Why is something that virtually no-one needs enabled by default?

Barney



------------------------------

Message: 2
Date: Thu, 08 Apr 2010 14:05:34 +0100
From: Vincent Hoffman <vi...@unsane.co.uk>
Subject: Re: kern/144917: Flowtable crashes system
To: Barney Cordoba <barney_...@yahoo.com>
Cc: freeb...@freebsd.org
Message-ID: <4BBDD49E...@unsane.co.uk>
Content-Type: text/plain; charset=UTF-8

On 08/04/2010 13:07, Barney Cordoba wrote:
>
> --- On Fri, 4/2/10, K. Macy <km...@freebsd.org> wrote:
>
>
>> From: K. Macy <km...@freebsd.org>
>> Subject: Re: kern/144917: Flowtable crashes system
>> To: "Ilya Zhuravlev" <il...@el-crane.net>
>> Cc: freeb...@freebsd.org, "Evgenii Davidov" <da...@korolev-net.ru>
>> Date: Friday, April 2, 2010, 11:07 PM
>> Please try with the latest 8-STABLE
>> and tell me if recent changes fix it.
>>
>> Thanks,
>> Kip
>>
>> On Thu, Mar 25, 2010 at 8:32 AM, Ilya Zhuravlev <il...@el-crane.net>
>> wrote:
>>
>>> On 21.03.2010 17:04, Evgenii Davidov wrote:
>>>
>>>> Ð—Ð´Ñ€Ð°Ð²Ñ Ñ‚Ð²ÑƒÐ¹Ñ‚Ðµ,
>>>>
>>>> On Sat, Mar 20, 2010 at 11:06:35PM +0000, Doychin
>>>>
>> Dokov пишет:
>>
>>>>
>>>>>> Description:
>>>>>>
>>>>> It seems like flowtable has been merged and
>>>>>
>> enabled by default in 8.0....
>>
>>>>> which is a really really bad idea.
>>>>> On a system which handles two full BGP tables
>>>>>
>> it makes one of the CPU
>>
>>>>> cores run at 100% right after most of the
>>>>>
>> prefixes get installed in the
>>
>>>>> routing table.
>>>>>
>>>> i saw the same effect with ospf
>>>>
>>>>
>>> 8.0-p2, 2 full-view with openbgpd
>>> "tuning":
>>> net.inet.tcp.blackhole=2
>>> net.inet.udp.blackhole=1
>>> net.inet.icmp.icmplim_output=0
>>> net.inet.icmp.drop_redirect=1
>>> net.inet.flowtable.nmbflows=32768
>>>
>>> 1 week uptime.Now I think only about increasing tx/rx
>>>
>> descriptors to reduce
>>
>>> interrupts (default values was not changed)
>>>
>>>
>>> netstat -w1 -Iigb0
>>> input (igb0)
>>>
>> output
>>
>>> packets errs bytes packets errs
>>>
>> bytes colls
>>
>>> 49100 0 12290513 23693 0
>>>
>> 27268884 0
>>
>>> 48322 0 12688283 24332 0
>>>
>> 28099404 0
>>
>>> 50602 0 12759620 24437 0
>>>
>> 27698341 0
>>
>>> 47857 0 11354124 21410 0
>>>
>> 23845155 0
>>
>>> netstat -w1 -Iigb1
>>> input (igb1)
>>>
>> output
>>
>>> packets errs bytes packets errs
>>>
>> bytes colls
>>
>>> 32428 0 35027019 24562 0
>>>
>> 5624934 0
>>
>>> 30621 0 33384339 23569 0
>>>
>> 4456944 0
>>
>>> 28419 0 31014269 21571 0
>>>
>> 3638083 0
>>
>>> 29409 0 32524760 22137 0
>>>
>> 3503600 0
>>
>>> 30965 0 33532742 23973 0
>>>
>> 5089231 0
>>
>>> netstat -w1 -Iem0
>>> input (em0)
>>>
>> output
>>
>>> packets errs bytes packets errs
>>>
>> bytes colls
>>
>>> 17217 0 3929366 72741 0
>>>
>> 46377762 0
>>
>>> 17412 0 3745112 75522 0
>>>
>> 49338883 0
>>
>>> 18385 0 4014568 77444 0
>>>
>> 50532101 0
>>
>>> 17142 0 3875518 77125 0
>>>
>> 47646681 0
>>
>>> 16870 0 3528316 73188 0
>>>
>> 47940959 0
>>
>>> 17069 0 3682891 80268 0
>>>
>> 52904747 0
>>
>>> 17313 0 4101576 75586 0
>>>
>> 51933330 0
>>
>>> _______________________________________________
>>> freeb...@freebsd.org
>>>
>
> How about telling us how to turn it off; or better yet how to not
> compile it into the kernel at all. Thats the best solution.
>
> As my Dad used to say on a regular basis, we need this like we
> need a hole in our head. Is 8.0 the Kip Macy personal test bed?
>
> Why is something that virtually no-one needs enabled by default?
>
> Barney
>
>
I havent followed the whole thread so if this doesnt actally work for
some reason then sorry for noise.

[root@prawn ~]# sysctl -a | grep flowtable
net.inet.ip.output_flowtable_size: 2048
net.inet.flowtable.nmbflows: 4096
net.inet.flowtable.tcp_expire: 86400
net.inet.flowtable.fin_wait_expire: 600
net.inet.flowtable.udp_expire: 300
net.inet.flowtable.syn_expire: 300
net.inet.flowtable.collisions: 0
net.inet.flowtable.max_depth: 0
net.inet.flowtable.free_checks: 8845
net.inet.flowtable.frees: 2181
net.inet.flowtable.misses: 2403
net.inet.flowtable.lookups: 11633
net.inet.flowtable.hits: 9231
net.inet.flowtable.enable: 1
net.inet.flowtable.debug: 0


[root@prawn ~]# sysctl -d net.inet.flowtable.enable
net.inet.flowtable.enable: enable flowtable caching.

[root@prawn ~]# sysctl net.inet.flowtable.enable=0
net.inet.flowtable.enable: 1 -> 0


Vince
>
> _______________________________________________
> freeb...@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net...@freebsd.org"
>

------------------------------

Message: 3
Date: Thu, 8 Apr 2010 11:07:52 -0700
From: "K. Macy" <km...@freebsd.org>
Subject: Re: kern/144917: Flowtable crashes system
To: Vincent Hoffman <vi...@unsane.co.uk>
Cc: freeb...@freebsd.org
Message-ID:
<j2y82c4140e1004081107p7...@mail.gmail.com>
Content-Type: text/plain; charset=KOI8-R

Hi Vincent,
Thanks for your response. However, the answers to both his questions
have been given many times before and he knows them already. This
person has not made material contributions to discussions and has in
fact made active efforts to reduce the signal to noise ratio.

Cheers,
Kip


On Thu, Apr 8, 2010 at 6:05 AM, Vincent Hoffman <vi...@unsane.co.uk> wrote:
> On 08/04/2010 13:07, Barney Cordoba wrote:
>>
>> --- On Fri, 4/2/10, K. Macy <km...@freebsd.org> wrote:
>>
>>
>>> From: K. Macy <km...@freebsd.org>
>>> Subject: Re: kern/144917: Flowtable crashes system
>>> To: "Ilya Zhuravlev" <il...@el-crane.net>
>>> Cc: freeb...@freebsd.org, "Evgenii Davidov" <da...@korolev-net.ru>
>>> Date: Friday, April 2, 2010, 11:07 PM
>>> Please try with the latest 8-STABLE
>>> and tell me if recent changes fix it.
>>>
>>> Thanks,
>>> Kip
>>>
>>> On Thu, Mar 25, 2010 at 8:32 AM, Ilya Zhuravlev <il...@el-crane.net>
>>> wrote:
>>>
>>>> On 21.03.2010 17:04, Evgenii Davidov wrote:
>>>>
>>>>> úÄÒÁ×ÓÔ×ÕÊÔÅ,
>>>>>
>>>>> On Sat, Mar 20, 2010 at 11:06:35PM +0000, Doychin
>>>>>
>>> Dokov ÐÉÛÅÔ:
>>>
>>>>>
>>>>>>> Description:
>>>>>>>
>>>>>> It seems like flowtable has been merged and
>>>>>>
>>> enabled by default in 8.0....
>>>
>>>>>> which is a really really bad idea.
>>>>>> On a system which handles two full BGP tables
>>>>>>
>>> it makes one of the CPU
>>>
>>>>>> cores run at 100% right after most of the
>>>>>>
>>> prefixes get installed in the
>>>
>>>>>> routing table.
>>>>>>
>>>>> i saw the same effect with ospf
>>>>>
>>>>>
>>>> 8.0-p2, 2 full-view with openbgpd
>>>> "tuning":
>>>> net.inet.tcp.blackhole=2
>>>> net.inet.udp.blackhole=1
>>>> net.inet.icmp.icmplim_output=0
>>>> net.inet.icmp.drop_redirect=1
>>>> net.inet.flowtable.nmbflows=32768
>>>>
>>>> 1 week uptime.Now I think only about increasing tx/rx
>>>>
>>> descriptors to reduce
>>>
>>>> interrupts (default values was not changed)
>>>>
>>>>
>>>> netstat -w1 -Iigb0
>>>> š š š š š šinput š š š š (igb0)
>>>>
>>> š output
>>>
>>>> š packets šerrs š š šbytes š špackets šerrs
>>>>
>>> š šbytes colls
>>>
>>>> š š 49100 š š 0 š 12290513 š š š23693 š š 0
>>>>
>>> š 27268884 š š 0
>>>
>>>> š š 48322 š š 0 š 12688283 š š š24332 š š 0
>>>>
>>> š 28099404 š š 0
>>>
>>>> š š 50602 š š 0 š 12759620 š š š24437 š š 0
>>>>
>>> š 27698341 š š 0
>>>
>>>> š š 47857 š š 0 š 11354124 š š š21410 š š 0
>>>>
>>> š 23845155 š š 0
>>>
>>>> netstat -w1 -Iigb1
>>>> š š š š š šinput š š š š (igb1)
>>>>
>>> š output
>>>
>>>> š packets šerrs š š šbytes š špackets šerrs
>>>>
>>> š šbytes colls
>>>
>>>> š š 32428 š š 0 š 35027019 š š š24562 š š 0
>>>>
>>> š š5624934 š š 0
>>>
>>>> š š 30621 š š 0 š 33384339 š š š23569 š š 0
>>>>
>>> š š4456944 š š 0
>>>
>>>> š š 28419 š š 0 š 31014269 š š š21571 š š 0
>>>>
>>> š š3638083 š š 0
>>>
>>>> š š 29409 š š 0 š 32524760 š š š22137 š š 0
>>>>
>>> š š3503600 š š 0
>>>
>>>> š š 30965 š š 0 š 33532742 š š š23973 š š 0
>>>>
>>> š š5089231 š š 0
>>>
>>>> netstat -w1 -Iem0
>>>> š š š š š šinput š š š š š(em0)
>>>>
>>> š output
>>>
>>>> š packets šerrs š š šbytes š špackets šerrs
>>>>
>>> š šbytes colls
>>>
>>>> š š 17217 š š 0 š š3929366 š š š72741 š š 0
>>>>
>>> š 46377762 š š 0
>>>
>>>> š š 17412 š š 0 š š3745112 š š š75522 š š 0
>>>>
>>> š 49338883 š š 0
>>>
>>>> š š 18385 š š 0 š š4014568 š š š77444 š š 0
>>>>
>>> š 50532101 š š 0
>>>
>>>> š š 17142 š š 0 š š3875518 š š š77125 š š 0
>>>>
>>> š 47646681 š š 0
>>>
>>>> š š 16870 š š 0 š š3528316 š š š73188 š š 0
>>>>
>>> š 47940959 š š 0
>>>
>>>> š š 17069 š š 0 š š3682891 š š š80268 š š 0
>>>>
>>> š 52904747 š š 0
>>>
>>>> š š 17313 š š 0 š š4101576 š š š75586 š š 0
>>>>
>>> š 51933330 š š 0
>>>
>>>> _______________________________________________
>>>> freeb...@freebsd.org
>>>>
>>
>> How about telling us how to turn it off; or better yet how to not
>> compile it into the kernel at all. Thats the best solution.
>>
>> As my Dad used to say on a regular basis, we need this like we
>> need a hole in our head. Is 8.0 the Kip Macy personal test bed?
>>
>> Why is something that virtually no-one needs enabled by default?
>>
>> Barney
>>
>>
> I havent followed the whole thread so if this doesnt actally work for
> some reason then sorry for noise.
>
> [root@prawn ~]# sysctl -a | grep flowtable
> net.inet.ip.output_flowtable_size: 2048
> net.inet.flowtable.nmbflows: 4096
> net.inet.flowtable.tcp_expire: 86400
> net.inet.flowtable.fin_wait_expire: 600
> net.inet.flowtable.udp_expire: 300
> net.inet.flowtable.syn_expire: 300
> net.inet.flowtable.collisions: 0
> net.inet.flowtable.max_depth: 0
> net.inet.flowtable.free_checks: 8845
> net.inet.flowtable.frees: 2181
> net.inet.flowtable.misses: 2403
> net.inet.flowtable.lookups: 11633
> net.inet.flowtable.hits: 9231
> net.inet.flowtable.enable: 1
> net.inet.flowtable.debug: 0
>
>
> [root@prawn ~]# sysctl -d net.inet.flowtable.enable
> net.inet.flowtable.enable: enable flowtable caching.
>
> [root@prawn ~]# sysctl net.inet.flowtable.enable=0
> net.inet.flowtable.enable: 1 -> 0
>
>
> Vince
>>
>> _______________________________________________
>> freeb...@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net...@freebsd.org"
>>
>
> _______________________________________________
> freeb...@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net...@freebsd.org"
>


------------------------------

Message: 4
Date: Fri, 09 Apr 2010 01:39:16 -0600
From: "Erich Jenkins, Fuujin Group Ltd" <er...@fuujingroup.com>
Subject: Broadcom BCM5701 / HP NC6770
To: freeb...@freebsd.org
Message-ID: <4BBED9A4...@fuujingroup.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

I just upgraded one of the lab boxes, an HP DL580-G3 with an NC6770 GigE
fiber card to 7.0-REL, and noticed that this card no longer works:

bge0@pci0:10:1:0: class=0x020000 card=0x00c10e11 chip=0x164514e4
rev=0x15 hdr=0x00
vendor = 'Broadcom Corporation'
device = 'BCM5701 NetXtreme BCM5701 Gigabit Ethernet'
class = network
subclass = ethernet

We were previously running 5.3 on this box (I know, VERY old), but never
had a problem. The link now fails to come up. I've tried forcing the
port out of auto (media 1000baseSX mediaopt full-duplex) and as long as
the port doesn't have an IP assigned via rc.conf on system boot, I can
get the switch to see it (Cisco 6505), but no traffic to flow. I've
checked all the obvious things (duplex setting on switch, cable failure,
etc.), all to no avail. I fiddled with the knobs in the driver (rxcsum,
vlan_mtu, etc) with no changes either.

Any input would be greatly appreciated.

--
Erich M. Jenkins
Fuujin Group Limited

"You should never, never doubt what no one is sure about."
-- Gene Wilder


------------------------------

Message: 5
Date: Fri, 9 Apr 2010 11:01:47 +0400
From: Evgenii Davidov <da...@korolev-net.ru>
Subject: Re: Broadcom BCM5701 / HP NC6770
To: freeb...@freebsd.org
Message-ID: <20100409070...@korolev-net.ru>
Content-Type: text/plain; charset=koi8-r

úÄÒÁ×ÓÔ×ÕÊÔÅ,

On Fri, Apr 09, 2010 at 01:39:16AM -0600, Erich Jenkins, Fuujin Group Ltd ÐÉÛÅÔ:

> We were previously running 5.3 on this box (I know, VERY old), but never
> had a problem. The link now fails to come up. I've tried forcing the
> port out of auto (media 1000baseSX mediaopt full-duplex) and as long as
> the port doesn't have an IP assigned via rc.conf on system boot, I can
> get the switch to see it (Cisco 6505), but no traffic to flow. I've
> checked all the obvious things (duplex setting on switch, cable failure,
> etc.), all to no avail. I fiddled with the knobs in the driver (rxcsum,
> vlan_mtu, etc) with no changes either.

sorry for silly ansver but is your interface UP ? (ifconfig bge0 up)

--
Evgenii V Davidov


------------------------------

Message: 6
Date: Fri, 09 Apr 2010 02:13:00 -0600
From: "Erich Jenkins, Fuujin Group Ltd" <er...@fuujingroup.com>
Subject: Re: Broadcom BCM5701 / HP NC6770
To: Evgenii Davidov <da...@korolev-net.ru>
Cc: freeb...@freebsd.org
Message-ID: <4BBEE18C...@fuujingroup.com>
Content-Type: text/plain; charset=KOI8-R; format=flowed

Evgenii Davidov wrote:
> úÄÒÁ×ÓÔ×ÕÊÔÅ,
>
> On Fri, Apr 09, 2010 at 01:39:16AM -0600, Erich Jenkins, Fuujin Group Ltd ÐÉÛÅÔ:
>
>> We were previously running 5.3 on this box (I know, VERY old), but never
>> had a problem. The link now fails to come up. I've tried forcing the
>> port out of auto (media 1000baseSX mediaopt full-duplex) and as long as
>> the port doesn't have an IP assigned via rc.conf on system boot, I can
>> get the switch to see it (Cisco 6505), but no traffic to flow. I've
>> checked all the obvious things (duplex setting on switch, cable failure,
>> etc.), all to no avail. I fiddled with the knobs in the driver (rxcsum,
>> vlan_mtu, etc) with no changes either.
>
> sorry for silly ansver but is your interface UP ? (ifconfig bge0 up)
>

Actually, I was silly for not mentioning that in the original post, but
yes, it's up. I've even tried up/down/up on the card a few times after
fiddling with the driver knobs, but the same thing happened, no link on
the switch.

I've also tested this back-to-back with two machines and the same cards.
Same result: no transmission of data. Interestingly enough, the link
lite is lit on the cards (in back-to-back) and on the card but not the
switch. Not sure if that's significant or not. In the interest if
completeness, here's ifconfig output for that card:

bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=9b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM>
ether 00:08:02:28:76:4d
inet 10.222.222.144 netmask 0xffffff00 broadcast 10.222.222.255
media: Ethernet 1000baseSX <full-duplex>
status: active

I also verified the MTU size to ensure the switch ports weren't
configured for jumbo frames. They are correctly set on the switch and on
the FreeBSD box, but no traffic flows.

--
Erich M. Jenkins
Fuujin Group Limited

"You should never, never doubt what no one is sure about."
-- Gene Wilder


------------------------------


End of freebsd-net Digest, Vol 366, Issue 5
*******************************************

0 new messages