Dylan Griffiths wrote:
> A bit of a followup. A NetGear GS108 arrived today on my doorstep.
> This is listed on the gigE jumbo frame site as being clean up to around
> 9k packets ( http://darkwing.uoregon.edu/~joe/jumbo-clean-gear.html )
> which nicely complements my Intel EEPRO gigEs (good up to 16,000).
Unless you've got newer E1000 hardware (82571 or later) with fairly
recent drivers, you'll likely eventually run into problems with 9K
frames once you've been up and running for a while.
The hardware only handles power-of-two buffers, so any MTU over 8192
gets bumped up to 16K. Then you add a bit of skb overhead and round up
to the nearest power-of-two and you end up trying to do an atomic
allocation of 32KB of physically contiguous memory for every incoming
packet. After a while the system can get fragmented enough that this
just isn't available.
We spent quite a while on a solution for this issue...
> The issue I still have is that NFS is kicking around 60-120Mbps, not the
> 300 I can get using iperf over TCP. I'll have to do some more tweaking
> (Tony Arkles sent me some great resources to work from).
If you haven't already, mount using 8K for "rsize" and "wsize". If
you're using NFS4, it can handle up to 32K.
Chris
Received on Fri Jul 6 23:19:30 2007
This archive was generated by hypermail 2.1.8 : Fri Jul 06 2007 - 23:19:33 CST