Re: RFC: MTU for serving NFS on Infiniband

From: David Miller
Date: Thu Aug 26 2010 - 20:06:04 EST


From: Stephen Hemminger <shemminger@xxxxxxxxxx>
Date: Thu, 26 Aug 2010 16:53:59 -0700

> On Thu, 26 Aug 2010 08:43:42 -0600 (Mountain Daylight Time)
> Marc Aurele La France <tsi@xxxxxxxxxxx> wrote:
>
>> Right. And a 65520 MTU allocates sk_buff's with 128K contiguous payloads.
>
> Infiniband device driver needs to be fixed to do SG and checksum offload.

Agreed, this problem is in the infiniband layer and should be fixed
there.

But I fear there is a real potential blocker for this, if the
infiniband layer can't checksum transmit packets in hardware we cannot
legitimately add SG support.

Paged SKBs can have references to page cache pages and similar. These
can be updated asynchronously to the transmit, there is no locking at
all to freeze the contents, and therefore full checksum offload is
required to support SG correctly.

So don't get the idea to do the checksum in software in the infiniband
layer, and advertize hw checksumming support, to get around this :-)
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/