Re: Linux IO scalability and pushing over million IOPS oversoftware iSCSI?
From: Pasi Kärkkäinen
Date: Fri Jun 25 2010 - 05:36:07 EST
How about numbers using other transports? FC? Has someone done benchmarks recently?
On Tue, Jun 22, 2010 at 04:44:10PM +0300, Pasi Kärkkäinen wrote:
> Recently Intel and Microsoft demonstrated pushing over 1.25 million IOPS using software iSCSI and a single 10 Gbit NIC:
> Earlier they achieved one (1.0) million IOPS:
> The benchmark setup explained:
> So the question is.. does someone have enough new hardware to try this with Linux?
> Can Linux scale to over 1 million IO operations per second?
> Intel and Microsoft used the following for the benchmark:
> - Single Windows 2008 R2 system with Intel Xeon 5600 series CPU,
> single-port Intel 82599 10 Gbit NIC and MS software-iSCSI initiator
> connecting to 50x iSCSI LUNs.
> - IOmeter to benchmark all the 50x iSCSI LUNs concurrently.
> - 10 servers as iSCSI targets, each having 5x ramdisk LUNs, total of 50x ramdisk LUNs.
> - iSCSI target server also used 10 Gbit NICs, and StarWind iSCSI target software.
> - Cisco 10 Gbit switch (Nexus) connecting the servers.
> - For the 1.25 million IOPS result they used 512 bytes/IO benchmark, outstanding IOs=20.
> - No jumbo frames, just the standard MTU=1500.
> They used many LUNs so they can scale the iSCSI connections to multiple CPU cores
> using RSS (Receive Side Scaling) and MSI-X interrupts.
> So.. Who wants to try this? :) I don't unfortunately have 11x extra computers with 10 Gbit NICs atm to try it myself..
> This test covers networking, block layer, and software iSCSI initiator..
> so it would be a nice to see if we find any bottlenecks from current Linux kernel.
> Comments please!
> -- Pasi
> To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
> the body of a message to majordomo@xxxxxxxxxxxxxxx
> More majordomo info at http://vger.kernel.org/majordomo-info.html
> Please read the FAQ at http://www.tux.org/lkml/
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/