On 11/4/06, Mikulas Patocka <mikulas@xxxxxxxxxxxxxxxxxxxxxxxx> wrote:>> Does one Linux kernel run on system with 1024 cpus? I guess it
>> must fry spinlocks... (or even lockup due to spinlock livelocks)
> The SGI Altix can have 2048 CPUs.
And does it run one image of Linux? Or more images each on few cpus?
Yes, of course it runs one image of Linux. It's SMP, not a cluster.
If I remember right:
2 CPUs per chip
2 chips per board (with local RAM; this is NUMA)
512 boards per machine
How do they solve problem with spinlock livelocks?
If time-spent-outside-spinlock/time-spent-in-spinlock < number-of-cpus,
the spinlock livelock may happen --- this condition is not true normally
with 2 or 4 cpus, but for that high amount of cpus, there is a danger.
Or do they have some special hardware spinlock instruction that guarantees
Well first of all it's using IA-64 processors. These do atomic operations
via instructions that are essentially "take lock" and "release lock".
The non-CPU hardware probably recognizes these operations by the
special bus cycles and does whatever is needed to ensure fairness.
Second of all, I think we just try to avoid having long spinlock hold
times. The SGI people love using RCU. As I recall, SGI also caused
Linux to get a sequence lock for jiffies.