Re: [PATCH] mips: remove reference to "newer Loongson-3"

From: Jiaxun Yang
Date: Mon Aug 30 2021 - 12:14:48 EST




在 2021/8/30 下午8:28, Xi Ruoyao 写道:
On Mon, 2021-08-30 at 10:32 +0800, Jiaxun Yang wrote:
在 2021/8/29 20:49, Xi Ruoyao 写道:
Newest Loongson-3 processors have moved to use LoongArch
architecture.
Sadly, the LL/SC issue is still existing on both latest Loongson-3
processors using MIPS64 (Loongson-3A4000) and LoongArch
(Loongson-3A5000).
LLSC is fixed on Loongson-3A4000 as per CPUCFG report.
If I don't enable LL/SC fix, GCC libgomp tests fail on both 3A4000 and
3A5000 (using github.com/loongson/gcc for the latter) with "invalid
access to 0x00000049" or "0x00000005". This is a race condition: it
does not happen at all with OMP_NUM_THREADS=1, happens with about 10%
possibility with OMP_NUM_THREADS=2, and about 90% possibility with
OMP_NUM_THREAD=4 (on 3A5000, on 3A4000 the possibility is lower).
Apologize for the false report, yes, you are right. I had checked with Loongson guys
and they confirmed that the workaround still needs to be applied to latest 3A4000
processors, including 3A4000 for MIPS and 3A5000 for LoongArch.

Though, the reason behind the workaround varies with the evaluation of their uArch,
for GS464V based core, barrier is required as the uArch design allows regular load
to be reordered after an atomic linked load, and that would break assumption of compiler
atomic constraints.

For GS464E, barrier is required to flush the Store Fill Buffer and land all the cachelines
to L1 cache, otherwise a linked load to a cacheline located at SFB may cause deadlock.

For original GS464, barrier is required to deal with some kind of pipeline hazard to
ensure store condition won't be shorted to success.

Patch LGTM. The config symbol looks ambiguous and I'd agree with your idea of renaming.

Thanks,

- Jiaxun


My investigation suggests this means a GCC instrinic,
__atomic_compare_and_exchange_n is not really atomic as it should be.

If this is not a hardware issue in the GS464V/LA464 uarch, then it will
be very low-possibility coincidence: two unrelated code-generation bugs
for __atomic_compare_and_exchange_n (LA port has borrowed some code from
MIPS port, but the instrinics are of course newly coded). And I've
inspected libgomp & gcc code about __atomic_compare_and_exchange_n
carefully, nothing wrong spotted except LoongArch GCC supports "-mfix-
loongson3-llsc" which adds a "dbar 0" (like "sync" on MIPS) instruction
after SC (only for instrinics). Enabling this fixes the libgomp
failures. Likewisely, "-Wa,-mfix-loongson3-llsc" fixes it on 3A4000.

libgomp code has been verified with thread sanitizer on other
architectures (unfortunately libtsan is not available on MIPS or
LoongArch yet), so it's very unlikely to be a coding error leading to
the race.

And LL/SC fix is still in Huacai's 3A5000 kernel. In a mail on linux-
arch Huacai said it's "not so easy to be fixed".

Or these are two different erratas and I misunderstand them as the same
one?