summaryrefslogtreecommitdiff
path: root/common
diff options
context:
space:
mode:
authorriastradh <riastradh@NetBSD.org>2022-04-09 12:06:47 +0000
committerriastradh <riastradh@NetBSD.org>2022-04-09 12:06:47 +0000
commitb0368ae930fa0dda589992ab92624911dfd107dc (patch)
tree18f7997c6d5f5568238f8af6bd1ab502f84ef8f5 /common
parente5affa2d217f7877e163e6babbc1416647f086ec (diff)
sparc64: Fix membar_sync by issuing membar #StoreLoad.
In TSO this is the only memory barrier ever needed, and somehow we got this wrong and instead issued an unnecessary membar #LoadLoad -- not needed even in PSO let alone in TSO. XXX Apparently we may run userland programs with PSO or RMO, in which case all of these membars need fixing: PSO RMO membar_consumer nop membar #LoadLoad membar_producer membar #StoreStore membar #StoreStore membar_enter nop membar #LoadLoad|LoadStore membar_exit membar #StoreStore membar #LoadStore|StoreStore membar_sync membar #StoreLoad|StoreStore membar #...everything... But at least this fixes the TSO case in which we run the kernel. Also I'm not sure there's any non-TSO hardware out there in practice.
Diffstat (limited to 'common')
-rw-r--r--common/lib/libc/arch/sparc64/atomic/membar_ops.S42
1 files changed, 34 insertions, 8 deletions
diff --git a/common/lib/libc/arch/sparc64/atomic/membar_ops.S b/common/lib/libc/arch/sparc64/atomic/membar_ops.S
index 58ef6e474a1..07d8695d5b5 100644
--- a/common/lib/libc/arch/sparc64/atomic/membar_ops.S
+++ b/common/lib/libc/arch/sparc64/atomic/membar_ops.S
@@ -1,4 +1,4 @@
-/* $NetBSD: membar_ops.S,v 1.6 2022/04/06 22:47:57 riastradh Exp $ */
+/* $NetBSD: membar_ops.S,v 1.7 2022/04/09 12:06:47 riastradh Exp $ */
/*-
* Copyright (c) 2007 The NetBSD Foundation, Inc.
@@ -33,22 +33,48 @@
.text
-/* These assume Total Store Order (TSO) */
+/*
+ * These assume Total Store Order (TSO), which may reorder
+ * store-before-load but nothing else. Hence, only membar_sync must
+ * issue anything -- namely, membar #StoreLoad.
+ *
+ * If we ran with Partial Store Order (PSO), we would also need to
+ * issue membar #StoreStore for membar_exit (load/store-before-store)
+ * and membar_producer (store-before-store).
+ */
-ENTRY(_membar_producer)
+ENTRY(_membar_consumer)
retl
nop
+END(_membar_consumer)
-ENTRY(_membar_consumer)
- membar #LoadLoad
+ENTRY(_membar_sync)
+ /*
+ * Some SPARC CPUs have errata with MEMBAR in the delay slot of
+ * a branch, such as the UltraSPARC-IIi:
+ *
+ * `Apparently, the deadlock is most easily caused if the
+ * delay slot of the JMPL is a MEMBAR #Sync, or any
+ * instruction that synchronizes on the load or store
+ * buffers being empty.'
+ *
+ * UltraSPARC-IIi User's Manual, Part No. 805-0087-01, Sun
+ * Microsystems, October 1997, Appendix K.2 `Errata
+ * Created by UltraSPARC-I', Erratum 51, p. 476.
+ * https://www.oracle.com/technetwork/server-storage/sun-sparc-enterprise/documentation/sparc-2i-usersmanual-2516677.pdf#page=518
+ *
+ * So let's avoid doing that.
+ */
+ membar #StoreLoad
retl
nop
+END(_membar_sync)
-ATOMIC_OP_ALIAS(membar_producer,_membar_producer)
+ATOMIC_OP_ALIAS(membar_producer,_membar_consumer)
+STRONG_ALIAS(_membar_producer,_membar_consumer)
ATOMIC_OP_ALIAS(membar_consumer,_membar_consumer)
ATOMIC_OP_ALIAS(membar_enter,_membar_consumer)
STRONG_ALIAS(_membar_enter,_membar_consumer)
ATOMIC_OP_ALIAS(membar_exit,_membar_consumer)
STRONG_ALIAS(_membar_exit,_membar_consumer)
-ATOMIC_OP_ALIAS(membar_sync,_membar_consumer)
-STRONG_ALIAS(_membar_sync,_membar_consumer)
+ATOMIC_OP_ALIAS(membar_sync,_membar_sync)