AuxXxilium/linux_dsm_epyc7002
1
0
Fork 0
mirror of https://github.com/AuxXxilium/linux_dsm_epyc7002.git synced 2024-11-24 03:30:52 +07:00
Code Issues Actions Packages Projects Releases Wiki Activity

lockref: Limit number of cmpxchg loop retries

Browse Source 
The lockref cmpxchg loop is unbound as long as the spinlock is not
taken. Depending on the hardware implementation of compare-and-swap
a high number of loop retries might happen.

Add an upper bound to the loop to force the fallback to spinlocks
after some time. A retry value of 100 should not impact any hardware
that does not have this issue.

With the retry limit the performance of an open-close testcase
improved between 60-70% on ThunderX2.

Suggested-by: Linus Torvalds <torvalds@linux-foundation.org>
Signed-off-by: Jan Glauber <jglauber@marvell.com>
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>
This commit is contained in:
Jan Glauber 2019-06-05 15:48:49 +02:00 committed by Linus Torvalds
parent d93445225c
commit 893a7d32e8
1 changed files with 3 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
lib/lockref.c
View File

@ -9,6 +9,7 @@
* failure case. * failure case.
*/ */
#define CMPXCHG_LOOP(CODE, SUCCESS) do { \ #define CMPXCHG_LOOP(CODE, SUCCESS) do { \
int retry = 100; \
struct lockref old; \ struct lockref old; \
BUILD_BUG_ON(sizeof(old) != 8); \ BUILD_BUG_ON(sizeof(old) != 8); \
old.lock_count = READ_ONCE(lockref->lock_count); \ old.lock_count = READ_ONCE(lockref->lock_count); \
@ -21,6 +22,8 @@
if (likely(old.lock_count == prev.lock_count)) { \ if (likely(old.lock_count == prev.lock_count)) { \
SUCCESS; \ SUCCESS; \
} \ } \
if (!--retry) \
break; \
cpu_relax(); \ cpu_relax(); \
} \ } \
} while (0) } while (0)