From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9B0DBC83F09 for ; Wed, 9 Jul 2025 01:53:15 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 395686B00A4; Tue, 8 Jul 2025 21:53:15 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 3474A6B00A5; Tue, 8 Jul 2025 21:53:15 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 20F776B00A6; Tue, 8 Jul 2025 21:53:15 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 0A5F06B00A4 for ; Tue, 8 Jul 2025 21:53:15 -0400 (EDT) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id AD599B8333 for ; Wed, 9 Jul 2025 01:53:14 +0000 (UTC) X-FDA: 83643053508.29.4184789 Received: from mail-pj1-f52.google.com (mail-pj1-f52.google.com [209.85.216.52]) by imf11.hostedemail.com (Postfix) with ESMTP id CC80640005 for ; Wed, 9 Jul 2025 01:53:12 +0000 (UTC) Authentication-Results: imf11.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=iGOLTRq3; spf=pass (imf11.hostedemail.com: domain of alexei.starovoitov@gmail.com designates 209.85.216.52 as permitted sender) smtp.mailfrom=alexei.starovoitov@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1752025992; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=AK1/X+FNv8/ob6f3g3/3MAD4UEKgr0dVFZKZxYWhXQM=; b=DXSy32ASZbINLjuh6EEfKZgXMuM+e/dnUQYJlCoqn20x4LOt2UxBKLH8FdNHd3MUAmntQz hui5G/srmAQO9C2xTIziyM8E/rDTQTAfPbUB19k8qiiGJzISe1i3HEfGagK38LdDCrXnuB PeODWUtl0uIn0rv1vZEs+CZdKzuTHO4= ARC-Authentication-Results: i=1; imf11.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=iGOLTRq3; spf=pass (imf11.hostedemail.com: domain of alexei.starovoitov@gmail.com designates 209.85.216.52 as permitted sender) smtp.mailfrom=alexei.starovoitov@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1752025992; a=rsa-sha256; cv=none; b=CqukUcM0zKevpy0NM/KxyvEPFv6ECmh6mhBNwJy6qqoKScs6h8GKiZn4KF0zkGtNppFBRl Yw8NHZqwSkwGEB0mVoN2vipYpoFUC/gwl4TGKEXibwu3njDke9mGMoGBhA71Bx5Bs6v7Yt dG7wpQYw/7mCr6mR4WmYElt4W0i4QmM= Received: by mail-pj1-f52.google.com with SMTP id 98e67ed59e1d1-313bb9b2f5bso4546954a91.3 for ; Tue, 08 Jul 2025 18:53:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1752025992; x=1752630792; darn=kvack.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=AK1/X+FNv8/ob6f3g3/3MAD4UEKgr0dVFZKZxYWhXQM=; b=iGOLTRq3VW/vYzL98hUwmcn2WI0W88XajuL4pUxf7mjckYaNjlfNVO9YFI3W23lxwF iw0xz8i76yt1s6W+/rZzKBWoAdl3332Q+5+L8RFjeGsb28ARSPk8Od7P5rJpedsf7mYO k4EaQyO9/v5OvYnqlX/ZZjZ1rEEUTKqHZyYvxOvz725mqp4jwmxIC+QHTHSwDzs/ZG/3 1a5YFhNyORr9YPCw9hHnJweG0G4fwRh4Z4ks9ze0XeCfdQMzdhFUzVOUd8mxxGQxYFcQ EVKnLg9KY4Y2XFKzLHfj40B5HYNbRZWcXuCLd+rysYjeIV9ybH3QXh/8vb4r3rWYcRQD QU5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1752025992; x=1752630792; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=AK1/X+FNv8/ob6f3g3/3MAD4UEKgr0dVFZKZxYWhXQM=; b=bphM1XgvwOe868Q+6B+5vGS/aKbNc15N5n5/IXF1dJuGjCKkx2onRBikhl5U4D3ENI F3CscleP1nxJEfdH2wMUcpUzm7YEOvS3MizI4prIVRrY9xI6bgzxCLXCwPZlahOKTMB4 xFvkw9oCLQiw33iM2HOqCTqAVEDMPVaP0PzABcRLDqQnXS5E4fntqil30vSVywaGLJ5B XjzZlB151IP/LfX7UjawWkVfmiQ0L66S15Sf+hlHyjcx6NPlRyjM9ujV3PGWiiYU4WiD yKrgcuYQ2lXEUDdJPCZ/mRyedBj+IanPhvt7gqgvSlXrn6aWsf9l9f5i1moZ/M7Gx3Or 7Opg== X-Forwarded-Encrypted: i=1; AJvYcCUE0ZzJkQM0fr/aWuILcUcpDe7P0DwyLb+acT4i9BqUtRgnkyjtNCLf7JN+3Yd0gzsoXilO2OtXGQ==@kvack.org X-Gm-Message-State: AOJu0Yx19cBlW+QuQybhM32lLO4k4m/whamVu+61twbKDWdFhlJdh+kJ HdL9GrmkLDGqg9SDE04VHYsl0ZUrQl4vJw6ncf32ELCKw2y5b0lQIcbX X-Gm-Gg: ASbGncskDNcT4GG1iWIKq4bArpdtcdMnqanKrbRgB+lmnyXG3JfYsCzPlV4I6hzfQJ2 9YSasgbBDF5j1yBU8mNBZ2QOmBuw3jTEU0k6w5tNGsUNneJV+O588SFbqkyfchjf7IZDqq7Jhcr OmjmpaBHjvGvQdeG4OQuQYadrDPkDSjnZVCSFvd/83TJGiAciGCOkQoGQ6OvwVevY25hufTNsbK XtzNkZUPrZwqLlgQh9Wja7Si2j+OPyjMMreOcA0NLdjJElx6Ef2htgAfsLCYbrsf4glGJLMSeSI tuHZNETM2rMOs3t++oRVrkC8u1I9mVi9ptTbnIe3lcMvQ2oZo8e93+OxlfrKtB9+ekn0JzbbDOw pTK6Xg7CSAUZw453xbYZwKZXbClw= X-Google-Smtp-Source: AGHT+IFZHPmbHD2yROO8MdoTSXUTlKToJZfX1sUdAMJ3Qa1KzIJt/XCBBp2IOiGGLKSJJa47PZtR9w== X-Received: by 2002:a17:90b:2f8f:b0:315:7ddc:4c2a with SMTP id 98e67ed59e1d1-31c2fcffcc9mr1320196a91.12.1752025991536; Tue, 08 Jul 2025 18:53:11 -0700 (PDT) Received: from localhost.localdomain ([2001:558:600a:7:a83d:600f:32cc:235a]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-23c8431a373sm122628495ad.7.2025.07.08.18.53.10 (version=TLS1_3 cipher=TLS_CHACHA20_POLY1305_SHA256 bits=256/256); Tue, 08 Jul 2025 18:53:11 -0700 (PDT) From: Alexei Starovoitov To: bpf@vger.kernel.org, linux-mm@kvack.org Cc: vbabka@suse.cz, harry.yoo@oracle.com, shakeel.butt@linux.dev, mhocko@suse.com, bigeasy@linutronix.de, andrii@kernel.org, memxor@gmail.com, akpm@linux-foundation.org, peterz@infradead.org, rostedt@goodmis.org, hannes@cmpxchg.org Subject: [PATCH v2 2/6] locking/local_lock: Introduce local_lock_is_locked(). Date: Tue, 8 Jul 2025 18:52:59 -0700 Message-Id: <20250709015303.8107-3-alexei.starovoitov@gmail.com> X-Mailer: git-send-email 2.39.5 (Apple Git-154) In-Reply-To: <20250709015303.8107-1-alexei.starovoitov@gmail.com> References: <20250709015303.8107-1-alexei.starovoitov@gmail.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: CC80640005 X-Stat-Signature: ca3fif7yykpu4kqd84wqwcjhgcuexo7d X-Rspam-User: X-Rspamd-Server: rspam07 X-HE-Tag: 1752025992-730563 X-HE-Meta: U2FsdGVkX19AONptVQ1hdBWcC4/F7XIKB8WIVS1HR6cUcEkmwpsP7A/YgI54J18okw5TV88fLI4StDBrLlhVC0R74HyYrYoDu8AzmE012cz8qy2kSkbazNSh0N2CpLRrh9z7dArR3UmyUTEjL0gzuLyQzCjrt6OPxvaovt2H8UtKBBLViETNAaTaKOrd5bAPp9wohzQodMfUwzY7DXolSW+8OZUu9750h3BfyPsxkaE96Uzfw8Xat0aAJEFCzjFEAK+8qgOXf9IepNeGLIxhJpd90Odbrzw2NqwCdD1oROObDABp9+nUUi531NSdCcONX8k8mk0KDRmQVhL+KcWV6phBM+o+by2zq3pon66dqGE9N4EYgZ9q4xDHN7naxo5sXtONRhc3FC4R941XxdwmYvEaixFDPUaSMq2YD36an9HIXEVHEwmtiFmUMYPcYIJdyr0Ce/nBtC2ABCrn7euHtYH2W38tf4qfZMVFB+zuKEzXC5rdXsCubDnoftVPh9g3X856u8I/Ulgoi8BfqLyvvYhM5GqlSvC/neOaWVdLk1Et+GORoQSZERUmkdhKFXJJaRWArMJ2oU7NxITYw7FgjQ2KnHodg0/Q6DYjQnp4H5vIUCK/yUKEs+geIvshfrOnM6vxNyGY1VgyiPXFEOMXSIbzXdJqAol6N/4+3N2ql41uoHeL3S6B1k+V7wjiX8ruFJZ8nE331Cq4lwQyoc+41/IHibDrj6gfUQIVdoj67Yawbv3xVQ/yRCWZ27+4MbgDZNPQA2gb1+QatSntqyKHFZk7ulUEc0nlz+t45KW6TClhsS8BwgF33+B2TlD0RJzSuBGyRfM9F+2zD5jbOh/V0IHG2M9YU7WiO7iwZ32+egdx/LnOD372XZ+TakmSsk25dex2fnDeWUmyUBUuXr8KGRpBs4ik3noRMCLeF/rDFlxPHL870tABp90ta0gLnxVGpurUsTK8GuPYwe+oV0s nO6ipkWu sK5Zz13EzJvoMx9xATPKyMosBhl8JrJDbF515AIU7ReK2s1Bv7BeS+cCF3Ap8HNXt7mcFKev7v3ayTpoCS5shbKkBBZ9pRX1ybyl/23CqpOAyhuwCrx7kDOqlEaGLX2d1Sj23G3BPUwsGU2wRO1v+yILftlmne7BZ8pQznRYQFxmuffMLCpuYHZYhiZZCI3/11lchf8UTpG/8UDPRskv8+Ar8wQsuDvAIBqBE/MpEIlqDuUaa2gbsHpx7aG9CT76Svmrf4SG/pUdzpYW5rjAX6GCja/wa5P7qKo++VFO0ClxkdF5bfDcgiWQU3p0laoqn9G2eu8oB/OLuXJ9/GBwFskt1I1kOcHKRFmxQBH2w2cLqS7YWspfLiU8+bvY+w74bC14eR9tGWo4dxe8qmpCfypiKz5pu1CNk4DPfXqA1k3P+bMk7KBmUl83Re9Ru1p/XgMYPIMzmXf/9YsFDJ3CTvnbHKDyjb9KWTauk6dWautIpgHhd+WjMxNzEBR8urSfc62DQOgFIJMdsTIYAUAkhbPhxeopFjkv+aefRFJNLqbeU9vNe8MyQ/vrX8z4xjPbfaT3N X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Alexei Starovoitov Introduce local_lock_is_locked() that returns true when given local_lock is locked by current cpu (in !PREEMPT_RT) or by current task (in PREEMPT_RT). Signed-off-by: Alexei Starovoitov --- include/linux/local_lock.h | 2 ++ include/linux/local_lock_internal.h | 7 +++++++ include/linux/rtmutex.h | 9 +++++++++ kernel/locking/rtmutex_common.h | 9 --------- 4 files changed, 18 insertions(+), 9 deletions(-) diff --git a/include/linux/local_lock.h b/include/linux/local_lock.h index 16a2ee4f8310..092ce89b162a 100644 --- a/include/linux/local_lock.h +++ b/include/linux/local_lock.h @@ -66,6 +66,8 @@ */ #define local_trylock(lock) __local_trylock(lock) +#define local_lock_is_locked(lock) __local_lock_is_locked(lock) + /** * local_trylock_irqsave - Try to acquire a per CPU local lock, save and disable * interrupts if acquired diff --git a/include/linux/local_lock_internal.h b/include/linux/local_lock_internal.h index 85c2e1b1af6b..db61409f040c 100644 --- a/include/linux/local_lock_internal.h +++ b/include/linux/local_lock_internal.h @@ -165,6 +165,9 @@ do { \ !!tl; \ }) +/* preemption or migration must be disabled before calling __local_lock_is_locked */ +#define __local_lock_is_locked(lock) READ_ONCE(this_cpu_ptr(lock)->acquired) + #define __local_lock_release(lock) \ do { \ local_trylock_t *tl; \ @@ -285,4 +288,8 @@ do { \ __local_trylock(lock); \ }) +/* migration must be disabled before calling __local_lock_is_locked */ +#define __local_lock_is_locked(__lock) \ + (rt_mutex_owner(&this_cpu_ptr(__lock)->lock) == current) + #endif /* CONFIG_PREEMPT_RT */ diff --git a/include/linux/rtmutex.h b/include/linux/rtmutex.h index 7d049883a08a..a8f2fe154487 100644 --- a/include/linux/rtmutex.h +++ b/include/linux/rtmutex.h @@ -44,6 +44,15 @@ static inline bool rt_mutex_base_is_locked(struct rt_mutex_base *lock) return READ_ONCE(lock->owner) != NULL; } +#define RT_MUTEX_HAS_WAITERS 1UL + +static inline struct task_struct *rt_mutex_owner(struct rt_mutex_base *lock) +{ + unsigned long owner = (unsigned long) READ_ONCE(lock->owner); + + return (struct task_struct *) (owner & ~RT_MUTEX_HAS_WAITERS); +} + extern void rt_mutex_base_init(struct rt_mutex_base *rtb); /** diff --git a/kernel/locking/rtmutex_common.h b/kernel/locking/rtmutex_common.h index 78dd3d8c6554..cf6ddd1b23a2 100644 --- a/kernel/locking/rtmutex_common.h +++ b/kernel/locking/rtmutex_common.h @@ -153,15 +153,6 @@ static inline struct rt_mutex_waiter *task_top_pi_waiter(struct task_struct *p) pi_tree.entry); } -#define RT_MUTEX_HAS_WAITERS 1UL - -static inline struct task_struct *rt_mutex_owner(struct rt_mutex_base *lock) -{ - unsigned long owner = (unsigned long) READ_ONCE(lock->owner); - - return (struct task_struct *) (owner & ~RT_MUTEX_HAS_WAITERS); -} - /* * Constants for rt mutex functions which have a selectable deadlock * detection. -- 2.47.1