From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pg1-f169.google.com (mail-pg1-f169.google.com [209.85.215.169]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 93C9D2EB5DC for ; Fri, 12 Sep 2025 10:12:51 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.215.169 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1757671974; cv=none; b=O/j7cdvohEzuS4KO3RV6w22PVazEQhK9e1rvuG73dEDAl4g4CZsYr3dm36tHm6orI9dhYEO4MxBgD420T4wQPDiot72MK8n+Lz8ZmjZfp4kpRsphqzovUcAzzuTO2oh6RVGGCKGA9FiLuhgBANpzUjn/LwtGy3Z3gSYLN5QG+4E= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1757671974; c=relaxed/simple; bh=a5HXFEXCxWNRHDDVyZZfIidS3SNN062TjXO3sF8vxcw=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=I7BCmBpWxV4sALlJgRAfp8va0D6E+6m+MhStdyn0GfZZ0b8tG7p+r7UryQgAmY4VQ0j62cx7g1F7eKGpSHflAFN8vmdoNeIU6OPavBCAkYcTW9tpvTezll/dN78H5vY0Mqll9Gf5mjo7bcn4lVFP84stayR1yJZ1xh4SoyRUGdM= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=X4SxenS3; arc=none smtp.client-ip=209.85.215.169 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="X4SxenS3" Received: by mail-pg1-f169.google.com with SMTP id 41be03b00d2f7-b54b55c6eabso21906a12.2 for ; Fri, 12 Sep 2025 03:12:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1757671971; x=1758276771; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=bEzQtMPq9PK+5+yYtP/oNug9OWMsSiZGEa798p9Mz9w=; b=X4SxenS3BxcAA9QiBmVt+MB6I+ZcELSePKO4cOmBRvVjrbpwt9Uj288zM4KHAmiu5C +5X/D3B1XHmLtRG5npsNGNIePp0Va+eE1jYuI6wwf66FeB44vMr8d0VzaKXgK/hJx2YC HWU1uOpyx0uN8VlsT99qnsM7eKsR5dFmlOcuzWmxhgTrPRw0HLqSvcNxjpwK00kz/ETk Zb7E+5h3IQLeY4XtJ7NXB/yZxZ7iSZzefLLcwcH2bn7hSHYWspt4wbRH71zf/zKIdwtd OxrOgXe0ovMgI2hz9sloJYajJ9dzBPoYj7+oepOOwo7W1lv+Rn3TSaQBWGkZqibQEN23 NKng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1757671971; x=1758276771; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=bEzQtMPq9PK+5+yYtP/oNug9OWMsSiZGEa798p9Mz9w=; b=ej7Es1Nq8Fu+FubTn7HLCoP0bbY0MtrxGOoDzXxq4bw6BE9xGG5f3CbHkM1/T8CyDn bd3u5ZV9NcBL4IpNH0a4aaXa6TqCmiOAcd2tiEmy6CihvpRXFrSYBZNginr4sSsxE5eo H3Wqrbq34x+L0jZRCfis20YOkWoVyTDFQkkeeJkL6eeu6Lt4OirCLun/TAB0b1N9oEbO 7LRhn6ydd6Ei6EXN1e9QLtTJE0BdV/lOdIFAZ9mGBg9Hy299qmuzwC++IWTt+Z9dAYnS b0N0t1XhM0fPny9LE0gniRf3LSYu1QNO/oPzH5VrOPVt0rsgMB4jpFfgEnMhnuLoEwJ3 j9eg== X-Forwarded-Encrypted: i=1; AJvYcCUWCV8BYoKRoB3/bhE29qC//Jg7vMsEg1TK1+GrPwXuq70FZ5l6JnQHj1ZiEKDPuVegtWODgWsQwvE=@vger.kernel.org X-Gm-Message-State: AOJu0YyqqXx/Fsc3AWxvaI69D9dcynAaNT2sBaqCOHx9C/MrI/F11Ust xCI0F4QB7SPIB8/H77T1GLYNHirpOoAsjLHlmfZiXCyDmue3+AOl2JLB X-Gm-Gg: ASbGncuI7hNUbF4AJxnEc2T/TXt+ZvPCQ3t9Qbwxs+29hV5xsbSShR641d5AkuRAkgn PF8/64cvaTmWf8YdxNJTU2uT5QGgfQsZL3PmjHuhcU1o0R/maJcJQ/X2Qra6tCcOWlJCmFvxf5Y bzFJWFoRXrFJWz23XJtUUZLlFBVnrjV2qPWH1ou/TpgwjvTIIx7Ubq6gfmJ6Mfs+zCupT9u48hL 6Y5c6wVgmjijWfdQElxLwCBSRHLx5QVQspbaH8Ns3o35CxGOypkgRebdWorarfJP7EEoPsv0B8i 4HbYnVF1fIFQCNTQHcUYI6aK2zfXq4IpPxjKgDlXqADFdpqsOiQ5t8SdTV3wBcoE2GtNPsjaHLd rUvDdIpfJqLHvckvcfihpqfddmFe5YyCqU8dAQ+2sT0kpDYqtshM2DGplnPGW X-Google-Smtp-Source: AGHT+IFjzeds5aG6Wb+p60MOU157xCW/uyAMBkC8kYhjKV3VQWNhWnO7RA/JWobHVFlYljAoloxrVg== X-Received: by 2002:a17:902:d490:b0:25c:18d:893 with SMTP id d9443c01a7336-25d24bb33f9mr25149495ad.22.1757671970918; Fri, 12 Sep 2025 03:12:50 -0700 (PDT) Received: from localhost ([185.49.34.62]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-25c37293f0asm45159835ad.43.2025.09.12.03.12.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 12 Sep 2025 03:12:50 -0700 (PDT) From: Jinchao Wang To: Andrew Morton , Masami Hiramatsu , Peter Zijlstra , Mike Rapoport , Alexander Potapenko , Jonathan Corbet , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , x86@kernel.org, "H. Peter Anvin" , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Valentin Schneider , Arnaldo Carvalho de Melo , Namhyung Kim , Mark Rutland , Alexander Shishkin , Jiri Olsa , Ian Rogers , Adrian Hunter , "Liang, Kan" , David Hildenbrand , Lorenzo Stoakes , "Liam R. Howlett" , Vlastimil Babka , Suren Baghdasaryan , Michal Hocko , Nathan Chancellor , Nick Desaulniers , Bill Wendling , Justin Stitt , Kees Cook , Alice Ryhl , Sami Tolvanen , Miguel Ojeda , Masahiro Yamada , Rong Xu , Naveen N Rao , David Kaplan , Andrii Nakryiko , Jinjie Ruan , Nam Cao , workflows@vger.kernel.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org, linux-mm@kvack.org, llvm@lists.linux.dev, Andrey Ryabinin , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , kasan-dev@googlegroups.com, "David S. Miller" , Mathieu Desnoyers , linux-trace-kernel@vger.kernel.org Cc: Jinchao Wang Subject: [PATCH v4 11/21] mm/ksw: add probe management helpers Date: Fri, 12 Sep 2025 18:11:21 +0800 Message-ID: <20250912101145.465708-12-wangjinchao600@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250912101145.465708-1-wangjinchao600@gmail.com> References: <20250912101145.465708-1-wangjinchao600@gmail.com> Precedence: bulk X-Mailing-List: workflows@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Provide ksw_stack_init() and ksw_stack_exit() to manage entry and exit probes for the target function from ksw_get_config(). The entry/exit probe handlers use atomic ksw_stack_pid to ensure a singleton watch and current->kstackwatch_ctx.depth to track recursion depth. A watch is set up only when depth reaches the configured value. Signed-off-by: Jinchao Wang --- mm/kstackwatch/kstackwatch.h | 4 ++ mm/kstackwatch/stack.c | 113 +++++++++++++++++++++++++++++++++++ 2 files changed, 117 insertions(+) diff --git a/mm/kstackwatch/kstackwatch.h b/mm/kstackwatch/kstackwatch.h index 0786fa961011..5ea2db76cdfb 100644 --- a/mm/kstackwatch/kstackwatch.h +++ b/mm/kstackwatch/kstackwatch.h @@ -38,6 +38,10 @@ struct ksw_config { // singleton, only modified in kernel.c const struct ksw_config *ksw_get_config(void); +/* stack management */ +int ksw_stack_init(void); +void ksw_stack_exit(void); + /* watch management */ int ksw_watch_init(void); void ksw_watch_exit(void); diff --git a/mm/kstackwatch/stack.c b/mm/kstackwatch/stack.c index cec594032515..ac52a9f81486 100644 --- a/mm/kstackwatch/stack.c +++ b/mm/kstackwatch/stack.c @@ -1 +1,114 @@ // SPDX-License-Identifier: GPL-2.0 +#define pr_fmt(fmt) KBUILD_MODNAME ": " fmt + +#include +#include +#include +#include +#include + +#include "kstackwatch.h" + +static struct kprobe entry_probe; +static struct fprobe exit_probe; +#define INVALID_PID -1 +static atomic_t ksw_stack_pid = ATOMIC_INIT(INVALID_PID); + +static int ksw_stack_prepare_watch(struct pt_regs *regs, + const struct ksw_config *config, + ulong *watch_addr, u16 *watch_len) +{ + /* implement logic will be added in following patches */ + *watch_addr = 0; + *watch_len = 0; + return 0; +} + +static void ksw_stack_entry_handler(struct kprobe *p, struct pt_regs *regs, + unsigned long flags) +{ + struct kstackwatch_ctx *ctx = ¤t->kstackwatch_ctx; + ulong watch_addr; + u16 watch_len; + int ret; + + if (ctx->depth++ != ksw_get_config()->depth) + return; + + if (atomic_cmpxchg(&ksw_stack_pid, INVALID_PID, current->pid) != + INVALID_PID) + return; + + ret = ksw_stack_prepare_watch(regs, ksw_get_config(), &watch_addr, + &watch_len); + if (ret) { + atomic_set(&ksw_stack_pid, INVALID_PID); + pr_err("failed to prepare watch target: %d\n", ret); + return; + } + + ret = ksw_watch_on(watch_addr, watch_len); + if (ret) { + atomic_set(&ksw_stack_pid, INVALID_PID); + pr_err("failed to watch on depth:%d addr:0x%lx len:%u %d\n", + ksw_get_config()->depth, watch_addr, watch_len, ret); + return; + } + + ctx->watch_addr = watch_addr; + ctx->watch_len = watch_len; + ctx->watch_on = true; +} + +static void ksw_stack_exit_handler(struct fprobe *fp, unsigned long ip, + unsigned long ret_ip, + struct ftrace_regs *regs, void *data) +{ + struct kstackwatch_ctx *ctx = ¤t->kstackwatch_ctx; + + if (--ctx->depth != ksw_get_config()->depth) + return; + + if (atomic_read(&ksw_stack_pid) != current->pid) + return; + WARN_ON_ONCE(!ctx->watch_on); + WARN_ON_ONCE(ksw_watch_off(ctx->watch_addr, ctx->watch_len)); + ctx->watch_on = false; + + atomic_set(&ksw_stack_pid, INVALID_PID); +} + +int ksw_stack_init(void) +{ + int ret; + char *symbuf = NULL; + + memset(&entry_probe, 0, sizeof(entry_probe)); + entry_probe.symbol_name = ksw_get_config()->function; + entry_probe.offset = ksw_get_config()->ip_offset; + entry_probe.post_handler = ksw_stack_entry_handler; + ret = register_kprobe(&entry_probe); + if (ret) { + pr_err("Failed to register kprobe ret %d\n", ret); + return ret; + } + + memset(&exit_probe, 0, sizeof(exit_probe)); + exit_probe.exit_handler = ksw_stack_exit_handler; + symbuf = (char *)ksw_get_config()->function; + + ret = register_fprobe_syms(&exit_probe, (const char **)&symbuf, 1); + if (ret < 0) { + pr_err("register_fprobe_syms fail %d\n", ret); + unregister_kprobe(&entry_probe); + return ret; + } + + return 0; +} + +void ksw_stack_exit(void) +{ + unregister_fprobe(&exit_probe); + unregister_kprobe(&entry_probe); +} -- 2.43.0