From: Maciej Wieczor-Retman <maciej.wieczor-retman@intel.com>
To: Andrey Konovalov <andreyknvl@gmail.com>
Cc: <sohil.mehta@intel.com>, <baohua@kernel.org>, <david@redhat.com>,
<kbingham@kernel.org>, <weixugc@google.com>,
<Liam.Howlett@oracle.com>, <alexandre.chartre@oracle.com>,
<kas@kernel.org>, <mark.rutland@arm.com>,
<trintaeoitogc@gmail.com>, <axelrasmussen@google.com>,
<yuanchu@google.com>, <joey.gouly@arm.com>,
<samitolvanen@google.com>, <joel.granados@kernel.org>,
<graf@amazon.com>, <vincenzo.frascino@arm.com>, <kees@kernel.org>,
<ardb@kernel.org>, <thiago.bauermann@linaro.org>,
<glider@google.com>, <thuth@redhat.com>,
<kuan-ying.lee@canonical.com>, <pasha.tatashin@soleen.com>,
<nick.desaulniers+lkml@gmail.com>, <vbabka@suse.cz>,
<kaleshsingh@google.com>, <justinstitt@google.com>,
<catalin.marinas@arm.com>, <alexander.shishkin@linux.intel.com>,
<samuel.holland@sifive.com>, <dave.hansen@linux.intel.com>,
<corbet@lwn.net>, <xin@zytor.com>, <dvyukov@google.com>,
<tglx@linutronix.de>, <scott@os.amperecomputing.com>,
<jason.andryuk@amd.com>, <morbo@google.com>, <nathan@kernel.org>,
<lorenzo.stoakes@oracle.com>, <mingo@redhat.com>,
<brgerst@gmail.com>, <kristina.martsenko@arm.com>,
<bigeasy@linutronix.de>, <luto@kernel.org>, <jgross@suse.com>,
<jpoimboe@kernel.org>, <urezki@gmail.com>, <mhocko@suse.com>,
<ada.coupriediaz@arm.com>, <hpa@zytor.com>, <leitao@debian.org>,
<peterz@infradead.org>, <wangkefeng.wang@huawei.com>,
<surenb@google.com>, <ziy@nvidia.com>, <smostafa@google.com>,
<ryabinin.a.a@gmail.com>, <ubizjak@gmail.com>, <jbohac@suse.cz>,
<broonie@kernel.org>, <akpm@linux-foundation.org>,
<guoweikang.kernel@gmail.com>, <rppt@kernel.org>,
<pcc@google.com>, <jan.kiszka@siemens.com>,
<nicolas.schier@linux.dev>, <will@kernel.org>,
<jhubbard@nvidia.com>, <bp@alien8.de>, <x86@kernel.org>,
<linux-doc@vger.kernel.org>, <linux-mm@kvack.org>,
<llvm@lists.linux.dev>, <linux-kbuild@vger.kernel.org>,
<kasan-dev@googlegroups.com>, <linux-kernel@vger.kernel.org>,
<linux-arm-kernel@lists.infradead.org>
Subject: Re: [PATCH v5 13/19] kasan: x86: Handle int3 for inline KASAN reports
Date: Mon, 8 Sep 2025 12:38:57 +0200 [thread overview]
Message-ID: <couuy2aawztipvnlmaloadkbceewcekur5qbtzktr7ovneduvf@l47rxycy65aa> (raw)
In-Reply-To: <CA+fCnZcMV0BOJyvx2nciCK2jvht-Hx0HnFtRzcc=zu+pQSOdVw@mail.gmail.com>
On 2025-09-06 at 19:19:01 +0200, Andrey Konovalov wrote:
>On Mon, Aug 25, 2025 at 10:30 PM Maciej Wieczor-Retman
><maciej.wieczor-retman@intel.com> wrote:
>>
>> Inline KASAN on x86 does tag mismatch reports by passing the faulty
>> address and metadata through the INT3 instruction - scheme that's setup
>> in the LLVM's compiler code (specifically HWAddressSanitizer.cpp).
>>
>> Add a kasan hook to the INT3 handling function.
>>
>> Disable KASAN in an INT3 core kernel selftest function since it can raise
>> a false tag mismatch report and potentially panic the kernel.
>>
>> Make part of that hook - which decides whether to die or recover from a
>> tag mismatch - arch independent to avoid duplicating a long comment on
>> both x86 and arm64 architectures.
>>
>> Signed-off-by: Maciej Wieczor-Retman <maciej.wieczor-retman@intel.com>
>> ---
>> Changelog v5:
>> - Add die to argument list of kasan_inline_recover() in
>> arch/arm64/kernel/traps.c.
>>
>> Changelog v4:
>> - Make kasan_handler() a stub in a header file. Remove #ifdef from
>> traps.c.
>> - Consolidate the "recover" comment into one place.
>> - Make small changes to the patch message.
>>
>> MAINTAINERS | 2 +-
>> arch/x86/include/asm/kasan.h | 26 ++++++++++++++++++++++++++
>> arch/x86/kernel/alternative.c | 4 +++-
>> arch/x86/kernel/traps.c | 4 ++++
>> arch/x86/mm/Makefile | 2 ++
>> arch/x86/mm/kasan_inline.c | 23 +++++++++++++++++++++++
>> include/linux/kasan.h | 24 ++++++++++++++++++++++++
>> 7 files changed, 83 insertions(+), 2 deletions(-)
>> create mode 100644 arch/x86/mm/kasan_inline.c
>>
>> diff --git a/MAINTAINERS b/MAINTAINERS
>> index 788532771832..f5b1ce242002 100644
>> --- a/MAINTAINERS
>> +++ b/MAINTAINERS
>> @@ -13177,7 +13177,7 @@ S: Maintained
>> B: https://bugzilla.kernel.org/buglist.cgi?component=Sanitizers&product=Memory%20Management
>> F: Documentation/dev-tools/kasan.rst
>> F: arch/*/include/asm/*kasan*.h
>> -F: arch/*/mm/kasan_init*
>> +F: arch/*/mm/kasan_*
>> F: include/linux/kasan*.h
>> F: lib/Kconfig.kasan
>> F: mm/kasan/
>> diff --git a/arch/x86/include/asm/kasan.h b/arch/x86/include/asm/kasan.h
>> index 1963eb2fcff3..5bf38bb836e1 100644
>> --- a/arch/x86/include/asm/kasan.h
>> +++ b/arch/x86/include/asm/kasan.h
>> @@ -6,7 +6,28 @@
>> #include <linux/kasan-tags.h>
>> #include <linux/types.h>
>> #define KASAN_SHADOW_OFFSET _AC(CONFIG_KASAN_SHADOW_OFFSET, UL)
>> +#ifdef CONFIG_KASAN_SW_TAGS
>> +
>> +/*
>> + * LLVM ABI for reporting tag mismatches in inline KASAN mode.
>> + * On x86 the INT3 instruction is used to carry metadata in RAX
>> + * to the KASAN report.
>> + *
>> + * SIZE refers to how many bytes the faulty memory access
>> + * requested.
>> + * WRITE bit, when set, indicates the access was a write, otherwise
>> + * it was a read.
>> + * RECOVER bit, when set, should allow the kernel to carry on after
>> + * a tag mismatch. Otherwise die() is called.
>> + */
>> +#define KASAN_RAX_RECOVER 0x20
>> +#define KASAN_RAX_WRITE 0x10
>> +#define KASAN_RAX_SIZE_MASK 0x0f
>> +#define KASAN_RAX_SIZE(rax) (1 << ((rax) & KASAN_RAX_SIZE_MASK))
>> +
>> +#else
>> #define KASAN_SHADOW_SCALE_SHIFT 3
>
>Putting this under else in this patch looks odd, we can move this part
>to "x86: Make software tag-based kasan available".
Sure, will do!
>
>> +#endif
>>
>> /*
>> * Compiler uses shadow offset assuming that addresses start
>> @@ -35,10 +56,15 @@
>> #define __tag_shifted(tag) FIELD_PREP(GENMASK_ULL(60, 57), tag)
>> #define __tag_reset(addr) (sign_extend64((u64)(addr), 56))
>> #define __tag_get(addr) ((u8)FIELD_GET(GENMASK_ULL(60, 57), (u64)addr))
>> +bool kasan_inline_handler(struct pt_regs *regs);
>> #else
>> #define __tag_shifted(tag) 0UL
>> #define __tag_reset(addr) (addr)
>> #define __tag_get(addr) 0
>> +static inline bool kasan_inline_handler(struct pt_regs *regs)
>> +{
>> + return false;
>> +}
>> #endif /* CONFIG_KASAN_SW_TAGS */
>>
>> static inline void *__tag_set(const void *__addr, u8 tag)
>> diff --git a/arch/x86/kernel/alternative.c b/arch/x86/kernel/alternative.c
>> index 2a330566e62b..4cb085daad31 100644
>> --- a/arch/x86/kernel/alternative.c
>> +++ b/arch/x86/kernel/alternative.c
>> @@ -2228,7 +2228,7 @@ int3_exception_notify(struct notifier_block *self, unsigned long val, void *data
>> }
>>
>> /* Must be noinline to ensure uniqueness of int3_selftest_ip. */
>> -static noinline void __init int3_selftest(void)
>> +static noinline __no_sanitize_address void __init int3_selftest(void)
>> {
>> static __initdata struct notifier_block int3_exception_nb = {
>> .notifier_call = int3_exception_notify,
>> @@ -2236,6 +2236,7 @@ static noinline void __init int3_selftest(void)
>> };
>> unsigned int val = 0;
>>
>> + kasan_disable_current();
>> BUG_ON(register_die_notifier(&int3_exception_nb));
>>
>> /*
>> @@ -2253,6 +2254,7 @@ static noinline void __init int3_selftest(void)
>>
>> BUG_ON(val != 1);
>>
>> + kasan_enable_current();
>> unregister_die_notifier(&int3_exception_nb);
>> }
>>
>> diff --git a/arch/x86/kernel/traps.c b/arch/x86/kernel/traps.c
>> index 0f6f187b1a9e..2a119279980f 100644
>> --- a/arch/x86/kernel/traps.c
>> +++ b/arch/x86/kernel/traps.c
>> @@ -912,6 +912,10 @@ static bool do_int3(struct pt_regs *regs)
>> if (kprobe_int3_handler(regs))
>> return true;
>> #endif
>> +
>> + if (kasan_inline_handler(regs))
>> + return true;
>> +
>> res = notify_die(DIE_INT3, "int3", regs, 0, X86_TRAP_BP, SIGTRAP);
>>
>> return res == NOTIFY_STOP;
>> diff --git a/arch/x86/mm/Makefile b/arch/x86/mm/Makefile
>> index 5b9908f13dcf..1dc18090cbe7 100644
>> --- a/arch/x86/mm/Makefile
>> +++ b/arch/x86/mm/Makefile
>> @@ -36,7 +36,9 @@ obj-$(CONFIG_PTDUMP) += dump_pagetables.o
>> obj-$(CONFIG_PTDUMP_DEBUGFS) += debug_pagetables.o
>>
>> KASAN_SANITIZE_kasan_init_$(BITS).o := n
>> +KASAN_SANITIZE_kasan_inline.o := n
>> obj-$(CONFIG_KASAN) += kasan_init_$(BITS).o
>> +obj-$(CONFIG_KASAN_SW_TAGS) += kasan_inline.o
>>
>> KMSAN_SANITIZE_kmsan_shadow.o := n
>> obj-$(CONFIG_KMSAN) += kmsan_shadow.o
>> diff --git a/arch/x86/mm/kasan_inline.c b/arch/x86/mm/kasan_inline.c
>> new file mode 100644
>> index 000000000000..9f85dfd1c38b
>> --- /dev/null
>> +++ b/arch/x86/mm/kasan_inline.c
>> @@ -0,0 +1,23 @@
>> +// SPDX-License-Identifier: GPL-2.0
>> +#include <linux/kasan.h>
>> +#include <linux/kdebug.h>
>> +
>> +bool kasan_inline_handler(struct pt_regs *regs)
>> +{
>> + int metadata = regs->ax;
>> + u64 addr = regs->di;
>> + u64 pc = regs->ip;
>> + bool recover = metadata & KASAN_RAX_RECOVER;
>> + bool write = metadata & KASAN_RAX_WRITE;
>> + size_t size = KASAN_RAX_SIZE(metadata);
>> +
>> + if (user_mode(regs))
>> + return false;
>> +
>> + if (!kasan_report((void *)addr, size, write, pc))
>> + return false;
>
>Hm, this part is different than on arm64: there, we don't check the
>return value.
>
>Do I understand correctly that the return value from this function
>controls whether we skip over the int3 instruction and continue the
>execution? If so, we should return the same value regardless of
>whether the report is suppressed or not. And then you should not need
>to explicitly check for KASAN_BIT_MULTI_SHOT in the latter patch.
I recall there were some corner cases where this code path got called in outline
mode, didn't have a mismatch but still died due to the die() below. But I'll
recheck and either apply what you wrote above or get add a better explanation
to the patch message.
>
>> +
>> + kasan_inline_recover(recover, "Oops - KASAN", regs, metadata, die);
>
>Maybe name this is as kasan_die_unless_recover()?
Sure, sounds good
>
>
>> +
>> + return true;
>> +}
>> diff --git a/include/linux/kasan.h b/include/linux/kasan.h
>> index 54481f8c30c5..8691ad870f3b 100644
>> --- a/include/linux/kasan.h
>> +++ b/include/linux/kasan.h
>> @@ -663,4 +663,28 @@ void kasan_non_canonical_hook(unsigned long addr);
>> static inline void kasan_non_canonical_hook(unsigned long addr) { }
>> #endif /* CONFIG_KASAN_GENERIC || CONFIG_KASAN_SW_TAGS */
>>
>> +#ifdef CONFIG_KASAN_SW_TAGS
>> +/*
>> + * The instrumentation allows to control whether we can proceed after
>> + * a crash was detected. This is done by passing the -recover flag to
>> + * the compiler. Disabling recovery allows to generate more compact
>> + * code.
>> + *
>> + * Unfortunately disabling recovery doesn't work for the kernel right
>> + * now. KASAN reporting is disabled in some contexts (for example when
>> + * the allocator accesses slab object metadata; this is controlled by
>> + * current->kasan_depth). All these accesses are detected by the tool,
>> + * even though the reports for them are not printed.
>> + *
>> + * This is something that might be fixed at some point in the future.
>> + */
>> +static inline void kasan_inline_recover(
>> + bool recover, char *msg, struct pt_regs *regs, unsigned long err,
>> + void die_fn(const char *str, struct pt_regs *regs, long err))
>> +{
>> + if (!recover)
>> + die_fn(msg, regs, err);
>> +}
>> +#endif
>> +
>> #endif /* LINUX_KASAN_H */
>> --
>> 2.50.1
>>
--
Kind regards
Maciej Wieczór-Retman
next prev parent reply other threads:[~2025-09-08 10:44 UTC|newest]
Thread overview: 68+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-08-25 20:24 [PATCH v5 00/19] kasan: x86: arm64: KASAN tag-based mode for x86 Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 01/19] kasan: sw_tags: Use arithmetic shift for shadow computation Maciej Wieczor-Retman
2025-08-26 19:35 ` Catalin Marinas
2025-08-27 6:26 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 02/19] kasan: sw_tags: Support tag widths less than 8 bits Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 03/19] kasan: Fix inline mode for x86 tag-based mode Maciej Wieczor-Retman
2025-09-06 17:17 ` Andrey Konovalov
2025-08-25 20:24 ` [PATCH v5 04/19] x86: Add arch specific kasan functions Maciej Wieczor-Retman
2025-09-06 17:17 ` Andrey Konovalov
2025-09-08 9:06 ` Maciej Wieczor-Retman
2025-09-18 15:52 ` Andrey Ryabinin
2025-09-19 11:05 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 05/19] kasan: arm64: x86: Make special tags arch specific Maciej Wieczor-Retman
2025-09-06 17:18 ` Andrey Konovalov
2025-09-08 10:12 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 06/19] x86: Reset tag for virtual to physical address conversions Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 07/19] mm: x86: Untag addresses in EXECMEM_ROX related pointer arithmetic Maciej Wieczor-Retman
2025-08-28 9:50 ` Mike Rapoport
2025-08-28 16:22 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 08/19] x86: Physical address comparisons in fill_p*d/pte Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 09/19] x86: KASAN raw shadow memory PTE init Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 10/19] x86: LAM compatible non-canonical definition Maciej Wieczor-Retman
2025-08-25 20:59 ` Samuel Holland
2025-08-27 6:32 ` Maciej Wieczor-Retman
2025-08-25 21:36 ` Dave Hansen
2025-08-26 8:08 ` Maciej Wieczor-Retman
2025-08-27 0:46 ` Samuel Holland
2025-08-27 6:08 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 11/19] x86: LAM initialization Maciej Wieczor-Retman
2025-09-06 22:24 ` Borislav Petkov
2025-09-08 8:30 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 12/19] x86: Minimal SLAB alignment Maciej Wieczor-Retman
2025-09-06 17:18 ` Andrey Konovalov
2025-08-25 20:24 ` [PATCH v5 13/19] kasan: x86: Handle int3 for inline KASAN reports Maciej Wieczor-Retman
2025-09-06 17:19 ` Andrey Konovalov
2025-09-08 10:38 ` Maciej Wieczor-Retman [this message]
2025-09-08 12:54 ` Maciej Wieczor-Retman
2025-09-08 13:08 ` Maciej Wieczor-Retman
2025-09-08 20:19 ` Andrey Konovalov
2025-09-09 8:24 ` Maciej Wieczor-Retman
2025-09-09 8:34 ` Peter Zijlstra
2025-09-09 8:40 ` Peter Zijlstra
2025-09-09 8:49 ` Maciej Wieczor-Retman
2025-09-09 9:03 ` Peter Zijlstra
2025-09-10 8:23 ` Maciej Wieczor-Retman
2025-09-09 8:53 ` Maciej Wieczor-Retman
2025-09-09 14:46 ` Andrey Konovalov
2025-08-25 20:24 ` [PATCH v5 14/19] arm64: Unify software tag-based KASAN inline recovery path Maciej Wieczor-Retman
2025-08-26 19:35 ` Catalin Marinas
2025-08-25 20:24 ` [PATCH v5 15/19] kasan: x86: Apply multishot to the inline report handler Maciej Wieczor-Retman
2025-09-06 17:19 ` Andrey Konovalov
2025-09-08 13:02 ` Maciej Wieczor-Retman
2025-09-08 20:19 ` Andrey Konovalov
2025-09-09 8:42 ` Maciej Wieczor-Retman
2025-09-09 14:45 ` Andrey Konovalov
2025-09-09 14:46 ` Andrey Konovalov
2025-08-25 20:24 ` [PATCH v5 16/19] kasan: x86: Logical bit shift for kasan_mem_to_shadow Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 17/19] mm: Unpoison pcpu chunks with base address tag Maciej Wieczor-Retman
2025-09-13 8:29 ` Baoquan He
2025-09-15 6:29 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 18/19] mm: Unpoison vms[area] addresses with a common tag Maciej Wieczor-Retman
2025-09-06 17:19 ` Andrey Konovalov
2025-09-08 13:11 ` Maciej Wieczor-Retman
2025-09-08 20:19 ` Andrey Konovalov
2025-09-09 8:26 ` Maciej Wieczor-Retman
2025-08-25 20:24 ` [PATCH v5 19/19] x86: Make software tag-based kasan available Maciej Wieczor-Retman
2025-09-06 17:19 ` Andrey Konovalov
2025-09-08 14:11 ` Maciej Wieczor-Retman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=couuy2aawztipvnlmaloadkbceewcekur5qbtzktr7ovneduvf@l47rxycy65aa \
--to=maciej.wieczor-retman@intel.com \
--cc=Liam.Howlett@oracle.com \
--cc=ada.coupriediaz@arm.com \
--cc=akpm@linux-foundation.org \
--cc=alexander.shishkin@linux.intel.com \
--cc=alexandre.chartre@oracle.com \
--cc=andreyknvl@gmail.com \
--cc=ardb@kernel.org \
--cc=axelrasmussen@google.com \
--cc=baohua@kernel.org \
--cc=bigeasy@linutronix.de \
--cc=bp@alien8.de \
--cc=brgerst@gmail.com \
--cc=broonie@kernel.org \
--cc=catalin.marinas@arm.com \
--cc=corbet@lwn.net \
--cc=dave.hansen@linux.intel.com \
--cc=david@redhat.com \
--cc=dvyukov@google.com \
--cc=glider@google.com \
--cc=graf@amazon.com \
--cc=guoweikang.kernel@gmail.com \
--cc=hpa@zytor.com \
--cc=jan.kiszka@siemens.com \
--cc=jason.andryuk@amd.com \
--cc=jbohac@suse.cz \
--cc=jgross@suse.com \
--cc=jhubbard@nvidia.com \
--cc=joel.granados@kernel.org \
--cc=joey.gouly@arm.com \
--cc=jpoimboe@kernel.org \
--cc=justinstitt@google.com \
--cc=kaleshsingh@google.com \
--cc=kas@kernel.org \
--cc=kasan-dev@googlegroups.com \
--cc=kbingham@kernel.org \
--cc=kees@kernel.org \
--cc=kristina.martsenko@arm.com \
--cc=kuan-ying.lee@canonical.com \
--cc=leitao@debian.org \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kbuild@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=llvm@lists.linux.dev \
--cc=lorenzo.stoakes@oracle.com \
--cc=luto@kernel.org \
--cc=mark.rutland@arm.com \
--cc=mhocko@suse.com \
--cc=mingo@redhat.com \
--cc=morbo@google.com \
--cc=nathan@kernel.org \
--cc=nick.desaulniers+lkml@gmail.com \
--cc=nicolas.schier@linux.dev \
--cc=pasha.tatashin@soleen.com \
--cc=pcc@google.com \
--cc=peterz@infradead.org \
--cc=rppt@kernel.org \
--cc=ryabinin.a.a@gmail.com \
--cc=samitolvanen@google.com \
--cc=samuel.holland@sifive.com \
--cc=scott@os.amperecomputing.com \
--cc=smostafa@google.com \
--cc=sohil.mehta@intel.com \
--cc=surenb@google.com \
--cc=tglx@linutronix.de \
--cc=thiago.bauermann@linaro.org \
--cc=thuth@redhat.com \
--cc=trintaeoitogc@gmail.com \
--cc=ubizjak@gmail.com \
--cc=urezki@gmail.com \
--cc=vbabka@suse.cz \
--cc=vincenzo.frascino@arm.com \
--cc=wangkefeng.wang@huawei.com \
--cc=weixugc@google.com \
--cc=will@kernel.org \
--cc=x86@kernel.org \
--cc=xin@zytor.com \
--cc=yuanchu@google.com \
--cc=ziy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox