From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C9E0AC25B7D for ; Mon, 27 May 2024 13:34:42 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 633626B00A4; Mon, 27 May 2024 09:34:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5E7536B00A9; Mon, 27 May 2024 09:34:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 45C3D6B00B4; Mon, 27 May 2024 09:34:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 240D86B00A4 for ; Mon, 27 May 2024 09:34:42 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 90FFAC103B for ; Mon, 27 May 2024 13:34:41 +0000 (UTC) X-FDA: 82164270762.11.77C3854 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf08.hostedemail.com (Postfix) with ESMTP id 5CDF4160018 for ; Mon, 27 May 2024 13:34:39 +0000 (UTC) Authentication-Results: imf08.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b="D8/J2B2v"; spf=pass (imf08.hostedemail.com: domain of dhildenb@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=dhildenb@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1716816879; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=lDEFX4Rwrocpmk1yMTSH1aYuyP5K1qPmVR60vlP0ECY=; b=CBU2oRj0C+08nNhD/upMP6IO43LFlnvMSfpVjR4SEvRhQ0K+5VpnGagKYKQZpRGAp3ZEod iwRi3mm1LP5NWLd2CwqAa2YH7lrRLtTo19cAGqdTDy3z3YTRRRC3Gsf0EgqMNj9gfFgALI qX3Sk0cdqkLvTK63nQTyi6AINRNU7k8= ARC-Authentication-Results: i=1; imf08.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b="D8/J2B2v"; spf=pass (imf08.hostedemail.com: domain of dhildenb@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=dhildenb@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1716816879; a=rsa-sha256; cv=none; b=dv/ptWcRzr1RC7TUwplpmYwBWhlZjVztUQq069QAVnjvvBpXSu2VEoStJyA2D0juYRxFxC noesCDQIYsafno5OE5Ud48/DYkqvW1LgnI0Bnvt81LZbHVPNTFAkfG3txtCe/Yh+/05Goy 0w61w43O33vKjvXCKf7sabxJ005OS3g= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1716816878; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lDEFX4Rwrocpmk1yMTSH1aYuyP5K1qPmVR60vlP0ECY=; b=D8/J2B2vMWq7GilXyEYTjzwR4QhDRlaNrZXtOsZlzmsQWVZanNC7Tpwoh4uxFbAA5XdXZP 5iuNHkkZW5HfCy9T082Z01u+MxezBd1tziZ7Vd/LCSD2zvfXS+QR2GXAva8DC146nbFuuC A/d5EMdt9SJSIcjvP9R5GmZDYHB0WjQ= Received: from mail-lj1-f200.google.com (mail-lj1-f200.google.com [209.85.208.200]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-645-b-mdpJHLMFONq1PNH31bXA-1; Mon, 27 May 2024 09:34:37 -0400 X-MC-Unique: b-mdpJHLMFONq1PNH31bXA-1 Received: by mail-lj1-f200.google.com with SMTP id 38308e7fff4ca-2e95a63aed3so26516161fa.1 for ; Mon, 27 May 2024 06:34:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1716816876; x=1717421676; h=content-transfer-encoding:in-reply-to:content-language:from :references:cc:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=lDEFX4Rwrocpmk1yMTSH1aYuyP5K1qPmVR60vlP0ECY=; b=CvrdiRkVbLbf+ti/NujJy2m/N/J1fOl642Xp3Z+AKCzQGnUg1OwyAWUEYypORcyaH6 AYDkeIVo+e9z+9gSEGeAmG8MwhOYtarFGO2nDJajm8zPjbD18VEjrrbZwzxmZu6bp85A L85I/Ti2Hi7mSfryc9iGg0YmSsY4RcaYwvb6UlG7ERe4Cqjo1HbIHVOxPEoaGOaWdTPX By6f5cGVmA9Di+t3/z7rcYgA+E6iFK46PSLh/hIW/Rb3nv7oy2tYxLOTouojqGRPgYrB uZcyNmVeqQ2fDaIwuz8vA2UqHn6Yp6ZnOj/1gAtQSiKn7gYhg3qppoRZraRW4AK6KAZ4 o0pA== X-Gm-Message-State: AOJu0YxvkGnbStl0yAZ8+4K2xy+Jy8KPl6NkfpMcOsarSeBy1lDUEFqW l/0fZOiUF3ukD6AmghaulW52JtFRb1H7yLoSzWz270PShDzECM0u7iUP9/YPlIYVajIH4FNjfLi j0SiQGTQwfSSyeZ1P1ltqmrIBQe5YggSPc7ny76YHU3ibXHES X-Received: by 2002:a2e:968c:0:b0:2e0:4cbb:858a with SMTP id 38308e7fff4ca-2e95b0c093bmr51745361fa.27.1716816875607; Mon, 27 May 2024 06:34:35 -0700 (PDT) X-Google-Smtp-Source: AGHT+IHhrNV6UN10MPlEkyX5Wt+TB73NepJi/OagUtHe4JM4L/f5UfWJW/uYUEbLaQ03g8LNnZTS7A== X-Received: by 2002:a2e:968c:0:b0:2e0:4cbb:858a with SMTP id 38308e7fff4ca-2e95b0c093bmr51745181fa.27.1716816875047; Mon, 27 May 2024 06:34:35 -0700 (PDT) Received: from ?IPV6:2003:d8:2f28:4600:d3a7:6c26:54cf:e01e? (p200300d82f284600d3a76c2654cfe01e.dip0.t-ipconnect.de. [2003:d8:2f28:4600:d3a7:6c26:54cf:e01e]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-3557dcf03acsm9229340f8f.103.2024.05.27.06.34.34 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 27 May 2024 06:34:34 -0700 (PDT) Message-ID: <2c943e16-e8f1-4311-b707-1be94d883948@redhat.com> Date: Mon, 27 May 2024 15:34:33 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v15 1/5] mm: add VM_DROPPABLE for designating always lazily freeable mappings To: "Jason A. Donenfeld" , linux-kernel@vger.kernel.org, patches@lists.linux.dev, tglx@linutronix.de Cc: linux-mm@kvack.org References: <20240521111958.2384173-1-Jason@zx2c4.com> <20240521111958.2384173-2-Jason@zx2c4.com> From: David Hildenbrand In-Reply-To: <20240521111958.2384173-2-Jason@zx2c4.com> X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspam-User: X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: 5CDF4160018 X-Stat-Signature: e1cbhzxwdrhu5uks15wfbpz5b6p9pbzw X-HE-Tag: 1716816879-216728 X-HE-Meta: U2FsdGVkX19j/63rQ++QlaytJ8fjng/cgfZyOGHQojNNHQGboEIZlO3/hpwDlWUZGsMhoX/nf9z5W3oRsp5aL5v+UJdj8mon/4jAGmFqjxojYonG0Sdx5INO4934kGJRdjz8DVEsBVmVyhfX0MwKVQowr6Bdj1DkP4krkIKg/WcuU1hBfUVmWpFqSTVFMQH2IvDVWcWtyyx/JA6VfreDxov2O8L5ucGjJx6YJ80L5UcYouMrSXKr628q8noOE53ghE9uZqfYGs5FRf1lk2zVmJN4a5PkXHcTt2Zrep4nqbDwskih/vFrwXplzlt5gCXEe904Fp5/bCfvwmqGUvtat+hZkLwdC7weco2VxAXYLZKK/vhSuwwlFs9nnMxrNOiqjD1GMoPDdbkMV2y35Krr3JvXw1fcKkfQJ7K6EZkQhwnJ/RnzRcqUTywg9V5srTQKJkzD/aWsyhgmZstCpnIs7W0/X/XueWH2grukQW4NQ695l9NC8ZG8f2tGjnGuIkd4K23pANlZHXfKmwD/7W+j8Uf1tfI/uidN1OUObEDTv0Hqyk3IBWRFjynzXcgFdFDqALoMYaI/kPiaiFJGfaSXwX0GKsQFLLEhaQw7RFHKijDix/FvheLJHLITyh1FtBQ74hnzpbjiAXmyCgX7GOVisGNRUK7WsVLfF/63Gy7jZ9pyh6vPcy+fkL30fNDdpB+kdpxxyxCq4q6ysfvW5bO4iZXwGa0o+bOdHJxtWwMBP/ErDXxIZHhj3quFvnXNfYETDnl9Oi65qh6mR9gGxPMXE4uu9GoFbtpaVqGkjZClsg9rHn2cfbDIATZ95iMwGPG5NfUPydt2IVTQj5Z8ooxyfYxpGRWaSyJK0NDw19DPagmK12GuNep/DzxOe/LdeC/EbpjbS1TusHKc6Dnyga2OXeGe4wODtVtOfR1RqZYAd1W9sxAcgaLr3wTN/fFMq+wZbkDJiAsZdgQvH5LYfqQ VclL34XS xmdHohanirv3AcDHRqSHv07NeBWRprezwcOtx8IrvHeOVln/FOuyv229T2jl8JwCDudBSyeU4d3NbXv0JseBGL/L21GdcOOi4AupLb1C2rnSE2CnYtbmw5uiF8DPOQnodbibsrRgCBGjmFeyXIX/PMLTxMZ7XZyPkBvKLthMVqjx/p5JtQ95ea8kgYoMgbSnk/YFLAl+3l9PxX6elKnWD+xOVshPVd7t04p4OsmLFgpDfwQdnGLfPxyFqo2nPQSL3dHfFIFCfztqqLaAbOKsJrZZl5UcMjcIZk/SXhT87ealzh6LXhkVyB+NYwwCGlt5FwdXHeW1jyl4/ilHM8XuahDbtXd8uii1EbRsEq3MOow2JLBiXLLDabC/YYhnfLLCAL2XmeQeARLnWKYI5q710qtaJalIrGymxxzJHHALEwcXX44Hb16F/VX2TyQ7fUV6lKZny/s4lrDOEzjO1H1fY+PrO5gKnkenkT/xuin1VHlAj4FqKGQak3ED6HImhmeqNIq6Yg0Kxdgplo8/sXtnLERSrtffhpYIUCw6OUwtRYP5C62kXmHGL/D0DcDpPvjxnh3SaBpsYiyHPfqQqjnc7jsURrQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Am 21.05.24 um 13:18 schrieb Jason A. Donenfeld: > The vDSO getrandom() implementation works with a buffer allocated with a > new system call that has certain requirements: > > - It shouldn't be written to core dumps. > * Easy: VM_DONTDUMP. > - It should be zeroed on fork. > * Easy: VM_WIPEONFORK. > > - It shouldn't be written to swap. > * Uh-oh: mlock is rlimited. > * Uh-oh: mlock isn't inherited by forks. > > - It shouldn't reserve actual memory, but it also shouldn't crash when > page faulting in memory if none is available > * Uh-oh: MAP_NORESERVE respects vm.overcommit_memory=2. > * Uh-oh: VM_NORESERVE means segfaults. > > It turns out that the vDSO getrandom() function has three really nice > characteristics that we can exploit to solve this problem: > > 1) Due to being wiped during fork(), the vDSO code is already robust to > having the contents of the pages it reads zeroed out midway through > the function's execution. > > 2) In the absolute worst case of whatever contingency we're coding for, > we have the option to fallback to the getrandom() syscall, and > everything is fine. > > 3) The buffers the function uses are only ever useful for a maximum of > 60 seconds -- a sort of cache, rather than a long term allocation. > > These characteristics mean that we can introduce VM_DROPPABLE, which > has the following semantics: > > a) It never is written out to swap. > b) Under memory pressure, mm can just drop the pages (so that they're > zero when read back again). > c) If there's not enough memory to service a page fault, it's not fatal. > d) It is inherited by fork. > e) It doesn't count against the mlock budget, since nothing is locked. > > This is fairly simple to implement, with the one snag that we have to > use 64-bit VM_* flags, but this shouldn't be a problem, since the only > consumers will probably be 64-bit anyway. > > This way, allocations used by vDSO getrandom() can use: > > VM_DROPPABLE | VM_DONTDUMP | VM_WIPEONFORK | VM_NORESERVE > > And there will be no problem with OOMing, crashing on overcommitment, > using memory when not in use, not wiping on fork(), coredumps, or > writing out to swap. > > Cc: linux-mm@kvack.org > Signed-off-by: Jason A. Donenfeld > --- > fs/proc/task_mmu.c | 3 +++ > include/linux/mm.h | 8 ++++++++ > include/trace/events/mmflags.h | 7 +++++++ > mm/Kconfig | 3 +++ > mm/memory.c | 4 ++++ > mm/mempolicy.c | 3 +++ > mm/mprotect.c | 2 +- > mm/rmap.c | 5 +++-- > 8 files changed, 32 insertions(+), 3 deletions(-) > > diff --git a/fs/proc/task_mmu.c b/fs/proc/task_mmu.c > index e5a5f015ff03..b5a59e57bde1 100644 > --- a/fs/proc/task_mmu.c > +++ b/fs/proc/task_mmu.c > @@ -706,6 +706,9 @@ static void show_smap_vma_flags(struct seq_file *m, struct vm_area_struct *vma) > #endif /* CONFIG_HAVE_ARCH_USERFAULTFD_MINOR */ > #ifdef CONFIG_X86_USER_SHADOW_STACK > [ilog2(VM_SHADOW_STACK)] = "ss", > +#endif > +#ifdef CONFIG_NEED_VM_DROPPABLE > + [ilog2(VM_DROPPABLE)] = "dp", > #endif > }; > size_t i; > diff --git a/include/linux/mm.h b/include/linux/mm.h > index 9849dfda44d4..5978cb4cc21c 100644 > --- a/include/linux/mm.h > +++ b/include/linux/mm.h > @@ -321,12 +321,14 @@ extern unsigned int kobjsize(const void *objp); > #define VM_HIGH_ARCH_BIT_3 35 /* bit only usable on 64-bit architectures */ > #define VM_HIGH_ARCH_BIT_4 36 /* bit only usable on 64-bit architectures */ > #define VM_HIGH_ARCH_BIT_5 37 /* bit only usable on 64-bit architectures */ > +#define VM_HIGH_ARCH_BIT_6 38 /* bit only usable on 64-bit architectures */ > #define VM_HIGH_ARCH_0 BIT(VM_HIGH_ARCH_BIT_0) > #define VM_HIGH_ARCH_1 BIT(VM_HIGH_ARCH_BIT_1) > #define VM_HIGH_ARCH_2 BIT(VM_HIGH_ARCH_BIT_2) > #define VM_HIGH_ARCH_3 BIT(VM_HIGH_ARCH_BIT_3) > #define VM_HIGH_ARCH_4 BIT(VM_HIGH_ARCH_BIT_4) > #define VM_HIGH_ARCH_5 BIT(VM_HIGH_ARCH_BIT_5) > +#define VM_HIGH_ARCH_6 BIT(VM_HIGH_ARCH_BIT_6) > #endif /* CONFIG_ARCH_USES_HIGH_VMA_FLAGS */ > > #ifdef CONFIG_ARCH_HAS_PKEYS > @@ -357,6 +359,12 @@ extern unsigned int kobjsize(const void *objp); > # define VM_SHADOW_STACK VM_NONE > #endif > > +#ifdef CONFIG_NEED_VM_DROPPABLE > +# define VM_DROPPABLE VM_HIGH_ARCH_6 > +#else > +# define VM_DROPPABLE VM_NONE > +#endif > + > #if defined(CONFIG_X86) > # define VM_PAT VM_ARCH_1 /* PAT reserves whole VMA at once (x86) */ > #elif defined(CONFIG_PPC) > diff --git a/include/trace/events/mmflags.h b/include/trace/events/mmflags.h > index e46d6e82765e..fab7848df50a 100644 > --- a/include/trace/events/mmflags.h > +++ b/include/trace/events/mmflags.h > @@ -165,6 +165,12 @@ IF_HAVE_PG_ARCH_X(arch_3) > # define IF_HAVE_UFFD_MINOR(flag, name) > #endif > > +#ifdef CONFIG_NEED_VM_DROPPABLE > +# define IF_HAVE_VM_DROPPABLE(flag, name) {flag, name}, > +#else > +# define IF_HAVE_VM_DROPPABLE(flag, name) > +#endif > + > #define __def_vmaflag_names \ > {VM_READ, "read" }, \ > {VM_WRITE, "write" }, \ > @@ -197,6 +203,7 @@ IF_HAVE_VM_SOFTDIRTY(VM_SOFTDIRTY, "softdirty" ) \ > {VM_MIXEDMAP, "mixedmap" }, \ > {VM_HUGEPAGE, "hugepage" }, \ > {VM_NOHUGEPAGE, "nohugepage" }, \ > +IF_HAVE_VM_DROPPABLE(VM_DROPPABLE, "droppable" ) \ > {VM_MERGEABLE, "mergeable" } \ > > #define show_vma_flags(flags) \ > diff --git a/mm/Kconfig b/mm/Kconfig > index b4cb45255a54..6cd65ea4b3ad 100644 > --- a/mm/Kconfig > +++ b/mm/Kconfig > @@ -1056,6 +1056,9 @@ config ARCH_USES_HIGH_VMA_FLAGS > bool > config ARCH_HAS_PKEYS > bool > +config NEED_VM_DROPPABLE > + select ARCH_USES_HIGH_VMA_FLAGS > + bool > > config ARCH_USES_PG_ARCH_X > bool > diff --git a/mm/memory.c b/mm/memory.c > index b5453b86ec4b..57b03fc73159 100644 > --- a/mm/memory.c > +++ b/mm/memory.c > @@ -5689,6 +5689,10 @@ vm_fault_t handle_mm_fault(struct vm_area_struct *vma, unsigned long address, > > lru_gen_exit_fault(); > > + /* If the mapping is droppable, then errors due to OOM aren't fatal. */ > + if (vma->vm_flags & VM_DROPPABLE) > + ret &= ~VM_FAULT_OOM; > + > if (flags & FAULT_FLAG_USER) { > mem_cgroup_exit_user_fault(); > /* > diff --git a/mm/mempolicy.c b/mm/mempolicy.c > index aec756ae5637..a66289f1d931 100644 > --- a/mm/mempolicy.c > +++ b/mm/mempolicy.c > @@ -2300,6 +2300,9 @@ struct folio *vma_alloc_folio_noprof(gfp_t gfp, int order, struct vm_area_struct > pgoff_t ilx; > struct page *page; > > + if (vma->vm_flags & VM_DROPPABLE) > + gfp |= __GFP_NOWARN | __GFP_NORETRY; > + > pol = get_vma_policy(vma, addr, order, &ilx); > page = alloc_pages_mpol_noprof(gfp | __GFP_COMP, order, > pol, ilx, numa_node_id()); > diff --git a/mm/mprotect.c b/mm/mprotect.c > index 94878c39ee32..88ff3ecc08a1 100644 > --- a/mm/mprotect.c > +++ b/mm/mprotect.c > @@ -622,7 +622,7 @@ mprotect_fixup(struct vma_iterator *vmi, struct mmu_gather *tlb, > may_expand_vm(mm, oldflags, nrpages)) > return -ENOMEM; > if (!(oldflags & (VM_ACCOUNT|VM_WRITE|VM_HUGETLB| > - VM_SHARED|VM_NORESERVE))) { > + VM_SHARED|VM_NORESERVE|VM_DROPPABLE))) { > charged = nrpages; > if (security_vm_enough_memory_mm(mm, charged)) > return -ENOMEM; > diff --git a/mm/rmap.c b/mm/rmap.c > index e8fc5ecb59b2..f23b9f796aae 100644 > --- a/mm/rmap.c > +++ b/mm/rmap.c > @@ -1397,7 +1397,8 @@ void folio_add_new_anon_rmap(struct folio *folio, struct vm_area_struct *vma, > VM_WARN_ON_FOLIO(folio_test_hugetlb(folio), folio); > VM_BUG_ON_VMA(address < vma->vm_start || > address + (nr << PAGE_SHIFT) > vma->vm_end, vma); > - __folio_set_swapbacked(folio); > + if (!(vma->vm_flags & VM_DROPPABLE)) > + __folio_set_swapbacked(folio); > __folio_set_anon(folio, vma, address, true); > > if (likely(!folio_test_large(folio))) { > @@ -1841,7 +1842,7 @@ static bool try_to_unmap_one(struct folio *folio, struct vm_area_struct *vma, > * plus the rmap(s) (dropped by discard:). > */ > if (ref_count == 1 + map_count && > - !folio_test_dirty(folio)) { > + (!folio_test_dirty(folio) || (vma->vm_flags & VM_DROPPABLE))) { > dec_mm_counter(mm, MM_ANONPAGES); > goto discard; > } If there is any unexpected temporary folio reference (ref_count != 1 + map_count), you'll end up calling folio_set_swapbacked() and the next swapout round will write that folio to swap. -- Thanks, David / dhildenb