From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 69B67C433F5 for ; Wed, 27 Oct 2021 16:08:35 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id EF56A60C51 for ; Wed, 27 Oct 2021 16:08:34 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org EF56A60C51 Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id 992866B0072; Wed, 27 Oct 2021 12:08:34 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 91A356B0073; Wed, 27 Oct 2021 12:08:34 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7BC0A940007; Wed, 27 Oct 2021 12:08:34 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0035.hostedemail.com [216.40.44.35]) by kanga.kvack.org (Postfix) with ESMTP id 6A73B6B0072 for ; Wed, 27 Oct 2021 12:08:34 -0400 (EDT) Received: from smtpin13.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 245F72DD61 for ; Wed, 27 Oct 2021 16:08:34 +0000 (UTC) X-FDA: 78742700148.13.179B888 Received: from mail-yb1-f176.google.com (mail-yb1-f176.google.com [209.85.219.176]) by imf29.hostedemail.com (Postfix) with ESMTP id A1B819000274 for ; Wed, 27 Oct 2021 16:08:33 +0000 (UTC) Received: by mail-yb1-f176.google.com with SMTP id m63so7568437ybf.7 for ; Wed, 27 Oct 2021 09:08:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=+7yM+AHVg6/RWwPVXoUMFU+BAoYxNZ6FELdoFv8vPVY=; b=jam13Ei0ZH0rmnEJQGz2oG7g5UJE6hddfGqNF9ht5JQ+AMTvawIvs2IlZEP15mrB8I 4Vb2WELl2sb+a8KiVkJxo21BQb8RmLmCXaAG3RZVsaWXnfLYRZBgE+NYnDb7fylVrVW+ aVveT6W+Z5ExMRWMYTo1j2GEkQK+b6zBHkgEzEB6XwHBRw98PDkazY5vkMfnt/uKBgJ+ k+ZG/MFiLjtd8w4m1+CBAn413mqp2pPJrigcXqzuwjTfe1S0J8GMx5VqnQWaMknlleuX pTHNvzis3he35IfamTHEUyzyNdSqAOGalCHjxrvlRJ2iQ6AaYVWgIBi7JdokemJnsocR h6dA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+7yM+AHVg6/RWwPVXoUMFU+BAoYxNZ6FELdoFv8vPVY=; b=jHn0Y30okN9mLWAnRoaYLDseKJjx2PuSD4EhOnZgPeWlDCOH0l0hpBLWcyvXf/7BjE DENFezAE3qgvNp6wxmEp52/dZUoVNA+G6cETODerY9SyZIqLqv730cynMCCJpXP316EZ rSszgrIggj7wEwQJV3nW+e207/3lSudLJruLN6PKHjOyO7asGHs+bjI+xuFQJG3nUSY0 9oSC0glKX184AIvYO00bwv/h52YzidbmE4fR2WP5ruuM197DBlWfgLF3g3Sz9fZ/vXKn 7n2seVQIUBixRdLRlqAlMJLA30XzcRopnWqR6ykr6IDp100KP+nRTmjFpEvzd7gy69ul /Syg== X-Gm-Message-State: AOAM531Q+zZJMIW9JZSGzw486yLVGIkm0SplYmd3Ros7Krqpfj306a0J xT1mhhdcXAieTbBX5Q72wD9EBelauJoYiHX/yTx70Q== X-Google-Smtp-Source: ABdhPJw/n7XwHkFkI9fOQmbZIV5nvoItVjlZ5jw4xeYJ3ZltRS5KLuUCkRrnZKnwCUWhrxfvAaiFxm6E/iWN3dKdn7k= X-Received: by 2002:a25:8411:: with SMTP id u17mr33162493ybk.376.1635350912546; Wed, 27 Oct 2021 09:08:32 -0700 (PDT) MIME-Version: 1.0 References: <20211022014658.263508-1-surenb@google.com> In-Reply-To: From: Suren Baghdasaryan Date: Wed, 27 Oct 2021 09:08:21 -0700 Message-ID: Subject: Re: [PATCH 1/1] mm: prevent a race between process_mrelease and exit_mmap To: Michal Hocko Cc: Andrew Morton , David Rientjes , Matthew Wilcox , Johannes Weiner , Roman Gushchin , Rik van Riel , Minchan Kim , Christian Brauner , Christoph Hellwig , Oleg Nesterov , David Hildenbrand , Jann Horn , Shakeel Butt , Andy Lutomirski , Christian Brauner , Florian Weimer , Jan Engelhardt , Linux API , linux-mm , LKML , kernel-team , "Kirill A. Shutemov" , Andrea Arcangeli Content-Type: text/plain; charset="UTF-8" X-Stat-Signature: 3he1i1giypbonutcd8qth6cwgsxwkyxj X-Rspamd-Server: rspam01 X-Rspamd-Queue-Id: A1B819000274 Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=jam13Ei0; dmarc=pass (policy=reject) header.from=google.com; spf=pass (imf29.hostedemail.com: domain of surenb@google.com designates 209.85.219.176 as permitted sender) smtp.mailfrom=surenb@google.com X-HE-Tag: 1635350913-181496 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Oct 22, 2021 at 10:38 AM Suren Baghdasaryan wrote: > > On Fri, Oct 22, 2021 at 1:03 AM Michal Hocko wrote: > > > > On Thu 21-10-21 18:46:58, Suren Baghdasaryan wrote: > > > Race between process_mrelease and exit_mmap, where free_pgtables is > > > called while __oom_reap_task_mm is in progress, leads to kernel crash > > > during pte_offset_map_lock call. oom-reaper avoids this race by setting > > > MMF_OOM_VICTIM flag and causing exit_mmap to take and release > > > mmap_write_lock, blocking it until oom-reaper releases mmap_read_lock. > > > Reusing MMF_OOM_VICTIM for process_mrelease would be the simplest way to > > > fix this race, however that would be considered a hack. Fix this race > > > by elevating mm->mm_users and preventing exit_mmap from executing until > > > process_mrelease is finished. Patch slightly refactors the code to adapt > > > for a possible mmget_not_zero failure. > > > This fix has considerable negative impact on process_mrelease performance > > > and will likely need later optimization. > > > > I am not sure there is any promise that process_mrelease will run in > > parallel with the exiting process. In fact the primary purpose of this > > syscall is to provide a reliable way to oom kill from user space. If you > > want to optimize process exit resp. its exit_mmap part then you should > > be using other means. So I would be careful calling this a regression. > > > > I do agree that taking the reference count is the right approach here. I > > was wrong previously [1] when saying that pinning the mm struct is > > sufficient. I have completely forgot about the subtle sync in exit_mmap. > > One way we can approach that would be to take exclusive mmap_sem > > throughout the exit_mmap unconditionally. > > I agree, that would probably be the cleanest way. > > > There was a push back against > > that though so arguments would have to be re-evaluated. > > I'll review that discussion to better understand the reasons for the > push back. Thanks for the link. Adding Kirill and Andrea. I had some time to dig some more. The latency increase is definitely coming due to process_mrelease calling the last mmput and exit_aio is especially problematic. So, currently process_mrelease not only releases memory but does more, including waiting for io to finish. Unconditional mmap_write_lock around free_pgtables in exit_mmap seems to me the most semantically correct way forward and the pushback is on the basis of regressing performance of the exit path. I would like to measure that regression to confirm this. I don't have access to a big machine but will ask someone in another Google team to try the test Michal wrote here https://lore.kernel.org/all/20170725142626.GJ26723@dhcp22.suse.cz/ on a server with and without a custom patch. If the regression is real, then I think we could keep the "if (unlikely(mm_is_oom_victim(mm)))" condition but wrap free_pgtables with conditional mmap_write_lock. To me this is cleaner because it clearly shows that we are trying to prevent free_pgtables from racing with any mm readers (current mmap_write_lock(); mmap_write_unlock() sequence needs a comment section to explain why this is needed). In that case I would need to reuse MMF_OOM_VICTIM in process_mrelease to avoid postponing the exit_mmap, like oom-reaper does. Maybe we could rename MMF_OOM_VICTIM / MMF_OOM_SKIP to something like MMF_RELEASING / MMF_RELEASED to make them more generic and allow their use outside of oom-killer? Again, this is a fallback plan in case unconditional mmap_write_lock indeed regresses the exit path. Any comments/suggestions? > > > > > [1] http://lkml.kernel.org/r/YQzZqFwDP7eUxwcn@dhcp22.suse.cz > > > > That being said > > Acked-by: Michal Hocko > > Thanks! > > > > > Thanks! > > > > > Fixes: 884a7e5964e0 ("mm: introduce process_mrelease system call") > > > Signed-off-by: Suren Baghdasaryan > > > --- > > > mm/oom_kill.c | 23 ++++++++++++----------- > > > 1 file changed, 12 insertions(+), 11 deletions(-) > > > > > > diff --git a/mm/oom_kill.c b/mm/oom_kill.c > > > index 831340e7ad8b..989f35a2bbb1 100644 > > > --- a/mm/oom_kill.c > > > +++ b/mm/oom_kill.c > > > @@ -1150,7 +1150,7 @@ SYSCALL_DEFINE2(process_mrelease, int, pidfd, unsigned int, flags) > > > struct task_struct *task; > > > struct task_struct *p; > > > unsigned int f_flags; > > > - bool reap = true; > > > + bool reap = false; > > > struct pid *pid; > > > long ret = 0; > > > > > > @@ -1177,15 +1177,15 @@ SYSCALL_DEFINE2(process_mrelease, int, pidfd, unsigned int, flags) > > > goto put_task; > > > } > > > > > > - mm = p->mm; > > > - mmgrab(mm); > > > - > > > - /* If the work has been done already, just exit with success */ > > > - if (test_bit(MMF_OOM_SKIP, &mm->flags)) > > > - reap = false; > > > - else if (!task_will_free_mem(p)) { > > > - reap = false; > > > - ret = -EINVAL; > > > + if (mmget_not_zero(p->mm)) { > > > + mm = p->mm; > > > + if (task_will_free_mem(p)) > > > + reap = true; > > > + else { > > > + /* Error only if the work has not been done already */ > > > + if (!test_bit(MMF_OOM_SKIP, &mm->flags)) > > > + ret = -EINVAL; > > > + } > > > } > > > task_unlock(p); > > > > > > @@ -1201,7 +1201,8 @@ SYSCALL_DEFINE2(process_mrelease, int, pidfd, unsigned int, flags) > > > mmap_read_unlock(mm); > > > > > > drop_mm: > > > - mmdrop(mm); > > > + if (mm) > > > + mmput(mm); > > > put_task: > > > put_task_struct(task); > > > put_pid: > > > -- > > > 2.33.0.1079.g6e70778dc9-goog > > > > -- > > Michal Hocko > > SUSE Labs