From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.2 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH, MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id DF592C433F5 for ; Mon, 13 Sep 2021 09:38:04 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5E2F160F4C for ; Mon, 13 Sep 2021 09:38:04 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 5E2F160F4C Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=virtuozzo.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id D8B7A900003; Mon, 13 Sep 2021 05:38:03 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D3B2A900002; Mon, 13 Sep 2021 05:38:03 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C2A71900003; Mon, 13 Sep 2021 05:38:03 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0210.hostedemail.com [216.40.44.210]) by kanga.kvack.org (Postfix) with ESMTP id B06A2900002 for ; Mon, 13 Sep 2021 05:38:03 -0400 (EDT) Received: from smtpin07.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 69D73267EC for ; Mon, 13 Sep 2021 09:38:03 +0000 (UTC) X-FDA: 78582048846.07.655543E Received: from relay.sw.ru (relay.sw.ru [185.231.240.75]) by imf17.hostedemail.com (Postfix) with ESMTP id D3125F00038D for ; Mon, 13 Sep 2021 09:38:01 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=virtuozzo.com; s=relay; h=Content-Type:MIME-Version:Date:Message-ID:From: Subject; bh=TkHNL+ib7NjPWsL57OO6zVdK+l/V7nLiS/zl/t9RNEE=; b=mJMKaH5Pr/TTWXM+k BEesbC+Nhe8eaboiOWdPHcU5U96lxPEXpN9qBs6mIIhOBWJukn/dMrao3+jSik9NoiDCJ433lNL1D iFTCZhUdXvw3FbwiTF/L4rZS0qQBqAMcRAEKv7t/zgTypsrXOeHh8j3HVW0/bYC89sjznMxIt5Pyg =; Received: from [10.93.0.56] by relay.sw.ru with esmtp (Exim 4.94.2) (envelope-from ) id 1mPiPV-001nw1-Lj; Mon, 13 Sep 2021 12:37:57 +0300 Subject: Re: [PATCH memcg] memcg: prohibit unconditional exceeding the limit of dying tasks To: Michal Hocko Cc: Johannes Weiner , Vladimir Davydov , Andrew Morton , Tetsuo Handa , cgroups@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org References: <5b06a490-55bc-a6a0-6c85-690254f86fad@virtuozzo.com> <8b98d44a-aeb2-5f5f-2545-ac2bd0c7049b@virtuozzo.com> From: Vasily Averin Message-ID: Date: Mon, 13 Sep 2021 12:37:56 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: D3125F00038D X-Stat-Signature: f3s5p4k1qucuoupz1cgnfgysunq8k3na Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=virtuozzo.com header.s=relay header.b=mJMKaH5P; spf=pass (imf17.hostedemail.com: domain of vvs@virtuozzo.com designates 185.231.240.75 as permitted sender) smtp.mailfrom=vvs@virtuozzo.com; dmarc=pass (policy=quarantine) header.from=virtuozzo.com X-HE-Tag: 1631525881-971232 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 9/13/21 11:39 AM, Michal Hocko wrote: > On Mon 13-09-21 10:51:37, Vasily Averin wrote: >> On 9/10/21 3:39 PM, Vasily Averin wrote: >>> The kernel currently allows dying tasks to exceed the memcg limits. >>> The allocation is expected to be the last one and the occupied memory >>> will be freed soon. >>> This is not always true because it can be part of the huge vmalloc >>> allocation. Allowed once, they will repeat over and over again. >> >>> diff --git a/mm/memcontrol.c b/mm/memcontrol.c >>> index 389b5766e74f..67195fcfbddf 100644 >>> --- a/mm/memcontrol.c >>> +++ b/mm/memcontrol.c >>> @@ -2622,15 +2625,6 @@ static int try_charge_memcg(struct mem_cgroup *memcg, gfp_t gfp_mask, >>> if (gfp_mask & __GFP_ATOMIC) >>> goto force; >>> >>> - /* >>> - * Unlike in global OOM situations, memcg is not in a physical >>> - * memory shortage. Allow dying and OOM-killed tasks to >>> - * bypass the last charges so that they can exit quickly and >>> - * free their memory. >>> - */ >>> - if (unlikely(should_force_charge())) >>> - goto force; >>> - >> >> Should we keep current behaviour for (current->flags & PF_EXITING) case perhaps? > > Why? On this stage task really dies and mostly releases taken resources. It can allocate though, and this allocation can reach memcg limit due to the activity of parallel memcg threads. Noting bad should happen if we reject this allocation, because the same thing can happen in non-memcg case too. However I doubt misuse is possible here and we have possibility to allow graceful shutdown here. In other words: we are not obliged to allow such allocations, but we CAN do it because we hope that it is safe and cannot be misused. >> It is set inside do_exit only and (I hope) cannot trigger huge vmalloc allocations. > > Allocations in this code path should be rare but it is not like they are > non-existent. This is rather hard to review area spread at many places > so if we are deciding to make the existing model simpler (no bypassing) > then I would rather have no exceptions unless they are reaaly necessary > and document them if they are. Thank you, vasily Averin