From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CADC9C54E41 for ; Mon, 26 Feb 2024 14:05:09 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 054EA44016B; Mon, 26 Feb 2024 09:05:09 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id F20E7440147; Mon, 26 Feb 2024 09:05:08 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D998B44016B; Mon, 26 Feb 2024 09:05:08 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id C5053440147 for ; Mon, 26 Feb 2024 09:05:08 -0500 (EST) Received: from smtpin28.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 86E7C1C08F9 for ; Mon, 26 Feb 2024 14:05:08 +0000 (UTC) X-FDA: 81834126696.28.6DA34DD Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) by imf28.hostedemail.com (Postfix) with ESMTP id C881FC0022 for ; Mon, 26 Feb 2024 14:05:05 +0000 (UTC) Authentication-Results: imf28.hostedemail.com; dkim=pass header.d=suse.com header.s=susede1 header.b=fUdpPHDz; dkim=pass header.d=suse.com header.s=susede1 header.b=fUdpPHDz; spf=pass (imf28.hostedemail.com: domain of mhocko@suse.com designates 195.135.223.131 as permitted sender) smtp.mailfrom=mhocko@suse.com; dmarc=pass (policy=quarantine) header.from=suse.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708956306; a=rsa-sha256; cv=none; b=4gGZH68X+lv+N2XTZLLoiKlE6dcNRvKQX9NjjHVs9xxaGKFfHwRZiBiTuP76lEIjNNLFRy RVfvyNWoQCUrf1ZAfOAAG0qatQb/xSIRw4+j+Pqpvx8JasJAOhE6FdbT7AMG6TMqNeUsmE UJDud9jMhQU0J+l5ufEKKn5IwL+RU/A= ARC-Authentication-Results: i=1; imf28.hostedemail.com; dkim=pass header.d=suse.com header.s=susede1 header.b=fUdpPHDz; dkim=pass header.d=suse.com header.s=susede1 header.b=fUdpPHDz; spf=pass (imf28.hostedemail.com: domain of mhocko@suse.com designates 195.135.223.131 as permitted sender) smtp.mailfrom=mhocko@suse.com; dmarc=pass (policy=quarantine) header.from=suse.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708956306; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=4U62e0AeLUYOaSALFynu7r+QV9zP8pRu510E9iUxsaM=; b=A4FcQeT/SLyv2eqBv2Qtb/qW0oOjZEw1O3kdA0DTp0PB3UoHEqZYZ9K9SLpeHG+gOkW2BS hZXaDLfdIjAnR/nrKcuGXelNyEHyqptr3rX8izMb9n8YLHIzRD/oXH1rbXcb1cWund6/7V VwBMCK/0lcKuG8HeaeF54Job0f9+QNM= Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [10.150.64.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id F32E21FB50; Mon, 26 Feb 2024 14:05:03 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1708956304; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=4U62e0AeLUYOaSALFynu7r+QV9zP8pRu510E9iUxsaM=; b=fUdpPHDzZlKK5SI91rZIVjlkXnoX8YbPcoZY0HG1lTJe9nyL/4xvAr355GoLuMK6JR6YhH aQ+gOugC2XJ45TcAc/l1csyFuABNj+LA+46agI2MfIngBYRFckiYbXKzXkoOWDzTzPgg6L smB9EUMESOP/c3OXM0a7keTJWLNMGHE= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1708956304; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=4U62e0AeLUYOaSALFynu7r+QV9zP8pRu510E9iUxsaM=; b=fUdpPHDzZlKK5SI91rZIVjlkXnoX8YbPcoZY0HG1lTJe9nyL/4xvAr355GoLuMK6JR6YhH aQ+gOugC2XJ45TcAc/l1csyFuABNj+LA+46agI2MfIngBYRFckiYbXKzXkoOWDzTzPgg6L smB9EUMESOP/c3OXM0a7keTJWLNMGHE= Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id D9BB913A3A; Mon, 26 Feb 2024 14:05:03 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id pk9bM4+a3GVxaAAAD6G6ig (envelope-from ); Mon, 26 Feb 2024 14:05:03 +0000 Date: Mon, 26 Feb 2024 15:04:59 +0100 From: Michal Hocko To: Yafang Shao Cc: akpm@linux-foundation.org, hannes@cmpxchg.org, roman.gushchin@linux.dev, shakeelb@google.com, muchun.song@linux.dev, linux-mm@kvack.org Subject: Re: [RFC PATCH] mm: Add reclaim type to memory.reclaim Message-ID: References: <20240225114204.50459-1-laoar.shao@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20240225114204.50459-1-laoar.shao@gmail.com> X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: C881FC0022 X-Stat-Signature: s87od1ynug5xuzfro8g1bbjzn7t4tewj X-Rspam-User: X-HE-Tag: 1708956305-582334 X-HE-Meta: U2FsdGVkX1/zYRPah6GMma4dVNELjqHkU/EFQJfIdO5WF8PF2ufsb3cQObmEmio5m9hB4/lMutfBmQLioFP0DkhkWhkG5RrdIeBO3SyZA84lFVysX/QwRvHt6l6nbH3U7EI2xwr/UnOm1YGlGRbl9eIhtm2l47Fc6Kl4s36v6JVoeteE8PQh/WZn6fH5tN4064EzlKuOI4dfP1ZOGGutACGNmZtZbaoY959RTyiIGkvbu5PQMzSlYdNf1Xu/rA/PJuB/lMr64cf8uQh48L0lgVLnUcvcWfk4nFRlCgxtREI3O3DgROTC8QfnY+E8vw0MomgKBfeWgQZ/5w+g0zytNv6/rIU0p19bWw9SYJ2FeF+2Oj7w2ja+RWK3LOg87H6P1vsKG4TQWWFu6YF0TB7i7f74PFIhbwfi1rcs6u1k3KZqqqJ59e24K2nJpvd86byFXdy3xjs7bZSLtQHmNJqIrcfKIqazHq/GsOpcq/sl8Ne/LzMWcgl5a+E9GKrGwh0ylh2B4E6cFjzUl0LKTA4EVwqNMQPpV2M5exPk0Z4i49wdzWKxMYW9hUrUfXsJ5aKNR9/YKlpZeUfvJdIIptzNRk8LiC6XTJSMH6YWGkwUuLsIuFe595Uw2CvapiiaHSA7oB6V3QE/BwwuDHEQGQcD3h4IdcIXJZYj5I0mtR5IN8OGxkLZNZgMAtULMHLHdOAaJ1wivAbmWX9//cFvDs8MxYrFqNdJjxI+InlJuzuP2+xSkQZuzNfnZfMEm/z6W3QTzWlBSsjSS2MXL1/WoWGYCfPEitkjQsDwYcG8/0VLh5rzYAgLrHtD47iAolrNR37qT5VTLDouNrl7I5kFxJ0zKp922iiirpkn9TucNtc6W3WvjuiIg5c+2o2awXoAey7fLU2iC9fYp1FDwtTdzPrIlN2X7g4CRzucVVTZfPTvNQMXu19JbXo1MzFGrLHQ+xhiRrZfFHpx4JxPJmq8uKv Bcecxcl+ yiW06fDm+rNA5RWavHNKuK6E5I7YGGpS2sJVKe54DPTmw9r0CuOrub3LKIIHg2nSMtNMtAG/Hw+SFPI1Rt7gLRJwJ4KUUQZtTExzsKw1uo9ltZiezfRy8JKKa02laQ2NHw6c0r+AVaVLew1F3+Fg5I015mLJ4EcXeon/ie/edaVd0ZUp5Gd2I9/mstAiXfYDQYoaTlKuyrRalkEaLT/PkzUOhCanur++w5Hw1y4g4l9FCs6egybNkYrvz679QM2UvXEr87faNfFW6OIj5bvsjuIfvMF9V9QcWToSc X-Bogosity: Ham, tests=bogofilter, spamicity=0.048207, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Sun 25-02-24 19:42:04, Yafang Shao wrote: > In our container environment, we've observed that certain containers may > accumulate more than 40GB of slabs, predominantly negative dentries. These > negative dentries remain unreclaimed unless there is memory pressure. Even > after the containers exit, these negative dentries persist. Have you considered using memory.high limit to trigger that memory reclaim? That is surely not focused on the neg. dentry cache but it should keep the overal memory consumption under control. > To manage disk > storage efficiently, we employ an agent that identifies container images > eligible for destruction once all instances of that image exit. > > However, during destruction, dealing with directories containing numerous > negative dentries can significantly impact performance. Performance of what. I have to say I am kind of lost here. We are talking about memory or a disk storage? > To mitigate this > issue, we aim to proactively reclaim these dentries using a user agent. > Extending the memory.reclaim functionality to specifically target slabs > aligns with our requirements. Matthew has already pointed out that this has been proposed several times already and rejected. Dedicated slab shrinking interface is especially tricky because you would need a way to tell which shrinkers to invoke and that would be very kernel version specific. -- Michal Hocko SUSE Labs