From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8A4C6C61D9C for ; Wed, 22 Nov 2023 10:23:33 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0E6176B05DB; Wed, 22 Nov 2023 05:23:33 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 0977D6B05E2; Wed, 22 Nov 2023 05:23:33 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EA0976B05E3; Wed, 22 Nov 2023 05:23:32 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id DB8B36B05DB for ; Wed, 22 Nov 2023 05:23:32 -0500 (EST) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 50556A06B9 for ; Wed, 22 Nov 2023 10:23:31 +0000 (UTC) X-FDA: 81485203422.19.91D39DF Received: from smtp-out1.suse.de (smtp-out1.suse.de [195.135.220.28]) by imf10.hostedemail.com (Postfix) with ESMTP id F27B4C0024 for ; Wed, 22 Nov 2023 10:23:27 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=suse.com header.s=susede1 header.b=P77qLai8; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (imf10.hostedemail.com: domain of mhocko@suse.com designates 195.135.220.28 as permitted sender) smtp.mailfrom=mhocko@suse.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1700648608; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=PlrtFUbphp1xKwmhddTZK3avXJcT+X0HqDrgDSKr+Yk=; b=ArBVOlxWtbt0nbsVN+xDPf8bIWYc3vWbBbmdSRVvVnarxwrfFjxNLF/zpqHf9o9wp/HcvB 561rm+EH8pwdNPKZFYlGPLruE0+1wIgUrCY2PRdc8PDRfR5uN3ZCIKmSu0+ojoSNAXbJzm ysj9aBrfr7sxe0Ct92Cajze8qKBeN2g= ARC-Authentication-Results: i=1; imf10.hostedemail.com; dkim=pass header.d=suse.com header.s=susede1 header.b=P77qLai8; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (imf10.hostedemail.com: domain of mhocko@suse.com designates 195.135.220.28 as permitted sender) smtp.mailfrom=mhocko@suse.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1700648608; a=rsa-sha256; cv=none; b=zOeKSkG2PJ4X3Ft5emLxpyvne99EHCeg6pF32ypOAK2Uyon6ZFOxoY/QyNw9kYHYDfXSP7 oISxQhpSPuVXiHLTenVOR633tUZChCRytPTr5NmhYxxrl2uFnUzfwvPWApGjagL1qEYZab 52vg1dWguyIfLs1fNFEO01K575iPMzY= Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out1.suse.de (Postfix) with ESMTPS id 3BCE021963; Wed, 22 Nov 2023 10:23:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1700648606; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=PlrtFUbphp1xKwmhddTZK3avXJcT+X0HqDrgDSKr+Yk=; b=P77qLai85rWBMrGTsafkxgHKUUvxfCmTbGAwFiMJZ+lmIITCQ0veHfNqJoA4Mvs6DsTxck FhDypOKa7BVuH7clX/MsfXpCbzBXtgePjuY8c4tNM9NR6u8ESVjAg8MWSd5+IVCRSDoBMk FBD2PFW7rhHGuHVgUv5bfatiAmN9kCk= Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id 0909113461; Wed, 22 Nov 2023 10:23:25 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id qLLKOp3WXWVEEwAAMHmgww (envelope-from ); Wed, 22 Nov 2023 10:23:25 +0000 Date: Wed, 22 Nov 2023 11:23:24 +0100 From: Michal Hocko To: Dmitry Rokosov Cc: rostedt@goodmis.org, mhiramat@kernel.org, hannes@cmpxchg.org, roman.gushchin@linux.dev, shakeelb@google.com, muchun.song@linux.dev, akpm@linux-foundation.org, kernel@sberdevices.ru, rockosov@gmail.com, cgroups@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, bpf@vger.kernel.org Subject: Re: [PATCH v2 2/2] mm: memcg: introduce new event to trace shrink_memcg Message-ID: References: <20231122100156.6568-1-ddrokosov@salutedevices.com> <20231122100156.6568-3-ddrokosov@salutedevices.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20231122100156.6568-3-ddrokosov@salutedevices.com> X-Rspamd-Queue-Id: F27B4C0024 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: p69z3je37h31eax4gzo84kmz9gjzmm5m X-HE-Tag: 1700648607-681836 X-HE-Meta: U2FsdGVkX18VSMw/+a4w0KWfC9CBSC7a8RPngbmAyIPhsEQ8nP/XnlPSQXKG4t3dklyc+eVsdxpE0whSbD42GbM9+WuJj/WqhvZPY/ovFgWiYirhHA6CEYdswshtvGyqola8E7HIzJtV+mF1fxLZanM7qkiTL4yWicPlSqrcpbCywmP6bQ4tvqMBcj3u5MtdRLhQNZFHl6tb84FaAQQ6llHrQJuSDXlj+gpYdTLiXBIShrLjcBWNXOfiMUWKaiRwnKCm2tnTZl16HWUCNhY/uVXj9O9B/Gtu+g+QHmXRvZxIP5ASvRhk3ZFcZw98c3q+36alzl7EoO/K+tQgAFyyQxAsJMU9rVQLRcFZszJfLKGeY4H1W9hRUecAeUOAw8+xJHdm2gNfbWw7I9Ls2Rsdfl2vkvFQgC1VnmMxVVyQ2ztpDAMzJh94JCgoHSlt/0Tvd++Z4wOZCpacUK+1PjOhdVWpCdELiXXwy22rd/UM+WgZBY6zuaLQpFMYC/Z0jvWrV83f4U1vDar5UVGugb9a64j4pjxa8wqsL7IlCmyPL0oDl+Hrr106X270GDsCTSC4iEBQebzKdGwbjKq+Oq94jNG2P5uuA/SRNPESPTj6jNd1s1trMDREN//VmCRPC/7ChQn1suLIZDJuRQdD+G4yVPnd2+D7Lg1zsDeNGcHj4kLK7915KrBu1z2U9Q78afSqhq04mT9bGwnF+c1Ukq3kW+zsVhl3ubloU5m+QHn1hKhw0UOcXcfOTNGKcsKghmXKhJB67lBcRFXZjDBQ/o3wOXGwa3IB/9NbZJALI1/8GGzmbuNMD8BBr+R/vrUfxDT89vrtHSLmJehWyN2k6WU7bB4sRohtKKo7mmiRH3TDC22wU833H43osrDZhm65KJzXi8/uIXbe2JyHQZKbfIGAwbnRnj4TmAR/VWJ0VN20ryhLSeDB/u0CpqQH67eLPc8dqfdKch8zCqUaD3biB/b qeLu4dT4 P4LDdY1PVCQalVQseka/0RBR6YezhAnNgwqGTAhKUDlCyjjtz28yrjpmAD43RptIZJdK62Qp6tjngRQq1Dqovt+86uA60ii5VJaQVM9CFpNEJb61y2G9HDrM/B4cg3OA3y8J2ogc5nUl+/oxk4ZCI1CwKmSHGkLEFDYEW5UKiSaNeWzxgvMm0Wbf+WNclUVUsq0NCjjqSt7Ry204Cx6AidEbJIwHgilgVjQOn3b1w0L/vFR0= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed 22-11-23 13:01:56, Dmitry Rokosov wrote: > The shrink_memcg flow plays a crucial role in memcg reclamation. > Currently, it is not possible to trace this point from non-direct > reclaim paths. Is this really true? AFAICS we have mm_vmscan_lru_isolate mm_vmscan_lru_shrink_active mm_vmscan_lru_shrink_inactive which are in the vry core of the memory reclaim. Sure post processing those is some work. [...] > diff --git a/mm/vmscan.c b/mm/vmscan.c > index 45780952f4b5..6d89b39d9a91 100644 > --- a/mm/vmscan.c > +++ b/mm/vmscan.c > @@ -6461,6 +6461,12 @@ static void shrink_node_memcgs(pg_data_t *pgdat, struct scan_control *sc) > */ > cond_resched(); > > +#ifdef CONFIG_MEMCG > + trace_mm_vmscan_memcg_shrink_begin(sc->order, > + sc->gfp_mask, > + memcg); > +#endif this is a common code path for node and direct reclaim which means that we will have multiple begin/end tracepoints covering similar operations. To me that sounds excessive. If you are missing a cumulative kswapd alternative to mm_vmscan_direct_reclaim_begin mm_vmscan_direct_reclaim_end mm_vmscan_memcg_reclaim_begin mm_vmscan_memcg_reclaim_end mm_vmscan_memcg_softlimit_reclaim_begin mm_vmscan_memcg_softlimit_reclaim_end mm_vmscan_node_reclaim_begin mm_vmscan_node_reclaim_end then place it into kswapd path. But it would be really great to elaborate some more why this is really needed. Cannot you simply aggregate stats for kswapd from existing tracepoints? -- Michal Hocko SUSE Labs