From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id BEF38C6FD1D for ; Thu, 30 Mar 2023 07:06:52 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 3A7D16B0074; Thu, 30 Mar 2023 03:06:52 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 358B66B0075; Thu, 30 Mar 2023 03:06:52 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1F92F6B0078; Thu, 30 Mar 2023 03:06:52 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 0F9E76B0074 for ; Thu, 30 Mar 2023 03:06:52 -0400 (EDT) Received: from smtpin25.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id BD3F6120865 for ; Thu, 30 Mar 2023 07:06:51 +0000 (UTC) X-FDA: 80624682222.25.A2B146D Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.220.29]) by imf24.hostedemail.com (Postfix) with ESMTP id BFB05180019 for ; Thu, 30 Mar 2023 07:06:49 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=suse.com header.s=susede1 header.b=mAI7MPiH; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (imf24.hostedemail.com: domain of mhocko@suse.com designates 195.135.220.29 as permitted sender) smtp.mailfrom=mhocko@suse.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1680160010; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=QLfYeLt+TXwV+pwToLzrHHrJTaYboOCW9UaiwVxS7lA=; b=iCmz2jzW/ijuvAa/vc7HdBZgitQfvIvBn8A71z8VMfmPwvfUs5HLdCbSvYP65BIHGY3ncD Q1Zm0fWHRoKsoNotIHycRtFo3yfQ+/jHxiD29734Tdcmq48pDCVeWqObvvcEb3AVzb+2Ph gbEvBecjHnstJxe6Rg7JbBp2ZPhgraU= ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=pass header.d=suse.com header.s=susede1 header.b=mAI7MPiH; dmarc=pass (policy=quarantine) header.from=suse.com; spf=pass (imf24.hostedemail.com: domain of mhocko@suse.com designates 195.135.220.29 as permitted sender) smtp.mailfrom=mhocko@suse.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1680160010; a=rsa-sha256; cv=none; b=NwbVxntCIzIXMVtveq1qWDy4VKHYTQHmrQ7jChB9QxwQzivE0uavSWUfwweZ4765+9JeH8 tLOPt9fO0PvL8KUMAkroAc4ICk2yUm6tl/JOZmbdmN51i/HQXu6gEveXML/Sg/N6E7cq/+ 4BA+PQXH2BpL4ZxHTe2PUWcXWuRvPsI= Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 654981FE87; Thu, 30 Mar 2023 07:06:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.com; s=susede1; t=1680160007; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=QLfYeLt+TXwV+pwToLzrHHrJTaYboOCW9UaiwVxS7lA=; b=mAI7MPiHSl8rJ93izo+zY41ldY7Q5UIHq3cnqnGtElFi7az9dtYt0NrZYGnhHulCp4xuiB tCKde3AIvlhN6fTukiLKYF3ViOCSzqBHTGWpE8aQCHMCXW6+8GcWX7Keeil3ozJ3OOGTHK IGmmNg/5vANvb4KhA3aiQh5XlXtsXR4= Received: from imap2.suse-dmz.suse.de (imap2.suse-dmz.suse.de [192.168.254.74]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (P-521) server-digest SHA512) (No client certificate requested) by imap2.suse-dmz.suse.de (Postfix) with ESMTPS id 4169A1348E; Thu, 30 Mar 2023 07:06:47 +0000 (UTC) Received: from dovecot-director2.suse.de ([192.168.254.65]) by imap2.suse-dmz.suse.de with ESMTPSA id yVwIDQc1JWR+bAAAMHmgww (envelope-from ); Thu, 30 Mar 2023 07:06:47 +0000 Date: Thu, 30 Mar 2023 09:06:46 +0200 From: Michal Hocko To: Shakeel Butt Cc: Yosry Ahmed , Tejun Heo , Josef Bacik , Jens Axboe , Zefan Li , Johannes Weiner , Roman Gushchin , Muchun Song , Andrew Morton , Michal =?iso-8859-1?Q?Koutn=FD?= , Vasily Averin , cgroups@vger.kernel.org, linux-block@vger.kernel.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, bpf@vger.kernel.org Subject: Re: [PATCH v2 4/9] cgroup: rstat: add WARN_ON_ONCE() if flushing outside task context Message-ID: References: <20230328221644.803272-1-yosryahmed@google.com> <20230328221644.803272-5-yosryahmed@google.com> <20230329192059.2nlme5ubshzdbpg6@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20230329192059.2nlme5ubshzdbpg6@google.com> X-Rspam-User: X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: BFB05180019 X-Stat-Signature: jtkfwixmr3ijq9owhko6kxqqkkiofrr7 X-HE-Tag: 1680160009-483328 X-HE-Meta: U2FsdGVkX1+I8yGbX9cnWJpphmZRJXdQ2vwnMMMN3T2EQuCDbNoKwHg+frVhCR2ghQwr9R+hxC7LLJEWGJG0sn7Uj8W7CcbRWGjmHFXSr1BuTEjOuJc4/SI+vAVgHZPeOQlv8iCIcVyxcdSnMl4L4L/E0YkLkDuSMkhDrImJJPfVRBN0EWwqZCKsCr9t5BMugZ6QmEifOqAnlE9pWvjAmo8PAvq5gisatIjZm+CU1WZky+QrehibXBwP6VJfsdz+LZPXvlaQCEBrq01OaGUWmGWX+wCO4ZxElElhWlaTggL3uaO9VCiU+805KKXbkvtV4m1ejNaB83TBHTyFpkoKx7zB+PZnDJ9D+/G5qjpU1EDJZvqLAx3e8WanWtCyzFjhgTxVBCgokrd/U/Nn1ZyCrS8Q/taQyirYWsWJqkL4Hr94v21kHqmwonV2j/yDq/K/jC0Zwov4Z4Hr3oDhdTBO0Dejjh+Sy1A4W4/vsjbHA3QZV6xo8N4Sl31l+EtNsrtFslTY17+8xMttJN6vfiO8t4tToU5ZXyI/YGsB/p37wS4h3srRirFvPDXn6GX5l1cHZwkp1BuGnsoZWLJF7tYewpTUBDaoH+MhOUt9gnPNXBj9t0P3iOTZbnnOlLDGqBrH3+Ys57pqZJTQx8bG+rPzS+VUm7009xEpaXqIUnOVi11DjOGzae+tV2TunNLEwshHt2Rf19XE4pYqyKFE1Y+CRI2yeVreZKK4t4pgLP5A0mSGN5qe0iVbP9LX7pLmcwdksPjEEHleBHpbsSnOoPGpAAtUE9A6xrgGxUxbAIB+UzRiQ4s8wrPd52PHDTox/VYzteGiiwZ12g0RkLnqFE3g0YfM9apGohn+shKVjQCn54WvSjsdiXrNHTU1K3YboM4ON5D2AP1fgRo0nZfdWsXDAK/2mVUo5b91vcJ9ubZvJSvzPm/ITewQ6Eie5ZY3orc16HqFPnjhJWAR1m5kb3g f3ysz70w tU0j89qT8h9ftasALtTRUb0RtqIpnkjunOPzfqjHskAVRzIoaFtq7NCf6UwdqnMfNNxlYgFfm+MlV6m+lADXHX/H3PE/X4ujkctbqNf/QON2rotGmI9FD3G993HOrK0hlk8WmF65zERMJig49vQ6ljRl0/xtKUGE1cf0y6V+mE+iEjbsGdoVww0HX5BTvQBqi+eF1PnQ9AtZMEviEnXf3z0bjfMaW+O7rY9o3gCQY3WBC0V2vlyf/flEB4fCaO0m6bQzI3kUE3IsMGG/x0Qz67xPtFw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed 29-03-23 19:20:59, Shakeel Butt wrote: > On Wed, Mar 29, 2023 at 11:41:39AM -0700, Yosry Ahmed wrote: > > On Wed, Mar 29, 2023 at 4:22 AM Michal Hocko wrote: > > > > > > On Tue 28-03-23 22:16:39, Yosry Ahmed wrote: > > > > rstat flushing is too expensive to perform in irq context. > > > > The previous patch removed the only context that may invoke an rstat > > > > flush from irq context, add a WARN_ON_ONCE() to detect future > > > > violations, or those that we are not aware of. > > > > > > > > Ideally, we wouldn't flush with irqs disabled either, but we have one > > > > context today that does so in mem_cgroup_usage(). Forbid callers from > > > > irq context for now, and hopefully we can also forbid callers with irqs > > > > disabled in the future when we can get rid of this callsite. > > > > > > I am sorry to be late to the discussion. I wanted to follow up on > > > Johannes reply in the previous version but you are too fast ;) > > > > > > I do agree that this looks rather arbitrary. You do not explain how the > > > warning actually helps. Is the intention to be really verbose to the > > > kernel log when somebody uses this interface from the IRQ context and > > > get bug reports? What about configurations with panic on warn? Do we > > > really want to crash their systems for something like that? > > > > Thanks for taking a look, Michal! > > > > The ultimate goal is not to flush in irq context or with irqs > > disabled, as in some cases it causes irqs to be disabled for a long > > time, as flushing is an expensive operation. The previous patch in the > > series should have removed the only context that flushes in irq > > context, and the purpose of the WARN_ON_ONCE() is to catch future uses > > or uses that we might have missed. > > > > There is still one code path that flushes with irqs disabled (also > > mem_cgroup_usage()), and we cannot remove this just yet; we need to > > deprecate usage threshold events for root to do that. So we cannot > > enforce not flushing with irqs disabled yet. > > > > So basically the patch is trying to enforce what we have now, not > > flushing in irq context, and hopefully at some point we will also be > > able to enforce not flushing with irqs disabled. > > > > If WARN_ON_ONCE() is the wrong tool for this, please let me know. > > > > If I understand Michal's concern, the question is should be start with > pr_warn_once() instead of WARN_ON_ONCE() and I think yes we should start > with pr_warn_once(). Yes, I do not really like the WARN_ON here. It is an overkill. pr_warn would much less intrusive but potentially incomplete because you won't know who that offender is. So if you really care about those then you would need to call dump_stack as well. So the real question is. Do we really care so deeply? After all somebody might be calling this from within a spin lock or irq disabled section resulting in a similar situation without noticing. -- Michal Hocko SUSE Labs