From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 867B6C0218D for ; Wed, 29 Jan 2025 15:52:59 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C9D916B019C; Wed, 29 Jan 2025 10:52:58 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id C4CCC6B019D; Wed, 29 Jan 2025 10:52:58 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B3B886B019E; Wed, 29 Jan 2025 10:52:58 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 968C46B019C for ; Wed, 29 Jan 2025 10:52:58 -0500 (EST) Received: from smtpin09.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 21043120EE7 for ; Wed, 29 Jan 2025 15:52:58 +0000 (UTC) X-FDA: 83060932836.09.3DA3415 Received: from out-182.mta0.migadu.com (out-182.mta0.migadu.com [91.218.175.182]) by imf02.hostedemail.com (Postfix) with ESMTP id 2988A80009 for ; Wed, 29 Jan 2025 15:52:55 +0000 (UTC) Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=fgKMYeaV; dmarc=pass (policy=none) header.from=linux.dev; spf=pass (imf02.hostedemail.com: domain of yosry.ahmed@linux.dev designates 91.218.175.182 as permitted sender) smtp.mailfrom=yosry.ahmed@linux.dev ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1738165976; a=rsa-sha256; cv=none; b=mkP+1tjlKQrWgLvh/NDNgiJerJILjAtjb1lj1LEQNFkNT1C1yaij+iadC0JWlu/l/C1Z8c rWEBoCAv5k82l4qJlkvPYemc+b/67f/25PG9EpCZ3z9zp1lEyfJLL5OzxQ/9EocPPuzTBT 6lqzCG+OusbsIcS12ua4kf8tvImW/Ug= ARC-Authentication-Results: i=1; imf02.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b=fgKMYeaV; dmarc=pass (policy=none) header.from=linux.dev; spf=pass (imf02.hostedemail.com: domain of yosry.ahmed@linux.dev designates 91.218.175.182 as permitted sender) smtp.mailfrom=yosry.ahmed@linux.dev ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1738165976; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=1nxnH7gjC69f//PjTAZ5mo7TGKKM+PlswgbxJc4ez1U=; b=yKePwUZfharOlB1lVJ+HgCiHxgDMDYczdmwZmit2gY0GgEiVhYWosylgESv7yriXOqpQ7U MUCNQSMS6KyF6pSsIQnFeFm/Ca06V2PjC6cfQq4cqBa61ARtgHznMHmxgnTxMIdxbEEwHT mJAEb2FkQypJ9KWVQQ3qAgBGV9YX1fY= Date: Wed, 29 Jan 2025 15:52:45 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1738165969; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=1nxnH7gjC69f//PjTAZ5mo7TGKKM+PlswgbxJc4ez1U=; b=fgKMYeaVyFXoLO4EWB/7RZnkoYR62K5VcsC4Ztt7NtILluStj90KVBXplBev7biJirI64W Qvh74BLbqF6Ol3hmsQdF3EP8wpRMDeQn4YovYtslIHifDv3aOoebLE9mH2QeCP7oY2CquU 69xeBj+hptdhQ0QEo3lk8WoGHZ34Uig= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Yosry Ahmed To: Hyeonggon Yoo <42.hyeyoo@gmail.com> Cc: Kanchana P Sridhar , Johannes Weiner , Nhat Pham , Chengming Zhou , Andrew Morton , linux-mm@kvack.org, stable@vger.kernel.org Subject: Re: [PATCH v3 mm-hotfixes] mm/zswap: fix inconsistency when zswap_store_page() fails Message-ID: References: <20250129100844.2935-1-42.hyeyoo@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20250129100844.2935-1-42.hyeyoo@gmail.com> X-Migadu-Flow: FLOW_OUT X-Rspam-User: X-Rspamd-Queue-Id: 2988A80009 X-Rspamd-Server: rspam10 X-Stat-Signature: ecinmsybf6gqphsomfam5zqngbd9jsq9 X-HE-Tag: 1738165975-470030 X-HE-Meta: U2FsdGVkX1/QtefdxrSvIorHLJa4I8iVCeDO1KQzaWaG+yFCVb09bSd0Cnp7Y0CHqVerr8b9KHghHWfl33doRLpz6hPG0Td8xtNMhNWBoU+42I563eoJrjyOC22asG5YwZcNy7bM/IPznTTl53T/6c2fc5gxU1T3PL62kPVZbyTRs2XB3QNne7RqbBhNBMckP5D55MzvEjdp4Vrn6/5lipr/sjSqmUoHq7r9dxgra86uSxz9JKAc/bx81/RsyFa7lwBVvMOGiT81col/v6IShsSsi2Nn0dsbp5JxZ7UkhLPipr0033hN3w1Ol6eu2H07JBdPUteSmv2Y0iPBlEJG/D4J0y7KZXVIq6ZP4cPgTBYHJqvZz29wo0o43h9WpOxjbt5tEggd0TgMd1OlcNXsf7A3Tqo4qFObxfJotEq5LrukKaKWdbpn16C16sUVXKUUZ7zDDczqSl7YDeXCbU2gbHTREFeYezCMH+PtFYU0/5Vw6tI+Hs0yta9tB/37NhpKXLaSXKUbUWAW9NxGTiqK2lgk/lZaCDjOmlERf/unnBHJKG6pYTrgjFSkcA29xwEIRHyX+QMRNSlbCOfi+1vEOajfuNBH47jaQyUn8xJEQCYljwerbJ4gdceaa4vqyUWuaGTjRjlEoxR6HfCDOBqmMQ48Cb/LJ6T5LJvm6ECIsoYU63fr33yaU+UHGdSAx4XFmPhyuR6XAsO9weNqIxUoywDdWkEe0cgcXANvlLKD6/qMvBeYS2kLCAA/etObxAj6O9VXdqwjs54RThR2aKUYO76RiAHH4m3npGFPeYjFiegrh1I2dBH6XV921E+Ix9vT0VJCymCfbuPs1cbMJANP/tsEpLioG6Ya1f5ENPLXUFOxniE5FjmxFGseyhV6GbxP5A16Az82fi73RaAoFQOlGbt8BNwt1FNlLUsr5/qBuC3v5CjQOgWqJjhIZaB/9K493kKk45eTLjKE5u8wMWo jYrdix/h JdjmRnOvxGWcw0X82R8+P/yQ2p6KCsDKiuBA9RpCEPXbIkSNBZCUFBL8GaW72ntF5EWp4pZrP30ZAlUltxdyAJyt7CBgQvvIZ2fl6/vWLOXmFxyh5WNWoaPysPzw3EoVzyLdKi9UO0coaIPsmeoEulkIWljQ12aBYibnF/by4MIcjqfmxURunzbwJt3sL8ao9Mqr4VkpLnAzOHNsSi3GcMPUwxHozdoPyKXuHc1atvx6Z9kRkHyFK4n2HfCiXYiYt12sY1oH93qS471CJmJLGUNSegA2cXyhjGdl2EWUhDq3U6ftyO0lcOzlH1jTPysZ3ZZc7JhC0DVlzrnsmtQGDDAxZFTsb05LdMl6BPjGVfVd7BNqhRVayG8GNbtW6sGx4L3fw/3CAlMPJ2ETS7i90dD+boA== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, Jan 29, 2025 at 07:08:44PM +0900, Hyeonggon Yoo wrote: > Commit b7c0ccdfbafd ("mm: zswap: support large folios in zswap_store()") > skips charging any zswap entries when it failed to zswap the entire > folio. > > However, when some base pages are zswapped but it failed to zswap > the entire folio, the zswap operation is rolled back. > When freeing zswap entries for those pages, zswap_entry_free() uncharges > the zswap entries that were not previously charged, causing zswap charging > to become inconsistent. > > This inconsistency triggers two warnings with following steps: > # On a machine with 64GiB of RAM and 36GiB of zswap > $ stress-ng --bigheap 2 # wait until the OOM-killer kills stress-ng > $ sudo reboot > > The two warnings are: > in mm/memcontrol.c:163, function obj_cgroup_release(): > WARN_ON_ONCE(nr_bytes & (PAGE_SIZE - 1)); > > in mm/page_counter.c:60, function page_counter_cancel(): > if (WARN_ONCE(new < 0, "page_counter underflow: %ld nr_pages=%lu\n", > new, nr_pages)) > > zswap_stored_pages also becomes inconsistent in the same way. > > As suggested by Kanchana, increment zswap_stored_pages and charge zswap > entries within zswap_store_page() when it succeeds. This way, > zswap_entry_free() will decrement the counter and uncharge the entries > when it failed to zswap the entire folio. > > While this could potentially be optimized by batching objcg charging > and incrementing the counter, let's focus on fixing the bug this time > and leave the optimization for later after some evaluation. > > After resolving the inconsistency, the warnings disappear. > > Fixes: b7c0ccdfbafd ("mm: zswap: support large folios in zswap_store()") > Cc: stable@vger.kernel.org > Co-developed-by: Kanchana P Sridhar > Signed-off-by: Kanchana P Sridhar > Signed-off-by: Hyeonggon Yoo <42.hyeyoo@gmail.com> I have a few nits, but generally: Acked-by: Yosry Ahmed > --- > > v2 -> v3: > - Adjusted Kanchana's feedback: > - Fixed inconsistency in zswap_stored_pages > - Now objcg charging and incrementing zswap_store_pages is done > within zswap_stored_pages, one by one > > mm/zswap.c | 10 ++++------ > 1 file changed, 4 insertions(+), 6 deletions(-) > > diff --git a/mm/zswap.c b/mm/zswap.c > index 6504174fbc6a..f0bd962bffd5 100644 > --- a/mm/zswap.c > +++ b/mm/zswap.c > @@ -1504,11 +1504,14 @@ static ssize_t zswap_store_page(struct page *page, > entry->pool = pool; > entry->swpentry = page_swpentry; > entry->objcg = objcg; > + if (objcg) > + obj_cgroup_charge_zswap(objcg, entry->length); nit: This can be moved to the existing if (objcg) check where we call obj_cgroup_get(). At that point there shouldn't be a possibility of failure. If you want to keep it here to make it obvious that we only charge when we set entry->objcg that's fine, but we can probably move obj_cgroup_get() here as well in this case. > entry->referenced = true; > if (entry->length) { > INIT_LIST_HEAD(&entry->lru); > zswap_lru_add(&zswap_list_lru, entry); > } > + atomic_long_inc(&zswap_stored_pages); nit: If you keep the charging after setting entry->objcg because that's when the freeing path will uncharge, then perhaps you want to move this after the tree store is successful, because at that point the freeing path will decrement the counter. > return entry->length; > > @@ -1526,7 +1529,6 @@ bool zswap_store(struct folio *folio) > struct obj_cgroup *objcg = NULL; > struct mem_cgroup *memcg = NULL; > struct zswap_pool *pool; > - size_t compressed_bytes = 0; > bool ret = false; > long index; > > @@ -1569,15 +1571,11 @@ bool zswap_store(struct folio *folio) > bytes = zswap_store_page(page, objcg, pool); > if (bytes < 0) > goto put_pool; Do we need 'bytes' anymore? I think we don't even need zswap_store_page() to return the compressed size anymore. Seems like a boolean will suffice. > - compressed_bytes += bytes; > } > > - if (objcg) { > - obj_cgroup_charge_zswap(objcg, compressed_bytes); > + if (objcg) > count_objcg_events(objcg, ZSWPOUT, nr_pages); > - } > > - atomic_long_add(nr_pages, &zswap_stored_pages); > count_vm_events(ZSWPOUT, nr_pages); > > ret = true; > -- > 2.47.1 > >