From: "Sridhar, Kanchana P" <kanchana.p.sridhar@intel.com>
To: Yosry Ahmed <yosryahmed@google.com>, Nhat Pham <nphamcs@gmail.com>
Cc: "linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"linux-mm@kvack.org" <linux-mm@kvack.org>,
"hannes@cmpxchg.org" <hannes@cmpxchg.org>,
"chengming.zhou@linux.dev" <chengming.zhou@linux.dev>,
"usamaarif642@gmail.com" <usamaarif642@gmail.com>,
"ryan.roberts@arm.com" <ryan.roberts@arm.com>,
"Huang, Ying" <ying.huang@intel.com>,
"21cnbao@gmail.com" <21cnbao@gmail.com>,
"akpm@linux-foundation.org" <akpm@linux-foundation.org>,
"Zou, Nanhai" <nanhai.zou@intel.com>,
"Feghali, Wajdi K" <wajdi.k.feghali@intel.com>,
"Gopal, Vinodh" <vinodh.gopal@intel.com>,
"Sridhar, Kanchana P" <kanchana.p.sridhar@intel.com>
Subject: RE: [PATCH v6 0/3] mm: ZSWAP swap-out of mTHP folios
Date: Fri, 20 Sep 2024 02:30:39 +0000 [thread overview]
Message-ID: <SJ0PR11MB567817BD31202F651F181B76C96C2@SJ0PR11MB5678.namprd11.prod.outlook.com> (raw)
In-Reply-To: <CAJD7tkY9SQ3NOukRY3Zh9ML4yyN-zC0krNkpoUzeCd5tyE1Zgw@mail.gmail.com>
> -----Original Message-----
> From: Yosry Ahmed <yosryahmed@google.com>
> Sent: Thursday, August 29, 2024 5:14 PM
> To: Nhat Pham <nphamcs@gmail.com>
> Cc: Sridhar, Kanchana P <kanchana.p.sridhar@intel.com>; linux-
> kernel@vger.kernel.org; linux-mm@kvack.org; hannes@cmpxchg.org;
> chengming.zhou@linux.dev; usamaarif642@gmail.com;
> ryan.roberts@arm.com; Huang, Ying <ying.huang@intel.com>;
> 21cnbao@gmail.com; akpm@linux-foundation.org; Zou, Nanhai
> <nanhai.zou@intel.com>; Feghali, Wajdi K <wajdi.k.feghali@intel.com>;
> Gopal, Vinodh <vinodh.gopal@intel.com>
> Subject: Re: [PATCH v6 0/3] mm: ZSWAP swap-out of mTHP folios
>
> On Thu, Aug 29, 2024 at 5:06 PM Nhat Pham <nphamcs@gmail.com> wrote:
> >
> > On Thu, Aug 29, 2024 at 4:55 PM Yosry Ahmed <yosryahmed@google.com>
> wrote:
> > >
> > > On Thu, Aug 29, 2024 at 4:45 PM Nhat Pham <nphamcs@gmail.com>
> wrote:
> > > I think it's also the fact that the processes exit right after they
> > > are done allocating the memory. So I think in the case of SSD, when we
> > > stall waiting for IO some processes get to exit and free up memory, so
> > > we need to do less swapping out in general because the processes are
> > > more serialized. With zswap, all processes try to access memory at the
> > > same time so the required amount of memory at any given point is
> > > higher, leading to more thrashing.
> > >
> > > I suggested keeping the memory allocated for a long time to even the
> > > playing field, or we can make the processes keep looping and accessing
> > > the memory (or part of it) for a while.
> > >
> > > That being said, I think this may be a signal that the memory.high
> > > throttling is not performing as expected in the zswap case. Not sure
> > > tbh, but I don't think SSD swap should perform better than zswap in
> > > that case.
> >
> > Yeah something is fishy there. That said, the benchmarking in v4 is wack:
> >
> > 1. We use lz4, which has a really poor compression factor.
> >
> > 2. The swapfile is really small, so we occasionally see problems with
> > swap allocation failure.
> >
> > Both of these factors affect benchmarking validity and stability a
> > lot. I think in this version's benchmarks, with zstd as the software
> > compressor + a much larger swapfile (albeit on top of a ZRAM block
> > device), we no longer see memory.high violation, even at a lower
> > memory.high value...? The performance number is wack indeed - not a
> > lot of values in the case 2 section.
>
> But when we use zram we are essentially comparing two swap mechanisms
> compressing mTHPs page by page, with the only difference being that
> zram does not account the memory. For this to have any value imo it
> should be on an SSD to at least provide the value of being a practical
> sanity check as you mentioned earlier. In its current form I don't
> think it's providing any value.
Just posted data today with SSD and longer running usemem processes,
that should hopefully better quantify the benefit of zswap-mTHP.
Thanks,
Kanchana
next prev parent reply other threads:[~2024-09-20 2:30 UTC|newest]
Thread overview: 34+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-08-29 21:27 Kanchana P Sridhar
2024-08-29 21:27 ` [PATCH v6 1/3] mm: Define obj_cgroup_get() if CONFIG_MEMCG is not defined Kanchana P Sridhar
2024-08-29 21:27 ` [PATCH v6 2/3] mm: zswap: zswap_store() extended to handle mTHP folios Kanchana P Sridhar
2024-08-29 23:06 ` Yosry Ahmed
2024-09-20 1:57 ` Sridhar, Kanchana P
2024-09-02 11:37 ` Chengming Zhou
2024-09-20 2:43 ` Sridhar, Kanchana P
2024-09-16 5:55 ` Barry Song
2024-09-20 20:53 ` Sridhar, Kanchana P
2024-08-29 21:27 ` [PATCH v6 3/3] mm: swap: Count successful mTHP ZSWAP stores in sysfs mTHP zswpout stats Kanchana P Sridhar
2024-08-30 0:19 ` Nhat Pham
2024-09-20 2:32 ` Sridhar, Kanchana P
2024-09-20 22:57 ` Yosry Ahmed
2024-09-20 23:28 ` Sridhar, Kanchana P
2024-08-29 22:48 ` [PATCH v6 0/3] mm: ZSWAP swap-out of mTHP folios Yosry Ahmed
2024-08-29 23:45 ` Nhat Pham
2024-08-29 23:54 ` Yosry Ahmed
2024-08-30 0:06 ` Nhat Pham
2024-08-30 0:14 ` Yosry Ahmed
2024-09-20 2:30 ` Sridhar, Kanchana P [this message]
2024-09-20 2:26 ` Sridhar, Kanchana P
2024-09-20 2:22 ` Sridhar, Kanchana P
2024-09-20 2:16 ` Sridhar, Kanchana P
2024-09-20 9:12 ` Huang, Ying
2024-09-20 16:53 ` Sridhar, Kanchana P
2024-08-30 9:27 ` Huang, Ying
2024-09-20 2:41 ` Sridhar, Kanchana P
2024-09-20 1:41 ` Sridhar, Kanchana P
2024-09-20 9:29 ` Huang, Ying
2024-09-20 17:57 ` Sridhar, Kanchana P
2024-09-20 23:15 ` Yosry Ahmed
2024-09-20 23:45 ` Sridhar, Kanchana P
2024-09-02 14:40 ` Usama Arif
2024-09-20 19:31 ` Sridhar, Kanchana P
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=SJ0PR11MB567817BD31202F651F181B76C96C2@SJ0PR11MB5678.namprd11.prod.outlook.com \
--to=kanchana.p.sridhar@intel.com \
--cc=21cnbao@gmail.com \
--cc=akpm@linux-foundation.org \
--cc=chengming.zhou@linux.dev \
--cc=hannes@cmpxchg.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=nanhai.zou@intel.com \
--cc=nphamcs@gmail.com \
--cc=ryan.roberts@arm.com \
--cc=usamaarif642@gmail.com \
--cc=vinodh.gopal@intel.com \
--cc=wajdi.k.feghali@intel.com \
--cc=ying.huang@intel.com \
--cc=yosryahmed@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox