From: Matthew Wilcox <willy@infradead.org>
To: Gao Xiang <hsiangkao@linux.alibaba.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
Huang Ying <ying.huang@intel.com>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH] mm/migrate: fix deadlock in migrate_pages_batch() on large folios
Date: Sun, 28 Jul 2024 22:46:29 +0100 [thread overview]
Message-ID: <Zqa8NTqKuXkTxzBw@casper.infradead.org> (raw)
In-Reply-To: <20240728154913.4023977-1-hsiangkao@linux.alibaba.com>
On Sun, Jul 28, 2024 at 11:49:13PM +0800, Gao Xiang wrote:
> It was found by compaction stress test when I explicitly enable EROFS
> compressed files to use large folios, which case I cannot reproduce with
> the same workload if large folio support is off (current mainline).
> Typically, filesystem reads (with locked file-backed folios) could use
> another bdev/meta inode to load some other I/Os (e.g. inode extent
> metadata or caching compressed data), so the locking order will be:
Umm. That is a new constraint to me. We have two other places which
take the folio lock in a particular order. Writeback takes locks on
folios belonging to the same inode in ascending ->index order. It
submits all the folios for write before moving on to lock other inodes,
so it does not conflict with this new constraint you're proposing.
The other place is remap_file_range(). Both inodes in that case must be
regular files,
if (!S_ISREG(inode_in->i_mode) || !S_ISREG(inode_out->i_mode))
return -EINVAL;
so this new rule is fine.
Does anybody know of any _other_ ordering constraints on folio locks? I'm
willing to write them down ...
> diff --git a/mm/migrate.c b/mm/migrate.c
> index 20cb9f5f7446..a912e4b83228 100644
> --- a/mm/migrate.c
> +++ b/mm/migrate.c
> @@ -1483,7 +1483,8 @@ static inline int try_split_folio(struct folio *folio, struct list_head *split_f
> {
> int rc;
>
> - folio_lock(folio);
> + if (!folio_trylock(folio))
> + return -EAGAIN;
> rc = split_folio_to_list(folio, split_folios);
> folio_unlock(folio);
> if (!rc)
This feels like the best quick fix to me since migration is going to
walk the folios in a different order from writeback. I'm surprised
this hasn't already bitten us, to be honest.
(ie I don't think this is even necessarily connected to the new
ordering constraint; I think migration and writeback can already
deadlock)
next prev parent reply other threads:[~2024-07-28 21:46 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-07-28 15:49 Gao Xiang
2024-07-28 19:50 ` Andrew Morton
2024-07-28 21:17 ` Matthew Wilcox
2024-07-28 22:35 ` Gao Xiang
2024-07-28 21:46 ` Matthew Wilcox [this message]
2024-07-28 22:11 ` Gao Xiang
2024-08-02 9:01 ` Gao Xiang
2024-07-29 1:38 ` Huang, Ying
2024-07-29 1:58 ` Gao Xiang
2024-08-16 5:02 ` Andrew Morton
2024-08-16 5:12 ` Gao Xiang
2024-08-16 5:17 ` Gao Xiang
2024-08-16 5:25 ` Andrew Morton
2024-08-16 5:32 ` Gao Xiang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=Zqa8NTqKuXkTxzBw@casper.infradead.org \
--to=willy@infradead.org \
--cc=akpm@linux-foundation.org \
--cc=hsiangkao@linux.alibaba.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=ying.huang@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox