From: Kent Overstreet <kent.overstreet@linux.dev>
To: Christoph Hellwig <hch@lst.de>
Cc: Chandan Babu R <chandan.babu@oracle.com>,
"Darrick J. Wong" <djwong@kernel.org>,
Hugh Dickins <hughd@google.com>,
Andrew Morton <akpm@linux-foundation.org>,
linux-xfs@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [PATCH 17/21] xfs: add file_{get,put}_folio
Date: Fri, 26 Jan 2024 20:26:22 -0500 [thread overview]
Message-ID: <zfgublewgj5g6ipf2twkdl4kyvgttrvmigegxthgvc6ghdauwo@fej77ff4mtjs> (raw)
In-Reply-To: <20240126132903.2700077-18-hch@lst.de>
On Fri, Jan 26, 2024 at 02:28:59PM +0100, Christoph Hellwig wrote:
> From: "Darrick J. Wong" <djwong@kernel.org>
>
> Add helper similar to file_{get,set}_page, but which deal with folios
> and don't allocate new folio unless explicitly asked to, which map
> to shmem_get_folio instead of calling into the aops.
>
> Signed-off-by: Darrick J. Wong <djwong@kernel.org>
> Signed-off-by: Christoph Hellwig <hch@lst.de>
looks boilerplatey to my eyes, but this is all new conceptual stuff and
the implementation will be evolving, so...
one nit: that's really not the right place for memalloc_nofs_save(), can
we try to start figuring out the proper locations for those?
Reviewed-by: Kent Overstreet <kent.overstreet@linux.dev>
> ---
> fs/xfs/scrub/trace.h | 2 ++
> fs/xfs/scrub/xfile.c | 74 ++++++++++++++++++++++++++++++++++++++++++++
> fs/xfs/scrub/xfile.h | 7 +++++
> 3 files changed, 83 insertions(+)
>
> diff --git a/fs/xfs/scrub/trace.h b/fs/xfs/scrub/trace.h
> index 0327cab606b070..c61fa7a95ef522 100644
> --- a/fs/xfs/scrub/trace.h
> +++ b/fs/xfs/scrub/trace.h
> @@ -908,6 +908,8 @@ DEFINE_XFILE_EVENT(xfile_store);
> DEFINE_XFILE_EVENT(xfile_seek_data);
> DEFINE_XFILE_EVENT(xfile_get_page);
> DEFINE_XFILE_EVENT(xfile_put_page);
> +DEFINE_XFILE_EVENT(xfile_get_folio);
> +DEFINE_XFILE_EVENT(xfile_put_folio);
>
> TRACE_EVENT(xfarray_create,
> TP_PROTO(struct xfarray *xfa, unsigned long long required_capacity),
> diff --git a/fs/xfs/scrub/xfile.c b/fs/xfs/scrub/xfile.c
> index 2d802c20a8ddfe..1c1db4ae1ba6ee 100644
> --- a/fs/xfs/scrub/xfile.c
> +++ b/fs/xfs/scrub/xfile.c
> @@ -365,3 +365,77 @@ xfile_put_page(
> return -EIO;
> return 0;
> }
> +
> +/*
> + * Grab the (locked) folio for a memory object. The object cannot span a folio
> + * boundary. Returns the locked folio if successful, NULL if there was no
> + * folio or it didn't cover the range requested, or an ERR_PTR on failure.
> + */
> +struct folio *
> +xfile_get_folio(
> + struct xfile *xf,
> + loff_t pos,
> + size_t len,
> + unsigned int flags)
> +{
> + struct inode *inode = file_inode(xf->file);
> + struct folio *folio = NULL;
> + unsigned int pflags;
> + int error;
> +
> + if (inode->i_sb->s_maxbytes - pos < len)
> + return ERR_PTR(-ENOMEM);
> +
> + trace_xfile_get_folio(xf, pos, len);
> +
> + /*
> + * Increase the file size first so that shmem_get_folio(..., SGP_CACHE),
> + * actually allocates a folio instead of erroring out.
> + */
> + if ((flags & XFILE_ALLOC) && pos + len > i_size_read(inode))
> + i_size_write(inode, pos + len);
> +
> + pflags = memalloc_nofs_save();
> + error = shmem_get_folio(inode, pos >> PAGE_SHIFT, &folio,
> + (flags & XFILE_ALLOC) ? SGP_CACHE : SGP_READ);
> + memalloc_nofs_restore(pflags);
> + if (error)
> + return ERR_PTR(error);
> +
> + if (!folio)
> + return NULL;
> +
> + if (len > folio_size(folio) - offset_in_folio(folio, pos)) {
> + folio_unlock(folio);
> + folio_put(folio);
> + return NULL;
> + }
> +
> + if (xfile_has_lost_data(inode, folio)) {
> + folio_unlock(folio);
> + folio_put(folio);
> + return ERR_PTR(-EIO);
> + }
> +
> + /*
> + * Mark the folio dirty so that it won't be reclaimed once we drop the
> + * (potentially last) reference in xfile_put_folio.
> + */
> + if (flags & XFILE_ALLOC)
> + folio_set_dirty(folio);
> + return folio;
> +}
> +
> +/*
> + * Release the (locked) folio for a memory object.
> + */
> +void
> +xfile_put_folio(
> + struct xfile *xf,
> + struct folio *folio)
> +{
> + trace_xfile_put_folio(xf, folio_pos(folio), folio_size(folio));
> +
> + folio_unlock(folio);
> + folio_put(folio);
> +}
> diff --git a/fs/xfs/scrub/xfile.h b/fs/xfs/scrub/xfile.h
> index 465b10f492b66d..afb75e9fbaf265 100644
> --- a/fs/xfs/scrub/xfile.h
> +++ b/fs/xfs/scrub/xfile.h
> @@ -39,4 +39,11 @@ int xfile_get_page(struct xfile *xf, loff_t offset, unsigned int len,
> struct xfile_page *xbuf);
> int xfile_put_page(struct xfile *xf, struct xfile_page *xbuf);
>
> +#define XFILE_MAX_FOLIO_SIZE (PAGE_SIZE << MAX_PAGECACHE_ORDER)
> +
> +#define XFILE_ALLOC (1 << 0) /* allocate folio if not present */
> +struct folio *xfile_get_folio(struct xfile *xf, loff_t offset, size_t len,
> + unsigned int flags);
> +void xfile_put_folio(struct xfile *xf, struct folio *folio);
> +
> #endif /* __XFS_SCRUB_XFILE_H__ */
> --
> 2.39.2
>
next prev parent reply other threads:[~2024-01-27 1:26 UTC|newest]
Thread overview: 48+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-01-26 13:28 put the xfs xfile abstraction on a diet v2 Christoph Hellwig
2024-01-26 13:28 ` [PATCH 01/21] mm: move mapping_set_update out of <linux/swap.h> Christoph Hellwig
2024-01-26 14:39 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 02/21] shmem: move shmem_mapping out of line Christoph Hellwig
2024-01-26 14:40 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 03/21] shmem: set a_ops earlier in shmem_symlink Christoph Hellwig
2024-01-26 14:41 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 04/21] shmem: move the shmem_mapping assert into shmem_get_folio_gfp Christoph Hellwig
2024-01-26 15:09 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 05/21] shmem: export shmem_get_folio Christoph Hellwig
2024-01-26 15:15 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 06/21] shmem: export shmem_kernel_file_setup Christoph Hellwig
2024-01-26 15:45 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 07/21] shmem: document how to "persist" data when using shmem_*file_setup Christoph Hellwig
2024-01-26 15:49 ` Matthew Wilcox
2024-01-28 16:54 ` Christoph Hellwig
2024-01-29 15:56 ` Matthew Wilcox
2024-01-29 16:04 ` Christoph Hellwig
2024-01-26 13:28 ` [PATCH 08/21] xfs: remove xfile_stat Christoph Hellwig
2024-01-26 13:28 ` [PATCH 09/21] xfs: remove the xfile_pread/pwrite APIs Christoph Hellwig
2024-01-26 16:21 ` Matthew Wilcox
2024-01-26 16:48 ` Darrick J. Wong
2024-01-26 13:28 ` [PATCH 10/21] xfs: don't try to handle non-update pages in xfile_obj_load Christoph Hellwig
2024-01-26 13:28 ` [PATCH 11/21] xfs: shmem_file_setup can't return NULL Christoph Hellwig
2024-01-26 13:28 ` [PATCH 12/21] xfs: don't modify file and inode flags for shmem files Christoph Hellwig
2024-01-26 13:28 ` [PATCH 13/21] xfs: don't allow highmem pages in xfile mappings Christoph Hellwig
2024-01-26 16:26 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 14/21] xfs: use shmem_get_folio in xfile_obj_store Christoph Hellwig
2024-01-26 16:29 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 15/21] xfs: use shmem_get_folio in in xfile_load Christoph Hellwig
2024-01-26 13:28 ` [PATCH 16/21] xfs: improve detection of lost xfile contents Christoph Hellwig
2024-01-26 16:33 ` Matthew Wilcox
2024-01-26 16:50 ` Darrick J. Wong
2024-01-28 16:55 ` Christoph Hellwig
2024-01-28 20:33 ` Matthew Wilcox
2024-01-26 13:28 ` [PATCH 17/21] xfs: add file_{get,put}_folio Christoph Hellwig
2024-01-26 16:40 ` Matthew Wilcox
2024-01-26 16:55 ` Darrick J. Wong
2024-01-27 1:26 ` Kent Overstreet [this message]
2024-01-27 1:32 ` Darrick J. Wong
2024-01-26 13:29 ` [PATCH 18/21] xfs: remove xfarray_sortinfo.page_kaddr Christoph Hellwig
2024-01-26 13:29 ` [PATCH 19/21] xfs: fix a comment in xfarray.c Christoph Hellwig
2024-01-26 13:29 ` [PATCH 20/21] xfs: convert xfarray_pagesort to deal with large folios Christoph Hellwig
2024-01-27 1:09 ` Kent Overstreet
2024-01-26 13:29 ` [PATCH 21/21] xfs: remove xfile_{get,put}_page Christoph Hellwig
2024-01-26 14:15 ` put the xfs xfile abstraction on a diet v2 Matthew Wilcox
2024-01-26 14:18 ` Christoph Hellwig
2024-01-26 16:47 ` Matthew Wilcox
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=zfgublewgj5g6ipf2twkdl4kyvgttrvmigegxthgvc6ghdauwo@fej77ff4mtjs \
--to=kent.overstreet@linux.dev \
--cc=akpm@linux-foundation.org \
--cc=chandan.babu@oracle.com \
--cc=djwong@kernel.org \
--cc=hch@lst.de \
--cc=hughd@google.com \
--cc=linux-mm@kvack.org \
--cc=linux-xfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox