From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 308A9CDB47E for ; Wed, 18 Oct 2023 15:04:16 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8E34E80016; Wed, 18 Oct 2023 11:04:15 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 892968D0016; Wed, 18 Oct 2023 11:04:15 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 759F580016; Wed, 18 Oct 2023 11:04:15 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 641C88D0016 for ; Wed, 18 Oct 2023 11:04:15 -0400 (EDT) Received: from smtpin21.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id D8AAD80301 for ; Wed, 18 Oct 2023 15:04:14 +0000 (UTC) X-FDA: 81358902828.21.22DB390 Received: from sin.source.kernel.org (sin.source.kernel.org [145.40.73.55]) by imf15.hostedemail.com (Postfix) with ESMTP id B6AD0A0163 for ; Wed, 18 Oct 2023 15:03:17 +0000 (UTC) Authentication-Results: imf15.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=Gn2cvizO; spf=pass (imf15.hostedemail.com: domain of jlayton@kernel.org designates 145.40.73.55 as permitted sender) smtp.mailfrom=jlayton@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1697641399; a=rsa-sha256; cv=none; b=pdfl9FGbSC5FpW+uaEHe6vOe21bAsz3cD/Fz9UdoWmtuEnD99JucOoptMISIjwkm/YRjmP KbXlWw4AqKspd5cDOV9Mt4kASXb9IdErWsg0xkgDXUAMgZ/7H36zXpwP51CPpPYGhKrGzr mzQ2aXKSbqLDUIqcFxeZP5LfNxXkFww= ARC-Authentication-Results: i=1; imf15.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=Gn2cvizO; spf=pass (imf15.hostedemail.com: domain of jlayton@kernel.org designates 145.40.73.55 as permitted sender) smtp.mailfrom=jlayton@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1697641399; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=g+mMZRBGExJ0az10I5PAIf8yvOhHM9lMpbUSG2nLuRg=; b=EjRdJjz4v0Td1GxjdHXVAKQIpYX7qZSavDtP4M0p/56IkAkC+4AA+s6b6CfqLE7gfck2i7 y3F/ayCRMJCeZ8U7bOXq7ZyoVZtblNv2DNEQiU8GRVPZxG6TFnKE60FdopLOOKh4nI4bVC 6Q5KO+YGRYd8yacO7stjselIIcy9578= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by sin.source.kernel.org (Postfix) with ESMTP id 51C8ECE24F4; Wed, 18 Oct 2023 15:03:14 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id CF3E9C433C8; Wed, 18 Oct 2023 15:03:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1697641393; bh=L6D+qpbBdCzUDrl/li04wVioUZCLruBmB/YXF1xf4Bs=; h=Subject:From:To:Cc:Date:In-Reply-To:References:From; b=Gn2cvizOXkUy01k71YGxTE7X4z6vLqaoJLFafo+1V2D8V7Wv88ZBfmZ6d50ZFxvKj r0STRxGjErKUq13H3Iv7mn7AvIVCLxpKl0n0AqJx/zBkuo7ZkXLhcheBVnAbwngAJy S2skRkZqL4VlJYnoY86FUfOK7xrHRmF0ZzWNiFTOC5AyErC5YFeuU702fAYEtK/kQ0 aIQ4dUnbHPpyCEC4k4S/zZbe8fb2opZ517pamFcrGwYG5OKsJ8cUyxGf+7h0XtSe7s mTD2R7Bi85VJqLSadyBjO5Aq+0cQCsfNSkx/qUgSy3TUsIJ33tfm5uq6iku67rtVOB 05ypzoiMkKRgg== Message-ID: <9d2fc137b4295058ac3f88f1cca7a54bc67f01fd.camel@kernel.org> Subject: Re: [RFC PATCH 12/53] netfs: Provide tools to create a buffer in an xarray From: Jeff Layton To: David Howells , Steve French Cc: Matthew Wilcox , Marc Dionne , Paulo Alcantara , Shyam Prasad N , Tom Talpey , Dominique Martinet , Ilya Dryomov , Christian Brauner , linux-afs@lists.infradead.org, linux-cifs@vger.kernel.org, linux-nfs@vger.kernel.org, ceph-devel@vger.kernel.org, v9fs@lists.linux.dev, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org, linux-cachefs@redhat.com Date: Wed, 18 Oct 2023 11:03:10 -0400 In-Reply-To: <20231013160423.2218093-13-dhowells@redhat.com> References: <20231013160423.2218093-1-dhowells@redhat.com> <20231013160423.2218093-13-dhowells@redhat.com> Content-Type: text/plain; charset="ISO-8859-15" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.48.4 (3.48.4-1.fc38) MIME-Version: 1.0 X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: B6AD0A0163 X-Stat-Signature: qbe4pw1djqw4s9nhfge53nm56hsruwch X-Rspam-User: X-HE-Tag: 1697641397-359728 X-HE-Meta: U2FsdGVkX18A2FfDytLy1DRg1obt01qnrpdOtQGVqateqLt+rH4cef0SjosWggipYubUxiQMJGItqf767oYJZ42C3hoVnrzrmPk3IYKUBXIZ2o8FLL0qTYd/hbF+gUSAAS+uSPdfYWxALCyfjAzTVnkptsxMwN1Y3XPWbyb5AYRTriY6Y9PQ/IYKAF1DpnYqvn37fxJPzx+Dpbh57zI1rgDz3r2WI9KsGSWVeJqtGCi2SCCpiCzJ4XZ7OziN7W6PP+Xp13RYGfCWvbf1oI5yXI6kQDFiMa4nXLWJyGggy9wNQQOK1Kre9qsciGbO6UUMA4DEjJ7K/HuSxM0XK2dSWu/jhfcCACikUyRYLcJOTvy+64lVj5I8foH01d9MjQcCMHmMY7YjAZG2GIRwiZMo1WMIaFZmVaX2ffSWxUHLtT8rUyZUkdZq/91Hcj0RQQ9B33CRqUL/7sRNdelErfdpdZFQ225uG1xh8schEVtvDHJrGNhlJiIc+gyOBsBimyQZ09pj4Sct4arsCzW1iPXulG9aGnjqYWsjAw7zlnc7a7mWzDZTt2igxkhDwsJEGJ4k3Sbqc3LUuKIOQ6i+oxFf8YcZdvdPGRlHbQ/5EkY3EpVcxZm+Y9q0T6RPD4i732T75HfCF8u8hgv8mtq3DQrsJHz3bmr/plRE9t401SSYT6Ta4GxgYD5PmWtwDcThEjR/twMqcVHHzgOrynNKWgc7pLII6LoHkhXDUhhW87azlSSxKje6koUQNIdd/WiavFmNmzDdPKiAh4cza3+4pswZwXYi5W8jMdctIWNB0hvUZZnPNBwk1A2pk5uSN6DcKUngdx+VsJtLARwGyU2Dav/3+rozsGTwacex+FLJ01xJd2WYXBjKMHSiSn1wWG7/FwTAgwBKCjBVNqqr1FsKEGm1VLdFOKowDniiGebo9zxvhMQj90Q0AQ2JiaR0oYuz/yN84VZbgseWwg8bv9NvNV3 +O0VqSgL yKsqG4N/Z4u+bZ7Sci6xcXl440aKKRcGIltLlEouPMieP6vkofr17jx+meGDevqVSIdR/a4Ffe5ovdO9d0aoAoWOuS2qSBsKi+eBc1+5QIo9RuCiV6K5bN/2FH4Roc1SQg9u2DWg1xQb94xtfdKFJy3uhf/YhaYHf1dzaU2llNqXFNtImbZcc5R2CS6D+SfLzs0bU5gPi2HGtvd7X/GgHZ648o8AT4bu+vKSIn9jG+/Q1JZCb3PkF8dhDvW+l/NGwSTVAenEldq/r6JqrR5WFNoUwzGerJxqABZ9KCVx5WSIVNm5krNvjZ+HtiEcYvSKa4XHwAaaEYqWDqIHdBTOM+0gP7lyebqlkuGzB7Pay7vA2KW+DJRehRXYrguMIIi5W/Ibc7oHRuL2bOAji2Dzd2qZosQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, 2023-10-13 at 17:03 +0100, David Howells wrote: > Provide tools to create a buffer in an xarray, with a function to add > new folios with a mark. This will be used to create bounce buffer and ca= n be > used more easily to create a list of folios the span of which would requi= re > more than a page's worth of bio_vec structs. >=20 > Signed-off-by: David Howells > cc: Jeff Layton > cc: linux-cachefs@redhat.com > cc: linux-fsdevel@vger.kernel.org > cc: linux-mm@kvack.org > --- > fs/netfs/internal.h | 16 +++++ > fs/netfs/misc.c | 140 ++++++++++++++++++++++++++++++++++++++++++ > include/linux/netfs.h | 4 ++ > 3 files changed, 160 insertions(+) >=20 > diff --git a/fs/netfs/internal.h b/fs/netfs/internal.h > index 1f067aa96c50..00e01278316f 100644 > --- a/fs/netfs/internal.h > +++ b/fs/netfs/internal.h > @@ -52,6 +52,22 @@ static inline void netfs_proc_add_rreq(struct netfs_io= _request *rreq) {} > static inline void netfs_proc_del_rreq(struct netfs_io_request *rreq) {} > #endif > =20 > +/* > + * misc.c > + */ > +int netfs_xa_store_and_mark(struct xarray *xa, unsigned long index, > + struct folio *folio, bool put_mark, > + bool pagecache_mark, gfp_t gfp_mask); > +int netfs_add_folios_to_buffer(struct xarray *buffer, > + struct address_space *mapping, > + pgoff_t index, pgoff_t to, gfp_t gfp_mask); > +int netfs_set_up_buffer(struct xarray *buffer, > + struct address_space *mapping, > + struct readahead_control *ractl, > + struct folio *keep, > + pgoff_t have_index, unsigned int have_folios); > +void netfs_clear_buffer(struct xarray *buffer); > + > /* > * objects.c > */ > diff --git a/fs/netfs/misc.c b/fs/netfs/misc.c > index c3baf2b247d9..c70f856f3129 100644 > --- a/fs/netfs/misc.c > +++ b/fs/netfs/misc.c > @@ -8,6 +8,146 @@ > #include > #include "internal.h" > =20 > +/* > + * Attach a folio to the buffer and maybe set marks on it to say that we= need > + * to put the folio later and twiddle the pagecache flags. > + */ > +int netfs_xa_store_and_mark(struct xarray *xa, unsigned long index, > + struct folio *folio, bool put_mark, > + bool pagecache_mark, gfp_t gfp_mask) > +{ > + XA_STATE_ORDER(xas, xa, index, folio_order(folio)); > + > +retry: > + xas_lock(&xas); > + for (;;) { > + xas_store(&xas, folio); > + if (!xas_error(&xas)) > + break; > + xas_unlock(&xas); > + if (!xas_nomem(&xas, gfp_mask)) > + return xas_error(&xas); > + goto retry; > + } > + > + if (put_mark) > + xas_set_mark(&xas, NETFS_BUF_PUT_MARK); > + if (pagecache_mark) > + xas_set_mark(&xas, NETFS_BUF_PAGECACHE_MARK); > + xas_unlock(&xas); > + return xas_error(&xas); > +} > + > +/* > + * Create the specified range of folios in the buffer attached to the re= ad > + * request. The folios are marked with NETFS_BUF_PUT_MARK so that we kn= ow that > + * these need freeing later. > + */ Some kerneldoc comments on these new helpers would be nice. I assume that "index" and "to" are "start" and "end" for this, but it'd be nice to make that explicit. > +int netfs_add_folios_to_buffer(struct xarray *buffer, > + struct address_space *mapping, > + pgoff_t index, pgoff_t to, gfp_t gfp_mask) > +{ > + struct folio *folio; > + int ret; > + > + if (to + 1 =3D=3D index) /* Page range is inclusive */ > + return 0; > + > + do { > + /* TODO: Figure out what order folio can be allocated here */ > + folio =3D filemap_alloc_folio(readahead_gfp_mask(mapping), 0); > + if (!folio) > + return -ENOMEM; > + folio->index =3D index; > + ret =3D netfs_xa_store_and_mark(buffer, index, folio, > + true, false, gfp_mask); > + if (ret < 0) { > + folio_put(folio); > + return ret; > + } > + > + index +=3D folio_nr_pages(folio); > + } while (index <=3D to && index !=3D 0); > + > + return 0; > +} > + > +/* > + * Set up a buffer into which to data will be read or decrypted/decompre= ssed. > + * The folios to be read into are attached to this buffer and the gaps f= illed > + * in to form a continuous region. > + */ > +int netfs_set_up_buffer(struct xarray *buffer, > + struct address_space *mapping, > + struct readahead_control *ractl, > + struct folio *keep, > + pgoff_t have_index, unsigned int have_folios) > +{ > + struct folio *folio; > + gfp_t gfp_mask =3D readahead_gfp_mask(mapping); > + unsigned int want_folios =3D have_folios; > + pgoff_t want_index =3D have_index; > + int ret; > + > + ret =3D netfs_add_folios_to_buffer(buffer, mapping, want_index, > + have_index - 1, gfp_mask); > + if (ret < 0) > + return ret; > + have_folios +=3D have_index - want_index; > + > + ret =3D netfs_add_folios_to_buffer(buffer, mapping, > + have_index + have_folios, > + want_index + want_folios - 1, > + gfp_mask); I don't get it. Why are you calling netfs_add_folios_to_buffer twice here? Why not just make one call? Either way, a comment here explaining that would also be nice. > + if (ret < 0) > + return ret; > + > + /* Transfer the folios proposed by the VM into the buffer and take refs > + * on them. The locks will be dropped in netfs_rreq_unlock(). > + */ > + if (ractl) { > + while ((folio =3D readahead_folio(ractl))) { > + folio_get(folio); > + if (folio =3D=3D keep) > + folio_get(folio); > + ret =3D netfs_xa_store_and_mark(buffer, folio->index, folio, > + true, true, gfp_mask); > + if (ret < 0) { > + if (folio !=3D keep) > + folio_unlock(folio); > + folio_put(folio); > + return ret; > + } > + } > + } else { > + folio_get(keep); > + ret =3D netfs_xa_store_and_mark(buffer, keep->index, keep, > + true, true, gfp_mask); > + if (ret < 0) { > + folio_put(keep); > + return ret; > + } > + } > + return 0; > +} > + > +/* > + * Clear an xarray buffer, putting a ref on the folios that have > + * NETFS_BUF_PUT_MARK set. > + */ > +void netfs_clear_buffer(struct xarray *buffer) > +{ > + struct folio *folio; > + XA_STATE(xas, buffer, 0); > + > + rcu_read_lock(); > + xas_for_each_marked(&xas, folio, ULONG_MAX, NETFS_BUF_PUT_MARK) { > + folio_put(folio); > + } > + rcu_read_unlock(); > + xa_destroy(buffer); > +} > + > /** > * netfs_invalidate_folio - Invalidate or partially invalidate a folio > * @folio: Folio proposed for release > diff --git a/include/linux/netfs.h b/include/linux/netfs.h > index 66479a61ad00..e8d702ac6968 100644 > --- a/include/linux/netfs.h > +++ b/include/linux/netfs.h > @@ -109,6 +109,10 @@ static inline int wait_on_page_fscache_killable(stru= ct page *page) > return folio_wait_private_2_killable(page_folio(page)); > } > =20 > +/* Marks used on xarray-based buffers */ > +#define NETFS_BUF_PUT_MARK XA_MARK_0 /* - Page needs putting */ > +#define NETFS_BUF_PAGECACHE_MARK XA_MARK_1 /* - Page needs wb/dirty flag= wrangling */ > + > enum netfs_io_source { > NETFS_FILL_WITH_ZEROES, > NETFS_DOWNLOAD_FROM_SERVER, >=20 --=20 Jeff Layton