From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 893A4D2E9C3 for ; Mon, 11 Nov 2024 09:13:03 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 624E06B0085; Mon, 11 Nov 2024 04:13:02 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 5D4FF6B0088; Mon, 11 Nov 2024 04:13:02 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 49CBE6B0089; Mon, 11 Nov 2024 04:13:02 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 297CF6B0085 for ; Mon, 11 Nov 2024 04:13:02 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id B52FCACC4D for ; Mon, 11 Nov 2024 09:13:01 +0000 (UTC) X-FDA: 82773248628.12.A42F3C5 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf09.hostedemail.com (Postfix) with ESMTP id E78FB140005 for ; Mon, 11 Nov 2024 09:12:31 +0000 (UTC) Authentication-Results: imf09.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=fgPSPhwK; spf=pass (imf09.hostedemail.com: domain of brauner@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=brauner@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1731316292; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=yfSoN4OSqAiMwHrjisFXEEhi83HwUxq1CYnJT/Lwnxk=; b=LbhQ/3agW5M6paHIz4b9MbrmwBU8+I0o3Lt2AAMH891JJlGkT2FOQJUZa1LNoevlvuE4ia J5Y2X/vxQ0vji8ui+JNJ7fSDmikZkva/kD12KcwcD1Izo5W65YR+yt4sZKP4uL76U/Pay/ +uDxNLL8+7Awzl3h4R2wK9tiyHbEe0s= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1731316292; a=rsa-sha256; cv=none; b=SzGdcCcm7qW8Nr77VfTzu2oLciWqM33HBGiStm6JhMLELpPc856uMsZZJqF6GrMLsupH7F fWlpVhYwbjTmTX7Z/QxlNPXe09wMjvgoPjVOq7o2fdwYGzou/yDpmAvFPxrEkC8FqLo2q9 g416w6Nc1KkuBD5N6VW5KYuE1zMpAuc= ARC-Authentication-Results: i=1; imf09.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=fgPSPhwK; spf=pass (imf09.hostedemail.com: domain of brauner@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=brauner@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 73A975C4AE6; Mon, 11 Nov 2024 09:12:14 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 56D85C4CED0; Mon, 11 Nov 2024 09:12:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1731316378; bh=eLegIPzm6kl+o1xbtiBt0w/Vn129KLVaIrdkjfKYWaA=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=fgPSPhwKVCoHhP5ZUhqFPaUA3BckikO442jgj8GZjtPjAiQvZy2Zt8UJaqx4sZ4cn tLQLnuNp8PDWRuevwPEyIHOAmeXYlFpVSIX3s7ozITJY1rKstBsCZlFlksJ0gw6tmS kdvvTwHsIdFewza2NlXVyqYUKM9MykIn/gCPy6V7rfKaE5bePR/WM3+hqBWYTt+baE ElCEQ+0slDPOh3YKguR0LIEL0eNaL2YyYEX/vSMtnmZZUKcDhQynA4VIMn0yTrjVZ3 fE5fwQWPiTHePSimVwb1JplWrql7brpCmIVXRpE7c1XmVUtvAeONSspLa67X4zbXJl sD6sd7jx8WGRQ== From: Christian Brauner To: David Howells Cc: Christian Brauner , Jeff Layton , Dominique Martinet , Marc Dionne , Paulo Alcantara , Shyam Prasad N , Tom Talpey , Eric Van Hensbergen , Ilya Dryomov , netfs@lists.linux.dev, linux-afs@lists.infradead.org, linux-cifs@vger.kernel.org, linux-nfs@vger.kernel.org, ceph-devel@vger.kernel.org, v9fs@lists.linux.dev, linux-erofs@lists.ozlabs.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org, Gao Xiang , Steve French , Matthew Wilcox Subject: Re: [PATCH v4 00/33] netfs: Read performance improvements and "single-blob" support Date: Mon, 11 Nov 2024 10:12:33 +0100 Message-ID: <20241111-kochkunst-kroll-f8386db7f273@brauner> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20241108173236.1382366-1-dhowells@redhat.com> References: <20241108173236.1382366-1-dhowells@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Developer-Signature: v=1; a=openpgp-sha256; l=4915; i=brauner@kernel.org; h=from:subject:message-id; bh=eLegIPzm6kl+o1xbtiBt0w/Vn129KLVaIrdkjfKYWaA=; b=owGbwMvMwCU28Zj0gdSKO4sYT6slMaQbnuoTcJer1I9iZPy/KXnXkR3yzUvPeSUdKhatyKkPP 1/h4qTTUcrCIMbFICumyOLQbhIut5ynYrNRpgbMHFYmkCEMXJwCMJHXyowMJ73NZvvz71XzWu/R kX/O6mpbvrbzAbX0naeF5dI9IzTqGRmeOOw/3D7HYsVKm7tHJ/g+THnPZ3IgVWj+mYxQHlHHyPM MAA== X-Developer-Key: i=brauner@kernel.org; a=openpgp; fpr=4880B8C9BD0E5106FC070F4F7B3C391EFEA93624 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam10 X-Stat-Signature: rwcdi49dp1p6gg6jy6aed1oakajrbx4m X-Rspamd-Queue-Id: E78FB140005 X-Rspam-User: X-HE-Tag: 1731316351-377118 X-HE-Meta: U2FsdGVkX18SOMhTKcRfYgnCDJjtI1uvMcb3+iYtWB0IywVvFvGbmZVo384sLyXZ02sjpSnbSNf2ixhU9MZVYf6mmNzJiH1QoqDrvrOfo0ExdOHLbbdgEUrnECXq+QwRDjqENVAdcYnD/bOU84T79HxqPW93M6x1MINwyWTxPj87K9sCXOoxRJF4MtYzCnnMsAzHevCKcjLFIXls65lUw2SCVfXGmGypmHANgQ4VPnBIllQb9UVw9pOCYciqrqaEm8ZsFjwVUV2Y9JTqxFeIiOCLhyc6iADrXix3vbbIxiA9uLK+3miOPxJvKjt832J5bvutmhmm2lwG3B37VcbvbLlzhVIfrvV8VNOdFWiVMoaolbeYYLOlPciuuO1QNDCJAw/EbW4OYewdR4plk8A6+Iibp7gtoj6Gvb0y3eG1kl36piOo5aJNYjm+rEGvhDRlSLm2SmqN7KvkFhwGsE0CSgSSWhO/z+oOwrA3yc/M1UmYckbmmBo2Wht/VKNBPlfacP2zsnNJpLqo1m8xLLmgJ0B5qH8sbHyfUd4j0/nAhMzSQXmuNyxZtlKqALtkOpyr8G9mQ65qJSozRkNlhjNF0pRHSpmprBVU2pZRWKcAUG6QfDq+iauZXSVBwS+0kTirAk3DKhr8BFZulR7eR0cMcbuT8fS4KT1s9n6UAVXDQKJ5wDtUBczNi7ebFojM+PhAbKOOv5VhBhlLHf98Q1EZn9g92fjDm2eiJhCA+SANMt75u49Dhi3WiRUUK2AHWHww12t3VPLKTjhlT41zQk/yJ6IzVQQF9pYi2J6l9PXkOdPgUiu0XghVDTr3fEtuuqu6GrlUPMJ4e+tnkUzzl7TjeYJXx206hm89kvhlVjpuGj+xrWRih92FJyxjdbQ5MbMSJuQWSQvcpUMH8+y1oYnE55ev5aCDmwQH1merIS5ePpxQ0NiQFcJDdUA5w+jNIzj8GCUu5Cue46xYv2g2rSu 75oUyNtX 8++h4c30kswCdMg2njyYKziAlHJ+bwwhGJTfntV7+JtCPUvtSJLC6iXWD2vowFUTVrFja1z/anKL1vFJnTdVefhdA50tQK72HGRQsYdb0/UWDqE4teyxkrWNXazmLXoSBaW8dyi6a5/+aT3s+QddBMmgLu/hn78yHNAfcftyiaHGPaUtmFjh7ZjrDxjV9t09k9WqLLAbfg6wAnAhvLx+gZgwKuVgAVK7f+PJ0mlfBzoEx81rRd/apk0eGo1fyUL+5IHi0VjtKsOJOc42PUCZT3YNAElqxOdzwTG9sSsp2RlEh0MY= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Fri, 08 Nov 2024 17:32:01 +0000, David Howells wrote: > This set of patches is primarily about two things: improving read > performance and supporting monolithic single-blob objects that have to be > read/written as such (e.g. AFS directory contents). The implementation of > the two parts is interwoven as each makes the other possible. > > READ PERFORMANCE > ================ > > [...] Applied to the vfs-6.14.netfs branch of the vfs/vfs.git tree. Patches in the vfs-6.14.netfs branch should appear in linux-next soon. Please report any outstanding bugs that were missed during review in a new review to the original patch series allowing us to drop it. It's encouraged to provide Acked-bys and Reviewed-bys even though the patch has now been applied. If possible patch trailers will be updated. Note that commit hashes shown below are subject to change due to rebase, trailer updates or similar. If in doubt, please check the listed branch. tree: https://git.kernel.org/pub/scm/linux/kernel/git/vfs/vfs.git branch: vfs-6.14.netfs [01/33] kheaders: Ignore silly-rename files https://git.kernel.org/vfs/vfs/c/3033d243b97c [02/33] netfs: Remove call to folio_index() https://git.kernel.org/vfs/vfs/c/f709cec9dc52 [03/33] netfs: Fix a few minor bugs in netfs_page_mkwrite() https://git.kernel.org/vfs/vfs/c/07a80742a52b [04/33] netfs: Remove unnecessary references to pages https://git.kernel.org/vfs/vfs/c/53f5f31a1549 [05/33] netfs: Use a folio_queue allocation and free functions https://git.kernel.org/vfs/vfs/c/1d044b4cb3e9 [06/33] netfs: Add a tracepoint to log the lifespan of folio_queue structs https://git.kernel.org/vfs/vfs/c/7583f643f714 [07/33] netfs: Abstract out a rolling folio buffer implementation https://git.kernel.org/vfs/vfs/c/2029a747a14d [08/33] netfs: Make netfs_advance_write() return size_t https://git.kernel.org/vfs/vfs/c/34961bbe07a5 [09/33] netfs: Split retry code out of fs/netfs/write_collect.c https://git.kernel.org/vfs/vfs/c/8816207a3e26 [10/33] netfs: Drop the error arg from netfs_read_subreq_terminated() https://git.kernel.org/vfs/vfs/c/44c5114bb155 [11/33] netfs: Drop the was_async arg from netfs_read_subreq_terminated() https://git.kernel.org/vfs/vfs/c/3c8a83f74e0e [12/33] netfs: Don't use bh spinlock https://git.kernel.org/vfs/vfs/c/5c962f9982cd [13/33] afs: Don't use mutex for I/O operation lock https://git.kernel.org/vfs/vfs/c/244059f6472c [14/33] afs: Fix EEXIST error returned from afs_rmdir() to be ENOTEMPTY https://git.kernel.org/vfs/vfs/c/10e890507ed5 [15/33] afs: Fix directory format encoding struct https://git.kernel.org/vfs/vfs/c/c8f34615191c [16/33] netfs: Remove some extraneous directory invalidations https://git.kernel.org/vfs/vfs/c/ab143ef48b3b [17/33] cachefiles: Add some subrequest tracepoints https://git.kernel.org/vfs/vfs/c/46599823a281 [18/33] cachefiles: Add auxiliary data trace https://git.kernel.org/vfs/vfs/c/499c9d489d7b [19/33] afs: Add more tracepoints to do with tracking validity https://git.kernel.org/vfs/vfs/c/606d920396fd [20/33] netfs: Add functions to build/clean a buffer in a folio_queue https://git.kernel.org/vfs/vfs/c/823f8d570db5 [21/33] netfs: Add support for caching single monolithic objects such as AFS dirs https://git.kernel.org/vfs/vfs/c/5ae8e69c119a [22/33] afs: Make afs_init_request() get a key if not given a file https://git.kernel.org/vfs/vfs/c/bfeb953ddf0b [23/33] afs: Use netfslib for directories https://git.kernel.org/vfs/vfs/c/2b6bae4ca558 [24/33] afs: Use netfslib for symlinks, allowing them to be cached https://git.kernel.org/vfs/vfs/c/a16c68c66f52 [25/33] afs: Eliminate afs_read https://git.kernel.org/vfs/vfs/c/b84e275b6da2 [26/33] afs: Fix cleanup of immediately failed async calls https://git.kernel.org/vfs/vfs/c/355d07737082 [27/33] afs: Make {Y,}FS.FetchData an asynchronous operation https://git.kernel.org/vfs/vfs/c/e31fb01515da [28/33] netfs: Change the read result collector to only use one work item https://git.kernel.org/vfs/vfs/c/1bd9011ee163 [29/33] afs: Make afs_mkdir() locally initialise a new directory's content https://git.kernel.org/vfs/vfs/c/4e93a341aec1 [30/33] afs: Use the contained hashtable to search a directory https://git.kernel.org/vfs/vfs/c/08890740b1d7 [31/33] afs: Locally initialise the contents of a new symlink on creation https://git.kernel.org/vfs/vfs/c/d4f4a6bde676 [32/33] afs: Add a tracepoint for afs_read_receive() https://git.kernel.org/vfs/vfs/c/f06ba511d8d5 [33/33] netfs: Report on NULL folioq in netfs_writeback_unlock_folios() https://git.kernel.org/vfs/vfs/c/19375843912f