From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id DACD9C41513 for ; Tue, 17 Oct 2023 10:43:31 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5CA358D000D; Tue, 17 Oct 2023 06:43:31 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5A0138D000C; Tue, 17 Oct 2023 06:43:31 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 48F5D8D000D; Tue, 17 Oct 2023 06:43:31 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 3A5978D000C for ; Tue, 17 Oct 2023 06:43:31 -0400 (EDT) Received: from smtpin24.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 108E51CBC38 for ; Tue, 17 Oct 2023 10:43:31 +0000 (UTC) X-FDA: 81354617022.24.0B386BF Received: from mail-yb1-f182.google.com (mail-yb1-f182.google.com [209.85.219.182]) by imf20.hostedemail.com (Postfix) with ESMTP id 32C261C000F for ; Tue, 17 Oct 2023 10:43:28 +0000 (UTC) Authentication-Results: imf20.hostedemail.com; dkim=pass header.d=dneg.com header.s=google header.b=jsZ8KajV; dmarc=pass (policy=none) header.from=dneg.com; spf=pass (imf20.hostedemail.com: domain of daire@dneg.com designates 209.85.219.182 as permitted sender) smtp.mailfrom=daire@dneg.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1697539409; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=OmZ/33TllYLHL47d/dVmhdUXpMsytcSlpt83kTPbFEw=; b=Ht9SAKBP7+K6SkdrijrjofUq8nyMXCU+u1HaBEO1sBuHcgBGSB4HzDIqmm/1V6BFhOqSXN oaOiM9d07drE6nY6nz8GSGafEgwe6sMYOE5iuS9ktweEyEyf/qKy3/xA9dn/HUiQkklfmi UZ3HXhBfF2Jr9jfsL3nj+ZPeSZEnq0k= ARC-Authentication-Results: i=1; imf20.hostedemail.com; dkim=pass header.d=dneg.com header.s=google header.b=jsZ8KajV; dmarc=pass (policy=none) header.from=dneg.com; spf=pass (imf20.hostedemail.com: domain of daire@dneg.com designates 209.85.219.182 as permitted sender) smtp.mailfrom=daire@dneg.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1697539409; a=rsa-sha256; cv=none; b=NFppK7PopuO2bX8oTTcltDMDOJAW5Oiubvx/RuqunxQd1o/uc1je/DBZ8c6tdo6CxH6sfD zsHhMBnZS7AQ+GTvQAWhKhX6fHkvxtfbVOVyZmDuykdjPLUlNMAnPRwJFAFaY1klmG+MNQ Cd0+b38umbZsr7bqU0Kd02jjg695idM= Received: by mail-yb1-f182.google.com with SMTP id 3f1490d57ef6-d9a6b21d1daso6447111276.3 for ; Tue, 17 Oct 2023 03:43:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dneg.com; s=google; t=1697539408; x=1698144208; darn=kvack.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=OmZ/33TllYLHL47d/dVmhdUXpMsytcSlpt83kTPbFEw=; b=jsZ8KajVc/OAhqkRJHsgl7eYAKbRSFdhv6AVZ6T+UtKXb35n4/4Jp1MTNvAj5W1w+y oMhaGtMddE/EhKJNOe9P2F8ZXZ0c8ykp0+kVPzyDykNWP4BD+2V1r9tMatZn3WBPMGWk VBNqQLl3PQOmsZPt3ciQfk0NOU7zgGbSNacKwAQOBHhvPHdt4o6gT+qxMTsxm3p7vjvO 5fhTxW3n1f2nBf3kHlhPH1hsvqec2SChOSWgE4m8tA9LOmU5DWfI3Rnm0AfN3Esj0pFC LaZzgSk6vNFzbIxA8/lLoFii6YOJEkLzC/gJjKm4LVrEk7HygkRtznWo7zhNAWFcvTNn mr3Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697539408; x=1698144208; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=OmZ/33TllYLHL47d/dVmhdUXpMsytcSlpt83kTPbFEw=; b=NXV8Gw9iYZ/ZRYLtx7TPVx1rVMdtekN1/+RtsRbaLaDsOzvWWteN3Q67tXa3/BwdCE Q48qfK4VHwGEI1Yl3ClZ01VIJqANuXEj1oNZAq1/ox1uUJwbIuOHog1zA8Hlkv3oV4UA svCZicglC5adYWaby1438+nqxIomlMzlEDvtGXueup/k0dQP5MWSFI93a16XX9EpXG3f msYGntBPP3oVh1kSFnOCiFGPyMyzjqNh910Wako8FNgHXnfoIDaHshvJ65Ty9MDqkl21 tEG782ZjDCTlxOLxdj800KJ99A6+REaZqFVqLjmNlWZYRRs9109NcDExAlTHWkFlEzAB Gimg== X-Gm-Message-State: AOJu0YyypcRW1Xsbm18z4XVRGANH3ftdpSclBYLwg35aX30TypH8ivdf vwAsgAllFxOvMwVZkkjUy0ENzPzcdRE/jf19eP+nbA== X-Google-Smtp-Source: AGHT+IEguG9VkvSZyN+YQKkbnzU4bPPMH68Gm77P3bS20bpQvkVCehXFFJFu9p/7GSuuBt2Sz4dkmWLIuiXDJ62NRdc= X-Received: by 2002:a25:cd44:0:b0:d9b:6c9d:e6a with SMTP id d65-20020a25cd44000000b00d9b6c9d0e6amr1563929ybf.0.1697539408286; Tue, 17 Oct 2023 03:43:28 -0700 (PDT) MIME-Version: 1.0 References: <20231013155727.2217781-1-dhowells@redhat.com> In-Reply-To: <20231013155727.2217781-1-dhowells@redhat.com> From: Daire Byrne Date: Tue, 17 Oct 2023 11:42:52 +0100 Message-ID: Subject: Re: [RFC PATCH 00/53] netfs, afs, cifs: Delegate high-level I/O to netfslib To: David Howells Cc: Jeff Layton , Steve French , Matthew Wilcox , Marc Dionne , Paulo Alcantara , Ronnie Sahlberg , Shyam Prasad N , Tom Talpey , Dominique Martinet , Ilya Dryomov , Christian Brauner , linux-afs@lists.infradead.org, linux-cifs@vger.kernel.org, linux-nfs@vger.kernel.org, ceph-devel@vger.kernel.org, v9fs@lists.linux.dev, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 32C261C000F X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: q51gjhwzfwpsd3qzmbwzwyktuosm57h7 X-HE-Tag: 1697539408-295292 X-HE-Meta: U2FsdGVkX19KK71v0DMErgXrapZPcCOSKLkhRXTUdRSLijYpAS28nQPIMLN9tJOVpo3UDeOlqU7lWfMA/MlkDkaKN/j0vXT/j+DW6DqrfOqpbz3GBT2ut3V4c26KMDFFshjK5nR+Q7RiZEUZqRwi0+3DyUmeCa4W1wYnQ5M0/roYdU5Z37f93KAFcs9DvgzaBa1IiZUpI1gF6BkY0jq95k94pf5tCHo0dfXBBbdYaZnouyjoGSE7XLnx7uh5x2IT3Jv9ed1z4BX8qDYN9WzZ8wZgj+Dz+4lJfCyj93TZGBf8YTd/+PblLkFKRdlLP4uRXH+8ZTitZ1O7saE9xPw456SuIR1Se68GAhA+1iqUcYg4QJAHMm87vhtkWr2AeL0a6GqfCRgRSB1KR0dbueVTgEMUVJzWHZRNutfUt0e4OZ7tomTDWFX+rl0LvO/UFlubKnxFOr2Zfx8grEHB/uS3SiBs1bTbFTskeZVZ0x08n9yWPWVSP2wRtzUFN0TNNeKgIsnxoQ5TJfusnncFaim3uO+ehOtJKYgHLaqVmktGmYMvW+tpCzbjPu5cK4KjDosA51+4uRCC6reSSj6KiYeY//Y+wNNHwEikJRMVo3+SYabjPH9TKTcb8USS3RqKY8ZuQF2zq9GZ+OjZu28kq1KeXHaeUPsmEfmidf/KKdUFGGgWArvWRH0A8krcRq2RS1IT2JJOOXwoNvHtt5Eh3ezON/q5z2PsSnn5dY6uHEZEWsB6VEXMLXdM+vDqV95hh6DfHOvyFIOcMfhqnLJ4fqKkKvwEyvTlqn/k+1BiYJazLl60JYQzjw3a0miDIbntiapCceBEpHPnWd8UqKy0vaF+PMTsd+byg6zcdxP849nB1iZq485w6LEZqezo+TGvTu+BaAWZo269MwIreZeqnyyNi6C7xPzn16uBEC0q8RJSiOTiv5fNeP3A91PG/ik4BlUeg3AW8QvPi3YPLGJR3c9 2nIpJsj1 n/LKzvBCG3JRgqvF7e9lf/uQc0Ke8kwzA11+CQFu9ku9h5l+oIg1HbZghdN5kkuUyoGatcRr/IjWC294Qi8GC9BfC+n6BrmgI2f6cT8qezC+ojHH0iNrs0TrTUgNriKy9eEpZGOQ1Qc+0mn5i+MYoWmLZePDMsUn8I1e7eVqqYE+xREatsk/uVnVr2wrqE61JPlNb+22Kegovde/jG3077L64XHHNrnf1o0gBY+PPMcla2Yk= X-Bogosity: Ham, tests=bogofilter, spamicity=0.023695, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, 13 Oct 2023 at 16:58, David Howells wrote: > > (2) Use of fscache is not yet tested. I'm not sure whether to allow a > cache to be used with a write-through write. Just adding a quick end user "thumbs up" for this potential feature. We currently use fscache as the backend for "NFS re-export" servers to extend our onprem storage to remote cloud compute (which works great). But batch compute hosts (think VFX render farm) often chunk up stages of work into multiple batch jobs such that they read data, write results and then read the same data on different clients. Having the ability to also cache the recent writes closer to the compute clients (on the re-export server) would open up a lot of new workload possibilities for us. > (5) Write-through caching will generate and dispatch write subrequests as > it gathers enough data to hit wsize and has whole pages that at least > span that size. This needs to be a bit more flexible, allowing for a > filesystem such as CIFS to have a variable wsize. If I understand correctly, this is above and beyond the normal write back cache and is more in tune with the wsize (of NFS, CIFS etc) for each file? Again, our workloads are over longer latencies than are normal (NFS over 200ms!) so this sounds like a nice optimisation when dealing with slow stuttering file writes over high latency. I can definitely volunteer for some of the fscache + NFS testing. Cheers, Daire