From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 37EBEC678D4 for ; Fri, 3 Mar 2023 13:12:00 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 65A6F6B0072; Fri, 3 Mar 2023 08:11:59 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 60AE86B0073; Fri, 3 Mar 2023 08:11:59 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4D2AA6B0074; Fri, 3 Mar 2023 08:11:59 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 3DCF86B0072 for ; Fri, 3 Mar 2023 08:11:59 -0500 (EST) Received: from smtpin13.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 159921A0B79 for ; Fri, 3 Mar 2023 13:11:59 +0000 (UTC) X-FDA: 80527624758.13.2E93F57 Received: from bedivere.hansenpartnership.com (bedivere.hansenpartnership.com [96.44.175.130]) by imf25.hostedemail.com (Postfix) with ESMTP id 8EF1AA0027 for ; Fri, 3 Mar 2023 13:11:55 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=hansenpartnership.com header.s=20151216 header.b=f1Pdx1vz; dkim=pass header.d=hansenpartnership.com header.s=20151216 header.b=Gr1jV7Au; spf=pass (imf25.hostedemail.com: domain of James.Bottomley@HansenPartnership.com designates 96.44.175.130 as permitted sender) smtp.mailfrom=James.Bottomley@HansenPartnership.com; dmarc=pass (policy=none) header.from=hansenpartnership.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1677849117; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=tKBbQI+l04LtT3WzkLYmEqll7eNWIoBd/kga6UQy+Vo=; b=lUiyQ+T1wOUzmWlz3ACl5zpI8rlR+f2y1E/k3AWWGbs1POB2DfdaG83FJLBb+cJAzXp0Uj qszqCRllN1beAudsOOIdJTImmnTB8D4A8D3QS7Gi7TATXlAfWfoRvEQN/DDVTd2GYP1Wxb DTNJb/ZX2UxCT6CI9hqZ3noyAyPVdsA= ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=pass header.d=hansenpartnership.com header.s=20151216 header.b=f1Pdx1vz; dkim=pass header.d=hansenpartnership.com header.s=20151216 header.b=Gr1jV7Au; spf=pass (imf25.hostedemail.com: domain of James.Bottomley@HansenPartnership.com designates 96.44.175.130 as permitted sender) smtp.mailfrom=James.Bottomley@HansenPartnership.com; dmarc=pass (policy=none) header.from=hansenpartnership.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1677849117; a=rsa-sha256; cv=none; b=HtAYBCgQuYJblzYFUd0gw5Q/7629mlT3QEd7XmbdRSllagqWZNAcOnLJpQ53XXNdU/Rx+j b+gqDWC+I7he4G68kFMAYW4bavF1419fcJlUdYxBVJaOR4/sxaCdAUWznSgMGWORHCYz/E RE4xDX6m+kZa9Cu6/SLKZCUCkoitpvY= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=hansenpartnership.com; s=20151216; t=1677849112; bh=hr2srA7lr1NS/bcOuwoy15lE9j7MbrTWwn/RCZPWv0o=; h=Message-ID:Subject:From:To:Date:In-Reply-To:References:From; b=f1Pdx1vzcijeNa0004rr3e9cC1SjXfOWCFM+NrWJGrr/TWHQ+3B49wbGzwv6Udf40 CxF6io8nWu/84nFNe/89vnDHQreJehCaxJd/gvEzK2WXET7NW/0JH4ZjuSs9eIrzyf aYqH9XtLmM1PUmqrdGYZfaFLzEDHpHFUHYcdGvtc= Received: from localhost (localhost [127.0.0.1]) by bedivere.hansenpartnership.com (Postfix) with ESMTP id EFFB212860A2; Fri, 3 Mar 2023 08:11:52 -0500 (EST) Received: from bedivere.hansenpartnership.com ([127.0.0.1]) by localhost (bedivere.hansenpartnership.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id h_qcRum7Wm9d; Fri, 3 Mar 2023 08:11:52 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=hansenpartnership.com; s=20151216; t=1677849111; bh=hr2srA7lr1NS/bcOuwoy15lE9j7MbrTWwn/RCZPWv0o=; h=Message-ID:Subject:From:To:Date:In-Reply-To:References:From; b=Gr1jV7AuEfHPRgmsMNt1lw07RRz25rhs0sLbhYiOU/KoJypM3unmCLMeCNKkqWgXJ elpVW6j/eU4OARWHw58u709qNvR+D8RPFahxs06foKJ/0HWQENbFBrv7gB20K9vze9 WUj6f27ybv5mwJs+1Z2/LCXn1vHuKWU9VatnZlu8= Received: from lingrow.int.hansenpartnership.com (unknown [IPv6:2601:5c4:4302:c21::a774]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (2048 bits) server-digest SHA256) (Client did not present a certificate) by bedivere.hansenpartnership.com (Postfix) with ESMTPSA id D8DB31285ED5; Fri, 3 Mar 2023 08:11:50 -0500 (EST) Message-ID: Subject: Re: [LSF/MM/BPF TOPIC] Cloud storage optimizations From: James Bottomley To: Matthew Wilcox , Keith Busch Cc: Luis Chamberlain , Theodore Ts'o , lsf-pc@lists.linux-foundation.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org, linux-block@vger.kernel.org Date: Fri, 03 Mar 2023 08:11:47 -0500 In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" User-Agent: Evolution 3.42.4 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 8EF1AA0027 X-Stat-Signature: hef3331skgcyztpsn5xs5mpiforg4eyq X-Rspam-User: X-Rspamd-Server: rspam08 X-HE-Tag: 1677849115-952516 X-HE-Meta: U2FsdGVkX19PI2hZE0kRrR7LpQ89rbMKKlIkhN0dhroXmwKyI8rCIeQy17ZBOu8TSUS71dG7sHRjS25lwSZtUZ+UjuNmchpfdpJkejKNlrd/yxJLunvtG75v5KaiYxxSf9dDv4e2ZDIYiFnrNeVgIKCZ1iACzmiBep5E3125VC5UjZ+BRwJtObwbtHHHaO00QF6ttIeaw/jRMv1f3u/fhq6xXzyEvG5yeL0/B/gJbYPbqOY1kRrXAYbRIcq+h5khdVNvQtnRb7+h0B8cAlbePuQ3U7f8vS7EtMdkHskqDgbKI4Fi4ZtyLlPNmV1y1/wTCxwJNhuW93ZULYgb9gXaeb002qBAehDP+EsncAbjjpAc+v8Noow+HZK1xjzR2Pnfq3QpZPsbPGREZOKrwK+zrnUixpkyM/9LCvB2h+t3XJ/hmTgigzBQiSh4sAVHtZGr5VUUTeVx8XYUqSI/ASNUp1h6qHpjXrkpIunx4eNv5/HkJTv7U0zoMknfx7rFjRj4+2LnD5mRvdZAVs9iOIIdp7OjciZanxLOB4p+eBnNqVydjbDQdDcfLyitMFZhuh90IQYf4ItEoDpm7f9TLkBEi5W3Rr6Pz7iUzy8zB0rOOGIb+QasauuoBba0I7rmxZu4BJuQ9P8KUQUe9yrO6BfdWjSCfvBF5aCbWnwAuPXhGvRTtRFD35GRoTpa/33y4ScjkJz8YoNyN1OOVwoWP/eShi5bywG99x+3PE3zK5V87vY9qDSGY5mLrwLvgbEQwdUTBt3p93wUCxcHP7scDP39RxbQXtF40gfRzhcoTJHGenNIM4/QQHuY4+4vCGsPKkVEwRyDBQLv7CvAkALxpJ2vZqrVGZF55ZFTKyH95vcuy8++nvQEN5UcP3tjiUSSu/zN5d2FKUrvbFnEZg+hX8hNILXw0zni+l3Wvz972IYMhpPqbm4ud4ajYpl+xJJCfA98LGCyjQyZrIKBPMUymNN jYlH07gH Gg7/vkSw+q0JQD4D0+IdoWVjJlA8JsEhez+zO4OGIstTKup1YSmf3U6ey1SODTYcN5UvpQp7jTkH+wv2Svr+tOHfzMYC5EHcAEcmPDSvvvlxptaM941LZZtjXSHfdjuSodat29uu9BqgkKEM9mn0cP+CYesYydnggGTyE39D8AUXfsS58rJ+8Sn9dsdPPhDjRxgXSsie61IyglvKomfsSFxtth/xVv+A++0jANUHxk7eI8MzlzNxl3gja4dT45rCnPQy2IO7YTBYK9SfjbO1kI27k8UWMDVdX3/MJwwGVEjH6Ew4yj/FIO6Jakf4qnXBiBBE0pbLB1hwQS/g= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, 2023-03-03 at 03:49 +0000, Matthew Wilcox wrote: > On Thu, Mar 02, 2023 at 06:58:58PM -0700, Keith Busch wrote: > > That said, I was hoping you were going to suggest supporting 16k > > logical block sizes. Not a problem on some arch's, but still > > problematic when PAGE_SIZE is 4k. :) > > I was hoping Luis was going to propose a session on LBA size > > PAGE_SIZE. Funnily, while the pressure is coming from the storage > vendors, I don't think there's any work to be done in the storage > layers.  It's purely a FS+MM problem. Heh, I can do the fools rush in bit, especially if what we're interested in the minimum it would take to support this ... The FS problem could be solved simply by saying FS block size must equal device block size, then it becomes purely a MM issue. The MM issue could be solved by adding a page order attribute to struct address_space and insisting that pagecache/filemap functions in mm/filemap.c all have to operate on objects that are an integer multiple of the address space order. The base allocator is filemap_alloc_folio, which already has an apparently always zero order parameter (hmmm...) and it always seems to be called from sites that have the address_space, so it could simply be modified to always operate at the address_space order. The above would be a bit suboptimal in that blocks are always mapped to physically contiguous pages, but it should be enough to get the concept working. James