From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 815F2C369C5 for ; Wed, 16 Apr 2025 19:28:03 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0C84728013D; Wed, 16 Apr 2025 15:28:02 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 077F228013B; Wed, 16 Apr 2025 15:28:02 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E5A7828013D; Wed, 16 Apr 2025 15:28:01 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id C221C28013B for ; Wed, 16 Apr 2025 15:28:01 -0400 (EDT) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 0D65ABB611 for ; Wed, 16 Apr 2025 19:28:02 +0000 (UTC) X-FDA: 83340892404.10.7E2FE96 Received: from sea.source.kernel.org (sea.source.kernel.org [172.234.252.31]) by imf01.hostedemail.com (Postfix) with ESMTP id 35F2A4000D for ; Wed, 16 Apr 2025 19:28:00 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=Tp4SGGLQ; dmarc=pass (policy=quarantine) header.from=kernel.org; spf=pass (imf01.hostedemail.com: domain of mcgrof@kernel.org designates 172.234.252.31 as permitted sender) smtp.mailfrom=mcgrof@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1744831680; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=rJAPvzJXhMpsf26EMLoh30IcB/NGOADx08q38L8qtek=; b=w/RlxzfXjigrCtwDuIR+362ShG3GUnfEEI2z/emGpIDsQPZWzUIAu2iFf7bhkoahvSg12m LM0ZSFh3fi9rvC49Y4g/9zZEUqgZ68OvQ8IF4w0aIDFTRzB/nRdUxumpWHuu1dQxOBmVDT hge3/rPrvhiLNq6e7XuTzoa/QH7q8k8= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=Tp4SGGLQ; dmarc=pass (policy=quarantine) header.from=kernel.org; spf=pass (imf01.hostedemail.com: domain of mcgrof@kernel.org designates 172.234.252.31 as permitted sender) smtp.mailfrom=mcgrof@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1744831680; a=rsa-sha256; cv=none; b=gbpHjXk3PVdUv/1Ds3XEw7w07oNGaBa6sX484SK75OQqji4tGWLFcqs8N6oMKqAzfGVNPw k0XnQvQOBKLX5Uq5AH3UrHCpHY7Ye13YMjLuzfzdlv2ImdzXwTi3/Hn8hPgrurRT54Foxa AJpLVXKm5SjrHI649waLdr067Pr7788= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by sea.source.kernel.org (Postfix) with ESMTP id DC5EB49EF7; Wed, 16 Apr 2025 19:27:57 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 839D2C4CEE2; Wed, 16 Apr 2025 19:27:58 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1744831678; bh=XH5BFbpOH07XYn9dfTAjIgoCoLGv9FMrkKS2XgAYvoo=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=Tp4SGGLQREAiPkkEKFVxZd1k/XeW6At6uioB//5nPm80VYSQ7o7FZW0AQQ+QNCKJA 2AGPDyqUqPND8kRXWRweTxTPZC14Keela2Sql68pb+J5oKBWSprznM1svUoiv178ew sSJazYli091wwKZeJYLoINkX5IfeCaMWrZpLpCD0G/nAeBIzx78inZzCUaYFTQ0WNl oDOALCoyICdKuwjm2+51JAllSU4wDndt+UFPE4kHnNpdSN/hUUNBQEcx8zJlJPDYsC sMVBDZJlDUAwJbuPoRyfEfyO1F+kKptiWVIYdk7CAkNlA/yLWGenjdLvJxhhm4phEp LNm174QjbkWvQ== Date: Wed, 16 Apr 2025 12:27:57 -0700 From: Luis Chamberlain To: Davidlohr Bueso , Linus Torvalds Cc: jack@suse.cz, tytso@mit.edu, adilger.kernel@dilger.ca, brauner@kernel.org, willy@infradead.org, hare@suse.de, djwong@kernel.org, linux-ext4@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-mm@kvack.org Subject: Re: [PATCH -next 0/7] fs/buffer: split pagecache lookups into atomic or blocking Message-ID: References: <20250415231635.83960-1-dave@stgolabs.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20250415231635.83960-1-dave@stgolabs.net> X-Stat-Signature: 9mgdnj6uh3px4tnw4b43uucptemrdg8o X-Rspamd-Queue-Id: 35F2A4000D X-Rspam-User: X-Rspamd-Server: rspam05 X-HE-Tag: 1744831680-531396 X-HE-Meta: U2FsdGVkX18tNPV70S+V2I+9VxKaCu8XcQFupyFxKEP90DPTwfVPRXQKIBspxM839cGmsmhAplvuPm5l7KLd1Y6UJf1aoQeWF6zcUywdy5A2rWN2X7DvX85yCBJtWwyMGw9NFExGONKZGDuVbLi5Yw3C9Ullyfv6ALAjpIcRe0RzZ6OgKEI2CoSaRZxQfkeRtmcbIiPwN51412RtjLF7nhn3oNh7ACDt6V6+uKAOxjQE2L1tZCkYLU1bADiNy3TYKSlCMKNmDfYhnGMllEboXDq26UtuIlwXBX+D32qNiy3y11fStSNNI9DHAfWzvZTCa9EgoSFGR2/+2iVL08KyAyFxbRqbLkTcWKDBd0hvHVkDAp2XRxAiOnQ0gxu3j5dorEPG3B3bkCpvcIJHC7u8KEcXCBmntr9fTjQF9RiWyidG2AVpdouTdyrU9dpnufaXO8kXq1ulIDyJ5G2Izv0HA3zybES7saAIYvIDTxKblux52A7hnNl+Ta+rMVKhji5axQTQ4YWavNInz347Pbge/NRPZ8Xs/6RzChWdYOJL74Y2Se3NXLJT0OC5XWcXVIuQpoMa/vC+kE4uYIQEk288AZpazwjLj7PD6EB9PSOB9OS+TgxsrKhcRkYlQ47opi5akcBxPmdstvoVdlTQIuizBuG4iV+q2exTSs6S+Eeo6huCviZ6P4rKeHZZiMseCz1GiGxK3/00qhhQdkc4vvQ5s4u7DtW4a0TftZUNgNfhiJUUVnuuCY7MqmVcGGsXpyjaa5qf8DGwMC+J7OPzVZdhzt7RX5b2S0GF+0+nIlFTTcCQil77iDhoJOrfHxl7l5K5Z2Fg+EE34a/YUy+SeEHtfVhtOSOQkPnpC1pyKflVcNONAZEPFeZQRxLUQJgW2zbYpEFCYgypvlBF4mGQhnkIlR4ZPFlQuuq6Z6jURZ0pNfnTlnlXPYUTI0uWIWyY1b5aMmW1GS25a+tAh3/D7ze SG/BJ/pI egULQ/jVKnbSGC9FtYbGllM2ZIn9BwECzsVT99pcQa4/8qsranBNFiN63wxC/UeMMFIv+6zPedKRTTb7Uki4QnnXPrP+tmsYF0PlyB2PJkPFLaKVyBeaQcoUVt4lFncsyM/96dUZqvNreYXHhfPOiQmKUa1kJAtZXXSydeFtAXcat1CrxhkMTM+LHR4/5FWHRwTk7FjgVY/kYGD+w3hnice7yKszsisveiTrCx6de+IttAd8uvOwOtHyWAGcjOp66x6O4qgF4fuGdJjs6O9okZr62HJACq+LhXzFgiqfxaIM7xMY= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Tue, Apr 15, 2025 at 04:16:28PM -0700, Davidlohr Bueso wrote: > Hello, > > This is a respin of the series[0] to address the sleep in atomic scenarios for > noref migration with large folios, introduced in: > > 3c20917120ce61 ("block/bdev: enable large folio support for large logical block sizes") > > The main difference is that it removes the first patch and moves the fix (reducing > the i_private_lock critical region in the migration path) to the final patch, which > also introduces the new BH_Migrate flag. It also simplifies the locking scheme in > patch 1 to avoid folio trylocking in the atomic lookup cases. So essentially blocking > users will take the folio lock and hence wait for migration, and otherwise nonblocking > callers will bail the lookup if a noref migration is on-going. Blocking callers > will also benefit from potential performance gains by reducing contention on the > spinlock for bdev mappings. > > It is noteworthy that this series is probably too big for Linus' tree, so there are > two options: > > 1. Revert 3c20917120ce61, add this series + 3c20917120ce61 for next. Or, Reverting due to a fix series is odd, I'd advocate this series as a set of fixes to Linus' tree because clearly folio migration was not complete for buffer_migrate_folio_norefs() and this is part of the loose bits to help it for large folios. This issue was just hard to reproduce. The enabler of large folios on the block device cache is actually commit 47dd67532303 ("block/bdev: lift block size restrictions to 64k") which goes later after 3c20917120ce61. Jan Kara, since you've already added your Reviewed-by for all patches do you have any preference how this trickles to Linus? > 2. Cherry pick patch 7 as a fix for Linus' tree, and leave the rest for next. > But that could break lookup callers that have been deemed unfit to bail. > > Patch 1: carves a path for callers that can block to take the folio lock. > Patch 2: adds sleeping flavors to pagecache lookups, no users. > Patches 3-6: converts to the new call, where possible. > Patch 7: does the actual sleep in atomic fix. > > Thanks! kdevops has tested this patch series and compared it to the baseline [0] and has found no regressions on ext4. Tested-by: kdevops@lists.linux.dev Detailed test results below: Comparing commits: Baseline: a74831cc4300 | linux-ext4-kpd: Linux 6.15-rc2 Test: 6b337686249b | 6.15-rc2 + these patches Baseline Kernel:6.15.0-rc2-g8ffd015db85f Test Kernel: 6.15.0-rc2-00006-g89e084d709fc Verbose Test Results Comparison: ================================================================================ Profile: ext4_1k | BASELINE | TEST -------------------|--------------|-------------- ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/082 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/235 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_2k | BASELINE | TEST -------------------|--------------|-------------- ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/082 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/235 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_4k | BASELINE | TEST -------------------|--------------|-------------- ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/082 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/235 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_advanced_features | BASELINE | TEST -------------------|--------------|-------------- ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/082 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/235 | [fail] | [fail] generic/270 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/477 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_bigalloc1024k_4k | BASELINE | TEST -------------------|--------------|-------------- ext4/033 | [fail] | [fail] ext4/034 | [fail] | [fail] ext4/045 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/075 | [fail] | [fail] generic/082 | [fail] | [fail] generic/091 | [fail] | [fail] generic/112 | [fail] | [fail] generic/127 | [fail] | [fail] generic/219 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/234 | [fail] | [fail] generic/235 | [fail] | [fail] generic/251 | [fail] | [fail] generic/263 | [fail] | [fail] generic/280 | [fail] | [fail] generic/365 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/435 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/614 | [fail] | [fail] generic/629 | [fail] | [fail] generic/634 | [fail] | [fail] generic/635 | [fail] | [fail] generic/643 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/698 | [fail] | [fail] generic/732 | [fail] | [fail] generic/738 | [fail] | [fail] generic/741 | [fail] | [fail] generic/754 | [fail] | [fail] Profile: ext4_bigalloc16k_4k | BASELINE | TEST -------------------|--------------|-------------- ext4/033 | [fail] | [fail] ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/075 | [fail] | [fail] generic/082 | [fail] | [fail] generic/091 | [fail] | [fail] generic/112 | [fail] | [fail] generic/127 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/234 | [fail] | [fail] generic/235 | [fail] | [fail] generic/263 | [fail] | [fail] generic/280 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_bigalloc2048k_4k | BASELINE | TEST -------------------|--------------|-------------- ext4/033 | [fail] | [fail] ext4/034 | [fail] | [fail] ext4/045 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/075 | [fail] | [fail] generic/082 | [fail] | [fail] generic/091 | [fail] | [fail] generic/112 | [fail] | [fail] generic/127 | [fail] | [fail] generic/219 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/234 | [fail] | [fail] generic/235 | [fail] | [fail] generic/251 | [fail] | [fail] generic/263 | [fail] | [fail] generic/280 | [fail] | [fail] generic/365 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/435 | [fail] | [fail] generic/471 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/614 | [fail] | [fail] generic/629 | [fail] | [fail] generic/634 | [fail] | [fail] generic/635 | [fail] | [fail] generic/643 | [fail] | [fail] generic/645 | [fail] | [fail] generic/676 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/698 | [fail] | [fail] generic/732 | [fail] | [fail] generic/736 | [fail] | [fail] generic/738 | [fail] | [fail] generic/741 | [fail] | [fail] generic/754 | [fail] | [fail] Profile: ext4_bigalloc32k_4k | BASELINE | TEST -------------------|--------------|-------------- ext4/033 | [fail] | [fail] ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/075 | [fail] | [fail] generic/082 | [fail] | [fail] generic/091 | [fail] | [fail] generic/112 | [fail] | [fail] generic/127 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/234 | [fail] | [fail] generic/235 | [fail] | [fail] generic/263 | [fail] | [fail] generic/280 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_bigalloc64k_4k | BASELINE | TEST -------------------|--------------|-------------- ext4/033 | [fail] | [fail] ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/075 | [fail] | [fail] generic/082 | [fail] | [fail] generic/091 | [fail] | [fail] generic/112 | [fail] | [fail] generic/127 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/234 | [fail] | [fail] generic/235 | [fail] | [fail] generic/263 | [fail] | [fail] generic/280 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Profile: ext4_defaults | BASELINE | TEST -------------------|--------------|-------------- ext4/034 | [fail] | [fail] ext4/055 | [fail] | [fail] generic/082 | [fail] | [fail] generic/219 | [fail] | [fail] generic/223 | [fail] | [fail] generic/230 | [fail] | [fail] generic/231 | [fail] | [fail] generic/232 | [fail] | [fail] generic/233 | [fail] | [fail] generic/235 | [fail] | [fail] generic/270 | [fail] | [fail] generic/381 | [fail] | [fail] generic/382 | [fail] | [fail] generic/566 | [fail] | [fail] generic/587 | [fail] | [fail] generic/600 | [fail] | [fail] generic/601 | [fail] | [fail] generic/681 | [fail] | [fail] generic/682 | [fail] | [fail] generic/741 | [fail] | [fail] Summary: - Total regressions: 0 - Total fixes: 0 - Unchanged failures: 261 [0] https://lore.kernel.org/all/Z__vQcCF9xovbwtT@bombadil.infradead.org/ Luis