From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 4D7FAC369DC for ; Tue, 29 Apr 2025 12:30:01 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4BBBD6B0008; Tue, 29 Apr 2025 08:30:00 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 4469D6B000A; Tue, 29 Apr 2025 08:30:00 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2BFA56B000C; Tue, 29 Apr 2025 08:30:00 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 0A9826B0008 for ; Tue, 29 Apr 2025 08:30:00 -0400 (EDT) Received: from smtpin15.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 529F9C95C3 for ; Tue, 29 Apr 2025 12:30:00 +0000 (UTC) X-FDA: 83387013360.15.C12E12E Received: from mail-qt1-f170.google.com (mail-qt1-f170.google.com [209.85.160.170]) by imf05.hostedemail.com (Postfix) with ESMTP id 5F2F910000B for ; Tue, 29 Apr 2025 12:29:58 +0000 (UTC) Authentication-Results: imf05.hostedemail.com; dkim=pass header.d=ziepe.ca header.s=google header.b=Wc3hoDMr; dmarc=none; spf=pass (imf05.hostedemail.com: domain of jgg@ziepe.ca designates 209.85.160.170 as permitted sender) smtp.mailfrom=jgg@ziepe.ca ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1745929798; a=rsa-sha256; cv=none; b=AZeMlepvxvuQi3BO+m+eTb7bA1Rksk83pPfP9WkqnlCr+lvZ6QpRcrc6Z9rd1q/n07zp7+ ygKBLQVrfUftksHrKp/qefv53qXelaAw1dLfYnwMK6ULUwPHkSlLlMCgA2ojwFDJpx2eLl ZbJyj7vUJr44eZYdcv56m3kfZEAg1x0= ARC-Authentication-Results: i=1; imf05.hostedemail.com; dkim=pass header.d=ziepe.ca header.s=google header.b=Wc3hoDMr; dmarc=none; spf=pass (imf05.hostedemail.com: domain of jgg@ziepe.ca designates 209.85.160.170 as permitted sender) smtp.mailfrom=jgg@ziepe.ca ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1745929798; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fspc3DFcSox1gyyee1r9hEoJNZDYkCPhN2qCzyuWCLE=; b=uuMHqwM/8f9ciOAhKpzLOAww8o9HaGRPvP7sqS6EBUM9TwNcFtnXj6GXW1c0UH2fTO6oKd S8ifV4O/IEYvSElkAt8RQKyxnoTDItR5GIkJrEA1Wt3ugia+18gjv6Cddm+r3FgwL4yNte /2pg8gWF/i6vt/kVzJK9VdAyWyS+RMA= Received: by mail-qt1-f170.google.com with SMTP id d75a77b69052e-47692b9d059so108333921cf.3 for ; Tue, 29 Apr 2025 05:29:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ziepe.ca; s=google; t=1745929797; x=1746534597; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=fspc3DFcSox1gyyee1r9hEoJNZDYkCPhN2qCzyuWCLE=; b=Wc3hoDMra9QE6WQuigmap9kbRI9hEv2kD2irmyDf51mVf+vXV1NfRhLMv/Xp1Er0Q0 ouJ9YNQe0SAmD3zEgqgjclxRjjYvBwqCI0f5Rmkh8q7NpmvakV2fte/HsIon6O5qAbIP XbFUhV7AArsH1smu6Ay4A3CuClrH3fkwRommN0B1271fxkY4CfCKmyhhE6GjoMUXcVGZ 0O9NDB2tgnfZV550ElFQlVKMbXk8fQJJc0fyTLiIYzEBnUT10M7JkY2XLuRYVtumavgL 3hkDS9E54M8qPQF0JLoItVw3anon58KdRPPxl/N2zvEpeWCnCOPP7G/F0yhLo7Xh/2G8 gcEw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1745929797; x=1746534597; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=fspc3DFcSox1gyyee1r9hEoJNZDYkCPhN2qCzyuWCLE=; b=GCfmjQ49obWeIKvl4SkigNHbXzEFNhqZtzd7Hel/i41pQ+Z/Q7Cn3ElRFcDk8UVy4E nUEfVDfA7QcuYqWHMw2sJxOaGApDlGpVYZvIJELWqnzEHVbg4FyG3bZJeD35PdRZOI5x GMcqeKY9nFDWgWgnaFJcGxIOL2AqYtPQDU9JJFAT5wisMBiFj/HwN7SoLFrhdgWR0/5c 3BzMPFX+5IuP9SIQFHKBtZ2fBBUJTenzn91CvG4gXUY13Hkzagit9fjnCu4QdTPHg4kN I9s2Su2U7S+Fpk9xjk4DG2hkILPLw+RzLo1tefwgmohrcIjqCvRz81wlbp9Uye5JGCOB Mupg== X-Forwarded-Encrypted: i=1; AJvYcCXMWkkDD8NUb/uE6FJYTec2bze0+KdxEIMYUWRac4FxXmdhdNHCC6ctiE2NypF3AT83RrqnCQcU+w==@kvack.org X-Gm-Message-State: AOJu0Yz9FLgTH56Hrluwv2ma0xQFglK3N+29F6lsqmz7VN21esU59rpm SzSgKOGaYUzjsPmiAXbTb0fxQaVwx5ZfxHx2V4UJXGc1OusOp9TkyKOK2oz1GHU= X-Gm-Gg: ASbGncvrnRhgsGrPeneT+Mkp92yHHXxWwXzysmBhFVM8RoGreyxE6iWuWnmmaXdpbVf Ev0gXIsrSqbNpwmjmjDmHR7mqws/y3Y6Ym8dByE6pEQUzVURiMuhvcLbSKfpT7PeGXKTSUHx2zz mzPIoN+mTBbX3zhz+9b11CF5NVchkZFbBetmKtzFO3kFJxDHEgIZ2gVbcb/CdSLRc7X3ei2xiaN dSd2XiMsP5hbNO2NGXdD3sGZX4lVVuyzVPHOzD7abXJjYjTDTImHhSKvngeZYnTuBT+qNVbo2pN wJ7QYSfQ55F6cNSGv2X2/0cOG4nIi1aByQaapAZaW8HHkTEGKtJ1BPNi2kkUrIgPco/wKrpmnax A9hKY3MpznmY9dFvktJw= X-Google-Smtp-Source: AGHT+IEgx9EB53XUdGV7vC29k/JxBvqJ89luumOzPRGbpdqAFnmUSowtG6tg8X/s0U1VWu7lyHl1sQ== X-Received: by 2002:a05:6214:d6d:b0:6f2:d45c:4a1d with SMTP id 6a1803df08f44-6f4d1f9d772mr228245476d6.38.1745929797482; Tue, 29 Apr 2025 05:29:57 -0700 (PDT) Received: from ziepe.ca (hlfxns017vw-142-167-219-86.dhcp-dynamic.fibreop.ns.bellaliant.net. [142.167.219.86]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6f4c0aae68csm71890226d6.97.2025.04.29.05.29.56 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 29 Apr 2025 05:29:56 -0700 (PDT) Received: from jgg by wakko with local (Exim 4.97) (envelope-from ) id 1u9k60-0000000A4cD-1RSJ; Tue, 29 Apr 2025 09:29:56 -0300 Date: Tue, 29 Apr 2025 09:29:56 -0300 From: Jason Gunthorpe To: jane.chu@oracle.com Cc: logane@deltatee.com, hch@lst.de, gregkh@linuxfoundation.org, willy@infradead.org, kch@nvidia.com, axboe@kernel.dk, linux-kernel@vger.kernel.org, linux-mm@kvack.org, linux-pci@vger.kernel.org, linux-nvme@lists.infradead.org, linux-block@vger.kernel.org Subject: Re: Report: Performance regression from ib_umem_get on zone device pages Message-ID: <20250429122956.GB2260621@ziepe.ca> References: <20250423232828.GV1213339@ziepe.ca> <84867704-1b25-422a-8c56-6422a2ef50a9@oracle.com> <20250424120143.GX1213339@ziepe.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 5F2F910000B X-Rspam-User: X-Rspamd-Server: rspam07 X-Stat-Signature: coupxicr5b73bcdmgkmamw5cxkcnbrni X-HE-Tag: 1745929798-356041 X-HE-Meta: U2FsdGVkX18mgxrsZOzNqjl7uZO+c+oNrCI1jo1wNaRHRv/ujuLterEB1qmXOm+UrFnTvWT0kwCKgCZYRWEeIWlcM/sa27hfBoyRwooYhD28TiWo01b3VtK1mZsiDRiAOMCE6kHWj3XLjV+ba5/hH0p+vjHdKnvrZ7jePlEE1kg180Am/b038BRhXilPHgZe8egqCcHfkhnaPG3ZeQqTLC0z29NkCPPnJM69pHS+bQlAqEVP5JsQv3Jn5O95aW+Y/T52E/TxSrTzcplYc+xIxv9Ys/Jdbzxu5eWx233OAHTv2fOXNOD6PSFf3+cf/UNDIyRe9NtBlXBildpl9rpUTdUWhZJ/MVfJf040SwSLE15VEeogQ/cSRIEgV6tGIZ/9PKmmRbWoRsmZxNUvv4B2NLf5Os/vXM6chKlmLumFW3FzqY7dETLyRYlFiDYMXtOTt5LHS0KInz+XsXccgNBSZgDTXaTzvuQp+GEmN/oGl5U2gkOm2+Oi3Ciao25ZznNjJH5/wvEX6+o3VuuBqPl8FyKmjVCamEH3xmQt7aIvky2FlB0GQEbFf0r8c4doZ26ZRAQlMAZG9xFnv4vBRdjYdJ0HjGM9nedk8xZaAij0+mLa/3tQUsuUx7Dp7iiGHlJdSza2qt0kkygKQd8iD0FDG0160VFqsSZOQHDAbCZtu7mLaDa9gJCFbO2UqPGN7+hLyK6Lal79idAQo6jsNOPwz1VCgBBoUw9qb0gvpoSWsjtarAACLoOnvgT6y5rcjZHTabbYAszUG4Z7uwBa+WMdEkgmeHdGFX2pKggyERqCNZnXltDVcte+Rw9RL7NsSLRcIa4g1RtCwDKAhvBwKxl6HB4kUltuNbFtJfv4Ikjx7kwE8mCwa0cM+0A3f2KEev226kZoepZM06bvlP7JP2awm5GXK4AAA6uoDn8t08VPDaKEgOGyaTaJOigCbysj9VR6kn8xsep+Fz1gLSv7dJa 8BXpRPgK holmHnODTgs17X3jJ7Luh/0yGuBHf8DdpMjGtNKAFUmDCI3PUnUDJ0TFdhngJZVFa8RMhz7JudLthB+eTYdOy6yxEeBFwKlck4F36EujdesfGTvEmwEpbCs9tvScutjIgIcLfeBJx8NbgtMLUbOjuo/MvyBw1mUsJ7xGMggub8SCpBOg9DT79D+5xAbZzeNKKicEKkjmr/6f85FzkEqbei5bCV0eZs6faSEUmjw8EZevwW+gaov0shB9zVFi8D41pFQO+/WwNftmisEeOOCi6BipXqjz0Lrll4yXkzwfLigTjErjvUtcjpsWayn3ghnAPvIGT3sCdIexJR+dZ0dfDqNPJBjWNJeiB+KaUKAOwNDN7QEc= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Mon, Apr 28, 2025 at 12:11:40PM -0700, jane.chu@oracle.com wrote: > 6.15-rc3 is orders of magnitude better. > Agreed that device-dax's using folio are likely the heros. I've yet to check > the code and bisect, maybe pin_user_page_fast() adds folios to page_list[] > instead of 4K pages? It does not. I think a bisection would be interesting information Jason