From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 94F19C04A6A for ; Tue, 25 Jul 2023 15:59:38 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0F5FA6B0071; Tue, 25 Jul 2023 11:59:38 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 0806D8D0002; Tue, 25 Jul 2023 11:59:38 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E3BC88D0001; Tue, 25 Jul 2023 11:59:37 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id D13EC6B0071 for ; Tue, 25 Jul 2023 11:59:37 -0400 (EDT) Received: from smtpin06.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id AC5FAC0E2F for ; Tue, 25 Jul 2023 15:59:37 +0000 (UTC) X-FDA: 81050594394.06.53D5095 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf22.hostedemail.com (Postfix) with ESMTP id 8D987C000B for ; Tue, 25 Jul 2023 15:59:35 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=mTK5dt2W; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf22.hostedemail.com: domain of brauner@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=brauner@kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1690300775; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=I3OMGDFkeiru0Dy3GX9ZxxS7BWevxZu8gkV/MjU+sB8=; b=Z6ufmoXyXVwel08E8hVwkYl2QIUfVRL2XiXqZqK1Y7DjpEVGRhkVLxS9oHSMtEyGS4PKUd GS790L9VAMu+j9NZw1xVnQYPUPlVMPnfVnqkzU+JdPKWSeFgeB02OvsQ5U4doy78xuVT2m rcrxWVA4YmpBI3HzBb7/+nlTpfbFfyk= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=mTK5dt2W; dmarc=pass (policy=none) header.from=kernel.org; spf=pass (imf22.hostedemail.com: domain of brauner@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=brauner@kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1690300775; a=rsa-sha256; cv=none; b=eKWKj/VjrJ/rVq2bUFxH0JomrsGkhA9GQ00zJ3QPKw4zDgz1x8m9Sdz0rXi8mtUk7cbAJZ ZOORg5Us62BryiGMlhAP2Dai91qJZXMwzLS3q3hNqF/7GFMvYKnP3BdNY7w4Kz02/vtV7/ 0gl+5KXJSjv/IRwsgclym0fWHvRY7Fc= Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 5D68D617C1; Tue, 25 Jul 2023 15:59:34 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id A6914C433C7; Tue, 25 Jul 2023 15:59:30 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1690300773; bh=0u+HYQGmoCedoBKVOoR5Hosif+VWaXwQKUiW99pfSl4=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=mTK5dt2WSUPfGCvS5hXGIxM5+Qo1OOaSBnYQUfe+AhZjnnlzlWwviZyCv9g4SmG6O x4FpMQGpcbie1X5LzuFQwFPEM7hMTeUoiHPNk/aSF9wqaXFYHcaWCL/2GwbPxq5P94 aFgY4ZwvYReY5VgXWvhtK7ZnYGnSXcahi0rchwtbgR41DYp/GDOJp1461QAp4qrrAn hq0maRK6VgjD16grARCE3QsP99YcuPcKVsYEjvxuCZTIMmD1SSZWT+bA4RdoYxrEMd 4bFVQNDaD1RB6Agl1WVf56i10pWbHdlzmP3yaXondjpvmEcR5YDQPkuC0O43oOFasY sitViS0NP5xIg== Date: Tue, 25 Jul 2023 17:59:22 +0200 From: Christian Brauner To: Philip Li Cc: Chuck Lever III , kernel test robot , Chuck Lever , "oe-lkp@lists.linux.dev" , kernel test robot , linux-mm , "ying.huang@intel.com" , "feng.tang@intel.com" , "fengwei.yin@intel.com" , Al Viro , Hugh Dickins , Andrew Morton , Jeff Layton , "linux-fsdevel@vger.kernel.org" Subject: Re: [PATCH v7 3/3] shmem: stable directory offsets Message-ID: <20230725-geraubt-international-910f0d37175b@brauner> References: <202307171436.29248fcf-oliver.sang@intel.com> <3B736492-9332-40C9-A916-DA6EE1A425B9@oracle.com> <53E23038-3904-400F-97E1-0BAFAD510D2D@oracle.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 8D987C000B X-Rspam-User: X-Rspamd-Server: rspam04 X-Stat-Signature: 46moad8eg9extx9diusye7oayzbtxxz5 X-HE-Tag: 1690300775-709375 X-HE-Meta: U2FsdGVkX193oo4SyG+guI180pIf2Sh3saB2TRLU33OEJSW0108m8UoQrMtsKJxGhKukS9NPwbOPG0hbRDQDfsgeSxY/gzMJDCovc1FB6Ge+LYgEYK8LKl7CkZKlQZrXJhAQtqWYo//5Vy6hnha6uzc6xmoQz900tgE/yFpzVM6w5CvCynpJjjTPAb/hQFI0rwJi2aV0XdXdZYEJX/HJL0VGrqqw4FfH3qrokZPe32BA/SBwQ9NEm5fzlpFWRRHgc4UP7gpqehBkiBpsQqwRg41SaNhvYkisMW+NhguTzUO8+cM85tl2CBQcfH2xZlO4l45Qz5x/vwoL/ip9j3qgsF42PcEsFzkStRbbdFzshJuzo68x4NKF6iyDIAKnD9W3IWUQ1gvUk6hrXk2h7ALI8PN4Kr5WsUCebFb8ONzAwcKPstnqToMMLKQiMoTuhOwqDdhDWj23mXTguC0wIWKyt+0qHCRqseWst8rA7hZi9jseBPohl+LWcoTG0B9csSmGAuBWz1YEJu+lUpaCWpT/hzYgSebwgS2VjL4rW+IYEWCqqMQwSL5ne3cRxaLr5lHPGlZqI871sywJpi103OwrW7+XWc4b2pSaVi3gg6WuYFeBjLqg5SjEbJQ33hJgeWoEJyrX2Pm17vpzVOpBMPT+UgrzcSFajJ1SnwTDsDKCKkLrjs2Qr+MoFPDAWYMCn+OkziICdOYVVE3B9lL8UXocdRYHoLaxbMX5CbiArnL4b9UXSC8M6EujFMNrcW6+qCuTpAWaFiO5zDVF4D5NoLqNUL3ZnlgJegVa6X2AjXTQxbuUZ47iKuc6RIAQqrUF/8tyOp1tZ1nHZaiR5j/DSGBg14WKuFldLjMpreTnMH/ng72OIzOhHQ55eMU4pBFHU+TVwD3hkobHUYfZZ8Nbjlbzz1ktsr21diBR043vXolqV5EO1ya/Ywxo0iI4jxrbVESbLdcdx8ouiH7WAp88Ih5 1xzg8y0M HFPeZ10+VbyjJoeOGvBB2cmWmK/RRW7p0ZtUP0dcnxbmSirWGKLBJxD1e/30vPZwgB9LkhqdVby6eZfGFKRNRR1S2+rm56jcYfe9+37ClDrghO3KJF6VZc4WTnIyRneV313AryezbS8wiyeRGDjALcfHxl8vctcvC+tQy33GH8jVB4zg8oOAfzad9iE6Y1oqf0ptX+yIrMxK4coyC/trRK7/9zjyQ/SG/Yq9cTWSqRZdsNujN5yCGD9e2mjJ7Kcyw5YjqaKKZP8J3cYcBAX+nQdnljYCLPPPZVXcEMAuesguN7POM7EGuzAonFLImBWquZSvsy1YeQWVNgET71SOsh3fHKGoNKhMUE7mFIt00DBdLPzUjSPyQGhaftfgS1ok4CX0bVDJG/8KBVUizHdHEUoqXOE+4VYb5RBMpHcWV1nu23NT1l9AI8u7YERgCcGN+2XATTfOjw/mn5x7S03J8Y5vDC9P/burfPs7O9A3drPJiIXzDmLoQvyvOMA0xkwh2WVekB41Bu+7kZVg= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue, Jul 25, 2023 at 11:54:26PM +0800, Philip Li wrote: > On Tue, Jul 25, 2023 at 03:12:22PM +0000, Chuck Lever III wrote: > > > > > > > On Jul 22, 2023, at 4:33 PM, Chuck Lever III wrote: > > > > > > > > > > > >> On Jul 17, 2023, at 2:46 AM, kernel test robot wrote: > > >> > > >> > > >> hi, Chuck Lever, > > >> > > >> we reported a 3.0% improvement of stress-ng.handle.ops_per_sec for this commit > > >> on > > >> https://lore.kernel.org/oe-lkp/202307132153.a52cdb2d-oliver.sang@intel.com/ > > >> > > >> but now we noticed a regression, detail as below, FYI > > >> > > >> Hello, > > >> > > >> kernel test robot noticed a -15.5% regression of will-it-scale.per_thread_ops on: > > >> > > >> > > >> commit: a1a690e009744e4526526b2f838beec5ef9233cc ("[PATCH v7 3/3] shmem: stable directory offsets") > > >> url: https://github.com/intel-lab-lkp/linux/commits/Chuck-Lever/libfs-Add-directory-operations-for-stable-offsets/20230701-014925 > > >> base: https://git.kernel.org/cgit/linux/kernel/git/akpm/mm.git mm-everything > > >> patch link: https://lore.kernel.org/all/168814734331.530310.3911190551060453102.stgit@manet.1015granger.net/ > > >> patch subject: [PATCH v7 3/3] shmem: stable directory offsets > > >> > > >> testcase: will-it-scale > > >> test machine: 104 threads 2 sockets (Skylake) with 192G memory > > >> parameters: > > >> > > >> nr_task: 16 > > >> mode: thread > > >> test: unlink2 > > >> cpufreq_governor: performance > > >> > > >> > > >> In addition to that, the commit also has significant impact on the following tests: > > >> > > >> +------------------+-------------------------------------------------------------------------------------------------+ > > >> | testcase: change | will-it-scale: will-it-scale.per_thread_ops -40.0% regression | > > >> | test machine | 36 threads 1 sockets Intel(R) Core(TM) i9-10980XE CPU @ 3.00GHz (Cascade Lake) with 128G memory | > > >> | test parameters | cpufreq_governor=performance | > > >> | | mode=thread | > > >> | | nr_task=16 | > > >> | | test=unlink2 | > > >> +------------------+-------------------------------------------------------------------------------------------------+ > > >> | testcase: change | stress-ng: stress-ng.handle.ops_per_sec 3.0% improvement | > > >> | test machine | 36 threads 1 sockets Intel(R) Core(TM) i9-9980XE CPU @ 3.00GHz (Skylake) with 32G memory | > > >> | test parameters | class=filesystem | > > >> | | cpufreq_governor=performance | > > >> | | disk=1SSD | > > >> | | fs=ext4 | > > >> | | nr_threads=10% | > > >> | | test=handle | > > >> | | testtime=60s | > > >> +------------------+-------------------------------------------------------------------------------------------------+ > > >> > > >> > > >> If you fix the issue in a separate patch/commit (i.e. not just a new version of > > >> the same patch/commit), kindly add following tags > > >> | Reported-by: kernel test robot > > >> | Closes: https://lore.kernel.org/oe-lkp/202307171436.29248fcf-oliver.sang@intel.com > > >> > > >> > > >> Details are as below: > > >> --------------------------------------------------------------------------------------------------> > > >> > > >> > > >> To reproduce: > > >> > > >> git clone https://github.com/intel/lkp-tests.git > > >> cd lkp-tests > > >> sudo bin/lkp install job.yaml # job file is attached in this email > > > > Has anyone from the lkp or ltp teams had a chance to look at this? > > I'm stuck without this reproducer. > > Sorry about this that fedora is not fully supported now [1]. A possible way > is to run the test inside docker [2]. But we haven't fully tested the > reproduce steps in docker yet, which is in our TODO list. Also a concern is > that docker environment probably can't reproduce the performance regression. > > For now, not sure whether it is convenient for you to have a ubuntu or debian > environment to give a try? Another alternative is if you have new patch, we > can assist to verify it on our machines. So while we have your attention here. I've asked this a while ago in another mail: It would be really really helpful if there was a way for us to ask/trigger a perf test run for specific branches/patches we suspect of being performance sensitive. It's a bit of a shame that we have no simple way of submitting a custom job and get performance results reported. I know that resources for this are probably scarce but some way to at least request it would be really really nice.