From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C9337C71153 for ; Tue, 29 Aug 2023 03:48:14 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 64130280030; Mon, 28 Aug 2023 23:48:14 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5F1398E001E; Mon, 28 Aug 2023 23:48:14 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4E0C5280030; Mon, 28 Aug 2023 23:48:14 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 3E3668E001E for ; Mon, 28 Aug 2023 23:48:14 -0400 (EDT) Received: from smtpin26.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 1155D12046F for ; Tue, 29 Aug 2023 03:48:14 +0000 (UTC) X-FDA: 81175759308.26.DFC5921 Received: from out-246.mta1.migadu.com (out-246.mta1.migadu.com [95.215.58.246]) by imf30.hostedemail.com (Postfix) with ESMTP id 2A19880009 for ; Tue, 29 Aug 2023 03:48:11 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b="TmZ/epwt"; spf=pass (imf30.hostedemail.com: domain of muchun.song@linux.dev designates 95.215.58.246 as permitted sender) smtp.mailfrom=muchun.song@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1693280892; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=in59HebODKGtW69dO+fJwJBRohG/et2KpWztX/mIYGc=; b=Te3HkiwvoY3Q7L3rEIhHrk8qC6QF+DZYX2paREQ7JxK/EFpQ3UrYc+2DYH5JtvOEcAIFw6 NiXWZGHMWROu+6FpxRdkWnZkDWLlbJFQYzmYFZlyeFONt3lWyw5IqqNNs+woolgjmYgUbY pAomAlPBs4wP2eStwp7FRIZSOHF9BYs= ARC-Authentication-Results: i=1; imf30.hostedemail.com; dkim=pass header.d=linux.dev header.s=key1 header.b="TmZ/epwt"; spf=pass (imf30.hostedemail.com: domain of muchun.song@linux.dev designates 95.215.58.246 as permitted sender) smtp.mailfrom=muchun.song@linux.dev; dmarc=pass (policy=none) header.from=linux.dev ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1693280892; a=rsa-sha256; cv=none; b=MR1DDYH8kCcfrYmytr1c7f8BnfgzG1eJN1tPy/RhewY75GjSA5lkjZ93kdPcB8KfeASaWE c/cwbmm9Nvdbv+ydK7OiStCnfrHfXdzdrVcZmbec085IDnzYXVXjttAgrA9Jgo+x7JJClk YjrRjSz8viTs6Cxqpsb9raDdnukO3Vs= Content-Type: text/plain; charset=us-ascii DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1693280889; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=in59HebODKGtW69dO+fJwJBRohG/et2KpWztX/mIYGc=; b=TmZ/epwtdjXXctwQH//NyVySMEyAS/9pGHcwueamQoZbOSBnIjm7o7lztJw0lygbbpCnmg VGlKUbbCrq4MvHUlRds13QU48TwHrksryd/jP9o1o2D+krl6YAzbO4qiywgmBvGzBB0c3e F7inyvPtlSAvheSYN6616nlFcpxt0ak= Mime-Version: 1.0 Subject: Re: [PATCH 10/12] hugetlb: batch PMD split for bulk vmemmap dedup X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Muchun Song In-Reply-To: <20230828164459.GA3290@monkey> Date: Tue, 29 Aug 2023 11:47:30 +0800 Cc: Joao Martins , kernel test robot , Linux-MM , llvm@lists.linux.dev, oe-kbuild-all@lists.linux.dev, Muchun Song , Oscar Salvador , David Hildenbrand , Miaohe Lin , David Rientjes , Anshuman Khandual , Naoya Horiguchi , Barry Song , Michal Hocko , Matthew Wilcox , Xiongchun Duan , Andrew Morton , LKML Content-Transfer-Encoding: quoted-printable Message-Id: References: <20230825190436.55045-11-mike.kravetz@oracle.com> <202308261325.ipTttZHZ-lkp@intel.com> <20230828164459.GA3290@monkey> To: Mike Kravetz X-Migadu-Flow: FLOW_OUT X-Rspamd-Queue-Id: 2A19880009 X-Rspam-User: X-Stat-Signature: 3zzr6u4x4rkbwxiwru9dm31bdcw53pid X-Rspamd-Server: rspam01 X-HE-Tag: 1693280891-622805 X-HE-Meta: U2FsdGVkX1+k1mbLXd85+JuI5Q8Q3SP+caiUQ12q4o+1d0/6zDu3W1/L5eKErZbbmxuE9nsS6gsdtoqnoXPFmOor0CSRFeWtPjZiDlmpQumDj6XnXjJ84OynSUE8IYCV2SR8YX20SsYptPwAFZGW8d9s4StDs0/xuXXCcw1ZgynbFaDzflTVhS0fwQgOXhMeczYi4ZMz2qCqqjoNqbxDiqam5rmNy1/8SE2K/7JHIpuB5AiOdPMhz9bUOindFIVuhwq5WTFoHJh+ywJdW2Grl85Ul3+OPqrO/CaQEbTV+VTX1GKryTouFEEoZ0skPzMdTXLqju0Odh6ztJkkYoAOuKhULlfUQKeL1dGl67qBe4vTd8arqMo6TqV2zHVUXyM8Rj1qyN7kEqADJN+ohOIQB78tgvMCF4fKPxc2yb67trM1RSa27tBf/Cpoik4XjpggbbIKM7116JTXj/Dvf2MoJMDDsz9bY635mI5Qj60CYZjcKII/yqH5v6N65KCt6Iabyv+ho2GasU8LyrQDp/jICU18vEr3dI+MaDveED9ai+cOPZrxHY9v7BwAftyCe8kq9td56REtjDnarw5ekYerBJDlp07PeFQDV2bwK5aBzsb9LG/J1MaNl3kI5DhfikjCfUNLaBAKhlcbgqjvbUK2cP8q6K7TEH+hXNuTzpoq05sFT90obsTCbGiUNQ6orM+GT59xbKvpEzIB4U8T+WBWpQakCBqfyQ1QksIEf9+ulg5Uvi37SbdlAOM/qsZKupHsN0gIBe2OorifgUmXhHcijYgc5YbYJZIqwMqvgBwZBjZC2yAHGPjNpMMW+urCKQ4tN4C4YGGaAVsifnYjDaIbKE8iiIy3Mp8FBn8UiQNs3jmEe6Ny5QJOyd8/l2E6uNHjNRhl0RNGFwGwbNYxzjSryZ64wQj0e2q7jxDJnMvS8/cYNQ4tlbPmVjX3VlABO4ndh2d5XPVaTpCl+7v7Jfu 8kh8EDrr X08jHfIhipWR4VowFi8EdVA5vnXbhGVnbwZXDFlSASF3uAG6IdkMwDUAlT2VemIE2b84Y1aJmC7DEMA8obFOIZ4mCV6f+NSAwxz71z7gPTYS9FaTckn6A6EHSm08Kvj9eSv/QduaZJxxz7/5+Y4AU87ogbkZHItQWUPu28svdMWzNqMZ9WCs6jmaFlu2Rom0xWsMr3wsBV+y2ZcoaFBkA5UvsXlPnrX4GttbvUmGBW+S0unB335m/EgyhacXyCejBSD1PLbptUCUzm4pCjp+9kgDhMCbom+xbJhLMXcAJ37XNaWbv8wcA04HX0SX+XaJI4+MKoeaYM3R9H5fbpmHGopDIz53Iawo7VIZtyjK70g42jf4= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: > On Aug 29, 2023, at 00:44, Mike Kravetz = wrote: >=20 > On 08/28/23 10:42, Joao Martins wrote: >> On 26/08/2023 06:56, kernel test robot wrote: >>> Hi Mike, >>>=20 >>> kernel test robot noticed the following build errors: >>>=20 >>> [auto build test ERROR on next-20230825] >>> [cannot apply to akpm-mm/mm-everything v6.5-rc7 v6.5-rc6 v6.5-rc5 = linus/master v6.5-rc7] >>> [If your patch is applied to the wrong git tree, kindly drop us a = note. >>> And when submitting patch, we suggest to use '--base' as documented = in >>> https://git-scm.com/docs/git-format-patch#_base_tree_information] >>>=20 >>> url: = https://github.com/intel-lab-lkp/linux/commits/Mike-Kravetz/hugetlb-clear-= flags-in-tail-pages-that-will-be-freed-individually/20230826-030805 >>> base: next-20230825 >>> patch link: = https://lore.kernel.org/r/20230825190436.55045-11-mike.kravetz%40oracle.co= m >>> patch subject: [PATCH 10/12] hugetlb: batch PMD split for bulk = vmemmap dedup >>> config: s390-randconfig-001-20230826 = (https://download.01.org/0day-ci/archive/20230826/202308261325.ipTttZHZ-lk= p@intel.com/config) >>> compiler: clang version 17.0.0 = (https://github.com/llvm/llvm-project.git = 4a5ac14ee968ff0ad5d2cc1ffa0299048db4c88a) >>> reproduce: = (https://download.01.org/0day-ci/archive/20230826/202308261325.ipTttZHZ-lk= p@intel.com/reproduce) >>>=20 >>> If you fix the issue in a separate patch/commit (i.e. not just a new = version of >>> the same patch/commit), kindly add following tags >>> | Reported-by: kernel test robot >>> | Closes: = https://lore.kernel.org/oe-kbuild-all/202308261325.ipTttZHZ-lkp@intel.com/= >>>=20 >>> All error/warnings (new ones prefixed by >>): >>>=20 >>=20 >> [...] >>=20 >>>>> mm/hugetlb_vmemmap.c:698:28: error: use of undeclared identifier = 'TLB_FLUSH_ALL' >>> 698 | flush_tlb_kernel_range(0, TLB_FLUSH_ALL); >>> | ^ >>> 2 warnings and 1 error generated. >>>=20 >>>=20 >>=20 >> TLB_FLUSH_ALL is x86 only so what I wrote above is wrong in what = should be >> architecture independent. The way I should have written the global = TLB flush is >> to use flush_tlb_all(), which is what is implemented by the arch. >>=20 >> The alternative is to compose a start/end tuple in the top-level = optimize-folios >> function as we iterate over folios to remap, and flush via >> flush_tlb_kernel_range(). But this would likely only be relevant on = x86 only, >> that is to optimize the flushing of 3 contiguous 2M hugetlb pages = (~24 vmemmap >> pages) as that's where the TLB flush ceiling is put (31 pages) for = per-page VA >> flush, before falling back to a global TLB flush. Weren't sure of the = added >> complexity for dubious benefit thus kept it in global TLB flush. >=20 > Thanks Joao. >=20 > I added my share of build issues to this RFC as can be seen in the bot > responses to other patches. >=20 > My assumption is that these build issues will not prevent people from > looking into and commenting on the bigger performance issue that was = the > reason for this series. The build issues would of course be resolved = if > there is some concensus that this is the way to move forward to = address > this issue. If the build issues are a stumbling block for anyone to > look at this bigger issue, let me know and I will fix them all ASAP. No need to update. But I need some time to look. Muchun, Thanks.