From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B9BA8CD6E64 for ; Wed, 11 Oct 2023 12:52:26 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1BC3E8E0006; Wed, 11 Oct 2023 08:52:26 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 16D428D0002; Wed, 11 Oct 2023 08:52:26 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 05C008E0006; Wed, 11 Oct 2023 08:52:26 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id E7B478D0002 for ; Wed, 11 Oct 2023 08:52:25 -0400 (EDT) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id C08CD4011E for ; Wed, 11 Oct 2023 12:52:25 +0000 (UTC) X-FDA: 81333169050.18.F7A240A Received: from outbound-smtp12.blacknight.com (outbound-smtp12.blacknight.com [46.22.139.17]) by imf13.hostedemail.com (Postfix) with ESMTP id C44D320019 for ; Wed, 11 Oct 2023 12:52:23 +0000 (UTC) Authentication-Results: imf13.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf13.hostedemail.com: domain of mgorman@techsingularity.net designates 46.22.139.17 as permitted sender) smtp.mailfrom=mgorman@techsingularity.net ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1697028744; a=rsa-sha256; cv=none; b=BAGn8qs8AYxTDaY5fpYdSFVBGeT9z2gG/M614oosJzGTAI8uSwYfZK/f/oQ5VJZs0/F3fj 75LLuJwBmQF5erWVOH1NOyFIqdqDuI4zHQjD6lkqfOlYPHZF26mOJOu5Gh+G3MRdR4Kfvw +ghRdCJfv5SJyZJy0XydZVJOvDl17vI= ARC-Authentication-Results: i=1; imf13.hostedemail.com; dkim=none; dmarc=none; spf=pass (imf13.hostedemail.com: domain of mgorman@techsingularity.net designates 46.22.139.17 as permitted sender) smtp.mailfrom=mgorman@techsingularity.net ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1697028744; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=W70XwxOzGtbCcF264ghOGIPT8N6qfssnCYAqOT8VnSs=; b=HWxXALxMFX1dl31FgZxT2iTccZ4++8cBeJFuFuwYtWNFra0frQVI5YRs6yuYpeoJ6ssUb8 VwuP8ezjWcgO3LWWqkf8GFRd1lvR3iX3V499xS9ygloFbfqMJRv+GhJqLmpR1/uy5CCt4/ qPq9M0YzUEDjjiWwXDwiJKsTB8QBXO8= Received: from mail.blacknight.com (pemlinmail01.blacknight.ie [81.17.254.10]) by outbound-smtp12.blacknight.com (Postfix) with ESMTPS id 19FC61C4951 for ; Wed, 11 Oct 2023 13:52:22 +0100 (IST) Received: (qmail 22332 invoked from network); 11 Oct 2023 12:52:21 -0000 Received: from unknown (HELO techsingularity.net) (mgorman@techsingularity.net@[84.203.197.19]) by 81.17.254.9 with ESMTPSA (AES256-SHA encrypted, authenticated); 11 Oct 2023 12:52:21 -0000 Date: Wed, 11 Oct 2023 13:52:19 +0100 From: Mel Gorman To: Huang Ying Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Arjan Van De Ven , Andrew Morton , Vlastimil Babka , David Hildenbrand , Johannes Weiner , Dave Hansen , Michal Hocko , Pavel Tatashin , Matthew Wilcox , Christoph Lameter Subject: Re: [PATCH 04/10] mm: restrict the pcp batch scale factor to avoid too long latency Message-ID: <20231011125219.kuoluyuwxzva5q5w@techsingularity.net> References: <20230920061856.257597-1-ying.huang@intel.com> <20230920061856.257597-5-ying.huang@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline In-Reply-To: <20230920061856.257597-5-ying.huang@intel.com> X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: C44D320019 X-Stat-Signature: gzw9pzeirguacdixug9rs16hqsnk738p X-Rspam-User: X-HE-Tag: 1697028743-553471 X-HE-Meta: U2FsdGVkX1862CvL9joPkdG11BJdkS244U6vklSU5ut94H3SgFFMiCejJA2pF0MbFGoYBi3wP9SRX6Ohhf/LJ9kLRQrhMxvL31N0KA3YObPLYoemkH5NZ0MPpq3SWqRjCVaeDWj1GQDiMN5GffkCvrtcJsxue9z6bh05F6TyKNnC0FmUhbyXTsqeDoH09AAjUGdu5ppxZsRkUg3aABRrz0q3rvRVA4+a56lk70bB2zlIXoCONYBBRZPD+D0dMgPQrFapsnnJx/GgJsYxdlHpwzJp/4gOvNkiLuKpY74n870ZjLbLJiLb48u46n/r7sSI+QWbd0OJnOpAJYemzqnWdXTLniDbe2EK+wcZh5f3yUHAowszgFJ0f6oiGSr494LSC3L31mEi2qiffJiPwArSHmyzJ1L8uNQEh3J3S7xChwDoz8aVyFLYgQPlmsxeJyfayrhM0bt4cwQ0FDgqQPtQ1pDcZ5BFKeslZR0/2DT8YI6cAJUszJdLWI1rGv09PsWUiCPjlkJA3UI5bmSl8Z8mWMOvUg+CE7y2LGwZcCL7ROISB2BBBXihqCyfggZPNvcZdqzbQxtuBQ6S81tfVhinoGWGFJWGZeRnBooA6ZTZHx5JMJgUFtBedrU2Cqb2C93HaeVgJ1xGD5lda+ftM4y0fb3tt+laavUwPujwLaANO1NBVNkIehSdy528lkRYGhbmQdnH/LIh2tnIEsqd6Hg2r/DY7x+CtgB9QeqN2V3Mf4ypU+8zpUfuMbKCTNf91wj0e5mnV71AhES8FqQcaJA3vkSOu2wlTbJ3ROGDKvJXo7jNDCL0WsuXQ/yf0tr4gAyZzjPx25jo2pv3mFVpLxWf8g8ntCB14rDsQ8impJHj5Og/mB4OmF6N2euCnDaBaolHLJiWAPF0sF0pAKypsax8OrFvTXUa6x+s745BkGYlynGmdVsN8s8HuCoxwhVqibf2zOLy3LnF8TjyMKaXW++ puSzbvQ0 0S/Rt16uyU3mOaj7SqlQoa0hErOfHQrkRwo//J/Mb8Afcnwhtg8ZAnjHNMDEFgocigkNTo+isHPQ+4ylTkz57PW0BEXVxtgyQjtRo5RmI4fpO9NSKDTmIvFBWAfj4ODGfNe0z0M0h/grBPVrMtUfMz6u2Qv9cS6GBjFU8V1jo/+cMBZwstyfVfzwDFw5VIjt9ZwGxb2GWvkerXz3HQ4rRzpSgywwlKqfK7Qbk+2c7sSM9ME+0WjWVy7rRx7E76Btz1kAr X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, Sep 20, 2023 at 02:18:50PM +0800, Huang Ying wrote: > In page allocator, PCP (Per-CPU Pageset) is refilled and drained in > batches to increase page allocation throughput, reduce page > allocation/freeing latency per page, and reduce zone lock contention. > But too large batch size will cause too long maximal > allocation/freeing latency, which may punish arbitrary users. So the > default batch size is chosen carefully (in zone_batchsize(), the value > is 63 for zone > 1GB) to avoid that. > > In commit 3b12e7e97938 ("mm/page_alloc: scale the number of pages that > are batch freed"), the batch size will be scaled for large number of > page freeing to improve page freeing performance and reduce zone lock > contention. Similar optimization can be used for large number of > pages allocation too. > > To find out a suitable max batch scale factor (that is, max effective > batch size), some tests and measurement on some machines were done as > follows. > > A set of debug patches are implemented as follows, > > - Set PCP high to be 2 * batch to reduce the effect of PCP high > > - Disable free batch size scaling to get the raw performance. > > - The code with zone lock held is extracted from rmqueue_bulk() and > free_pcppages_bulk() to 2 separate functions to make it easy to > measure the function run time with ftrace function_graph tracer. > > - The batch size is hard coded to be 63 (default), 127, 255, 511, > 1023, 2047, 4095. > > Then will-it-scale/page_fault1 is used to generate the page > allocation/freeing workload. The page allocation/freeing throughput > (page/s) is measured via will-it-scale. The page allocation/freeing > average latency (alloc/free latency avg, in us) and allocation/freeing > latency at 99 percentile (alloc/free latency 99%, in us) are measured > with ftrace function_graph tracer. > > The test results are as follows, > > Sapphire Rapids Server > ====================== > Batch throughput free latency free latency alloc latency alloc latency > page/s avg / us 99% / us avg / us 99% / us > ----- ---------- ------------ ------------ ------------- ------------- > 63 513633.4 2.33 3.57 2.67 6.83 > 127 517616.7 4.35 6.65 4.22 13.03 > 255 520822.8 8.29 13.32 7.52 25.24 > 511 524122.0 15.79 23.42 14.02 49.35 > 1023 525980.5 30.25 44.19 25.36 94.88 > 2047 526793.6 59.39 84.50 45.22 140.81 > > Ice Lake Server > =============== > Batch throughput free latency free latency alloc latency alloc latency > page/s avg / us 99% / us avg / us 99% / us > ----- ---------- ------------ ------------ ------------- ------------- > 63 620210.3 2.21 3.68 2.02 4.35 > 127 627003.0 4.09 6.86 3.51 8.28 > 255 630777.5 7.70 13.50 6.17 15.97 > 511 633651.5 14.85 22.62 11.66 31.08 > 1023 637071.1 28.55 42.02 20.81 54.36 > 2047 638089.7 56.54 84.06 39.28 91.68 > > Cascade Lake Server > =================== > Batch throughput free latency free latency alloc latency alloc latency > page/s avg / us 99% / us avg / us 99% / us > ----- ---------- ------------ ------------ ------------- ------------- > 63 404706.7 3.29 5.03 3.53 4.75 > 127 422475.2 6.12 9.09 6.36 8.76 > 255 411522.2 11.68 16.97 10.90 16.39 > 511 428124.1 22.54 31.28 19.86 32.25 > 1023 414718.4 43.39 62.52 40.00 66.33 > 2047 429848.7 86.64 120.34 71.14 106.08 > > Commet Lake Desktop > =================== > Batch throughput free latency free latency alloc latency alloc latency > page/s avg / us 99% / us avg / us 99% / us > ----- ---------- ------------ ------------ ------------- ------------- > > 63 795183.13 2.18 3.55 2.03 3.05 > 127 803067.85 3.91 6.56 3.85 5.52 > 255 812771.10 7.35 10.80 7.14 10.20 > 511 817723.48 14.17 27.54 13.43 30.31 > 1023 818870.19 27.72 40.10 27.89 46.28 > > Coffee Lake Desktop > =================== > Batch throughput free latency free latency alloc latency alloc latency > page/s avg / us 99% / us avg / us 99% / us > ----- ---------- ------------ ------------ ------------- ------------- > 63 510542.8 3.13 4.40 2.48 3.43 > 127 514288.6 5.97 7.89 4.65 6.04 > 255 516889.7 11.86 15.58 8.96 12.55 > 511 519802.4 23.10 28.81 16.95 26.19 > 1023 520802.7 45.30 52.51 33.19 45.95 > 2047 519997.1 90.63 104.00 65.26 81.74 > > From the above data, to restrict the allocation/freeing latency to be > less than 100 us in most times, the max batch scale factor needs to be > less than or equal to 5. > > So, in this patch, the batch scale factor is restricted to be less > than or equal to 5. > > Signed-off-by: "Huang, Ying" Acked-by: Mel Gorman However, it's worth noting that the time to free depends on the CPU and while the CPUs you tested are reasonable, there are also slower CPUs out there and I've at least one account that the time is excessive. While this patch is fine, there may be a patch on top that makes this runtime configurable, a Kconfig default or both. -- Mel Gorman SUSE Labs