From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D37FECA0EE4 for ; Thu, 14 Aug 2025 15:36:28 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 6C26790019C; Thu, 14 Aug 2025 11:36:28 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 6988B900172; Thu, 14 Aug 2025 11:36:28 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 510D290019C; Thu, 14 Aug 2025 11:36:28 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 389D5900172 for ; Thu, 14 Aug 2025 11:36:28 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 0082CBADE2 for ; Thu, 14 Aug 2025 15:36:27 +0000 (UTC) X-FDA: 83775764814.16.787315D Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2079.outbound.protection.outlook.com [40.107.237.79]) by imf26.hostedemail.com (Postfix) with ESMTP id 47CCE14000E for ; Thu, 14 Aug 2025 15:36:25 +0000 (UTC) Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=dpO89jon; spf=pass (imf26.hostedemail.com: domain of Raghavendra.KodsaraThimmappa@amd.com designates 40.107.237.79 as permitted sender) smtp.mailfrom=Raghavendra.KodsaraThimmappa@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1755185785; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=JidjaM9jyZU+0KQmXw5u/FNar0F7TNpXCByTADsZ7fE=; b=AIMuyr4DYq+D29gP4S5BVBY/yn5dMGcRzQvzlzIy3JKqFeTh2GoyJRAv086N5n9h5mOcI/ wMHfxGXR9/yRuL5VgTIBwvw6S6F2EQNIGpPSStEwWuGhOgXeV/90afclOZSu2sf/BSaVpT LuL7TkHepL5ZebfpF8AgzBmkH5B6xUA= ARC-Authentication-Results: i=2; imf26.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=dpO89jon; spf=pass (imf26.hostedemail.com: domain of Raghavendra.KodsaraThimmappa@amd.com designates 40.107.237.79 as permitted sender) smtp.mailfrom=Raghavendra.KodsaraThimmappa@amd.com; dmarc=pass (policy=quarantine) header.from=amd.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1755185785; a=rsa-sha256; cv=pass; b=YRQyqRWkWkEiKK86/tC0SC+kpaztLS9lBHjLuLeteNuOtzRDxMJ8Kc4jFRJnsDvMrl0q8J 9Gfz/sPXi+wceyDAhYYdtgOU2RZVu5DTZNgCqUJ844B+m9K/MG4bortSLEp3IlziP14WYg gJE9ALzmY7TJ7gBOfGdWOOJpvTDepBE= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=lCx7MiG7z1QWmZG4n4gjHbwqrYpoIo9FAFpnv8cSsbiGR2wOr9uZs6T14eS/inD0phMQ1t5nkk8KCR2fpcgp2gS7u/WTH5fXNfM3JkMupbWn+cG7vj+ujudTMGy5KQjMnE166IiNkfT1/+OfyCWjJoQHHVd1jbU68pYxFKYV/PTDWZw2R3pGcf8RCk1FlylSrNMBwq5za4+OFdb+dbwuKMiALUQ0vfsRGddXL57sQ4dlFfMjzGnxeOQ+ZDocdupjRXt34l+Lr0P4dsXJrCcqm6DVfCRug4dqFkGv9xlBl3Hz0H4QEdqiuDKyz8qVLu11BZn4rgm28kHPrVXbcPyrQA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=JidjaM9jyZU+0KQmXw5u/FNar0F7TNpXCByTADsZ7fE=; b=wIa7iuZxBQUscRC4RBBclmhdJYVI0vP0XrOTIkqtIG/cTWCPqUibqCHaKoYyIoAl5zbDEllnsMVFtyf5KIO7A+eHwvaGYiXrcApULT4rsj8mMCMrUfUDJTcp/mkwl7n0Tquh016b8HGK1BlAFw1MMWsnAZ2ssjKAIDYvDjZOOonzyKlFuyS2/mG/NWjuva5/aHRXHhSsCW1Wkq8OL4J1UBjarWnB7RSVOLKontPZLUGRtBEar2dQIT4y1Ra8k0vZQv32f28dfYzxEAprBEG3y3hqa/WOHHzTKE8C+2i479Xc/wRohP5ovFotbU/Jcz52o4TKAZ2tMGmX8UiFb+Soiw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=arm.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JidjaM9jyZU+0KQmXw5u/FNar0F7TNpXCByTADsZ7fE=; b=dpO89joneZc8e/tzjujX3rgPjYN7c7YCa2od75DjpAq7rLe+GE6RWch/tVZ2/1kMd6MC+4Z210j2tSk/iITlEaiwxSlLQgWJJacmRu3YAN9Z1GsDesVC3TgJMLk4d0Ixjw2oXzYSBK0mCL/7oZpuQ9ixJKtnXGfUzvwrmjeeyug= Received: from DS7PR07CA0005.namprd07.prod.outlook.com (2603:10b6:5:3af::15) by CH3PR12MB7740.namprd12.prod.outlook.com (2603:10b6:610:145::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.9031.16; Thu, 14 Aug 2025 15:36:22 +0000 Received: from DS1PEPF0001709C.namprd05.prod.outlook.com (2603:10b6:5:3af:cafe::3c) by DS7PR07CA0005.outlook.office365.com (2603:10b6:5:3af::15) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.9031.18 via Frontend Transport; Thu, 14 Aug 2025 15:36:22 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C Received: from SATLEXMB04.amd.com (165.204.84.17) by DS1PEPF0001709C.mail.protection.outlook.com (10.167.18.106) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.9031.11 via Frontend Transport; Thu, 14 Aug 2025 15:36:22 +0000 Received: from tunga.amd.com (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Thu, 14 Aug 2025 10:36:10 -0500 From: Raghavendra K T To: CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: [RFC PATCH V3 16/17] prctl: Fine tune scan_period with prctl scale param Date: Thu, 14 Aug 2025 15:33:06 +0000 Message-ID: <20250814153307.1553061-17-raghavendra.kt@amd.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20250814153307.1553061-1-raghavendra.kt@amd.com> References: <20250814153307.1553061-1-raghavendra.kt@amd.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Originating-IP: [10.180.168.240] X-ClientProxiedBy: SATLEXMB03.amd.com (10.181.40.144) To SATLEXMB04.amd.com (10.181.40.145) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS1PEPF0001709C:EE_|CH3PR12MB7740:EE_ X-MS-Office365-Filtering-Correlation-Id: f725ea02-d89b-47c0-1b76-08dddb485277 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|82310400026|1800799024|7416014|376014|36860700013; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?0V3LN+pINwsONuEG0fMkpEEYC8MCG+x9nbBKeqAHeSn98sEbY1bgxrrMJFty?= =?us-ascii?Q?WT+iILxlniKvWhP5lyrs076kuHCODtD0RsFBX4wpohJMbROmowxBMZ/QF9f5?= =?us-ascii?Q?VxArbrzoJVzgmEcz8GhhGsFvef/LZGkDLpWWqINzJFj94pjc984oas862U6w?= =?us-ascii?Q?2FrzK1k3ELjeLzYV4x4DFg9tjuqEc6KSIwJSAmddao/0tRm2WfC8dwq12CtP?= =?us-ascii?Q?19x84zK9UqitqBK7ooJ2E7FKSOJQGSOEECcB/aBQSMivDN4Mltdm0Wwn3oPq?= =?us-ascii?Q?qq7SagcZ8XTEMwN9K4jRHcdy/XqTHgkoF5wL/m3x2c06tPlNiSiFfojhG8CR?= =?us-ascii?Q?D71ufEaE30O3O1RheW7PUVssNicXh9UXrtV1yBL1yo5dLVQkF+Fx/5XqMOvy?= =?us-ascii?Q?GF1f/kXi50ynXEpXru7fuHIK6cHEXle9ulmQRlmbqtoGoWuds0bn6ydzpzcX?= =?us-ascii?Q?zpNUfTRCEVrbSoLacdoVORANGzdyO8YwWtMgPagMo+60cN312LQAz0XRVcmY?= =?us-ascii?Q?DTXU1IxzzRZjTofuTgSnr0gdtdsQYZy/hWk3yKy1xyMZQn5fS1amUnxFKYct?= =?us-ascii?Q?GmFBQlPzOccnAF+lpTPuEi6KZvf5ZB3B1VRHCYKQK+KQDVskTMnYypJfYXEx?= =?us-ascii?Q?YgDsxfKtgJcFK5DMybtZhGthk5sOzhLGf4dwI+lk2sBCRpD321VTnuek88o8?= =?us-ascii?Q?0TyZgkguCKknWuz+nuIpyMj03Hsh7yqE5gvYpjInqKH5x0IJS/FvTcCgqq5t?= =?us-ascii?Q?wd+azj8pfg0j0HqNS4DqPVh67gvO9ogWBJtESC+EGCfQ9qq/lM8kNQokHtRJ?= =?us-ascii?Q?zZW4+uTSu/7gzYzDOVuIdEDfWq5VKi/Zu6Ma2K68IB8rKUzxJZ/Uf9RrPThS?= =?us-ascii?Q?r3Ey6ee6r67k1MOe+drm3YjE9XG+db7rxMnr9mKZy3aDarktWQhujlMFkx0n?= =?us-ascii?Q?hOxsJrCMvXaLQQnz2vCH7F0JWeJib3/BtVBSRBrcwW13wXQ70tLSSpgV1IzK?= =?us-ascii?Q?5iHhiQLSn/HbzStlyznthx108pF76KtUNgVBDYHxx/bkIlk1nMn0b9r5tP1w?= =?us-ascii?Q?HTAxTIgnIT56Y1xX02le4vAkdSdEvF9rCYl5DCaBhfcgH7hmAC94QEHoHu/J?= =?us-ascii?Q?W90LrcnVW2+XPsZaMZuHVN5HOcJd7ftQcgg4VGvi54m0i1mANVpTcTnXuyyI?= =?us-ascii?Q?DwlnpLsIpKiBej9VcNUpn7qpnM2+J05hL+csVeGpYUUuUnsug1FliVoqYI7j?= =?us-ascii?Q?8Y+FR6xpIIpZBCGxdQzMvVXXM48zk62Gt+R9sX4Ee1DvnP4a8KceoDUur6cb?= =?us-ascii?Q?n3V10VEbIWHNLxLm5y3TJEu4xta7Olz0IgYDwTUKF0h8mus14G23KEHLgNjz?= =?us-ascii?Q?so3dJ3u1mWtNL4ZsyFs7iCIgPmuYunK6ragYRfxocqMDJVBdFHFtjJLAFljX?= =?us-ascii?Q?i9jg9aqfNUlVbMLuKSlf+gesPNjSExfqfK/GrPtDRha969jaqY+VucN+t3of?= =?us-ascii?Q?MnBYh4ON1Nw8GDe4yk0516Xpve0nM+yLC9P5?= X-Forefront-Antispam-Report: CIP:165.204.84.17;CTRY:US;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:SATLEXMB04.amd.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230040)(82310400026)(1800799024)(7416014)(376014)(36860700013);DIR:OUT;SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Aug 2025 15:36:22.3337 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: f725ea02-d89b-47c0-1b76-08dddb485277 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d;Ip=[165.204.84.17];Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: DS1PEPF0001709C.namprd05.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH3PR12MB7740 X-Rspamd-Queue-Id: 47CCE14000E X-Rspamd-Server: rspam04 X-Rspam-User: X-Stat-Signature: bnei19uto6jb34bcosckosf3s9wpfrwj X-HE-Tag: 1755185785-487460 X-HE-Meta: U2FsdGVkX1+w3sQqXqkIH8VoqGhMwzS8kXYK7igPYVLn0dRgpIXMjhtUZxFT1LOyF5WlLUiRyt+0IDVW48U1BE7aQnk4ANG6abF/iau/dNxhOyD/XBhGsXSv7f0j8L0u0s/7JYtwMPyDd/DQ2vj/OpxDokIFew1OslsQBAGJUM8p1vOJgYUPSwIIkiXO8MuNyBWaFprdFQspEe4yZpdjEpir0KwkucV580wSLmWjiGgvHlQGCuXkzHyGdiILcRYN2dr6p019AQ1FFGotYO+xkFO9b1sDnktgcrokXggsz/bR0A5A8jY17nCmGqxey6ftodsDrFBBdOt8NbOjKhUry9ldm9MmiTtFtNFEV2vzcRLFg3h9jo2RfQrLFxEzPkISYImK/mMYzDMvoz9lLElAm4JwWVYCbZ6UcpYxD0Ujk8Ugl9eohVaOMp0BE4wxzfzWg6CA3Lui5SX8aTYpZZ45uS0UWi7BRUU3yAiccQanlZ/s8913fSwkKVtuIx4QJ5HX4ZVTJ7t7IXQr8Z3qwUDsdtucUemNieTWpenUBZ/BxZMDzxj2hoEld8yQnEhDynS/P0CqAcU44Q1qiOsHgBe+HnoyiaoIyksVhK/Br5UC22eAaOU9R/XjM6Ga8O4aly1zHBwECGeK3a2Jxwx+gYgC7qWDdpFiZTtlutNX2mOHmnIHLHHWAjbGZ917I+Z+L3U1PgYpwuZMXWCgefVAAT8SE7l4zXC2J0NguaKDuv6W9ftWp9mGyP/kotaMB9pp+TYLZlA+VcVbHqAOCzBtJSVLVadF7mYeII+rBThFtUrvDysxuOr9Y+zIxlo6LaZi7Lr/7rYBtXy7e2gJzQZTU+G9EDC0LAuyKyodufGr3IKox0UaFie7bQ0qN+gWdqmQafkWsd8yUccTcWAWyKM0XCwy5VVJ18kkRG07NQoV3KqxexIrUfY+hEDWUIDThjOHd50HBddbvYn86QtJ2iDa1j7 l2PbL/iU 2sBIxnLTVYjXj860Dwpnsx+gqbL/ZkOsBlKaqJrW1C9cFMaUQHkM6bxFpEiHsBZSibGFW6WMI/9azPxGf1ZhL3hL0Pb7Na0Aygy4yqPzF1KcCMvonalqCFaeiJS7nGx9l/L0HhqrSE98VvO5mwGiCW9vYnfoUsES1q5LBu6aqnnJSLdfiLoOoeWUEzirtVEUiZutm0AEi7vXrAqKgN8S7sFLQDcVKRQFLm+bkecJmrfWb4vv936u/mrHeth6fPZ9M6zCEGmvId7UQC98ZHb1KldPvaBoZwf2ijR6q3Ob2dcxnan3XEI7RJTXx/0+UyzYxSNLkAhEDQmmn2OevU5zSvP87iudW7hbt0sdjTo0clqUPByTQz67t4s/PoR+CoG6jMVZA X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Absolute value of pte_scan_scale param further tunes scan_period by 20%. Signed-off-by: Raghavendra K T --- mm/kscand.c | 27 +++++++++++++++++++++++++-- 1 file changed, 25 insertions(+), 2 deletions(-) diff --git a/mm/kscand.c b/mm/kscand.c index 8aef6021c6ba..641150755517 100644 --- a/mm/kscand.c +++ b/mm/kscand.c @@ -21,6 +21,7 @@ #include #include #include +#include #include #include @@ -1157,6 +1158,26 @@ static int kscand_mstat_scan_period(unsigned int scan_period, int fratio) return scan_period * (1 + fratio / 10); } +/* + * Scanning aggression is further controlled by prctl. pte_scan_scale value + * further tunes the scan period by 20%. + * 0 => scanning disabled. + * 1 => current min max is retained. + * 2..10 => scale the scan period by 20% * scale factor. + */ +static unsigned long kscand_get_scaled_scan_period(unsigned int scan_period, + unsigned int scale) +{ + int delta = 0; + + if (scale) { + delta = scan_period * (scale - 1); + delta /= (PR_PTE_A_SCAN_SCALE_MAX - 1); + } + + return scan_period + delta; +} + /* * This is the normal change percentage when old and new delta remain same. * i.e., either both positive or both zero. @@ -1201,7 +1222,7 @@ static int kscand_mstat_scan_period(unsigned int scan_period, int fratio) * Increase scan_size by (1 << SCAN_SIZE_CHANGE_SHIFT). */ static inline void kscand_update_mmslot_info(struct kscand_mm_slot *mm_slot, - unsigned long total, int target_node) + unsigned long total, int target_node, unsigned int scale) { int fratio; unsigned int scan_period; @@ -1243,6 +1264,7 @@ static inline void kscand_update_mmslot_info(struct kscand_mm_slot *mm_slot, } scan_period = clamp(scan_period, KSCAND_SCAN_PERIOD_MIN, KSCAND_SCAN_PERIOD_MAX); + scan_period = kscand_get_scaled_scan_period(scan_period, scale); fratio = kmigrated_get_mstat_fratio((&mm_slot->slot)->mm); scan_period = kscand_mstat_scan_period(scan_period, fratio); scan_size = clamp(scan_size, KSCAND_SCAN_SIZE_MIN, KSCAND_SCAN_SIZE_MAX); @@ -1384,7 +1406,8 @@ static unsigned long kscand_scan_mm_slot(void) if (update_mmslot_info) { mm_slot->address = address; - kscand_update_mmslot_info(mm_slot, total, target_node); + kscand_update_mmslot_info(mm_slot, total, + target_node, mm->pte_scan_scale); } trace_kmem_scan_mm_end(mm, address, total, mm_slot_scan_period, -- 2.34.1