From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E7C61C7EE2A for ; Fri, 27 Jun 2025 15:30:31 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 78FCC6B00A5; Fri, 27 Jun 2025 11:30:31 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 740236B00B8; Fri, 27 Jun 2025 11:30:31 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5E1A46B00B9; Fri, 27 Jun 2025 11:30:31 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 4611B6B00A5 for ; Fri, 27 Jun 2025 11:30:31 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id BC8931A0244 for ; Fri, 27 Jun 2025 15:30:30 +0000 (UTC) X-FDA: 83601567420.16.28B2829 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) by imf10.hostedemail.com (Postfix) with ESMTP id 839E2C0007 for ; Fri, 27 Jun 2025 15:30:27 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2025-04-25 header.b=O7fYzQUe; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=cCvVzTeh; spf=pass (imf10.hostedemail.com: domain of lorenzo.stoakes@oracle.com designates 205.220.177.32 as permitted sender) smtp.mailfrom=lorenzo.stoakes@oracle.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); dmarc=pass (policy=reject) header.from=oracle.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1751038227; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=VFcKog4eIxnZ4e0QmT/uTawXrMeLWw6iOtlAEvBCiRM=; b=Oj+m6Z7tUALcmKI/CmEQSdsORJP66AfZjdpGjAvrHGeIkOIaY+LFAuw4fTKwtuugCiikDd FhCihkN0wDWj53Dci9pf+RIS4a41UUArZyTuDneHCtoCmUuTKShBfok41jMel/VbdIrk5J MTFitD9dSI11+9inc9B7Eq1dl0QITvQ= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1751038227; a=rsa-sha256; cv=pass; b=AugBsR/cdQAJH8sTBHBLKNS3Q5RIqrJygODSuP8mkfUeHl6v0oy8wzcd8JBMpVUWrW5Cb5 ZO+9+12ffE4ejEQg4Cgy54YXU6c0j1xNti12JXes3icdcB7KlmL6owxrDCaZ8GHrmSpsey /CD0rIr8WFmg9g4zb/JgbzYI3TaSQdw= ARC-Authentication-Results: i=2; imf10.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2025-04-25 header.b=O7fYzQUe; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=cCvVzTeh; spf=pass (imf10.hostedemail.com: domain of lorenzo.stoakes@oracle.com designates 205.220.177.32 as permitted sender) smtp.mailfrom=lorenzo.stoakes@oracle.com; arc=pass ("microsoft.com:s=arcselector10001:i=1"); dmarc=pass (policy=reject) header.from=oracle.com Received: from pps.filterd (m0246630.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 55RFQb7R026026; Fri, 27 Jun 2025 15:30:24 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=cc :content-type:date:from:in-reply-to:message-id:mime-version :references:subject:to; s=corp-2025-04-25; bh=VFcKog4eIxnZ4e0QmT /uTawXrMeLWw6iOtlAEvBCiRM=; b=O7fYzQUeDrumTnSUdXSf+BpenU3r/DASlY nGcnseI23sb+64gXbA0ZN+3t1yiGq0QeJ74B71iUpQrUaxJcWnxJf5fRFVZZd+UX N117NyjSehEYDZjcuAnUllzTXZWkKUGK4SHfnnZld8/Gi4lxOUgAnuKX+xNRXjYn EhtpdLPFCKDdCCfjtmFzx5LfGGls1tsjFzzRnFO8mOSowpi+YJkoN4DUoGBTFL3q 7dnElH/4SYBif/EBjpFeF0WdJ46DCA1zlmz100qmnTNrUpKe0OSBtTb4GsIrcnv6 R3TQuCdRP+dx0VsvLs6ohysGFLjucKF59ZCeuzAJhdbnStr9ryzQ== Received: from iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta02.appoci.oracle.com [147.154.18.20]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 47egt1jwka-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 27 Jun 2025 15:30:24 +0000 (GMT) Received: from pps.filterd (iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (8.18.1.2/8.18.1.2) with ESMTP id 55RED2i4017883; Fri, 27 Jun 2025 15:30:23 GMT Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10on2051.outbound.protection.outlook.com [40.107.94.51]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 47ehw1gf3q-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 27 Jun 2025 15:30:23 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=HsSQPOHd6tkmMHrOzYN89KI60MCUEnngPnU2dCUzLN4MPQ10la7LDTBgTHFN1AjTiJW2uVwwCg9bCbdgnNhqMn+mLyMw/j2/BJAg4SoGPW4bR4/GL2rduUd0ipWp/STyiwN5/AhJZ+dfahRFSoql1f7tgiLKPVU1+W56lT/fUPm3JSI1OxUzYRNBi8mlo7wxfrVh0qDxN6kXX+xY/ii5LqqiA9/Zfq/pRUi7aWNdqvfh/p/QeECKCVRYroaMtPlAZkY44ZK/iI4IpD3/RZ63wJUqO5a/G+4kuH3XtR7j8/kHd5uoNMnY0xxYdhCz6TPyN/enzVS3a2KF9uLH7aXvbw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=VFcKog4eIxnZ4e0QmT/uTawXrMeLWw6iOtlAEvBCiRM=; b=Xbs5oZHySHCp70GMJi11LMZRQBeMvDncKzdUW7qo2Vezjgg9sOIt5iUfQoZRkVPNIMh6nowoxCh+1+1m9M2wj/zp5Rc+Pr7HF+Ts+pAV5xcIWh/4duyywOpR6jWkrqY/EuTPY7zSRwolbmeSCbAVs6FG3bUyzKZnf3SJ1R4GiEqh36doG0tirCJhaAOgGEpmzfbYaR6DiREPyZ15UBSQlp1obrHj+c2voJ7E5r2Eh4gMqXBuDwCiYK/27mpjsJt4YJTPOt2hPUWILILOb7g4NfoASiqh0229B9T6bRTmqKRH/hEv3FJ2qriutMMS903DfW4JUrmoc3prKUCy2gBelA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=VFcKog4eIxnZ4e0QmT/uTawXrMeLWw6iOtlAEvBCiRM=; b=cCvVzTehETBiEXrYlrMB0agX7QDyWWN+jRV4PUUPS3jLOwc06mACcB5gB7Lvy/tVQEva0nzBsF7Te6D9huDxigXOwsx/dKNEYNl+8HYoqHV+rIShtLnhopXAE2aIQH1YndT/4KMx1RuvEupcF5BUq7mH746QOKETGQ1OTgfukGU= Received: from DM4PR10MB8218.namprd10.prod.outlook.com (2603:10b6:8:1cc::16) by CH3PR10MB7161.namprd10.prod.outlook.com (2603:10b6:610:12b::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8880.21; Fri, 27 Jun 2025 15:30:15 +0000 Received: from DM4PR10MB8218.namprd10.prod.outlook.com ([fe80::2650:55cf:2816:5f2]) by DM4PR10MB8218.namprd10.prod.outlook.com ([fe80::2650:55cf:2816:5f2%6]) with mapi id 15.20.8857.026; Fri, 27 Jun 2025 15:30:15 +0000 Date: Fri, 27 Jun 2025 16:30:12 +0100 From: Lorenzo Stoakes To: siddhartha@kenip.in Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, mgorman@suse.de, Vlastimil Babka Subject: Re: [PATCH] mm: limit THP alignment =?utf-8?Q?=E2=80=93_performan?= =?utf-8?Q?ce?= gain observed in AI inference workloads Message-ID: <4990838b-660d-46a2-b21c-67adcba61ff9@lucifer.local> References: <28338f055b3c9afa8b69ff6f05ea20ed@kenip.in> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <28338f055b3c9afa8b69ff6f05ea20ed@kenip.in> X-ClientProxiedBy: LO4P123CA0237.GBRP123.PROD.OUTLOOK.COM (2603:10a6:600:1a7::8) To DM4PR10MB8218.namprd10.prod.outlook.com (2603:10b6:8:1cc::16) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM4PR10MB8218:EE_|CH3PR10MB7161:EE_ X-MS-Office365-Filtering-Correlation-Id: 95d78a3b-14f0-4d73-53fb-08ddb58f8387 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|1800799024|366016|376014|7053199007; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?awMYNupGJPduIkuW8CYGjI4fuHrFoEgtX3VE/oaOUkpQ3U3g5MZALe2mRekv?= =?us-ascii?Q?4qbl8XsZDlz3jUoVnTaj8so0OuZmG3gkZlujf5Mg+bxofGZAAPa6hFzoZhiJ?= =?us-ascii?Q?4LacyxxDRxS/0HCBnbO0ti2sQhv/VwFo+21iOVuB3jYsw/K3V4xgZn4+fJzT?= =?us-ascii?Q?o7uj49UoUO0O1FHyePA5B8y4frMvawH6a3lEnhgyajwzzHogn3mLdZPZXwYE?= =?us-ascii?Q?m5FVEM2xn520FEH7SUNfQIBVUvaJ80H+8Ae2TXINWd6F5zo3LY6xJeZ1SMn1?= =?us-ascii?Q?HeaQ0csi+nQ8/bcxo4Kr7P1iDQDE9H87Bq+YmOnq0dCk5ZD0TlByt6zarmfI?= =?us-ascii?Q?IrUw6BKm6giV8OHA+iG9iD6thupyAaRWMm7KMXIVk49N8VZHokKGedoY+kVQ?= =?us-ascii?Q?Xdclwrve3xqS0cfchKEW49DysmkKfRZq9/dItHKdF+k2HG2ENMUIJNW1V6uG?= =?us-ascii?Q?TtJz7lWJ6pre8YmISJzGjSDq1p6tiZucuEyVGB1e/AvNq/S4VHWnQIhqFE+L?= =?us-ascii?Q?L9WqwBZja2FBN1xwL8oX0neMQzk92IznykUcZCm/PmxBPNGhZwNcfgjknqEa?= =?us-ascii?Q?LD5l2LKenjXQnjehNPfHH74dK93ePhMl388hjXFEiCQkww1d9gy++z7SJiZZ?= =?us-ascii?Q?fygVqy9oNUnl63qyHOcLBidRmyB1nrRVeS5x/NDzVOScLa9WflM0qCwbAuT7?= =?us-ascii?Q?iX45mHfNVjSp0/ftEM5mu8r/hpxa1OULULbp3fZxJF3BCUAwDCewvgO6gNgc?= =?us-ascii?Q?CyV52TUE5S/k4SQk27xFdVTd3soIuUWYbQw4c6ikwR6DC4BGXv4OLxB907fx?= =?us-ascii?Q?DVFjUDQxoaiLOpTX+YlNTW1VSe7L+pki4cv9XoO6QDZjDOsCCQJuorz6Ss0U?= =?us-ascii?Q?J64/ErMqZ+U5AoOk4dhrtBcqAEeVIYDQTvkHy38rQZmaROnmgYpa3ludjvg4?= =?us-ascii?Q?L5Y7VyPmNdlLjNA2AzhqlzbddwRKNIEhufeQotU8Yhn/rqZQxadRziCjef1f?= =?us-ascii?Q?/Guvy/3MjVcnz8MWNkYDihSTfUsQN+bO0tXtGXEcHvUc2myCIAT4M557cVvT?= =?us-ascii?Q?9GPF+PM/oMTpvLxeseNSOkG0bKDUadXYi8YksxvoSSE27ciPQDtLr1JJCBl6?= =?us-ascii?Q?7Sf3XTd6djqNKDlsSs1LA1cgTiDy/j+wSvc5/0UWmXqMTsyPemknBqj6x3HT?= =?us-ascii?Q?AnqE0dA5Nr4K7p5O8WGS9HeCjVqou7tv12nNZaDqXQd0htvkfQE+ZA3Sz17O?= =?us-ascii?Q?WWPAHyfbr0iNPXIyJPtlpNdD/u/8zTmuWkwRzPqbQjZ832+ZbLvlB2JQ745u?= =?us-ascii?Q?O8osEXMLJcFWvXdyDv3mf+slQe2ztwGfGEtoxgZm+ESO1OeXMWXZ/sijYgLo?= =?us-ascii?Q?4mLxcwmUKtiExJsTNzuGsUdlw4UswXDqYy2J0zg4UAdCL7fHKelAAzhRlJGw?= =?us-ascii?Q?b9qTWCivxTA=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM4PR10MB8218.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230040)(1800799024)(366016)(376014)(7053199007);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?S2XxaLpqwlsCnzMK4XZoEr28C0rJ2EGgtHWlyHGF0KVlE7zYA0z9627bw5sZ?= =?us-ascii?Q?y/G97gzqr99tWHf0vyg17CrbQaWelzNfD6J6WOWyj+BTYdw+lbHFq0DX9nXa?= =?us-ascii?Q?ilLCarYH9OyaIEjDPyzdoySYER3goi1g1IBACqc5KaBu6SZsWZ1Z50vZNQ/H?= =?us-ascii?Q?5XNuZKG1AHJdavRnithMk9MwKVa7NSdqk0hONTSU6ne30YQPGeJW2K+VBRal?= =?us-ascii?Q?uOKsEK5Ld9TVdCGUYaqL8L+03nAjO9m1hJsXyUDzlQcZdyyYztA9sPaEurSp?= =?us-ascii?Q?SzHh7FwMchq2Q9KzL3lSaerFa1BT69TACvDXuKmNPTrrFolZNNOc2L0PlQg1?= =?us-ascii?Q?HUgbNTxrTQayITESI5pkGJ8O7TxKpsBArrrpOvj/ThUYCyWNoOBnJr8I+gIZ?= =?us-ascii?Q?94xgUR/WO8MlM+ttBAFdb+HdWcvMMV1HmlipYyowNHIIfXudVxVGC98S0DT1?= =?us-ascii?Q?AxhOlG4JM9g/WW5Oo8RwuKFIO6x56Dlithg1f7lKysqR8Ecvt2goqOstGuEj?= =?us-ascii?Q?PenkpiJoJ+FBES18tyHfVRCNYZYu6R6vHc+/VEe5ysaE1Q12wXn/6U80u/2i?= =?us-ascii?Q?1aGFn3IKgGpbs8d6bPw/MDEA2WHB50xWTbXnv4lfh7P+DHvG1htsrkWg3pa9?= =?us-ascii?Q?SYhvqI07Mw9HLrjWz9RFCxNND9RXvwOBAc9IjViE6MXeyEPGHCkihXEzFuYp?= =?us-ascii?Q?EhM0NvAoSBLkXlv69pMWZzGJIqnLchaXCZoEsLke9GPrNSdrrGl/FGEAmR2m?= =?us-ascii?Q?lanHjKtMug0bK13y2D5x4xzpYAPah9aAX596uN+Ew5fv5QtRTi3l55ccm321?= =?us-ascii?Q?zfRE5oHe7DUPpmRTfA2hNa9ByaLUVO4KPtCHkcSroy1dM/x9JbcnNi18Q6WX?= =?us-ascii?Q?yHKwiTRfVAsVCJExv3V1IEfPUxAJqCFVjjcKUlr/g0Q/W+CZkHBgNHm90F/6?= =?us-ascii?Q?DnH9jAQ7p553MHoNueQeMx5IKv9LodxxYiP/jQc/qRaCXj2gAe1NIDmlpq6R?= =?us-ascii?Q?/tyvH3kRcWm0wGVXwk/PPgF0HMofJMNnm3dC0YX2dY6vxwn8BwK9YkTNH6GR?= =?us-ascii?Q?7loCxslvTZd5S5ki+rbgbbLLmNYkK6kENc4mGe/qKW0EaSQGhP3QpdaZ+J4L?= =?us-ascii?Q?BxctFTTc+xz3T4vSqqsojqgkjnmY0/uFGBt4rturX9ravw6Okjc3pKSMc4LS?= =?us-ascii?Q?A02t0N17Sr2wxvvib+t36pZPn7M70BMRqiBnYzS/j1OFGDHwob77I344iX9D?= =?us-ascii?Q?HVAWhl0wJgX4cSS/iZsksVmYPBtqU0aUZMdemHZuAbtDmOoyoaEVkYRR1GKM?= =?us-ascii?Q?V8t9pPF+wtW1X8heicGaOaUsD4wml9EM9//NmriOJ/j/BjMthGoeR/Sk9pAY?= =?us-ascii?Q?mxCRfB2t40aeJfrCiIcvGepCAdfSsxQRg95/OPJrhtNwd8/yBPBIWfIKBFHM?= =?us-ascii?Q?7JBA76PnQON/YugqwXKtC8g1HblEP7a88N11D5Ew710bYyC3h8xDwLwm2Vod?= =?us-ascii?Q?s7RP26Lt7uMjNyT7WZFRPRE0j/LgLEfS7WuDUfsQeyvUNbxseqZv/6Qx7iRB?= =?us-ascii?Q?UWnI9JQx8Dd6xaR3pw3PkeiPbU8ZyQR6qePUsIYdpzT/Axzj244gjU+BTXj/?= =?us-ascii?Q?CA=3D=3D?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: vDa1IIi/oVO9k+bEO6kIZHZ5qWDSZeEWCtenq0tiT2gRE728+PH8farn/gT7pymXZpydA3lHkF3gZzxdyB9zIQJL+8nTLEF1HPlCsxDEg0XMgvE41nftqaV+sLwTkAvwyTJU4RUD9NASbAZGu13tZmqfchwOsoGw/dF1osbymHT3yHgClV+kzd6DUBB7i8SB/tbOsROXYdnqm8Kv1b2nI2UkN68GOpPSishdxKI/S2JhJ8DEkFOHURYM2NZ++M2c/wGlGzlvP3C7bSoJEDUV+nz7zJpn51dTAZCj9sAVYWmXkTioeJxqiFr5PNmnTVUOCRdpkBTV9ohiu35D0aTy/mLt/ih04HNMNWWiqZccKShf+rB0V8SdlhAEf0+cYEJIjocHJrpejzmSX61atF8Afs6AyO9sXM6qlji8XoksJ84clZI0Ia9j98rzEGf4nQ5uMZLemXEXVzfjx5qHgPiqkbBUa0XohougshatBaOBzxWcz+gacfarQpMt2O+U2kT0XtYcD8Dl7GAGuSkLCF+UKuxiJsy5YXutDbOJQeIWkmLhHOrgggPcNKiTED4yeMCjCgT+ebIOS2JGP6pYHHq0oqFjawExkZT34/XjCETy8m4= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 95d78a3b-14f0-4d73-53fb-08ddb58f8387 X-MS-Exchange-CrossTenant-AuthSource: DM4PR10MB8218.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Jun 2025 15:30:14.9631 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 7Wbnm4BpcBeiQJ05aK0vpYIKX4KS4fvn2kBkZ4OKY0ovCk5disGa/EMjxr3QijGi4kHyXoRXv7hFR249f037+Pf8A/HubZvtja364eAgYVg= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH3PR10MB7161 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1099,Hydra:6.1.7,FMLib:17.12.80.40 definitions=2025-06-27_04,2025-06-26_05,2025-03-28_01 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 bulkscore=0 spamscore=0 phishscore=0 adultscore=0 malwarescore=0 suspectscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2505160000 definitions=main-2506270126 X-Proofpoint-GUID: Q1VbcPMVrmkPFNlG_F0eLZBBEioFwTgH X-Proofpoint-ORIG-GUID: Q1VbcPMVrmkPFNlG_F0eLZBBEioFwTgH X-Authority-Analysis: v=2.4 cv=cpebk04i c=1 sm=1 tr=0 ts=685eb910 b=1 cx=c_pps a=e1sVV491RgrpLwSTMOnk8w==:117 a=e1sVV491RgrpLwSTMOnk8w==:17 a=6eWqkTHjU83fiwn7nKZWdM+Sl24=:19 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=kj9zAlcOel0A:10 a=6IFa9wvqVegA:10 a=5KLPUuaC_9wA:10 a=GoEa3M9JfhUA:10 a=QyXUC8HyAAAA:8 a=8suTRfrAFwa9obAF6TUA:9 a=CjuIK1q_8ugA:10 a=LIGZGoaQJTYA:10 a=4EqGVQd47fwA:10 cc=ntf awl=host:14723 X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNjI3MDEyNiBTYWx0ZWRfX+TDdUKRJfRfg 6n1DoWKTWKnsB4G68oJATF3bodlXEBK+OslUbTR516nGfOSqJjKru/h0iKdJQsKWCISjhORXFIG Ge8Q31lACeNg6+WniHV9c3X2ZTPljAebCEFatNe41sJ2O9LLtkzlGyQ+K6oXHeBSukVm+3+zLXk qkU+lxLek/8kFLWOa6FUYnALMoS8AUYK++65l/l25Tr/rJRFfMDTKgc1mEewcI/PCmMIm2/5QBx I/WochLW7AsFc4htC0uM1IiFnTShZLoLqHIdy9vPIZoeqSdemq+ABHLK9OZTLxJG3vWMQESnBk0 YlCbPsq4kTA9yJSsgMbHbLSVvVY+kOAR6h5OxwMHiZooJhwCFrTFxNXIE0vg7AMEcqiI0CjUOG2 +dAKjBvubWu0VMM636vgUjD7ariKSjSKxPJbhR4MKPcrG0ru3TobkAJH4NhF7AAAfbEm3ULg X-Rspamd-Queue-Id: 839E2C0007 X-Rspam-User: X-Rspamd-Server: rspam06 X-Stat-Signature: 4zzsh3uhg1phowitzn59x71wx5p9183a X-HE-Tag: 1751038227-199181 X-HE-Meta: U2FsdGVkX18d2xKpKsqegQj79HmdeZhxfGol9krxXW0XgA0uozfXBwuAhJi/6LAQHfninCVbT/mYcl9MUlRGkzfhz1yi708abqFRC29Nhm6FncGLlfjIImzy8lY5a4VE3p+h1hO/q5uq8VOVk0X1JCrhiWKAu0PtqVcFW/E5CM7n+djtONMvZ5BLF1UphrlC4I+NDIOOkLpQ79NRdbsSD9QEW1jWU3YZEH5QsIApt8qPtyBuDT9id/gyjJmmCVMQ46MuwLVq1A+finfqlaoPyunE331TRc+lGCK17MTX0qvK84M0E7hEXV+YNXSj6VDlLBSDWDkwGxzTimQ0q75oYGfyd04PI5t2iLuebxVw5ScbB6c/WlilGOxSwXo+3V6Xs/Bn4/SIgEh4SRhP36Mylw2KbWuHu0FPLb9xJuJ19c22o8i+XapNfkXEOltra6e33gFG5qj0GnHtgNkvSGz6nUc+b8718LricgaSBatHuiGWOJxgx/g+ZGjN+A7AlzU5HnP9AxU83sb5dWaDUg/byDxcCJ3PqJbVkbDPpUgoDn61FN0t8b5ESSwVmKSVOmBjVzFFTu14RF/9BuHZ8J+JPL6NopWTDzFxDagIu9LdiejqZik4BGF+vKVgkxdc4Uv/Fc/foVre9Gz/HKRANbcedBO1zzx59KnKJ2mSko5A7UgjfoDLWK1HqlinepcK4po4S5i0W7YVYEwzJLhHDe9dDBOTNbIa0iz+0jXBMZH4iJnr2eevTnkJmOGEp9UpjtebUDpVAG5yM6mGtQzszuu3U2J6oZET/f07HOevPBkA3rWj2b4JXbXtzjHPzO0Vf/QspFH8iE84ejiizTBbx79ZCmIh44MR7nBOYlbGWL/NeiUTDtD7/MfnGNPqIbK6/gmIWVFgX5GGn7gxucLz+vkh3WP/UgmKZ3O1JvGlKxwnOG1qzyQYe73lV9v8DvGkhUrCDO8dev+wxLFRmO1zvdS GD1csfIg SZkUJ X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: +cc Vlata On Fri, Jun 27, 2025 at 04:09:16PM +0530, siddhartha@kenip.in wrote: > Hi all, > > I wanted to share validation data from a Hugging Face-based AI inferencing > workload, > which was significantly impacted by the THP alignment logic introduced in > commit efa7df3e3bb5. > > Using transformer models with dynamic input lengths on Intel Xeon (Cooper > Lake), > we observed up to a 3200% throughput improvement after applying the patch > from Oct 2024: > > mm: limit THP alignment of anonymous mappings to PMD-aligned sizes All congratulations are owed to Vlastimil Babka for doing this, cc'd :) I gather he enjoys novelty beer mugs as tokens of thanks ;) > > Metrics: > - Model: BERT-base > - Inference engine: Transformers + ONNX Runtime > - Kernel: 6.6 vs patched 6.6.8 > - Batch size: 8-32, input length: 64-512 tokens > - Metric: inference throughput (samples/sec) > > Thanks for the fix -- this change had real impact on a production-relevant > workload. > > Best Regards, > Siddhartha Sharma > ISV @ Kenip > Solution Link: https://www.intel.com/content/www/us/en/partner/showcase/offering/a5bHo00000045YUIAY/deadlock-clearance.html >