From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E8D86C7EE29 for ; Thu, 8 Jun 2023 21:24:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D96CC6B0072; Thu, 8 Jun 2023 17:24:05 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D46B28E0001; Thu, 8 Jun 2023 17:24:05 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B99A26B0075; Thu, 8 Jun 2023 17:24:05 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id A893C6B0072 for ; Thu, 8 Jun 2023 17:24:05 -0400 (EDT) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id 7BDB6C02C3 for ; Thu, 8 Jun 2023 21:24:05 +0000 (UTC) X-FDA: 80880858450.29.3A291ED Received: from mx0a-00069f02.pphosted.com (mx0a-00069f02.pphosted.com [205.220.165.32]) by imf11.hostedemail.com (Postfix) with ESMTP id 127C540008 for ; Thu, 8 Jun 2023 21:24:01 +0000 (UTC) Authentication-Results: imf11.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2023-03-30 header.b=kwRUqYHR; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=DsrzWiHv; dmarc=pass (policy=none) header.from=oracle.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf11.hostedemail.com: domain of mike.kravetz@oracle.com designates 205.220.165.32 as permitted sender) smtp.mailfrom=mike.kravetz@oracle.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1686259442; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=8DGkLZf53+pryfLgvh0el7simzbeAmq/yWxeMMGtyu4=; b=2w1FMo52HzSEyESPnW8q21b/WY7VeQ5T8cmNsrIefwe52b5dj6RyFoMS5zCsQAHEdkC5l0 yrglwfPrUjksvYR449H1IhM6v+8v6GF/jPf648IK8GEW8WiPl4zo+03gyeMC2+8B0xADIK u0r30UKodoUoLg399P+o9QTe1Mw4NTU= ARC-Authentication-Results: i=2; imf11.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2023-03-30 header.b=kwRUqYHR; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=DsrzWiHv; dmarc=pass (policy=none) header.from=oracle.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf11.hostedemail.com: domain of mike.kravetz@oracle.com designates 205.220.165.32 as permitted sender) smtp.mailfrom=mike.kravetz@oracle.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1686259442; a=rsa-sha256; cv=pass; b=8XOnSum2uCjVGuHLJUaA+TLRkWV7pquJ7XXmcFcgEtmDAZZH39rAHGBh6msoz+lkMTOndD S/E1dwJ3NdakVink6AEPCFVZyMykb+MAl++p76JBH4pgv+aORwsmhItcbG12aIJwdKtuRj tEwstUsfW9uUNnNEyN2yTI0h5KGj2yw= Received: from pps.filterd (m0246627.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 358IoRFx009050; Thu, 8 Jun 2023 21:23:49 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=date : from : to : cc : subject : message-id : references : content-type : content-transfer-encoding : in-reply-to : mime-version; s=corp-2023-03-30; bh=8DGkLZf53+pryfLgvh0el7simzbeAmq/yWxeMMGtyu4=; b=kwRUqYHRX0LsUJDjqTZIe3WduxKNiaSmDdpbAHe8hajCnnln/FoJBruDPctw7XpQBWZo XRS8TM6XPf3TmsEgihjpKl4NFn6lsQ5yWPn0DjwBwfkN0AwH1jYjfjFFKSYaqBi94SCK aW81fnIX1KHltT9I/7+GJI16WOwKT8c9Z4oFbqELYRuENcWFG9dA7nj3/hFNgUN1CA00 6zTKI8awCvGfmlMFwr9yubOtk95dP0EnFGxasCA9M5GMXGfv+3D7RqEhp9SkSr3CzoTY /UF9yDWXJYpdfqVeMKk6hkijLEbiBMJsYZtNkTilAiqt8EQRxXI+GELuWcnBwjBcmRsE Dg== Received: from iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta02.appoci.oracle.com [147.154.18.20]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 3r2a6uw88k-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 08 Jun 2023 21:23:48 +0000 Received: from pps.filterd (iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (8.17.1.19/8.17.1.19) with ESMTP id 358LJAlj010513; Thu, 8 Jun 2023 21:23:47 GMT Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10lp2109.outbound.protection.outlook.com [104.47.55.109]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 3r2a6seayp-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Thu, 08 Jun 2023 21:23:47 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HaddIxi9MID5Inl3gso+VjSOJ5dsIEsUSoLTgqQYyxMXW5DTnr9Q3csyBx0bpu+5IcbyiD0BHwVyGSqkEXCi2j0gM5WdgP8jQzB0dGxoaZ8t4f3s6b8Ij7E+PHzX9ij4DaRjvZPNkRYrE2c2vQdMNYRVdVELHUbysEZYUyLSkaUSWGvhAkey/IJgyNMeMMaZL5KaGO79caZkEfeTmSTtEML9lyri+sKAqfFKpdjmpYOOw0GjgM0roUYCf3SsAuidq0BVhtAPxLPKRLEUECbj2+gP7CdL9xiLgn8TNSUsWqnNCUD9pbRet+1gEX0Zrdv1eYxQ6SFt1OrzP5jObYQ4jw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=8DGkLZf53+pryfLgvh0el7simzbeAmq/yWxeMMGtyu4=; b=RpUJQT73FeXZx9AkKdExZ+u0Xz6q5qy5O29j+nDhrtlRqp5PKus9OgYW/YlnYP1akdr6+d8O8p0Tx2nvsSePgoZE6wAnYF/sOWiM/G3btXuEDk0Yv0qQb+PbAWBzOyzSOy5scoYTueRyhLQX1DZvTBZPcpWLI1KuSadW9IRx7PXfYDnPgKkickvoUMMuT1BzeISVzhwMa1O0EfkzJEMcxXjMfk2asNxwy9o2YZCi99t1JF5arp/c1ACEo7AulW1rxWKQjmtjI6wQ19Cnl2xYpDjE0OizE4J/epYMLXpy6vavx5//adg0I1oxVlOb99NaD9zhHIeLDBcvqW0sNNs3yg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=8DGkLZf53+pryfLgvh0el7simzbeAmq/yWxeMMGtyu4=; b=DsrzWiHv/4PPY7ifszKGJNXNUYpaKp/pOUSOS4qykpzT7cFTkp5n/rGfP8lbx4c9YJyLKJUJj8yJtxs8bHWTLHG22Zx4f1i5sMfBzXigUrboHU8cBoC4su9UGKE4RRzh5vXIgSicQmsyMlYt/VL+knxJug1i2Lj9JsbrsJK4iY8= Received: from BY5PR10MB4196.namprd10.prod.outlook.com (2603:10b6:a03:20d::23) by MN2PR10MB4317.namprd10.prod.outlook.com (2603:10b6:208:199::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6455.36; Thu, 8 Jun 2023 21:23:40 +0000 Received: from BY5PR10MB4196.namprd10.prod.outlook.com ([fe80::4a17:13b0:2876:97f2]) by BY5PR10MB4196.namprd10.prod.outlook.com ([fe80::4a17:13b0:2876:97f2%6]) with mapi id 15.20.6455.030; Thu, 8 Jun 2023 21:23:40 +0000 Date: Thu, 8 Jun 2023 14:23:36 -0700 From: Mike Kravetz To: Yang Shi Cc: David Hildenbrand , David Rientjes , Yosry Ahmed , James Houghton , Naoya Horiguchi , Miaohe Lin , lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, Peter Xu , Michal Hocko , Matthew Wilcox , Axel Rasmussen , Jiaqi Yan , Zi Yan Subject: Re: [LSF/MM/BPF TOPIC] HGM for hugetlbfs Message-ID: <20230608212336.GA88798@monkey> References: <20230602172723.GA3941@monkey> <7e0ce268-f374-8e83-2b32-7c53f025fec5@google.com> <7c42a738-d082-3338-dfb5-fd28f75edc58@redhat.com> <75d5662a-a901-1e02-4706-66545ad53c5c@redhat.com> <20230607220651.GC4122@monkey> <686e3e61-704e-1258-8a8b-f18399b41668@google.com> Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-ClientProxiedBy: MW4PR03CA0035.namprd03.prod.outlook.com (2603:10b6:303:8e::10) To BY5PR10MB4196.namprd10.prod.outlook.com (2603:10b6:a03:20d::23) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BY5PR10MB4196:EE_|MN2PR10MB4317:EE_ X-MS-Office365-Filtering-Correlation-Id: 043f3b7d-c058-4efb-57c4-08db6866a102 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 2XnE4yaP+//AL2YMR56rypq9kOZd/qT4t/iwG6/UTqBvGY8pazmmcfynWm9ZS/oeCM5x7htaPeYf0Iv40U67Cpte3w18//PG1k3kuQ4rLaTKy/8+ZFpEDJbOCyJzwmrKr+qjVRbOrimkQ4gZXZjZzZ2X1z0EdvJAsZhVfBM16MiDE4oS0sdRtV0u0SWUe/4atG3J8qoFHmhXjpL43269ixd1XkWevpK/3b0FCzzKTK1jv8w564RdgUzYiTqP/BaPGxQr6licgE3QMklWv0p7rwFS0xUjD51Id3vh6GFvYIK91BWuXeg3MSvC0jv4NWkQW/HtUaS1oxT5vL/eSBVH+vXuBOXEl+paJvg0RdE/MHiLYze5a7BzM4ooSdNKkMBtP6AAlK4uQTtpvCpy74hSI10GvoqS9lPJp0euDEWZrfJ5o5/fVTTVCAi93hDuoSUcRN5bgVg2hVcJxwLi5xSjBLZ2RAyUyOJWwbPDwv+ImI8QrwUu1xQ8kbQEPdqH0wfqjCFPP1oUalGe3WyykEDrvF5XwLSE3fF7yOlx4kx0aIApz3ZS+ByF9OTUJnVl7eQo X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BY5PR10MB4196.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(7916004)(136003)(396003)(39860400002)(346002)(366004)(376002)(451199021)(83380400001)(7416002)(478600001)(8936002)(8676002)(33656002)(4326008)(86362001)(66476007)(66946007)(66556008)(6916009)(5660300002)(38100700002)(41300700001)(316002)(6666004)(6486002)(2906002)(54906003)(44832011)(6512007)(33716001)(186003)(1076003)(26005)(6506007)(9686003)(53546011);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?MTRKaFdCTU5jeDVGdjc1QkZ3SHBFSks0bWVEaVdQVFF4aWE0VTBsZlZXY0Vs?= =?utf-8?B?eXFNTjJlYlVQZVlzYmNYa1VLalNTTm9kV3J3VDUvNThPRUhMSmg2b0VRTHB4?= =?utf-8?B?Tjd6bjV4MEpwbEVnTzJPb2FEVSt6Y1hkQnh2ZldCTW1TUFZYbk5LblNYdXNi?= =?utf-8?B?NHVIUmtTNXVJU3dYb0FtbXpLSCt1dlhxQXNYOEZaODlHNG5RcVhlalR6UUNO?= =?utf-8?B?ZVJ4b3k5VDJmdG5lZWx2UWNjbzltSGFzRmE5VWdrZ0ZDVDdwenJVOWhUcVVV?= =?utf-8?B?NjdNWGNQT2NqODUwUks3N2F2SUNpalhkYnNOK0g3Ti9uaGdXTDNmVklhN3FW?= =?utf-8?B?Q2xYNEVSYmY3b2tCTGVncmF2enpXWVZ1VXpodGtGVkNoNUttMW1EZzZsa1FR?= =?utf-8?B?M0QrckxydXgzdG1rU2VqelcwNFFITU0wQVFma0Z5QTFWWWJwZlk5T3V4Wnk4?= =?utf-8?B?VFpuQzlFNHNVV0RvTjIzdXFvcnAzdVpERy8wMExDR0lhem1FVCtoVkJLb3Bp?= =?utf-8?B?aDF0eDNZaTYzdm1IUVFYZ2RmcEk3KzV6TkcvZDBrTzRrQ2FzZnhWa2NuM21N?= =?utf-8?B?S2cwYXhoZVFBY1NPRkg2NGdteFR0bnhadDVSbW5iOW1ZY0w4cmJKMkJ2cmlk?= =?utf-8?B?aTNUci84a25FVG92RnVxODNqU3BjY0tNenN4TEhuVFFYZE1OcUcvcGlZN25k?= =?utf-8?B?OEZHY3hmeU1jbmtab0ZSQ3pKUUxpc1lOTDVCYytEcmNUaFdYSjF5YVBXNEgr?= =?utf-8?B?dnJsenNpZmYvRDh1c21QWjNTd0Q4aEdBaE1qZkFmQ1ZvaDAybk9FaXcwOUtj?= =?utf-8?B?RnlTbjhUZHRaVXdrZWNhQzNJNGZTekN3MDhHajdzMGZzVFI2NlNwUjJGaW92?= =?utf-8?B?L2lhdnBBTktpdk85RFhLczlXbE5DaERmZkFoK0FKaUk4c252amVtWXp0ZndF?= =?utf-8?B?akVmVk1mNE5ZeDY0VGh1S2taVy9mQnFlc1krZlVKazJ0eEc1M3hzNm5STjRI?= =?utf-8?B?L1AwRGRWMm1rQTE5Z1IwNFQvK1k5WmRYSFFhRHIwbDB2L3B6WFNwcDNLME1r?= =?utf-8?B?a0tVc3RZSUxOQ1lKaVVaWjdJRTg2eXVBcUN5ZEFZbmRKY3hoNGxVdURQKzBT?= =?utf-8?B?RjBnVFpOWUpobVlNR1B5RlZDZzZqOHo4MTJxUTNVRDBHWVVWeHZXeW1JWmZr?= =?utf-8?B?azZaRW1nU0I1cjJKa3E0NzZ4Sy90NzZyRzhUSHpReXYwWmRsK1ZNU0lvQmJk?= =?utf-8?B?TEtxRVc3TUZwY3E1QzhOZmxFdENnSDJLN21jU3hKV0RsdkRLWnJUUkxaM2ZV?= =?utf-8?B?aE8wdHVBdE1nZHU1dUttbFZPYndYTFVxd0FkUHNqYzZWUGR0eVFzQ3RKazlx?= =?utf-8?B?SEJjVXRnVTJPdHp5dkEwanZmNTJiNVhacTIvQ1NubUlsTnpvM2U3U01NVWJL?= =?utf-8?B?a1k1bWhBalNDWWgreVlUbXc1V0ZMZ05TTU4weDBzN20wUi8rYXYvdXdWczVZ?= =?utf-8?B?RkVhZTU0cU93OHk4czFkQmdKR3VDbWoxMGw2aTBYVkhhdkx4MzZtMlJNeUFK?= =?utf-8?B?T0xKUFZzSU1UdmsvUHFPMDNIYWxXMmQrZjA1allIaUttS3FZY1B2cXFUOFRp?= =?utf-8?B?M0hZUVBiVnVMOXQ1SmZ0emJzalA1NWNUU1BDN1F5MEljek8vbmdzVW5PVWhl?= =?utf-8?B?eEJSR3ZyamtVSTNqb1hnUkZ6NCszRDkxcVlEVWxzSkp5VThOS0ZIdEFzQzdD?= =?utf-8?B?MUZDYUxsVkJVbnVnTUVlRll1R0ZVeWlYTEw5Qit0ZDAzeTI0Z2ROaG1udzVv?= =?utf-8?B?YkVxcytaQWVQTTVyQXVhN2dKVWtsVTREeHhmaDVCYTR4Q3NNdzgrNi9tM29K?= =?utf-8?B?QlgvWlNSRlJoUDlka0ZzMmM0SHhRRHZpTWFXZ0Z5M2FWUkpEREZMa2MxUGd6?= =?utf-8?B?ZWYybnp3NC8vdVhjUVlVVTVpSjJuTFNDZitWSmRNN2wzMFdLMWdQVnlVaVZW?= =?utf-8?B?NGRkZ0RsZUp2Y1VrOVByYUxNYkxYdXI2ckRreTFGWXBPamZvZFEyU1ZJM1Bj?= =?utf-8?B?ejU1Z3BYOWoya3I0MDBjSEluZHRvZ1FFQ0lkK1FRUllkSHVpUjZKdWNRaXpr?= =?utf-8?B?UVB2NUl6RFZnUlZqQnlHY2t1dE5YRy85OXFJRE9HVUVlV2k4cnEwMHlSb1Ri?= =?utf-8?B?Z2c9PQ==?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: =?utf-8?B?bEVXczczYjlyRXFLaXpqRTFmd0VwUnVVVmpHejhDbEJIN3lDV2NCQWZqYnd1?= =?utf-8?B?YVNnT3pLVGlqNTJma1ArdHpmT2htS3VuS1dwRjZkWVRLeU14cDZoeVpuWjRK?= =?utf-8?B?MmU5WDVMYjJxdWR6eUJsRXVFMVc4azZ2M0dBTlhRRE1pNDd3UlJmL1VZSDdH?= =?utf-8?B?SWFMQm1FRnJ1N3ZJaklJbnhIaDBCa2YxTkthRlhjZ2VhOXF6Wit1a0t2V1lZ?= =?utf-8?B?b0ZUZHhrQlVZVGdGQjNJbDZ5Z3o2anJBQUc1dWV1ODN0TEhKcHZ0RzBZc0Mw?= =?utf-8?B?bjF6cU4zcXljazlSUEgyMmVEaHYySThBanlDNnhoQ2VJK1VnNXVtMk5yR0pW?= =?utf-8?B?bUxWbGUvUHFjekJYcjBObHMzTmJ6KzIxMFB2bW4vRUZqZkFnSFpjSnpRdWxV?= =?utf-8?B?VEhlcFc1VFBJZUMyeDI2eFA0dTJoZ25IQm5CWUtCaFFMTWhFSE94MUwrK2kz?= =?utf-8?B?MUJqWC9mVlpINC82NlV3WmgxWkFjR0x2aE9oZlQzdTJkN29ZL0ZUSVBHUWdk?= =?utf-8?B?UE1lTU95bWVWWTl4RnlmNndyN1k5MW1tWktQeW9Lak9lTW5hZVBIY0o4ZCs3?= =?utf-8?B?WEJacFVOWVRHNlRiQzIybUxhUFFaTmo5TVJXUm96Q3orQnV1MTZkSFBtT01Y?= =?utf-8?B?dDBYbG5UTnBLU2xPdWNkZzhEYUoxZjhMeEtRcVJScHh3UjJmYy9NNHpoMVp6?= =?utf-8?B?Yi9mbEpxSHh4VDFsUE9GS0daV0ZsaExJRlJ4ckc0L3dWN2FrV2Z5akErMVRs?= =?utf-8?B?V0x5aXd3Qm9iaVpEeHFOQ2RNQUtsYk96SjVKNjNTbEhvTy81dnVENXpnK2xD?= =?utf-8?B?anRibTJjSFNPZXBFQjQrZEswOThtSDBqMEE3dzArRkhCVG01VkUreDhxRkpQ?= =?utf-8?B?UUJUMjlRS3FSYU5oSXNJUEVZbStaNzVUb09lNmxRZWpqV0c3dDRZVzNYTmg4?= =?utf-8?B?anE2WUJOTmt4b0FFTTh5ZG1Rc01wOHZ1eWJxVk9vUmZlSVN5R28ycjc3Z2Q0?= =?utf-8?B?Z2REU2tKZ3dxNDVzUFM2TXViWllSdS90UHlqb3FqU0dpTWEyd2tpckhzMVBN?= =?utf-8?B?cjNEL01hTUlmNjFxL2JUc3l0R3EzQXZzaTQ0Sk5nQU1JMkhWWWMxdXYvS21T?= =?utf-8?B?Tm5VdXdLbWllVWRabnh4ZDdPMWw5UFNOM1VtZmVBbjduM3VtYjhyZkxKd3Rt?= =?utf-8?B?U2YwM0x3UUNXcWoxRi8zN1dPM2oyYW9DMDBidHp3TkpWL0dadDdsb1Y3b2Rm?= =?utf-8?B?S01HeFFpdG5mbFM2dGlxUUpFOXVZUWM5SnU5OTQ3MGZXSWtJQ0twa3Vsd0pJ?= =?utf-8?B?Nmx6V2pkeVl2U0JZeWNiMjc2UkZGZERZUVV4T08wNnlRQkEwaXhtek9abUZj?= =?utf-8?Q?T5aovgrY508Jf+Eq7BnS6KqgZf3lA5bo=3D?= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: 043f3b7d-c058-4efb-57c4-08db6866a102 X-MS-Exchange-CrossTenant-AuthSource: BY5PR10MB4196.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Jun 2023 21:23:40.3234 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: hRl9nL/RsP4J8yAR+KAoU6YsPcqUP1DDol/OY0/aD9x2RZj9x18e49/J51dfQ1P0i+Z13IRJ6ORkvnV4BkV5Ow== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR10MB4317 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.573,FMLib:17.11.176.26 definitions=2023-06-08_16,2023-06-08_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 mlxscore=0 bulkscore=0 phishscore=0 mlxlogscore=999 spamscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306080185 X-Proofpoint-GUID: YICkMXXsxYFvgYr1A36KyoZ3oooHyEAz X-Proofpoint-ORIG-GUID: YICkMXXsxYFvgYr1A36KyoZ3oooHyEAz X-Rspamd-Queue-Id: 127C540008 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: 8k3ykshuwgbo3r5rktfa1r6ufm559ap6 X-HE-Tag: 1686259441-406249 X-HE-Meta: U2FsdGVkX1/sOjMrMq8ILd9WPOhLounbY9HT5TpBR60z100oVWFabPxz7UA8K/TDv2usRqGkOA3DZzMx8LNbqnjxBFYoFH9lan8/uNVSFhLPYzP9WQ9iLWJpbhMjgyqwiPxmWhlNYn8VEZutMO9klsgFTpumcP/8qn/05E9Lv0JloGd9bunsS3SNAFnQljgRlfg3j4uCVs5byAsEp2/NV9tIT1a5giwk3kaL0BxwIQash/9ifU8mkfaTjFFSGUCNDcBaLm+UPKBeG2HWLSmyA22KCdicVzg55g3mMJrQnNF0Nbqo+sSYvb++mU7akrN2tGXFjXAwYx/Y2V/Vg6+W8QoM88Hday8VImZQBQrQ19y0il7HS7YARPhUe5NxkIrsvReqkgwVpsxAU61pGQwfJ4vQ60zG8MtOg6ACXicPTjS96vAHDuVIg8WpIBcunDyLRDQuLKWfSod6pgNB9zA+AFfOgajWMKcjRR20DcsXCLYcQnAOogKuEtghr+ghJXIb3wBgjiSay6DLzCg3rQS/oTsEB866uQZkYpno/kUo12q7JHLZS4x0S5FGTm6Ocx2RVbw6JSXMZBzwQZ3APZaWxHNNOat+3HubeFWEIbfCpLxkR6P2qmaeQ/2IGjNMQnBkHWkixAqKGAvZPx0dak+HvvAisEFqcE50VbuOTYGW1fH4PVzbdfP1xu6pVROrh4Gwwmz6Sn/yf2QZJC3aKPZ61FjZVKrWpXpCEBfDz77ltABKNIi2xlbSyqO70AZJu/IFRWMzTJHv+Go/f9QneYoHknb24g9ej85aeuC+ZbZzDbHZEUhJrIDKa9L+FIxk/kwncXUHqHT8uHIkhugd6B2BrURtM5vy5r222+15nCPW+j/DtT/W1KW87eDrfw64F7ZWLHbataL12HrDS+vr62AWXcChFydbehdGFF/Lv9G/E1VO1YNRVkZUSAHorL5Jj9/UuzTtrOy6pAlkU1pJTVx xfYbo3+k 0kor+0y0WxvzNvvDxUF6a8yCm36rsBruLaS8wPHJFBSywdKg1dyzSuiXxCCLo13tJh4BGnC7CSQrVQeV5hpniDmKjd9mUlqeKMB+NeI0iqSjE3B9n2rxxZNtEVGBkpx68cCsHp84CouHdFmqv+byX2j25bYuYnufhASYlmEI9B791nNnbq7YPYX7J8StkE87TmiZRcdkPbTAq2Aw8BejduDmk2b6sSGBdIpjMqIWlD351SjLBX00d2/cpjflcNcsYkcQf2B48P6B3CN8JyQ9Mm/sLxxaQfXe78b3/B/16ft8GBhEyui7OxETrOWq+y/hxS7wt3Mr0pG3t+qkSQfMd7bUNNr6CtFUDS6B51fMOiAY4fyiXWtO0wxu0t9FrX/MGpPZkWDJdxVVnziU= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 06/08/23 11:50, Yang Shi wrote: > On Wed, Jun 7, 2023 at 11:34 PM David Hildenbrand wrote: > > > > On 08.06.23 02:02, David Rientjes wrote: > > > On Wed, 7 Jun 2023, Mike Kravetz wrote: > > > > > >>>>>> Are there strong objections to extending hugetlb for this support? > > >>>>> > > >>>>> I don't want to get too involved in this discussion (busy), but I > > >>>>> absolutely agree on the points that were raised at LSF/MM that > > >>>>> > > >>>>> (A) hugetlb is complicated and very special (many things not integrated > > >>>>> with core-mm, so we need special-casing all over the place). [example: > > >>>>> what is a pte?] > > >>>>> > > >>>>> (B) We added a bunch of complexity in the past that some people > > >>>>> considered very important (and it was not feature frozen, right? ;) ). > > >>>>> Looking back, we might just not have done some of that, or done it > > >>>>> differently/cleaner -- better integrated in the core. (PMD sharing, > > >>>>> MAP_PRIVATE, a reservation mechanism that still requires preallocation > > >>>>> because it fails with NUMA/fork, ...) > > >>>>> > > >>>>> (C) Unifying hugetlb and the core looks like it's getting more and more > > >>>>> out of reach, maybe even impossible with all the complexity we added > > >>>>> over the years (well, and keep adding). > > >>>>> > > >>>>> Sure, HGM for the purpose of better hwpoison handling makes sense. But > > >>>>> hugetlb is probably 20 years old and hwpoison handling probably 13 years > > >>>>> old. So we managed to get quite far without that optimization. > > >>>>> > > > > > > Sane handling for memory poisoning and optimizations for live migration > > > are both much more important for the real-world 1GB hugetlb user, so it > > > doesn't quite have that lengthy of a history. > > > > > > Unfortuantely, cloud providers receive complaints about both of these from > > > customers. They are one of the most significant causes for poor customer > > > experience. > > > > > > While people have proposed 1GB THP support in the past, it was nacked, in > > > part, because of the suggestion to just use existing 1GB support in > > > hugetlb instead :) > > Yes, but it was before HGM was proposed, we may revisit it. > Adding Zi Yan on CC as the person driving 1G THP. > > > > Yes, because I still think that the use for "transparent" (for the user) > > nowadays is very limited and not worth the complexity. > > > > IMHO, what you really want is a pool of large pages that (guarantees > > about availability and nodes) and fine control about who gets these > > pages. That's what hugetlb provides. > > The most concern for 1G THP is the allocation time. But I don't think > it is a no-go for allocating THP from a preallocated pool, for > example, CMA. I seem to remember Zi trying to use CMA for 1G THP allocations. However, I am not sure if using CMA would be sufficient. IIUC, allocating from CMA could still require page migrations to put together a 1G contiguous area. In a pool as used by hugetlb, 1G pages are pre-allocated and sitting in the pool. The downside of such a pool is that the memory can not be used for other purposes and sits 'idle' if not allocated. Hate to even bring this up, but there are complaints today about 'allocation time' of 1GB pages from the hugetlb pool. This 'allocation time' is actually the time it takes to clear/zero 1G of memory. Only reason I mention is using something like CMA to allocate 1G pages (at fault time) may add unacceptable latency. > > > > In contrast to THP, you don't want to allow for > > * Partially mmap, mremap, munmap, mprotect them > > * Partially sharing then / COW'ing them > > * Partially mixing them with other anon pages (MADV_DONTNEED + refault) > > IIRC, QEMU treats hugetlbfs as 2M block size, we should be able to > teach QEMU to treat tmpfs + THP as 2M block size too. I used to have a > patch to make stat.st_blksize return THP size for tmpfs (89fdcd262fd4 > mm: shmem: make stat.st_blksize return huge page size if THP is on). > So when the applications are aware of the 2M or 1G page/block size, > hopefully it may help reduce the partial mapping things. But I'm not > an expert on QEMU, I may miss something. > > > * Exclude them from some features KSM/swap > > * (swap them out and eventually split them for that) > > We have "noswap" mount option for tmpfs now, so swap is not a problem. > > But we may lose some features, for example, PMD sharing, hugetlb > cgroup, etc. Not sure whether they are a showstopper or not. > > So it sounds easier to have 1G THP than HGM IMHO if I don't miss > something vital. I have always wanted to experiment with having THP use a pre-allocated pool for huge page allocations. Of course, this adds the complication of what to do when the pool is exhausted. Perhaps Zi has performed such experiments? -- Mike Kravetz