From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id B9C56C04A68 for ; Wed, 27 Jul 2022 22:48:29 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id DF4CE94002A; Wed, 27 Jul 2022 18:48:28 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D7DF9940012; Wed, 27 Jul 2022 18:48:28 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B829694002A; Wed, 27 Jul 2022 18:48:28 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id A35E7940012 for ; Wed, 27 Jul 2022 18:48:28 -0400 (EDT) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 66615AAE68 for ; Wed, 27 Jul 2022 22:48:28 +0000 (UTC) X-FDA: 79734370296.12.D2D8C5D Received: from mx0b-002e3701.pphosted.com (mx0b-002e3701.pphosted.com [148.163.143.35]) by imf30.hostedemail.com (Postfix) with ESMTP id 8291C8002D for ; Wed, 27 Jul 2022 22:48:27 +0000 (UTC) Received: from pps.filterd (m0134424.ppops.net [127.0.0.1]) by mx0b-002e3701.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 26RLjLmZ005838; Wed, 27 Jul 2022 22:48:11 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=pps0720; bh=8/1/oT6pRqj6TaF6XeyLwtCa1VySnDqM4Bs2jDyDmww=; b=VfwO/QLWScyIyQHZuuC/rJ9ot3lvuq5KDmzzpkUDnB5QnFHTG+3l5maCa2B6n5+PGINM 6JKdkdcjFlok6X4v99zaHgKgTRQioprkihSvbNWp9hx9Z5YvB/ZAq8/f1xt8gUvMwqKM YMaVbqxGKnjcWp2epGRJjY8vf96hUeRoBzv+gKg60mKM+bQa35DxWc6lxTKOWUJOML4H ZQMvv5ZHIFKEb0iUXEs4Cpj3rWWqtjibA3O+pArHK/fUovJctDHp94HGD/hd8oimeA/8 IcScICXraZsTqnW5sOcRfcSFFfDSG5Qr88DKCSaBJecHwjbyZckyRz0hMsUd5T4o+b7E 5A== Received: from p1lg14880.it.hpe.com (p1lg14880.it.hpe.com [16.230.97.201]) by mx0b-002e3701.pphosted.com (PPS) with ESMTPS id 3hkdj28axg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 27 Jul 2022 22:48:11 +0000 Received: from p1wg14925.americas.hpqcorp.net (unknown [10.119.18.114]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by p1lg14880.it.hpe.com (Postfix) with ESMTPS id 4F118801ACF; Wed, 27 Jul 2022 22:48:09 +0000 (UTC) Received: from p1wg14928.americas.hpqcorp.net (10.119.18.116) by p1wg14925.americas.hpqcorp.net (10.119.18.114) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.15; Wed, 27 Jul 2022 10:48:06 -1200 Received: from p1wg14920.americas.hpqcorp.net (16.230.19.123) by p1wg14928.americas.hpqcorp.net (10.119.18.116) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.15 via Frontend Transport; Wed, 27 Jul 2022 10:48:06 -1200 Received: from NAM04-MW2-obe.outbound.protection.outlook.com (192.58.206.38) by edge.it.hpe.com (16.230.19.123) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.15; Wed, 27 Jul 2022 10:48:06 -1200 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=YBx2EErnVI1NeN58gtjAoWgO2NdBfPq5A4eeiZysp1qKKydDsf7kUCWoy/WXM9mslhSS1mgtOlbBHWB99UXBl0ubwvZ2XTwRfzsvaB5Jz8jKRngoOwEBiBN7777DCbflF0CVR6qcZ4xgwTxfjAjcOHQDnfxxWb8Z8yhh7qixiRrLX8aEO3CLXPZyoDjNQNIGvWeA8z6OE9s2qxzEq+bTloUImjHs+jIE1BnQRv/sc2CXCFUy0bG6aPS7cvCD/KMVGCjJwUcfEBcH/zc4/aox4DAnVKc+ZpaFpidVnbOOJLm+ZKyhB7+D9AVHCcZNDy0XaItur80aDOh1URMkVbfjDw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=8/1/oT6pRqj6TaF6XeyLwtCa1VySnDqM4Bs2jDyDmww=; b=hnyBw2Sa4/V+oJVTHhT0kKcNNdDqzoBajoc1TWGm0aj3F+we3aiGY1zdBKsd2w+xHa0MueLpIqgvIAxpnGupnwEG0oWfkk/JFKeHnwoRAtsI63/+TvchOfqjb1dnJ5Fc+7Nr2+gqh9JIb2WWMUlSkGjgiskRkGebUlQCGwjH7+kENkZSBa4Uu7yYiJr+yZ7Ja/IvUuzwy7EN+oPO6Ct6Zz1Ao04Yy59+VqGqVH9cLzhAyDBcvC6/4fRYVtKBq21LIfm/HbiMYJvGOcSLIm+J/W4spNAQMqDBN6iXYpoBGHZum6zE4WjUdRejlUpo3d6LgcWSISKZoy9gPy9tkvGBIQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hpe.com; dmarc=pass action=none header.from=hpe.com; dkim=pass header.d=hpe.com; arc=none Received: from MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM (2603:10b6:303:1ab::18) by PH7PR84MB1368.NAMPRD84.PROD.OUTLOOK.COM (2603:10b6:510:152::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5458.25; Wed, 27 Jul 2022 22:48:03 +0000 Received: from MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM ([fe80::e5ce:e8a5:d075:8bc3]) by MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM ([fe80::e5ce:e8a5:d075:8bc3%6]) with mapi id 15.20.5458.025; Wed, 27 Jul 2022 22:48:03 +0000 From: "Albert, Des" To: Matthew Wilcox CC: Mike Kravetz , "songmuchun@bytedance.com" , "linux-mm@kvack.org" Subject: RE: Additional Huge Pages Thread-Topic: Additional Huge Pages Thread-Index: Adid6fHQyc+9ZzIjQla40Ysx3DpXKgADKCGAAAAYIeAAAu+ggAEA9u6w Date: Wed, 27 Jul 2022 22:48:03 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 5013ed2d-60d0-44a4-b64a-08da702210ae x-ms-traffictypediagnostic: PH7PR84MB1368:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: wdCJaWDnUT4J+Lzpla+z5cPK32QN67kRZoGCbTxSVlEvPcp0lRQFqBNymS5yL6C/BwNfRuMgFvFibcSiTCoS3QezemqrN5VZf0y1MwjnkMf/U1mvWbWvmi2BHz4V1Q3GXdxEvc2Bc6o7uuVx8bRZHZlT//s6wYyc9+MO9byaAoTu3rhLwB7kuYVXeVEsUMSrtnSHTpCx2nntx3gFfFnmQ/wd1JDwiW2Wh8nYhJ6zN403RX20YWqkb164HSkVJiFw6zImL9DNqdZkFvUo4BUwJJQIBk2WgEKNQNd9uFEvJIlQBSUGtBirAkF/mz0MXNITgVnnkl5DEjwrK+Y1JBYYITwqTrrEIBvFo9z51VCF9lIHA3+55oNR+y1SVPyBtwqAstfdQMYvF3lLt5F/8/Ir4ocfV0L8kKjWzsfJaMgh33Q8K1j0EYxOc+DTK9BtiH8V6M1wJxSadDzuKUhPXDlNMmmoz+Prq/BZkJP7b3LzUpoNNGHlRpciJszkimwNAPxgCEV6Ri77Aw8RXccOJykx5vd0FsdBUBBFqnGj7dCNGkh/katJCDSGSfbYuiMTW3qSZlt0uhg8G2bDPvGrJ9Np8LP9htKz4pscJHCO/PFqFc6JRYDJdbjKF7RA1XuKrML7opQKdTqhgZzHCBoMbzBezsI+TGpHRKAnvz29D38H7lO/dQKgahshGnvbsxfJIAVidoRUhYG5NQSzG0+paJ0X4QJpj6lxSsgtEbyEgpEjpX+8MGbLPcyntWQh7tvXRIYau/wmMCyZtWfM+2VZ1LKkerCOccOHsL6lUwAReAJDmlrB5FWaZJWOQQU0El1a4XKE/4v36yVQv6W6etV5bZ4ERg== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(136003)(366004)(346002)(376002)(39860400002)(396003)(64756008)(66476007)(83380400001)(66556008)(82960400001)(8676002)(3480700007)(66446008)(7116003)(7696005)(6506007)(26005)(478600001)(4326008)(55016003)(66946007)(41300700001)(86362001)(76116006)(9686003)(71200400001)(186003)(6916009)(122000001)(33656002)(53546011)(54906003)(316002)(38070700005)(2906002)(8936002)(5660300002)(52536014)(38100700002)(14583001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?lWpWm2v7if/r/KbpiN0nWpJjng4vcb0CjYJsqd9pvGuuk+xNRzrUTRWm33yg?= =?us-ascii?Q?LA4wP/yr4aCXyg9l1Sc9QhKVNFiZ+doDPwXDHI7L1gIEkCg/aKxbBp6PZsDK?= =?us-ascii?Q?+Vc+tRq8MJ78PNDCoxaLKfyzVSs2uN8lPXPrgjHymQ8+2OQflMUT1G8OYfQS?= =?us-ascii?Q?bn6Y5l7JmnQMwiJiwFc51R/7AvcR0rsn/hGVgGwQm13K6cGRqP3Yfzhd8QdJ?= =?us-ascii?Q?V0snC8G6fUlLloaLg01V4YDxqZgqrSFQTGqe+gLLc3VoSHVrQWMR85iG2n9u?= =?us-ascii?Q?mqRligO4c3HKN6wpudavnDpBLvlgtBfYbD5rZe3Tt61UEt/k0Yui5oobEIVD?= =?us-ascii?Q?Iqjim0EB3Liasr/b//GxNwd98wKSZly7In5a86WVeemICd0jSTAUWC80hT3Z?= =?us-ascii?Q?mhdVigevCG/9XCQyXqDQ8MTiFZlRmNzKAcvI2/r0x9o4bh6yhpF6RB8v5JmH?= =?us-ascii?Q?ktwN5JOFnrE6jDJ4qwA+IoQ4lAZx191xseTvzHr1WwnfJRMmGs2cF9SbX31A?= =?us-ascii?Q?Bln6Z7EErGcOS20M+SRf2GHu8J3MFrMjfY2cRaghh6iCSq2asbjBnm59yNG1?= =?us-ascii?Q?FEfmZTpC9UnnbV59xl7dgAwAZ72Z031HkND9ErwPu2OGRvvYqEdL4qGpFG3I?= =?us-ascii?Q?5Do5TZBtBwFC+6SaARPnkrCWZM/G1ywL6ZX9EOEJm1PgND2x9BZBgdiHA0t1?= =?us-ascii?Q?yvxeU/sKDRhAhKHs7+WEXUq1CZYC3Oz5pXUgtzgsb/u2zLTpCau09YJcCecm?= =?us-ascii?Q?hhy8dkrnqwxLbTVGmBNgmbRPRDfnJeEUwerau84YpfwRUwQP90PYvbZjt8qJ?= =?us-ascii?Q?D+w691ISA8Zxv5XxtZmhvhyL2mn3ZNYWFvtGOKHCVYp4ktzApszlh/ke5Nii?= =?us-ascii?Q?S9Cov2yIZTjlQXC6fsRDqpUeiG1IaRAzM5g5sll43U5EkUDwE/jpmnTIAB6R?= =?us-ascii?Q?fqHXb7F2neoyOsB5cIXmIPttV05Z1qkbo6XH7iQFId+7l0hIRelxFVYhnhHB?= =?us-ascii?Q?pqfoKCBTsgQQ1L4xnRItJIJwGJ+He69RKx94L2uD1uZI1nQ7joEOeWyM50s9?= =?us-ascii?Q?LxGPjW5FHkafD3j1y2HuW1QTRFWGz0b4tOrHXAOgtf57ulvuyx3nXNR6UrZH?= =?us-ascii?Q?VBmpcMptjCa4gJ02gHxFcbqKfWWgzvSFp3lLHQrtxEm1WkaTOLaLdMvQbpgj?= =?us-ascii?Q?lPOWrrT8+WJAL+uWOBDt+l9ql1p0cZ4CZzSHDKd3DG1WEvCC98dvhIM9XwCS?= =?us-ascii?Q?LlgMdqSc8cYB+dcYeVICoiiHKZrGttuRK4dZqfOQaBq0muAbYbnzcTeTIn07?= =?us-ascii?Q?LXkaqPIBy9uMrm/K5r/G1xQQgkL+5Un9D4EyN80sXSYTTQkxc94G2Zixe/53?= =?us-ascii?Q?nSaHuzht9bWVFadpelzAndKSeCapa9iDOWqQdVIpWQh5FWzrKXqL9/g0m+ww?= =?us-ascii?Q?04vozVWaZfyuVasWanGnjo9w82Ouuf1OrwfmkwMEB/o1dKzJzsVxOePE02fi?= =?us-ascii?Q?rsO3/Mg97jbmyJTwZuLDJBgRYB4HDqOxZT/InTzvLm7asSUCd/1whJqFh4Kl?= =?us-ascii?Q?dxXvL0trwG6sJnLWxWg1lFoetZIuO1+vx4jyWy5i?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 5013ed2d-60d0-44a4-b64a-08da702210ae X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Jul 2022 22:48:03.6950 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 105b2061-b669-4b31-92ac-24d304d195dc X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: nmq4jXxyqvXd8SP3qEUfSmP3M0PvcYHsR60somYUaXla98RvYdxhG5Uoqypzv3oTKciZjZnWBxJP8yMlWJSppA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR84MB1368 X-OriginatorOrg: hpe.com X-Proofpoint-ORIG-GUID: bHjfM758Tjoal5HLrsaDKkQzTKnWPNq6 X-Proofpoint-GUID: bHjfM758Tjoal5HLrsaDKkQzTKnWPNq6 X-HPE-SCL: -1 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.883,Hydra:6.0.517,FMLib:17.11.122.1 definitions=2022-07-27_08,2022-07-27_01,2022-06-22_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 suspectscore=0 spamscore=0 clxscore=1015 bulkscore=0 malwarescore=0 priorityscore=1501 lowpriorityscore=0 adultscore=0 mlxscore=0 phishscore=0 impostorscore=0 mlxlogscore=999 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2206140000 definitions=main-2207270101 ARC-Authentication-Results: i=2; imf30.hostedemail.com; dkim=pass header.d=hpe.com header.s=pps0720 header.b="VfwO/QLW"; spf=pass (imf30.hostedemail.com: domain of "prvs=0207e17860=des.albert@hpe.com" designates 148.163.143.35 as permitted sender) smtp.mailfrom="prvs=0207e17860=des.albert@hpe.com"; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=hpe.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1658962107; a=rsa-sha256; cv=pass; b=6THc3t2fhswx4HM6Yxv/O9sNbyhkh9kmjYK/UvaSt7lpfMDq4QK3ESDPXkBdlrrANzmF+8 aVybe8t+d7zjpQYEMHrkJ5jI7DQHMjvzcm3AV9id9CUz89JOTDXZN/LasH9WR30T0V9dnQ QAIwNsVtDyo5EpX5mfQeaA8c6kOjsbU= ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1658962107; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=8/1/oT6pRqj6TaF6XeyLwtCa1VySnDqM4Bs2jDyDmww=; b=AsiOg/rebDTgQcbYXLNAySYoXZbu73Ypo0HHziswIeHLuD3ucA4N6s3mZtDa0ow6wwZelb fVgX0JRdxbK6bxX7P7sI3jhQuy2TsRaze+Q9U/8pNtmHpgRSnmxHyaLuK6C3jbhWwo+yXF s2e+YtoYI65f5XAUSFLQbQy/BBAyLdo= Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=hpe.com header.s=pps0720 header.b="VfwO/QLW"; spf=pass (imf30.hostedemail.com: domain of "prvs=0207e17860=des.albert@hpe.com" designates 148.163.143.35 as permitted sender) smtp.mailfrom="prvs=0207e17860=des.albert@hpe.com"; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=hpe.com X-Rspam-User: X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 8291C8002D X-Stat-Signature: zbfha73iptmjczwmboag7ub7kzthdgm8 X-HE-Tag: 1658962107-539030 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Matt I have discussed this topic in more detail with the primary maintainer of t= his kernel code. He confirmed that the additional huge pages are currently = of most value to those who develop software that supports the HPE Slingshot= High Speed Network. It is therefore of considerable benefit where networks= access large areas of memory with PGAS (Partitioned Global Address Space )= or Symmetrical Hierarchical Memory ( SHMEM ) Because these programming co= ncepts are relatively specific to HPC, it seems likely that it will remain = a niche topic. =20 I suspect that there is an assumption that offering code to kernel.org will= , in some way, reduce the HPE resources required to maintain the code. I do= ubt that would be possible. In the opinion of the developer, the primary be= nefit of contributing code to kernel.org comes from ensuring that other cha= nges to the Linux kernel do not adversely affect the kernel code that HPE h= as contributed and will continue to maintain. =20 At this time, the primary maintainer is dedicated to other projects and is = therefore not available for more detailed discussions. My primary goal has = been to establish contact with the appropriate maintainers at kernel.org an= d seek responses to the suggestion of offering the code. Des=20 -----Original Message----- From: Matthew Wilcox =20 Sent: Friday, July 22, 2022 12:39 PM To: Albert, Des Cc: Mike Kravetz ; songmuchun@bytedance.com; linux= -mm@kvack.org Subject: Re: Additional Huge Pages On Fri, Jul 22, 2022 at 07:20:51PM +0000, Albert, Des wrote: > This is the first time I have heard of the folio abstraction as the futur= e for memory management. When you mention that future hugetbls work will be= based on that concept, it seems unlikely that there would be interest in c= ode that is not consistent with those developments. I also doubt that there= would be a justification to 'update' the code to be consistent with future= kernel developments. >=20 > I am therefore forming the impression that this idea may not be of intere= st to the Linux kernel community, however, I do not the detailed technical = depth of the development team. >=20 > Do you have some more information about this folio abstraction plan ? Hi Des! I'm the lead on the folio abstraction plan, so hopefully I can be = of some help. Folios, like your Cray Hugepages, broaden the supported page sizes. They were originally conceived for relatively small page sizes (eg 16kB-256kB) and have been implemented so far only for the XFS filesystem. Other filesystems are in progress. This is the first hint we've had that people are interested in folio sizes = above 2MB. I think the folio work should make supporting this Cray require= ment much easier. It's certainly good to know that this is interesting bef= ore we do too much work on converting the existing hugetlb code over to fol= ios. Are you able to direct any developers to help us with this? We can d= efinitely work together on this project; we've had a similar collaboration = running for a few years now on the Transparent Huge Page side of things.