From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1C16CC43334 for ; Fri, 22 Jul 2022 19:54:16 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 376E06B0072; Fri, 22 Jul 2022 15:54:15 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 327EC6B0073; Fri, 22 Jul 2022 15:54:15 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 1544C6B0074; Fri, 22 Jul 2022 15:54:15 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id F41996B0072 for ; Fri, 22 Jul 2022 15:54:14 -0400 (EDT) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id C5080A0D6F for ; Fri, 22 Jul 2022 19:54:14 +0000 (UTC) X-FDA: 79715787228.12.2578575 Received: from mx0a-002e3701.pphosted.com (mx0a-002e3701.pphosted.com [148.163.147.86]) by imf02.hostedemail.com (Postfix) with ESMTP id 4A5CE80063 for ; Fri, 22 Jul 2022 19:54:13 +0000 (UTC) Received: from pps.filterd (m0150241.ppops.net [127.0.0.1]) by mx0a-002e3701.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 26MJouYh017362; Fri, 22 Jul 2022 19:54:00 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=pps0720; bh=zdHzj9ue+k/pEW9DJy4GMd2ISzrKFyMIXAXVuFOhrGY=; b=QuyIEctjBmWpucKn9ov5QMtJOOIWhYh5uGWGifVnrvUecW2mtiHzCUxMvueJniFui7Zn HgluEQvuUGOGyEQV5POB02aQg1/h2fjAkPZAueLq6fFfVAhPD2RG+Y4ZZZ36JyxQRzk9 SOkph6zOnvymryyKfb3577nF56u/NXgZghF+HYz/krMu0D03Qvw4ckTf62atkLlI7Nfy zaXmgQqw6ST3eJ0sV48iAJpYitruG7II5rmyTAmwDQTbIZfcHTxga/5T6Q3ukGbLgxPh 1oD22+67THme+Q+aX65PKcJHAmH5MgRKLxVZAc7z5CoR2sOQ6SUEUCfaaQ6lkBDteudo UQ== Received: from p1lg14880.it.hpe.com (p1lg14880.it.hpe.com [16.230.97.201]) by mx0a-002e3701.pphosted.com (PPS) with ESMTPS id 3hfx9chvst-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 22 Jul 2022 19:54:00 +0000 Received: from p1wg14925.americas.hpqcorp.net (unknown [10.119.18.114]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by p1lg14880.it.hpe.com (Postfix) with ESMTPS id 744A08000B8; Fri, 22 Jul 2022 19:53:59 +0000 (UTC) Received: from p1wg14925.americas.hpqcorp.net (10.119.18.114) by p1wg14925.americas.hpqcorp.net (10.119.18.114) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.15; Fri, 22 Jul 2022 07:53:55 -1200 Received: from p1wg14919.americas.hpqcorp.net (16.230.19.122) by p1wg14925.americas.hpqcorp.net (10.119.18.114) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.15 via Frontend Transport; Fri, 22 Jul 2022 07:53:55 -1200 Received: from NAM10-BN7-obe.outbound.protection.outlook.com (192.58.206.38) by edge.it.hpe.com (16.230.19.122) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.15; Fri, 22 Jul 2022 07:53:54 -1200 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=GuFVo8lVwCNR3bI3pruU1GzZHXG4kecy8GsyALKhKZvTv9lb7rD+YtSK85YjDO01XMQJFyPL4YK62HJR0bSkD6r2yrSY0yDLNZQ7TuhDtECSu3PTjkz1kZFonA1q72LLitGCnYuPqqBqTck+zP+mph/Tz24mgrHr8Cr7Pm532XnNEtyn5jKQnCkKiWs6cDeXuYJ/R2+fev8/b5X3NxuAxoMqX1jb+3GcTXSgH1fUfS8YqsLgWGkAHjbJ4hpBdle+7DnWPtqly3JOwcKTtaFA4mqp1CetWlhqir3nH39jWMGdlTKEIM7/IUZSgC0qSmTDjjELU/5o7EC7nwBy3bqe0Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zdHzj9ue+k/pEW9DJy4GMd2ISzrKFyMIXAXVuFOhrGY=; b=G33dhqRxsatpyOvsZ6MJY6c+Q2U+x4EKwbApoiISWsVyn8Eq3kQ/3ENepEE0eRufbbBrtJCfubwCW0z7B7he5+pq0Xge6ht7yZWKM676Odu/tZfICoPToQFPEWcH6V19BZqABQa7JUBK+T42cdCtSHZvwB2w6cLMTgVXsuRbNUYHHYW155CjDwckVrAwmxIOdV3PNzLfzR9zTvhRMKs77Ry3OJf4RYJ/9uh5NnjFoig8tJ5BOCLiIZIQT1/g24HfoUPli9NzWoq4yt2W1GkEfI9tK3cLtJFBfotTo1exMatuk27E7alPGIReq3yztlQMaGIGpiaAqMVvbczltyGZoA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=hpe.com; dmarc=pass action=none header.from=hpe.com; dkim=pass header.d=hpe.com; arc=none Received: from MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM (2603:10b6:303:1ab::18) by DM4PR84MB1782.NAMPRD84.PROD.OUTLOOK.COM (2603:10b6:8:4d::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5458.19; Fri, 22 Jul 2022 19:53:53 +0000 Received: from MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM ([fe80::e5ce:e8a5:d075:8bc3]) by MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM ([fe80::e5ce:e8a5:d075:8bc3%4]) with mapi id 15.20.5458.018; Fri, 22 Jul 2022 19:53:53 +0000 From: "Albert, Des" To: Matthew Wilcox CC: Mike Kravetz , "songmuchun@bytedance.com" , "linux-mm@kvack.org" Subject: RE: Additional Huge Pages Thread-Topic: Additional Huge Pages Thread-Index: Adid6fHQyc+9ZzIjQla40Ysx3DpXKgADKCGAAAAYIeAAAu+ggAAAGLHQ Date: Fri, 22 Jul 2022 19:53:53 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: b367a241-489e-4ee3-eeef-08da6c1be7c9 x-ms-traffictypediagnostic: DM4PR84MB1782:EE_ x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 8vA1VdFGoERoFjhuERrWVhFXGdYDWjQFN/NfAavz0ZCa2bx17r3tRSnzCnYr9lvvGfyV9x5jbsHCAh/4BvQ9o4Xk7jrvuPdFdx0eW2nBNEj+Bq/0D7M+mqoSA4O1m6wJR9ihG1o9A02DZ5/yN/7AggXrWSnCJf1QH5GNoMe2zU3bGROC906cauaJ8LD+of7xmkT81JtTwROysWdz7RGkkfkeIfeLt+Yk0S4foQx96cvYvLb3L1L8H1Lv3bgHeO/Xe5+NfvemzvvGNR09IwLySkVRjIr8PNBhDRrFMk/7pG1CB20BcpTtt+WFxmxoAo8AXO4ErL3GsbaACotEK/7XQ9qyVc6C2Eonh0bYVghhjaGyA3TVi4DQbqolfJNJEU7NPZoESwWQ0q41bFzghHU9DcrJ01WNhvEI5kjrT97/LlnttpNeROrShTdqkc9RsuU48aN1j1vtHsmeQQjPtlbDch5AgNFfB1RQVYl6c2PcRNfNcLPmKw2q3oZFnuPXm4QUW5GRWvuBSc3K1OElvRhfHe3GXfMy2Jy5l8znl8SBQ4hWIumIXFv1HtlVWHcrarNTjX5WULx4X0COwv3lV+RJZS2M9HN6GoFe7aQkvoBWkmnvIszTusEOoooSRBVNijsQt1W0dRWCxeRZjhlZsKPu6CRWVblc7HrzxhUKniZIsjSunQ7KKikQVZMs2FQW767NTv48E9v2fSM/KVJZjjXJmFV2V8S9tJY1C0izTaow1dBBxzJY1WjpUtoJls4fuCo1taNwMhIF0Z9NVXuInENyefTL88qG/4A2FShtRL16VrfmczturnRIPlREImIlSSxOFaNg2H0WRZjezLBSUe4C6Q== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(39860400002)(346002)(376002)(136003)(366004)(396003)(53546011)(33656002)(71200400001)(82960400001)(38100700002)(26005)(54906003)(86362001)(122000001)(7696005)(6506007)(41300700001)(186003)(478600001)(316002)(6916009)(9686003)(66946007)(64756008)(76116006)(2906002)(8676002)(4326008)(66446008)(7116003)(66556008)(66476007)(8936002)(5660300002)(83380400001)(3480700007)(38070700005)(52536014)(55016003)(14583001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?XiQ4HOmPveCGwEUwCFYrA+HfxkKrY+uuaHaN9vBUzudafsei75U7gE2av/PP?= =?us-ascii?Q?COe4peeTbHtuMTwg1F/e65rd0tsh1C1baJ2QBJ4el7SOP2Ro3jg8OC4pc+3A?= =?us-ascii?Q?O0noR4z/ITc+ZqBUL7mEuZSxxJMwewh1/jknXAlgN6FIJv5VMHwxiluULLY3?= =?us-ascii?Q?EgEfcwFXPyUnnw6bRJlR2AOYEAxzfx8bTs/3uQjql1k/8HV4C0HmUsZ9XlqL?= =?us-ascii?Q?4EGMEf5xLwGSOGEOGTYvZDk8x/HnBsX93ZZBq/ugtvCOaYNMdFqcGDArN0xu?= =?us-ascii?Q?8Xzp+9z7PdKz5SOQX9737XQ3PnKmZDU0agiLTJSakh7NVnMsymrUBbTlV4Cn?= =?us-ascii?Q?jEkVcl6y5vCRtG3QiwlA1rba7pwT1w+vE+S/97gPXh7Rs91/0nJ8HG0Ro9lg?= =?us-ascii?Q?E88MbNPaLFnQsOWCBjxUimjdktBqPkC4eI8ZR4Jre/kvKXEx3mp+FSBRS/Vx?= =?us-ascii?Q?RlbcrUx1gnHIRTXvb2bT1pKTJDw/eZR4vwLcSSG0gsKMmpeaXfWs6yOaxx0X?= =?us-ascii?Q?i0mFNNSOfhChnZkcn7ybNUiIcf2gi5hNb6KFhxHCX9JZGI9up2yNxGnU7lPh?= =?us-ascii?Q?1IaqyvbzRsEsCPjNPbrLVPrBY5Mc6iXJ1aNP7qq7/wv3Hu6YmyBu2uj5h72V?= =?us-ascii?Q?Lzo/yf8IETsNlq5Uwn2Romuzeo8TdyZcZSrZFnqNoog0TPgxoiZnotYHFbgM?= =?us-ascii?Q?NqokitEMblHCNI+XJeegMuw/jtAIYOdW2Y24O7DUltl3+njybfcwRJ9VSgqR?= =?us-ascii?Q?9GLWUsqbVzLb9Dv9LhgyacXi9V5cDDHMn81gnu+hTjq1PyAL+UuEgTD+/4Nm?= =?us-ascii?Q?fnZjsJK2uZzeaDF9qA10Gmk7iEEHFWGi7ApW2sKa3WHmoPqpflRItHkz56kQ?= =?us-ascii?Q?Z8EOVgjaD3c2HaE5n9bp0KoRdYWZdLWVnVIIf3EsJYh6lrfKboqsuCA5T2wU?= =?us-ascii?Q?CH9CwnkEBehBDdcmMHQx49nEajxtucnQHOigztt0Es7RCtAyVj1CGl+E4HRZ?= =?us-ascii?Q?0f7bXPJ+Kmb5/aXwxDmw5TH4fv0zOMI0qHXKqtSArh5VKtD7NAoWMiFnmK9Z?= =?us-ascii?Q?HtKvXeRrSZL5zoBfJly0Olvkmap/EvBb8bwylE4BLXMJNfcwPghgZ1T+1BHy?= =?us-ascii?Q?AiUZc0jNznEsATWdiM7ZZ5BaIhmaU+HOb1rIlpWkksfUgq6ksNAlIehTMQCZ?= =?us-ascii?Q?TY1PZifAR7NJv196mNEBWDzxyErdvN2iXZPcknwWqISEEV/WRV2iuJ+C1gYg?= =?us-ascii?Q?E4xn1zeoyQIqnT2XEu+omg3j4w1RfZ0aDO6AIHXX8psXN0mp4j/a7vKGHJPD?= =?us-ascii?Q?vHYBHCNLINgVIKUzNYrLH0NB7GTgrLlu5EbSqeea3NHd6XDpgItjbtAJVzJ+?= =?us-ascii?Q?OxSErykoRnrXTBC61mmf6Lv4NXHhrfh6F6rzWpPSbw8dwuohGaRiV95dGBch?= =?us-ascii?Q?AUwxI73+ws9ZIz8T+cSVYIfYf9yLgm1JjDq7upYBVgm7isIE5GifDcRmqW2T?= =?us-ascii?Q?8Ln67Ff0FwlEBXBOQGwF7o+ri5nGtyyRuRexdGW7gwnP1NvcOwoa5ljPF4Zv?= =?us-ascii?Q?Tm4sI591YP2sHS8yjBCorz6Ap1wAvpRlCemBb5c6?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MW5PR84MB1641.NAMPRD84.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: b367a241-489e-4ee3-eeef-08da6c1be7c9 X-MS-Exchange-CrossTenant-originalarrivaltime: 22 Jul 2022 19:53:53.4408 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 105b2061-b669-4b31-92ac-24d304d195dc X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 7SUzbfQJwCJYB3eil1JGDJLOCdB4tKCnLGb2PdivWfwc/zG62j/hDevhj8RzBK6hqD6qNsTIfz7p8HTQhY0dsQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM4PR84MB1782 X-OriginatorOrg: hpe.com X-Proofpoint-ORIG-GUID: 3AFoPcY-AfpDGb0GWTIxiGhOaUzMnAcc X-Proofpoint-GUID: 3AFoPcY-AfpDGb0GWTIxiGhOaUzMnAcc X-HPE-SCL: -1 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.883,Hydra:6.0.517,FMLib:17.11.122.1 definitions=2022-07-22_06,2022-07-21_02,2022-06-22_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 lowpriorityscore=0 priorityscore=1501 mlxscore=0 phishscore=0 mlxlogscore=999 spamscore=0 suspectscore=0 bulkscore=0 malwarescore=0 impostorscore=0 clxscore=1011 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2206140000 definitions=main-2207220081 ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1658519653; a=rsa-sha256; cv=pass; b=L063tVhDClAP3tQCVQJShm8GTiOh8UjxLH2LC4qLZJdZIKVE6oIMVbJsp2RupmgUePc1oS KMx6vhMoF0Ey4PdWzfG99liocWjqTuT+GEolm5rmzYWDUaIpLdNdP6cDI1OCzNULYzcnxf REMQioSqAq3G+2Ot3ReQy7+l3orHyq8= ARC-Authentication-Results: i=2; imf02.hostedemail.com; dkim=pass header.d=hpe.com header.s=pps0720 header.b=QuyIEctj; dmarc=pass (policy=none) header.from=hpe.com; spf=none (imf02.hostedemail.com: domain of "prvs=020299fbdc=des.albert@hpe.com" has no SPF policy when checking 148.163.147.86) smtp.mailfrom="prvs=020299fbdc=des.albert@hpe.com"; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1658519653; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=zdHzj9ue+k/pEW9DJy4GMd2ISzrKFyMIXAXVuFOhrGY=; b=hbXSV8cg+FmfH64iuv4/R3GxZrOg9k+OfKDgSyafkI/VbXPux7zufox2NlWnduVySD1LaT XxljxHOXkLzQJm+kE9r3dTkxAm94dpRn4rQkd9iSJTYIcHTfm/xCXk+3frX5CuqSC8mpZO YxDdn2ECXP2CksGgmdwe/IJAhFs3eMI= X-Rspam-User: X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 4A5CE80063 X-Stat-Signature: ksa3tus3k83z7hyh9n3opf5s3d7hc8jz Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=hpe.com header.s=pps0720 header.b=QuyIEctj; dmarc=pass (policy=none) header.from=hpe.com; spf=none (imf02.hostedemail.com: domain of "prvs=020299fbdc=des.albert@hpe.com" has no SPF policy when checking 148.163.147.86) smtp.mailfrom="prvs=020299fbdc=des.albert@hpe.com"; arc=pass ("microsoft.com:s=arcselector9901:i=1") X-HE-Tag: 1658519653-502530 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Matthew Thanks for your prompt response. I had already jumped to the conclusion th= at the folio abstraction idea would effectively negate the need for additio= nal huge pages. It seems that I was wrong. I can definitely try to connect you with our developers, however, I first w= anted to assess whether there was real interest from the relevant kernel.or= g maintainers. I don't want our technical people spending time on work that= will not be of overall benefit. In my opinion, it would be good to see thi= s code as a standard Linux feature so that our developers can devote their = attention to other work. Our focus is HPC so I had assumed that the feature= would have limited interest in the broader Linux community.=20 As previously stated, I am cannot find much evidence the current benefits f= rom huge pages above 2 MB but I am certainly not qualified to discuss the l= ow level details. Des -----Original Message----- From: Matthew Wilcox =20 Sent: Friday, July 22, 2022 12:39 PM To: Albert, Des Cc: Mike Kravetz ; songmuchun@bytedance.com; linux= -mm@kvack.org Subject: Re: Additional Huge Pages On Fri, Jul 22, 2022 at 07:20:51PM +0000, Albert, Des wrote: > This is the first time I have heard of the folio abstraction as the futur= e for memory management. When you mention that future hugetbls work will be= based on that concept, it seems unlikely that there would be interest in c= ode that is not consistent with those developments. I also doubt that there= would be a justification to 'update' the code to be consistent with future= kernel developments. >=20 > I am therefore forming the impression that this idea may not be of intere= st to the Linux kernel community, however, I do not the detailed technical = depth of the development team. >=20 > Do you have some more information about this folio abstraction plan ? Hi Des! I'm the lead on the folio abstraction plan, so hopefully I can be = of some help. Folios, like your Cray Hugepages, broaden the supported page sizes. They were originally conceived for relatively small page sizes (eg 16kB-256kB) and have been implemented so far only for the XFS filesystem. Other filesystems are in progress. This is the first hint we've had that people are interested in folio sizes = above 2MB. I think the folio work should make supporting this Cray require= ment much easier. It's certainly good to know that this is interesting bef= ore we do too much work on converting the existing hugetlb code over to fol= ios. Are you able to direct any developers to help us with this? We can d= efinitely work together on this project; we've had a similar collaboration = running for a few years now on the Transparent Huge Page side of things.