From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.3 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI, MSGID_FROM_MTA_HEADER,NICE_REPLY_A,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1E653C433DB for ; Wed, 10 Mar 2021 19:57:02 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 6DF5A64FC9 for ; Wed, 10 Mar 2021 19:57:01 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 6DF5A64FC9 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=oracle.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id D2F408D0209; Wed, 10 Mar 2021 14:57:00 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id CEE878D01ED; Wed, 10 Mar 2021 14:57:00 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B2F768D0209; Wed, 10 Mar 2021 14:57:00 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0222.hostedemail.com [216.40.44.222]) by kanga.kvack.org (Postfix) with ESMTP id 933ED8D01ED for ; Wed, 10 Mar 2021 14:57:00 -0500 (EST) Received: from smtpin08.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 50D2C6D92 for ; Wed, 10 Mar 2021 19:57:00 +0000 (UTC) X-FDA: 77905023000.08.0A5ED76 Received: from userp2130.oracle.com (userp2130.oracle.com [156.151.31.86]) by imf18.hostedemail.com (Postfix) with ESMTP id 4DF5B200039C for ; Wed, 10 Mar 2021 19:57:00 +0000 (UTC) Received: from pps.filterd (userp2130.oracle.com [127.0.0.1]) by userp2130.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 12AJo2Gc120075; Wed, 10 Mar 2021 19:56:56 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=subject : to : cc : references : from : message-id : date : in-reply-to : content-type : content-transfer-encoding : mime-version; s=corp-2020-01-29; bh=aVdBgvcWq4TvfgIFC6kfCAcUaRvDUAPNCqRLomI9v0w=; b=quW9dDzWjUHzhU3EXrX36Iw50s4/a4rloNDeqnszV+P1a5M9Axu5q5e8wiEvDN58RuVX 1BFM88jkeVeXapAwkBF47sWY1vt4OML6Xirmo9a5pAX2nw4eRY7ogDswLZNdrT5BrkWa ZiwWlxxV0i09jYxYSs6DEzsQS0J8iKIaqhYFuuTotfbAFX8B/+jYZZiF8sHNpRRd2oEo tpq3vTlJAMG7ugWbS1tYEX+vpCpkbYt1+zKX7B2KuX734Yqo3bhD00zejV330UXHYEuC 3jL2OTFxZdpHRleuU/x3B1zbM1wbkSvUuC4FXq82yN4A7uT6m+VytJEivAKBpvb1YLGv Ew== Received: from aserp3020.oracle.com (aserp3020.oracle.com [141.146.126.70]) by userp2130.oracle.com with ESMTP id 37415rc9pw-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 10 Mar 2021 19:56:56 +0000 Received: from pps.filterd (aserp3020.oracle.com [127.0.0.1]) by aserp3020.oracle.com (8.16.0.42/8.16.0.42) with SMTP id 12AJpX4P060706; Wed, 10 Mar 2021 19:56:55 GMT Received: from nam10-bn7-obe.outbound.protection.outlook.com (mail-bn7nam10lp2104.outbound.protection.outlook.com [104.47.70.104]) by aserp3020.oracle.com with ESMTP id 374kn1f2bt-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 10 Mar 2021 19:56:55 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=OZ6lT3InJmLBvwEt8wYo8JHKASnH74t/v9//ukNqlZ8+6nCYgo39nCkVf53tIC0NnyvdDXyWfWA1Hncrd9brBd+8DjsxpIwxyX/+Ua4lK3sJ2F5zXix9SrNwUTSGrhdsZGkst49UHZEAo6UDB+UW97L4n3/lVPlW1KREp5Q+7/nial75bbR6v3wjzeaRMELc2d/9g0uyQngRvaYQ5UydPd8rcfDuxh6jPnlJswWKosBJEGkdIVrD463B2+vNgybW18P44MEDAlnAvP58bHg7rB9N2Bu2c6Ml7kuMtEpk7+kmqVY9Ag0KJ1OIVPAp7mhIN7KphV8P4G4ECx0n2dQnWQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=aVdBgvcWq4TvfgIFC6kfCAcUaRvDUAPNCqRLomI9v0w=; b=JPs6ciCBDZwmwkH0PBar6Ss/Spr0QZhxN3haMjJGRoiEwS8g9zoD3G3FH+W+CRW/ELNob96UdsU7F7QC1+fGfiJHYJaJgiRA20PUAGZgTSeBJUOAPnRLXfBvz4vqXdSozyySlfrQC5uxvZYlAs3LRjCc3jDqXO8qBheo5sDovI1inyMBgVYbt7w6oCcL3cqurdwgUd7zy1IM8bl4NcDmVLmw5DDYaAe3cum9AO1+TmUmfTlU0QN2ZG/DqsYjSgAsku5Lb8dvA44fHy+xnmHHGGMvM0n7GvNWSTH5LO6hvsmywjjH+k0XfGVGHbVz4/XX6ta/N4MRSwqKhdaFrQZaxA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=aVdBgvcWq4TvfgIFC6kfCAcUaRvDUAPNCqRLomI9v0w=; b=fx32xsSw0rGrCygyo6YQvgLMDAS0dM7q1nBqdxavY7HjieY7MyJyOWFtZ7J0UTV4dsorVUQpV8X3QfZV4CJRRgoE9TPl88nPpSFTWy/35gDOpgBJwan5qFjmrePjodztTfW7psVyOOlUuVX3O1OjldBiXASzAwlBtDvOOCP8DbU= Authentication-Results: linux-foundation.org; dkim=none (message not signed) header.d=none;linux-foundation.org; dmarc=none action=none header.from=oracle.com; Received: from BY5PR10MB4196.namprd10.prod.outlook.com (2603:10b6:a03:20d::23) by BY5PR10MB4273.namprd10.prod.outlook.com (2603:10b6:a03:205::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3912.29; Wed, 10 Mar 2021 19:56:53 +0000 Received: from BY5PR10MB4196.namprd10.prod.outlook.com ([fe80::980e:61ba:57d2:47ee]) by BY5PR10MB4196.namprd10.prod.outlook.com ([fe80::980e:61ba:57d2:47ee%7]) with mapi id 15.20.3912.029; Wed, 10 Mar 2021 19:56:53 +0000 Subject: Re: [RFC PATCH 0/3] hugetlb: add demote/split page functionality To: Zi Yan , Michal Hocko Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, David Hildenbrand , Oscar Salvador , David Rientjes , Andrew Morton References: <20210309001855.142453-1-mike.kravetz@oracle.com> <298CE371-115E-4A78-A732-57D7B37DF74C@nvidia.com> From: Mike Kravetz Message-ID: Date: Wed, 10 Mar 2021 11:56:51 -0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.1.1 In-Reply-To: <298CE371-115E-4A78-A732-57D7B37DF74C@nvidia.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [50.38.35.18] X-ClientProxiedBy: MWHPR11CA0035.namprd11.prod.outlook.com (2603:10b6:300:115::21) To BY5PR10MB4196.namprd10.prod.outlook.com (2603:10b6:a03:20d::23) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [192.168.2.112] (50.38.35.18) by MWHPR11CA0035.namprd11.prod.outlook.com (2603:10b6:300:115::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3912.17 via Frontend Transport; Wed, 10 Mar 2021 19:56:53 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: bd042722-b86b-414c-86db-08d8e3fea6e0 X-MS-TrafficTypeDiagnostic: BY5PR10MB4273: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:3383; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 9vFwV8yieTgZEWlDuRFHDU0YJCmdsYDj2cXNCZKOMEpRkSuzlr+7w4eLPGtM0+Z4w23WKzhFkn3hEb7m3FrantnnLG10uJUReH+SChb4bH/LN56GNCv/jtFDvc+2gN75uLSIQQy4xaqyVN5zuFEu8K3THYw10fn3KY0hNJ5Y2V0Qy6hu5c/8oo05rUexNEPXWSSHhIj/yD6mF28w+eUn2LoihOM2+glu7AncUc4sI/ua7UePHNuyuq43GlzhRnZZyrm2o84ix+r44v4oIsLO3QDLQpotExOzxDLW0oZbkobCDuP3NJhmHDeg8sk2j/Fcw+YI11zabORq8sQf8dHTAzKXkcWyEQan+abOxeGvCHOyu9mRfc7+41svfJHZ4JozOa8vFnsKY0YfUTPrjhhu3Wq4qiLCYXM3zNACiyNUp+ujV5qGrZOLBA9mykZls4oKQFulDOCS97yBW8q4ZJf0fVQmFD3wCc4uSYqJdmv76tLBFB8a/Odk0mJIEqXkmN0Yu+XzsgCiF1EsJjU2wA8Rimi66xZRdH0ieOXQZNixz7ihu18vtcxhEunWg69Yu6K6SyPOM5Aki6DBLxLxO7pHk65hBd83fI8b4NZbtD6n8Vg= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BY5PR10MB4196.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(376002)(39860400002)(346002)(396003)(366004)(136003)(31686004)(53546011)(2906002)(26005)(31696002)(186003)(6486002)(86362001)(16526019)(83380400001)(44832011)(8676002)(36756003)(52116002)(66556008)(54906003)(316002)(66946007)(478600001)(2616005)(5660300002)(956004)(16576012)(4326008)(66476007)(110136005)(8936002)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData: =?utf-8?B?TUV2TXBTeGc3ZFdnSEpoazBLVStBWTFnS0RmYm5US0JHckV4ZmsxYUU4UkFy?= =?utf-8?B?NnE0eVVvRFdWWCs5S3dWZmI0WWxueVFTTXp1LytPMlBSbXE4c3VBNnhwbEpo?= =?utf-8?B?d0xBZ3Brb0Z4ZTIrMUJzRVNZRVhUVlJYTzViTm1nVlVRM3ZqbzV5LzJEQm1S?= =?utf-8?B?SWZNYnZJSGk0cVd1bEZsZk94blc4bTA0NmZBakV1dHBwSUUrMzdldVMxQitZ?= =?utf-8?B?ZExRMnJCbDBuU0NLdkJ2TTRnNHdWUTdFRTNJbVVSZG5tcllDS2RQc2RSZlk3?= =?utf-8?B?WU1lMWJ4VUZkMC90VkppVmVIOEpjcS9yVUlNQW1SNzdsZTV4STBEUXpsc3Bi?= =?utf-8?B?aHZuUUlmVjFLVTJGRVMwL0VnS25zb3Y2OE9UZUVFVnRnSm1nL2xYZURMTkU0?= =?utf-8?B?YnBuUVVoRE9ncFFlNkpiZTZaWlo2RS9OZ2xqWVJFajB2U3p2ekg2T3JGLzRZ?= =?utf-8?B?RTJ1TVQzZnR5Y2N1c0NsamFUVXpmVzhDM2hsMURMZjE5QTZWNDBVVzVhTlBh?= =?utf-8?B?bm95SjNLUmlBYzJnYTViOG1TRVIrUUNDKzVoSW9DWEo5aHd0WGRUUkpERDlF?= =?utf-8?B?c3JXMktoUlFuT0RFSlNybEUzWHFOSkxtNE5QUk9Rai9NVVprTWJKUWhTcWU4?= =?utf-8?B?Z2Y4aFVycEE1a0xsSHlzWElkZXlPeC9XblpwVGphM3Zrd3FwYW4wbEw3ZWQr?= =?utf-8?B?S2hSZFg2S1FLRG9OVTFBS2NKejJUTlBYb1JLSytLWUdzWjZhN0xGY1ZTaW5x?= =?utf-8?B?YXhhaC9BWVZqZFVNWUJCdThYNjRxYnFJeVVLRjFsMVNXMlpEckt6NEEwdmVM?= =?utf-8?B?ZkVReU9xUGdvc05UZGxwUUJ4ZTg3TGltRHlVdCtzVk1DSHBJb0NsTGtJK2Nt?= =?utf-8?B?VU9WNGxoVXRWWThWdUxudzZRV3poQjlScmh0eUNUUjRYS0FTOVNiTGtBMjdv?= =?utf-8?B?MWpKbWtldlUrL2RPZGozNkVWWGE4SzlRUjJWMmpjN3hhMFZaV25nNDArQ0pS?= =?utf-8?B?V0plQjZHQ2ZGd1RQMXZpWWM3ZVo3VXFmMUdtM3JzV2I0QmRxbXErRlFQekhM?= =?utf-8?B?TlNLa0VPeXdqd1psem41Zi9hbll2dDI3RFhDbEVwcTYyQ1E0SGY2c0J3TE5n?= =?utf-8?B?TGRYMG1mU05CSVVrVENyL3JKKzVrbjNISjlTbUM1bE5qd3Bkb0RJalNOa0lM?= =?utf-8?B?SWd4V3NqYUxETnRCUm1DVDlGMEcwVWJkZFV6THlYZjZKdUJQUEF1NnF0TDBw?= =?utf-8?B?bWxRcFdoYWYzbTJHYXBjL0gvc1FOcjFPRWlRd21sbDBnOTdCN3U4d09yS3ZH?= =?utf-8?B?OGxhL3cwUmMzRUdrbW9IZGZ3a1Nza1lPVzY3anp1Rjh5aTUxVU1DREVGT3Fq?= =?utf-8?B?N0RsQ0lhTnRXOHNYcGVLRFpiUjF1cFh2VDF5VUlEdXk4d3VTekRWRzNCREVu?= =?utf-8?B?VS9vWm9idHdpZ1NGcklwSUxFSzQ1a1JpZE5uREdTd05YVEdCNUl0VVB4b3cw?= =?utf-8?B?MXRuRmExWmhLd2FZbjF5WWdNVGU5a1pXRmJteGNPV1pmcHFYblA1TjdRR3Fa?= =?utf-8?B?VGg5cjZUc3VrUnl0bmdET2dLb3AyS25Ob2JESElIc015akIrVlZSYmFhMVNO?= =?utf-8?B?dGdqL21sWkptQzFDeCswTjJ4RzVtSFBUM1Y1YUF2VTZjVnNrZ0xMSHhxNk0x?= =?utf-8?B?VmRCNkpZMzJ4djV0SnRFUktXNzU3ZHloZHJyaUpzWkl0cnN5SzBBK2UxR08r?= =?utf-8?Q?gZAhFmx++SBKyoe0u+SrF+QVgYfT0vR/nBaCe0r?= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: bd042722-b86b-414c-86db-08d8e3fea6e0 X-MS-Exchange-CrossTenant-AuthSource: BY5PR10MB4196.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Mar 2021 19:56:53.7938 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: k+pNeF8irX54spcKS3fXaR6ccxOVYNKl/7ibDJM2hou6INSBQjwMzx4uuDGstRoJq/mg+uv6d0w5Js3sr6JcRw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY5PR10MB4273 X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9919 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 bulkscore=0 malwarescore=0 spamscore=0 mlxlogscore=999 phishscore=0 adultscore=0 suspectscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2103100094 X-Proofpoint-Virus-Version: vendor=nai engine=6200 definitions=9919 signatures=668683 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 mlxscore=0 lowpriorityscore=0 impostorscore=0 mlxlogscore=999 malwarescore=0 suspectscore=0 adultscore=0 phishscore=0 spamscore=0 priorityscore=1501 bulkscore=0 clxscore=1015 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2103100094 X-Stat-Signature: txticirhewx9fk9zxrkmgybyz8kie18r X-Rspamd-Server: rspam01 X-Rspamd-Queue-Id: 4DF5B200039C Received-SPF: none (oracle.com>: No applicable sender policy available) receiver=imf18; identity=mailfrom; envelope-from=""; helo=userp2130.oracle.com; client-ip=156.151.31.86 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1615406220-210446 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 3/10/21 8:46 AM, Zi Yan wrote: > The high level goal of this patchset seems to enable flexible huge page > allocation from a single pool, when multiple huge page sizes are available > to use. The limitation of existing mechanism is that user has to specify > how many huge pages he/she wants and how many gigantic pages he/she wants > before the actual use. > > I just want to throw an idea here, please ignore if it is too crazy. > Could we have a variant buddy allocator for huge page allocations, > which only has available huge page orders in the free list? For example, > if user wants 2MB and 1GB pages, the allocator will only have order-9 and > order-19 pages; when order-9 pages run out, we can split order-19 pages; > if possible, adjacent order-9 pages can be merged back to order-19 pages. The idea is not crazy, but I think it is more functionality than we want to throw at hugetlb. IIRC, the default qemu huge page configuration uses THP. Ideally, we would have support for 1G THP pages and the user would not need to think about any of this. The kernel would back the VM with huge pages of the appropriate size for best performance. That may sound crazy, but I think it may be the looooong term goal. -- Mike Kravetz