From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8B7DBEE14C3 for ; Wed, 6 Sep 2023 21:13:20 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 8489B28001E; Wed, 6 Sep 2023 17:13:19 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 7D1D78D0005; Wed, 6 Sep 2023 17:13:19 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5FD5928001E; Wed, 6 Sep 2023 17:13:19 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 4A1C78D0005 for ; Wed, 6 Sep 2023 17:13:19 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id 12CB21CA3FF for ; Wed, 6 Sep 2023 21:13:19 +0000 (UTC) X-FDA: 81207423318.11.152DDD5 Received: from mx0b-00069f02.pphosted.com (mx0b-00069f02.pphosted.com [205.220.177.32]) by imf11.hostedemail.com (Postfix) with ESMTP id C07854000E for ; Wed, 6 Sep 2023 21:13:15 +0000 (UTC) Authentication-Results: imf11.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2023-03-30 header.b=BLLxmYMC; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=d+zKdSGD; dmarc=pass (policy=none) header.from=oracle.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf11.hostedemail.com: domain of mike.kravetz@oracle.com designates 205.220.177.32 as permitted sender) smtp.mailfrom=mike.kravetz@oracle.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1694034795; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=sVJDRPbEECk42jOj4O5tOOYC1Foj1vK2WjfUGqhOsrs=; b=M9WWKuIreb/Knl8vsSg0qCvckWvtDF3UJv/AzPkr8xIrRDTBvU9Uh462llJdOnLmGMrCGq OR3wcl0nqJqLpLp9fH09MXuWhJHtS7VWUxnVlBUl0q7IrEZvIgE8Vhv3oMs5pbg9b0g4IM WSYWCYPQqEMB78hhOAHOxu64Ry105cc= ARC-Authentication-Results: i=2; imf11.hostedemail.com; dkim=pass header.d=oracle.com header.s=corp-2023-03-30 header.b=BLLxmYMC; dkim=pass header.d=oracle.onmicrosoft.com header.s=selector2-oracle-onmicrosoft-com header.b=d+zKdSGD; dmarc=pass (policy=none) header.from=oracle.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf11.hostedemail.com: domain of mike.kravetz@oracle.com designates 205.220.177.32 as permitted sender) smtp.mailfrom=mike.kravetz@oracle.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1694034795; a=rsa-sha256; cv=pass; b=rKrMLa8o1oU3/h9u5F1VIVO4mYmtMQM2YcBBcFivP6tytTqzS69olX8CxN31KfVLf1gKfH LHLUc31AmHXDYWdEAhjVpru8o2SFvfdCl5mdH0PlmYcdANK1oYnuM01sju9m/53hqiapVN jODtUpFI8dLA9plnDPc+7XLytlKl4sg= Received: from pps.filterd (m0246632.ppops.net [127.0.0.1]) by mx0b-00069f02.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 386Kt9c2009235; Wed, 6 Sep 2023 21:12:41 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=date : from : to : cc : subject : message-id : references : content-type : in-reply-to : mime-version; s=corp-2023-03-30; bh=sVJDRPbEECk42jOj4O5tOOYC1Foj1vK2WjfUGqhOsrs=; b=BLLxmYMCXTTH8ntIegwSuhSiIyFPuM6zjNtrKnOR8IjjqewKRem0K9/Sr3zovwvq8WMT 2PD7p1Bh4X1iVVCd2RaBXB3HKfitslMzszhjdPF1Bul8qpNFg/1nX2se9wLjixFOtqwu 3Ux/zUyLFDrzunsLNrutz8FwAZ8cxyajYm261zeYjtV0HwZ+YZjPSqpIqK2dXyB6q31r FM0CPPACvNBKXgnX10hfInGJbLUkhUHHsZPz08Vdk3zRcuy1R9/F+qN8EJ2RtmqY0uz2 pq/cqy5EwZO7P2+LR2CILUsxCITXYvy3cX0rpUubGYcwlRea9hgwRvZ/09UJI1++nJfn kQ== Received: from iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (iadpaimrmta02.appoci.oracle.com [147.154.18.20]) by mx0b-00069f02.pphosted.com (PPS) with ESMTPS id 3sy0vj01a9-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 06 Sep 2023 21:12:40 +0000 Received: from pps.filterd (iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com [127.0.0.1]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (8.17.1.19/8.17.1.19) with ESMTP id 386JEbNO007741; Wed, 6 Sep 2023 21:12:39 GMT Received: from nam10-dm6-obe.outbound.protection.outlook.com (mail-dm6nam10lp2102.outbound.protection.outlook.com [104.47.58.102]) by iadpaimrmta02.imrmtpd1.prodappiadaev1.oraclevcn.com (PPS) with ESMTPS id 3suug6uyb0-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 06 Sep 2023 21:12:39 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NduL2KDDHzlKm056ZdTKSfWLXpMT6E+CCJq8DfxOqQumaaY4UKFkkq8Sm8hoC06QaSq6J8WUNmKnQ2AMn0CsONeIPe9XQviT+KZJB3Gc+0GyFXqXegyxGyoDEPnGTRUx0/DRjM0Ce62e+0WuM34xTf7H5OY5uxIGuff6aFtRspiVfnFIkLKkV4XAIAPkp5mJdWW2kSN17IGZV2Nrfc876soNnEZTxkFkZDTv55+G3bo1vtlH+Clp44nkWidhfC5dqWfkYhRwhN6zz8WgmIP/PdxA8MP9u9de7Bh1g5yr503PCdZnk+G+T+rGwsKPDvyjtUmpS3hH+0mQpdO2AbjxAg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=sVJDRPbEECk42jOj4O5tOOYC1Foj1vK2WjfUGqhOsrs=; b=V5rkPQhKKGBGp5jaaACqf3m/+yDDYXCKuMZyl0IGKnGSkQPqUidUmkBGf7adhfMRAOghnZ+ieIRZdnNgAxabRKbfW3ObzFM/Ft62cJEEr3hGnxMDFBOKxwliuIlehHAZPGVDMD2IjukEexOvVfUt4JIDFRwBCQmozqU+eTPJha/Mnol0hUh8vUSMMhPzmZMJDyFL+usUqBEprIICDnCriYUu7IpCsKHrXbn+HFhxyYRQZfn0gdIqBofhV8w+LT6VG1IJdWw6QKr7JjgDAJdfHdNnR41OIZbifmlIWtwvxWRz4g47v8QkH1/GcGej+M+qYkWAekUovamGTXU5cs3jwQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=oracle.com; dmarc=pass action=none header.from=oracle.com; dkim=pass header.d=oracle.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.onmicrosoft.com; s=selector2-oracle-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sVJDRPbEECk42jOj4O5tOOYC1Foj1vK2WjfUGqhOsrs=; b=d+zKdSGDgwy5Pze+17z5AO7sYixy/8TdKW4r5DVRPRlctjgdL8kvUtwAZrbbCopVqeKX/D5N2KL6S4xLifqSdiRAWKreSsrbrmabX+6FMy0kvbWjWWNxgh/5GiULLNtOgdKX8W1ofKHZQWFdq9u7ZgHc0519VKYz8mA8bhYU0v4= Received: from BY5PR10MB4196.namprd10.prod.outlook.com (2603:10b6:a03:20d::23) by CYYPR10MB7570.namprd10.prod.outlook.com (2603:10b6:930:c0::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.34; Wed, 6 Sep 2023 21:12:37 +0000 Received: from BY5PR10MB4196.namprd10.prod.outlook.com ([fe80::c621:12ca:ba40:9054]) by BY5PR10MB4196.namprd10.prod.outlook.com ([fe80::c621:12ca:ba40:9054%4]) with mapi id 15.20.6745.034; Wed, 6 Sep 2023 21:12:37 +0000 Date: Wed, 6 Sep 2023 14:12:34 -0700 From: Mike Kravetz To: Muchun Song Cc: Linux-MM , LKML , Muchun Song , Joao Martins , Oscar Salvador , David Hildenbrand , Miaohe Lin , David Rientjes , Anshuman Khandual , Naoya Horiguchi , Barry Song , Michal Hocko , Matthew Wilcox , Xiongchun Duan , Andrew Morton Subject: Re: [PATCH v2 07/11] hugetlb: perform vmemmap restoration on a list of pages Message-ID: <20230906211234.GC3612@monkey> References: <20230905214412.89152-1-mike.kravetz@oracle.com> <20230905214412.89152-8-mike.kravetz@oracle.com> <5e091211-9a32-8480-55fb-faff6a0fadef@linux.dev> <38E2F051-E00B-4104-A616-0EEB2729386F@linux.dev> Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <38E2F051-E00B-4104-A616-0EEB2729386F@linux.dev> X-ClientProxiedBy: MW4PR03CA0187.namprd03.prod.outlook.com (2603:10b6:303:b8::12) To BY5PR10MB4196.namprd10.prod.outlook.com (2603:10b6:a03:20d::23) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BY5PR10MB4196:EE_|CYYPR10MB7570:EE_ X-MS-Office365-Filtering-Correlation-Id: e1bc906a-687a-4aa5-929f-08dbaf1dff22 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: TK2yDpf0tF1yp3SOGdbHybChrKPpH8HLkGHa8InERT2b7mXCPqX3EVfZ9aCBhFa+C6ZKGDHspy0D8uSy7vjAv8Wm9+DFhCHya2r2GDgskO+RGkCB0dVh4r9T9ee/NDTOG3kAYN7/WMf6DPORlEpza3B1aEPXqheucm+WcRp6dNGs2C0lojNqH4L9lJFiCsGIr6HqKPVXVa46ltB9lKDLMIkmopHNUxhJrgQ1k5R6LzFiY/zXqjwWH1/WPIlHUaEtm9/WuFva82JQEPve6eKUC45oN9hluhR4T9/OTfQ+t4LnphMG3Er07kv6DbYs6YN4SVg0ht22J3oA7FiEVaJ8Syi0roTi1ifsPhgWrZ/2ZdxUnHhR5lW6BmJ39FQIn3KvxVLNeaNvmazspmbv9vFTs/8glkDLmL/tn7vWNVstUMXE/LULaSffGkXXmyPuBWahTEPLMEqGpUBAu9wSEsfisxg2Dh1iHEvAO/61EgBo59dnsPY3EJRv+Mch3hEXN4L0kurboTM/zEHHFLJ/hJTPo5uRBvjvOAfC4Zi2S9qItaY= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BY5PR10MB4196.namprd10.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(7916004)(346002)(376002)(136003)(396003)(366004)(39860400002)(1800799009)(186009)(451199024)(33716001)(4326008)(8676002)(8936002)(83380400001)(966005)(478600001)(66946007)(66556008)(6916009)(66476007)(54906003)(9686003)(6486002)(6512007)(1076003)(26005)(6506007)(6666004)(53546011)(41300700001)(2906002)(316002)(44832011)(38100700002)(5660300002)(86362001)(7416002)(33656002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?Oj2oERu0kAP3qd7obuWWDP6BFtmRAzF4jpMFxHZo49BfaE/9b2rTergQcqjD?= =?us-ascii?Q?3slHJPsD0BOUChkywJRsE2wbGDAxYaVJsIHNOMiyv2kmR0g/T8/rdjKF4AjY?= =?us-ascii?Q?CSkp/BqzXoLYYySFWWxob+ESzqVukWYvV5iyY/PNWwzAe2sgZzrpvLXWrHko?= =?us-ascii?Q?FwTIkExi8fRnYskIaCFpahHwAuvkb9ER6+Ppfsw/vnsMsYjWNMkmhf/hO8ku?= =?us-ascii?Q?b/gRx/6XmyNt+g5fDAinSkeAfTuku8hpIyvGAuNTqnunKreDDEwHWdWj5g26?= =?us-ascii?Q?K2cTcuq8Bs7KY2lom3eAep/0A02QRRpXAPWOKs6qtvHmUePzS8K0BAjxuWDv?= =?us-ascii?Q?wkS7L8JQjx3wsLSNU4ijta11sokhPTMisSAl/2jIeSM8pJNj1aSqec1+wzlz?= =?us-ascii?Q?JL/MMQdFH6qwa1VsdJNBvvr/o22kcc3prC/RGHkgEcDGgSEPcWZP2GKO5WeZ?= =?us-ascii?Q?MhAQs1DFDOta2Zj1U2MrUTdhX7KSgIhaNfIw3kVpopGcZ+IpvUPPS+b/hM5k?= =?us-ascii?Q?mPHOVovcSbYBeRErbIZZ8lpaIUvPTY4C4Q4PU95zCIkxD48JEYDX92aX9u5l?= =?us-ascii?Q?5IOKEovUd+/bHyJxj6rWInurlLkzs9EIIdtQLIg58GEm80VOuHhuT12LpK1I?= =?us-ascii?Q?ijX1T02suW0jxI4VCcrCWX3+gfEKyevHqI6EXaXfQ4FS+K9LiQgBajPakMbm?= =?us-ascii?Q?FDi+p9SWBfVgrqU47BmVcjDzzN1WAH2GN7eXFphsn4SWdyxOAV8XlqXHXhs2?= =?us-ascii?Q?O2sW3vfFyyy9yzw3zbPvMa+1i5T9aM1dTP/CNSYEOWEdWswBC64iTV8Fcn25?= =?us-ascii?Q?jLFKGTEXuqwynKiXaddmFcooq1eU1lwnIDeUWn2FF585nalAR2s66xr69D+r?= =?us-ascii?Q?JW/GOVgua5gwCxfPkiMWHhI+nV8wmaAYcLmjt4UQ/NdsvMX2Ch55oN8klO/T?= =?us-ascii?Q?l/FdoAZufjDuB5GeyZPEPdLAKEgNX8LkFJYQR8C06I/kSgH+pdcobol4pBcL?= =?us-ascii?Q?no0Vo4W1xdBJGTPy/MawYf66yCnWMVYeJoRSlB7pjnU+GWm1veXfozKmMiiP?= =?us-ascii?Q?hjaOKr8B9LTGp65x5mIJJJ0VfFq9WXeZVYlp0fVrNPN0ylluH7/ItcQPCWpT?= =?us-ascii?Q?1MCwPKWQ4yxNIM8Pui9+3pl+W/s5rf6VJazGhw8pYjSXuakGsCkxVYGxGa3S?= =?us-ascii?Q?9sWWxS2MWVwor7Rv9Yb/l0ePsKyl79wWFk23drkubFMo0X3b+tBwy0AW+fWf?= =?us-ascii?Q?BUggkapn8nOsju4Jf0wgktu5o+Q/fgfeotrE2drgpL9iDTm91yb9ATsoafDH?= =?us-ascii?Q?HypHYLCIsl6bQ2vI3v4gPv8j3cgsuxESe4l/vzoGSx0RgWAU7eV/RgckcV2I?= =?us-ascii?Q?EBPpt3Qn2G75k4M3TcF7q59nQymixZM5RELnDBoXYKd79UYMF+yjew9nKmjT?= =?us-ascii?Q?p6go2sH40OpqPbVtHJkTG3hGLG8X1u3AyvDNmzl0AsspZYbtd9N/nxJEdFZl?= =?us-ascii?Q?33T5ayx4n4N3ggrUvn3NA33zAIv6NrYnLR9JAjsOhC2nCqcAhjfAiaFGC/45?= =?us-ascii?Q?uxRs1v5MYyi3TaW8lho84MaooIShV/SfSQtiDt52pcQFIVNzcQh1EHVzVDIm?= =?us-ascii?Q?bQ=3D=3D?= X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: =?us-ascii?Q?uc2aV/GThLOUxyKlKb+xEncuIt8ardUTS8GsP47Hm9vfs2W82I3DOnt496Wq?= =?us-ascii?Q?S2+ePhzbHm4zkHQ8roc01JbCsqF9LdPf5CGSKETCv/7xcJ5Jb0P2jITw2uXv?= =?us-ascii?Q?iW7INRq71UhWCh7BlHsuF+/pCZUcRCKH6LWzLWmwOvfKVGAVPZgFIKIUH+ol?= =?us-ascii?Q?8KbsFaVBLnRIGuuFTt4BjY/lhA7eSfuTXJYa7YJ/Gdp/H28m6+MdbmM0249t?= =?us-ascii?Q?x0LuReekDN8cPQuVsHq8gvyAx2SzVfG4zmjJUdoseAVZdkbt2326kprLEhPe?= =?us-ascii?Q?dvAWJFSDnWyFL1hyzJU1uen0yX+jbPqh5Y+CHWyLjz5idKouUfqVe128wieT?= =?us-ascii?Q?OGm7JnCDGRBZAxlrjU5JRd+gu6TNWTJ+kcSefphlH/r+y919qF06KoNOJOeN?= =?us-ascii?Q?4+9WhGRps4Ehckuf0pZUYOjsl4MoRQByhCBYA7rEOyekSp5A0epd665YWQn2?= =?us-ascii?Q?ao+cdRqIpw5WkENpsDHG4f6tbI+E60kgC+64UqJZYJEarsIItX6ZfyIF5S6f?= =?us-ascii?Q?xDbcBRxDK4NOeW57dWPj4FDoC3rBXdTPQaxtZRTseqKaUA44KLQ5umNVimx7?= =?us-ascii?Q?JiEwsUu9L0eu5fd7/cnDSqugZg4MihQlOWWQig4t8F2B53tH+ic6OCfM7DxW?= =?us-ascii?Q?r2DlH8GrceAnSt98e05wPcIORYqfgDR2hjXXFD1u1JSiNzfSYeYa9VMB90tT?= =?us-ascii?Q?qa20W1nGaidkU2LhLm/qIDPP2ubRyBcRK5W2FQLat6EvIDVHrMT8k6IbXnvR?= =?us-ascii?Q?gwAXo2NOUtGgyRqX1CUKp0O8QTK4B58mrJ7CXKDRwQ3zUBw06vK/o5H8h1TB?= =?us-ascii?Q?6iwHhGPBiHujoudGVNy7hhT29xJwXq0f4il7ecjR56k299kl948fJZ/Rpx7p?= =?us-ascii?Q?tPFYRdBfmRONjNMjiPzQ1zEfRAp9cg4X134GBYB+8jB9yVFTpECTYUN2COw7?= =?us-ascii?Q?vKrW4KK8B1y2ggxbwOg94OtZU0fBI5ziRw1bKYpJ3kqXshJwbrBn6yZq2/5P?= =?us-ascii?Q?hf4xY+beJo0/0sLQzfySF6k9460XZvFeMxgJyWGBMTWHAuLfogIpIVBVwWGV?= =?us-ascii?Q?fBwkUeAp72QZsXXUT40RAUP8341POr2SYbtJzGP4r6xClBbwsnvFN4pA23Sf?= =?us-ascii?Q?88I8lKHUuEPG?= X-OriginatorOrg: oracle.com X-MS-Exchange-CrossTenant-Network-Message-Id: e1bc906a-687a-4aa5-929f-08dbaf1dff22 X-MS-Exchange-CrossTenant-AuthSource: BY5PR10MB4196.namprd10.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Sep 2023 21:12:37.4231 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 4e2c6054-71cb-48f1-bd6c-3a9705aca71b X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: qXlDmR8a8YwXwGnAAlJCpIZ2BIvFhz9f19avv7LEESrlsF499mm9adkfv6wNGGtuBgLn62O+FS6ncwxO42xmmg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CYYPR10MB7570 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.267,Aquarius:18.0.957,Hydra:6.0.601,FMLib:17.11.176.26 definitions=2023-09-06_06,2023-09-05_01,2023-05-22_02 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 spamscore=0 suspectscore=0 phishscore=0 bulkscore=0 mlxlogscore=999 malwarescore=0 mlxscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2308100000 definitions=main-2309060184 X-Proofpoint-ORIG-GUID: o7Oex9AtkAG1vXc3rwj96gXdxS6utDLx X-Proofpoint-GUID: o7Oex9AtkAG1vXc3rwj96gXdxS6utDLx X-Rspam-User: X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: C07854000E X-Stat-Signature: qfez3xiqtesg41p6oz4tcd31kbwqy1c9 X-HE-Tag: 1694034795-919290 X-HE-Meta: U2FsdGVkX19KmHh2et5lrJfHvRO2h3NU3aTZGof8GlxrXIcYzhTAPpIbIlReGCX08Ta7qslJPntyDd5Y+jc3voDjTLtMpSx6Ygr8gGzsVMkCn48MVnadKsB/pelBirQKs6/2bThAln86C6VvUMAM0umBb2TQRCKHs+DKMlPf3FoWlxKeSxCoMu30r/GD3fq7MpFRZxuFjumWvw4xAr4rsjMVJOt3jP08SSWhDHINKyYg8hrf0Q+nw4K1qd3KpN6GuU0yRPqHwro0KRjAGdwhiSh0Od7xjORpcX7Qx9khvxe3StK2lGZHHI5sNk9yz1YuYrxxFhCUeqTcvG9ylIa/HOOEwlIN85x4j09yup7AIe2T2TfyDw4kadYF67y2AfijBVrXKWeRvwFvbH8F/pPe+geTAeZ/dB/l5yzGEDIdYa0lN3tJct0sxh8Amf61WSqN1g+/LETBGzodB28WIIC+E3W2d/cUhcLGpH8raprR5iX0NE3H6+Z1WU8Txeg1GDBYNU2N343YWUJIZw3GEmchl5QkE+VYQ0lYL0Q0QeYrms+AhuAWUTnNCPbZ6yzNJm3La0Gk61NTzCsSGznfAlJ5cSM488p95cjFLATEET4+SORebbm+hVUiz3Lt1m3b13LdIsGEiNtvooeFkgH002x7xPFYhtBEO2NLQBUFHyc9qwwsj10bmKBv0BMteVE6TIfrEc/XF4doXMMOgDBAaiISUXfGCyoywzjY/qBcmC0M4/uv3X8JS1KGz2fpxw8Emd4yi64BpcnReVIgvCji2TRg2NeJkfrbySyaRd8CvB97h8iQDHJthH0G0osI/LiGO9JpmIfBflWaanIhNAJvCQkKl80BDMKn3ci5xNODAwCIvV+uer4UTrtAF0YrfliUFyQtfTkcwxCBeJOtbA4BEFpFMt3hD5HCEYHdflelTFarIyv51G92fNJdIA9OX3BiGaPcxlNupvS0x7l/TWoq0+f s3mk7S0t o4dLEhqP/MJH3PqPOVcnT9Ux8PaqXX1apKNwLQXY9+jfdCREE792RGFF1sJWZEI0aOP/i16zqF00YQDoPlbCUZ+axIQ6ETQPlDk4SadWAkrfT8DlK/LJpeBPQizJqiwlnDJ6sflsfhyCnN1qNFVeonQlrpup7iJdvBNXGH/CVDYhTH75h94F1KWCW87dSFZWhBcBMJ7CrlA+fQSSAhSDcfJ84bVuuLikq9tH3n7GIj692tgPKbPqjQVYq2l6nEd+z9F0d4LzdlgVn7CRP3QEUepZgDtDKSyDnPrmzAUrq3/p1uzPvLxwJVPSxMZZx96v4yQiPYCJ/TC1nsjYG+1NMc3ZoibqYsrXchXmpHTJLTeCJ4Kv2Va7AxWk0/rnturc/rDoIEhB24KZsByfRLQdxWR4hCR0eqdGPCeZ1jUdG2Me6jrdueMPiH2vb5x1XGkeu6PKdZO5GK8nHaRs5283zhIPfXoQGl6x6reRf+L+EFHhbnePaosb4ndJTRjPU7DgHZCrGbaAUvPxoNo0efbm71Q4ubJ+lefWrXMrdYjsEd3g8SolXN3VHAsAGxChjybTZUjBiyliI4rTLQw8Y72L+yiR7Qg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 09/06/23 16:07, Muchun Song wrote: > > On Sep 6, 2023, at 15:33, Muchun Song wrote: > > On 2023/9/6 05:44, Mike Kravetz wrote: > >> When removing hugetlb pages from the pool, we first create a list > >> of removed pages and then free those pages back to low level allocators. > >> Part of the 'freeing process' is to restore vmemmap for all base pages > >> if necessary. Pass this list of pages to a new routine > >> hugetlb_vmemmap_restore_folios() so that vmemmap restoration can be > >> performed in bulk. > >> > >> Signed-off-by: Mike Kravetz > >> --- > >> mm/hugetlb.c | 3 +++ > >> mm/hugetlb_vmemmap.c | 13 +++++++++++++ > >> mm/hugetlb_vmemmap.h | 5 +++++ > >> 3 files changed, 21 insertions(+) > >> > >> diff --git a/mm/hugetlb.c b/mm/hugetlb.c > >> index 554be94b07bd..dd2dbc256172 100644 > >> --- a/mm/hugetlb.c > >> +++ b/mm/hugetlb.c > >> @@ -1838,6 +1838,9 @@ static void update_and_free_pages_bulk(struct hstate *h, struct list_head *list) > >> { > >> struct folio *folio, *t_folio; > >> + /* First restore vmemmap for all pages on list. */ > >> + hugetlb_vmemmap_restore_folios(h, list); > >> + > >> list_for_each_entry_safe(folio, t_folio, list, lru) { > >> update_and_free_hugetlb_folio(h, folio, false); > >> cond_resched(); > >> diff --git a/mm/hugetlb_vmemmap.c b/mm/hugetlb_vmemmap.c > >> index ac5577d372fe..79de984919ef 100644 > >> --- a/mm/hugetlb_vmemmap.c > >> +++ b/mm/hugetlb_vmemmap.c > >> @@ -481,6 +481,19 @@ int hugetlb_vmemmap_restore(const struct hstate *h, struct page *head) > >> return ret; > >> } > >> +/* > >> + * This function will attempt to resore vmemmap for a list of folios. There > >> + * is no guarantee that restoration will be successful for all or any folios. > >> + * This is used in bulk operations, and no feedback is given to the caller. > >> + */ > >> +void hugetlb_vmemmap_restore_folios(const struct hstate *h, struct list_head *folio_list) > >> +{ > >> + struct folio *folio; > >> + > >> + list_for_each_entry(folio, folio_list, lru) > >> + (void)hugetlb_vmemmap_restore(h, &folio->page); > > > > I am curious about the purpose of "void" here, seems it it not necessnary, > > ritgh? We cound see so many palces where we do not add the void if the caller > > does not care about the return value of the callee. > > Another question: should we stop restoring vmemmap pages when > hugetlb_vmemmap_restore() fails? In which case, I suspect there > is no memory probably, there is no need to continue, right? Recall that the list of hugetlb pages may be from multiple nodes. My first thought was that we should continue because memory allocation may fail on one node but succeed on another. However, with https://lore.kernel.org/linux-mm/20230905031312.91929-1-yuancan@huawei.com/ memory allocation should fall back to other nodes. So, yes I do believe it would make sense to stop when hugetlb_vmemmap_restore returns ENOMEM as we are unlikely to make forward progress. Today's behavior will try to restore vmemmap for all pages. No stopping on error. I have mixed thoughts on this. Quitting on error 'seems reasonable'. However, if we continue we 'might' be able to allocate vmemmap for one hugetlb page. And, if we free one hugetlb page that should provide vmemmap for several more and we may be able to free most pages on the list. -- Mike Kravetz