From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CC47AEB64DC for ; Mon, 17 Jul 2023 23:27:48 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EC25F8D0001; Mon, 17 Jul 2023 19:27:47 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E72AF6B0074; Mon, 17 Jul 2023 19:27:47 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CC4FB8D0001; Mon, 17 Jul 2023 19:27:47 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id BA0BE6B0071 for ; Mon, 17 Jul 2023 19:27:47 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 72B6912060F for ; Mon, 17 Jul 2023 23:27:47 +0000 (UTC) X-FDA: 81022693374.11.C1AEB3F Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by imf22.hostedemail.com (Postfix) with ESMTP id 52AFEC0009 for ; Mon, 17 Jul 2023 23:27:43 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=haq0N7nW; dmarc=pass (policy=none) header.from=intel.com; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}"); spf=pass (imf22.hostedemail.com: domain of fengwei.yin@intel.com designates 192.55.52.115 as permitted sender) smtp.mailfrom=fengwei.yin@intel.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1689636464; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=tECi6409ORnROxwAa2ZIfn3VNwd0CMRot7Qa0ckXFZw=; b=O0EEX5dGFURj1VfRVhGGp/zLZ7yuXb/Rh1HYP+ZoXihgFvVQKNSzS4f4dUIGzQBS2jrreN DP2xQOUBNxFzdsC9OP1ik8+9KG+n4C2/Q4kHeZivZUlat02uBxIMfaw4UFRgwNfGdDCufx c0+b5fhkzrBpIqpYhkusFaxQNRigtZQ= ARC-Authentication-Results: i=2; imf22.hostedemail.com; dkim=pass header.d=intel.com header.s=Intel header.b=haq0N7nW; dmarc=pass (policy=none) header.from=intel.com; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}"); spf=pass (imf22.hostedemail.com: domain of fengwei.yin@intel.com designates 192.55.52.115 as permitted sender) smtp.mailfrom=fengwei.yin@intel.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1689636464; a=rsa-sha256; cv=fail; b=pc778lSYE0HBGdSR3/juJshSR21s5Ybd/tfkvywb5BHkLGR0ceK2mVcrF90V0lsGx5GWTM J1mNKAxpgTKDgi5mzCW8v9S453BOjg9wkrMEU5k8xd/foPaY7VXA7ctR99+64g6Z6N79J8 shf7dkycx8iTqwT9DgydEYbk48fZZAo= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1689636463; x=1721172463; h=message-id:date:subject:to:cc:references:from: in-reply-to:content-transfer-encoding:mime-version; bh=qbt/k0pJr8y4TLBiUTioDRoH3XCbSib6ZF4KtG8f5WU=; b=haq0N7nWuEE0QJ8odbh0PGVQIBJHZZJ59/xxu6IdsmfI/3DZF2laxI1b oQ+5pbTQ/IPE6RSCc0ZpuCYdzfq0jWsuIqY2SSCo6ByRSqNV5/FI2ni+l DOT5Bicq+7r1jOs9wsnexicD6b12xsN9nC06fwbJm0Yd8EB1pub01ueJE 2V3YZXVvN+l3tJWrFn3VNHKRe/Qveu3mbFzQm4dFTt7U9U1sCxoKelzmI g7jaYe9Bw5EyO2zgzSff51ZvjCVRqRMagNs7eN5yp4KjnNhQrwtRnP1/8 15CmyefA1Q+MMEyIgAVID5Z0xHafp0Ev+Kd8QeHb44ZFzZ8gNU8bZqc1X Q==; X-IronPort-AV: E=McAfee;i="6600,9927,10774"; a="366103466" X-IronPort-AV: E=Sophos;i="6.01,211,1684825200"; d="scan'208";a="366103466" Received: from orsmga005.jf.intel.com ([10.7.209.41]) by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 17 Jul 2023 16:27:41 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10774"; a="897355839" X-IronPort-AV: E=Sophos;i="6.01,211,1684825200"; d="scan'208";a="897355839" Received: from fmsmsx601.amr.corp.intel.com ([10.18.126.81]) by orsmga005.jf.intel.com with ESMTP; 17 Jul 2023 16:27:40 -0700 Received: from fmsmsx610.amr.corp.intel.com (10.18.126.90) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.27; Mon, 17 Jul 2023 16:27:40 -0700 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by fmsmsx610.amr.corp.intel.com (10.18.126.90) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.27 via Frontend Transport; Mon, 17 Jul 2023 16:27:40 -0700 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.169) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.27; Mon, 17 Jul 2023 16:27:40 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Yje0Pa9Tx044llDl7gitLgL7WqHNbx/N7zlJxK89qs13SsmGXbKf8T2D/+cQ2H3efWwm2ceqmdcSqm6qM6+PrzCJOUAxcPcbMsFLsfX5QDnme5xNe1HgjTB225Ar0eDVanpGvWBL7e4n8WqR76zn8CEEAO6pFt3IPKbbnrXtXGCw5qjzNkUB+Sfifcs9qAJIjcdAvJBMh41ejEN+7evKuFoTlQkmRTsE3ouWh+ZmQQoY4GlgPE+nIg6cn09pQRvk2IIlNJ1pC45pDMMZeAQ4VLcZMuFy1WbY0WhM9BZ64xpGfbcm9NKPSNEvWRN7MygEROvZPg46fMAQoxwj3J4/xA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tECi6409ORnROxwAa2ZIfn3VNwd0CMRot7Qa0ckXFZw=; b=lQab/BXEUmxpUJ4n9DGF8sc9VAwH52f+Hd2zNtEJ63nZUz4klS6wD1Iqyb8tRF1fubPYJjaTIdbuRv7WlFI3zeiFfW86fbxoNJNTolhtlhm9OIww9aZxr2yha26V+LLFIpBQFF9Bm0ttzSG9Iwx1RRgVxMl2AEOExl+uXHuYobS2qKCY7kRKE34skNuwiefaSMHf+YnNB9ulhGyVAvVthwyGs0isVy3Hz1Decx4UPjH5PRrDowtpgxFj+kGstlTDq0FxY/rBDsS1cV8zKVSPgb2W13G64FaYG8zLq6Lco5Ny/rCTXbbRnT0c5OhYcYK+AxaOO88MZosouOBusyHL2A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from CO1PR11MB4820.namprd11.prod.outlook.com (2603:10b6:303:6f::8) by SA1PR11MB5803.namprd11.prod.outlook.com (2603:10b6:806:23e::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6588.28; Mon, 17 Jul 2023 23:27:38 +0000 Received: from CO1PR11MB4820.namprd11.prod.outlook.com ([fe80::f4df:c85c:6300:880e]) by CO1PR11MB4820.namprd11.prod.outlook.com ([fe80::f4df:c85c:6300:880e%5]) with mapi id 15.20.6588.031; Mon, 17 Jul 2023 23:27:38 +0000 Message-ID: Date: Tue, 18 Jul 2023 07:27:39 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Firefox/102.0 Thunderbird/102.11.0 Subject: Re: [PATCH v1 3/3] mm: Batch-zap large anonymous folio PTE mappings Content-Language: en-US To: Ryan Roberts , Andrew Morton , Matthew Wilcox , "David Hildenbrand" , Yu Zhao , Yang Shi , "Huang, Ying" , Zi Yan CC: , References: <20230717143110.260162-1-ryan.roberts@arm.com> <20230717143110.260162-4-ryan.roberts@arm.com> From: Yin Fengwei In-Reply-To: <20230717143110.260162-4-ryan.roberts@arm.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-ClientProxiedBy: SI2PR04CA0005.apcprd04.prod.outlook.com (2603:1096:4:197::16) To CO1PR11MB4820.namprd11.prod.outlook.com (2603:10b6:303:6f::8) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CO1PR11MB4820:EE_|SA1PR11MB5803:EE_ X-MS-Office365-Filtering-Correlation-Id: fc6bab64-7394-42ea-66e8-08db871d685f X-LD-Processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: ux2nqN+3ahfMWvndo+SDV0ol7xuw+Pr1StN+ldwIQNc1In0IufuFBZbpgFF+oAalB3aQBpTJIOr1sRJSCodOI/jaMXmy0j1yBbuUso5WLp0ysxwlMf0TWXz774xmOvJU98nWHVPewyhbU6m/yh7qnB/kL96Zs1SYcZRV+EsyPRZQNiQysDCIA3hr2xarrE34oYVq77b8yyo7V5JIXmsiQSexcML9mQoJLn+Kw94JtIzIEMHlbvG/qjBTInfvltYL/GPluHSXwJX33j/KfjiuQUK+zkrqegH7nllj+nYFfPBQU7h5nhzpuQ0WGRmiCdMGihHpg4VWKlveK8jNk4W8qJPbe2MElFbpq6a10TIOksow6I22NLgoEVW0dCYhMb4rY3qqsTJ3KxNCR7wdY3+xUuftbobbgbDXHbSGF4KeIzY9O5VRIPL0/qSDrz+xYAv25OWFBGZHq3EBQuCEp2TsReCA4UqJWavylhybc3V6IwVKY/1UUeQ1A75ur3cxM0m07eyLFNJLxbQcuw86+rMa/2iCkLs6BMW7ILp71nprvZGdk5olirMhS54T6TXCmhYOrR5zQtixxOGq/r25AOJ/EuKT8ZIFnj5YJUEm2v1ftqBuZXor3iOPcb0qJS/Ja8PdEDx3SruA0JiOWzJLpT7CKw== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:CO1PR11MB4820.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(39860400002)(396003)(346002)(366004)(376002)(136003)(451199021)(110136005)(2616005)(6486002)(478600001)(31696002)(82960400001)(8676002)(86362001)(53546011)(36756003)(26005)(6506007)(8936002)(316002)(41300700001)(66476007)(5660300002)(2906002)(4326008)(38100700002)(66946007)(6512007)(186003)(66556008)(83380400001)(31686004)(43740500002)(45980500001);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?REU4dW53MU5jVGd6VzJWdHl4UUM5QUhvV0JCcjRFelB1QXZ5aHlhVDFiVFlY?= =?utf-8?B?UzdabXVpT1NlT2JwcmlLSzJ4ZUhGQzRaNlpoMHF0NTFCN1E4L3NtYWRUQzdo?= =?utf-8?B?TEdGQ0FMOTdGRDdUalUwMTF4TTJvT1hCSlBHWDdSQTdpeDVLY0UrRno5djZR?= =?utf-8?B?cWplM2ZUT1Z1VDY0bmJrbm9odjE1SnlCaVk5MUhjV1FUVURGQVZDRmxrSStn?= =?utf-8?B?Y0x2MFBuN1BOa1E1a1FkdGZPdUoxeHlwMFlkNXlicTNYTmZseEhib3cwSnR4?= =?utf-8?B?cWw3SGxSak1BS0V1TVBTVC9MUllEOWdCeWZqcmdYcG15Y21oYVJScmpkZjl4?= =?utf-8?B?QVhSS0thVCs1ZjdQd3poa0d1d0QwWmFtTHNGKzJzQ2Y5YXZCNnRpYzBMTjRu?= =?utf-8?B?NWQ4VjZhY3hmL1FmSURjaW1GKzRzbFdwTzh4NEJPN1E2SDQwSytUWWZHaEZF?= =?utf-8?B?MHdwTkluVktqcGpoYXF1TzhQQmhteWtxMTN4N1YzVzJZSHdrU1Z2cjFHTU5U?= =?utf-8?B?WDU4SDh6T0hKU1c3eGRtaXYxeklJUks4UzR4bmJPc3JSQXpaWVppaHp2dWs1?= =?utf-8?B?SHl6YUlYbGFzSUpZdmlXbEVUV2xES0dBWHlQNy9DRUZ2SDMvK0c2OUgxVTU3?= =?utf-8?B?Mmt1b1NhVHJ3M1p6dzBaMkZCdDlwR1VrL3pvSlRDZkJnOU5JUkRYV1BzUHRC?= =?utf-8?B?ZTlDTDZidzErOVpDdkgyYkFibGJ4NkM0Z3g1aGl6YWpuOE5GZDBaSm9iSEJH?= =?utf-8?B?U3d5TThnb3BMUmxZNjY4SG94UFhTcGdubFlOOW5XRjNSRkNzTHhGMlR6bEl3?= =?utf-8?B?cUR1R2xKU0pYL28zTDVPZkdENHhTL2lvRTlyZ21hYzNoWXRuUzVxSzRSbmky?= =?utf-8?B?OXUwM2QzNTR6dnFxaEFGdVRSTEphTEFrSnFZcVRRZnk4UEdLc2N0c0dVenYr?= =?utf-8?B?S1ZEb2YzaHlid0R6VEQ4cW03WFc2U0NGdUlsU2lHaG1WN1ZvNW16dnJTeFhZ?= =?utf-8?B?NGs0Q0hjQTNxL1MxdWJNSGdXV0poNDlPc004YjhHZjdLc0hPenEvYnpLaTd4?= =?utf-8?B?d01pZUhtaHVtTVRaaU12YjN6Zjk0aGtiSzdBbXRBTkpnZ1hNS0FKL2tGN0NM?= =?utf-8?B?dythU050cy9rK1dPem5jRkY0MU9IVWVFdy82L1IvaWFJR2RFcFZkTGFsOGVr?= =?utf-8?B?L09xVklrVHUrU3V1dmo5OHFlNGExMmZPTXRieVp4SWV1MW9LWGNTN1ZKTjhL?= =?utf-8?B?ZEZYcTJ5ZDI0Q1BJNFFLVFhPdmNYZ1Uxb01BUkdhU3hPMGhrekF6dWwvNnBs?= =?utf-8?B?K3dxdWsvaDZYTnNlcEJRR3ZZc1MrVHdnOGdtcXp5R1JqYjdoMEw5dGk0ejU4?= =?utf-8?B?bi9JQ0lUOUVTSTVJS2lzMEJxNmFDZUhRU1o3TVN3SlVuRTBKN1pMNTZ0dDRl?= =?utf-8?B?UVc1YnF4WUZjV3FPWGtEMVlPc1kzSCt1cDcxZnNWV05ESWpzVHdBM01kUk03?= =?utf-8?B?RS9rd3dtcFlDOXh5cjZ4QUJwTmRBMGpOdDVjUUl0VTlkT1JpYXVyQitPcklq?= =?utf-8?B?WnpNc3lpbXFOSjd3TnFXaDMzZ1pLT1hxUmFCbHFZRERQSXZjMDVCeDA2R0k4?= =?utf-8?B?cm5FR29rb1N3UlNFdHA0emFYMUkwR0s1cVlzT3J0YXlzM2V1ZEFmUkpUamxv?= =?utf-8?B?YnVDRjdtUlhKSXYzTGdyWGh3YXV3cVRaU0V6bVBoeGtnOC9Tc3NvRzJYV2VQ?= =?utf-8?B?Wm9UZ2tMcTBGRUZaZmhNOXlwa244RSt3d0d6UzYzQ0UwY1pzUVJYZ0c0RnVH?= =?utf-8?B?czB6SzQwVDZPb2JyZytpanM3NEN6Wk1CTHhwWHFGM3FjcUJZeW9mVmc4Y1hP?= =?utf-8?B?VlpmWDMzZFRQUm5ENE5ybUQ1MGJWa3ZzOVV4U0NXVXJZaEEyOUtUZ0FvTmlT?= =?utf-8?B?c1pRbm1mWUkydXNsQndXVG1ZNEozSGpsVXNLb2NIQzBJZzA4aUZZV0pUVzI1?= =?utf-8?B?WVJpSVhiSUJlUzEzRDVTeVV6cm1XRG00bWN6cVRUdmhodE9NUmM5cXVldG0y?= =?utf-8?B?SVV5Q2RxWlhDcDBaTlBaZ3B3RDFyb2dwR2RKbTVTb3lvWUFGOXBuMzhtZm9X?= =?utf-8?Q?Fo+0AcL/evakqksb2KA3f/qvd?= X-MS-Exchange-CrossTenant-Network-Message-Id: fc6bab64-7394-42ea-66e8-08db871d685f X-MS-Exchange-CrossTenant-AuthSource: CO1PR11MB4820.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Jul 2023 23:27:37.9166 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 0uIIFUUKjwp3T9rawJ8MI1MkNJgbKell1LLjg+3GMOaVgxeEVDWuybVzRSB8vaKmKKe7xNvIda5LYmpgi6dhiQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB5803 X-OriginatorOrg: intel.com X-Rspam-User: X-Stat-Signature: sx587zw6fe9qt3sjhswyy9wtsh1hhzyq X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 52AFEC0009 X-HE-Tag: 1689636463-947361 X-HE-Meta: U2FsdGVkX1+3eZV5UHsF+50B7fnP6l4YGJdkaS/fsdL1w26BvHNer4D8UvP3xq1nUHbyJjMuW+E6TkILD06fIZtpHVNvzJnQaqXhIWZ15/boJfy7EVPVT9odSIo//o/0LdufUQgvaBE1uMTBl+2vOCcNkUY202ce6y0UgX+uAU9zwzlXd6xXppGA0Al6vRt0EPcyv++YXDAWEzK7pZ5dazQFAgox4NTzquyXqucnsVGRGyth9yW0G+YvpJ17Bgn8CK69vY4PDY/b+1Lg41p+Bn9vo8sHyYPhGTWwbNFDCR49w4WidSsB8JFi9lQTxQ9niLIedpQhQri0U53pCGuosjk1VQD7qgkv4520XoP9I7CJ6nOFLVC59MsTaiwbnYNPx0O3ToGuZslzFkBuLzCNmp+pPVLCpx70PIKF7BbWqzJfALiq0vkQx6p8E2iauzR3wXIWnnk0ai1tSK74zcJ1dJPduSgUR5XgER7uLdnaXMHeaxaxTiJYA7cyUzxZnfCypzENfQLubYldMs/tSYiIfOEjvIrCUbr6kkBQfV9LGFoYHyIVQNfrVVZ0W//ckWTnYK9dFSdg4J/WYWODxJe2dQSTbuF4ROJx2EVZEjeeVrskWNoKwts4VqmG0mBhwFaSpks0CGLqetQGL3x+SoxctiqjL6qYQ1sxO+gfS6NjLMpyD46tAOKgKI8Mig1DStQkCYi+DjLoMGF3SILhNZnLpIuafmd+lCd2YvJqemYG9CA2TaVKwYB4840asCnUiUSrEqcqx/em5zAb81IFZ6FPTS6iiCQmHenU6CNNhFwP2zexP9M9P0QlT2sM/BHUI8Bed773nqG635VS8rxvKsvwFzquvs8JhnwxgkCTAtZxDzM38YJC/SrdjxK+n6J0GdM+Ubm5G/2bvgUAwUyXmHNLRuKtsvSWPcKcwJJTjWnN2UgIJAYhfqqheuoQJYZLDcIv7/oQHf2W0IgZaDAERcn n4Y/XNaa X0EVTO+uf51fN21l1tmxgVSiS/J/UBv2a9E7r5GoAEJO++AcJMIU+3zl87RJyRDlZb/1E1aIcdZ+VyC7jr/SZU5e0p4v0lSgKQj0drFXJX7B68auFDChpyZY8KgPtwBG7oWjAlEUek9cpDXtSaT7xNERUPxA5CtjFYilQUaFnyZwUmMeJ968RUJwXuoEy6vnESkaMyNqh81uzrwSypY08736UbT+/apCClLuVyeCm1EkybNZJgvd61kreoloBVPVjuDHnVZ8LEMepAZs8JlY/6WGAbWRJ51q0FNZG97/12+a+9q03CO2OtX8+DDKhxNkS9o1+3E83o9dHJIEuquXCXiRq4w== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 7/17/23 22:31, Ryan Roberts wrote: > This allows batching the rmap removal with folio_remove_rmap_range(), > which means we avoid spuriously adding a partially unmapped folio to the > deferrred split queue in the common case, which reduces split queue lock > contention. > > Previously each page was removed from the rmap individually with > page_remove_rmap(). If the first page belonged to a large folio, this > would cause page_remove_rmap() to conclude that the folio was now > partially mapped and add the folio to the deferred split queue. But > subsequent calls would cause the folio to become fully unmapped, meaning > there is no value to adding it to the split queue. > > Signed-off-by: Ryan Roberts > --- > mm/memory.c | 119 ++++++++++++++++++++++++++++++++++++++++++++++++++++ > 1 file changed, 119 insertions(+) > > diff --git a/mm/memory.c b/mm/memory.c > index 01f39e8144ef..6facb8c8807a 100644 > --- a/mm/memory.c > +++ b/mm/memory.c > @@ -1391,6 +1391,95 @@ zap_install_uffd_wp_if_needed(struct vm_area_struct *vma, > pte_install_uffd_wp_if_needed(vma, addr, pte, pteval); > } > > +static inline unsigned long page_addr(struct page *page, > + struct page *anchor, unsigned long anchor_addr) > +{ > + unsigned long offset; > + unsigned long addr; > + > + offset = (page_to_pfn(page) - page_to_pfn(anchor)) << PAGE_SHIFT; > + addr = anchor_addr + offset; > + > + if (anchor > page) { > + if (addr > anchor_addr) > + return 0; > + } else { > + if (addr < anchor_addr) > + return ULONG_MAX; > + } > + > + return addr; > +} > + > +static int calc_anon_folio_map_pgcount(struct folio *folio, > + struct page *page, pte_t *pte, > + unsigned long addr, unsigned long end) > +{ > + pte_t ptent; > + int floops; > + int i; > + unsigned long pfn; > + > + end = min(page_addr(&folio->page + folio_nr_pages(folio), page, addr), > + end); > + floops = (end - addr) >> PAGE_SHIFT; > + pfn = page_to_pfn(page); > + pfn++; > + pte++; > + > + for (i = 1; i < floops; i++) { > + ptent = ptep_get(pte); > + > + if (!pte_present(ptent) || > + pte_pfn(ptent) != pfn) { > + return i; > + } > + > + pfn++; > + pte++; > + } > + > + return floops; > +} > + > +static unsigned long zap_anon_pte_range(struct mmu_gather *tlb, > + struct vm_area_struct *vma, > + struct page *page, pte_t *pte, > + unsigned long addr, unsigned long end, > + bool *full_out) > +{ > + struct folio *folio = page_folio(page); > + struct mm_struct *mm = tlb->mm; > + pte_t ptent; > + int pgcount; > + int i; > + bool full; > + > + pgcount = calc_anon_folio_map_pgcount(folio, page, pte, addr, end); > + > + for (i = 0; i < pgcount;) { > + ptent = ptep_get_and_clear_full(mm, addr, pte, tlb->fullmm); > + tlb_remove_tlb_entry(tlb, pte, addr); > + full = __tlb_remove_page(tlb, page, 0); > + > + if (unlikely(page_mapcount(page) < 1)) > + print_bad_pte(vma, addr, ptent, page); > + > + i++; > + page++; > + pte++; > + addr += PAGE_SIZE; > + > + if (unlikely(full)) > + break; > + } > + > + folio_remove_rmap_range(folio, page - i, i, vma); > + > + *full_out = full; > + return i; > +} > + > static unsigned long zap_pte_range(struct mmu_gather *tlb, > struct vm_area_struct *vma, pmd_t *pmd, > unsigned long addr, unsigned long end, > @@ -1428,6 +1517,36 @@ static unsigned long zap_pte_range(struct mmu_gather *tlb, > page = vm_normal_page(vma, addr, ptent); > if (unlikely(!should_zap_page(details, page))) > continue; > + > + /* > + * Batch zap large anonymous folio mappings. This allows > + * batching the rmap removal, which means we avoid > + * spuriously adding a partially unmapped folio to the > + * deferrred split queue in the common case, which > + * reduces split queue lock contention. Require the VMA > + * to be anonymous to ensure that none of the PTEs in > + * the range require zap_install_uffd_wp_if_needed(). > + */ > + if (page && PageAnon(page) && vma_is_anonymous(vma)) { Why this is only for anonymous page? I suppose it can support file mapping also. Regards Yin, Fengwei > + bool full; > + int pgcount; > + > + pgcount = zap_anon_pte_range(tlb, vma, > + page, pte, addr, end, &full); > + > + rss[mm_counter(page)] -= pgcount; > + pgcount--; > + pte += pgcount; > + addr += pgcount << PAGE_SHIFT; > + > + if (unlikely(full)) { > + force_flush = 1; > + addr += PAGE_SIZE; > + break; > + } > + continue; > + } > + > ptent = ptep_get_and_clear_full(mm, addr, pte, > tlb->fullmm); > tlb_remove_tlb_entry(tlb, pte, addr);