From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 28EF2C64EC7 for ; Tue, 28 Feb 2023 06:02:24 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 96CD86B0071; Tue, 28 Feb 2023 01:02:23 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 91C596B0072; Tue, 28 Feb 2023 01:02:23 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7BD936B0073; Tue, 28 Feb 2023 01:02:23 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 689486B0071 for ; Tue, 28 Feb 2023 01:02:23 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 315BF81156 for ; Tue, 28 Feb 2023 06:02:23 +0000 (UTC) X-FDA: 80515655766.12.E60BE10 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (mail-co1nam11on2054.outbound.protection.outlook.com [40.107.220.54]) by imf08.hostedemail.com (Postfix) with ESMTP id 279DF16001B for ; Tue, 28 Feb 2023 06:02:19 +0000 (UTC) Authentication-Results: imf08.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=w8CfFZUt; dmarc=pass (policy=quarantine) header.from=amd.com; spf=pass (imf08.hostedemail.com: domain of Pankaj.Gupta@amd.com designates 40.107.220.54 as permitted sender) smtp.mailfrom=Pankaj.Gupta@amd.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1677564140; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=zQf8HvPWh5E6Mi9uCZVFlrrJppmyfCeR5OHPxy58lUY=; b=2OglGu9g9cqlG16VRHuqp6cXJrgOoDk/zZMGrBiFP/i61zAGuMyU87EMX6fQQWzmZEWMfw +wXc8hfzLAGUbohVrTv0B61YhLH2wBeCCCVqMxCaqhzRfy21GnqIlnCBqaaeUDe8pMrRGT /Ixgpxkz9UtqOA8KCChFg/nsWtx7Wm8= ARC-Authentication-Results: i=2; imf08.hostedemail.com; dkim=pass header.d=amd.com header.s=selector1 header.b=w8CfFZUt; dmarc=pass (policy=quarantine) header.from=amd.com; spf=pass (imf08.hostedemail.com: domain of Pankaj.Gupta@amd.com designates 40.107.220.54 as permitted sender) smtp.mailfrom=Pankaj.Gupta@amd.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1677564140; a=rsa-sha256; cv=pass; b=oXRYpyWnVW5mg+lraOQMqqA0tlhmibk1M1fJyro5BxDvIHDzHsxHhERJhhbHXtu8OQ+Kg4 PsyxNPW5ykg3wUMY9DR6dGRvYJXKpKoh66/whGZDdMNEdseHSVxmzMvBfdZ6X+ZDKsm29c cqjvy9JXH1dbDslU7zg6ei5A+Hnw0Es= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=C1DzOkV2VZCnW8BA2T/wVYioH9iWLzsRhU/+3kre1/dgg7cDwHSC8i5yi271FeY+5Jozzw/pmb2RV/9htqExTVsKCHzQdu6QRCUGdHmNidnrNMcyMvpjlaMy85F7j1pGQwgPH4rwOjRADCx0/PdZv5w6TwCr6x78kN/0GasPx7W2L0BD0aOH1WAwyywTX6vNl9BPx1mI/oz2q6gLGNp3BYAsFqQ0abPTAia1ug0fM9/ZTxryHWUAZTWz970qdcjV7pPFr+03u8FBCYFZXxk4w0kRFLKEd7hbAJaXICWp45+AcSqt7h+tylhUPtRthzIMjWHXsfOCNe3Owz8nWUatJQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=zQf8HvPWh5E6Mi9uCZVFlrrJppmyfCeR5OHPxy58lUY=; b=g/aUhpVyE+ACcn7O5pdbSjmukrX/EGCLQobXTeM7rF7Hz4iIHUG81EABqcxoJIeqkq0LvnpVBimDeQyeN2KQ+nxHoD3IiaV6Ptab8NSW4IcwTmbSp16bNXML/aDoE8DbCuQZUoeIku/E46PmYW7X/4DeZk966vGKZh9QA2la51BnyAjtblEDL0BNpBXrvLGpB14VcJzQvZZPZB+pJ4pz4O60ZeK/PfymkT0Rhi4r/GkJH9Z8NMhTip0xbAVBbJQasNIo5io8eeT59nvnUahKJArUwVqMogYygixTmPbTzKzdrdXi0VxLIBq5I1T3hNXnQqwwCJv1rwrj+lBGFzHUbw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=zQf8HvPWh5E6Mi9uCZVFlrrJppmyfCeR5OHPxy58lUY=; b=w8CfFZUtSPiyppb62Fk+24MFxDIAYHdmzMdrgtE0EwO0NqaQsbQn/WnTQQwtjWOZxMiMt1IKQYMT2JX8e6eM0ilEyQBIAP0+5XQGqkksss1eY31Q04IoEJBZ8HmMXo7ok5KFnmRrm6R0okCd5UneJZXHU6yXyVmlnxHZj3yydCE= Received: from DM6PR12MB2810.namprd12.prod.outlook.com (2603:10b6:5:41::21) by DM6PR12MB4249.namprd12.prod.outlook.com (2603:10b6:5:223::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6134.29; Tue, 28 Feb 2023 06:02:17 +0000 Received: from DM6PR12MB2810.namprd12.prod.outlook.com ([fe80::bad5:8f56:fc07:15cf]) by DM6PR12MB2810.namprd12.prod.outlook.com ([fe80::bad5:8f56:fc07:15cf%3]) with mapi id 15.20.6134.025; Tue, 28 Feb 2023 06:02:16 +0000 Message-ID: <03c941dd-39a9-6775-ce4d-ff6ac9abffd7@amd.com> Date: Tue, 28 Feb 2023 07:02:09 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.6.0 Subject: Re: [LSF/MM/BPF TOPIC] VM Memory Overcommit Content-Language: en-US To: "T.J. Alumbaugh" , lsf-pc@lists.linux-foundation.org Cc: "Sudarshan Rajagopalan (QUIC)" , hch@lst.de, kai.huang@intel.com, David Hildenbrand , jon@nutanix.com, Yuanchu Xie , linux-mm References: From: "Gupta, Pankaj" In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR2P281CA0157.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:99::18) To DM6PR12MB2810.namprd12.prod.outlook.com (2603:10b6:5:41::21) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM6PR12MB2810:EE_|DM6PR12MB4249:EE_ X-MS-Office365-Filtering-Correlation-Id: f0b66d72-d93a-4c89-3311-08db195157da X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: gA/AjuGitIt/Ok+EkOGhJ4gOdQxNnDVEsQUW/FH80IKok2bgIhqOhcBp1vsBZ/Q2rZTnO2GVo4WN5bYSvmtZN1M5O3fFP/Q72xNIUCKnrFjzOuaJvLKHAx03ERYQTkTF4MjMcL9me3AYFocBWWYW6QUozB3/sXJeg3TbjQ0tWzitfScF1c1H55jDsLBJVgFHcxhzAcbrzSIN4Uh1vmJX0UfGO0q6hDnQ2hkEi7tFmAl/lOEpw0f88q6PQ03k7NGYbicnWhuplKxC7zWtm6rfCuH6Nfe55VOUbzr5SyoloJ4W+Wz6AXb0IsNLTf3a0KrUtFLUkFiOtIWvJ49crSAf0zVBxIt5qXZ1xfoLo+WsmcG1ycHHH+xukvWjiaHs8AfXfwJG2I2OCR9e3GVLRN26VEn+K0wOXNJSRa2ypr3e0Dlt8bj36WGGB4aO6cfomy4MPjEBnUjUkcLGjoGQ3rPZBA0nutYtw1DMH8tDIpYlBVBeOcdzRO1pGh66ExxftZY1NXXTpGs0XqLPTFdtl7cl01nQ2PBlR9RGiIxfnEhjwWRj5fj1KJtUXiLwIkf4tQS+09jyBfFS29IIrWFlPZZMrmHnbookTApTC2KOXFIFxkpHfQosOXNH/XCe63PTYPpwwJCJNGZUdWg8InuYachICXcpA2WB1QylD5VmNIQ3WOZOR/9RpSdPKqrY5cH/xVlUHMkuL3h6IimmTib5abITppzIxaqhyRwv0s0noUgQoj8= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DM6PR12MB2810.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230025)(4636009)(39860400002)(396003)(346002)(366004)(376002)(136003)(451199018)(316002)(66946007)(31686004)(2906002)(31696002)(36756003)(5660300002)(8936002)(86362001)(6512007)(6506007)(8676002)(186003)(4326008)(54906003)(66476007)(66556008)(38100700002)(41300700001)(2616005)(83380400001)(478600001)(26005)(6486002)(6666004)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?WlYwcjlCQlFJbEJta3ozeDlmMVNrK1QyWVVQZCtZaVdBVm9YdjFJV3lHVERU?= =?utf-8?B?NGpMNjRlOS9wUUkrZm9YbzM2OWF6bEpyU0dUaXd3dkNYbGxrTzNPSUpPanJV?= =?utf-8?B?aGNCZFhzZ0dlRFFIWWdSUG9EQnY4V1Vvb29LK1ZzQ3Jvd2pzQ1U3QmdrQ2lh?= =?utf-8?B?eVc0L1FkMmdQVkY0V2xBV3hqV0w4TUlEUnhBa2VVYkdENEZyVXRtM0p0WUlD?= =?utf-8?B?aS9wQWZRNUJBVlZqeHFTcU1lRjVWcVNIWGtDamlhMUN1eEZpbXJiOVJwcUZx?= =?utf-8?B?U1I1UUFLWGdjYkVsV1RuRW1zVjRpSlRWcXlnQ0ZNeXd1MXlwcWhSZFVXMW42?= =?utf-8?B?STRKQng2VGRWcHBIU0FIT01BYzVOTDJCdVVac285M0ZHWHIwQkhrU0lvNms1?= =?utf-8?B?eXFGcGhsYm1wTlhjZWt3UXVGUlpmY0c5WnpCMng0S3ExSzBjbTBhazRyYjZP?= =?utf-8?B?bGFwV0NETWFzRGphSGRHV3FGams5NmttZGdvdGY4QXlKUXZJVENtTWZLQUd3?= =?utf-8?B?b3BrZmduTmllQ1hrZWp6RVdtNFNQcHljNVVTY0MvcElWUGpRb3FjZXRrb1B1?= =?utf-8?B?TDZzdjVIUy9HRDd3N0tmdGFsK0dLMUlXeko5RktqNThwOXVUekVFc1dpVDc0?= =?utf-8?B?b28vT0ZjY0xYb0pXMExpclBVb0lrb3o5YktQaTRMeU4vVXlRSEdBUG1xL0tG?= =?utf-8?B?QkNkS2Vlb2JtUGpJMHI5MFNoSHdCUllFL0lSYkl1N0xadjNTUXpVSG1XOXJl?= =?utf-8?B?cDVkREJJczlIVXZ1dDh2THVHelp6Mnh3cW5DWHZEakxPN2F4ZmNkN3lKS2g1?= =?utf-8?B?bDNWNGRvN0twMUFCWkVmNXp2L3hmcG5GN2J3MGdyOCtNSVVRbEZKdXZ0L1VG?= =?utf-8?B?M2RDaUxLWW50THRROTBsR2xSR3l5M2FudXZQR3hjTVNiUWQySE0rRjdtSzZq?= =?utf-8?B?UFdON2hxNGdCcHB0TmY3dUVJRklQMG5zQlRIYTJOT28rMFpuRVk1aHdtTW1K?= =?utf-8?B?L2lhL21TOE9vMy84cWdUSkVGWVMvYytiYnB6WlkrUUhHNEhSWHJFZEdLdkNa?= =?utf-8?B?bkdHS2tKZ0h2MDBtcVZUZHlYbWtDZWFNU1grRWoyaUs0ODdHQiszMmJrcTYz?= =?utf-8?B?RFRqUFRoWitxRUIrVDA5V2ljSnF5TUY4KzRMLzhHYlh4RWIwZ3c3dWtza1hI?= =?utf-8?B?a1NTdEk1bTdDWUswSUdXbG0rUjJOTnRJYWNsYjgwVjdzalpRY0VHeUw3UVVE?= =?utf-8?B?ZHk5WHZabGJ5elc0dXo1NnQ5Y25BQm8zemdkSkxGVUNzcjMyMVptcGRhTVFQ?= =?utf-8?B?T01SQVZpU0wwU0EyNG9HeFpod1RsVWpVRVVaU25zTW5VRncxS04wUjM4RCs5?= =?utf-8?B?aUhBeTdTTGxSTjhTbkN5TmxXdjVTVDM5cEZUZHdWeXJPc05ORTUyUGxwN2JF?= =?utf-8?B?Ti9MSW1Bd0NNMGptY04zQS8wcHNoQndjdXlqWmE3RUw2b0FpWnBQZUkrSzdw?= =?utf-8?B?SXJYOG9waGlOY0dENWRpNlE4b3hURmpTOHlEQlRnaWtLV0dQeTQxSEZTcDVv?= =?utf-8?B?cS82M2Y1RXJJRzd3U2xxUWRCQ2dVYlZveHo2elBXUkVzT21WYVhnczJmQi9k?= =?utf-8?B?TnVuU0xJd1hZOE5nanN4QXZGTmhNTlNrTDQzZDlzZlBQZ2w0eDZONS9reVJJ?= =?utf-8?B?WXl2V055NzQvWnJxaGIzcWVOait5UEl1UDhqc2sxVHRJTkxxdGRFMktnMmE0?= =?utf-8?B?aXJyM3JQSU9HOS9aZGgwR2FTa1VjSlZubVB0SUVsYUhrUE9YYUdHMjg1NmhY?= =?utf-8?B?RVNObjdlWUxYZ1lVaUVOQURURnRqdE5JYjFlSVZwZzhLVnAxQkVkK1hyL1Vz?= =?utf-8?B?SElrVzd3NVBtSHdqWmNwcTVIYUJsUlVROWtsUnNPR0twK1A4Um1WS2tWTXdt?= =?utf-8?B?RGRPeXI0ekpxRFF5ZHRpdTh0TmI2cDM2bTVuaEFDOGx4aHVQbzBwRnpFbFpj?= =?utf-8?B?T0JIbUpzeG91QnJXUGpMNGp0MXBNaXdqK0RiVmFRMXNIdXkvdjZLNkExN25E?= =?utf-8?B?U0ZIeVMvS1V0VjN6b3luL3RXOWZHTEY0RzFwVy9OazBkaHB3MVAyeW0wZStL?= =?utf-8?Q?+ONgwmePSF6mGor99yzMQRdWy?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: f0b66d72-d93a-4c89-3311-08db195157da X-MS-Exchange-CrossTenant-AuthSource: DM6PR12MB2810.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Feb 2023 06:02:16.2676 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: yKEULoX9UEC0fY6jkH7zmOLiLZBK1QFQ0deIAcubJfhcIBe5yExToMj7X2vZ8EjNXJqUQABPd/WqEdcp9vyoDw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4249 X-Rspamd-Queue-Id: 279DF16001B X-Rspamd-Server: rspam09 X-Rspam-User: X-Stat-Signature: kowqhm3ze65dfj8td1fnek188t5auq6r X-HE-Tag: 1677564139-926048 X-HE-Meta: U2FsdGVkX19yIqvjYb2HElrAEKXt7w9Fi/zDMYpHpeaf+SiK35jP08+AYe0QDU+b2hhcQ/um2kDKBVgTeT9/DzBmYe/9qS90JRSdUFFKIMcR0m9UoPlvjZZpO6NUz44FhzoUJTZPpzz+vNKfysaymHmuPidqr+QWbLifRa+mT5o8hx4DOo5FzIZn7OMTiIqYdv/fkMM6hLH6vsBfVeNJlfKl/pwxdyLdTgdtfTcP4l2VbektsJEpNTfzxUexhBAJN0RwsqmxIOJCASTgU3uOfnLEkvZd3bvrtUQFJF83bnfo/OZvvbLUr6SmVi+vOSLpok3CsG4OSBXOqixi9gjyD+E+XAdAeVQDKbJWUPq302DUwzmmWlFm1l0T21LO0zcJFxhJW1jUQLcs9Zk5wOovMTVz0ePBkaD6DdW/Cr2VSBjjLzR2wcwFprUr1L4t7I4BuEtRPeB7yA2d4A/MFo41Nmq91lzPCr6lB8H/+poMCeYneWiYBrU0+wQIyojbNBAeO27wO3n7aFDc74DaQMsEAhQxL/jd+SXYF6Ec8mNVtkjUOvP1cFTNlMumFNuXtc9uq+31emEI5MZuh8Iky3AjS/nXSHwI1cv72UbGVkNSClzY1hRSJd8zp49+9kCOT1jPz32ajeyNbduQgLtxaEIbuV1t4Ler+HLw+YLVqdZEd4uIFKH3xw0uMP+skSLrGXkzZby0xfMUS7EoPBSFJgzhdx2hThXJXPeRrW97dsCYGXKtUbc8HMYMWV9Oa3LGbMMS3KPi228EDjfxGwHbToP2Q21MECLUxMIidt/qVmDK2JZONpq5MIWtOWu9SG9krJ4Pt+T7CsbKJ8z1BChXGU6CJIg06chqndOgQSA4NV5/ljlz9P98+4ot+DB7N4M41lGpEj03w86EFPB8rbeRYE2lqZEWeMN3MC1F9itH0/X6JuV8oNH2jLTfiAfhync+EnNdrWZMTDXkW4+1MXantrU aX2SimYD zYscn4FUwGprKMot3Lno71JiGo0X4AA5ce4V93q+F6aJDJuTkJJnAxpmRXAKq+C/8gX2wL3dDhecEdU9eGQZmL/aVSeQjnT8hnKIyAqUEgoSayyM4vrped3+F2N5iFPAHlm7rtO7THwVzH60zLcOQbX947+5tDM2fRkM7lLUCUOOWpoIiP97tKoKzSQP0t/wylf9KYf9Gw2pORc7ds1km5Cmz750s/+jDrS8+ X-Bogosity: Ham, tests=bogofilter, spamicity=0.017275, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi T.J, > This topic proposal would be to present and discuss multiple MM > features to improve host memory overcommit while running VMs. There > are two general cases: > > 1. The host and its guests operate independently, > > 2. The host and its guests cooperate by techniques like ballooning. > > In the first case, we would discuss some new techniques, e.g., fast > access bit harvesting in the KVM MMU, and some difficulties, e.g., > double zswapping. > > In the second case, we would like to discuss a novel working set size > (WSS) notifier framework and some improvements to the ballooning > policy. The WSS notifier, when available, can report WSS to its > listeners. VM Memory Overcommit is one of its use cases: the > virtio-balloon driver can register for WSS notifications and relay WSS > to the host. The host can leverage the WSS notifications and improve > the ballooning policy. I am interested in this discussion. Have few questions below: - What kind/frequency of data we expect WSS would relay to the host in good and worst case? - Thoughts already considered about the overhead VM will have based on WSS relay data to the host and host taking action on the data? -- One thing iirc from the free page hinting design experiments is preventing guest and host acting simultaneously (e.g for free) on same page (pfn) and also reducing the overhead of sending data from guest to host by sending the highest possible page order. Maybe some of these or other similar techniques are already considered. Thanks, Pankaj > > This topic would be of interest to a wide range of audience, e.g., > phones, laptops and servers. > Co-presented with Yuanchu Xie. > > Thanks, > > -T.J. >