From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 578D5C77B7A for ; Tue, 16 May 2023 12:24:35 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id A933D280003; Tue, 16 May 2023 08:24:34 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id A3FFF900002; Tue, 16 May 2023 08:24:34 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 8E0A6280003; Tue, 16 May 2023 08:24:34 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 7B0BB900002 for ; Tue, 16 May 2023 08:24:34 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 3A8F8A0268 for ; Tue, 16 May 2023 12:24:34 +0000 (UTC) X-FDA: 80796036468.16.8DAE7A5 Received: from NAM04-DM6-obe.outbound.protection.outlook.com (mail-dm6nam04on2051.outbound.protection.outlook.com [40.107.102.51]) by imf25.hostedemail.com (Postfix) with ESMTP id 4B1E3A000D for ; Tue, 16 May 2023 12:24:30 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=lA1ZEmsH; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf25.hostedemail.com: domain of apopple@nvidia.com designates 40.107.102.51 as permitted sender) smtp.mailfrom=apopple@nvidia.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1684239870; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fzcjHcXWoVQ9GLNTnd73sPk1oCZehBHl2lJh8tWwizI=; b=djc7vnpyAQBT/wvNIicc8fU5KpG1P43xC5I2wGpTkGdDg4HypNj6eFos/gMEJ7GeTAFni4 PcNGnJxVumpYftC/p2I7829GefndPK0uuUepaSRvVljNJFkBAF82SsBWTolKj6cB14CLMF 1VGD8ASAXA1o3hshh5fBeBR5+xIhGGc= ARC-Authentication-Results: i=2; imf25.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=lA1ZEmsH; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf25.hostedemail.com: domain of apopple@nvidia.com designates 40.107.102.51 as permitted sender) smtp.mailfrom=apopple@nvidia.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1684239870; a=rsa-sha256; cv=pass; b=1ojA5nzsQBrdSU2tJFROad8oqkim+VL0iqb/7ZyEqOtG49qc2aA/vo4fLJhUBxS8PdoWsG zUSdFIFKhP/lNcxkj6FqR5vsWL9K3jXy/eJcOeMWW/rGHq2Y6BmpN+trakurhtKNbIRCNo +IWWpuQSheLfGBd6LCaBNwBa1jqQgts= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NUU83Su0GvfmLi2q+v4iJNI16HKSR3e7yrFHAeKWWDDVFgSRYH78bQTHguFFikbvwz7OzA6DGXIpPTLXdsqeCZKldII1+S5w0mixRWJL4kLgNd+2IAw3BNmE1uvRCETHU2skxBOzatGgWt2V+nmRn6F1csq9cBDdnkV6oA5MwoZG3z7MyGec2fpMshM3yq4zqjtFQMClTXURhr709T58oQG/gCBVSItg5u0Ni/ZOLpYursdG0OwiH6GbNXuFBuvFYOlPMI/zN6ExNZCfjUd1QKpXJhPKD9Ly9ruHqOw2kfks9IyAX2qUnKR6eF59H3uxK6lEbxQ8X9Th6Q/ZcjT6qw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fzcjHcXWoVQ9GLNTnd73sPk1oCZehBHl2lJh8tWwizI=; b=LO8drDNJODe7nxni7f1dvUFvtBIEdutyUbvKgBS+7qz8KAAeFPYgGPyBlHo0B4CcjJ5uQaKrsc0hDNuwxzKTpBhTz80UgPO+4uw2pXnFaPxFwolHlDE7X6FzJOQ5Nb0rXXHGFNvqWhwCwUtZ/ecreGButAz1nvTyMEyTNYFYNowJtiDPhY1VdQiBkKDjgzLtknMl8iu57X9exL/tiHcjQ+/2fMyi6a2xjqk5WQoZGONchrU9NMm/Ux8K+ek2VSl1nnTq3dT9y+gb68LykzxkSZJQEZlNkqtS984ga1Q6NF2D8YcHzorN9oCveIlKKcYn4ZPHzIST4UDT28yAEmDgKA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=fzcjHcXWoVQ9GLNTnd73sPk1oCZehBHl2lJh8tWwizI=; b=lA1ZEmsHCWucaqf46VPtbG1zVcANVfgFiM/r3FVhqk4KUSwab2J6jN4WlVcn7n5XMEl5ozBa05jokKvsMhpYCuz+XwfbSu5FtNM3/zA4rweKJek+iu9Mo3WUY+H9XJyBprGOitFRKOx1UQaSqRGiJ1yVOgU09f7hQ3Slt9PtoePR4kmnE5WbQKZNwTtvWqInjYqxjMNIEbWtZvwvEOHef0ewAzdLt8hFrGXJtAlKr8tD4qfjWV+S4BGhACiGuSr4bHAv9Ppdf1qOgbzLu7TLAUWHUAdy/CeOMu7mU89XYn5MOz+pVLAwDU4qRqMYJDzQou2RJWLTtHrz/gPqgZzmkA== Received: from BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) by BN9PR12MB5115.namprd12.prod.outlook.com (2603:10b6:408:118::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6387.33; Tue, 16 May 2023 12:24:26 +0000 Received: from BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::f6e4:71a5:4998:e6b2]) by BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::f6e4:71a5:4998:e6b2%4]) with mapi id 15.20.6387.029; Tue, 16 May 2023 12:24:26 +0000 References: <874josz4rd.fsf@nvidia.com> <877ctm518f.fsf@nvidia.com> <87ttwnkzap.fsf@nvidia.com> <87jzxe9baj.fsf@nvidia.com> User-agent: mu4e 1.8.10; emacs 28.2 From: Alistair Popple To: Jason Gunthorpe Cc: Chris Li , "T.J. Mercier" , lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, cgroups@vger.kernel.org, Yosry Ahmed , Tejun Heo , Shakeel Butt , Muchun Song , Johannes Weiner , Roman Gushchin , Kalesh Singh , Yu Zhao Subject: Re: [LSF/MM/BPF TOPIC] Reducing zombie memcgs Date: Tue, 16 May 2023 22:21:10 +1000 In-reply-to: Message-ID: <87y1lo8nwp.fsf@nvidia.com> Content-Type: text/plain X-ClientProxiedBy: BYAPR02CA0025.namprd02.prod.outlook.com (2603:10b6:a02:ee::38) To BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BYAPR12MB3176:EE_|BN9PR12MB5115:EE_ X-MS-Office365-Filtering-Correlation-Id: df60946f-5fde-42cb-ff4e-08db56087d32 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 2YYWiVtE8Q8SM+5WbIdAPDejoAJBCWMohgA95Jlk7p0AVGl5JdgXRhcBfTG+I0xmpsD65ji/p5GgUVtUNYdD/7I4Ofo1oXzbElAo6pR6aWZOrDVPLfwVm2gsdbRZVr/LPKiXdk1TlUk10o3j1Kgylr46XygHXfWMV8EN0vcVS5EHgBVoQNdsXjY1z0XqHnyC5aHI0rKE2ip5/V27lrCd7eUDyfPCzLdE+A9W0R2RFiZTRqHhJZ1t7Mx9r2q9wXsHNWuvCvzXMBA1deu7Gt+1k+r4iOP4Vfvimlu+otSvpElkvJhEfVsHEETc4WZBpZsZSW21rIb4+XmOPXEisVplVXLGBbCgBl1Vg74NSJ+TK7dFyQF4kr47OYZbUjisHBEai3x2zut0nHhwDPvrFWlZask3EZH/MMotcAjYiZBqG8PDmIcCQ7GowMZZs8OQEBgWD0wvh2PoXKrr+wHy+AfahbREEqAH2gQtI8S0Zd8GtmRLyjniBcKBNv03KmWSphSirRVlR3KGg369I/cXhAQa0jQmCpcSSwY7G4fYcH3IY/IoGcgyeoXK2t/ijbWc0eID X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR12MB3176.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(396003)(39860400002)(136003)(376002)(366004)(346002)(451199021)(6636002)(4326008)(36756003)(2906002)(66899021)(8936002)(5660300002)(6862004)(8676002)(7416002)(41300700001)(66476007)(86362001)(316002)(66556008)(66946007)(478600001)(54906003)(37006003)(6666004)(6486002)(186003)(26005)(6512007)(6506007)(83380400001)(2616005)(38100700002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?eU9Lz8qylC7BvINFkU3jos896C+f8DqUlhzNNYCFZWdseIZJNs2lNTLrVkWH?= =?us-ascii?Q?e9I+zfP0KBrTHuB/AhK8sFDKVw9zJLH/4Yg1cXfu1UMEhUC6wJbtpwXJVaEe?= =?us-ascii?Q?gh2+9nbj6MEjJW8IpatCWiYdhwk9LKTACWnR8wtMOYwaFI9jS48zKafLJK+N?= =?us-ascii?Q?OutlW0ueIjvaUx0C8dvcUuKe7sf4+nm9M3oE3bi9X7HCkqu+fo2B22Ai5oYe?= =?us-ascii?Q?UCTrBdjsG57CGxOlwTSHA/tYbtHFp0QwWg0b7t7491AcILWAKynTiBa1sL5d?= =?us-ascii?Q?Xef3TH7/0ZuSz+WsLpUFVWijnPvbyXevO+5L0I8QcSWsrH2KBgmqLMbiE9uV?= =?us-ascii?Q?T21q05RHCrR0EIFCdxhtWh9WgK6ELzv9A/Xa8ZcNEqBTH8VaZ/JbXlu/dGE3?= =?us-ascii?Q?s7EUrtZwcx2A4e7K5wLQ6s8uFhkpQRoWq5pQvWOpBRDtivhW3DmDCaF2oags?= =?us-ascii?Q?Ewu6qsaIPHemz9DWIh/6Kq4EHSDrpi2C63W+jXI2AXeAxF9vzxApEctoyapY?= =?us-ascii?Q?Umbs4sJzTTrzJWzmkS7hSy0uSvgRUjyzuwbw8fo/trtbWaeK+hCKaxHJ0IpB?= =?us-ascii?Q?PvuvWRLgdcaW4lXdEEq1SDYxZfzZgpwpRW1OlR0RkYLOj178fxzmBlKq5IFH?= =?us-ascii?Q?c8xWFZr50rJLv0abSFPpL4/T0q0arCK7/rnO/ME9fS+RU1OXjO3EMoTA9+4H?= =?us-ascii?Q?9j84YkNU+Jhbpm8AGAOTRrkdT77P/6NHzsX2brvd9Wjwan46pymm6S1qbO9x?= =?us-ascii?Q?05ie+Z6//pjLjscchKWfjPdW0MNpVakxyI/p5i2R1336/r2C6+qzDYUf0KAD?= =?us-ascii?Q?9p+LNtcHa18T9jdbpvpMuJqI8n3dvqTrMz1jYAxc21Rcc5VOx/dpgobBhrT/?= =?us-ascii?Q?qCGX9XoZWsHUwllkRzhORmNjaGXGqPh3aAZZOBC9KiNLl1hPTTrzGODhEqJx?= =?us-ascii?Q?mQoZShIqf5ZjNot8K/zC1CcuHXyGO93dRRYDVG6RvSR48UAXriFMnWtgmU8y?= =?us-ascii?Q?VD0dJ72skrgNu1tn59MZL9oHiEj63SX+5C4DfVc/avJGMTOy1dtdFMaEdp+i?= =?us-ascii?Q?9PiPvzDi3lzYF5bdfpgBUWqgu+Nq1ErgbQICeAUu4jsLzk69Vfz+lZ2Lo/T/?= =?us-ascii?Q?ypQ4wbv/LrRcjduPOjjIw/0xbECNwLHC6axJ29p/7ywFefMxFD8UPWzQNn/r?= =?us-ascii?Q?TiUquXNepNNRi09JgNKUCYY2BqUqBi624QlCEzm673ISOylPjZupZw6xOSrU?= =?us-ascii?Q?lPN0Fx4FkmCbsrEkSOEm/RIwJVhKSdVf8KUWjfWfpYo/4kqi9rv2BtnD7lLe?= =?us-ascii?Q?wQp9U29nNGc89HZbD/JrrJ7e/020SDivRMGHmATpuns8K5Ww8zvqom+wq7yV?= =?us-ascii?Q?QAnSHfqagtOSOvs3yQFobpHlkxHImLUwzp2z1KjLzepc7JPmVQm4YwG4W0eJ?= =?us-ascii?Q?qQlggoNqQLL/tAwmPpdvdWVaOxCf3apYhk36s6Bps0e1gEa2/RXv6iKCnNaX?= =?us-ascii?Q?xxZwDZq1e0UilGpy7VSpB374FL1K4mlxDLmdA5sjLfayTRdHtiPqixQkdn9s?= =?us-ascii?Q?7qPVUZ7NcISY5eVEyMRslEWfc/rr/j0KMx0lpslH?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: df60946f-5fde-42cb-ff4e-08db56087d32 X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3176.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 May 2023 12:24:26.5856 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: YC6Bzj5wZjanjKFof8aSnlPc+oG+E8kfp/4Gaibr/UOQ8PkfAcZngvNquOojyxCXdKKgox+zqKv1eTEGNS/YQg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN9PR12MB5115 X-Stat-Signature: wz9s6ha1jqwd7d7g6ryoms89pqb1misn X-Rspam-User: X-Rspamd-Queue-Id: 4B1E3A000D X-Rspamd-Server: rspam07 X-HE-Tag: 1684239870-600972 X-HE-Meta: U2FsdGVkX189MgL9SWCKlOjLP3J9GqUWpBQcMG5INn/WCep0UIv08p0AzgN8AQLysTzeuEFPEFYm8hVBzly1H/lZR6Pu0Cf72sCYqAosyRAK8S8PlKxiLm9yw2pVDetjQhxMdyDjvpSaXc98G/SUk4hgWhbte8yusljujFrJ3chCNz1dtDn47LfpnN7r8mcbE5Ark7Tja3ITa5AeEleI35KFOuksX7VpGCOKA6GLIJM7ICL2D70pcsyQlM6cixzBXzLfmOEEiSrR0o4yGmreexArCdTunQatpQWLQj+pOe/4yMJmRa4/95rQIaoWIvnW6Zo2Q+yM0+VghjS+DNBxt4v89yba8LdKfAJQODE9MJS69iPc2KGqoN0F5DyPknZcPOkUxaYy8Bq4kR/fAbyQ92BK5lxJ0u1G/hcXLwUxSgnYc42F4oj0yFRpRS/5rOFfU7lCd6kBX+1hQdtgHWjTW93PB1+AkmJs4pEY1zIQygOpYpsNvLh+IotjUqVdwUnqtlYFXcRjZVKX5dGK2aGVjUk07OKvRHYN8YuObBdvqzu38axCXoZDm8vk3y0WBoJG+RD3PqPsxmIB14aI1babh9CMU+86soACvcD2wnpvJ0R+5v1BjiIaGE8xQvlIanPht4jwpR7aInArCfAPHI/iB5c/7ZcQXKo/TU8KcdMksIE0go36UcL8YRMBl7F+eqcH4parJCM1sDUhcTQJWaIdkO59eJBtfI98v5hHWXkQNo3Pn2SNtL9Cand9apVsVijPN5/ROp3Dk7XOp2CbugI6jriAsWj9kAqfdYCm1Q01szv3bczPnjly6vpD8fRoFBrAH0WkVYtILkbn+AV+DnSQjLvsxvhKtcGM9ojNmnw4EKuUSyD20IQtzj46rU5sLYUCyhs5rE2HwWPxvrGdpEFhV5ZKE40P+ppPHScywsw56biLGQDOdyAegsEBGLRmq9RAZP/w3BJQExXxM3QIB5Q 3ZsdomrE shJFpGpYWgdMdn2MLErjrhB5oSD5goeT/EsnLS4gUoTMkTpPQKxJNyLlKeGTdo2GMgzp4LJfK6z4gS4dqWGezuR58CF5HOhDSDf3RzGW8SZ3fTyB25UBYYojlUvcYBwD9cstnqrkXZhqQYKMrLI7Xn+yoMEyn+cRaufjfaOvrMiBkb3SN5GrKfRk6TQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Jason Gunthorpe writes: > On Fri, May 12, 2023 at 06:45:13PM +1000, Alistair Popple wrote: > >> However review comments suggested it needed to be added as part of >> memcg. As soon as we do that we have to address how we deal with shared >> memory. If we stick with the original RLIMIT proposal this discussion >> goes away, but based on feedback I think I need to at least investigate >> integrating it into memcg to get anything merged. > > Personally I don't see how we can effectively solve the per-page > problem without also tracking all the owning memcgs for every > page. This means giving each struct page an array of memcgs > > I suspect this will be too expensive to be realistically > implementable. Yep, agree with that. Tracking the list of memcgs was the main problem that prevented this. > If it is done then we may not even need a pin controller on its own as > the main memcg should capture most of it. (althought it doesn't > distinguish between movable/swappable and non-swappable memory) > > But this is all being done for the libvirt people, so it would be good > to involve them Do you know of anyone specifically there that is interested in this? I've rebased my series on latest upstream and am about to resend it so would be good to get some feedback from them. Thanks. > Jason