From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D7039C76196 for ; Tue, 11 Apr 2023 23:36:52 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EE390900002; Tue, 11 Apr 2023 19:36:51 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E6BA66B0075; Tue, 11 Apr 2023 19:36:51 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D336A900002; Tue, 11 Apr 2023 19:36:51 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id C43C16B0074 for ; Tue, 11 Apr 2023 19:36:51 -0400 (EDT) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay03.hostedemail.com (Postfix) with ESMTP id 8D2E3A0D40 for ; Tue, 11 Apr 2023 23:36:51 +0000 (UTC) X-FDA: 80670722622.18.C52C08A Received: from mail-yb1-f178.google.com (mail-yb1-f178.google.com [209.85.219.178]) by imf12.hostedemail.com (Postfix) with ESMTP id F1F704000C for ; Tue, 11 Apr 2023 23:36:48 +0000 (UTC) Authentication-Results: imf12.hostedemail.com; dkim=pass header.d=google.com header.s=20221208 header.b="vk1Y0/oQ"; spf=pass (imf12.hostedemail.com: domain of tjmercier@google.com designates 209.85.219.178 as permitted sender) smtp.mailfrom=tjmercier@google.com; dmarc=pass (policy=reject) header.from=google.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681256209; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=e+cWg+b19Pk6f8lXfyk0VWgnSnQrmltuo/INztAOGCM=; b=7hcqNFWSeKSS+knxKroLCZk5l9eRlL7Okuu6qvX+uvb1ZjFts1JBkxSyE6qh0QjpDSRUyx dRMsdgi55FRrJfw74wGL21ABMLXPB/zhDiU2KhD1nagAn0hM3MIOkjpxsR4Mtz5rHgXGNe yZwBCW4fb/ZN+fR3gAXnDkVPJeHIPFI= ARC-Authentication-Results: i=1; imf12.hostedemail.com; dkim=pass header.d=google.com header.s=20221208 header.b="vk1Y0/oQ"; spf=pass (imf12.hostedemail.com: domain of tjmercier@google.com designates 209.85.219.178 as permitted sender) smtp.mailfrom=tjmercier@google.com; dmarc=pass (policy=reject) header.from=google.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681256209; a=rsa-sha256; cv=none; b=tVzkeG87bimFa5Gp41ZvLdAMBkzO+pPCNrQ/XZDaJBFHHnEbC7UWa5v5BhLtCPmVDB5Vy1 R5HvoYG1QstW8t5SPdaOXBgfbB7cqZ0P3K89WwSwmesG0X/xiSojnlKrTIMRUyNpY/Yqb1 Ajwn03DKyiUDwgnq8fPo/rJEEYsziUM= Received: by mail-yb1-f178.google.com with SMTP id z9so10004627ybs.9 for ; Tue, 11 Apr 2023 16:36:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20221208; t=1681256208; x=1683848208; h=cc:to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=e+cWg+b19Pk6f8lXfyk0VWgnSnQrmltuo/INztAOGCM=; b=vk1Y0/oQzBUKttG+1CE6Ykc1Os1ojCytzOnyh/uKmZw1VqlduwkcIOGwSrjaxmqQZy 9rbnHcjMsuGy47RJQ0tDwzDsfqZ3odrq+rP2bYEL8fY0bFzv09M8Ns8y9subW8q2Hxmi Wy45zN3ZdT6Nn60tro6WBgbtscAv4FWObD957ShoM4DJR3ARE9eSLY78cFkVS9AD3JWQ jETav30clTRWo3y8krtaJPOD39cGb6zkkFpSG8Op77Gr0Js3nG0R1MlZ41AF13QSZqFS AeSFa3TCWZlR54JH/xtyu8RGrzmUPafEJhPZkfwPIgSMYesdaBp7Uqn6tI5mRFpcNQkF nppA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1681256208; x=1683848208; h=cc:to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=e+cWg+b19Pk6f8lXfyk0VWgnSnQrmltuo/INztAOGCM=; b=IOqqx04prtIkODapt164jNlw6+qT5uZMnJL2iwzXmN8zmbU/th1penDGEjV+aQL6vB lOMMvfGCure3sJVPw1gXU4hyDCwWymCgWh4lXpldCm2NUvZupF7mYKaOKDMoS6RiqimA vovHd2hmLxvKSqdlOe75qfwbTp3FHAQibjjGzqISn2AE3Oqs60zr00evSm41lhEBsKyg Aoggl7Vx+OAA0OsizFvitXt3R4cFiSe5eOhSRWOkV1xrH1IVwN+7uUwRvj3t8Cr9W7QB gIPDadcyNWfi91O+6hRNB/jGu0aYnpigS4FdWhtL3yswNbJ6OuWTKu4njCm3+2jw3mW9 zOzw== X-Gm-Message-State: AAQBX9cUR9I3eKnov2BmEZdqq1GZ37mdiSi7bVau9+ssct591OrAphDp wjOBGxT2loSp4jE+KD23WcwQ/daUaVsFBl1FYgF+Xw== X-Google-Smtp-Source: AKy350a/D1o92hNC65AUYewK6NKnO5GBHgtProbpBqJDoVgY74hK4YNYrX19Hq1NIrvTbVlXoBjnfT2wr92sdl5THZI= X-Received: by 2002:a25:e009:0:b0:b8e:db4a:a366 with SMTP id x9-20020a25e009000000b00b8edb4aa366mr383770ybg.11.1681256208004; Tue, 11 Apr 2023 16:36:48 -0700 (PDT) MIME-Version: 1.0 From: "T.J. Mercier" Date: Tue, 11 Apr 2023 16:36:37 -0700 Message-ID: Subject: [LSF/MM/BPF TOPIC] Reducing zombie memcgs To: lsf-pc@lists.linux-foundation.org Cc: linux-mm@kvack.org, cgroups@vger.kernel.org, Yosry Ahmed , Tejun Heo , Shakeel Butt , Muchun Song , Johannes Weiner , Roman Gushchin , Alistair Popple , Jason Gunthorpe , Kalesh Singh , Yu Zhao Content-Type: text/plain; charset="UTF-8" X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: F1F704000C X-Stat-Signature: fjm6sktnsdtwr5739mtbsquedw7dghsu X-HE-Tag: 1681256208-403813 X-HE-Meta: U2FsdGVkX19AosvaDNpqQGsqmId1eD+ahm34IzRPvVjRRlbvvnXJQNATIaRli3r948h4WBtINTGF+0EbSw6olz3la18HGJx7Ab1Xh7LTd+GesKrGegjHlGHAZx/0UZMi+3BwS2Wi/E6upDYeKs7/BLlgtzUIj+Wz2EVZ+SW2dUl62pOp0IRdQlz1zNHYj2VpFsD+6+pB55WIrhPnjLFMBOqpakHD8ll4dtSSD5q2MliR5BzGywgXHZVC9e+JitEMCl9aM4PbnZHd55mz76qiegghGjnZoncqbU27ub1ClpvdlOXtulrS6V07FJQSWCWna22/08yXkFqGRWMLBpReoToNIeTA6FAohvQks6vTfNYZ5iKHo+hiW3rJ8E1vWZ1IyL/Yi5+qQpXTLlUQwTr4hgPLXgW3zcrrT3WumUckb8ZB4Y8KA7gyeXUNVjIvKFbLGLLAks61JeI4kBAnK0t/cv+mNHTtMHMjL9vyrSZAly3zAioJgPZWbKe/u/IQ3Y7++fZwpz9uzRexwNQiovqZlHJ3xr/GeoM2iB53boN5bp4UFdyspAFP+O6akFuFf8SM4G7po8LGV9rwIpz2uoGAqybkjGjge6JxDha/dJmNZ3CEzKNyvY8ysp46kOAezvE6TJz2vGb11oWU1STh1wUAIhfj5PzKaf7Gvd15Tml8sqgwbvUer3kFnMcWX9OR9cY2lnzjCuY4mRhqgXOQHYzl68zNlx3lsCjXJKKWOpSjwvwngMoriPGKQE4py2N0P+0ogcbOEh9oUwnfr/QNW1/mLOahH+j5VdKJsbkEOJwHI/U4gPRDhJ2ZTed1VaDv/6NZpYBNXMclvH4VPxl96o5+IQ9CLrYZw1c1T5pXjseoUvTIuHaD7AT6leJXLL7k3SPZ52OcYPlvwFnqdOEHGS4d73i4TY1xbpP5dJryfGJMXZq2kOso9dr2FOtb3Ddqa5OohQMDDZSEHMGxB+c/5ty Veot6wwp nERSyPQ7bcPkx0TH8bVnf5eM8s8ZjBJuk97ZL0ATnzqRoLGWo//PhBIwANaD23d3dMSbOtY6IEeOok27ThrLm9Dv5JANyfQn3HGmED5eiozGfXIwtzIrgJSwvd5gC25+g5lfX/VdEal7fqUxdvIkSRimIJE7/quFVKbW+94QkR0KTKB8d01YrTs4sM+tUrI/Fh7Uiz5aMZSam00Ix5pBQvplNOFuhyKfdicbcVai/abAzAciM5AXQGVEEWx544fgIb+Oinh9bwQoHkB+Rly7+VfeQ8enCPE+QJxyv3KDnGixTR384YyWSoe8YxlxVTjNdDoJ/ukoUhBt3VrSu3zhRnGhUmk3x9CH7QN2FhlOl1T6W4PExrLTHVtelSszTyoD/cYmPcFkvdlRZWftvRw4VaLwNGUMzQnfx9DDe X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: When a memcg is removed by userspace it gets offlined by the kernel. Offline memcgs are hidden from user space, but they still live in the kernel until their reference count drops to 0. New allocations cannot be charged to offline memcgs, but existing allocations charged to offline memcgs remain charged, and hold a reference to the memcg. As such, an offline memcg can remain in the kernel indefinitely, becoming a zombie memcg. The accumulation of a large number of zombie memcgs lead to increased system overhead (mainly percpu data in struct mem_cgroup). It also causes some kernel operations that scale with the number of memcgs to become less efficient (e.g. reclaim). There are currently out-of-tree solutions which attempt to periodically clean up zombie memcgs by reclaiming from them. However that is not effective for non-reclaimable memory, which it would be better to reparent or recharge to an online cgroup. There are also proposed changes that would benefit from recharging for shared resources like pinned pages, or DMA buffer pages. Suggested attendees: Yosry Ahmed Yu Zhao T.J. Mercier Tejun Heo Shakeel Butt Muchun Song Johannes Weiner Roman Gushchin Alistair Popple Jason Gunthorpe Kalesh Singh