From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C8B2CC433EF for ; Mon, 30 May 2022 11:26:39 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 69F2D6B008A; Mon, 30 May 2022 07:26:39 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 678DC6B008C; Mon, 30 May 2022 07:26:39 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 53BA16B0092; Mon, 30 May 2022 07:26:39 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 452996B008A for ; Mon, 30 May 2022 07:26:39 -0400 (EDT) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay13.hostedemail.com (Postfix) with ESMTP id 213186104F for ; Mon, 30 May 2022 11:26:39 +0000 (UTC) X-FDA: 79522181718.14.9849F12 Received: from mail-lj1-f174.google.com (mail-lj1-f174.google.com [209.85.208.174]) by imf08.hostedemail.com (Postfix) with ESMTP id 1D9A1160042 for ; Mon, 30 May 2022 11:26:14 +0000 (UTC) Received: by mail-lj1-f174.google.com with SMTP id v9so11262871lja.12 for ; Mon, 30 May 2022 04:26:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=openvz-org.20210112.gappssmtp.com; s=20210112; h=message-id:date:mime-version:user-agent:from:subject:to:cc :references:content-language:in-reply-to:content-transfer-encoding; bh=lq150UndXxHEWEhIvsqNd7aCUGl0NaprSMERTMCukMc=; b=yL39YrAU3i/NoAsVN95rMmJdSBldmOz1PwlQ73jfMuWdBXrupcnQd2G2xM7mDHLOTw 5cG1/LbM9ELIeheHf4QRIj9qoEGrwWMMYtTwVRLQaMrZRY2GTI6OHsCLJntYiy66xJLY dcyIU7JJNYbu0N8ONgoWHtdXARu59CTqL/J5y5kDSzriAP6IQIHw/6y+net9f403FUOP Aes5Xixs/Zs3CgFNNxQ0wi8z2ztQjubVeeh91mEi5dPW+K70JTAiWKmInlePnVUr/5IK DTGNdcEdAZiKlmqMNwtccV54snA1/n0921UB4g/zMC0+ndU8bwXFam+o5cqi5VihlEFc srgA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:from :subject:to:cc:references:content-language:in-reply-to :content-transfer-encoding; bh=lq150UndXxHEWEhIvsqNd7aCUGl0NaprSMERTMCukMc=; b=vDaAKxrxOBwBs+BwJRuNTdugl5+0nQpz9Wa5gbqeXLGbxZaIiPQIGnmBpBDs6FduCZ fNMFzxnScKAg3qgUiCYDguKyYy+RVOzF56zzsFdeGEwhs3zc1pOGFkam1BEuK8ZbQzve eY2pZo7DMdPTejR9CqCiEO5IJ82fbXMKPly1HJq9mXSSFlgjzm+0+/KmRhn9JFGFxIW6 19l04RpQlZSZSCuo4yMu9dfP8xh5EDLzRaaVExpcm+DD9IqeVyyV+moFhgirbVLungJs H5IvzftLlkEdde72DEBNvUQmTSpLuOvnCqpfcuQs19aY9bz0G2HgqC8GGzGVc5W3hhZf xhIA== X-Gm-Message-State: AOAM531qH5GvMhd5cVNnMQrx0Bzq7dYT//CgWCR5tEsYpiYmZwqb9/0g tG6K3SidH0rKDwEOPZHBwj4HMw== X-Google-Smtp-Source: ABdhPJwoNEILXS/Ta/5QtJ50Sqhv6gqI05zlzE2tSZ8ZQnzFJ2iJChwRNpf+PMd3ZkCKWgErKXBsxQ== X-Received: by 2002:a2e:a286:0:b0:253:bff6:ed52 with SMTP id k6-20020a2ea286000000b00253bff6ed52mr33837134lja.229.1653909998100; Mon, 30 May 2022 04:26:38 -0700 (PDT) Received: from [192.168.1.65] ([46.188.121.129]) by smtp.gmail.com with ESMTPSA id i16-20020a056512341000b0047855972515sm2257257lfr.72.2022.05.30.04.26.37 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 30 May 2022 04:26:37 -0700 (PDT) Message-ID: <2fbede88-6ef7-4ce7-b3a3-ec349bc2cc06@openvz.org> Date: Mon, 30 May 2022 14:26:36 +0300 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.8.1 From: Vasily Averin Subject: [PATCH mm v3 6/9] memcg: enable accounting for percpu allocation of struct cgroup_rstat_cpu To: Andrew Morton Cc: kernel@openvz.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org, Shakeel Butt , Roman Gushchin , =?UTF-8?Q?Michal_Koutn=c3=bd?= , Vlastimil Babka , Michal Hocko , Muchun Song , cgroups@vger.kernel.org References: <06505918-3b8a-0ad5-5951-89ecb510138e@openvz.org> Content-Language: en-US In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 1D9A1160042 X-Stat-Signature: 71ib6buj95pr9nud64xi55swu1bihnrr Authentication-Results: imf08.hostedemail.com; dkim=pass header.d=openvz-org.20210112.gappssmtp.com header.s=20210112 header.b=yL39YrAU; dmarc=pass (policy=none) header.from=openvz.org; spf=pass (imf08.hostedemail.com: domain of vvs@openvz.org designates 209.85.208.174 as permitted sender) smtp.mailfrom=vvs@openvz.org X-Rspam-User: X-Rspamd-Server: rspam11 X-HE-Tag: 1653909974-691286 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: struct cgroup_rstat_cpu is percpu allocated for each new cgroup and can consume a significant portion of all allocated memory on nodes with a large number of CPUs. Common part of the cgroup creation: Allocs Alloc $1*$2 Sum Allocation number size -------------------------------------------- 16 ~ 352 5632 5632 KERNFS 1 + 4096 4096 9728 (cgroup_mkdir+0xe4) 1 584 584 10312 (radix_tree_node_alloc.constprop.0+0x89) 1 192 192 10504 (__d_alloc+0x29) 2 72 144 10648 (avc_alloc_node+0x27) 2 64 128 10776 (percpu_ref_init+0x6a) 1 64 64 10840 (memcg_list_lru_alloc+0x21a) percpu: 1 + 192 192 192 call_site=psi_cgroup_alloc+0x1e 1 + 96 96 288 call_site=cgroup_rstat_init+0x5f 2 12 24 312 call_site=percpu_ref_init+0x23 1 6 6 318 call_site=__percpu_counter_init+0x22 '+' -- to be accounted, '~' -- partially accounted Signed-off-by: Vasily Averin Acked-by: Shakeel Butt Acked-by: Roman Gushchin --- kernel/cgroup/rstat.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/kernel/cgroup/rstat.c b/kernel/cgroup/rstat.c index 24b5c2ab5598..2904b185b01b 100644 --- a/kernel/cgroup/rstat.c +++ b/kernel/cgroup/rstat.c @@ -257,7 +257,8 @@ int cgroup_rstat_init(struct cgroup *cgrp) /* the root cgrp has rstat_cpu preallocated */ if (!cgrp->rstat_cpu) { - cgrp->rstat_cpu = alloc_percpu(struct cgroup_rstat_cpu); + cgrp->rstat_cpu = alloc_percpu_gfp(struct cgroup_rstat_cpu, + GFP_KERNEL_ACCOUNT); if (!cgrp->rstat_cpu) return -ENOMEM; } -- 2.36.1