From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-16.5 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A932EC433ED for ; Fri, 16 Apr 2021 05:16:11 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 4B99C610FC for ; Fri, 16 Apr 2021 05:16:11 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 4B99C610FC Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=bytedance.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id DE0F56B007E; Fri, 16 Apr 2021 01:16:10 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DB8176B0080; Fri, 16 Apr 2021 01:16:10 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C593C6B0081; Fri, 16 Apr 2021 01:16:10 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0231.hostedemail.com [216.40.44.231]) by kanga.kvack.org (Postfix) with ESMTP id A1F906B007E for ; Fri, 16 Apr 2021 01:16:10 -0400 (EDT) Received: from smtpin17.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 650E08248D52 for ; Fri, 16 Apr 2021 05:16:10 +0000 (UTC) X-FDA: 78037068900.17.036E5D9 Received: from mail-pl1-f182.google.com (mail-pl1-f182.google.com [209.85.214.182]) by imf17.hostedemail.com (Postfix) with ESMTP id AB1FD40002CF for ; Fri, 16 Apr 2021 05:16:07 +0000 (UTC) Received: by mail-pl1-f182.google.com with SMTP id p16so9387498plf.12 for ; Thu, 15 Apr 2021 22:16:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bytedance-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=j8wWJIpwyMTu3hxIlWXzmIud8VzdA+zaDtz12NM5n5U=; b=iHBp4oj9JUNupFLCeYguBqBHnt/v6XaFLarmLsBE+1tkt3jxMhzFrhBvE5l8AN997Q yoR3q08gqyt+Sx6AKbEcIzEhpyu0SaMeCtIyPXxDWEBmmc8d+jxn8sPUbnCHWffKbanT /c72tbHOahxBwRDDNhxZTRoZr/HSGYnPyiKa2252M9kQLGncdK4AWFI9Nb42osoA7MsV oawzC8OlTQdgpjx5CaRugEGbD6uaUGlx8fjNkGmJ3d4OSCeLlIlDlN5cLhA0Qh/tb5Ok AfnV+x3DYN9fEgAcJbV0sXzSIl8BcX4pCPs/6UlWSYZkFna0+lK1qCsK8xEfiDTxpAG3 TjLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=j8wWJIpwyMTu3hxIlWXzmIud8VzdA+zaDtz12NM5n5U=; b=jbiGjsJfswr3E74btBwyLx7miH1rc0nZf9YMuQZw4XtsWVNWJxScZzOSmfPI6c1lNM WBPqJM2cEntxFwTfagGgwknRHwNcB8TnRV5hjMq7N4NzcyDdECNwUL91wDOb1uAr6U1O AXZzzEXh9FnGYVp/WsnKDxGmoqapPyqDa/fMUSigOuHm9EkdUY3YUyxgw02A42eZHy0+ 0Y/qE+gSreqICoQJLlBHMEAB4G1Vu1TfUdreoV2KzkfvWv1Do5o/sRjiBsHFL+J9PdJq knDMwONxEVsG5+/fs3b6rrkcrc5QKhttQuIZJxXIeLSlj1E7bR0o5TXeSVN9DIebGDHB DTlA== X-Gm-Message-State: AOAM533wvxhs/6xHrlPpmQFs/oTWbRONlIwyZPOQ6ntBgT8Nk4MFp/Xo Np4TXplgCj6i00MS4Gh6PPh3tQ== X-Google-Smtp-Source: ABdhPJxiIy16z6+pQ2PwCIV5UB57x16+veoagt6ZKlXWDE19ptYCd7nfBf8ivXxvb72aa+VHvmL9bw== X-Received: by 2002:a17:90a:7893:: with SMTP id x19mr7908730pjk.3.1618550169181; Thu, 15 Apr 2021 22:16:09 -0700 (PDT) Received: from localhost.localdomain ([139.177.225.235]) by smtp.gmail.com with ESMTPSA id j7sm3518540pfd.129.2021.04.15.22.16.04 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 15 Apr 2021 22:16:08 -0700 (PDT) From: Muchun Song To: guro@fb.com, hannes@cmpxchg.org, mhocko@kernel.org, akpm@linux-foundation.org, shakeelb@google.com, vdavydov.dev@gmail.com Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org, duanxiongchun@bytedance.com, Muchun Song Subject: [PATCH v2 6/8] mm: memcontrol: simplify the logic of objcg pinning memcg Date: Fri, 16 Apr 2021 13:14:05 +0800 Message-Id: <20210416051407.54878-7-songmuchun@bytedance.com> X-Mailer: git-send-email 2.21.0 (Apple Git-122) In-Reply-To: <20210416051407.54878-1-songmuchun@bytedance.com> References: <20210416051407.54878-1-songmuchun@bytedance.com> MIME-Version: 1.0 X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: AB1FD40002CF X-Stat-Signature: 118t4gu3kpr31t1zbtnzg6ecyfor8c9n Received-SPF: none (bytedance.com>: No applicable sender policy available) receiver=imf17; identity=mailfrom; envelope-from=""; helo=mail-pl1-f182.google.com; client-ip=209.85.214.182 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1618550167-368575 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: The obj_cgroup_release() and memcg_reparent_objcgs() are serialized by the css_set_lock. We do not need to care about objcg->memcg being released in the process of obj_cgroup_release(). So there is no need to pin memcg before releasing objcg. Remove those pinning logic to simplfy the code. There are only two places that modifies the objcg->memcg. One is the initialization to objcg->memcg in the memcg_online_kmem(), another is objcgs reparenting in the memcg_reparent_objcgs(). It is also impossible for the two to run in parallel. So xchg() is unnecessary and it is enough to use WRITE_ONCE(). Signed-off-by: Muchun Song Acked-by: Johannes Weiner Reviewed-by: Shakeel Butt Acked-by: Roman Gushchin --- mm/memcontrol.c | 20 ++++++-------------- 1 file changed, 6 insertions(+), 14 deletions(-) diff --git a/mm/memcontrol.c b/mm/memcontrol.c index caf193088beb..c4eebe2a2914 100644 --- a/mm/memcontrol.c +++ b/mm/memcontrol.c @@ -261,7 +261,6 @@ static void obj_cgroup_uncharge_pages(struct obj_cgro= up *objcg, static void obj_cgroup_release(struct percpu_ref *ref) { struct obj_cgroup *objcg =3D container_of(ref, struct obj_cgroup, refcn= t); - struct mem_cgroup *memcg; unsigned int nr_bytes; unsigned int nr_pages; unsigned long flags; @@ -291,11 +290,9 @@ static void obj_cgroup_release(struct percpu_ref *re= f) nr_pages =3D nr_bytes >> PAGE_SHIFT; =20 spin_lock_irqsave(&css_set_lock, flags); - memcg =3D obj_cgroup_memcg(objcg); if (nr_pages) obj_cgroup_uncharge_pages(objcg, nr_pages); list_del(&objcg->list); - mem_cgroup_put(memcg); spin_unlock_irqrestore(&css_set_lock, flags); =20 percpu_ref_exit(ref); @@ -330,17 +327,12 @@ static void memcg_reparent_objcgs(struct mem_cgroup= *memcg, =20 spin_lock_irq(&css_set_lock); =20 - /* Move active objcg to the parent's list */ - xchg(&objcg->memcg, parent); - css_get(&parent->css); - list_add(&objcg->list, &parent->objcg_list); - - /* Move already reparented objcgs to the parent's list */ - list_for_each_entry(iter, &memcg->objcg_list, list) { - css_get(&parent->css); - xchg(&iter->memcg, parent); - css_put(&memcg->css); - } + /* 1) Ready to reparent active objcg. */ + list_add(&objcg->list, &memcg->objcg_list); + /* 2) Reparent active objcg and already reparented objcgs to parent. */ + list_for_each_entry(iter, &memcg->objcg_list, list) + WRITE_ONCE(iter->memcg, parent); + /* 3) Move already reparented objcgs to the parent's list */ list_splice(&memcg->objcg_list, &parent->objcg_list); =20 spin_unlock_irq(&css_set_lock); --=20 2.11.0