From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C7F8BC32771 for ; Thu, 9 Jan 2020 08:52:36 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 9728220678 for ; Thu, 9 Jan 2020 08:52:36 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9728220678 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 1F4B08E0005; Thu, 9 Jan 2020 03:52:36 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 1A5D38E0001; Thu, 9 Jan 2020 03:52:36 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 094FD8E0005; Thu, 9 Jan 2020 03:52:36 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0131.hostedemail.com [216.40.44.131]) by kanga.kvack.org (Postfix) with ESMTP id E852F8E0001 for ; Thu, 9 Jan 2020 03:52:35 -0500 (EST) Received: from smtpin06.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with SMTP id 8DD75181AEF00 for ; Thu, 9 Jan 2020 08:52:35 +0000 (UTC) X-FDA: 76357479870.06.snow19_8af4df2662244 X-HE-Tag: snow19_8af4df2662244 X-Filterd-Recvd-Size: 4710 Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by imf07.hostedemail.com (Postfix) with ESMTP for ; Thu, 9 Jan 2020 08:52:34 +0000 (UTC) X-Amp-Result: UNKNOWN X-Amp-Original-Verdict: FILE UNKNOWN X-Amp-File-Uploaded: False Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by orsmga102.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Jan 2020 00:52:33 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.69,413,1571727600"; d="scan'208";a="421716257" Received: from richard.sh.intel.com (HELO localhost) ([10.239.159.54]) by fmsmga005.fm.intel.com with ESMTP; 09 Jan 2020 00:52:31 -0800 Date: Thu, 9 Jan 2020 16:52:31 +0800 From: Wei Yang To: Michal Hocko Cc: Wei Yang , hannes@cmpxchg.org, vdavydov.dev@gmail.com, akpm@linux-foundation.org, kirill.shutemov@linux.intel.com, cgroups@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, yang.shi@linux.alibaba.com Subject: Re: [RFC PATCH] mm: thp: grab the lock before manipulation defer list Message-ID: <20200109085231.GA7305@richard> Reply-To: Wei Yang References: <20200103143407.1089-1-richardw.yang@linux.intel.com> <20200106102345.GE12699@dhcp22.suse.cz> <20200107012241.GA15341@richard> <20200107083808.GC32178@dhcp22.suse.cz> <20200108003543.GA13943@richard> <20200108094041.GQ32178@dhcp22.suse.cz> <20200109031821.GA5206@richard> <20200109083641.GH4951@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200109083641.GH4951@dhcp22.suse.cz> User-Agent: Mutt/1.9.4 (2018-02-28) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, Jan 09, 2020 at 09:36:41AM +0100, Michal Hocko wrote: >On Thu 09-01-20 11:18:21, Wei Yang wrote: >> On Wed, Jan 08, 2020 at 10:40:41AM +0100, Michal Hocko wrote: >> >On Wed 08-01-20 08:35:43, Wei Yang wrote: >> >> On Tue, Jan 07, 2020 at 09:38:08AM +0100, Michal Hocko wrote: >> >> >On Tue 07-01-20 09:22:41, Wei Yang wrote: >> >> >> On Mon, Jan 06, 2020 at 11:23:45AM +0100, Michal Hocko wrote: >> >> >> >On Fri 03-01-20 22:34:07, Wei Yang wrote: >> >> >> >> As all the other places, we grab the lock before manipulate the defer list. >> >> >> >> Current implementation may face a race condition. >> >> >> > >> >> >> >Please always make sure to describe the effect of the change. Why a racy >> >> >> >list_empty check matters? >> >> >> > >> >> >> >> >> >> Hmm... access the list without proper lock leads to many bad behaviors. >> >> > >> >> >My point is that the changelog should describe that bad behavior. >> >> > >> >> >> For example, if we grab the lock after checking list_empty, the page may >> >> >> already be removed from list in split_huge_page_list. And then list_del_init >> >> >> would trigger bug. >> >> > >> >> >And how does list_empty check under the lock guarantee that the page is >> >> >on the deferred list? >> >> >> >> Just one confusion, is this kind of description basic concept of concurrent >> >> programming? How detail level we need to describe the effect? >> > >> >When I write changelogs for patches like this I usually describe, what >> >is the potential race - e.g. >> > CPU1 CPU2 >> > path1 path2 >> > check lock >> > operation2 >> > unlock >> > lock >> > # check might not hold anymore >> > operation1 >> > unlock >> > >> >and what is the effect of the race - e.g. a crash, data corruption, >> >pointless attempt for operation1 which fails with user visible effect >> >etc. >> >> Hi, Michal, here is my attempt for an example. Hope this one looks good to >> you. >> >> >> For example, the potential race would be: >> >> CPU1 CPU2 >> mem_cgroup_move_account split_huge_page_to_list >> !list_empty >> lock >> !list_empty >> list_del >> unlock >> lock >> # !list_empty might not hold anymore >> list_del_init >> unlock >> >> When this sequence happens, the list_del_init() in >> mem_cgroup_move_account() would crash since the page is already been >> removed by list_del in split_huge_page_to_list(). > >Yes this looks much more informative. I would just add that this will >crash if CONFIG_DEBUG_LIST. > >Thanks! Glad you like it~ Will prepare v2 with your suggestion :-) >-- >Michal Hocko >SUSE Labs -- Wei Yang Help you, Help me