From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr0-f199.google.com (mail-wr0-f199.google.com [209.85.128.199]) by kanga.kvack.org (Postfix) with ESMTP id AA89B6B0279 for ; Thu, 8 Jun 2017 07:07:05 -0400 (EDT) Received: by mail-wr0-f199.google.com with SMTP id v102so4539967wrc.8 for ; Thu, 08 Jun 2017 04:07:05 -0700 (PDT) Received: from mx1.suse.de (mx2.suse.de. [195.135.220.15]) by mx.google.com with ESMTPS id g10si5175799wmf.157.2017.06.08.04.07.04 for (version=TLS1 cipher=AES128-SHA bits=128/128); Thu, 08 Jun 2017 04:07:04 -0700 (PDT) Subject: Re: [PATCH 2/3] mm/page_ref: Ensure page_ref_unfreeze is ordered against prior accesses References: <1496771916-28203-1-git-send-email-will.deacon@arm.com> <1496771916-28203-3-git-send-email-will.deacon@arm.com> <20170608104056.ujuytybmwumuty64@black.fi.intel.com> From: Vlastimil Babka Message-ID: Date: Thu, 8 Jun 2017 13:07:02 +0200 MIME-Version: 1.0 In-Reply-To: <20170608104056.ujuytybmwumuty64@black.fi.intel.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: owner-linux-mm@kvack.org List-ID: To: "Kirill A. Shutemov" Cc: Will Deacon , linux-mm@kvack.org, linux-kernel@vger.kernel.org, mark.rutland@arm.com, akpm@linux-foundation.org, Punit.Agrawal@arm.com, mgorman@suse.de, steve.capper@arm.com On 06/08/2017 12:40 PM, Kirill A. Shutemov wrote: > On Thu, Jun 08, 2017 at 11:38:21AM +0200, Vlastimil Babka wrote: >> On 06/06/2017 07:58 PM, Will Deacon wrote: >>> page_ref_freeze and page_ref_unfreeze are designed to be used as a pair, >>> wrapping a critical section where struct pages can be modified without >>> having to worry about consistency for a concurrent fast-GUP. >>> >>> Whilst page_ref_freeze has full barrier semantics due to its use of >>> atomic_cmpxchg, page_ref_unfreeze is implemented using atomic_set, which >>> doesn't provide any barrier semantics and allows the operation to be >>> reordered with respect to page modifications in the critical section. >>> >>> This patch ensures that page_ref_unfreeze is ordered after any critical >>> section updates, by invoking smp_mb__before_atomic() prior to the >>> atomic_set. >>> >>> Cc: "Kirill A. Shutemov" >>> Acked-by: Steve Capper >>> Signed-off-by: Will Deacon >> >> Undecided if it's really needed. This is IMHO not the classical case >> from Documentation/core-api/atomic_ops.rst where we have to make >> modifications visible before we let others see them? Here the one who is >> freezing is doing it so others can't get their page pin and interfere >> with the freezer's work. > > Hm.. I'm not sure I'm getting what you are talking about. > > What would guarantee others to see changes to page before seeing page > unfreezed? My point was that we do the freezing for other reasons than to guarantee this, but it can be needed too. >>> include/linux/page_ref.h | 1 + >>> 1 file changed, 1 insertion(+) >>> >>> diff --git a/include/linux/page_ref.h b/include/linux/page_ref.h >>> index 610e13271918..74d32d7905cb 100644 >>> --- a/include/linux/page_ref.h >>> +++ b/include/linux/page_ref.h >>> @@ -174,6 +174,7 @@ static inline void page_ref_unfreeze(struct page *page, int count) >>> VM_BUG_ON_PAGE(page_count(page) != 0, page); >>> VM_BUG_ON(count == 0); >>> >>> + smp_mb__before_atomic(); >>> atomic_set(&page->_refcount, count); > > I *think* it should be smp_mb(), not __before_atomic(). atomic_set() is > not really atomic. For instance on x86 it's plain WRITE_ONCE() which CPU > would happily reorder. Yeah but there are compile barriers, and x86 is TSO, so that's enough? Also I found other instances by git grep (not a proof, though :) >>> if (page_ref_tracepoint_active(__tracepoint_page_ref_unfreeze)) >>> __page_ref_unfreeze(page, count); >>> >> > -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org