From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.8 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2C81EC433DB for ; Thu, 24 Dec 2020 07:11:50 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 86F8E227BF for ; Thu, 24 Dec 2020 07:11:49 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 86F8E227BF Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=amazon.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 9EE5A8D0073; Thu, 24 Dec 2020 02:11:48 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 99EB08D0063; Thu, 24 Dec 2020 02:11:48 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 8B4188D0073; Thu, 24 Dec 2020 02:11:48 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0086.hostedemail.com [216.40.44.86]) by kanga.kvack.org (Postfix) with ESMTP id 763718D0063 for ; Thu, 24 Dec 2020 02:11:48 -0500 (EST) Received: from smtpin16.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 476291EF3 for ; Thu, 24 Dec 2020 07:11:48 +0000 (UTC) X-FDA: 77627305896.16.cake32_6005c942746f Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin16.hostedemail.com (Postfix) with ESMTP id 271D1100E690B for ; Thu, 24 Dec 2020 07:11:48 +0000 (UTC) X-HE-Tag: cake32_6005c942746f X-Filterd-Recvd-Size: 6180 Received: from smtp-fw-9101.amazon.com (smtp-fw-9101.amazon.com [207.171.184.25]) by imf10.hostedemail.com (Postfix) with ESMTP for ; Thu, 24 Dec 2020 07:11:46 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1608793907; x=1640329907; h=from:to:cc:subject:date:message-id:in-reply-to: mime-version; bh=qB1g1eHuyQvggi8B8SoTOL62S33u6oe9Xwh0/sUKi0U=; b=nkhw0qB8Ie7Bb1N3n46I/c2amgjAavOAp84UE9g9BszGnTgTwK0qWGMX rzsEffwabHX6TMDM+Fw1SDnVXxxvlRwWGxc0TTPeCulIRdM11VK4lDfkH fdglwEQsYNeP3eojspmVukV8ZmKSDhrkkmnSZLP731reCcoDgAxw6zQgR U=; X-IronPort-AV: E=Sophos;i="5.78,444,1599523200"; d="scan'208";a="98777246" Received: from sea32-co-svc-lb4-vlan3.sea.corp.amazon.com (HELO email-inbound-relay-2c-76e0922c.us-west-2.amazon.com) ([10.47.23.38]) by smtp-border-fw-out-9101.sea19.amazon.com with ESMTP; 24 Dec 2020 07:11:46 +0000 Received: from EX13D31EUA001.ant.amazon.com (pdx1-ws-svc-p6-lb9-vlan2.pdx.amazon.com [10.236.137.194]) by email-inbound-relay-2c-76e0922c.us-west-2.amazon.com (Postfix) with ESMTPS id E8608A831F; Thu, 24 Dec 2020 07:11:42 +0000 (UTC) Received: from u3f2cd687b01c55.ant.amazon.com (10.43.162.252) by EX13D31EUA001.ant.amazon.com (10.43.165.15) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 24 Dec 2020 07:11:25 +0000 From: SeongJae Park To: Shakeel Butt CC: SeongJae Park , , "Andrea Arcangeli" , , , , , , Brendan Higgins , Qian Cai , Colin Ian King , Jonathan Corbet , "David Hildenbrand" , , Marco Elver , "Du, Fan" , , "Greg Thelen" , Ian Rogers , , "Kirill A. Shutemov" , Mark Rutland , Mel Gorman , Minchan Kim , Ingo Molnar , , "Peter Zijlstra (Intel)" , Randy Dunlap , Rik van Riel , David Rientjes , Steven Rostedt , Mike Rapoport , , Shuah Khan , , , Vlastimil Babka , Vladimir Davydov , Yang Shi , Huang Ying , , , Linux MM , , LKML Subject: Re: [PATCH v23 05/15] mm/damon: Implement primitives for the virtual memory address spaces Date: Thu, 24 Dec 2020 08:11:11 +0100 Message-ID: <20201224071111.11551-1-sjpark@amazon.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [10.43.162.252] X-ClientProxiedBy: EX13D22UWB002.ant.amazon.com (10.43.161.28) To EX13D31EUA001.ant.amazon.com (10.43.165.15) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed, 23 Dec 2020 14:54:02 -0800 Shakeel Butt wrote: > On Wed, Dec 23, 2020 at 8:47 AM SeongJae Park wrote: > > > [snip] > > > [snip] > > > > + > > > > +static bool damon_va_young(struct mm_struct *mm, unsigned long addr, > > > > + unsigned long *page_sz) > > > > +{ > > > > + pte_t *pte = NULL; > > > > + pmd_t *pmd = NULL; > > > > + spinlock_t *ptl; > > > > + bool young = false; > > > > + > > > > + if (follow_pte_pmd(mm, addr, NULL, &pte, &pmd, &ptl)) > > > > + return false; > > > > + > > > > + *page_sz = PAGE_SIZE; > > > > + if (pte) { > > > > + young = pte_young(*pte); > > > > + if (!young) > > > > + young = !page_is_idle(pte_page(*pte)); > > > > + pte_unmap_unlock(pte, ptl); > > > > + return young; > > > > + } > > > > + > > > > +#ifdef CONFIG_TRANSPARENT_HUGEPAGE > > > > + young = pmd_young(*pmd); > > > > + if (!young) > > > > + young = !page_is_idle(pmd_page(*pmd)); > > > > + spin_unlock(ptl); > > > > + *page_sz = ((1UL) << HPAGE_PMD_SHIFT); > > > > +#endif /* CONFIG_TRANSPARENT_HUGEPAGE */ > > > > + > > > > + return young; > > > > > > You need mmu_notifier_test_young() here. Hmm I remember mentioning > > > this in some previous version as well. > > > > Your question and my answer was as below: > > > > > Don't you need mmu_notifier_clear_young() here? > > > > I think we don't need it here because we only read the Accessed bit and PG_Idle > > if Accessed bit was not set. > > > > I should notice that you mean 'test_young()' but didn't, sorry. I will add it > > in the next version. > > > > I should have said mmu_notifier_test_young() instead of > mmu_notifier_clear_young(). > > > > > > > BTW have you tested this on a VM? > > > > Yes. Indeed, I'm testing this on a QEMU/KVM environment. You can get more > > detail at: https://damonitor.github.io/doc/html/latest/vm/damon/eval.html#setup > > > > Hmm without mmu_notifier_test_young() you should be missing the kvm > mmu access updates. Can you please recheck if your eval is correctly > seeing the memory accesses from the VM? Seems I didn't clearly answered, sorry. My test setup installs the DAMON-enabled kernel in a guest VM and run it for workloads in the guest, rather than running DAMON in host to monitor accesses of VMs. The MMU notifier is for latter case, AFAIU, so my test setup didn't see the problem. If I'm missing something, please let me know. Thanks, SeongJae Park