From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.6 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 87BA5C49361 for ; Thu, 17 Jun 2021 12:41:44 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 15FF3611CE for ; Thu, 17 Jun 2021 12:41:43 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 15FF3611CE Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=infradead.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 7864B6B0070; Thu, 17 Jun 2021 08:41:43 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 747736B0071; Thu, 17 Jun 2021 08:41:43 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5D5826B0072; Thu, 17 Jun 2021 08:41:43 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0172.hostedemail.com [216.40.44.172]) by kanga.kvack.org (Postfix) with ESMTP id 2778C6B0070 for ; Thu, 17 Jun 2021 08:41:43 -0400 (EDT) Received: from smtpin37.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id B59A610FD8 for ; Thu, 17 Jun 2021 12:41:42 +0000 (UTC) X-FDA: 78263177244.37.2627EBD Received: from casper.infradead.org (casper.infradead.org [90.155.50.34]) by imf21.hostedemail.com (Postfix) with ESMTP id 7E55FE000259 for ; Thu, 17 Jun 2021 12:41:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=6buJ1EzwuAkSghHPh7appt09mi8sVKMXWYQqJKpVxtQ=; b=TvkE86lgS/8sg7Iv/GbSjgmfR1 lCDZTb3RWjU40fLyNYsLCIZytLxziAsc/zUOz7FLogKU/wd7lQY0mF7p+dYw/NV97CjIrkYfngFMT vaqK0lTs8HpvSobY6SrHaIPfvIqDNTMaX80gG7C98v0rDQHCmS7CPymXcl8RdeVTVc5i5HiHwCrYE r6/F7HNUtyNEyA0vi3AUqy/Gp8BgLsVMPI3o2j8yntn4brsVPviYRWMXP1vZllPfWaGsabW7pHGP9 JYHNWaVuXqoYlrxqL9IQRLXgh8Nbi0LMtbeFLcu+f5Xi3+cgUu1pfDxUoM22g8DjG5lV6tvdB3+7N XpVNOEVg==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1ltrKG-00981p-37; Thu, 17 Jun 2021 12:40:55 +0000 Date: Thu, 17 Jun 2021 13:40:52 +0100 From: Matthew Wilcox To: Janghyuck Kim Cc: Catalin Marinas , Will Deacon , Andrew Morton , Palmer Dabbelt , Atish Patra , Gavin Shan , Zhengyuan Liu , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-mm@kvack.org Subject: Re: [PATCH 1/2] mm: support fastpath if NUMA is enabled with numa off Message-ID: References: <20210616083745.14288-1-janghyuck.kim@samsung.com> <20210617115544.GB183559@KEI> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210617115544.GB183559@KEI> Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=TvkE86lg; spf=none (imf21.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none X-Stat-Signature: agdt33xxfurjq71uzm61z4ukgqauk4qm X-Rspamd-Queue-Id: 7E55FE000259 X-Rspamd-Server: rspam06 X-HE-Tag: 1623933687-210225 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, Jun 17, 2021 at 08:55:44PM +0900, Janghyuck Kim wrote: > On Wed, Jun 16, 2021 at 06:32:50PM +0100, Matthew Wilcox wrote: > > On Wed, Jun 16, 2021 at 05:37:41PM +0900, Janghyuck Kim wrote: > > > Architecture might support fake node when CONFIG_NUMA is enabled but any > > > node settings were supported by ACPI or device tree. In this case, > > > getting memory policy during memory allocation path is meaningless. > > > > > > Moreover, performance degradation was observed in the minor page fault > > > test, which is provided by (https://protect2.fireeye.com/v1/url?k=c81407ae-978f3ea4-c8158ce1-0cc47a31384a-10187d5ead74c318&q=1&e=cbc91c9b-80e1-4ca0-b51a-9f79fad5b0c1&u=https%3A%2F%2Flkml.org%2Flkml%2F2006%2F8%2F29%2F294). > > > Average faults/sec of enabling NUMA with fake node was 5~6 % worse than > > > disabling NUMA. To reduce this performance regression, fastpath is > > > introduced. fastpath can skip the memory policy checking if NUMA is > > > enabled but it uses fake node. If architecture doesn't support fake > > > node, fastpath affects nothing for memory allocation path. > > > > This patch doesn't even apply to the current kernel, but putting that > > aside, what's the expensive part of the current code? That is, > > comparing performance stats between this numa_off enabled and numa_off > > disabled, where do you see taking a lot of time? > > > > mempolicy related code that I skipped by this patch took a short time, > taking only a few tens of nanoseconds that difficult to measure by > sched_clock's degree of precision. But it can be affect the minor page > fault test with large buffer size, because one page fault handling takes > several ms. As I replied in previous mail, performance regression has > been reduced from 5~6% to 2~3%. I'm not proposing you use sched_clock. Try perf.