From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-10.2 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D51F9C433E0 for ; Mon, 22 Mar 2021 16:45:01 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id DE26A61931 for ; Mon, 22 Mar 2021 16:45:00 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DE26A61931 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=techsingularity.net Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id CF99D6B00B8; Mon, 22 Mar 2021 12:44:59 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id CD0F86B00BB; Mon, 22 Mar 2021 12:44:59 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BE7316B00BF; Mon, 22 Mar 2021 12:44:59 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0243.hostedemail.com [216.40.44.243]) by kanga.kvack.org (Postfix) with ESMTP id A32D56B00B8 for ; Mon, 22 Mar 2021 12:44:59 -0400 (EDT) Received: from smtpin10.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 65B4A8249980 for ; Mon, 22 Mar 2021 16:44:59 +0000 (UTC) X-FDA: 77948084676.10.94A26FF Received: from outbound-smtp10.blacknight.com (outbound-smtp10.blacknight.com [46.22.139.15]) by imf05.hostedemail.com (Postfix) with ESMTP id 10111E0011FE for ; Mon, 22 Mar 2021 16:44:56 +0000 (UTC) Received: from mail.blacknight.com (pemlinmail04.blacknight.ie [81.17.254.17]) by outbound-smtp10.blacknight.com (Postfix) with ESMTPS id 40D291C4F47 for ; Mon, 22 Mar 2021 16:44:55 +0000 (GMT) Received: (qmail 4119 invoked from network); 22 Mar 2021 16:44:55 -0000 Received: from unknown (HELO techsingularity.net) (mgorman@techsingularity.net@[84.203.22.4]) by 81.17.254.9 with ESMTPSA (AES256-SHA encrypted, authenticated); 22 Mar 2021 16:44:55 -0000 Date: Mon, 22 Mar 2021 16:44:53 +0000 From: Mel Gorman To: Jesper Dangaard Brouer Cc: Andrew Morton , Vlastimil Babka , Chuck Lever , Christoph Hellwig , Alexander Duyck , Matthew Wilcox , LKML , Linux-Net , Linux-MM , Linux-NFS Subject: Re: [PATCH 0/3 v5] Introduce a bulk order-0 page allocator Message-ID: <20210322164453.GH3697@techsingularity.net> References: <20210322091845.16437-1-mgorman@techsingularity.net> <20210322130446.0a505db0@carbon> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline In-Reply-To: <20210322130446.0a505db0@carbon> User-Agent: Mutt/1.10.1 (2018-07-13) X-Stat-Signature: o8j3pne4fsig5czykwgh1eiffzfzrk8k X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 10111E0011FE Received-SPF: none (techsingularity.net>: No applicable sender policy available) receiver=imf05; identity=mailfrom; envelope-from=""; helo=outbound-smtp10.blacknight.com; client-ip=46.22.139.15 X-HE-DKIM-Result: none/none X-HE-Tag: 1616431496-997074 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Mar 22, 2021 at 01:04:46PM +0100, Jesper Dangaard Brouer wrote: > On Mon, 22 Mar 2021 09:18:42 +0000 > Mel Gorman wrote: > > > This series is based on top of Matthew Wilcox's series "Rationalise > > __alloc_pages wrapper" and does not apply to 5.12-rc2. If you want to > > test and are not using Andrew's tree as a baseline, I suggest using the > > following git tree > > > > git://git.kernel.org/pub/scm/linux/kernel/git/mel/linux.git mm-bulk-rebase-v5r9 > > page_bench04_bulk[1] micro-benchmark on branch: mm-bulk-rebase-v5r9 > [1] https://github.com/netoptimizer/prototype-kernel/blob/master/kernel/mm/bench/page_bench04_bulk.c > > BASELINE > single_page alloc+put: Per elem: 199 cycles(tsc) 55.472 ns > > LIST variant: time_bulk_page_alloc_free_list: step=bulk size > > Per elem: 206 cycles(tsc) 57.478 ns (step:1) > Per elem: 154 cycles(tsc) 42.861 ns (step:2) > Per elem: 145 cycles(tsc) 40.536 ns (step:3) > Per elem: 142 cycles(tsc) 39.477 ns (step:4) > Per elem: 142 cycles(tsc) 39.610 ns (step:8) > Per elem: 137 cycles(tsc) 38.155 ns (step:16) > Per elem: 135 cycles(tsc) 37.739 ns (step:32) > Per elem: 134 cycles(tsc) 37.282 ns (step:64) > Per elem: 133 cycles(tsc) 36.993 ns (step:128) > > ARRAY variant: time_bulk_page_alloc_free_array: step=bulk size > > Per elem: 202 cycles(tsc) 56.383 ns (step:1) > Per elem: 144 cycles(tsc) 40.047 ns (step:2) > Per elem: 134 cycles(tsc) 37.339 ns (step:3) > Per elem: 128 cycles(tsc) 35.578 ns (step:4) > Per elem: 120 cycles(tsc) 33.592 ns (step:8) > Per elem: 116 cycles(tsc) 32.362 ns (step:16) > Per elem: 113 cycles(tsc) 31.476 ns (step:32) > Per elem: 110 cycles(tsc) 30.633 ns (step:64) > Per elem: 110 cycles(tsc) 30.596 ns (step:128) > > Compared to the previous results (see below) list-variant got faster, > but array-variant is still faster. The array variant lost a little > performance. I think this can be related to the stats counters got > added/moved inside the loop, in this patchset. > If you are feeling particularly brave, take a look at git://git.kernel.org/pub/scm/linux/kernel/git/mel/linux.git mm-percpu-local_lock-v1r10 It's a prototype series rebased on top of the bulk allocator and this version has not even been boot tested. While it'll get rough treatment during review, it should reduce the cost of the stat updates in the bulk allocator as a side-effect. -- Mel Gorman SUSE Labs