From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 415AEE732D8 for ; Thu, 28 Sep 2023 13:41:04 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C00538D00A0; Thu, 28 Sep 2023 09:41:03 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id BB01F8D0038; Thu, 28 Sep 2023 09:41:03 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id A9F3F8D00A0; Thu, 28 Sep 2023 09:41:03 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 9BA498D0038 for ; Thu, 28 Sep 2023 09:41:03 -0400 (EDT) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 6F72C12010C for ; Thu, 28 Sep 2023 13:41:03 +0000 (UTC) X-FDA: 81286117206.12.0DB25DA Received: from olivedrab.birch.relay.mailchannels.net (olivedrab.birch.relay.mailchannels.net [23.83.209.135]) by imf25.hostedemail.com (Postfix) with ESMTP id A7FCCA0026 for ; Thu, 28 Sep 2023 13:41:00 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=stgolabs.net header.s=dreamhost header.b=YX3pGd+s; spf=pass (imf25.hostedemail.com: domain of dave@stgolabs.net designates 23.83.209.135 as permitted sender) smtp.mailfrom=dave@stgolabs.net; dmarc=none; arc=pass ("mailchannels.net:s=arc-2022:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1695908461; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fV4Zxk0FhT7C3XEli4MGvFTPX5hp1XlfXjZMP4aD39E=; b=xT2nv1T+pURvwGc3vYmxfamvSQwZno+qjnpbTRCwyzLRgCqaFSE0AtNdCTp8Leak9wEml9 0unTkFEyTa2v94GP8aQnLIFfqMINSHj7CwvM20YfRKlmv+YCbMid2k/lqNLncqeKd7MJuI KwadVNf1thsD16x4U4tV+RkYwqT1/UM= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1695908461; a=rsa-sha256; cv=pass; b=HYIHpn9iu/Fcs9Im9iW3iH6p6+fKypGbbNs7u8KJ15MUSwcd51xT5O+bP1MOmJ9Gajs16r PvlCKHK/gaTVOPRmqkKFBEdcxBN/4KmZn+SG/bErLUSa0duhQ4Hx/+petFjIUrQQxMiYv0 aiZnrjNVtWW+xnN7w9R+qY16p53SZzs= ARC-Authentication-Results: i=2; imf25.hostedemail.com; dkim=pass header.d=stgolabs.net header.s=dreamhost header.b=YX3pGd+s; spf=pass (imf25.hostedemail.com: domain of dave@stgolabs.net designates 23.83.209.135 as permitted sender) smtp.mailfrom=dave@stgolabs.net; dmarc=none; arc=pass ("mailchannels.net:s=arc-2022:i=1") X-Sender-Id: dreamhost|x-authsender|dave@stgolabs.net Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id E2EA16C13E9; Thu, 28 Sep 2023 13:40:57 +0000 (UTC) Received: from pdx1-sub0-mail-a312.dreamhost.com (unknown [127.0.0.6]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id 4657C6C10E9; Thu, 28 Sep 2023 13:40:57 +0000 (UTC) ARC-Seal: i=1; s=arc-2022; d=mailchannels.net; t=1695908457; a=rsa-sha256; cv=none; b=g9ApNVDpXUw8NbiVPB91whx+A98KefOUdvwQ3MYgplXW6DoYam+sUPQAu91KxM6lXmAxXG 4+lVY54zLzyyeGEiSaAH0MBOT3EuV9QBCa0z35Pjcv+ka5OdYgrOTPawDQ8X/6Hog0PECj +VCYPSQUjhUvfaQFeKTuTziLY1PYZ7zN0W2keRSHnvhhkZRSqGTT7nDSy/vr6QmB7kG2zE aKNFEeYHzAdw4/CP9pzCP/D5KIHZM+kN6o0Doinn8IGGWCCyXnD4WUM7GoCEAEmTdubvyH YNCN9PZ81xsNuE4W7RAYFXtAiT4RMIC4CXIiuJJCIv6I1MUs9hAY1OAbljCfwg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchannels.net; s=arc-2022; t=1695908457; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:dkim-signature; bh=fV4Zxk0FhT7C3XEli4MGvFTPX5hp1XlfXjZMP4aD39E=; b=HoJv0cmylHUZA6FoIjPfBtY0ro3gzvVAMtGpG62BbF4JZKhTFuAeXbbMMWrMRmmHLMWbC1 Su1yYVFJnEg6+imcOYpfqRFBMKak44KKYR7GGJC1Y23rdaeyTn8Z1YRVOvAY8jdOJGmth6 ki1bCHAvCi1kba0drAKEAC254cmoOeUVO95JQzn7aFe1bnyaEsN4EX9DQLOFMWoci1n9Fq KgwUoMt97N7Npdr93dzqm0EXiacL/gvbC8ECImymDcwm4f2YFI3iSlGTyH5WvxP5xNjV4m qBqAkSJSA/OCTfaTx6sj6Uvr+90EujW3AM732SSUMEeK1om25hJK4lnP9RI4jA== ARC-Authentication-Results: i=1; rspamd-7d5dc8fd68-ftkct; auth=pass smtp.auth=dreamhost smtp.mailfrom=dave@stgolabs.net X-Sender-Id: dreamhost|x-authsender|dave@stgolabs.net X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|dave@stgolabs.net X-MailChannels-Auth-Id: dreamhost X-Plucky-Illegal: 128ccf8d5bc7bb01_1695908457686_874718514 X-MC-Loop-Signature: 1695908457686:2815361285 X-MC-Ingress-Time: 1695908457686 Received: from pdx1-sub0-mail-a312.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384) by 100.109.140.241 (trex/6.9.1); Thu, 28 Sep 2023 13:40:57 +0000 Received: from offworld (ip72-199-50-187.sd.sd.cox.net [72.199.50.187]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: dave@stgolabs.net) by pdx1-sub0-mail-a312.dreamhost.com (Postfix) with ESMTPSA id 4RxF481GpZzLJ; Thu, 28 Sep 2023 06:40:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=stgolabs.net; s=dreamhost; t=1695908457; bh=fV4Zxk0FhT7C3XEli4MGvFTPX5hp1XlfXjZMP4aD39E=; h=Date:From:To:Cc:Subject:Content-Type; b=YX3pGd+sUWu1zeeF2pqWBMRrJZeNQkOmmn70Mqq6Iw782HyjKK/rQbp90x0CM28MQ ORUsj1thJvkFcftFmXRFJgwcTgcZAUIZnM8TWQkBbOnsfu3mrIjHTt1mt7DmYtaeo+ YA/JI9YuN/kkMCRAeJLVbjheB8a558IPuxjyzgYK1d4QDcG4sNAI3j9bKO3NwAPGWw xjMHvl+rpIZEnI4KMbpxd8720EKSNF/OzV/vX425Rpme0SB+CUYaGU/7bSv2i+dXCK 9ho7aXqOGPZPB7rqpNc5GGz+/Yg4v0H+teJQiEal+h5fLIp3hcmE3uZhGbuxwl2OWx hgJkWw+wEHVfg== Date: Thu, 28 Sep 2023 06:40:53 -0700 From: Davidlohr Bueso To: Peter Zijlstra Cc: tglx@linutronix.de, axboe@kernel.dk, linux-kernel@vger.kernel.org, mingo@redhat.com, dvhart@infradead.org, andrealmeid@igalia.com, Andrew Morton , urezki@gmail.com, hch@infradead.org, lstoakes@gmail.com, Arnd Bergmann , linux-api@vger.kernel.org, linux-mm@kvack.org, linux-arch@vger.kernel.org, malteskarupke@web.de, steve.shaw@intel.com, marko.makela@mariadb.com, andrei.artemev@intel.com Subject: Re: futex2 numa stuff Message-ID: Mail-Followup-To: Peter Zijlstra , tglx@linutronix.de, axboe@kernel.dk, linux-kernel@vger.kernel.org, mingo@redhat.com, dvhart@infradead.org, andrealmeid@igalia.com, Andrew Morton , urezki@gmail.com, hch@infradead.org, lstoakes@gmail.com, Arnd Bergmann , linux-api@vger.kernel.org, linux-mm@kvack.org, linux-arch@vger.kernel.org, malteskarupke@web.de, steve.shaw@intel.com, marko.makela@mariadb.com, andrei.artemev@intel.com References: <20230921104505.717750284@noisy.programming.kicks-ass.net> <20230921104505.717750284@noisy.programming.kicks-ass.net> <20230922200120.011184118@infradead.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <20230922200120.011184118@infradead.org> User-Agent: NeoMutt/20230517 X-Rspamd-Queue-Id: A7FCCA0026 X-Rspam-User: X-Rspamd-Server: rspam11 X-Stat-Signature: tpxkn91unry1q8jpojqbqztfriphpgn6 X-HE-Tag: 1695908460-336073 X-HE-Meta: U2FsdGVkX1/bHpMZp9UWTHKyYQQqpWLW6A/zkczC3zbvCXrf/upctI0D5VSGpzuVQwemqk+EQlM5Y2kX6TWjr47esvbeiPA7RSOHqx91ayPohgZpHWn8TneE8G3khwY9clqZJWJDgz5k11UPKMn0o6QQXoopbcQF6vGhONkgRtJocAa47viq7lFYoSfc8MKJsyNnFRp0sEy92CU7c86ISjnGsoPiqTMuWVBqCtxreQyIZy/xsvtvKYhfVb+chVIq0RsIn4XDww5tANyHrFg40BZOOeHnQpu6vt/RmD2fG8bSeRbMQrdf56EiZueRfkKijAouLzZtRWMCt0cU7A5W2Ruf6q1FaEHgcRQojPZ18KGDOyicF+JgcUbObqyclZjlbWZ4671li+AYMt2HFaC/MHeSAVj+veZb92rBCG47AaFp+hNBWD/pFQ5ErxglQGejx10+HVVuh36lN3L4F5kaUt5waP1LRe1deWa8KWzfpi+eX3oK+uZIOI19noS01VVEnNyoz8RjTGG4fuw8RYJIK7haIP/1sFNa7ryd11wR7W2ZbIeiyz6RWoj4J12NTEdXAzE6C1ZehsSGWjIsrc3Xe53gc27HxGl7BYLYuhTL+k/z+4WQeRXyTzSQwG5/wdLVN4mifBP932CVpvPsM5d89Xndb2sXD//F4rHT4/4mUVtdHceVfACnqeyzFXEsHUfj37LhX2PBSCHLWVJALIs227U4ebeiuX3pAvkO27+AAHATyQ9dCfeedks8tvyuakxnWz+51MHsmFkneFrPRBfzmSHZTju0APJXvi+dv0pPaBRVtbhVOrpdHGGqFEJ+4QxzAkNS+DQsAuGjRqHqjccu8P1qbDXdVXxCcZj17DasSzajFQPVD2X5cKI3kvvOFa/+BEiehpcrUReqcOf6T5tt0KAyI7NekUG55K+J2wYcSMmKIAWtkZcSEYWmncMfyjEterrqiTcqwtJNrCTQQkj GYjI0S+A D9Kp4PjesspKOt6pdDvPPbuHkdpzT80UM1eldl34qmK/0LCtPvC6qTQAKZF+bQNcDwuT3DIgbmtJtX+i3oKVoad+2gZ5p0Jwptie0xsIiD5uqwEoz4BCRgNQBhhXCPNqIdnYr8Izha+LGickTjWhrzTsuD8CK2LrXVTlNLfAvM1pfckK8DA3CqJHrMlqCsMKljmMJLwSMvP2XNqWcubPrKS954wDk4hfIj2iOeWavgD2Q4ejkwXvyXmzsZuHbnqTsoRtswwNITsduCYQL5Y0GB0Kd0QF0Ml3FzOxdFBYKeuIXMnz38dBhs9bfZK7MH2Fo0c/x5lAXh46Eakb0Qs50G291tTDbzhN7854VhPrjQydUO07RBO6il3ZvNnCyIVzNnd9J X-Bogosity: Ham, tests=bogofilter, spamicity=0.000007, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, 22 Sep 2023, Peter Zijlstra wrote: >Hi! > >Updated version of patch 15/15 and a few extra patches for testing the >FUTEX2_NUMA bits. The last patch (17/15) should never be applied for anything >you care about and exists purely because I'm too lazy to generate actual >hash-bucket contention. > >On my 2 node IVB-EP: > > $ echo FUTEX_SQUASH > /debug/sched/features > >Effectively reducing each node to 1 bucket. > > $ numactl -m0 -N0 ./futex_numa -c10 -t2 -n0 -N0 & > numactl -m1 -N1 ./futex_numa -c10 -t2 -n0 -N0 > > ... > contenders: 16154935 > contenders: 16202472 > > $ numactl -m0 -N0 ./futex_numa -c10 -t2 -n0 -N0 & > numactl -m1 -N1 ./futex_numa -c10 -t2 -n0 -N1 > > contenders: 48584991 > contenders: 48680560 > >(loop counts, higher is better) > >Clearly showing how separating the hashes works. > >The first one runs 10 contenders on each node but forces the (numa) futex to >hash to node 0 for both. This ensures all 20 contenders hash to the same >bucket and *ouch*. > >The second one does the same, except now fully separates the nodes. Performance >is much improved. > >Proving the per-node hashing actually works as advertised. Very nice.