From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 2753FE77188 for ; Tue, 24 Dec 2024 23:48:48 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 5D1436B0082; Tue, 24 Dec 2024 18:48:47 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 580A66B0083; Tue, 24 Dec 2024 18:48:47 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 46F766B0085; Tue, 24 Dec 2024 18:48:47 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 2A7BA6B0082 for ; Tue, 24 Dec 2024 18:48:47 -0500 (EST) Received: from smtpin20.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id B9252140272 for ; Tue, 24 Dec 2024 23:48:46 +0000 (UTC) X-FDA: 82931492238.20.1702D5B Received: from out30-131.freemail.mail.aliyun.com (out30-131.freemail.mail.aliyun.com [115.124.30.131]) by imf10.hostedemail.com (Postfix) with ESMTP id 5968FC0010 for ; Tue, 24 Dec 2024 23:48:25 +0000 (UTC) Authentication-Results: imf10.hostedemail.com; dkim=pass header.d=linux.alibaba.com header.s=default header.b="e/qjZZvI"; dmarc=pass (policy=none) header.from=linux.alibaba.com; spf=pass (imf10.hostedemail.com: domain of ying.huang@linux.alibaba.com designates 115.124.30.131 as permitted sender) smtp.mailfrom=ying.huang@linux.alibaba.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1735084106; a=rsa-sha256; cv=none; b=MtMJ7+Ys+ReFrD9yBLEybWJSOl9SF/tlvaQUckAxhYVLYUfoVD7Loj8CFHapfJ0ZUjNcqC lYuPISgvMEg7nJGozpiuBZqdTivWBERm51+tVyYIqL9SyazYyjy3adhuItriQ6mY/rhOhT NPhasjRYs2oYLUTZytQl+pzoQLGlyqg= ARC-Authentication-Results: i=1; imf10.hostedemail.com; dkim=pass header.d=linux.alibaba.com header.s=default header.b="e/qjZZvI"; dmarc=pass (policy=none) header.from=linux.alibaba.com; spf=pass (imf10.hostedemail.com: domain of ying.huang@linux.alibaba.com designates 115.124.30.131 as permitted sender) smtp.mailfrom=ying.huang@linux.alibaba.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1735084106; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=IWOt90lynNL0xLBlX/5fzb0ZLmhgA/zMlV5D1Uv2jLM=; b=1GCTFcDosf9Mlrz0fFvZIaJgO6aIwr7lqqns5QOH0uzS3YxZM+19sFfKuo/dSZgB6ldXgS nx4KZeUeODkXKbkz0+Z6ILIVogXsxjYIiO9dlehzh+h9pfpKsYmhzaQPehiEPP2zK1zUQ0 snIbGTeGZfA2XFWi7OUPzglYlC9yLsc= DKIM-Signature:v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.alibaba.com; s=default; t=1735084120; h=From:To:Subject:Date:Message-ID:MIME-Version:Content-Type; bh=IWOt90lynNL0xLBlX/5fzb0ZLmhgA/zMlV5D1Uv2jLM=; b=e/qjZZvIswuGE4wtdh0D93X6hWPY9ltPvHhJS9Ecg4Ue7oyfcfkQLj0w4RohmUqInf1eLZBV98RVY4RqOXq8bSa2vJoVXIbllYU6qqdm9xVVNEXpBpNy2nPv2kLx07Po7nPqCskSckk2Jeg7gCs7LMkKgyA/1k06NdARCHx7OKA= Received: from DESKTOP-5N7EMDA(mailfrom:ying.huang@linux.alibaba.com fp:SMTPD_---0WMD4lv7_1735084117 cluster:ay36) by smtp.aliyun-inc.com; Wed, 25 Dec 2024 07:48:38 +0800 From: "Huang, Ying" To: Gregory Price Cc: Hyeonggon Yoo , Joshua Hahn , kernel_team@skhynix.com, 42.hyeyoo@gmail.com, "rafael@kernel.org" , "lenb@kernel.org" , "gregkh@linuxfoundation.org" , "akpm@linux-foundation.org" , Honggyu Kim , Rakie Kim , "dan.j.williams@intel.com" , "Jonathan.Cameron@huawei.com" , "dave.jiang@intel.com" , "horen.chuang@linux.dev" , "hannes@cmpxchg.org" , "linux-mm@kvack.org" , "linux-kernel@vger.kernel.org" , "linux-acpi@vger.kernel.org" , "kernel-team@meta.com" Subject: Re: [External Mail] [RFC PATCH v2] Weighted interleave auto-tuning In-Reply-To: (Gregory Price's message of "Sun, 22 Dec 2024 12:03:22 -0500") References: <20241219191845.3506370-1-joshua.hahnjy@gmail.com> <3682b9cf-213c-497d-ab81-f70e1a785716@sk.com> <87r060i3nn.fsf@DESKTOP-5N7EMDA> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Wed, 25 Dec 2024 07:48:36 +0800 Message-ID: <87ikr8abhn.fsf@DESKTOP-5N7EMDA> MIME-Version: 1.0 Content-Type: text/plain; charset=ascii X-Rspam-User: X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 5968FC0010 X-Stat-Signature: 6153my7pemx7at57t7i4nhn1ijps7fjr X-HE-Tag: 1735084105-408231 X-HE-Meta: U2FsdGVkX18Gbudzrul+bSG4xnxnmgT9Qgr+xilMnli40V2P4jCNi/G20ZUwY2icjScOJ7+UMOMd9ve4gRpcw5Y42C5BQ6+tQm6dzgWACR0Pc1l8ffwReKaLgv4wJ/ChI8qTCOXs02RGPTi7TIKwBIFVUCIa67IHSjdwNart8eun+84EwUDj6L7XZlFbxUTotKOYISKjKeQexdW7kw+u2DPpmC5IwhJM15641r8cCpOWzQE8RalZeptJbHs+BcN4ipkt+wivt8XIiHE/hNmhzMeBbViFK7P0I0kAFayriXnLivLotv8vhzWHZH3cWtfHFgvKW/joIt89YfpzvHUH11R1QXnE3/Izlgc+yjYmkLGqZ6wrEixyTlWn2A4nZaqNyXrb5smfVlzSqQbfds5ifZxB6ypGmQ9JY6GiK6/kjbuPb5oIAWhqRVNQHhyVwSA/e1/d5BpaCpmMBoBMaeyoKt1mqXthH/9GsmwDi7tP0pHe/t8Y+9EZ7FDweHvIikzfezYTxKxQk9EVcaneUF2WE5GEc1EZ4ShK49nfetSmlRkTWxFvwC9VLJpHwyLtulru0DBWjcFNY7h5T0NiayRZEeIigxriqJqMY97NkVfysVwChia+EQQEN6MYAguyVHRCfl9Q/75glCBZtsoBbNnjgs4NeAUFVZqrjU3VaCZUd6w69qN0Coal4xSbHEFER6s2QHM8QYOXRBpFDqez+7Vf4m85cTQ++Bybg8rGtKi2SjrIZ95QNzZMMPoF0n0jdcUpDPm5DQOIatNtcK8l7aPi6FD+tSZLYzNEvC+vrfSSV5HACaq2CJsIzT6oRW8A+FSWqNwxBMf7VgFkNfeuUk5eXLYAEiN/VcOcxP9wK8JdDqzglCrytsOFjMmAG5pFbnGG1Q1jFWEy4fkB8YvTcFZxS8Kd+iBLuRqrWxxVjlBswjgulmtJgnGcO3J/VzVHgGdYQKH90+PxXLQH8DvBJjW G9EtkkcK Hrtg62lsHw7JbWTL0HanEu2Ot1u/0mjlwdDHzpGIF2mvMmfwU4CZTzh9FJ2Wi2oKkyitTrjNBjZBPHlkjHqa9kXhFkexFmq8jAIrGRjxfW23Ae2Vq90/AKk4qtLVJiHipAG8ltnFmnqeKvibFooWpjR3LpnAm8QtvanMGpzfyOLI4U807uGQSkhoxPE3LFqF5/3sRj0PrZm3h5PDKr1ET2SUQs4eE48XFW1oC3kyOZoaYKEDjcu9dseXhA+O6i6W8uPgXilgniwHLa5YMk5lpGPo/Jcrga/QjpUEFdctmCrUEE7qePNTJrVzCHhuxU9WViQHjdm7uREZtsC+pGbQplHAldkaYmcweWpi9f5yU9QNG8sel5x0+Ark6yK5M/QvROdwBWjsctI2IAet1a3R88LHulW+WYdlj/dcVPWuKnG05BZDYgA0SCJzzsLbMlSpPZo+aHzfHPFxHTax1B6auUQvLO1FJ5jGpX2LpiT7r0ljZPJN7S6Nok2x/ZF8qhiJivxLF7xmaqFg40Jo= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Gregory Price writes: > On Sun, Dec 22, 2024 at 03:21:32PM +0800, Huang, Ying wrote: >> Hyeonggon Yoo writes: >> >> > On this server, ideally weighted interleaving should be configured >> > within a socket (e.g. local NUMA node + local CXL node) because >> > weighted interleaving does not consider the bandwidth when accessed >> > from a remote socket. >> >> If multiple sockets are considered, what is the best behavior? >> >> The process may be cross-socket too. So, we will need to use >> set_mempolicy() to bind tasks to sockets firstly. Then, it may be >> better to use per-task weights. >> > > If we want to revisit this, we might be able to make task-local weights > work without a new syscall, but the use case was not clear enough which > is why it was soft-nak'd originally. Yes. That is doable. However, the challenge is lacking use cases. I guess that we can wait for more use cases? > vma-local weights are arguably more usable, but require the task to be > numa-aware and probably require a new mempolicy syscall because mbind > has no remaining arguments. > > recall my original testing results from stream: > https://lore.kernel.org/linux-mm/20240202170238.90004-1-gregory.price@memverge.com/ > > Stream Benchmark (vs DRAM, 1 Socket + 1 CXL Device) > Default interleave : -78% (slower than DRAM) > Global weighting : -6% to +4% (workload dependant) > Targeted weights : +2.5% to +4% (consistently better than DRAM) --- Best Regards, Huang, Ying