From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D4960C0219B for ; Mon, 10 Feb 2025 16:06:35 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 77BD16B0089; Mon, 10 Feb 2025 11:06:35 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 72CBD6B008A; Mon, 10 Feb 2025 11:06:35 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5CCD1280001; Mon, 10 Feb 2025 11:06:35 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 3D8AB6B0089 for ; Mon, 10 Feb 2025 11:06:35 -0500 (EST) Received: from smtpin21.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id E82CC1A01BA for ; Mon, 10 Feb 2025 16:06:34 +0000 (UTC) X-FDA: 83104512708.21.0B2936A Received: from mail-qv1-f41.google.com (mail-qv1-f41.google.com [209.85.219.41]) by imf13.hostedemail.com (Postfix) with ESMTP id 9B36520018 for ; Mon, 10 Feb 2025 16:06:32 +0000 (UTC) Authentication-Results: imf13.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b="o2fa9eP/"; spf=pass (imf13.hostedemail.com: domain of gourry@gourry.net designates 209.85.219.41 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1739203592; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=tke47kbpnFrWp9UrJwZsklKqJ06afMwqKKSvzF3lCiQ=; b=z+3VT1GgJg0veej0hasKbqIqbht9PQOLTKrtFk0uARULE7FB9aP5DqwYBIuWK2Dc1/5m9D 4tANbcpN+fiDjhwDx9ee69/cy/PN9RZLCEuAdbhMPkiykV9hWJihmchGFkbj1DC2H1C9wA l7tAk0u4Oqj9h++TdI1aSI0jnlPZvis= ARC-Authentication-Results: i=1; imf13.hostedemail.com; dkim=pass header.d=gourry.net header.s=google header.b="o2fa9eP/"; spf=pass (imf13.hostedemail.com: domain of gourry@gourry.net designates 209.85.219.41 as permitted sender) smtp.mailfrom=gourry@gourry.net; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1739203592; a=rsa-sha256; cv=none; b=7INFv/5U4SHA3pMhefLG14Es0V2p8UeGUJP1eiK8MAGZkGRFn+QheG5nbtHY6X/QlO+tdF MwbEXh/ZDfEkphP9QppgE3L/cZIdqsUUdohlyTIeROY5sbN+JP5d2tuQgW6m40skFYRI9H q59dVYgBXfQdlRycg9qi1O5BCYPODCA= Received: by mail-qv1-f41.google.com with SMTP id 6a1803df08f44-6d8e8445219so36511846d6.0 for ; Mon, 10 Feb 2025 08:06:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gourry.net; s=google; t=1739203591; x=1739808391; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=tke47kbpnFrWp9UrJwZsklKqJ06afMwqKKSvzF3lCiQ=; b=o2fa9eP/fNyCoOL9TEhWpwMmwpQJN3ZwtzUOCJpLcW91LW84E+Nqg/fAwFGWyzGDzk E7U3gQqwpArTuf6JdikadTH/RcspMG2nvp8E+CfqX/UHaXITaIS9rWorjpejT/umcuwL nyktfpEPpq5ms8roPR5IYS8jb4Cknm186Eq/lKbAnVqRXUbh+qkhQasLQQ9uPy1MOYIE Hl+XBWB6Swk8O5l6kvkxrCtc7uzQ2/jTgoMOT0MNoZtpGD40jszhYMlWwt+hffNpO569 t95xbAVNSYcayZuZZYiR0OrOuEI5Qwk5XcS+j3WXK7qQ22LIY2fWvIePnggrubiS2/Ig jtzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1739203591; x=1739808391; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=tke47kbpnFrWp9UrJwZsklKqJ06afMwqKKSvzF3lCiQ=; b=qxogAp2lAhD22QspZRojJaA3Z8eICqVL6lDIN4qenQqg7id4Tah1USsu91f4mij0Ro qqGBgvWoEcu8BzIggileJZwbeM52N2axGCVqOLXimQvisXhBZPV6fgcd10t0BchgkjSY dRNM84NE+duOkw8DjE+wAp1z+LUrQEqiMdyFJVy2ICkZrYZbCFk+X3F0NVV+kQhwpNm6 KGjCAo6dCTCH4skxRyOnNMyjOIJzi2z/+tfjIPkk2sxZSAiJ6w8Q8vDt+KvmglYTAGXX plXuitYFyWpHRGOJ7vIkA25HzgSMOnhO/ZosQ8CUh7sSwvuJJK8CWmEoQtzW19zmslo9 R2Ow== X-Forwarded-Encrypted: i=1; AJvYcCWrydyjw2IQk6EndyYKZVkBxv3teirdi6O4xXxQj+GVJiFhugWQMImyHeGWhNzyA0PAfWOluILruw==@kvack.org X-Gm-Message-State: AOJu0YxC9OjeXDIdgjx6+WxLtai7NwbKlwW7XOnGq5e+ELVmRlUArgGD ppkopa9vRwHPJsOLunZrdR9a5mr3bD5rV4zM4Lhp0hzEiRM7E0Z/ox+Qwe/Lz0A= X-Gm-Gg: ASbGnct9D4wPUzZgIRXWJlm/N/VW8wNn0zgsxFjLAQzrTjEWdhUpMoegGDqB5DIh0XG GpfzxL+zmUApiDiHtg58mFuRoS+KQO1MUjexX7FVA8uRDNX2MmsptAWn8LTNMDm33SRl8HFHYsk chfBIAvPBv49umu3/OTEiYbO65uEkv2u9p+ZBHzHZyTCd+8mgy2YqiJPgWMApohHw9zAI7q1q0o ZfwUV4KDkfTzBRu4Q5JPOWnCX+iJzi2VX3Rw8PQFk467UqFfa7hyAIUsfT2EyDruc9+0bLTlPFf Au7igPZ2AU/PkTiV0GmRSf/DWbrAQeje7gq4H3L7tgyw8ucV6cS3Bg88rwvKPuv9gYKaKgGjzw= = X-Google-Smtp-Source: AGHT+IHyY64XYBQP0i1c6Qh0JHQpZ6nK53wQfuc9tLq7d03x5CkTUoa8aqdVuHXijLL2T+ZMD90Vww== X-Received: by 2002:a05:6214:76f:b0:6e2:2dd7:1404 with SMTP id 6a1803df08f44-6e4455bafc7mr200422336d6.3.1739203590049; Mon, 10 Feb 2025 08:06:30 -0800 (PST) Received: from gourry-fedora-PF4VCD3F (pool-173-79-56-208.washdc.fios.verizon.net. [173.79.56.208]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6e4556d150csm24531036d6.54.2025.02.10.08.06.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 10 Feb 2025 08:06:29 -0800 (PST) Date: Mon, 10 Feb 2025 11:06:28 -0500 From: Gregory Price To: Matthew Wilcox Cc: Byungchul Park , "Harry (Hyeonggon) Yoo" <42.hyeyoo@gmail.com>, Honggyu Kim , kernel_team@skhynix.com, lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, linux-cxl@vger.kernel.org Subject: Re: [LSF/MM/BPF TOPIC] Restricting or migrating unmovable kernel allocations from slow tier Message-ID: References: <20250207072024.GA48419@system.software.com> <20250210071741.GB39454@system.software.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Rspamd-Server: rspam11 X-Rspamd-Queue-Id: 9B36520018 X-Stat-Signature: fbuq1937gj1ajdke7z6q1515osmnj9fs X-HE-Tag: 1739203592-649935 X-HE-Meta: U2FsdGVkX1/Ac7wh6870+osGcSQjGeCQPagEgeBhbEQX0XdEoQe2DKAdVHav/Q4xl5XVy7sD21h2/URjBOV5j187sqW2ncrsxwWI1idPnRB6ie+z8H1eAeTr/4wy16K2dtUFVVjkeiUZiMDSWFG1FyorS+dv4w1iUSwl9Lf6RiTiJxB6tkCs5yzfefIiel9M0DIunEvejIA/AlbiH4bgndwFXdbCD9OGGZ+XZfSfRYJkk6XacyFbqS/lGNHw8AbMP88AQWUwf2Fjzpe/yl4xh49QbKd0IVFnzAiIe2QerZmaT5A0wwo0zC6YnWDo9H7kT2wDx5hXtYdNF/j/6wv4xM+GlwqIQBKp2USmp4mF2dSvUk7cWRve6onL7IkP4z8JS5+tcF5wyf6h9Ff40Kqz6pr8TKm/5KLDnxSXMCp4xKfsIIYXTB7kMEQo0+KFFnwT0HQ7IjW0uswwC3io5JyjAhJ7GnM490n1FBX8vGYV35rpNt/CC/p4DxgBKeQQUnNDw7Z5GkhBNYpBOzStQ5wDfCdzeqE2TuUzA27Ei3ePMzT/F2OV+i/Bj+bmxyZljZ7Frg9nNXnUZK3XcK3zYLjorF6eWUr2W4QxuKaW0AsBS5eqOOyhu4ZYhMa7ZUndJ+CJY3pQ+11nCNU+URu24tPPaPNzXodotRMHu3MGEeefs/Zobpgmj3WvJ2ewE9t+ihTwCl8bgCT5WARhvGvw/Oh4qSExXcCGgVN5zp/x0nRK0NBpmsFpylydiCz3/4cdrrD+mjwfeR+f5X+nDbzlG2/gjDhy38ZkAWO8p/+ODsPpGGr54JmGX7dJvwpEvJQqB5q+aAJPFSHgXHqesGbJEg/UuQQspbuHFLU4kh3NZedWmET/CILp6mZdmhFSSeQtosxnyEc7RxY4cTHiGE1Z1PLAm3GdTzieTCykmm+vmwGFbKxgKcZsDIxsQQ0eDoBhFZSWu+uYX/qzOU3kNTJnrno 0T1nRKHO HDPSqEO8JxCIeAL3rhB+pzPnFjHUeQjwEgov/krR3zJFWGNXfOdBg6zG++UOyA9ikLTg73Ing2uu5CSl3fncb18uIxOVH1OHQvyfd+rvL07vJS8lFlOAaQwfudtRkcOOIKDFMJi/xhJ3E74cxwT1Up2wjHn2c60rdG7m2US+7eCY0mX5q1jGqeHZA0fnGeVP6tdLWQHK28TY+66A/gKmHShoqp1GhmrkDJoRdVaSDTufoFXxV0zrC17FFrsezy0GOApxwWQJz9fYJfmIYh6D05JHpXNOqGd3NKmsmcjMQmtHrEA3S6UUOXt3Lit4xZM5Dwh8kxbfGajTmgC6SbPjZZsTiS0X0XxahyAH3p34/3y9cZrUNk8GtHpzYcQHovtW1bAdSj5ZUiSq5uASLzj7vaIvbcw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.002607, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Mon, Feb 10, 2025 at 03:55:47PM +0000, Matthew Wilcox wrote: > On Mon, Feb 10, 2025 at 10:47:58AM -0500, Gregory Price wrote: > > I also think someone should actively ask whether `struct page` can be > > hosted on remote memory without performance loss. I may look into this. > > Given that it contains a refcount and various flags, some of which > are quite hot, I would expect performance to suffer. It also suffers > contention between different CPUs, so depending on your cache protocol > (can it do cache-to-cche transfers or does it have to be written back > to memory first?) it may perform quite poorly. But this is something > that can be measured. > > Of course, the question must be asked whetheer we care. Certainly Intel's > Apache Pass and similar Optane RAM products put the memmap on the 3DXP > because there wasn't enough DRAM to put it there. So the pages are > slower, but they were slower anyway! > Well, *if* said memory is intended to host cold(er) data, then we may find the structures to describe those pages aren't particularly hot or contended. This is my suspicion - and I'd rather limit kernel resource allocation on remote memory than try to move kernel resources around. Plus this would still enables hot-unplug. Once all the zone movable regions are clicked off, the page-desc regions are unused... probably. Would just be nice to have some concrete data on when greater zone movable capacity becomes a net-negative. We're making the assumption this this occurs fairly early. ~Gregory