From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6C16EC54FB3 for ; Thu, 29 May 2025 08:57:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id DF8FF6B0123; Thu, 29 May 2025 04:57:05 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DA84A6B0124; Thu, 29 May 2025 04:57:05 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C97E96B0125; Thu, 29 May 2025 04:57:05 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id A66F96B0123 for ; Thu, 29 May 2025 04:57:05 -0400 (EDT) Received: from smtpin21.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 3D9AF80CE7 for ; Thu, 29 May 2025 08:57:05 +0000 (UTC) X-FDA: 83495340810.21.964DC15 Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) by imf01.hostedemail.com (Postfix) with ESMTP id E38A94000A for ; Thu, 29 May 2025 08:57:02 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=xLHEUufK; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b="qAxP/Tgb"; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=xLHEUufK; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b="qAxP/Tgb"; dmarc=none; spf=pass (imf01.hostedemail.com: domain of vbabka@suse.cz designates 195.135.223.131 as permitted sender) smtp.mailfrom=vbabka@suse.cz ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1748509023; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=6Vnold/atbSNdl8iC6MpcIMnsul0rxS/gPOmT+RYJUM=; b=L6Wr9byOuAh090puDJZqAaMbGw9gCkFol/T9JK3FDvzYkz5dKSdr0qdksYKwyxMOuI8YHX 6ABZLtqBC+Ibg4/dVSBNqGkma1TNgJfTQKzqSPLXCPfQ9BkvZcrCLmTlolSF6f+oK67lmT Dvt3fZ6sd0V4IFjHe8z5JoP83/UUlY0= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1748509023; a=rsa-sha256; cv=none; b=NHr/35BlPyfL9XZPKaGWIZGnOMq7ywBZV2i+4t2VIjDvYdINYeJQItOpoEOous4RIFTt+l 4Q8S4ite7zbODexBfJdyDn/5Y6P4P9RDI/77YkjbMPcCXsFV7QTlLv7JXX+QszyWcCDUPT gL30Qf8AaMreyY3KkvTq2Kfg16AZrIo= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=xLHEUufK; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b="qAxP/Tgb"; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=xLHEUufK; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b="qAxP/Tgb"; dmarc=none; spf=pass (imf01.hostedemail.com: domain of vbabka@suse.cz designates 195.135.223.131 as permitted sender) smtp.mailfrom=vbabka@suse.cz Received: from imap1.dmz-prg2.suse.org (unknown [10.150.64.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id 250961F82A; Thu, 29 May 2025 08:56:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1748509009; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6Vnold/atbSNdl8iC6MpcIMnsul0rxS/gPOmT+RYJUM=; b=xLHEUufKJ5SPoEvJdoI0gBDDR1OP/9By1MiuoyHEhHCDgLNYKeypJ3qKnlzy19kBYeW/0x kSrj/CDvUC1Ns+Fw6m9aYPZfreyoGB4ef/F6DOhDyEWP1PmokQ6eHT5eJnU5K4FdQkS28F wupmrawpT1AABCXvHzBPj+igJVAdc84= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1748509009; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6Vnold/atbSNdl8iC6MpcIMnsul0rxS/gPOmT+RYJUM=; b=qAxP/Tgbfds6XOsSTt7HTn/FOoGdnbocHsuJYIXfRoOc+NADNZFXsoJbDbMJBWUt0L5vT5 UccQ0/gtb5Zd8bAA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1748509009; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6Vnold/atbSNdl8iC6MpcIMnsul0rxS/gPOmT+RYJUM=; b=xLHEUufKJ5SPoEvJdoI0gBDDR1OP/9By1MiuoyHEhHCDgLNYKeypJ3qKnlzy19kBYeW/0x kSrj/CDvUC1Ns+Fw6m9aYPZfreyoGB4ef/F6DOhDyEWP1PmokQ6eHT5eJnU5K4FdQkS28F wupmrawpT1AABCXvHzBPj+igJVAdc84= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1748509009; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6Vnold/atbSNdl8iC6MpcIMnsul0rxS/gPOmT+RYJUM=; b=qAxP/Tgbfds6XOsSTt7HTn/FOoGdnbocHsuJYIXfRoOc+NADNZFXsoJbDbMJBWUt0L5vT5 UccQ0/gtb5Zd8bAA== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id 1303913AC0; Thu, 29 May 2025 08:56:49 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id aE5jBFEhOGj5aQAAD6G6ig (envelope-from ); Thu, 29 May 2025 08:56:49 +0000 From: Vlastimil Babka Date: Thu, 29 May 2025 10:56:27 +0200 Subject: [PATCH 2/2] mm, slab: support NUMA policy for large kmalloc MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <20250529-frozen-pages-for-large-kmalloc-v1-2-b3aa52a8fa17@suse.cz> References: <20250529-frozen-pages-for-large-kmalloc-v1-0-b3aa52a8fa17@suse.cz> In-Reply-To: <20250529-frozen-pages-for-large-kmalloc-v1-0-b3aa52a8fa17@suse.cz> To: Christoph Lameter , David Rientjes Cc: Andrew Morton , Roman Gushchin , Harry Yoo , Matthew Wilcox , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Vlastimil Babka X-Mailer: b4 0.14.2 X-Developer-Signature: v=1; a=openpgp-sha256; l=1248; i=vbabka@suse.cz; h=from:subject:message-id; bh=a98gp0kg1iMA/bz6QdciDajVGzzk/CUNrQZOQuQ1K5I=; b=owEBbQGS/pANAwAIAbvgsHXSRYiaAcsmYgBoOCFOYsFS9i8S6vYyCP7KE3yRti79xDhUn8WSI cWCkwSOxRaJATMEAAEIAB0WIQR7u8hBFZkjSJZITfG74LB10kWImgUCaDghTgAKCRC74LB10kWI mgVvCACcMqqZ0kPKUICmReWJRDoVwdSaXsgFLTJPBqH0MqpFiQSN+oZcpzqhQOKsxlhonxc472X vc3QOFbSingeJsF4gaYJx/Pr/4491B+ruhFVTvJMqnqRFKzeh8oYTDGy1OAZlsMAqsfN7zFahlj ruLPGdlnD0ID2bTo391i6SYySaUpXJNKiWhrAX8sZdSLeR7GzBA94sCFuRCEJv8tlcdijGu2DLS r/ZEz/oYE9GJ6OFaSV44dqkbRne8oIxU2kwBBTkflfPH788LbDkFf4PCaL8UkIdRS3a0NMYXOOO EpNbPX5dXBQo+GfR6CxDIoRvBhsl4Po/MbunH/bvhP+mZMvg X-Developer-Key: i=vbabka@suse.cz; a=openpgp; fpr=A940D434992C2E8E99103D50224FA7E7CC82A664 X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: E38A94000A X-Stat-Signature: 5q8u3q1mq8touzm6z4i4ok5rfajamxc1 X-Rspam-User: X-HE-Tag: 1748509022-884319 X-HE-Meta: U2FsdGVkX1+x5U1L1F/Tr/xLvPxzZ3evZBpAdK51fMSDr2OyFXjlVUEOhD/zBRkooWEIAW4FEqikQRnjZ4yddBEHNssDGXyFAJ1DDRZkVqW01Ki7a2T8LDZ6bgF98+bl0kcGfuXBo0K2EdPGBnMp8rQSZyclGHWAjlCNKEqZeTMk4aVxZzj/FCUj5T03VguUzHlR1KjyXTgvdUfWxoYtIYbYzipertIr2lVO0hnfKe864gvEWLPKWbqfhZbhwMQ/jyoFvVHJoZyRx+5GkxofxKBDBFxoRejl66TDNqLhrMeUeDdzgSamoEevJJQ90GatYVPRmFOlTDwer0YQj8gC97VBsgzQ1O7iyH/ItOQd1Bd8mOau/TbH5q9nVqCigTCY7oq7rncuvN0G57sDpgbqSJ8mradlCzyO+C+UIVAR+VRzOVNQqFnWlnE6G7eBVT4oeP2zyvXduKpFizexI0oAubeYJ9gRlkV6W/L+yw59bvynJOn1b46t91Q65/dLt4nBL5T9Bby+DPSIexIr5bP/P5X6EukduCGXpSpNWXzyjSS5QdRPzGUaS4y/ihddussrXMnND19vD3YDMiKV8cXXxWVNYmJB2nUpEQpHt4ThhHkbXu8Li+P6/si68KkjutocrvQ+KFpWdwPtZ0XahtpHUDchs891dXOXO8Pf2TE9ZXhI08IzOftpa8rs/ps8DOKLavouenNlJhjBcoBErfRKXnULI4oNCn+pmbDPTeTJSBprcNfKPd5Gbq+u3IXfbdTMNtLgVj3sx6zBGAAlgRAayzJ7tocUUOtwaUCEImHmRZN4CZVzGFYU5VPkZ7eKt0B4YaYRUSb492McA0/jvZ79iNHASQI2R7+fYAfeZ7vLB4+IDE2vNU7lWryNTGkCOwg9WdtKl8on7ZwQ4VTSxEuKqdknQ3+0FWdnZLI5FwbS6d/+8vpmzEWixWLywIajAfI1EEL/64wW80Sxcte2h5M 4iElU3s5 OcaW7ysDWRlKUDJLWw6tIov32HtPCljDEnwbJp5SkshuIt8ErIEzfClQPkGzVLjwdsquH4cVKIxW/FQZfS/mWfK99axm4g4kGFHHmXJcOFEpt0PZTrWfp0LnzAURFStff76xuHNEP6VqMcwRRb7Uc+HmFWDDOLTPKcBIWK/wZXeGzMOWvjvPITBRoaFW9bnXoCnXlQnnkwQibiPp2I4Tc/jz4UcUbCLjLbSkwV9pkGWiXYZ+1ZUSc1kfzzg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The slab allocator observes the task's numa policy in various places such as allocating slab pages. Large kmalloc allocations currently do not, which seems to be an unintended omission. It is simple to correct that, so make ___kmalloc_large_node() behave the same way as alloc_slab_page(). Signed-off-by: Vlastimil Babka --- mm/slub.c | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/mm/slub.c b/mm/slub.c index d7a62063a1676a327e13536bf724f0160f1fc8dc..d87015fad2df65629050d9bcd224facd3d2f4033 100644 --- a/mm/slub.c +++ b/mm/slub.c @@ -4281,11 +4281,13 @@ static void *___kmalloc_large_node(size_t size, gfp_t flags, int node) if (unlikely(flags & GFP_SLAB_BUG_MASK)) flags = kmalloc_fix_flags(flags); + flags |= __GFP_COMP; + if (node == NUMA_NO_NODE) - node = numa_mem_id(); + folio = (struct folio *)alloc_frozen_pages_noprof(flags, order); + else + folio = (struct folio *)__alloc_frozen_pages_noprof(flags, order, node, NULL); - flags |= __GFP_COMP; - folio = (struct folio *)__alloc_frozen_pages_noprof(flags, order, node, NULL); if (folio) { ptr = folio_address(folio); lruvec_stat_mod_folio(folio, NR_SLAB_UNRECLAIMABLE_B, -- 2.49.0