From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 361BFC3DA6E for ; Fri, 5 Jan 2024 09:36:15 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id ABA748D001A; Fri, 5 Jan 2024 04:36:14 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id A6AD08D0018; Fri, 5 Jan 2024 04:36:14 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 932F88D001A; Fri, 5 Jan 2024 04:36:14 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 7E6258D0018 for ; Fri, 5 Jan 2024 04:36:14 -0500 (EST) Received: from smtpin08.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 4B1398025B for ; Fri, 5 Jan 2024 09:36:14 +0000 (UTC) X-FDA: 81644751468.08.3481904 Received: from smtp-out2.suse.de (smtp-out2.suse.de [195.135.223.131]) by imf29.hostedemail.com (Postfix) with ESMTP id DF4A112000E for ; Fri, 5 Jan 2024 09:36:10 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b="ngtAf/wt"; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b=YYKzRJFW; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=1hG31dr7; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b=H3X8mKtD; dmarc=none; spf=pass (imf29.hostedemail.com: domain of vbabka@suse.cz designates 195.135.223.131 as permitted sender) smtp.mailfrom=vbabka@suse.cz ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1704447371; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=B7oLL4S0CY29vzW6K3/CLzt37el9f7mj55GXjEITUVs=; b=SjHCqFKA3YpCQ6h36aaBj4h7tA99jwMmTwxQ4LouNlshUSIj/UdriWrlhu9Lj8k0KSpz+t FrUroSCnf60PNsESVGphYgy2jiT+LXA/GaozwNh9+KUV9ho3/gSc06pCOsZla+WJOTGVly 7jECNFLSyeshAjDrD6bpryIfxLLGvYk= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b="ngtAf/wt"; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b=YYKzRJFW; dkim=pass header.d=suse.cz header.s=susede2_rsa header.b=1hG31dr7; dkim=pass header.d=suse.cz header.s=susede2_ed25519 header.b=H3X8mKtD; dmarc=none; spf=pass (imf29.hostedemail.com: domain of vbabka@suse.cz designates 195.135.223.131 as permitted sender) smtp.mailfrom=vbabka@suse.cz ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1704447371; a=rsa-sha256; cv=none; b=yAFc9iQKvDRJfzfk5k9+SIb458PLwer0y9pmzvoMhlmDIp7sQQyV6SEKdbfmULI3fQPnL1 OY0hruPQqTpzxKT0PE58850Nlbe6r5Rsj/jueI/qZyl+HE25OrcxA0FDx1q5/UdOUTwyeJ ULZTH1IjHrYO2bfi7hIcV+tOYDD1EKY= Received: from imap1.dmz-prg2.suse.org (imap1.dmz-prg2.suse.org [IPv6:2a07:de40:b281:104:10:150:64:97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by smtp-out2.suse.de (Postfix) with ESMTPS id C83861F851; Fri, 5 Jan 2024 09:36:08 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1704447369; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=B7oLL4S0CY29vzW6K3/CLzt37el9f7mj55GXjEITUVs=; b=ngtAf/wtvnioC/gcCb7q5GrR2iA6FexmjgVsprefWQaIBWsmUKWQcLyGArOowmGVneIFVR HbYgBNk9uA301rSPPGUNGQGr7BGF4MoAcEpQWp1CsIYqtszdcfwkUQqlSTnKqRgKUhEL9R u4ckwwig5woM/ky9EFsVMJgxuRHS5WE= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1704447369; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=B7oLL4S0CY29vzW6K3/CLzt37el9f7mj55GXjEITUVs=; b=YYKzRJFWC20Gzb/IF8BKP+FuAiWpuNufLdqbdzsmjz62q5eQbf+QPnaZirfpouK0IqbxTK +RPOaffGSaSEp8AQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_rsa; t=1704447368; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=B7oLL4S0CY29vzW6K3/CLzt37el9f7mj55GXjEITUVs=; b=1hG31dr7EKUK87fE/57JoINGflxoZAvEvX50cmKUEiRF+cIto/BHoFZyk9AwSRarBy39rC Uv890iRWLwG2uelmzZATbtkr0sSE1GTcdfn7nEG81A+aQjIsINPsI37Nlt5ABpL3o2LSdO 7DLsvE/UgjkaeZGKQiufW01wEqibqIA= DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/relaxed; d=suse.cz; s=susede2_ed25519; t=1704447368; h=from:from:reply-to:date:date:message-id:message-id:to:to:cc:cc: mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=B7oLL4S0CY29vzW6K3/CLzt37el9f7mj55GXjEITUVs=; b=H3X8mKtDZXCHcsE0gV1cgYqWXvXXjhDh/daPsKtiVDSSLk2bNNJEzWVUwBZ3gDdV8mzHyN 3cFSYgwiacc6amAA== Received: from imap1.dmz-prg2.suse.org (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by imap1.dmz-prg2.suse.org (Postfix) with ESMTPS id A009E13C99; Fri, 5 Jan 2024 09:36:08 +0000 (UTC) Received: from dovecot-director2.suse.de ([2a07:de40:b281:106:10:150:64:167]) by imap1.dmz-prg2.suse.org with ESMTPSA id c2qbJojNl2UkUAAAD6G6ig (envelope-from ); Fri, 05 Jan 2024 09:36:08 +0000 Message-ID: Date: Fri, 5 Jan 2024 10:36:08 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird From: Vlastimil Babka Subject: [GIT PULL] slab updates for 6.8 To: Linus Torvalds Cc: David Rientjes , Joonsoo Kim , Christoph Lameter , Pekka Enberg , Andrew Morton , "linux-mm@kvack.org" , LKML , patches@lists.linux.dev, Roman Gushchin , Hyeonggon Yoo <42.hyeyoo@gmail.com>, Chengming Zhou , Stephen Rothwell Content-Language: en-US Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Spamd-Bar: +++++ X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: DF4A112000E X-Stat-Signature: gzkxxax53g11n7fbhzddt1fnubt713yz X-Rspam-User: X-HE-Tag: 1704447370-173628 X-HE-Meta: U2FsdGVkX1/ro3k/g1TNvpdcQHPI7kEsBOkpOCo+7Zc2k7kly1Q/8OXLydwf5wxyeApU7+4H9Bxgkas9WoYN/bCpIrv9XkzjjlBvu5bBj8VuSSuy01iHFua3PWGkH3Pmgny2fWSxWs2ZcONZCHf5yRRwC73zzNfz/kRSQNezJ/mzS/sNyIoYuScs7FifvyFrw+wlFtLA/Ip9rlHp++eSOTsKDAG4pUVYvP3GSTsWoPlHCcnmXynYS1diKweTRS7mSPLbQbl7H3Tt/gcCmZuX6PjR7+QkS/c0nDucjbavQAuxOnEhcTJXg3Esj2ZlV9caQn9LFySNrzGTlwu4UmNb30G9lEVC9H2hMP13COFJ3uKfOd1NEXJpqz2L8Wh0mWX6G7zqQiMSSr6OamaOCfprvRDVAzgENf0EF889IODkYWBw3UklPVMdqTKivhnMgl1tnCZFxrQECxqxhwzlXMWSlyg0RZgjYXCw5/I53non32pMq3dxmki/MIKpNsXDOEQi4gQnZUrmOZ4g1OeoYtpCiTM0x7c/KUmZ2cqrmJ5ZQhANSqyElfAreD8Wwoy2fq+bM5uJhmXxlm2RuobY3iOeXMFyK6SsrE1muklhy5F9+NBnBjEhNJPHCfF2AJedsXfiYVSVXcbeUwBpMT8atbBfVimg9wVD8TLUG9rvL8rez1A475yjZCSz1k1XW8rDbHG+EzFNXjjgJva4Ih0+MgMR97c4ckAG9AM2sGPDln+99KlOWDsmOlizBAn26LRLRdMQYpkBrtn3t6gwyFZfcEIfb121cYGkcyuhLDAPJeme5ewOEy8141XQhtx2OWbpRAltznI64/Odia2LWwxDW6PRE26Jlf4hACWNxwvVCR7FmXQ0guoGfV0lMXgwh18WwRaotF97c+Cc0evNWV1thr14eTHTt7QiDxzZNUMEZ20lxFhWdVlFRzoTmPzJz7C1CrXLeocL9C5WYW7BRO4htV5 1gT29H+e 0vC0LdKrAeynLY5aik3bZQ8v7CEnvnMpNqVOHou6dV1ZCd8pBQCRfMYgTFMZu/pHxwhlr9JfslGjji4qMjV92kkWY4hgG0GdOPUifYyFmjdg1IG45E9vLdgJO/p20tgW7bvlEeTGkZnO7TVbfgTkd28tK1KTcGBkUvsuy2Jcvg6gr69AkRh3BENt3Xopr2jM4cXPcglncogsc0bbbckmwsHmC36bBgDpdcom6zu3s7I4Fv4Z5QgOfeD7lZjsHiXQG9ho+6YgEz68Nyi6uTu3N9+CHJYVtvQ32QNVV7Sl/e5bNTqOJ/nRGtxhi7BwGVnK11Qh9KHRJ6YACahSmj7lT6z4mhmmWKgII8f2IleC/ScOHr1vtyn9ED4qipoZzgc6j6qYE2dD+I0LHdnO5tFiHA9kkcE39xuiKJPVdY0i6XC2hxu64cfcqCbGyeT3rFHNqA55ZRdDQzgfgOPlc5F3yVig923WxoIbDGxbytu0er/jwPaw0ubVT9aUT0w== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi Linus, once the merge window opens, please pull the latest slab updates from: git://git.kernel.org/pub/scm/linux/kernel/git/vbabka/slab.git tags/slab-for-6.8 there are more conflicts (with mm tree) than usual this time, but I believe it's a one-off situation due to a bunch of code being deleted or shuffled due to the SLAB removal. Stephen's -next resolutions (merging slab-next after mm) https://lore.kernel.org/all/20240102150224.3c091932@canb.auug.org.au/ https://lore.kernel.org/all/20240102151332.48a87d86@canb.auug.org.au/ https://lore.kernel.org/all/20240102153438.5b29f8c5@canb.auug.org.au/ Only the last one is more involved as changes to __kmalloc_large_node() and free_large_kmalloc() in mm/slab_common.c from mm tree need to be replicated in mm/slub.c I have tried the opposite direction (mm after slab) and it was basically the same. Parking this slab PR until mm PR's is certainly an option. Thanks, Vlastimil ====================================== - SLUB: delayed freezing of CPU partial slabs (Chengming Zhou) Freezing is an operation involving double_cmpxchg() that makes a slab exclusive for a particular CPU. Chengming noticed that we use it also in situations where we are not yet installing the slab as the CPU slab, because freezing also indicates that the slab is not on the shared list. This results in redundant freeze/unfreeze operation and can be avoided by marking separately the shared list presence by reusing the PG_workingset flag. This approach neatly avoids the issues described in 9b1ea29bc0d7 ("Revert "mm, slub: consider rest of partial list if acquire_slab() fails"") as we can now grab a slab from the shared list in a quick and guaranteed way without the cmpxchg_double() operation that amplifies the lock contention and can fail. As a result, lkp has reported 34.2% improvement of stress-ng.rawudp.ops_per_sec - SLAB removal and SLUB cleanups (Vlastimil Babka) The SLAB allocator has been deprecated since 6.5 and nobody has objected so far. We agreed at LSF/MM to wait until the next LTS, which is 6.6, so we should be good to go now. This doesn't yet erase all traces of SLAB outside of mm/ so some dead code, comments or documentation remain, and will be cleaned up gradually (some series are already in the works). Removing the choice of allocators has already allowed to simplify and optimize the code wiring up the kmalloc APIs to the SLUB implementation. ---------------------------------------------------------------- Chengming Zhou (9): slub: Reflow ___slab_alloc() slub: Change get_partial() interfaces to return slab slub: Keep track of whether slub is on the per-node partial list slub: Prepare __slab_free() for unfrozen partial slab out of node partial list slub: Introduce freeze_slab() slub: Delay freezing of partial slabs slub: Optimize deactivate_slab() slub: Rename all *unfreeze_partials* functions to *put_partials* slub: Update frozen slabs documentations in the source Vlastimil Babka (26): mm/slab, docs: switch mm-api docs generation from slab.c to slub.c mm/slab: remove CONFIG_SLAB from all Kconfig and Makefile KASAN: remove code paths guarded by CONFIG_SLAB KFENCE: cleanup kfence_guarded_alloc() after CONFIG_SLAB removal mm/memcontrol: remove CONFIG_SLAB #ifdef guards cpu/hotplug: remove CPUHP_SLAB_PREPARE hooks mm/slab: remove CONFIG_SLAB code from slab common code mm/mempool/dmapool: remove CONFIG_DEBUG_SLAB ifdefs mm/slab: remove mm/slab.c and slab_def.h mm/slab: move struct kmem_cache_cpu declaration to slub.c mm/slab: move the rest of slub_def.h to mm/slab.h mm/slab: consolidate includes in the internal mm/slab.h mm/slab: move pre/post-alloc hooks from slab.h to slub.c mm/slab: move memcg related functions from slab.h to slub.c mm/slab: move struct kmem_cache_node from slab.h to slub.c mm/slab: move kfree() from slab_common.c to slub.c mm/slab: move kmalloc_slab() to mm/slab.h mm/slab: move kmalloc() functions from slab_common.c to slub.c mm/slub: remove slab_alloc() and __kmem_cache_alloc_lru() wrappers mm/slub: optimize alloc fastpath code layout mm/slub: optimize free fast path code layout mm/slub: fix bulk alloc and free stats mm/slub: introduce __kmem_cache_free_bulk() without free hooks mm/slub: handle bulk and single object freeing separately mm/slub: free KFENCE objects in slab_free_hook() Merge branch 'slab/for-6.8/slub-hook-cleanups' into slab/for-next CREDITS | 12 +- Documentation/core-api/mm-api.rst | 2 +- arch/arm64/Kconfig | 2 +- arch/s390/Kconfig | 2 +- arch/x86/Kconfig | 2 +- include/linux/cpuhotplug.h | 1 - include/linux/slab.h | 22 +- include/linux/slab_def.h | 124 -- include/linux/slub_def.h | 204 -- kernel/cpu.c | 5 - lib/Kconfig.debug | 1 - lib/Kconfig.kasan | 11 +- lib/Kconfig.kfence | 2 +- lib/Kconfig.kmsan | 2 +- mm/Kconfig | 68 +- mm/Kconfig.debug | 16 +- mm/Makefile | 6 +- mm/dmapool.c | 2 +- mm/kasan/common.c | 13 +- mm/kasan/kasan.h | 3 +- mm/kasan/quarantine.c | 7 - mm/kasan/report.c | 1 + mm/kfence/core.c | 4 - mm/memcontrol.c | 6 +- mm/mempool.c | 6 +- mm/slab.c | 4026 ------------------------------------- mm/slab.h | 551 ++--- mm/slab_common.c | 231 +-- mm/slub.c | 1137 ++++++++--- 29 files changed, 1094 insertions(+), 5375 deletions(-) delete mode 100644 include/linux/slab_def.h delete mode 100644 include/linux/slub_def.h delete mode 100644 mm/slab.c