From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 59FD8C021AA for ; Wed, 19 Feb 2025 18:10:05 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D3854280256; Wed, 19 Feb 2025 13:10:04 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id CCB7A280246; Wed, 19 Feb 2025 13:10:04 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B88A6280256; Wed, 19 Feb 2025 13:10:04 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 9810D280246 for ; Wed, 19 Feb 2025 13:10:04 -0500 (EST) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 3E50681B62 for ; Wed, 19 Feb 2025 18:10:04 +0000 (UTC) X-FDA: 83137483128.22.1D04831 Received: from mail-qt1-f176.google.com (mail-qt1-f176.google.com [209.85.160.176]) by imf29.hostedemail.com (Postfix) with ESMTP id 57FC2120005 for ; Wed, 19 Feb 2025 18:10:02 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=google.com header.s=20230601 header.b=XxNTagco; spf=pass (imf29.hostedemail.com: domain of fvdl@google.com designates 209.85.160.176 as permitted sender) smtp.mailfrom=fvdl@google.com; dmarc=pass (policy=reject) header.from=google.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1739988602; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=cN2Rqb9pVr1wEbelwivZbg+NdO1vHfBTI3BqVx7m8tI=; b=biELuoqn/7tPJ26qX63Ng6WZ6axyvHp9gprsW/g+pNazheESaFGpRQvCPEOETe3fsfRIOC WueA8HXNigHDUFSm3wPqpSU4k4y9ucTwFZvbbOerJbr9dp3xT+jZsIEXLQpWTJge3+Siw5 uBLf75WFsFk25vD/8CLulZNnvTQsRm8= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=google.com header.s=20230601 header.b=XxNTagco; spf=pass (imf29.hostedemail.com: domain of fvdl@google.com designates 209.85.160.176 as permitted sender) smtp.mailfrom=fvdl@google.com; dmarc=pass (policy=reject) header.from=google.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1739988602; a=rsa-sha256; cv=none; b=r4O8hVvWEDNdubMKFklFoRfYAd4nQ1bMsYZ1AbvOU7sxETj9GRIvBohoLGOlbWyd6pp7sz ExXM61PZ8jBN/QAm3pHP+P7W/ooa5N42bv9OqXoQTObo4hBbikYhj+MAArmw8PjK8SOpof U1VZF1/ErKyDHF6znBTpCDtQuf+uF04= Received: by mail-qt1-f176.google.com with SMTP id d75a77b69052e-471f1dd5b80so9831cf.1 for ; Wed, 19 Feb 2025 10:10:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20230601; t=1739988601; x=1740593401; darn=kvack.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=cN2Rqb9pVr1wEbelwivZbg+NdO1vHfBTI3BqVx7m8tI=; b=XxNTagcoINfYbwCj8TxDj1CE9yBOyrJ5fjxO2NU2WyGdRKJp1xZind2c2Vipqj4jAS 6H9B2m+IfgAV8S+wChA8PfR3saHUxXOXUqI9h1h0MtCLQdgPT7e5+A3gWkCzJCObQZ3e 17erIfAWEzoSG7DIU9f/Fp/WfISSd2yBSSC6nx1c6stczRJqjPXDWtw67acQ84GbBhuH clwKlYi4N/Y5q676XquFwzNZH25ZrgF46Hhb2n8eZjvzNhs/ny3XFPlWj1gi4HiWEcN8 HxV/ojc+fnSfDI6lDGG7nt0rW8IuvwF+z+IxihQfznQlrKGfW2kH9OrG3R6lTGbirEmC UljQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1739988601; x=1740593401; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=cN2Rqb9pVr1wEbelwivZbg+NdO1vHfBTI3BqVx7m8tI=; b=CIAeK4kzADU2FWRyVoLSTOOuuehpMVHkhjtXoF6xzCz/uSUR1nGOqXJm6S2qmkq5UK 9OP33zdseHr4BVTdRqnzoTtYoCtiSc7ssqa+ylzEmjtuP4G31I3y+pbHd1+4/z69t1t/ XorEheP0oXR8yLHqG+te5iWFFCzr8kmifVLZGAuivHQx2Xsj5QXCs654/lP4Bn0K3D1H I7HHK7p0AWS4Pc0sbUsWHdBirMV+ZR7eJtAuqI/vYRJvthSm5uC/xwQouVqw6VzIjjYT prF4O0/hI52CSQv9K1uiTjI0B7bFqAeLoR45S3HDRdQ2Q/U9zjFvy8F0/TJ1T+gKK6sg vqig== X-Forwarded-Encrypted: i=1; AJvYcCWjZOjKK9nH3BIaIvi5GknApfRwH3vq+5dS++lMNjN+a/F0wT3rMcJHRScXcrHn/YXHFyuwQiK9Kg==@kvack.org X-Gm-Message-State: AOJu0YzbMarPUWwyJ7bx1JkUSmry9XYot9qW/H0SKyBBQmflJq2VqiUH 31+weHe/OcQmScUe7MO5ESupeL4JNqvuQodyfb/fRnnQuU+09hsPizyzL6KcH3Bm5nTRoDJAcMr yq3KhgGkTR2CuIO3DVoY/ubDyXq3sLnrKt7OK X-Gm-Gg: ASbGncvoOCWk8UhiFPYqyLblDcgsJlo4a9UdgDgB3Vvxp7rY3fObsYYopxdQaBTrvG8 cQwIaWO8Ut1rKEn9KAw/CrhaBX1hdycz0ioZp14e8o06S6Okg5OUZcaeeWOJ1Na1KD7Jaog== X-Google-Smtp-Source: AGHT+IFECn4l0B9qOC1a0Jsue3I+n7DzaMiiOTXZNUAt2jIlFgFxSsUbpq4Nx4VMcy+s7Y4gzhzjGXJZ4X33VbqUPyY= X-Received: by 2002:a05:622a:14c7:b0:471:f8af:3231 with SMTP id d75a77b69052e-4720a541b6cmr3830931cf.19.1739988601038; Wed, 19 Feb 2025 10:10:01 -0800 (PST) MIME-Version: 1.0 References: <20250218181656.207178-1-fvdl@google.com> In-Reply-To: <20250218181656.207178-1-fvdl@google.com> From: Frank van der Linden Date: Wed, 19 Feb 2025 10:09:49 -0800 X-Gm-Features: AWEUYZlgmyBY-mj3iRaq8vXknIOGgntMAabmV3Q9iZKJkWDq1xSamLvU_YJ7u4w Message-ID: Subject: Re: [PATCH v4 00/27] hugetlb/CMA improvements for large systems To: akpm@linux-foundation.org, muchun.song@linux.dev, linux-mm@kvack.org, linux-kernel@vger.kernel.org Cc: yuzhao@google.com, usamaarif642@gmail.com, joao.m.martins@oracle.com, roman.gushchin@linux.dev Content-Type: text/plain; charset="UTF-8" X-Rspam-User: X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 57FC2120005 X-Stat-Signature: 8t4hnhqjbnkpnt889rgy73zxn1zgnfxn X-HE-Tag: 1739988602-436549 X-HE-Meta: U2FsdGVkX1/UlolkdE2zG/2KjWOn79qHL439/psfM8xlH073QvreUDTIzPLx373JyjJvABFnZrsf0nmx6fLw16553M2Bf6jnFhfPvau8M6YU7jVPNza+JgBclSwBODFQOUB/NR8DO/G99orn7itKoszwniCW3kEXrsliYYMxC1jNB3AcibFJiXfhj/XNUgf6sDb2xnq+rZtRfFEX3KBkp0KUYuhigLjhU/z9V2ktxFUiF5YQhamSaTY7xml9BeeRrnSGlz8flpJ2/C5pCdwdQhdXKEgsW9M5Tb/XP+lb2xRLxR2WHrZZ+UMUHzhpY2uvCCKg0yhts38Z+qxdsHdm2Lk9n7HZy6bJm/NDCmzHidqEdtPApOO89nkL67lFJvCrGNEIrui8gd5fetFdtPZIzS6V8D4xcgYsVDbVt3BxT+WbXr5dyT1A5us4XpI7n+04oQH20OZCCkfltjhUfCmo2cecolv6QeXLgY0W6I53tO/7zuBL5cAPYpkYl5nrzUIxqbgKBLNRTj6Kmd/pc1rII6PuqCat1+82PXX6lQolT0oD/qpCLNj6OKfe8QSL85CO9FmlaJ220Piz6Krrnrxjcnnihp/Qu3En1FY5mCHyzTB+D9TuZoyyv/0op8T56tTgZmeOqDB8tXcqpMuOXdEqhIIIMgxI/L3ML1gHoVInL1lYchyk5hSXqIkCOW4JCG58aYfahajF+xtQMu0IdDsRyHy4naJR8xc73Vt5ElvIf84iyzcxH2WFYsolNrhFJjNAwh95rV03v/wQ7JBqhEJsZ215v7EcVkfk2ROyhf3CNWS4KDSubU9JbxFAzfyRnZS1M2zzt5O8m8dTHoyssa0JmPSr7ogUGGt1vrdDWgZSka9BRC45v71omEFRkhgaOFkN5TtSSyaXVlhQ5FkEPGoET9DrD5Ryl0Z700EB3vwnvhyStoxc/gUeSdOlZJnTEjKpFCQxEhJY3GNpnxoyyzM H5GbSVEh mxu1LyjFLXjjXIjkbd3gyoROferatS9FUfMHzME+S8yoI315cany8J2l4j4Jr7x5h69ucLvGV+o/1VqfgoVHbJaDBSRyOaJlZX2iV4QJ1pp9tf5OfS1i5TeY1zVoSw8f6VR2zHBQ6lklDWno4Qw3MeSQJod9ZInxjnyokqqJ1x2EYfGLL+FOQDBcBLNInxidlfkcP X-Bogosity: Ham, tests=bogofilter, spamicity=0.000076, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: I forgot to add this to the cover letter: These first 4 are the multi-range CMA support, and can be reviewed as an independent series: > mm/cma: export total and free number of pages for CMA areas > mm, cma: support multiple contiguous ranges, if requested > mm/cma: introduce cma_intersects function > mm, hugetlb: use cma_declare_contiguous_multi These implement huge/gigantic page pre-HVO, and can also be reviewed as a separate series if that's more convenient: > mm/hugetlb: remove redundant __ClearPageReserved > mm/hugetlb: use online nodes for bootmem allocation > mm/hugetlb: convert cmdline parameters from setup to early > x86/mm: make register_page_bootmem_memmap handle PTE mappings > mm/bootmem_info: export register_page_bootmem_memmap > mm/sparse: allow for alternate vmemmap section init at boot > mm/hugetlb: set migratetype for bootmem folios > mm: define __init_reserved_page_zone function > mm/hugetlb: check bootmem pages for zone intersections > mm/sparse: add vmemmap_*_hvo functions > mm/hugetlb: deal with multiple calls to hugetlb_bootmem_alloc > mm/hugetlb: move huge_boot_pages list init to hugetlb_bootmem_alloc > mm/hugetlb: add pre-HVO framework > mm/hugetlb_vmemmap: fix hugetlb_vmemmap_restore_folios definition > mm/hugetlb: do pre-HVO for bootmem allocated pages > x86/setup: call hugetlb_bootmem_alloc early > x86/mm: set ARCH_WANT_SPARSEMEM_VMEMMAP_PREINIT These implement early allocations from CMA, enabling pre-HVO of pre-allocated CMA hugepages. It depends on the previous two groups of patches: > mm/cma: simplify zone intersection check > mm/cma: introduce a cma validate function > mm/cma: introduce interface for early reservations > mm/hugetlb: add hugetlb_cma_only cmdline option > mm/hugetlb: enable bootmem allocation from CMA areas > mm/hugetlb: move hugetlb CMA code in to its own file >