linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Mike Rapoport <rppt@kernel.org>
To: Andrew Morton <akpm@linux-foundation.org>,
	David Hildenbrand <david@kernel.org>
Cc: Baolin Wang <baolin.wang@linux.alibaba.com>,
	Barry Song <baohua@kernel.org>, Dev Jain <dev.jain@arm.com>,
	Donet Tom <donettom@linux.ibm.com>,
	Jason Gunthorpe <jgg@ziepe.ca>,
	John Hubbard <jhubbard@nvidia.com>,
	"Liam R. Howlett" <Liam.Howlett@oracle.com>,
	Lance Yang <lance.yang@linux.dev>,
	Leon Romanovsky <leon@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Mark Brown <broonie@kernel.org>,
	Michal Hocko <mhocko@suse.com>, Mike Rapoport <rppt@kernel.org>,
	Nico Pache <npache@redhat.com>, Peter Xu <peterx@redhat.com>,
	Ryan Roberts <ryan.roberts@arm.com>,
	Sarthak Sharma <sarthak.sharma@arm.com>,
	Shuah Khan <shuah@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Vlastimil Babka <vbabka@kernel.org>, Zi Yan <ziy@nvidia.com>,
	linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
	linux-mm@kvack.org
Subject: [PATCH v2 00/53] make MM selftests more CI friendly
Date: Sat, 18 Apr 2026 13:54:45 +0300	[thread overview]
Message-ID: <20260418105539.1261536-1-rppt@kernel.org> (raw)

From: "Mike Rapoport (Microsoft)" <rppt@kernel.org>

Hi,

There's a lot of dancing around HugeTLB settings in run_vmtests.sh.
Some test need just a few default huge pages, some require at least 256 MB, and
some just skip lots of tests if huge pages of all supported sizes are not
available.

The goal of this set is to make tests deal with HugeTLB setup and teardown.

There are already convenient helpers that allow easy reading and writing of
/proc and /sysfs, so adding a few APIs that will detect and update HugeTLB
settings shouldn't be a big deal. But these nice helpers use kselftest
framework, and many of HugeTLB (and even THP) test don't, so as a result this
patchset also includes a lot of churn for conversion of those tests to
kselftest framework (patches 7-19).

The series break out:
patches 1-4:   small fixes
patches 7-19:  mechanical conversion to kselftest framework
patches 20-26: extension of thp_settings to hugepage_settings to also include
               HugeTLB helpers
patches 27-28: add helpers for setting up SHM limits in hugetlb-shm and
               thuge-gen tests
patches 29-51: integrate the new APIs in all the tests that use HugeTLB
patches 52-53: drop HugeTLB setup from run_vmtests.sh

I belive at this point this can go to mm-new and wait there for more review
feedback.

Based on mm-stable-2026-04-18-02-14

v2 changes:
* fix hugetlb mmap tests to actually test file mappings
* increase maximal tests number in khugepaged
* add tags, thanks everyone!

v1: https://lore.kernel.org/all/20260406141735.2179309-1-rppt@kernel.org

Mike Rapoport (Microsoft) (53):
  selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler
  selftests/mm: khugepaged: enable collapse_single_pte_entry_compound for shmem
  selftests/mm: migration: don't assume hupe page is TWOMEG
  selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES
  selftests/mm: merge map_hugetlb into hugepage-mmap
  selftests/mm: rename hugepage-* tests to hugetlb-*
  selftests/mm: hugetlb-shm: use kselftest framework
  selftests/mm: hugetlb-vmemmap: use kselftest framework
  selftests/mm: hugetlb-madvise: use kselftest framework
  selftests/mm: hugetlb_madv_vs_map: use kselftest framework
  selftests/mm: hugetlb-read-hwpoison: use kselftest framework
  selftests/mm: khugepaged: group tests in an array
  selftests/mm: khugepaged: use ksefltest framework
  selftests/mm: ksm_tests: use kselftest framework
  selftests/mm: protection_keys: use descriptive test names in TAP output
  selftests/mm: protection_keys: use kselftest framework
  selftests/mm: uffd-stress: use kselftest framework
  selftests/mm: uffd-unit-tests: use kselftest framework
  selftests/mm: va_high_addr_switch: use kselftest framework
  selftests/mm: add atexit() and signal handlers to thp_settings
  selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch]
  selftests/mm: move HugeTLB helpers to hugepage_settings
  selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size
  selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages
  selftests/mm: hugepage_settings: rename get_free_hugepages()
  selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown
  selftests/mm: move read_file(), read_num() and write_num() to vm_util
  selftests/mm: vm_util: add helpers to set and restore shm limits
  selftests/mm: compaction_test: use HugeTLB helpers ...
  selftests/mm: cow: add setup of HugeTLB pages
  selftests/mm: gup_longterm: add setup of HugeTLB pages
  selftests/mm: gup_test: add setup of HugeTLB pages
  selftests/mm: hmm-tests: add setup of HugeTLB pages
  selftests/mm: hugepage_dio: add setup of HugeTLB pages
  selftests/mm: hugetlb_fault_after_madv: add setup of HugeTLB pages
  selftests/mm: hugetlb-madvise: add setup of HugeTLB pages
  selftests/mm: hugetlb_madv_vs_map: add setup of HugeTLB pages
  selftests/mm: hugetlb-mmap: add setup of HugeTLB pages
  selftests/mm: hugetlb-mremap: add setup of HugeTLB pages
  selftests/mm: hugetlb-shm: add setup of HugeTLB pages
  selftests/mm: hugetlb-soft-online: add setup of HugeTLB pages
  selftests/mm: hugetlb-vmemmap: add setup of HugeTLB pages
  selftests/mm: migration: add setup of HugeTLB pages
  selftests/mm: pagemap_ioctl: add setup of HugeTLB pages
  selftests/mm: protection_keys: use library code for HugeTLB setup
  selftests/mm: thuge-gen: add setup of HugeTLB pages
  selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages
  selftests/mm: uffd-unit-tests: add setup of HugeTLB pages
  selftests/mm: uffd-wp-mremap: add setup of HugeTLB pages
  selftests/mm: va_high_addr_switch: add setup of HugeTLB pages
  selftests/mm: va_high_addr_switch.sh: drop huge pages setup
  selftests/mm: run_vmtests.sh: free memory if available memory is low
  selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB

 tools/testing/selftests/mm/.gitignore         |   4 +
 tools/testing/selftests/mm/Makefile           |  13 +-
 tools/testing/selftests/mm/compaction_test.c  | 113 +----
 tools/testing/selftests/mm/cow.c              |  29 +-
 .../selftests/mm/folio_split_race_test.c      |   2 +-
 tools/testing/selftests/mm/guard-regions.c    |   2 +-
 tools/testing/selftests/mm/gup_longterm.c     |   3 +-
 tools/testing/selftests/mm/gup_test.c         |  12 +
 tools/testing/selftests/mm/hmm-tests.c        |  24 +-
 tools/testing/selftests/mm/hugepage-mmap.c    |  78 ----
 .../{thp_settings.c => hugepage_settings.c}   | 284 +++++++++++--
 .../{thp_settings.h => hugepage_settings.h}   |  75 +++-
 tools/testing/selftests/mm/hugetlb-madvise.c  | 209 ++++------
 tools/testing/selftests/mm/hugetlb-mmap.c     | 140 +++++++
 .../{hugepage-mremap.c => hugetlb-mremap.c}   |  13 +-
 .../selftests/mm/hugetlb-read-hwpoison.c      | 123 +++---
 .../mm/{hugepage-shm.c => hugetlb-shm.c}      |  65 ++-
 .../selftests/mm/hugetlb-soft-offline.c       |  45 +-
 .../{hugepage-vmemmap.c => hugetlb-vmemmap.c} |  46 +-
 tools/testing/selftests/mm/hugetlb_dio.c      |  15 +-
 .../selftests/mm/hugetlb_fault_after_madv.c   |   7 +-
 .../selftests/mm/hugetlb_madv_vs_map.c        |  22 +-
 tools/testing/selftests/mm/khugepaged.c       | 394 ++++++++----------
 tools/testing/selftests/mm/ksm_tests.c        | 182 ++++----
 tools/testing/selftests/mm/map_hugetlb.c      |  88 ----
 tools/testing/selftests/mm/migration.c        |  54 ++-
 tools/testing/selftests/mm/pagemap_ioctl.c    |  13 +-
 tools/testing/selftests/mm/pkey-helpers.h     |   6 +-
 .../testing/selftests/mm/prctl_thp_disable.c  |   2 +-
 tools/testing/selftests/mm/protection_keys.c  | 131 +++---
 tools/testing/selftests/mm/run_vmtests.sh     | 177 ++------
 tools/testing/selftests/mm/soft-dirty.c       |   2 +-
 .../selftests/mm/split_huge_page_test.c       |   2 +-
 tools/testing/selftests/mm/thuge-gen.c        |  80 +---
 tools/testing/selftests/mm/transhuge-stress.c |   2 +-
 tools/testing/selftests/mm/uffd-common.h      |   1 +
 tools/testing/selftests/mm/uffd-stress.c      |  44 +-
 tools/testing/selftests/mm/uffd-unit-tests.c  | 110 +++--
 tools/testing/selftests/mm/uffd-wp-mremap.c   |  12 +-
 .../selftests/mm/va_high_addr_switch.c        |  40 +-
 .../selftests/mm/va_high_addr_switch.sh       |  39 +-
 tools/testing/selftests/mm/vm_util.c          | 133 +++---
 tools/testing/selftests/mm/vm_util.h          |  15 +-
 43 files changed, 1376 insertions(+), 1475 deletions(-)
 delete mode 100644 tools/testing/selftests/mm/hugepage-mmap.c
 rename tools/testing/selftests/mm/{thp_settings.c => hugepage_settings.c} (60%)
 rename tools/testing/selftests/mm/{thp_settings.h => hugepage_settings.h} (55%)
 create mode 100644 tools/testing/selftests/mm/hugetlb-mmap.c
 rename tools/testing/selftests/mm/{hugepage-mremap.c => hugetlb-mremap.c} (94%)
 rename tools/testing/selftests/mm/{hugepage-shm.c => hugetlb-shm.c} (56%)
 rename tools/testing/selftests/mm/{hugepage-vmemmap.c => hugetlb-vmemmap.c} (76%)
 delete mode 100644 tools/testing/selftests/mm/map_hugetlb.c


base-commit: 0b5e8d7999076ac3c490fc18376a404e2626abff
--
2.53.0


             reply	other threads:[~2026-04-18 10:55 UTC|newest]

Thread overview: 54+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-18 10:54 Mike Rapoport [this message]
2026-04-18 10:54 ` [PATCH v2 01/53] selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 02/53] selftests/mm: khugepaged: enable collapse_single_pte_entry_compound for shmem Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 03/53] selftests/mm: migration: don't assume hupe page is TWOMEG Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 04/53] selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 05/53] selftests/mm: merge map_hugetlb into hugepage-mmap Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 06/53] selftests/mm: rename hugepage-* tests to hugetlb-* Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 07/53] selftests/mm: hugetlb-shm: use kselftest framework Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 08/53] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 09/53] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 10/53] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 11/53] selftests/mm: hugetlb-read-hwpoison: " Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 12/53] selftests/mm: khugepaged: group tests in an array Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 13/53] selftests/mm: khugepaged: use ksefltest framework Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 14/53] selftests/mm: ksm_tests: use kselftest framework Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 15/53] selftests/mm: protection_keys: use descriptive test names in TAP output Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 16/53] selftests/mm: protection_keys: use kselftest framework Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 17/53] selftests/mm: uffd-stress: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 18/53] selftests/mm: uffd-unit-tests: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 19/53] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 20/53] selftests/mm: add atexit() and signal handlers to thp_settings Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 21/53] selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch] Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 22/53] selftests/mm: move HugeTLB helpers to hugepage_settings Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 23/53] selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 24/53] selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 25/53] selftests/mm: hugepage_settings: rename get_free_hugepages() Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 26/53] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 27/53] selftests/mm: move read_file(), read_num() and write_num() to vm_util Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 28/53] selftests/mm: vm_util: add helpers to set and restore shm limits Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 29/53] selftests/mm: compaction_test: use HugeTLB helpers Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 30/53] selftests/mm: cow: add setup of HugeTLB pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 31/53] selftests/mm: gup_longterm: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 32/53] selftests/mm: gup_test: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 33/53] selftests/mm: hmm-tests: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 34/53] selftests/mm: hugepage_dio: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 35/53] selftests/mm: hugetlb_fault_after_madv: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 36/53] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 37/53] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 38/53] selftests/mm: hugetlb-mmap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 39/53] selftests/mm: hugetlb-mremap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 40/53] selftests/mm: hugetlb-shm: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 41/53] selftests/mm: hugetlb-soft-online: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 42/53] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 43/53] selftests/mm: migration: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 44/53] selftests/mm: pagemap_ioctl: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 45/53] selftests/mm: protection_keys: use library code for HugeTLB setup Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 46/53] selftests/mm: thuge-gen: add setup of HugeTLB pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 47/53] selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 48/53] selftests/mm: uffd-unit-tests: add setup of HugeTLB pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 49/53] selftests/mm: uffd-wp-mremap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 50/53] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 51/53] selftests/mm: va_high_addr_switch.sh: drop huge pages setup Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 52/53] selftests/mm: run_vmtests.sh: free memory if available memory is low Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 53/53] selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB Mike Rapoport

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260418105539.1261536-1-rppt@kernel.org \
    --to=rppt@kernel.org \
    --cc=Liam.Howlett@oracle.com \
    --cc=akpm@linux-foundation.org \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=broonie@kernel.org \
    --cc=david@kernel.org \
    --cc=dev.jain@arm.com \
    --cc=donettom@linux.ibm.com \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=lance.yang@linux.dev \
    --cc=leon@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=npache@redhat.com \
    --cc=peterx@redhat.com \
    --cc=ryan.roberts@arm.com \
    --cc=sarthak.sharma@arm.com \
    --cc=shuah@kernel.org \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox