From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9AEDEC36008 for ; Wed, 26 Mar 2025 20:46:12 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 6E4ED2800AB; Wed, 26 Mar 2025 16:46:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 66DEF2800A5; Wed, 26 Mar 2025 16:46:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4E7A32800AB; Wed, 26 Mar 2025 16:46:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 28FCF2800A5 for ; Wed, 26 Mar 2025 16:46:11 -0400 (EDT) Received: from smtpin08.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 454BA1205C2 for ; Wed, 26 Mar 2025 20:46:11 +0000 (UTC) X-FDA: 83264884542.08.2EA0A05 Received: from mail-pj1-f53.google.com (mail-pj1-f53.google.com [209.85.216.53]) by imf24.hostedemail.com (Postfix) with ESMTP id 203E3180003 for ; Wed, 26 Mar 2025 20:46:08 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=fromorbit-com.20230601.gappssmtp.com header.s=20230601 header.b=wLVQsgju; dmarc=pass (policy=quarantine) header.from=fromorbit.com; spf=pass (imf24.hostedemail.com: domain of david@fromorbit.com designates 209.85.216.53 as permitted sender) smtp.mailfrom=david@fromorbit.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1743021969; a=rsa-sha256; cv=none; b=vsgMMEzs6c+rvPDRYvSIAxMLhLFLC+qTYc9NjE7x+y/13eDEKi6rx4oSg3q9CcwtLX8d+A JFNj4Msr26nZ/pP6OoZQICuRKKS5buMQR4DbBBfhSflYvAu1jw2MnRQluD5e4O807+dSxa 6jzpStCxyOlIrqqCXMJuOFiFR4zCIk0= ARC-Authentication-Results: i=1; imf24.hostedemail.com; dkim=pass header.d=fromorbit-com.20230601.gappssmtp.com header.s=20230601 header.b=wLVQsgju; dmarc=pass (policy=quarantine) header.from=fromorbit.com; spf=pass (imf24.hostedemail.com: domain of david@fromorbit.com designates 209.85.216.53 as permitted sender) smtp.mailfrom=david@fromorbit.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1743021969; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=l0DxjNG0t0sEawU75w2W9OviEBnYSuXggXRVCOAy4Bs=; b=NHs++FTp44HNpnb3wHCICacp+W7TJl9gVsTalOBD7EBDNgPHjF7Y159Z4xaHmqXw6E4D+H osCDsNKwlWe8TxN3VomQwtx7a/udlRhI8+XGWIYGtegxynohbi0uJYxGUQejXPV6R0Qpvn xSyseDuFUvj2qau4IfLoOCxQQCwa1JI= Received: by mail-pj1-f53.google.com with SMTP id 98e67ed59e1d1-30384072398so321108a91.0 for ; Wed, 26 Mar 2025 13:46:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fromorbit-com.20230601.gappssmtp.com; s=20230601; t=1743021968; x=1743626768; darn=kvack.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=l0DxjNG0t0sEawU75w2W9OviEBnYSuXggXRVCOAy4Bs=; b=wLVQsgjuzFeO5Wujpc3n3lmLscRd3GWVTkuF1ao4F4gcdsNzr/7+XxRrUeoAduV2ch g2ef/xYtM4zbpi5ncfODHgb+XIdO9S+sm7KQ9xouezOkeXJR52lYBikHmgafpZ3xLe3a TL+QL5AXoZABB1fv3VR1LWJCFruU+nDfTtpWmVCYLhqzZc6HLDdEerYsOZx/flFiCZ5B eBqvWka1hkwqOXcX+CGYJzRhbHE4cEm4XFtNJf00E74QwFM1dMXLg4apmR+Iis9ngjGl iY+pyG0LDWsm3Z8cJL4ndTz4SecH+Lzbd7+Fg/zxLIn0x1uUbd+tZcX/8o8sJvZyh7Lc 6OUQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1743021968; x=1743626768; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=l0DxjNG0t0sEawU75w2W9OviEBnYSuXggXRVCOAy4Bs=; b=VkpggIFVFaP4EKByY9pwdj8AnuYoDviTh1Cds4VyQnInvbNfDQIHkwpobSyKP+2rNm YyJUOwYrpa+VA3sQABwCMnT0ppmGjg5naYBlz5fJsmCfSALb+A5AlSmWjeBayrMMgKJo IXOta+qQ5cF8FPCJw9YsMEeu/VGH/2ixL12SoJ33A2cqcfxH/QRE4+DMsfeHM7GXBgkP Av3vHN+lcEXlSfRbE431NBjh+gWfzkzhMneBWvE7kt4ErFaYwnADCyVswinb39zF2J8i hgprh1tOqV0PNrqWNa85IL+jp8XKUwts7PyThUNu9smACQP3El3bTRpzUKhxlZ0s8mcv Adqw== X-Forwarded-Encrypted: i=1; AJvYcCWnpvIRKYKRI3o5dxVXqOuDyAPYOSQHAeIvMFOQj+PwMPyb2jnBwy8q9re6AKigbWr6Dpt68HF/bQ==@kvack.org X-Gm-Message-State: AOJu0YxSoh5AKSdRslmQAm9wM4F0K03jq8mYVxYLHQ/OEeHh5cDTg0T3 8al1f2ILLYt9SuegxilkuGc3BccRkLWQSYMD08vOQs7VJ3kTEcpo31CY5rHjC1E= X-Gm-Gg: ASbGnctzx0jHS1v4D3N1/O/G3rqXxNppxLx6nZ+AkK9UUChB9zWUHGCOrTkKI8wdKuu iouA+4eMSHwaRFPDd1j9zP0lsT/cZrqpo6N+DU8zA6B4rn6fqUkgzqrqegdionRqRMDx5+SkCQQ tB5kMiEa14JrFPfm/n4jyiP6YKAzp7m/TO8y9AoVZelSVCggmAiiRcPMq3+5NSLkNOSh8BZlzma J+rh8E6Bd3ygecxr6iHN3KUgNrYRr8x4VPLGy5iZiujBoQ5mWDaf8KDEr4XSPsdmMrqEiTZjvmo 0dVDvoS9FEd84seYaB7irzb0QlLhCC9F2M2R9O0Vf03mQyXut53OLfIQQ/nZBcvqD8EGdEdgHS+ N/VLfv9skakuowkjsgA== X-Google-Smtp-Source: AGHT+IHYC9faJMfvw3S3nDn2V7wFInikoEkVJnJUgRfyAHRL+/TjLMdCvBBuENH2adHdN+PgG4A1eA== X-Received: by 2002:a17:90b:2c84:b0:2ff:6e72:b8e2 with SMTP id 98e67ed59e1d1-303a8e76448mr1592314a91.31.1743021967688; Wed, 26 Mar 2025 13:46:07 -0700 (PDT) Received: from dread.disaster.area (pa49-181-60-96.pa.nsw.optusnet.com.au. [49.181.60.96]) by smtp.gmail.com with ESMTPSA id 98e67ed59e1d1-3039e60f81fsm752510a91.48.2025.03.26.13.46.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 26 Mar 2025 13:46:07 -0700 (PDT) Received: from dave by dread.disaster.area with local (Exim 4.98) (envelope-from ) id 1txXdT-00000000gYk-3LF2; Thu, 27 Mar 2025 07:46:03 +1100 Date: Thu, 27 Mar 2025 07:46:03 +1100 From: Dave Chinner To: Luis Chamberlain Cc: lsf-pc@lists.linux-foundation.org, patches@lists.linux.dev, fstests@vger.kernel.org, linux-mm@kvack.org, linux-fsdevel@vger.kernel.org, linux-block@vger.kernel.org, oliver.sang@intel.com, hannes@cmpxchg.org, willy@infradead.org, jack@suse.cz, apopple@nvidia.com, brauner@kernel.org, hare@suse.de, oe-lkp@lists.linux.dev, lkp@intel.com, john.g.garry@oracle.com, p.raghav@samsung.com, da.gomez@samsung.com, dave@stgolabs.net, riel@surriel.com, krisman@suse.de, boris@bur.io, jackmanb@google.com, gost.dev@samsung.com Subject: Re: [LSF/MM/BPF Topic] synthetic mm testing like page migration Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 203E3180003 X-Stat-Signature: dukqeab741r5w7u9aut89je77c9jhea9 X-Rspam-User: X-HE-Tag: 1743021968-397959 X-HE-Meta: U2FsdGVkX1+F/DX/QM4cUjpx9f9nlUP96U7/xM8DFczMHvhjZOuwEmSgYR/kX0wTQDzTz+Efbw9wvjKoCWpL7EBSz2u054HqnZqjjUgCPcfkQ4TRQppkf3/mv7I5YKH5LvO8NQDgd9ei9n4+QhxPtMyqlbRAEJqh8jdOY3tpEFZwuQ+OkWQxOjF4fKJ7ISKCzjXYrViOGQ32GPW5ePGlIc5BP58nOuwE/9JJJdaIfN8Lgmd7g46btuYErNynRAuulvPTGrKIt5oJQrR78Q7IYCDJ8acrpngfD0DkYqOrE4AGAyrht1XKUikrYeaSqgdB3Im5VTh7qfNfpFun9RQhOmK7oqzwQ+Gnsue01fmcRC+UXkXAllEdgfeIsMiyz0Bd63oCtcb7fhCJnAUwU7L4uXzFsfTiD/nKBo8rwLk6kWTY/2pNS5O2wfzx4NNig7vpzAYn+4gPLECcUMRYQVCDTZDSfGscZqOMhznfZem5l3e3CFpCsBI17kW/uv1NGhfHBuYUR7CqE6OtDybUfKpxP6y6X4BzdD7ubqav/y5ZZsXaTRLsdmdgrz0/Ptyg8CiOdXTTHMnvH6EP2nTPVgrUd2i0lUkw2Ge9Ix0uMofppNW43rPkkwhPtlr16gk9IwwSENeIRbsUl52Z3IorhwXEqvuzrzA3JxEsZ5bJf/+fYHwpovaKNaKLaxqMLFcWwyH/lEw3whY7pZyOQ1GgMzHehzOPA7N8V25rt9usJybA4wP9ksp4IhKfsa6IhA9IabZYBKGSPOv+mxh4YWL/rYLryydHEYwiwTVo5jzhp5K+UlXZySeT84iLu8cXJrMEapmkEutfMsUWQQphLR9KrrwL5OOOSgBjUMMdSShDLa7KZ4HMntEUtNskeIwBxEHnrwVCiJ2Lrq0/+Uy08fbFnZdsh5w/ie4RfpzjZyyTf38Db86mpEHbwc7F6qpZVFefzPuWVme67mEmVeBjeePOAma x1tvqYHz 4lTstvIoAgtgDaulDBpuwydUZxrDS9u4+RCWm9I+7RBaGT/HkqGgLVaso7znkomWLjJjMkdHYAEd7ZnWjBjN72LvledPS1S+mSFwDn+7t0d4ryyOisGaAjTaGpn3uqzYgXVfIRXctYtHOnRQqfTNbJlVIl/tOQZ7D9acRKwgMHON2bKhaRMDglfn7gF9UlUhv0xO8FJ2CkJb4Owu4GbfAPPxG4vKOH1+gXjZ1ORi+whFHE3/3qd8YMQQp/cpNWWVvBXEpzq/uI9tOwuK+ShtNbPSdjngMQzYHjHG4/EnDC2Jk7TI/rf8yHZWj4sW/JdwS/0RihjMTGE0yN0lK6xdQxEWBm+RwUTG4vIFjL5wJCp1JcotRjGurLVMd//YJ9b2FvJWonTOHg35Hz7PN2APqnbbr6dNmQiHmAKv/ X-Bogosity: Ham, tests=bogofilter, spamicity=0.000004, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, Mar 26, 2025 at 11:59:48AM -0700, Luis Chamberlain wrote: > I'd like to propose this as a a BoF for MM. > > We can find issues if we test them, but some bugs are hard to reproduce, > specially some mm bugs. How far are we willing to add knobs to help with > synthetic tests which which may not apply to numa for instance? An > example is the recent patch I just posted to force testing page > migration [0]. We can only run that test if we have a numa system, and a > lot of testing today runs on guests without numa. Would we be willing > to add a fake numa node to help with synthetic tests like page > migration? Boot your test VMs with fake-numa=4, and now you have a 4 node system being tested even though it's not a real, physical numa machine. I've been doing this for the best part of 15 years now with a couple of my larger test VMs explicitly to test NUMA interactions. I also have a large 64p VM with explicit qemu NUMA configuration that mirrors the underlying hardware NUMA layout. This allows NUMA aware perf testing from inside that VM that responds the same as a real physical machine would. $ $ lscpu .... CPU(s): 64 On-line CPU(s) list: 0-63 Thread(s) per core: 1 Core(s) per socket: 16 Socket(s): 4 ..... NUMA: NUMA node(s): 4 NUMA node0 CPU(s): 0-15 NUMA node1 CPU(s): 16-31 NUMA node2 CPU(s): 32-47 NUMA node3 CPU(s): 48-63 This is also the VM I'm doing most of my performance testing and check-parallel development on, so I see the NUMA scalability issues that occur when trying to make use of the underlying hardware NUMA capability... > Then what else could we add to help stress test page migration and > compaction further? We already have generic/750 and that has found some > snazzy issues so far. But what else can we do to help random guests > all over running fstests start covering complex mm tests better? Use check-parallel on buffered loop devices - it'll generate a heap of page cache pressure from all the IO, and run a heap more tests at the same time as the compaction is running from g/740. This often overlaps with g/650 which does background CPU hotplug, and it definitely overlaps with other tests running drop_caches, mount, unmount, etc, too. One of the eventual goals of check-parallel is to have all these things environmental variables like memory load, compaction, cpu hotplug, etc to be changing in the background whilst the tests running so that we can exercise all the filesystem functionality under changing MM and environmental conditions without having to code that into individual tests.... -Dave. -- Dave Chinner david@fromorbit.com