From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 57684C433FE for ; Mon, 21 Nov 2022 14:57:14 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id EB90D6B0071; Mon, 21 Nov 2022 09:57:13 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id E68926B0073; Mon, 21 Nov 2022 09:57:13 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D33236B0074; Mon, 21 Nov 2022 09:57:13 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id BFEA06B0071 for ; Mon, 21 Nov 2022 09:57:13 -0500 (EST) Received: from smtpin08.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 9A0191A0EE2 for ; Mon, 21 Nov 2022 14:57:13 +0000 (UTC) X-FDA: 80157752346.08.3B6FAF3 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by imf29.hostedemail.com (Postfix) with ESMTP id 40E3D120011 for ; Mon, 21 Nov 2022 14:57:12 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1669042631; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=YKhtto51BkO/qqsyDgdGypNLsOVsCRpQ1auwp3TLJ1I=; b=KcJucgYqEUYlPSvZ/wWZYxTNqWJFbwS+dDJa2tVcVsROYYroLsCmw2TEUI3iyIUt3WveSc lTnZaiH9r9BVHk9XRGWxspmFFsv522+9Fuyx/Yyjfp1PyodBV+unHjBUIqtqdd8CMyym7J koXog96gEIFSTxd0CdtnnnXGWOgBp5c= Received: from mail-qk1-f200.google.com (mail-qk1-f200.google.com [209.85.222.200]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_128_GCM_SHA256) id us-mta-452-3S1ZYIwdPEeOUMri7vvb5w-1; Mon, 21 Nov 2022 09:57:09 -0500 X-MC-Unique: 3S1ZYIwdPEeOUMri7vvb5w-1 Received: by mail-qk1-f200.google.com with SMTP id bk30-20020a05620a1a1e00b006fb2378c857so15820613qkb.18 for ; Mon, 21 Nov 2022 06:57:08 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=YKhtto51BkO/qqsyDgdGypNLsOVsCRpQ1auwp3TLJ1I=; b=MHU7xtGeP00/ze7O5hfmiUYM3sBGQc46klynUP7hRCmmzmi1XJSS0GKlIpR4Hb1bsy 0iYGtDMdDbEdc2evmnrHpOAdx8Dr5EjuWUzZq84QZ6Pp44WOrvW4w1NxXB7DzGHtfRT+ oaZplprfXJy3h2Gi1+//If5w2exE/vPespJ7f7w0r4FxV5VDnDx6xiLm8XpHWvG01Fdy XM7taa0pN1YXfeBEOW5Y5QgygpIwJGvidlvOgb4OlCNVwHRQr0wNbRkl6BeUcViSdZZS 6UDc6HzUtUZ/wjwuT7VeOTxT6hGzx6IyWRp7eP7bvWLPEGoXjhV8EgAHFh8Js3psgV3z z46w== X-Gm-Message-State: ANoB5pkuFJRwVD7yO6lvHdujZFgmG8hO077jmkDQxagH9eziHy8vAauv /Qkzop9cHZEvV/PSFcwbpZCH0wDic6J7RsByKwgyi06m53LVi4E8mOeRdrZUoYoLfGHi5ddWjET oFMPUCXx3VLI= X-Received: by 2002:a05:620a:8c9:b0:6ec:6d36:74f7 with SMTP id z9-20020a05620a08c900b006ec6d3674f7mr2323627qkz.718.1669042628463; Mon, 21 Nov 2022 06:57:08 -0800 (PST) X-Google-Smtp-Source: AA0mqf6ObOJL+UEY7TEBcrrgffzRGgOse6/llgNXLuMrf9tRXu7qJt16HUSKgBMtuO6xSU7iHdjjqA== X-Received: by 2002:a05:620a:8c9:b0:6ec:6d36:74f7 with SMTP id z9-20020a05620a08c900b006ec6d3674f7mr2323594qkz.718.1669042628197; Mon, 21 Nov 2022 06:57:08 -0800 (PST) Received: from x1n (bras-base-aurron9127w-grc-46-70-31-27-79.dsl.bell.ca. [70.31.27.79]) by smtp.gmail.com with ESMTPSA id j6-20020a05620a410600b006fa2dde9db8sm8402000qko.95.2022.11.21.06.57.07 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 21 Nov 2022 06:57:07 -0800 (PST) Date: Mon, 21 Nov 2022 09:57:06 -0500 From: Peter Xu To: Raghavendra K T Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Hugh Dickins , "Kirill A . Shutemov" , Alistair Popple , Andrea Arcangeli , Minchan Kim , Andrew Morton , David Hildenbrand , Andi Kleen , Nadav Amit , Huang Ying , Vlastimil Babka Subject: Re: [PATCH v4 0/7] mm: Remember a/d bits for migration entries Message-ID: References: <20220811161331.37055-1-peterx@redhat.com> MIME-Version: 1.0 In-Reply-To: X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8 Content-Disposition: inline ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=KcJucgYq; spf=pass (imf29.hostedemail.com: domain of peterx@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=peterx@redhat.com; dmarc=pass (policy=none) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1669042632; a=rsa-sha256; cv=none; b=4+pMq0OMnYuszGIc7wsVej2/tjDf+rsCsHOIlWsAo9vdTC+yS75+vqkEpNNHSuRZqy9mnX IjSiftmAys8y6TeWPl+GAeKJS4D3sOyDPZxQvnJmmNnoWO4/BMc7hhcLU9ZHtJmP6Nw1g5 6Xo1D+8esO8wAL+H5J8PQUzKTB5qF74= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1669042632; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=YKhtto51BkO/qqsyDgdGypNLsOVsCRpQ1auwp3TLJ1I=; b=4rDXm36hKWPF03MUDvFrA2n+Slf9jnWgC/SjxkV2WhHmWsG/X6DkpR4W8cwvWDuNk3D9Tl JpL875tvfIeBfHL/mU2/gJ3kaNT9uapduGta/LvDPiva1mkGsJkVV0MPT2HjHPC5BRlpFV QXtnL4w3uHKd8Oh+BfxQdCHm11A1Dsc= X-Rspamd-Queue-Id: 40E3D120011 X-Rspam-User: Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=KcJucgYq; spf=pass (imf29.hostedemail.com: domain of peterx@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=peterx@redhat.com; dmarc=pass (policy=none) header.from=redhat.com X-Rspamd-Server: rspam06 X-Stat-Signature: 5tutew89qzruncz7inqgymsskydierzd X-HE-Tag: 1669042632-576664 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi, Raghavendra, On Mon, Nov 21, 2022 at 10:45:45AM +0530, Raghavendra K T wrote: > I was able to test on AMD EPYC 64 core 2 numa node (Milan) 3.72 GHz clocked > system > > am seeing the similar improvement for the test mentioned above (swap-young) > > base: (6.0) > -------------- > Write (node 0) took 562202 (us) > Read (node 0) took 7790 (us) > Move to node 1 took 474876(us) > Move to node 0 took 642805(us) > Read (node 0) took 81364 (us) > Write (node 0) took 12887 (us) > Read (node 0) took 5202 (us) > Write (node 0) took 4533 (us) > Read (node 0) took 5229 (us) > Write (node 0) took 4558 (us) > Read (node 0) took 5198 (us) > Write (node 0) took 4551 (us) > Read (node 0) took 5218 (us) > Write (node 0) took 4534 (us) > > patched > ------------- > Write (node 0) took 250232 (us) > Read (node 0) took 3262 (us) > Move to node 1 took 640636(us) > Move to node 0 took 449051(us) > Read (node 0) took 2966 (us) > Write (node 0) took 2720 (us) > Read (node 0) took 2891 (us) > Write (node 0) took 2560 (us) > Read (node 0) took 2899 (us) > Write (node 0) took 2568 (us) > Read (node 0) took 2890 (us) > Write (node 0) took 2568 (us) > Read (node 0) took 2897 (us) > Write (node 0) took 2563 (us) > > Please feel free to add FWIW > Tested-by: Raghavendra K T The series has already landed v6.1-rc1 so it should be a bit late to apply the tested-by tag, but still thanks a lot for your tests and upate! It seems the mem size is different for the two rounds of test as even the initial write differs in time, but I think that still explains the difference because what matters is the first read/write after migration, and that can be compared with the 2nd/3rd/... reads/writes afterwards. Side note: there's actually one tiny thing got removed from the series on handling dirty bit of thp split (434e3d15d92b), but it seems there's hope we cound have found the root issue of the issues on sparc64 and loongarch so we may have chance to re-apply them. -- Peter Xu