From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9F0A9C77B70 for ; Fri, 14 Apr 2023 03:33:31 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 2D63E900004; Thu, 13 Apr 2023 23:33:31 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 28658900002; Thu, 13 Apr 2023 23:33:31 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 128FC900004; Thu, 13 Apr 2023 23:33:31 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 03353900002 for ; Thu, 13 Apr 2023 23:33:31 -0400 (EDT) Received: from smtpin27.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id ADC7C16020C for ; Fri, 14 Apr 2023 03:33:30 +0000 (UTC) X-FDA: 80678576580.27.FBDEB76 Received: from cyan.elm.relay.mailchannels.net (cyan.elm.relay.mailchannels.net [23.83.212.47]) by imf16.hostedemail.com (Postfix) with ESMTP id 44ED2180016 for ; Fri, 14 Apr 2023 03:33:28 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=stancevic.com header.s=dreamhost header.b=c7DNT7Mc; spf=pass (imf16.hostedemail.com: domain of dragan@stancevic.com designates 23.83.212.47 as permitted sender) smtp.mailfrom=dragan@stancevic.com; arc=pass ("mailchannels.net:s=arc-2022:i=1"); dmarc=none ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681443208; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=7JtTfcQBMAcxQrCiZjcisUJbs5xxsDDTkmB8dGemUsw=; b=RR8eCm21nm5Mmxx0Nv3u8nRkHGgFqIoEj41rov0JmoeRI5bmg543QGeeeTKa4r7w2x5p5I cT4PtUJBYxiCmuckJ0KVkxWP4PpupSemSG5b/mCCkgjIhhSLSNDlNq2qkVCsXKp9C3Ckrl QMwpGf0FDrvAgpr77utdqDsZe0jeWjY= ARC-Authentication-Results: i=2; imf16.hostedemail.com; dkim=pass header.d=stancevic.com header.s=dreamhost header.b=c7DNT7Mc; spf=pass (imf16.hostedemail.com: domain of dragan@stancevic.com designates 23.83.212.47 as permitted sender) smtp.mailfrom=dragan@stancevic.com; arc=pass ("mailchannels.net:s=arc-2022:i=1"); dmarc=none ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1681443208; a=rsa-sha256; cv=pass; b=ZVgOEN1R8LBdpqmDQ+JNWb15H1+p97OuN6YO1TGa6RwuQlV5BZzCd5U3sSdWZlKnclODx/ UcEF0aKrHfcAPWarYVfVH7VDmpLKo3C/+PVpD8MuC48atAE2gX8LOSbzEfCk26yyHciFUR 5wgpa+5DhQoN+M5A7fQR58dngze/hwE= X-Sender-Id: dreamhost|x-authsender|dragan@stancevic.com Received: from relay.mailchannels.net (localhost [127.0.0.1]) by relay.mailchannels.net (Postfix) with ESMTP id ECEF4541D0F; Fri, 14 Apr 2023 03:33:26 +0000 (UTC) Received: from pdx1-sub0-mail-a207.dreamhost.com (unknown [127.0.0.6]) (Authenticated sender: dreamhost) by relay.mailchannels.net (Postfix) with ESMTPA id 6DC375419D3; Fri, 14 Apr 2023 03:33:26 +0000 (UTC) ARC-Seal: i=1; s=arc-2022; d=mailchannels.net; t=1681443206; a=rsa-sha256; cv=none; b=ZGlsTIKsDSEnWtNiMCkYDWt5DD0mVP/iNV8SdU3KyRknBI/1oMcGB69H+F+H+dWWkhwH51 H1dns40vajKz2WjLeEtkTDsSDPM5/K9IAAdD/MVpI5Yzr+i0cwMTozXpfTNOGmQ3m956DQ WJH/aIR+OI6FiruQ8RN/dlmGiKpv3xajLxCWtsz5uvtsVDbcjxN8izYwgq2QzcBbmDG82P SYRvVJr50wAdlMjQ7Q4f7CFhQGyOaHjceLvPaSrbJNJc0a5rlHBccb7A2YekGbTgYiIFME SqfriZwvw06MOOqFG9+a3/BP26HtbtLwGnWnDP43I2ek8oYXMS21RwUkNU3kEA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=mailchannels.net; s=arc-2022; t=1681443206; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=7JtTfcQBMAcxQrCiZjcisUJbs5xxsDDTkmB8dGemUsw=; b=WSjvN4lhvkyyVU0Ysfz5+cBzBmGQhM9lBhTamPn1MauaX68HogrS4aIo6/ej2t1WX30z7F 5witx8Xj6w8oyPWKdir9+1Nwbc2bBfBcnykYSeJ4kohy76U2JCyq6fZ0t8R7DFm1PHuE1r WrOdv7Of+lo/qZalpjG3/zVxl102NWvCQPngyeRsu86Mn6hdsWbrQFOyNBMT5ABObtrak4 0GUlMxPf8VTG5DS8I5HLGEAlyqZ+9CXyTHbMLsQKA69tYYLBym9FN2ulCUgP2K3gyJXCCm NMRBa/+HiliEHh6mux0tvWk6JNwMMZpSNZYvHSTjSfmgaIhphhO9iGpqMLXetw== ARC-Authentication-Results: i=1; rspamd-7f66b7b68c-gmsjp; auth=pass smtp.auth=dreamhost smtp.mailfrom=dragan@stancevic.com X-Sender-Id: dreamhost|x-authsender|dragan@stancevic.com X-MC-Relay: Neutral X-MailChannels-SenderId: dreamhost|x-authsender|dragan@stancevic.com X-MailChannels-Auth-Id: dreamhost X-Squirrel-Callous: 34f136452915a007_1681443206743_857392299 X-MC-Loop-Signature: 1681443206743:3335622857 X-MC-Ingress-Time: 1681443206743 Received: from pdx1-sub0-mail-a207.dreamhost.com (pop.dreamhost.com [64.90.62.162]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384) by 100.116.217.224 (trex/6.7.2); Fri, 14 Apr 2023 03:33:26 +0000 Received: from [192.168.1.31] (99-160-136-52.lightspeed.nsvltn.sbcglobal.net [99.160.136.52]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) (Authenticated sender: dragan@stancevic.com) by pdx1-sub0-mail-a207.dreamhost.com (Postfix) with ESMTPSA id 4PyMVF4lZ8z29; Thu, 13 Apr 2023 20:33:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=stancevic.com; s=dreamhost; t=1681443206; bh=7JtTfcQBMAcxQrCiZjcisUJbs5xxsDDTkmB8dGemUsw=; h=Date:Subject:To:Cc:From:Content-Type:Content-Transfer-Encoding; b=c7DNT7Mc/UBLtUooDiAclmeyBFqiq8N31rRNv5vjdI5TBuKk/DbRt+lbIk5oJnjIW EM9A/9pQ1ExlnVMOv98jv47Uw1okRMdWt58CB52thrvciE/nCcaAY5QOsa3sGJiLvK 7T1jEAKqsOKBx2d7ik8pbVDdWwP0m9jQiWKis45kL5mfunAud6+lnNts1DZjU8PmXU l0bgIZBw5UC05sXREjAk9c40eXmI9BLA+FVciVJnj+pWAEchMzKQeuO6punyri9o5X I+DLErtG2nINVN0E4t7d+KwnQYWqP64WxKOgh+l8mgfKqAG59A/gKxb3sNg93WtBa6 +SIwvvTYUWspg== Message-ID: <4a1e74f5-284f-7bfe-6a79-42b44909ca23@stancevic.com> Date: Thu, 13 Apr 2023 22:33:24 -0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.9.0 Subject: =?UTF-8?Q?Re=3a_=5bLSF/MM/BPF_TOPIC=5d_BoF_VM_live_migration_over_C?= =?UTF-8?B?WEwgbWVtb3J54oCL?= Content-Language: en-US To: "Huang, Ying" , Gregory Price Cc: lsf-pc@lists.linux-foundation.org, nil-migration@lists.linux.dev, linux-cxl@vger.kernel.org, linux-mm@kvack.org References: <5d1156eb-02ae-a6cc-54bb-db3df3ca0597@stancevic.com> <87v8i22abl.fsf@yhuang6-desk2.ccr.corp.intel.com> From: Dragan Stancevic In-Reply-To: <87v8i22abl.fsf@yhuang6-desk2.ccr.corp.intel.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 44ED2180016 X-Stat-Signature: i3foej3ux9aipiawjjyh5m9mop9t5pcu X-HE-Tag: 1681443208-528275 X-HE-Meta: U2FsdGVkX19Hyhiy5Dcbqb/8ppJsCOQwK+nNmfFVBqPn5YigzYPSBXaTzj9KzUk1hb6qJeAnPxSM2uwYLZJ8hj87xLkxDPRaFhazLQq1P+Bj2pf8AFKnJa386Vjgl/k3eUIaGzV92bMPZ9oXmjfxszf6mStQTmdHvU9hybRiCyNkC/+HXWrl3WGzSLfC1DM1heZ0WwOITBpwDRVxCaYGyvHgsTktgTT6FpjG5ZGx0TesgIhulh0ea5eN5kAe7tM5yiHU+TAm5c7cJBU5o9V7Kj08pN2gvxa/4BCakqZW+CIm9ihbnov3dNB01egz3MWSSWIGM2h+pMGaMc3YjPEReO63MZzE5tzI87M4bmJs1ldT9ASWs0qj/Hfr/biDVew3VK2EMBZqGbnXz44p7t25lWP67OjQLl2IA978Pdn9M28bNfS3KTlBW5/HBxA4bbR6jJPk0pHhyVE7QoJeRKAYGvakO+I6N8jv7QZRLhsfAAmLBDLibdtGPUCz5yh9OFecNORe6HVffdvA+YwVXa6cy5368xT3HkYw36pJUNeXAPkCuwdqaNtpRSon6b+rBOpiMH/LeskQInQ3aNGxVIOCxvwbKRDb9TCtH2qA5JqbA3Xdbg9JzzAv2FgSTiERf0uImVAxrCNKHUB2e5RjPFSrfGtWGvbF+i01mmoJ7cZklOQd1lriZutcfkHRv6Qu5V5jHT32uvgd2KgypUj/gsJF83uI0arlhVW3yn4EyvqOqahMBeNtScSFolH6ibC/2g6Ip+Y9FDQJNsP40ncK0gUWmH7bimvSu3HHKHF1qOdk9W7bVb/J9ofmm2r1LWP/utGCp940f/G62B5kjlFc6wNpYU7OJ/VFGjkzcwV0mpfBDKeakGss52f+Kj2MhUiNOTY2ny+49LWaMfHOOyKVbJS+EFh8/3GiD5JwyTl2GvEHHXs/Hk/rf6Zse72yzR+o0G2ian7EiehdEZy3BXaLbTE MWusb7Pb mO+tRCFFD1cWCxRGjpxgbztgTPJjj86nq+nJ17TnAMr4qZT4opLiSr33eOoUPYoDqbB7lH1KXuYS0ZnLTpN+te4FCtGAvuskZWd6qEXsEU/EoHG/jejJxPQ0xuM0niutf3wcrLKaziV6VRYlpKKm5UTK2RmSBk3mvIEBqVy4f3Pp1WTd8mXT70PCvD3chlvLQSkfuQ0zMRY8tW3RWklPRwZSvRgoSCSRs/v6dSZnGqSMHYM8EezuBU+0HzUynyP0CJ5DIPZs4OknnQ5ZiFHpVBC2zvmT8Nm5wxKwKNsy8Y+x7Mjgw2DoXvI7MGvHhogXkmxAmYQElQ6U8bt3MjsXcSxmqNhGJYVdL4Pi1a/z6UY9ImLtlOjtQmGmQ/xr7go2JApyZgNy22JvwcBKuZVYAByVD8GtCJ/S6Uw8D X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 4/11/23 01:37, Huang, Ying wrote: > Gregory Price writes: > > [snip] > >> 2. During the migration process, the memory needs to be forced not to be >> migrated to another node by other means (tiering software, swap, >> etc). The obvious way of doing this would be to migrate and >> temporarily pin the page... but going back to problem #1 we see that >> ZONE_MOVABLE and Pinning are mutually exclusive. So that's >> troublesome. > > Can we use memory policy (cpusets, mbind(), set_mempolicy(), etc.) to > avoid move pages out of CXL.mem node? Now, there are gaps in tiering, > but I think it is fixable. Hmmm, I don't know about cpusets. For mbind, are you thinking something along the lines of MPOL_MF_MOVE_ALL? I guess it does have that deterministic placement, but this would have to be called from the process itself. Unlike migrate_pages which takes a pid. Same for set_mempolicy, right? I mean I guess, if some of this needs to be added into qemu it's not the end of the word... > Best Regards, > Huang, Ying > > [snip] > -- -- Peace can only come as a natural consequence of universal enlightenment -Dr. Nikola Tesla