From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CB4C0EE49A5 for ; Mon, 21 Aug 2023 09:05:42 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 2BDFA8D0008; Mon, 21 Aug 2023 05:05:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 248198D0001; Mon, 21 Aug 2023 05:05:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 09AF78D0008; Mon, 21 Aug 2023 05:05:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id E70EE8D0001 for ; Mon, 21 Aug 2023 05:05:41 -0400 (EDT) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id B6A82409E8 for ; Mon, 21 Aug 2023 09:05:41 +0000 (UTC) X-FDA: 81147528882.07.A02523D Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2056.outbound.protection.outlook.com [40.107.243.56]) by imf30.hostedemail.com (Postfix) with ESMTP id E7F778000E for ; Mon, 21 Aug 2023 09:05:38 +0000 (UTC) Authentication-Results: imf30.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=Fjs2s81I; spf=pass (imf30.hostedemail.com: domain of apopple@nvidia.com designates 40.107.243.56 as permitted sender) smtp.mailfrom=apopple@nvidia.com; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1692608739; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=0xyI8hsorToWOTWGMrK4/iiXa2KDML5RIksR5cGfz3Y=; b=PeEDcFAHQ17+KYF5h02fdnQknNsExWLkBS+YOrq2CazfX9wpD+hQZndKrCIzo4K2AyGXmv 141tCvZ4IqtHNOx2n16mYQhHGMx8klw64TGnozcrDzBsU9Cq+DzNN3D+wcQDvGFseB3g1O nEP1NfD/ADUkVKZB3Zw3TLrJLNhEppM= ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1692608739; a=rsa-sha256; cv=pass; b=E2DwMKSCvyQh3EiQj43he6NY3Adafs+XkEoD6DyQTc9hpaoumI01bmd+coLiKnHH03fNTH GFL54jUtWV9OC8yA0lwYpQCij+lglrD9DRqzVO750TjQtGBvDftpd2kxwEsG3iJIRv5HFz 2VNwe2TUO4842MqItsEx9TZXdQDo9o4= ARC-Authentication-Results: i=2; imf30.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=Fjs2s81I; spf=pass (imf30.hostedemail.com: domain of apopple@nvidia.com designates 40.107.243.56 as permitted sender) smtp.mailfrom=apopple@nvidia.com; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1") ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fY1AcVSAnkT3v49vD4Px74i4xkGwOe1XMGkT7wVwudfp7pOqEOQg0/X8EyHER/VbmfgYsV7WLuH7iOOdHmgLs2Q6NNzw9Sxs0/PMib9ylI10VtnLKE8dkeUKzFtqIdJqUPk1sY4u/2lzQkR4FkT0j4MzfPOPlZjfsmHbSHduQ02wLC6cFNyU+/Tm79RmMlf8FxkiYSOnIWJXSB061owKxQTlvZOU/OdKPzTpM8p7PHvhit7zjmzokrshXmLSUN52EdRysaD92XrriHzlxKAeQT9Eoy3prA7IVILuyob+8qq3gP8oAbTJd8FcTDfEuiwwRPx2lcpaScHk0Ni323NTlw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=0xyI8hsorToWOTWGMrK4/iiXa2KDML5RIksR5cGfz3Y=; b=U5TZ2IZyXUxmr95ozuza8JSIwAnEDiMRRhN+y+NRJFyW3fdr7jC/dt4clrsPNZP97wEV7KR6jY5BZpRBIGlYVc9MBcnSCxuhUTIyDrsCAZkmpquFGPYhxC/tW0pvw5wUas9yB0Sd8BjU2CMxiAs0MZRAiwodhn5ySXvyFIOPNzJg0QhLPRIhymb+tKz3RSQgEj3ATBDVunJgx7QIHqnHtOds6n0uHz4JxEmiXF0swRDMwIBPyGRDi5vISy0rdmwNXuBcVIkesfKxTJXTHEEMq29V0ubW7bGIj05WNoMb8e0ECuDQDth6lUcVsFjKmHx1V0h6IkXY2yvFxfSlKYEbHA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0xyI8hsorToWOTWGMrK4/iiXa2KDML5RIksR5cGfz3Y=; b=Fjs2s81IVwBc9GVLCeU2dbZVwG01JHkqtInQUlMvhWwW6iw7yz1p59XeD5uN2MedNtEvu7lZn6uHzkIeGXg3RV0aCGvGuKjzbqX0CtjXAgOfImFGBH/4cPzkOiQiZ2IVb0hkPpwLahpAcozd20buFVGXzfsNkOETQI0tIhjCu9eSlLUDYtK/YNrEjQmbUZUfLNWvPMfj1fEo+Wn1JJ/dyfo9BqEDuVR2gm4Tz9ccUXfi45K5q3B6I/20TE0KOeObqgs826R4Nnl8+aPz1LeRyUmdXRGl9zjZBSg4Ox7zkPghfAQOdZhlcXUQBOYxOUgzFsTfqWEuc3LEWgShmcChkA== Received: from BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) by CH3PR12MB8481.namprd12.prod.outlook.com (2603:10b6:610:157::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6699.24; Mon, 21 Aug 2023 09:05:36 +0000 Received: from BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::3bf6:11f3:64d7:2475]) by BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::3bf6:11f3:64d7:2475%7]) with mapi id 15.20.6699.022; Mon, 21 Aug 2023 09:05:36 +0000 References: <3427735b-2a73-2df7-ebd9-0d1066a55771@redhat.com> <2aee6681-f756-9ace-74d8-2f1e1e7b3ae6@redhat.com> <87cz0364kx.fsf@nvdebian.thelocal> User-agent: mu4e 1.8.13; emacs 28.2 From: Alistair Popple To: "Kasireddy, Vivek" Cc: Jason Gunthorpe , David Hildenbrand , "Kim, Dongwon" , "Chang, Junxiao" , "dri-devel@lists.freedesktop.org" , Hugh Dickins , Peter Xu , "linux-mm@kvack.org" , Gerd Hoffmann , Mike Kravetz Subject: Re: [RFC v1 1/3] mm/mmu_notifier: Add a new notifier for mapping updates (new pages) Date: Mon, 21 Aug 2023 19:02:28 +1000 In-reply-to: Message-ID: <87h6oswysm.fsf@nvdebian.thelocal> Content-Type: text/plain X-ClientProxiedBy: SYAPR01CA0030.ausprd01.prod.outlook.com (2603:10c6:1:1::18) To BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BYAPR12MB3176:EE_|CH3PR12MB8481:EE_ X-MS-Office365-Filtering-Correlation-Id: 070f403e-5163-47da-c73f-08dba225c822 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 0R6ap5iTBQo7X5pgZzMNR3N5KZOCyNEQAMvHK3MZMFayN7vkwfnA2drlGnqokm555sMML7qs42Lj8kReXZ3CJwWD6QNDZdRHXq/adsYZuWcrrggGhqXQ26d6O4EBm+nlbkt0KJcyMtceCy859grWmZXAetlGf8N7edS/pEfmofRPZTRN91MByye981FeTPXtIJ9aANGTmzQMg1SPfxDWpQWNen+IvBD3x7Z8CHtsckvz7m0U6hwolV7RZQQRsH1G9eMwVw3uDVJ08xdJn/iMRTNEA/PG7N93yz4eqCio6SH5igJ5R25rkq4GEO/mAbsvMfu8Gb1oNFj/tV0T+vwFR0Z3EJwvDurdVYTAjbBXMsw3knpU+t8WUbu932tZKWRKNSPNEaYVtH6RyQyL5s2hCpBfio+QVZcQ7j7QRgAjKOJFTTB1w8c6DoG9aR0HJItXOx1J+L2GgD4Ao/ET0PGxSf9rgWep7RLgnUvTrOhC2UqTqGtvbepEpVMVsG1qPf/iNrhoM7zQ591J1S7lPUPXqvUXNaNKq5VfOkhcpezpy/itFHRi1rYyg+E5Lyr1iYwY X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR12MB3176.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(39860400002)(366004)(346002)(136003)(396003)(376002)(451199024)(186009)(1800799009)(2906002)(83380400001)(7416002)(38100700002)(6506007)(6486002)(15650500001)(5660300002)(26005)(86362001)(8676002)(8936002)(4326008)(316002)(9686003)(6512007)(66946007)(6916009)(54906003)(66556008)(66476007)(478600001)(6666004)(41300700001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?Pxr3Hnelp/PegbnSETZbks0D1W3smH/nyVcr/iA2leX9dsh2PaxlDm7OTAB5?= =?us-ascii?Q?Kelk1024mgUonJQcEL6H9+EyM0zOsYmnkw0f1UDL1VFzj0am5sFmU2oy3Acg?= =?us-ascii?Q?WWS/zRMN48A7IxcP0pivXdFZXjLW2SRxZ3+bJ/dLcFYcaAHztMo6SPS5+0o3?= =?us-ascii?Q?zv3+PicRQ3LyoPYPGtJSrDtkqUE8OvI201C9ues8gHRyvKjs8+DUkOBUrKY3?= =?us-ascii?Q?qmo8hbYPRor2wnPORWA2/s36wdC3vlujm55/bfGKmDuf8IrLcCaR861GsFEY?= =?us-ascii?Q?UFU2fymgZJEO/sg8oBMSIlxbt/Nw0UQ1RFVj+n/jPwcpFOMyi6tcjAKQAo7l?= =?us-ascii?Q?bzejmRKd3ocoFtAHKMNbzJTPbAlq4D9wyIN3upYMWca6B/zeyEUkmqMk9dCI?= =?us-ascii?Q?rMcCv60dXKPv3GRHvejedbceoQVX6yseW1LQYOFTxmRIdR6PsVuymeMc1Psc?= =?us-ascii?Q?5x06cUgEMTz3Fy/4pNEs0UwS7XwSOt5C1y5HXhC8s0yU4PJidWx5iWdLu+bS?= =?us-ascii?Q?BWb9KyeuRLNIwVx20mS0jlUATSE1vxaIbJFHAoguM5UIaOgmkit8jyiy0XTe?= =?us-ascii?Q?s4pNLH+jOHgMDJ9IqMfpBqqu4YOkfX8CQ1qIiH/ayeSiB33bl/fjTnkdlnpE?= =?us-ascii?Q?L8jVlFT4UmwoSA0T37qauGT7Ng8AGpNRwAlAA1H0mZGhfXRR+lSByh/aVSuH?= =?us-ascii?Q?xRlPcYRVevrtt9n3joRfbC32lf9dejMNK67NXHa9vVdwRcF2Kv3e9zNLBa59?= =?us-ascii?Q?g32UyotizxgUyOBEQg1Qm66hbpvJipITfThyAHCc4s4RhosSAt2bJVETB3bm?= =?us-ascii?Q?MWp4GMGOqdGaoUE0MPYByagkELk0qusOkmpJsghBwmHFQlHfZvrRRBanJAat?= =?us-ascii?Q?n9PGyZxzu9DiPONPIzDbd1KT5V6jQQJidO3VnZGOIUdwm7n5qrrluipGzWNO?= =?us-ascii?Q?Xg51WWjA0ggk6fxVYXG3Z69pcpjrASE7+LwOxnFlrECgGpRuF3yytjWvAvvP?= =?us-ascii?Q?tsmsi2/lV3B0vdelbpFdidiG0/iQuLmq0/JeW67WjHtxAAGi/LbcZmS28JU0?= =?us-ascii?Q?ygAaHemJ0nhF8eg204/Qm2NU41ic0PZslZrZomGB8mOx31T8vrJtRlE6aS51?= =?us-ascii?Q?EweyEq/RtnwShvVX70WzEzQGl/GofhwAR8V2GCkLrTwWh4TdolwxK9dZ/z1Q?= =?us-ascii?Q?DAkGmlZobFgsSQYpaqPspyMKQCmMl8M6iDF7uAM4UIqQm+fiBduC/Y7qseB4?= =?us-ascii?Q?zzPiiOsIqDkAL79jjO3Qnu2sYuEbwumQvJXU/bOc7difVbnQZ50fVoK6wp6I?= =?us-ascii?Q?+iDg8XFC2GPQzHLTsPMKZGsGqqFYIlWqeUCt+OPjNs2sCto+b7e9UIyYIODQ?= =?us-ascii?Q?XaZXJ2JMQ7hbO2gRRV7ipn8XsQK04aIz0j74pM/p1Ksct9fPHETnx93m6STB?= =?us-ascii?Q?EQPfhMbGmu7HgDHqiTIKCmWgtBvAvyWDdB4g59OsX4NE/zzLe8a6nOt4kInv?= =?us-ascii?Q?Yinx63TKuAPahYv4ZtW4YH33HZ4CjaWeSqhCvbXn5S94KGe7AdPH+QzVn6tL?= =?us-ascii?Q?du7ugbQ9GHVziNDRNcD9G+m5MT0h5/caFaFAl7c/?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 070f403e-5163-47da-c73f-08dba225c822 X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3176.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Aug 2023 09:05:36.0199 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: EopV6KN29lpJnB8TeJf+JPUGkot/haN8exjngp0klgbAELZZ5u9qf2OuZfYkJHTNe7yup2ZCZS2ru91D9YtEMw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH3PR12MB8481 X-Rspamd-Queue-Id: E7F778000E X-Rspam-User: X-Stat-Signature: am1otft9i37rdwmeaou3upywbs77byx6 X-Rspamd-Server: rspam03 X-HE-Tag: 1692608738-513750 X-HE-Meta: U2FsdGVkX1+tSQtVbKjYAac1BERBnRP0vmtUpiR4FgFKN+RxT1P0mI4mLquwGduzhLHeIaCeVy4JAp3Qnv11XVBcIUusaGmAwGhsc79/hEn+aAU6q23mg7TD/5pP8WHQn76yWBX1peSDbCIsqyyhpfY2WeU695C8uaYItJPXwwVcdGnD1SX4TbrblipwHXipId9AtIaUuRiorj7uwdUdpITZuHa6J+BNmfioqUhS3nvIr1IlCCesXIgEx9ObEKyh46BTTdjKX3rmLcWc32WO+0sUkut2cE+3OgPd28qNS9vQ0sOCurNdNSHMrDXU2ZoxSEY+OdDux0VY0VTwOYnTeHiIM89bDofSfuYiegq26if2TAiUPMyHDFwQasa++azdwn6efgEWEh/fEcRMYXS3ttmTJGZWSAhKENcle+oU3lGhahT4X7Ixc4MX7R5oxsuXbHGpL39uQjS8EiZBWkDzC+7XPBq7ve4ch7y9rR3Dq+Y/3v3bJH1o/19c3B6TzRon+ntVGWipXkelGkxVTgcm/I9iXKT3Oh9n8XV+IduHUbyQTEJDI6b8n4R3Tj3ph/8aI2EfsQo19ZqkRvprJCKB05UQBYMDJjMIi9gGHbnDs8lylJcnyVhdCfSenMER0pGHnz0ZbiOondi+tiCXiupbPggIt/FGNOsCUXP3BGs4sjBkJ1949SCSz8pWGfaMuCKpU5MTYnszHzJmiorWMJq6OsNYBGx8NEyo8Z3QDinnz9L2xWpu3HsCr6zwsjb56+6eptH3KNJ37/tk9yZ73/FMtDt/bJX1mVI6oqOWFw9MeiELo0uO8cPUuUu+8yLRLwWHQ/f88zCdOg5i1eBnx3kJ3Bo/MCd00sZa/BbtXa1fiaiIL/M1ONjQ3WKu62UyJLQHPcRkfqIOdZjgwGhBW0466hgpi2GmoWgP4h18T0Ow819vayNDuFrVij5+tpC0SOvRsnWe+KE25xpgfi6GeW1 aasKWc3D a+MX5Ej27lZtsSzt3fZyHTHtw8Sb0Zb02twI3bzeDkG/I9bQgq1oQFVFWak9KDLAzJbu73Zd9naSQKpogvFsHjjPM6OAAjTMA/2quh+O/DRR4+/YrbYddL9wtXlNKUgSeK/b1I0nf643xp2pvyfq0d5GtjBKL3AiKut0pZqiofW8oAO+L+M29yOaV9aIdbk9jSak0AIeEJlpijCckSeEBtG0PoedcjPtrHkIeo8t3uVv40gQ= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000163, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: "Kasireddy, Vivek" writes: > Hi Jason, > >> > > >> > > > No, adding HMM_PFN_REQ_WRITE still doesn't help in fixing the issue. >> > > > Although, I do not have THP enabled (or built-in), shmem does not evict >> > > > the pages after hole punch as noted in the comment in >> shmem_fallocate(): >> > > >> > > This is the source of all your problems. >> > > >> > > Things that are mm-centric are supposed to track the VMAs and changes >> to >> > > the PTEs. If you do something in userspace and it doesn't cause the >> > > CPU page tables to change then it certainly shouldn't cause any mmu >> > > notifiers or hmm_range_fault changes. >> > I am not doing anything out of the blue in the userspace. I think the >> behavior >> > I am seeing with shmem (where an invalidation event >> (MMU_NOTIFY_CLEAR) >> > does occur because of a hole punch but the PTEs don't really get updated) >> > can arguably be considered an optimization. >> >> Your explanations don't make sense. >> >> If MMU_NOTIFER_CLEAR was sent but the PTEs were left present then: >> >> > > There should still be an invalidation notifier at some point when the >> > > CPU tables do eventually change, whenever that is. Missing that >> > > notification would be a bug. >> > I clearly do not see any notification getting triggered (from both >> shmem_fault() >> > and hugetlb_fault()) when the PTEs do get updated as the hole is refilled >> > due to writes. Are you saying that there needs to be an invalidation event >> > (MMU_NOTIFY_CLEAR?) dispatched at this point? >> >> You don't get to get shmem_fault in the first place. > What I am observing is that even after MMU_NOTIFY_CLEAR (hole punch) is sent, > hmm_range_fault() finds that the PTEs associated with the hole are still pte_present(). > I think it remains this way as long as there are reads on the hole. Once there are > writes, it triggers shmem_fault() which results in PTEs getting updated but without > any notification. Oh wait, this is shmem. The read from hmm_range_fault() (assuming you specified HMM_PFN_REQ_FAULT) will trigger shmem_fault() due to the missing PTE. Subsequent writes will just upgrade PTE permissions assuming the read didn't map them RW to begin with. If you want to actually see the hole with hmm_range_fault() don't specify HMM_PFN_REQ_FAULT (or _WRITE). >> >> If they were marked non-prsent during the CLEAR then the shadow side >> remains non-present until it gets its own fault. >> >> If they were made non-present without an invalidation then that is a >> bug. >> >> > > hmm_range_fault() is the correct API to use if you are working with >> > > notifiers. Do not hack something together using pin_user_pages. >> >> > I noticed that hmm_range_fault() does not seem to be working as expected >> > given that it gets stuck(hangs) while walking hugetlb pages. >> >> You are the first to report that, it sounds like a serious bug. Please >> try to fix it. >> >> > Regardless, as I mentioned above, the lack of notification when PTEs >> > do get updated due to writes is the crux of the issue >> > here. Therefore, AFAIU, triggering an invalidation event or some >> > other kind of notification would help in fixing this issue. >> >> You seem to be facing some kind of bug in the mm, it sounds pretty >> serious, and it almost certainly is a missing invalidation. >> >> Basically, anything that changes a PTE must eventually trigger an >> invalidation. It is illegal to change a PTE from one present value to >> another present value without invalidation notification. >> >> It is not surprising something would be missed here. > As you suggest, it looks like the root-cause of this issue is the missing > invalidation notification when the PTEs are changed from one present I don't think there's a missing invalidation here. You say you're seeing the MMU_NOTIFY_CLEAR when hole punching which is when the PTE is cleared. When else do you expect a notification? > value to another. I'd like to fix this issue eventually but I first need to > focus on addressing udmabuf page migration (out of movable zone) > and also look into the locking concerns Daniel mentioned about pairing > static and dynamic dmabuf exporters and importers. > > Thanks, > Vivek