From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C2B07C87FD3 for ; Mon, 4 Aug 2025 07:48:24 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 63B596B008C; Mon, 4 Aug 2025 03:48:24 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 612CE6B0092; Mon, 4 Aug 2025 03:48:24 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 501DD6B0093; Mon, 4 Aug 2025 03:48:24 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0017.hostedemail.com [216.40.44.17]) by kanga.kvack.org (Postfix) with ESMTP id 3C8996B008C for ; Mon, 4 Aug 2025 03:48:24 -0400 (EDT) Received: from smtpin03.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id D9BBE1410A2 for ; Mon, 4 Aug 2025 07:48:23 +0000 (UTC) X-FDA: 83738297286.03.1DABECA Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by imf15.hostedemail.com (Postfix) with ESMTP id 5F2E4A0012 for ; Mon, 4 Aug 2025 07:48:21 +0000 (UTC) Authentication-Results: imf15.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Iel10p1o; dmarc=pass (policy=quarantine) header.from=redhat.com; spf=pass (imf15.hostedemail.com: domain of david@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=david@redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1754293701; a=rsa-sha256; cv=none; b=1DS2RCcHbNE+Vzo7t9g/MSpwi56yuInQm9R87wexee6RR46K1hseHwK9qOE/cylxlNJlQL IYPCwHQziT96v63H0Xe5MZWuZspXo/DH3FL+1B8OT2Ps81uCd1O5R4UWK+tCX2ZGHK/YtR aohzDr/711G5ZwkVMhSa/kIK7o7E5Rs= ARC-Authentication-Results: i=1; imf15.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Iel10p1o; dmarc=pass (policy=quarantine) header.from=redhat.com; spf=pass (imf15.hostedemail.com: domain of david@redhat.com designates 170.10.133.124 as permitted sender) smtp.mailfrom=david@redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1754293701; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=CI9V5tQa/vNbUREhWfZQik4IRoDBf2O57MsxRr5DRVg=; b=CKiXMm0Ire/ZZYklaOhhgDaZME2mLu+bR5GhgTuipaceWJx+zENbCZhGhtuk6+QjvRTYnH gpbR6+OQBBG4F8abRlRbrbxC9tNf+HCi0h4VkcyZnhu8i+nQb10czyRSBFcVBZi53ldk78 eEoc4vmVPXC+dj/WP44EVKdb3U7Agqo= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1754293700; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:autocrypt:autocrypt; bh=CI9V5tQa/vNbUREhWfZQik4IRoDBf2O57MsxRr5DRVg=; b=Iel10p1onG9IKL0ziCw46XxvYcGzz1jKn39/op41Tp1SIcxpni3jPoYNWXuQnn8rmSWKsA 0wZk3TzYKgYDUK8te2Of2TO+CV36l4nbX1zOk3yLOcMMHHrhnbhCtauUTCxyLRu13jgUOY P1wHO2Q6AyrfupLIYl1HzM5mh/DR4WY= Received: from mail-wr1-f69.google.com (mail-wr1-f69.google.com [209.85.221.69]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-92-eOmEtq_RPmSfHNASKZ6Lfg-1; Mon, 04 Aug 2025 03:48:19 -0400 X-MC-Unique: eOmEtq_RPmSfHNASKZ6Lfg-1 X-Mimecast-MFC-AGG-ID: eOmEtq_RPmSfHNASKZ6Lfg_1754293698 Received: by mail-wr1-f69.google.com with SMTP id ffacd0b85a97d-3b793f76a46so3133100f8f.2 for ; Mon, 04 Aug 2025 00:48:19 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1754293698; x=1754898498; h=content-transfer-encoding:in-reply-to:organization:autocrypt :content-language:from:references:cc:to:subject:user-agent :mime-version:date:message-id:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=CI9V5tQa/vNbUREhWfZQik4IRoDBf2O57MsxRr5DRVg=; b=xBgvM+TRcrnkTWWGAFpiGDMDI6MRr/x9SkyFAtVMKbNwzM5hoG4HyJnJi9KvoVkoOY 9y0mYhlXOFG2GRo9PRo5FvLcpMZMKHw3Z5Y5BCa4zIWk/3dwOKxy526WcknefoFHEyKb wRhs637QPtWqC83xfW4PqMXKDR2AMocnigdu7hKhVT6iMx9YAOHUPCh4/v4X+2OJyMBP rpsK/ZIippWQlxurims1yHbLn+Cbg3lHP+5mVDoiX/3RWDNmEVI9G2Bj7f7iuU7We//k cTz9bPT5z40SXX48ixJQjr8R2rBT/gPFGBHK1+4sAI3yVmuPDtIQTUx1Q3n8/Z7M2m+X w9VQ== X-Forwarded-Encrypted: i=1; AJvYcCX/ATEtA83TMFglzoPJ3lFA+o/T3VBq0jRYs4uK2PSnCGl38J6Y9akTCw5ENkJVmg0ogqv6C65wLg==@kvack.org X-Gm-Message-State: AOJu0Yy9DG7IP0fq1SCTMuPTdjKG/v42JqyWDLKSwCebmA6VJ6yk2ANg /ENysxzXsUMAtcFedgggs3psq9Udg+xsztdUHMg6RSBX6y7YQbCkfvXiefAI7ze83pd5mkfTgm8 UyXqMaPHLyztz2wEj2zUAZl4K5m2buaEjpXKruXYuNuCH9MuPicto X-Gm-Gg: ASbGncu8m1zSZDe9n9qs3MYr8Pz00VXvPFbM7kjDPyuEFVEoy0/+MzOftJWy+nAhkRo oDeAsDVVo9NfaQEWoh60Qz6qSpEn0mwXHcPGKp8BKRB60MEePOLZ6vM170Uq2Kk/QGSPKJVNrr4 YknuYyvj6RA0k1Zmc0XfXwEQNBuoEIVprAn+PyJapxcSQbdI9XPBak2OQiW2xmNEwkdHvSVhq4x WBb0xL9Xt4IonKJY/m+9aroObOWLC90qjIYYzevEvcjg97e9oq849YIbEGV0zKmVAyTS+i3K/jE 05S4LS/jVdVIcUgddiG3W+VL6EuFumGGJshmLzwY9NezGH6KkyKyh7NTxz5/Zw2o5ga3RUia7r+ j9Ai4RGtmXKJEPmlrDDlhivObNF5lr1ompLd6YPWEX3mzeDqZbrH2LfkQICKJN36Oobc= X-Received: by 2002:a05:6000:2884:b0:3b7:90f3:cd8a with SMTP id ffacd0b85a97d-3b8d94c4a53mr6034029f8f.49.1754293698081; Mon, 04 Aug 2025 00:48:18 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGfYT0lcXyX08bXfIENSYopKSKAxiPsmMGCtLCADlyGZAB/nU3jxTIAQ+97SAdwL4HDWRlAbw== X-Received: by 2002:a05:6000:2884:b0:3b7:90f3:cd8a with SMTP id ffacd0b85a97d-3b8d94c4a53mr6034010f8f.49.1754293697653; Mon, 04 Aug 2025 00:48:17 -0700 (PDT) Received: from ?IPV6:2003:d8:2f0e:2c00:d6bb:8859:fbbc:b8a9? (p200300d82f0e2c00d6bb8859fbbcb8a9.dip0.t-ipconnect.de. [2003:d8:2f0e:2c00:d6bb:8859:fbbc:b8a9]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-3b79c3b95f4sm14512834f8f.23.2025.08.04.00.48.15 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 04 Aug 2025 00:48:17 -0700 (PDT) Message-ID: <16c98fa8-e85c-4aa2-bf53-ba070833661c@redhat.com> Date: Mon, 4 Aug 2025 09:48:15 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2 1/5] mm/hmm: HMM API to enable P2P DMA for device private pages To: Jason Gunthorpe Cc: Alistair Popple , Matthew Wilcox , Yonatan Maman , =?UTF-8?B?SsOpcsO0bWUgR2xpc3Nl?= , Andrew Morton , Leon Romanovsky , Lyude Paul , Danilo Krummrich , David Airlie , Simona Vetter , Ben Skeggs , Michael Guralnik , Or Har-Toov , Daisuke Matsuda , Shay Drory , linux-mm@kvack.org, linux-rdma@vger.kernel.org, dri-devel@lists.freedesktop.org, nouveau@lists.freedesktop.org, linux-kernel@vger.kernel.org, Gal Shalom References: <20250718144442.GG2206214@ziepe.ca> <7lvduvov3rvfsgixbkyyinnzz3plpp3szxam46ccgjmh6v5d7q@zoz4k723vs3d> <20250801164058.GD26511@ziepe.ca> <20250801165749.GF26511@ziepe.ca> From: David Hildenbrand Autocrypt: addr=david@redhat.com; keydata= xsFNBFXLn5EBEAC+zYvAFJxCBY9Tr1xZgcESmxVNI/0ffzE/ZQOiHJl6mGkmA1R7/uUpiCjJ dBrn+lhhOYjjNefFQou6478faXE6o2AhmebqT4KiQoUQFV4R7y1KMEKoSyy8hQaK1umALTdL QZLQMzNE74ap+GDK0wnacPQFpcG1AE9RMq3aeErY5tujekBS32jfC/7AnH7I0v1v1TbbK3Gp XNeiN4QroO+5qaSr0ID2sz5jtBLRb15RMre27E1ImpaIv2Jw8NJgW0k/D1RyKCwaTsgRdwuK Kx/Y91XuSBdz0uOyU/S8kM1+ag0wvsGlpBVxRR/xw/E8M7TEwuCZQArqqTCmkG6HGcXFT0V9 PXFNNgV5jXMQRwU0O/ztJIQqsE5LsUomE//bLwzj9IVsaQpKDqW6TAPjcdBDPLHvriq7kGjt WhVhdl0qEYB8lkBEU7V2Yb+SYhmhpDrti9Fq1EsmhiHSkxJcGREoMK/63r9WLZYI3+4W2rAc UucZa4OT27U5ZISjNg3Ev0rxU5UH2/pT4wJCfxwocmqaRr6UYmrtZmND89X0KigoFD/XSeVv jwBRNjPAubK9/k5NoRrYqztM9W6sJqrH8+UWZ1Idd/DdmogJh0gNC0+N42Za9yBRURfIdKSb B3JfpUqcWwE7vUaYrHG1nw54pLUoPG6sAA7Mehl3nd4pZUALHwARAQABzSREYXZpZCBIaWxk ZW5icmFuZCA8ZGF2aWRAcmVkaGF0LmNvbT7CwZgEEwEIAEICGwMGCwkIBwMCBhUIAgkKCwQW AgMBAh4BAheAAhkBFiEEG9nKrXNcTDpGDfzKTd4Q9wD/g1oFAmgsLPQFCRvGjuMACgkQTd4Q 9wD/g1o0bxAAqYC7gTyGj5rZwvy1VesF6YoQncH0yI79lvXUYOX+Nngko4v4dTlOQvrd/vhb 02e9FtpA1CxgwdgIPFKIuXvdSyXAp0xXuIuRPQYbgNriQFkaBlHe9mSf8O09J3SCVa/5ezKM OLW/OONSV/Fr2VI1wxAYj3/Rb+U6rpzqIQ3Uh/5Rjmla6pTl7Z9/o1zKlVOX1SxVGSrlXhqt kwdbjdj/csSzoAbUF/duDuhyEl11/xStm/lBMzVuf3ZhV5SSgLAflLBo4l6mR5RolpPv5wad GpYS/hm7HsmEA0PBAPNb5DvZQ7vNaX23FlgylSXyv72UVsObHsu6pT4sfoxvJ5nJxvzGi69U s1uryvlAfS6E+D5ULrV35taTwSpcBAh0/RqRbV0mTc57vvAoXofBDcs3Z30IReFS34QSpjvl Hxbe7itHGuuhEVM1qmq2U72ezOQ7MzADbwCtn+yGeISQqeFn9QMAZVAkXsc9Wp0SW/WQKb76 FkSRalBZcc2vXM0VqhFVzTb6iNqYXqVKyuPKwhBunhTt6XnIfhpRgqveCPNIasSX05VQR6/a OBHZX3seTikp7A1z9iZIsdtJxB88dGkpeMj6qJ5RLzUsPUVPodEcz1B5aTEbYK6428H8MeLq NFPwmknOlDzQNC6RND8Ez7YEhzqvw7263MojcmmPcLelYbfOwU0EVcufkQEQAOfX3n0g0fZz Bgm/S2zF/kxQKCEKP8ID+Vz8sy2GpDvveBq4H2Y34XWsT1zLJdvqPI4af4ZSMxuerWjXbVWb T6d4odQIG0fKx4F8NccDqbgHeZRNajXeeJ3R7gAzvWvQNLz4piHrO/B4tf8svmRBL0ZB5P5A 2uhdwLU3NZuK22zpNn4is87BPWF8HhY0L5fafgDMOqnf4guJVJPYNPhUFzXUbPqOKOkL8ojk CXxkOFHAbjstSK5Ca3fKquY3rdX3DNo+EL7FvAiw1mUtS+5GeYE+RMnDCsVFm/C7kY8c2d0G NWkB9pJM5+mnIoFNxy7YBcldYATVeOHoY4LyaUWNnAvFYWp08dHWfZo9WCiJMuTfgtH9tc75 7QanMVdPt6fDK8UUXIBLQ2TWr/sQKE9xtFuEmoQGlE1l6bGaDnnMLcYu+Asp3kDT0w4zYGsx 5r6XQVRH4+5N6eHZiaeYtFOujp5n+pjBaQK7wUUjDilPQ5QMzIuCL4YjVoylWiBNknvQWBXS lQCWmavOT9sttGQXdPCC5ynI+1ymZC1ORZKANLnRAb0NH/UCzcsstw2TAkFnMEbo9Zu9w7Kv AxBQXWeXhJI9XQssfrf4Gusdqx8nPEpfOqCtbbwJMATbHyqLt7/oz/5deGuwxgb65pWIzufa N7eop7uh+6bezi+rugUI+w6DABEBAAHCwXwEGAEIACYCGwwWIQQb2cqtc1xMOkYN/MpN3hD3 AP+DWgUCaCwtJQUJG8aPFAAKCRBN3hD3AP+DWlDnD/4k2TW+HyOOOePVm23F5HOhNNd7nNv3 Vq2cLcW1DteHUdxMO0X+zqrKDHI5hgnE/E2QH9jyV8mB8l/ndElobciaJcbl1cM43vVzPIWn 01vW62oxUNtEvzLLxGLPTrnMxWdZgxr7ACCWKUnMGE2E8eca0cT2pnIJoQRz242xqe/nYxBB /BAK+dsxHIfcQzl88G83oaO7vb7s/cWMYRKOg+WIgp0MJ8DO2IU5JmUtyJB+V3YzzM4cMic3 bNn8nHjTWw/9+QQ5vg3TXHZ5XMu9mtfw2La3bHJ6AybL0DvEkdGxk6YHqJVEukciLMWDWqQQ RtbBhqcprgUxipNvdn9KwNpGciM+hNtM9kf9gt0fjv79l/FiSw6KbCPX9b636GzgNy0Ev2UV m00EtcpRXXMlEpbP4V947ufWVK2Mz7RFUfU4+ETDd1scMQDHzrXItryHLZWhopPI4Z+ps0rB CQHfSpl+wG4XbJJu1D8/Ww3FsO42TMFrNr2/cmqwuUZ0a0uxrpkNYrsGjkEu7a+9MheyTzcm vyU2knz5/stkTN2LKz5REqOe24oRnypjpAfaoxRYXs+F8wml519InWlwCra49IUSxD1hXPxO WBe5lqcozu9LpNDH/brVSzHCSb7vjNGvvSVESDuoiHK8gNlf0v+epy5WYd7CGAgODPvDShGN g3eXuA== Organization: Red Hat In-Reply-To: <20250801165749.GF26511@ziepe.ca> X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: UnXz-houPoQRjdk4n7AaYiobR38nuSlP9lLwIAi-afc_1754293698 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Stat-Signature: m5fbmipjoszkmmt85eqoaewzf8hdmsnn X-Rspam-User: X-Rspamd-Queue-Id: 5F2E4A0012 X-Rspamd-Server: rspam02 X-HE-Tag: 1754293701-799831 X-HE-Meta: U2FsdGVkX19xKSSjAlDBhyaFQxR10jvDSbm9Vp20r2XOKlnv9a9BLMuNV1G7yAhBWiYL168w1WKONh52ZMfsYfibvP0wTHhWUjJ71NUuwoDCPStfQFTPkdetT6xG+tE1xub38KLlBmefigTEIh9mTCa5rGxhDNY8VhOWDBJh4XbqVIJg8UkJRt0qEXkJP2GdUr7gamE95hs4qjvWleKDFDDzTOKpMPKhWVtAspCJI0t1eaNmR53Wa2N4SHLWWd5Pm89kFhXXWM+HFOmHdpdLT4KhF5f5kovvPeXe+TEvjAYVQBIWeuxk3wiSctzsXDDI8JeOIhSDqa+NXYqq5WLIw1ytLch7UEyqzlrevKbdrGuXDENRJUsHE/D6uOUIIj1/8p6k1hOutDihXBLsSs/OceWxWcnPGccmjAMYlS9W5aX7ftsk0gXBTYqY3cmI6ItrRd2rQpZV2OGS6uVWVniW9MNBTHkAjmgVvRdgKoFtN0xIHdwd6RwYDD9cpJel/qtEcWXwfjvQXkW3rzsWNziFC5mAAKXwfP1cA6OUWswpinYQvh1pBd/SyhdyhJg+/Y+etJedf+aY6g3PPxIDPS9BNzP7Ugd3P+yd5iqPAYrSSOpYoPFDfEaPz2YdCxQEFbkzmRTW1BoiPOcaaHer7Sb2gK6YCsWsfzuKp2Kg3+7EOqQ2HCHjFMXo30YUIRktWivOuxRC3UOEIrsVpRpbwFdv7dzf2LH408pRDju6fjoDh7TPAgKQqpnDeB3dsXSh0MUT1i95NMvWJDNxqkJfBlHaBRFm/j+KoNM7sbfOxK1jg/7Ww5HLWETASq16piZnjrzh/66bxm8HbmeZpltGU1Ld2i7Myc8xI2MiVcQGMBNox7nVCDtvfumnEpcfdHuckoEOkhhADzdQkl6dYWn2W8uWdhx2gz2ZV2YWvyd0zi64Cs4i20HyPqtgU1ZpB3T8fiBaEfjoohAEhKXLUzOx50x LBgXUXHk J1Y2BUI4/TWd7+eEcBG0BYNe4U1ozUAvm/vIO4S4Zl6L5DrwHcpYZkOQcQNayKo/bQJipNYFSdGsRgZ5meDq208dTkAR9eGq0D+Ra5NVl83o3VBqTNgpxQFNfasVb50oblBLBibxCt0Bg8nmcdPvW7+5pAkarmHtqCZi03e2+emDKDXwS/DQ3+ZgN9bKcSnSh6u2IKWPJIgmj7fS9d+l96vLj5QO/qyV7fDk642uBNMr1ek7+dvz7wBQz/76JcVNuU+BrYmgUkMx/YXU3yQmOPzXbRRGtXmPvIPhNOG+o5uA+Nv9onQQ450C72zVAQEPSbDNnfU9xYtqbBqUKHU3iBgiWoegJmrgeayB/2mEk/xTaf2nVOe+NqGrPIvKyR1iHe/buze0Ti2QWz9KmHUyVK8UIkq1RTFxzzccU+/WHd7dfZvJp2EAs5tMC+HkkP2X+QWrttaF6gBjKxz3AWDzjLyldGw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 01.08.25 18:57, Jason Gunthorpe wrote: > On Fri, Aug 01, 2025 at 06:50:18PM +0200, David Hildenbrand wrote: >> On 01.08.25 18:40, Jason Gunthorpe wrote: >>> On Fri, Jul 25, 2025 at 10:31:25AM +1000, Alistair Popple wrote: >>> >>>> The only issue would be if there were generic code paths that somehow have a >>>> raw pfn obtained from neither a page-table walk or struct page. My assumption >>>> (yet to be proven/tested) is that these paths don't exist. >>> >>> hmm does it, it encodes the device private into a pfn and expects the >>> caller to do pfn to page. >>> >>> This isn't set in stone and could be changed.. >>> >>> But broadly, you'd want to entirely eliminate the ability to go from >>> pfn to device private or from device private to pfn. >>> >>> Instead you'd want to work on some (space #, space index) tuple, maybe >>> encoded in a pfn_t, but absolutely and typesafely distinct. Each >>> driver gets its own 0 based space for device private information, the >>> space is effectively the pgmap. >>> >>> And if you do this, maybe we don't need struct page (I mean the type!) >>> backing device memory at all.... Which would be a very worthwhile >>> project. >>> >>> Do we ever even use anything in the device private struct page? Do we >>> refcount it? >> >> ref-counted and map-counted ... > > Hm, so it would turn into another struct page split up where we get > ourselves a struct device_private and change all the places touching > its refcount and mapcount to use the new type. We're already working with folios in all cases where we modify either refcount or mapcount IIUC. The rmap handling (try to migrate, soon folio splitting) currently depends on the mapcount. Not sure how that will all look like without a ... struct folio / struct page. -- Cheers, David / dhildenb