From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 10ED2D49761 for ; Sun, 1 Dec 2024 10:38:37 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 841166B0096; Sun, 1 Dec 2024 05:38:36 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7CA556B0098; Sun, 1 Dec 2024 05:38:36 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 61B946B0099; Sun, 1 Dec 2024 05:38:36 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 444566B0096 for ; Sun, 1 Dec 2024 05:38:36 -0500 (EST) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id CD312C1799 for ; Sun, 1 Dec 2024 10:38:35 +0000 (UTC) X-FDA: 82846040634.17.BFE529B Received: from NAM10-MW2-obe.outbound.protection.outlook.com (mail-mw2nam10on2076.outbound.protection.outlook.com [40.107.94.76]) by imf24.hostedemail.com (Postfix) with ESMTP id 779941802C8 for ; Sun, 1 Dec 2024 10:38:31 +0000 (UTC) Authentication-Results: imf24.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=IDwFBfwO; spf=pass (imf24.hostedemail.com: domain of ymaman@nvidia.com designates 40.107.94.76 as permitted sender) smtp.mailfrom=ymaman@nvidia.com; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1733049503; a=rsa-sha256; cv=pass; b=SwpuKBkJN97GeTwKebBLjSbB2+QlbeB83P3Bi7ktFgjtG873hejBm6KHcLNEvJ9YjEzGXn VWQZmxEz3CwR39uYsxn5q2sGrw8RxWuq+8KBJkZA3dfyxPXyJBercvqNPtuuUXc+4/GWhf Gy2whTCgYtG6BiN77a6EkFPZ8bVkfv0= ARC-Authentication-Results: i=2; imf24.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=IDwFBfwO; spf=pass (imf24.hostedemail.com: domain of ymaman@nvidia.com designates 40.107.94.76 as permitted sender) smtp.mailfrom=ymaman@nvidia.com; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector10001:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1733049502; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Om5/P0VucjwtVSyPAahMihMrFKhMEGTpXlaDQvTox2M=; b=5Ct/MKiizuR7thGA6+H2y/BXYlEpY5S/McU1yF1iiM4ABViQVkLdYqJGZ7cQAe+HL426Rs S4dLZDxth0iG07qRx+y4/8NsrORnPYVBdhY+TUC205LKhoidjOEeJ/yEO/hHTWv4kTPIDn x5VKdbOv/ReRCkUBW/fHsjGfTfeSnrs= ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=BpK0LmS8UTBk7qNjxrWU92rXyT8/etkQJ0thpXKnTBfE93o8GUwWSVjDOIwzh1Aogu7KhlzOHmjtqvc5RyS1j6NiWWAdqasY9rJa2HIP2hNlbQvMpreinGcWq4/a7KJwhL7Vab4gWCms0KnQ0z8hjiONw8OtQGpbTVIrsAXmV3kbsmRZYsUN0mvxwF8QQE3B78l7sW0BcV7L8sN4apQmwkd6ni2SAcMqLuGXuy+QEjRf+qxluhv2UC99WKnDUjLLIrTwiJBTlbogEnM/j0YfF9/Ujt3qzO51ccOMAJQZNOW/FvM9ZjuA4HI8ZtpGQtmlwvPchZDgHaRFF2kqwVbQMg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Om5/P0VucjwtVSyPAahMihMrFKhMEGTpXlaDQvTox2M=; b=u2Jm+zm6RVSCNbKPPGpGFeLjdWDPsif5wfY88usujP89st8yort8Ienfxi2SIUCP7q9/De1YeNc8UYcZfKswJRMhyzpO6z8vJ/nj5ZANjo6sxus3K3eBbEVxK4JvKDi3qSeWR7e7pkp2ukCy5zCSg5K+CRKYNC6v7LWXuJvLNrGGtMeKG5VML5665ACuxKweDSkCl7YPWGKvJ/IC9Pi5KBdE4acm6ml+TgEMs7nAA/9qSFJiPubyBjY2JtNeNKZ0Im1FcS6C/EsuwS3OH0Hb3J6Rb5ggRcIstx2O6c7ZMA4mdLh1nnYBo25tOvs4bTfjkj5OaCpixOzpzT9QLbyxxw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.118.233) smtp.rcpttodomain=redhat.com smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Om5/P0VucjwtVSyPAahMihMrFKhMEGTpXlaDQvTox2M=; b=IDwFBfwO5qS9Tg6KYGwJCywwX5rEM15VOTszLcScVSysxrWyuhMYcpE33plE/Hj8y1CQ/AEY+e3GIYhPzTX6XvmzQoLySHveKcPRxeZOn8UAfmEf/zcIRYyTvlpedvTaCi/Glk1XnA5E3TFH6J+h6NLvCwLqKDvY8kP12u0bgNAYHUuvZTj0V1BhpaDjMOihzD1iy9LlpWVdc2oMcYDZUbH8MrYnMvYHmwWao7RE3e5OmwSXZS9JmdKR2XtlbE4uvA3LxmG0SmWyU9/I62MPoO0SB4GHsh3jEPd+lz7e0BKNN4837TpyP7fiNx19fKXU79jP6mDYL2V9U0tw8l89vg== Received: from BN8PR12CA0020.namprd12.prod.outlook.com (2603:10b6:408:60::33) by SN7PR12MB8790.namprd12.prod.outlook.com (2603:10b6:806:34b::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8207.16; Sun, 1 Dec 2024 10:38:28 +0000 Received: from BL02EPF0001A0FD.namprd03.prod.outlook.com (2603:10b6:408:60:cafe::dc) by BN8PR12CA0020.outlook.office365.com (2603:10b6:408:60::33) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8207.17 via Frontend Transport; Sun, 1 Dec 2024 10:38:28 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.118.233) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.118.233 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.118.233; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.118.233) by BL02EPF0001A0FD.mail.protection.outlook.com (10.167.242.104) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8230.7 via Frontend Transport; Sun, 1 Dec 2024 10:38:27 +0000 Received: from drhqmail201.nvidia.com (10.126.190.180) by mail.nvidia.com (10.127.129.6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Sun, 1 Dec 2024 02:38:17 -0800 Received: from drhqmail202.nvidia.com (10.126.190.181) by drhqmail201.nvidia.com (10.126.190.180) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Sun, 1 Dec 2024 02:38:16 -0800 Received: from vdi.nvidia.com (10.127.8.9) by mail.nvidia.com (10.126.190.181) with Microsoft SMTP Server id 15.2.1544.4 via Frontend Transport; Sun, 1 Dec 2024 02:38:13 -0800 From: Yonatan Maman To: , , , , , , , , , , , , , , , , Subject: [RFC 5/5] RDMA/mlx5: Enabling ATS for ODP memory Date: Sun, 1 Dec 2024 12:36:59 +0200 Message-ID: <20241201103659.420677-6-ymaman@nvidia.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20241201103659.420677-1-ymaman@nvidia.com> References: <20241201103659.420677-1-ymaman@nvidia.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-NV-OnPremToCloud: ExternallySecured X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BL02EPF0001A0FD:EE_|SN7PR12MB8790:EE_ X-MS-Office365-Filtering-Correlation-Id: c96b6a3c-d68c-458e-1b18-08dd11f44ab7 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|7416014|376014|1800799024|36860700013|82310400026|921020; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?NqxX3b2JY16FbXvl8cD9+y1neSRMNNSXfyxI9S1O5WiQaeHcoeWxxhjiEcY5?= =?us-ascii?Q?yjJYfY/6GsaaA0UTui1909CmrGNFQ6FOu5DAegxKJUgCKgJ82EH5XpjKoQhm?= =?us-ascii?Q?fadMoxwrRHsDDRf1elq4Eur1I4MD5vMl5v3moVeM7l+VYUyxCFh0oX6Gyiwe?= =?us-ascii?Q?SXdkB/K0KoSZv4qlKBEMMKchiiQCFCMYgTJSBfhx1NzKA3ZLYuCpUCOKDhz0?= =?us-ascii?Q?7+bgRkMg37DVR1Ve1ekLAW7GnnHTfmkKezXCqjbv7DLtIsJGrU6vHtQOx2vp?= =?us-ascii?Q?vJ9Rx2tHmaahZp58b/SG7SeCzxP18jebJWoiYHEHYDd4X8HeI2sZmrbceSsW?= =?us-ascii?Q?Vg1F2HeF2YpaJTQXhp64O+RW9U88JvGalV2ykBt1kmyb4trMyVgfJZSSxMGA?= =?us-ascii?Q?2bckimRnEJeTVAro873CyZT5SJoHPl6Q4oKhWl+4BrRIRchAzsCxu2GhvjUM?= =?us-ascii?Q?Dk+59eSdG9JUMKTtTRZHRYTas7MygxLL4awByg8KwTf3Lm5F4Ud7aL878PkA?= =?us-ascii?Q?boaORVCwMXZHrKRvgJWkGsuv19AZC01TygPXvoSs3g6Xnb+rWByWYiBUqcck?= =?us-ascii?Q?FzLODrspZbLZcQccO4NZANJ3gfdnHNAGm6aDDSn7Z+H7FDWcLhorr4Ienjgs?= =?us-ascii?Q?xOO+uCIrvOGk1ItH/GrNCIvoqg1WGTjQUAXAouhuL6P+wJEI+P7RAAMRrXaW?= =?us-ascii?Q?zyvnih3DiaVgSvQ4XhSgzh1Y2mkaHzOH6JhT+ZbbfaFF39DkIK++ubmGmUl5?= =?us-ascii?Q?NYxwvGn8lEh5Nl7/bWX348FDIRlE6tmb71sbTzPPzvBRZ7frt6WRjdCTFNKA?= =?us-ascii?Q?87V4tH+1hdkAcK4JmemOYMW46RMMV9zNVmBHL4gjzlBJ+rBIKLFWleyE44/o?= =?us-ascii?Q?RW3xvUsbFx0dLk8Xals33J1IbgAy71xTUSm7cCeED5TLIYMFCrgYHdKc3YLY?= =?us-ascii?Q?3ZWF3b0XASg5JioPQK4fnx3Pm+ihQEB08Su4e6CNtqOba0NK8W2RW8hXKYSy?= =?us-ascii?Q?nr30LQM7cwYgp35E+MXnxRRenih4Ee/KcWQR5Tb3XwALiOR9jxuu3ALwDch+?= =?us-ascii?Q?tpbMpO4GNodAXy6Lf58I6+kYZ+LHMlCbJg5mjb2I+G3miVGMU6jsh52nujR3?= =?us-ascii?Q?qbLpC/C5qRuA1l7z+beSbEf0787Jn4kqfBrxjb6bw3cuHEPkzYFTypeiCFEg?= =?us-ascii?Q?ueJGUhtIxavHB8FNPw/npEAuTODFQ4EHNwAlrfDguTGFItpCB03yVGZaYYZa?= =?us-ascii?Q?jayqXLZ+BVatD9C/9y399bpCBiP6D6L9VSYttqEzBC0YXIkJYyC0V+gvBHPN?= =?us-ascii?Q?Ra73uSrHoCz72KPf0gBU111AkQuoX3p/q0LfTtOKvAwBtgNEXes84bK1cL5N?= =?us-ascii?Q?iL+xDoJemmZb21ruycgPF/sLbTH9a8Bed7P36tNRFGSLxuenOqwwTmQII0sc?= =?us-ascii?Q?ny5Wjl+wI0S9pqSPlYU0Qv3D4k1UQuSHFjdsl8OU1GiScPpk04FilA=3D=3D?= X-Forefront-Antispam-Report: CIP:216.228.118.233;CTRY:US;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:mail.nvidia.com;PTR:dc7edge2.nvidia.com;CAT:NONE;SFS:(13230040)(7416014)(376014)(1800799024)(36860700013)(82310400026)(921020);DIR:OUT;SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Dec 2024 10:38:27.7809 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: c96b6a3c-d68c-458e-1b18-08dd11f44ab7 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a;Ip=[216.228.118.233];Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BL02EPF0001A0FD.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR12MB8790 X-Rspamd-Queue-Id: 779941802C8 X-Stat-Signature: ydqpm8m9iwgn4o5kgq9s8sgcu75x1j6y X-Rspam-User: X-Rspamd-Server: rspam09 X-HE-Tag: 1733049511-804401 X-HE-Meta: U2FsdGVkX1+zy/S44VSP9nHq3CbLViBx4RnajCcq1NaSKljVM4u4Dagfb++QXrFe8FehDnqYN9gJYUeOy8TgY296qYJwTuOUU4spnrsMOjwTNzYwA5J1LQ1q/RxibSryXm/o+X69h6PAMTISNa/s/mrOh3M+w6svFEq7QhzcqWXjBednrC8MVMQRhkZNfH4wAHjiLOls0DQakEpsfOdFFNJDAi19uzjGuB10Xy9tplxvro2sUJAzMzJN6OvXl9l+KMSNBgNkkYyxyeF2hjdhuP+r/XCvkCmPeMRhUOTdu9Oy4EDxILyal+0CKdEp9Hx4dKa74rwMJRKGaZWpHzjJM2OhTfhjTWWb+0EyOwZwXhIhnB9bzLbWkHkh9Ncygu6RY8mbnVMHvgPdUOR9U7hE1VVtChLDVN2J1uBrC8mhO8hfwT0RujlJzd3BVeRPxHpVWD8LCt3BdMWNRTm5ACc9lxjP2jW9EHBS9Gxgww2GwqP4+DL5/u90AbVwro5hrPlWJdeyZTcuH4iaLLBQF+XNA2RRRlfYmtjojHfyn2vWPZmNP5xmdi74aaYwMngD2UFACKBA9KP1xRJQtg1hkaqLMPD9qwpVHkxNDiabDeP3NJmyeaV9ct1saK7G5A8zXJq3EMzzH9Vx7AWkydS4Q7jSz+FLtvDSBjfwfYOLLefXx+kBfy7OYEXelecHmAc9B+StYYcat4NcjcAoFPHuhe4tmO9KM87NP6gkcglVQgLfsWvkW0BYToPBPoJESfpmnBLj1xr8gd7A7iGjfXP077T0A24gSYU/feRQNWCvcAFktnTFugvjw/4zspEmVPF14zsdr6taBcb6zuLERZXZ3dd7759UJkOkp8KPegLNJgbT5fNG+m6qJtBY8NBlXmxer6G846ovU8PCUEnuxCmTpki7R+xM0R/e9j3HXjgDrKjrqGEJqibXFgE1C4YL7GLIAoHIhqCS/vAEWFW6Ce0WN1y LDB6NBxN dTm5j2FSsNfIg1XJXhuJI4xs2KeYQ6ixkQ9kuh7NKGSANLm0Q9knRw19pS/Hh3o+eZZ/jC8JWltIW7oedNxid2jNtE0mEDLS+o5WBWOpfc/aWULH8dXBona8EmvQcat1J7sYbBxP2Fcs47VMRf2O3d6+wxashFb6FfQJsOdLnn6VtqprLfvfuq/3hstc0JHXo0q2T3DEIWNvRMke1O0IWHKn44GR773uafa+YOUa/krDn2ZlZ3LiPYMdVdZ6Uuf5/l9iAGXRrTHiWldi1I6ymKKScYKpja839CaPDQVwhd70lPfFt/Q2rKmFC3oIgmwu5UGrkceq74XYHBboEypycQzYn7mTWwc34dL3JzFrQjvHKAojp+KSJzmlNVDUMcPmNIHti X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Yonatan Maman ATS (Address Translation Services) mainly utilized to optimize PCI Peer-to-Peer transfers and prevent bus failures. This change employed ATS usage for ODP memory, to optimize DMA P2P for ODP memory. (e.g DMA P2P for private device pages - ODP memory). Signed-off-by: Yonatan Maman Signed-off-by: Gal Shalom --- drivers/infiniband/hw/mlx5/mlx5_ib.h | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/drivers/infiniband/hw/mlx5/mlx5_ib.h b/drivers/infiniband/hw/mlx5/mlx5_ib.h index 1bae5595c729..702d155f5048 100644 --- a/drivers/infiniband/hw/mlx5/mlx5_ib.h +++ b/drivers/infiniband/hw/mlx5/mlx5_ib.h @@ -1705,9 +1705,9 @@ static inline bool rt_supported(int ts_cap) static inline bool mlx5_umem_needs_ats(struct mlx5_ib_dev *dev, struct ib_umem *umem, int access_flags) { - if (!MLX5_CAP_GEN(dev->mdev, ats) || !umem->is_dmabuf) - return false; - return access_flags & IB_ACCESS_RELAXED_ORDERING; + if (MLX5_CAP_GEN(dev->mdev, ats) && (umem->is_dmabuf || umem->is_odp)) + return access_flags & IB_ACCESS_RELAXED_ORDERING; + return false; } int set_roce_addr(struct mlx5_ib_dev *dev, u32 port_num, -- 2.34.1