From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CFD55C77B73 for ; Wed, 31 May 2023 13:08:06 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4CCC66B0074; Wed, 31 May 2023 09:08:06 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 47CF68E0002; Wed, 31 May 2023 09:08:06 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 3454E8E0001; Wed, 31 May 2023 09:08:06 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 258AF6B0074 for ; Wed, 31 May 2023 09:08:06 -0400 (EDT) Received: from smtpin07.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 9C68080174 for ; Wed, 31 May 2023 13:08:05 +0000 (UTC) X-FDA: 80850578130.07.2F669BA Received: from NAM02-BN1-obe.outbound.protection.outlook.com (mail-bn1nam02on2059.outbound.protection.outlook.com [40.107.212.59]) by imf25.hostedemail.com (Postfix) with ESMTP id 145EEA0072 for ; Wed, 31 May 2023 13:07:16 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=hkJ2wKIp; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf25.hostedemail.com: domain of apopple@nvidia.com designates 40.107.212.59 as permitted sender) smtp.mailfrom=apopple@nvidia.com ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1685538437; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=8m7lsHLv9j/Fk7OAE89etEiMNHnBtOPtaQMgZ19CILA=; b=Kfa6J19j8QkRb87Bx36Ce+I974qIuMy0bTB/nBUt8kWgEzARSOU0y+c/mm2j134co7h/il 63INe7EyO6YWVpHwTLuBG01CI+csaDjSwf/Qtqru9N5d1hQmFNEgx1o1nGoi5vbVL3ajz7 tt9lRhMnGgHt4PebqN7iAErGvPow0T4= ARC-Authentication-Results: i=2; imf25.hostedemail.com; dkim=pass header.d=Nvidia.com header.s=selector2 header.b=hkJ2wKIp; dmarc=pass (policy=reject) header.from=nvidia.com; arc=pass ("microsoft.com:s=arcselector9901:i=1"); spf=pass (imf25.hostedemail.com: domain of apopple@nvidia.com designates 40.107.212.59 as permitted sender) smtp.mailfrom=apopple@nvidia.com ARC-Seal: i=2; s=arc-20220608; d=hostedemail.com; t=1685538437; a=rsa-sha256; cv=pass; b=Z/GGH7qnBwoa7XbfFH7rKpLDKW23Jk8XefJp0KTA/fFOHFsyfA1Q+IRlIcLMbkB6sKVV/e iNRda8r/iP3Ptg89nCqlbT9eK9t4RGWEUxpcOHf/R4Um73ysMk7VIfRHXSalEBmDGa8dpF rSoUAGH0hy5bygbQIKYVHGsLcbXXp1Y= ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=BiB5WFuSYByIvGt4yxklop0G/9y/7FEr06Lt7f0rgV9yr/YmWMuBK2OYogSHIiVGiODHTdAB2j060yqP/NGOntj/xb+k1p1UQ9nzLANaUZg4boCpscV75PV7q+LhSY3taTdcI3ZA7QwRyMIYBpgcaelG5YptkYEtFMDq9b8v3MWvOpu3yL+poP6fmgAIu7qmLrIiebUAZl3csVCmm6Dk4knEWNmvsvrarqC1uEEy9W97ppnbBO2xbKbfKSbpHoubSwNkY1Apco/HQWUjpsN+NZB+nigun8NMCs9AYsAyzKM275+SgEIQA6mH1Z3rBSoObLWE4XSZSP6wJopHzrXN1w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=8m7lsHLv9j/Fk7OAE89etEiMNHnBtOPtaQMgZ19CILA=; b=E7K0ZBsgK41wMWYo1bKZQmvthjKq7+5up4XYbl5FweLbDM9IpAODDX6GevKyZqJK1CPCdR0pkOuQXdDNDT9ifhAKJcFlwyCplb1ylrg4PIgWQ3eyK1BJPvRxG79WCoR+lU9Vwa2ZebuV1LUdKpOoiKy23iugktTtegPyMWPiK/kJ+aN3nW3PgjOcs8bY3Q3HQQleRH2DtpGuGcokYBHLVQlemSt4s+PRLIwgRmUOHPilltzzdUZg3PgcAPyYwOeZcaCnMLK4puCqp6/2WHLfgVkp/od6C34bEABXSRSV7rwsyN7J4LQqqUIAwPWLy9KxbeM9qL0NZYMNM3xu4fj4Bg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=8m7lsHLv9j/Fk7OAE89etEiMNHnBtOPtaQMgZ19CILA=; b=hkJ2wKIpUtyzNS0IEkbDsktjYteyHVXe+86eupZXfVo8T7Ffd2GIrKFUJTqS7HPVgzJEfep9ZxicM7issZxU0zuOlt0lX33AxIS5Qv7NllV/xsA9Gkax9x5amhgE381ptzM0MnQJj8KCLvssqkGGTsKYq7gWKC+rZOCMbivmNOLWWSEWTmOkSQh/HvepRPwG1ZTQcur8cqINvRzFIo1dBQZmrmLEWYAi3Djo4z/7x9arxqOTLXyfI0ZdZjMOKGry5A4efmSWA/p3o9MwWfRKFl4QYUxu6MCDHWIQJn8nmsZx8fgJeVl07hGVRMtuAm9cdNtNeNgx6yL52IJkGhm2IQ== Received: from BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) by MN0PR12MB6317.namprd12.prod.outlook.com (2603:10b6:208:3c2::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6433.23; Wed, 31 May 2023 13:07:12 +0000 Received: from BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::f6e4:71a5:4998:e6b2]) by BYAPR12MB3176.namprd12.prod.outlook.com ([fe80::f6e4:71a5:4998:e6b2%5]) with mapi id 15.20.6433.022; Wed, 31 May 2023 13:07:12 +0000 References: <46ad119c-b129-e983-031b-d71aacad6a20@redhat.com> <87edmxqetp.fsf@nvidia.com> <4f21d08c-3e79-6a16-4cd2-8f166b32d0f8@redhat.com> User-agent: mu4e 1.8.10; emacs 28.2 From: Alistair Popple To: David Hildenbrand Cc: Karim Manaouil , npiggin@gmail.com, akpm@linux-foundation.org, mike.kravetz@oracle.com, linux-mm@kvack.org, Hugh Dickins , =?utf-8?B?SsOpcsO0bWU=?= Glisse Subject: Re: mm: Question: pte SMP data race in do_anomyous_page()? Date: Wed, 31 May 2023 22:54:06 +1000 In-reply-to: <4f21d08c-3e79-6a16-4cd2-8f166b32d0f8@redhat.com> Message-ID: <87a5xkr6o2.fsf@nvidia.com> Content-Type: text/plain X-ClientProxiedBy: SJ0PR03CA0389.namprd03.prod.outlook.com (2603:10b6:a03:3a1::34) To BYAPR12MB3176.namprd12.prod.outlook.com (2603:10b6:a03:134::26) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BYAPR12MB3176:EE_|MN0PR12MB6317:EE_ X-MS-Office365-Filtering-Correlation-Id: 64512e99-1000-4926-fbfc-08db61d7f2f6 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: fUg+V5Wjq/lw62/var/WyKIvPSsHHzfpIv7bJTasIElGCDDPx2/3qF8LI9JFLdg88o3yMZhExb2vb88Y/P5SC/9qZhP7p/+zY2PSnhmVvw64+AuEkV2j7ls2/+HUkmf3PjyGBedqJFtA7f85wJz/zKfk/5umq+3MscnmfphTdQ5Px1FIifKnul7TJpdRI2GTzSMnFlzP44pd77SOdZx2tLFT6VmZ+1koMDtzjwr9FPBuN2Hxmtfe00wei0RNuFNZQJfo5L4SBHeeCpTmb9/5NgERy+qhnG45boxCGuFmqfW57qN44PosKUEvNL5xMMnErot1trWqGnOFbYhzNzuoNxxrEK9cLDuhxTu67aQJ7ETKTt2jZOqRoODgzJ0+CmA8s9TWgVdNVwNvv8N//vkTWeW3qomTKYtSbz8aormCr0yUZiUJabew2WsZGpxpm/E6z1Yl2hQ8AaIbpthxu5mf4NDQy7HLzgw95i9LxjT3S3Wjuex9FBSX6dFdIRqq/+i46VQm7J1BfoVx61ZgsKjhWhYD1lD6Rcj9mQIg06qJGClimdScIt/h8IC1cO7kRiVA X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BYAPR12MB3176.namprd12.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(4636009)(396003)(346002)(136003)(39860400002)(376002)(366004)(451199021)(66899021)(316002)(38100700002)(6486002)(41300700001)(6666004)(53546011)(36756003)(478600001)(86362001)(186003)(2616005)(83380400001)(54906003)(6506007)(26005)(6512007)(5660300002)(2906002)(4326008)(6916009)(66476007)(66946007)(66556008)(8676002)(8936002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?VPMQpaRvxApZDAONDxksS1J1U2reT4vcZYiO0RnQmBZ2yAx9oyfK6ZpdVaKN?= =?us-ascii?Q?3q19g9tmjSKzVU0eqJ0r4w10Q0wNmbzzFfPRrh+n5vIWYGe/Lu1wHsGq6nKl?= =?us-ascii?Q?sLv1OJgWBFI7S24JpXDE7ItYXE2OYA8flNZXS0BZMFMGzP2lUHZ5SMtpZyTr?= =?us-ascii?Q?uwTbOIijHj8uCR9ms+3DeU6p3Glyus1kw+kJ0V7a/EDVRhfL9/RIpFHr4DY5?= =?us-ascii?Q?ZdW2ppmjm60ghnnmVZ/onSJ5B0EVVhFKjFtaiWTdWu2E87wlmxsfb59VZNll?= =?us-ascii?Q?kzng/FNWN+bkJrrCOoxZLmSpUOcDZhUYgj4oPNfu6fVQOelUVfQnZmNU8DZ5?= =?us-ascii?Q?UJTaQMPLD/06CZsnPceeXXy4/3gzvQa4+MzLbDleqU8V1iQyY5HjBQCBRBHn?= =?us-ascii?Q?FOTCxwYTv2YKRipSPi+Z159tFwbn6b/4HgN0E8tjHE7AOte5pd25X5sdV/6R?= =?us-ascii?Q?ugnsSfqATAm5qlzlW7lXzFBaGgDI709Bzwcd0XeBpVh+iUmZS7iY/Pom0rcS?= =?us-ascii?Q?2yV25MKWruWp7ztVOkYJvpuVJ17aF+QDGo/QGZq/JNAPdpluzG3KNlDsx1fv?= =?us-ascii?Q?rqf7aiix7T+kjhQya/2rLGDjWWba0W8ZvpmD3b0l9tN2wJ1YaizijXeGN7ML?= =?us-ascii?Q?XCqSIy9FDkXDMSUkOHSAvDaxv54XbGPoyYzwKYZXlFEF8OfkvXecrDTsrBBB?= =?us-ascii?Q?7SmBk9awMQERsyLWRv+bBBgVMyANApz45o6BxI/ugWLXZ/dTVpNT2TtM0eoy?= =?us-ascii?Q?i/k+UDX50VJIL7cAloCJxSSVI2+mA5JkG1pz1Z7Ql3ewMg6AxeHkWw5rdqRQ?= =?us-ascii?Q?L8FI8ed+ltfmmCI/9SSWdr4QGjPBrptLD0XkWWCl2OpjADCAiNsFGq7XEG8h?= =?us-ascii?Q?TM3So7uyvniX1GGWjkubGIKkmVqp44a4xj3Aa57Dt7O7wKylbekyHRC+xSHb?= =?us-ascii?Q?k9j8Z5Eh6OObKG1DalAbkLPfwiFvvXOzZjMOq6vribBjhl7QCGbBKTQDskQU?= =?us-ascii?Q?Fj0RcHkEHdVyvEg28gUvBBlXUKIB7HosVUs6uLQtVTvY6hU3Ms7zXzHXJrox?= =?us-ascii?Q?nMyc2FcVizR8BMu9+C6yB3B0lB4POibrIx4JzAMVCi3cr/guFjPsVXyelb3P?= =?us-ascii?Q?XGXdQo0il3YNlC1GMl8dUWuoZHEGxRWQff1vWI66Ova6wWJ+z21wvVRb6E6f?= =?us-ascii?Q?8fIWv/FYRytj4zh3HDzliRFzQ2SnJ6OGPy5n0P08GZotzgGajMSwnaBg8D0k?= =?us-ascii?Q?27nPe6uJp2TPtWBLNpH6Zi4Yi1JzENH1zLUSDoLtJFar+dW4lF4y+njnBiRa?= =?us-ascii?Q?j9JMZvKkBt9ZaSVYU6i7/rH+U3XR2l6fgM6bWLMf1BCRGiqx1JqtVdlzKEgs?= =?us-ascii?Q?g3RirytzMhp1zXJiGvUi5pLl/9VhQYBtTZ9YrcbYpnrKE/m0hyq9BpgXzTmJ?= =?us-ascii?Q?oDmUFnoDwkPvet/GLczwHIKNhXm1AqzbqHbHW4MpYEXkVbKcW9n+c3t26hLa?= =?us-ascii?Q?lZajb/wR16hPs5glr8yFe8V9uNwDszliUbkoA0IEx6EV2SsJ2nukr3H7C6/c?= =?us-ascii?Q?z5Rip8cGtxjjiNdEiQjE0plkRA2TGCdKJhO2CuZK?= X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-Network-Message-Id: 64512e99-1000-4926-fbfc-08db61d7f2f6 X-MS-Exchange-CrossTenant-AuthSource: BYAPR12MB3176.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 31 May 2023 13:07:12.7479 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: jQiwuCs1XxREXq/T89Z/4c7DPH66whG/BRko0WyDlUEZSsvYk0U/1vF3qA3Qux2djYJhDioQ4426vrQ/yuSzfA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN0PR12MB6317 X-Rspamd-Queue-Id: 145EEA0072 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: a1ocu89a4qxhgsgwud3eza5di6nowunc X-HE-Tag: 1685538436-409269 X-HE-Meta: U2FsdGVkX18eCGSyNAeNz1hPBWHnyRf5Ka/jKQw75IXi0yyzzV/h2Feri1uHNtT1wPGzxKXNytClSZaODQXqkZMcFw+gjDHpc44YJ4Impk1UbLsMRVaVfjNmyAvZOTcaF1R/mW17pfdBAAmBBAGoV0CfXS794XIDEIznA0C3UkXBjoPjSRwrIq+jZpFwR76KzqbpucdSCFcaNiBGWZnq8Kc5TM8BEVMFzCLI9fRqEffWpo2VHvJZSEnwiWw750WXZnUHZMDWlwaf7xmypX8N/3lXX/XyvaPu4AP9dKriOg+E5Zc+YZrR2Y9gG/xBtyUMFZj9Ooa42YZ9KoFUV6ZAWgnRFUWqBQdxtdHD/ZdSaByNtYOUs6i8xyxK2Msq+bY+jokaV5uSPXYFGUlQESdaebqPRyAewM/g3uGnTAta5tuGl4D1RMx6L+7WhbQ9S7QrlgtWYYZVht74PnAiiYmosnMcXfa1iG2czxZXzQk0JSXAcox/kVjQByoGljHCK2YT0eGaC4egh3CDfHYSRSJLKfEywh8gzx9S1hyftE473LEA+yb12b2qkcqhJx6gql6YHXZ0Vw+WatkpKzr3NHZ25vyZLDZS5XRyy9ddYpvEdVGspQtd8isGVElgrWeXGOHqt6VZyeZchM19Di3Q36xUOvzTLSbvBNxZMnSU7hLmSMYDa9NaK/4NqFye5Di6YQnX4huOWaABKbGUmczqEMTbc2x2H3nZzhyM1MHYNNeoL8ro2VIjyyaHGzzTBfAvH+tseJSGTj6i9TPw8oQqCsaEmAGXzZLtLNS2ayAj4gI4zSsP8UOIo703z1QdR4Sm89GbWhoQbnf4QQPAWYGdu8Sy6dbPtIGMoIyKOWHPHBeqlAEfWQ2Nwp/BeQ2GHYkYCLjdoQIaOPJWyY2p0N6FlUBR5MrcVd1l/nHmmjLaRZbgLOYih2VZbm+MJTtjG/YzIeM8Q7mqgTA2RqeRjz0HE71 4dinTzBp lWdt8PqrMDpdBZCVGlqDCHBYdU2Hbo9318cDDLy/OWdqKPdWladWAsQK1WRvi0upcAFfKrYMORxlh3SMNpxYUu2x0Q28c/LRkVrDkGFkpFvGlXTVepwnrU6JKnMoEoZJP1grHrLgSpZkpAx77aSPxzPq0VdnkhXfxn4YyL/M6b4Tl0NoR2p29cDudtrch21eldkf9uwXF9q9oCYruCGFHNlvy+ZVJXfM6tyBNdtbBs0ZO1c7Jj6SPHG1t6TDQ2wiIvViiXoBkADbd9QbXJhvGPfO0ig== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: David Hildenbrand writes: > On 31.05.23 06:55, Alistair Popple wrote: >> David Hildenbrand writes: >> >>> On 26.05.23 11:07, Karim Manaouil wrote: >>>> On Thu, May 25, 2023 at 02:55:30PM +0200, David Hildenbrand wrote: >>>>> On 25.05.23 12:06, Karim Manaouil wrote: >>>>>> Hi, >>>>>> >>>>>> In do_anonymous_page(), a new page is allocated and zeroed, and the >>>>>> corresponding page struct is initialised (setting flags PageUptodate, >>>>>> PageSwapBacked, etc. and initialising the various counters). >>>>>> >>>>>> Then, set_pte_at() is called directly without calling smp_wmb() to make >>>>>> the updates above visible on other CPUs. >>>>>> >>>>>> This could race with a page table walker. The walker can read the new pte >>>>>> and try to access the page struct or the page content before the changes >>>>>> above were made visible. >>>>> >>>>> Only after acquiring the page table lock (which the writer first has to >>>>> release), right? >>>> In many cases, the walkers don't take the page table locks (e.g. >>>> mm/hmm.c). >>> >>> Looks like we really should be locking the page table in >>> hmm_vma_walk_pmd() instead of only doing a pte_offset_map(). >>> >>> It's all very racy without that ... >>> >>> Even the !pte_present(pte) check is racy ... >> hmm_range_fault() on it's own is racy, but it's supposed to be used >> with >> mmu interval notifiers which provide a sequence number and a driver >> mutex to synchronise against pte changes. See for example >> dmirror_range_snapshot() in lib/test_hmm.c. >> > > How is this supposed to work with racing do_swap_page() that converts > !pte_present() -> pte_present() without triggering any mmu notifier > AFAIKs? It depends what the caller asks for. If the caller has set HMM_PFN_REQ_FAULT hmm_range_fault() will call handle_mm_fault() and then retry, presumably finding the now present PTE. If the caller hasn't asked for it to be faulted it will be returned as a non-present PTE. But the caller has to be prepared to deal with that - even if we took the PTL it's just a matter of timing. In practice hmm_range_fault() is used to mirror PTEs to a secondary MMU in response to a fault. So it doesn't matter if a transient condition causes no PTE to be returned, the secondary MMU will just retry the fault. What is critically important is that the secondary MMU doesn't contain more permissive PTEs, hence the need to synchronise using mmu notifiers to ensure mappings and write permissions get revoked.