From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F14BCC4332F for ; Mon, 21 Nov 2022 14:57:19 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 6F2F96B0073; Mon, 21 Nov 2022 09:57:19 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 6A0E86B0074; Mon, 21 Nov 2022 09:57:19 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 56A296B0075; Mon, 21 Nov 2022 09:57:19 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0011.hostedemail.com [216.40.44.11]) by kanga.kvack.org (Postfix) with ESMTP id 47DE26B0073 for ; Mon, 21 Nov 2022 09:57:19 -0500 (EST) Received: from smtpin24.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id B572D160A22 for ; Mon, 21 Nov 2022 14:57:18 +0000 (UTC) X-FDA: 80157752556.24.ABCDAD8 Received: from madras.collabora.co.uk (madras.collabora.co.uk [46.235.227.172]) by imf12.hostedemail.com (Postfix) with ESMTP id D47734000E for ; Mon, 21 Nov 2022 14:57:16 +0000 (UTC) Received: from [192.168.10.9] (unknown [39.45.241.105]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: usama.anjum) by madras.collabora.co.uk (Postfix) with ESMTPSA id 8623666029A5; Mon, 21 Nov 2022 14:57:12 +0000 (GMT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1669042634; bh=SUxqx2ct+YMAWPyZQcYXUyYo4xyFn2Xq74LW6CRW/UM=; h=Date:Cc:Subject:To:References:From:In-Reply-To:From; b=WTcL3k3D5NZH/YqSRA58tsyvHXmhFUvWvjOma9SFxR7EY66rMcNldGyBxuf7n/zJn 3z+c3pzeNNzVR/KgEanB+kUDKkOxZNT75be7l/tIC+rll7bGtgasBNVsXaqbf27bWv 6ZM77e6euue8FNuIswWMKIhB1p/ZzqPMn0t4qxVeXMIkzmHRZDI5xo52IZh+TOzG3r Fg57qfv7A01YqWa70ND+sgjXuj4i0RKHuuVMLjN0tQri2iNkpSlyepKpp1K6Ap7QnA b7tEqaWkCX/R2scWx8OBUlqvfYYcNQEiInNEKu4Nkw23LUaieEAaUbtSU32jJO2erB zHI6ouppmNb6Q== Message-ID: Date: Mon, 21 Nov 2022 19:57:05 +0500 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.5.0 Cc: Muhammad Usama Anjum , David Hildenbrand , Nadav Amit , Andrea Arcangeli , Andrew Morton , linux-kernel@vger.kernel.org, linux-mm@kvack.org Subject: Re: [PATCH v4 1/3] mm/mprotect: Fix soft-dirty check in can_change_pte_writable() Content-Language: en-US To: Peter Xu References: <20220725142048.30450-1-peterx@redhat.com> <20220725142048.30450-2-peterx@redhat.com> From: Muhammad Usama Anjum In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1669042637; a=rsa-sha256; cv=none; b=VW+Tx9IfYxZHIrhMT6K2HzIAutjPD/L9KRDYjKREybwGUiF19c9fT45Md4mEs46UyZlwQL d1J6b6kgEYzj7H+4ePkJZwETRQLEXBX2ADCPrxrArUHl2Q6WpQiCICmuurJ3xZ5Mdl3YUW g/M2o+zI6fScnynI+0LLWkM/f9R6i50= ARC-Authentication-Results: i=1; imf12.hostedemail.com; dkim=pass header.d=collabora.com header.s=mail header.b=WTcL3k3D; spf=pass (imf12.hostedemail.com: domain of usama.anjum@collabora.com designates 46.235.227.172 as permitted sender) smtp.mailfrom=usama.anjum@collabora.com; dmarc=pass (policy=none) header.from=collabora.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1669042637; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=eF3fbrL7T17ZRmAQxpB5H4Gx31IIJJ5yHy2ozf6baL8=; b=h30I+V7d01c1rfZ3LakF51Xp2NN2qucG/0hCK0sJnJN9zxcD8SCo3L0uZK+Xpmp8PEMKj8 J8bu77HAEroFde88KqaUDPHeRaZWIWOJwDnycXogEal30IWbwF7HWIYAC//j9PWnvSIBcj d1X7W3BwmuUSvgsnxSDeTmGe3nHjfNc= X-Stat-Signature: 57tpomhg77zghcgyz83r8g7mgu9e97ah X-Rspamd-Queue-Id: D47734000E X-Rspamd-Server: rspam01 X-Rspam-User: Authentication-Results: imf12.hostedemail.com; dkim=pass header.d=collabora.com header.s=mail header.b=WTcL3k3D; spf=pass (imf12.hostedemail.com: domain of usama.anjum@collabora.com designates 46.235.227.172 as permitted sender) smtp.mailfrom=usama.anjum@collabora.com; dmarc=pass (policy=none) header.from=collabora.com X-HE-Tag: 1669042636-949385 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Peter, Thank you so much for replying. On 11/19/22 4:14 AM, Peter Xu wrote: > On Sat, Nov 19, 2022 at 01:16:26AM +0500, Muhammad Usama Anjum wrote: >> Hi Peter and David, > > Hi, Muhammad, > >> >> On 7/25/22 7:20 PM, Peter Xu wrote: >>> The check wanted to make sure when soft-dirty tracking is enabled we won't >>> grant write bit by accident, as a page fault is needed for dirty tracking. >>> The intention is correct but we didn't check it right because VM_SOFTDIRTY >>> set actually means soft-dirty tracking disabled. Fix it. >> [...] >>> +static inline bool vma_soft_dirty_enabled(struct vm_area_struct *vma) >>> +{ >>> + /* >>> + * NOTE: we must check this before VM_SOFTDIRTY on soft-dirty >>> + * enablements, because when without soft-dirty being compiled in, >>> + * VM_SOFTDIRTY is defined as 0x0, then !(vm_flags & VM_SOFTDIRTY) >>> + * will be constantly true. >>> + */ >>> + if (!IS_ENABLED(CONFIG_MEM_SOFT_DIRTY)) >>> + return false; >>> + >>> + /* >>> + * Soft-dirty is kind of special: its tracking is enabled when the >>> + * vma flags not set. >>> + */ >>> + return !(vma->vm_flags & VM_SOFTDIRTY); >>> +} >> I'm sorry. I'm unable to understand the inversion here. >>> its tracking is enabled when the vma flags not set. >> VM_SOFTDIRTY is set on the VMA when new VMA is allocated to mark is >> soft-dirty. When we write to clear_refs to clear soft-dirty bit, >> VM_SOFTDIRTY is cleared from the VMA as well. Then why do you say tracking >> is enabled when the vma flags not set? > > Because only when 4>clear_refs happens would VM_SOFTDIRTY be cleared, and > only until then the real tracking starts (by removing write bits on ptes). But even if the VM_SOFTDIRTY is set on the VMA, the individual pages are still marked soft-dirty. Both are independent. It means tracking is enabled all the time in individual pages. Only the soft-dirty bit status in individual page isn't significant if VM_SOFTDIRTY already is set. Right? > >> I'm missing some obvious thing. Maybe the meaning of tracking is to see >> if VM_SOFTDIRTY needs to be set. If VM_SOFTDIRTY is already set, tracking >> isn't needed. Can you give an example here? > > If VM_SOFTDIRTY is set, pagemap will treat all pages as soft-dirty, please > see pagemap_pmd_range(): > > if (vma->vm_flags & VM_SOFTDIRTY) > flags |= PM_SOFT_DIRTY; > > So fundamentally it reports nothing useful when VM_SOFTDIRTY set. That's > also why we need the clear_refs first before we can have anything useful. > > Feel free to reference to the doc page (admin-guide/mm/soft-dirty.rst): > > ---8<--- > The soft-dirty is a bit on a PTE which helps to track which pages a task > writes to. In order to do this tracking one should > > 1. Clear soft-dirty bits from the task's PTEs. > > This is done by writing "4" into the ``/proc/PID/clear_refs`` file of the > task in question. > > 2. Wait some time. > > 3. Read soft-dirty bits from the PTEs. > > This is done by reading from the ``/proc/PID/pagemap``. The bit 55 of the > 64-bit qword is the soft-dirty one. If set, the respective PTE was > written to since step 1. > ---8<--- > > The tracking starts at step 1, where is when the flag is cleared. > > Thanks, > -- BR, Muhammad Usama Anjum