From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id D29F5C4332F for ; Sun, 26 Dec 2021 14:34:51 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0EE826B0072; Sun, 26 Dec 2021 09:34:51 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 09E3A6B0074; Sun, 26 Dec 2021 09:34:51 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id EA7246B0075; Sun, 26 Dec 2021 09:34:50 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0021.hostedemail.com [216.40.44.21]) by kanga.kvack.org (Postfix) with ESMTP id D8A536B0072 for ; Sun, 26 Dec 2021 09:34:50 -0500 (EST) Received: from smtpin31.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id 8213B7CCE5 for ; Sun, 26 Dec 2021 14:34:50 +0000 (UTC) X-FDA: 78960191940.31.360A5D1 Received: from heian.cn.fujitsu.com (mail.cn.fujitsu.com [183.91.158.132]) by imf21.hostedemail.com (Postfix) with ESMTP id 898A51C0022 for ; Sun, 26 Dec 2021 14:34:44 +0000 (UTC) IronPort-Data: =?us-ascii?q?A9a23=3A/+wqsq6lfzFmvSpppo7iowxRtFPGchMFZxGqfqr?= =?us-ascii?q?LsXjdYENS0jMPmjMXWm+PbveLM2KkLtpwYYnlpBwCuZOAmtU3HVQ5pCpnJ55og?= =?us-ascii?q?ZCbXIzGdC8cHM8zwvXrFRsht4NHAjX5BJhcokT0+1H9YtANkVEmjfvRH+CmVra?= =?us-ascii?q?dUsxMbVQMpBkJ2EsLd9ER0tYAbeiRW2thiPuqyyHtEAbNNw1cbgr435m+RCZH5?= =?us-ascii?q?5wejt+3UmsWPpintHeG/5Uc4Ql2yauZdxMUSaEMdgK2qnqq8V23wo/Z109F5tK?= =?us-ascii?q?NmbC9fFAIQ6LJIE6FjX8+t6qK20AE/3JtlP1gcqd0hUR/0l1lm/hr1dxLro32R?= =?us-ascii?q?wEyIoXCheYcTwJFVSp5OMWq/ZeeeCni75fDkxCun3zEhq8G4FsNFYER5Od7KW9?= =?us-ascii?q?U8vkfMjoMclaIgOfe6LKwSsFtgMo5JcXmNY9ZvWtvpRnVBPBgQ9bcQqHO5NZdx?= =?us-ascii?q?x8xgNxDGbDVYM9xQTZtcxPGbDVMN00RBZZ4m/2n7lH7cjtFuBeQoII0/WHYz0p?= =?us-ascii?q?2yreFGNzLdt2PQO1Rn12EvSTC/mLkElcWOcL34TiM9H/qje/StSThUYkWGfuz8?= =?us-ascii?q?fsCqFmSwHEDTRMNWValrP2RlEGzQZRcJlYS9y5oqrI9nGSvT9/gT1i7rWSCsxo?= =?us-ascii?q?0RdVdCas55RuLx66S5ByWbkAATzhceJk2utQeWzMnzBmKksnvCDgpt6eaIU9xX?= =?us-ascii?q?J/8QSiaYHBTdDFdI3RfC1Zt3jUqm6lr5jqnczqpOPfdYgXJJAzN?= IronPort-HdrOrdr: =?us-ascii?q?A9a23=3AXO9SV6+gxX3MbzwR2Rpuk+AwI+orL9Y04lQ7?= =?us-ascii?q?vn2YSXRuHPBw8Pre+MjztCWE7wr5N0tBpTntAsW9qBDnhPtICOsqTNSftWDd0Q?= =?us-ascii?q?PCRuxfBODZogEIdReQygck79YDT0FhMqyKMXFKydb9/BKjE8sthP2O8KWTj+/Y?= =?us-ascii?q?yHt3JDsaEp1I3kNoDBqBCE1qSE1jDZo9LpCV4c1KvH6OYnISB/7LfkUtbqzSoc?= =?us-ascii?q?HRjpL6bVojDx4j0gOHijSl8/rbPnGjr3Ejbw8=3D?= X-IronPort-AV: E=Sophos;i="5.88,237,1635177600"; d="scan'208";a="119563845" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 26 Dec 2021 22:34:45 +0800 Received: from G08CNEXMBPEKD06.g08.fujitsu.local (unknown [10.167.33.206]) by cn.fujitsu.com (Postfix) with ESMTP id 110FB4D13BFD; Sun, 26 Dec 2021 22:34:41 +0800 (CST) Received: from G08CNEXCHPEKD09.g08.fujitsu.local (10.167.33.85) by G08CNEXMBPEKD06.g08.fujitsu.local (10.167.33.206) with Microsoft SMTP Server (TLS) id 15.0.1497.23; Sun, 26 Dec 2021 22:34:39 +0800 Received: from irides.mr.mr (10.167.225.141) by G08CNEXCHPEKD09.g08.fujitsu.local (10.167.33.209) with Microsoft SMTP Server id 15.0.1497.23 via Frontend Transport; Sun, 26 Dec 2021 22:34:38 +0800 From: Shiyang Ruan To: , , , , CC: , , , , Subject: [PATCH v9 00/10] fsdax: introduce fs query to support reflink Date: Sun, 26 Dec 2021 22:34:29 +0800 Message-ID: <20211226143439.3985960-1-ruansy.fnst@fujitsu.com> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Type: text/plain X-yoursite-MailScanner-ID: 110FB4D13BFD.A4C06 X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@fujitsu.com X-Rspamd-Server: rspam08 X-Rspamd-Queue-Id: 898A51C0022 X-Stat-Signature: 9s4hmyr5uega6t8d15jyeiyust1tna1i Authentication-Results: imf21.hostedemail.com; dkim=none; spf=none (imf21.hostedemail.com: domain of ruansy.fnst@fujitsu.com has no SPF policy when checking 183.91.158.132) smtp.mailfrom=ruansy.fnst@fujitsu.com; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=fujitsu.com (policy=none) X-HE-Tag: 1640529284-897876 Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: This patchset is aimed to support shared pages tracking for fsdax. Changes from V8 Resend: - Fix usage of dax write/read lock - Remove fsdax/xfs register/unregister wrappers - Move unrelated fixes into separate patchset - Fix code style Changes from V8: - Rebased to "decouple DAX from block devices v2" - Patch8(implementation in XFS): Separate dax part to Patch7 - Patch9: add FS_DAX_MAPPING_COW flag to distinguish CoW with normal This patchset moves owner tracking from dax_assocaite_entry() to pmem device driver, by introducing an interface ->memory_failure() for struct pagemap. This interface is called by memory_failure() in mm, and implemented by pmem device. Then call holder operations to find the filesystem which the corrupted data located in, and call filesystem handler to track files or metadata associated with this page. Finally we are able to try to fix the corrupted data in filesystem and do other necessary processing, such as killing processes who are using the files affected. The call trace is like this: memory_failure() |* fsdax case |------------ |pgmap->ops->memory_failure() =3D> pmem_pgmap_memory_failure() | dax_holder_notify_failure() =3D> | dax_device->holder_ops->notify_failure() =3D> | - xfs_dax_notify_failure() | |* xfs_dax_notify_failure() | |-------------------------- | | xfs_rmap_query_range() | | xfs_dax_failure_fn() | | * corrupted on metadata | | try to recover data, call xfs_force_shutdown() | | * corrupted on file data | | try to recover data, call mf_dax_kill_procs() |* normal case |------------- |mf_generic_kill_procs() =3D=3D Shiyang Ruan (10): dax: Use percpu rwsem for dax_{read,write}_lock() dax: Introduce holder for dax_device mm: factor helpers for memory_failure_dev_pagemap pagemap,pmem: Introduce ->memory_failure() fsdax: fix function description fsdax: Introduce dax_lock_mapping_entry() mm: move pgoff_address() to vma_pgoff_address() mm: Introduce mf_dax_kill_procs() for fsdax case xfs: Implement ->notify_failure() for XFS fsdax: set a CoW flag when associate reflink mappings drivers/dax/device.c | 11 +- drivers/dax/super.c | 104 ++++++++++++++-- drivers/md/dm-writecache.c | 7 +- drivers/nvdimm/pmem.c | 16 +++ fs/dax.c | 174 +++++++++++++++++++++------ fs/fuse/dax.c | 6 +- fs/xfs/Makefile | 1 + fs/xfs/xfs_buf.c | 15 +++ fs/xfs/xfs_fsops.c | 3 + fs/xfs/xfs_mount.h | 1 + fs/xfs/xfs_notify_failure.c | 189 +++++++++++++++++++++++++++++ fs/xfs/xfs_notify_failure.h | 10 ++ include/linux/dax.h | 63 +++++++++- include/linux/memremap.h | 9 ++ include/linux/mm.h | 15 +++ mm/memory-failure.c | 232 +++++++++++++++++++++++++----------- 16 files changed, 719 insertions(+), 137 deletions(-) create mode 100644 fs/xfs/xfs_notify_failure.c create mode 100644 fs/xfs/xfs_notify_failure.h --=20 2.34.1