From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8D493C83007 for ; Tue, 28 Apr 2020 09:32:56 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5B79E206C0 for ; Tue, 28 Apr 2020 09:32:56 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 5B79E206C0 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=cn.fujitsu.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id EC4428E0006; Tue, 28 Apr 2020 05:32:55 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id E74368E0001; Tue, 28 Apr 2020 05:32:55 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D8AF58E0006; Tue, 28 Apr 2020 05:32:55 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0070.hostedemail.com [216.40.44.70]) by kanga.kvack.org (Postfix) with ESMTP id C10AF8E0001 for ; Tue, 28 Apr 2020 05:32:55 -0400 (EDT) Received: from smtpin11.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 6F8DDC5C3 for ; Tue, 28 Apr 2020 09:32:55 +0000 (UTC) X-FDA: 76756749510.11.sack76_3679fedfd2e0d X-HE-Tag: sack76_3679fedfd2e0d X-Filterd-Recvd-Size: 5809 Received: from heian.cn.fujitsu.com (mail.cn.fujitsu.com [183.91.158.132]) by imf39.hostedemail.com (Postfix) with ESMTP for ; Tue, 28 Apr 2020 09:32:53 +0000 (UTC) X-IronPort-AV: E=Sophos;i="5.73,326,1583164800"; d="scan'208";a="90638122" Received: from unknown (HELO cn.fujitsu.com) ([10.167.33.5]) by heian.cn.fujitsu.com with ESMTP; 28 Apr 2020 17:32:51 +0800 Received: from G08CNEXMBPEKD05.g08.fujitsu.local (unknown [10.167.33.204]) by cn.fujitsu.com (Postfix) with ESMTP id 3DFFC50A9991; Tue, 28 Apr 2020 17:32:49 +0800 (CST) Received: from [10.167.225.141] (10.167.225.141) by G08CNEXMBPEKD05.g08.fujitsu.local (10.167.33.204) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Tue, 28 Apr 2020 17:32:46 +0800 Subject: =?UTF-8?B?UmU6IOWbnuWkjTogUmU6IFtSRkMgUEFUQ0ggMC84XSBkYXg6IEFkZCBh?= =?UTF-8?Q?_dax-rmap_tree_to_support_reflink?= To: Dave Chinner CC: Matthew Wilcox , "linux-kernel@vger.kernel.org" , "linux-xfs@vger.kernel.org" , "linux-nvdimm@lists.01.org" , "linux-mm@kvack.org" , "linux-fsdevel@vger.kernel.org" , "darrick.wong@oracle.com" , "dan.j.williams@intel.com" , "hch@lst.de" , "rgoldwyn@suse.de" , "Qi, Fuli" , "Gotou, Yasunori" References: <20200427084750.136031-1-ruansy.fnst@cn.fujitsu.com> <20200427122836.GD29705@bombadil.infradead.org> <20200428064318.GG2040@dread.disaster.area> From: Ruan Shiyang Message-ID: <259fe633-e1ff-b279-cd8c-1a81eaa40941@cn.fujitsu.com> Date: Tue, 28 Apr 2020 17:32:41 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: <20200428064318.GG2040@dread.disaster.area> Content-Type: text/plain; charset="utf-8"; format=flowed Content-Language: en-US X-Originating-IP: [10.167.225.141] X-ClientProxiedBy: G08CNEXCHPEKD05.g08.fujitsu.local (10.167.33.203) To G08CNEXMBPEKD05.g08.fujitsu.local (10.167.33.204) X-yoursite-MailScanner-ID: 3DFFC50A9991.AE2A1 X-yoursite-MailScanner: Found to be clean X-yoursite-MailScanner-From: ruansy.fnst@cn.fujitsu.com Content-Transfer-Encoding: quoted-printable X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 2020/4/28 =E4=B8=8B=E5=8D=882:43, Dave Chinner wrote: > On Tue, Apr 28, 2020 at 06:09:47AM +0000, Ruan, Shiyang wrote: >> >> =E5=9C=A8 2020/4/27 20:28:36, "Matthew Wilcox" =E5= =86=99=E9=81=93: >> >>> On Mon, Apr 27, 2020 at 04:47:42PM +0800, Shiyang Ruan wrote: >>>> This patchset is a try to resolve the shared 'page cache' problem = for >>>> fsdax. >>>> >>>> In order to track multiple mappings and indexes on one page, I >>>> introduced a dax-rmap rb-tree to manage the relationship. A dax e= ntry >>>> will be associated more than once if is shared. At the second tim= e we >>>> associate this entry, we create this rb-tree and store its root in >>>> page->private(not used in fsdax). Insert (->mapping, ->index) whe= n >>>> dax_associate_entry() and delete it when dax_disassociate_entry(). >>> >>> Do we really want to track all of this on a per-page basis? I would >>> have thought a per-extent basis was more useful. Essentially, create >>> a new address_space for each shared extent. Per page just seems like >>> a huge overhead. >>> >> Per-extent tracking is a nice idea for me. I haven't thought of it >> yet... >> >> But the extent info is maintained by filesystem. I think we need a wa= y >> to obtain this info from FS when associating a page. May be a bit >> complicated. Let me think about it... >=20 > That's why I want the -user of this association- to do a filesystem > callout instead of keeping it's own naive tracking infrastructure. > The filesystem can do an efficient, on-demand reverse mapping lookup > from it's own extent tracking infrastructure, and there's zero > runtime overhead when there are no errors present. >=20 > At the moment, this "dax association" is used to "report" a storage > media error directly to userspace. I say "report" because what it > does is kill userspace processes dead. The storage media error > actually needs to be reported to the owner of the storage media, > which in the case of FS-DAX is the filesytem. Understood. BTW, this is the usage in memory-failure, so what about rmap? I have=20 not found how to use this tracking in rmap. Do you have any ideas? >=20 > That way the filesystem can then look up all the owners of that bad > media range (i.e. the filesystem block it corresponds to) and take > appropriate action. e.g. I tried writing a function to look up all the owners' info of one block=20 in xfs for memory-failure use. It was dropped in this patchset because=20 I found out that this lookup function needs 'rmapbt' to be enabled when=20 mkfs. But by default, rmapbt is disabled. I am not sure if it matters..= . >=20 > - if it falls in filesytem metadata, shutdown the filesystem > - if it falls in user data, call the "kill userspace dead" routines > for each mapping/index tuple the filesystem finds for the given > LBA address that the media error occurred > > Right now if the media error is in filesystem metadata, the > filesystem isn't even told about it. The filesystem can't even shut > down - the error is just dropped on the floor and it won't be until > the filesystem next tries to reference that metadata that we notice > there is an issue. Understood. Thanks. >=20 > Cheers, >=20 > Dave. >=20 -- Thanks, Ruan Shiyang.