From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6E17AC433EF for ; Fri, 1 Jul 2022 11:33:20 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id D37666B0071; Fri, 1 Jul 2022 07:33:19 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id CE6276B0073; Fri, 1 Jul 2022 07:33:19 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id BD6AF6B0074; Fri, 1 Jul 2022 07:33:19 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id AF81E6B0071 for ; Fri, 1 Jul 2022 07:33:19 -0400 (EDT) Received: from smtpin16.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 736C034B29 for ; Fri, 1 Jul 2022 11:33:19 +0000 (UTC) X-FDA: 79638320118.16.757CFB3 Received: from frasgout.his.huawei.com (frasgout.his.huawei.com [185.176.79.56]) by imf25.hostedemail.com (Postfix) with ESMTP id B347CA0044 for ; Fri, 1 Jul 2022 11:33:18 +0000 (UTC) Received: from fraeml707-chm.china.huawei.com (unknown [172.18.147.207]) by frasgout.his.huawei.com (SkyGuard) with ESMTP id 4LZCdf3yhHz6H71B; Fri, 1 Jul 2022 19:29:10 +0800 (CST) Received: from lhreml724-chm.china.huawei.com (10.201.108.75) by fraeml707-chm.china.huawei.com (10.206.15.35) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.24; Fri, 1 Jul 2022 13:33:16 +0200 Received: from [10.126.173.51] (10.126.173.51) by lhreml724-chm.china.huawei.com (10.201.108.75) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.24; Fri, 1 Jul 2022 12:33:15 +0100 Message-ID: <51af869a-83d4-631a-2d91-edb8b066bf4d@huawei.com> Date: Fri, 1 Jul 2022 12:33:17 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: [PATCH] iommu/iova: change IOVA_MAG_SIZE to 127 to save memory To: Feng Tang CC: Robin Murphy , Joerg Roedel , "Will Deacon" , , , Andrew Morton , "Christoph Lameter" , Vlastimil Babka , , , Paul Menzel References: <20220630073304.26945-1-feng.tang@intel.com> <13db50bb-57c7-0d54-3857-84b8a4591d9e@arm.com> <7c29d01d-d90c-58d3-a6e0-0b6c404173ac@huawei.com> <117b31b5-8d06-0af4-7f1c-231d86becf1d@arm.com> <2920df89-9975-5785-f79b-257d3052dfaf@huawei.com> <20220701035622.GB14806@shbuild999.sh.intel.com> From: John Garry In-Reply-To: <20220701035622.GB14806@shbuild999.sh.intel.com> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-Originating-IP: [10.126.173.51] X-ClientProxiedBy: lhreml712-chm.china.huawei.com (10.201.108.63) To lhreml724-chm.china.huawei.com (10.201.108.75) X-CFilter-Loop: Reflected ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=none; dmarc=pass (policy=quarantine) header.from=huawei.com; spf=pass (imf25.hostedemail.com: domain of john.garry@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=john.garry@huawei.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1656675199; a=rsa-sha256; cv=none; b=PzbIcRQFyP4pvzUxbnyCisBRnBeDm+OPMOggfsYMxSCNvdbie1W8ufmD+bTer/SGW4uMaL h7oIIZhjZCCX900pO0i6x+SawOSC67SnPjbt4uqtTtHkUu8avl3MJJiT2j4ljKUMgOUICI MIDBTLCA89Kg5dGQfwiMMX2z+VNi0I4= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1656675199; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=uF/LW6i3L/gPdgFeO4qb3jid183OPAoSjhcn2rNEMVI=; b=NatUAtlMg2oCTk0JZ7ez6ulTPkYxEhBrYBkJPg4gdpHt6lEONzF+t3hY7BT9LfPfyke5jc CD3KvkDkgp24Fxf8Sh0bXGnQ5C9DES41CjFSNo6shB+NZ8zFKO8W2uC4FN0Jou1tQltXeT 90+HwrY0WW/e2biQjLGnZL93oGfooZo= X-Stat-Signature: wxmb5g3a6kq771zdos4s65gtyq6yidmm X-Rspamd-Queue-Id: B347CA0044 Authentication-Results: imf25.hostedemail.com; dkim=none; dmarc=pass (policy=quarantine) header.from=huawei.com; spf=pass (imf25.hostedemail.com: domain of john.garry@huawei.com designates 185.176.79.56 as permitted sender) smtp.mailfrom=john.garry@huawei.com X-Rspam-User: X-Rspamd-Server: rspam11 X-HE-Tag: 1656675198-954163 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 01/07/2022 04:56, Feng Tang wrote: >>> inclination. >>> >> ok, what you are saying sounds reasonable. I just remember that when we >> analyzed the longterm aging issue that we concluded that the FQ size and its >> relation to the magazine size was a factor and this change makes me a little >> worried about new issues. Better the devil you know and all that... >> >> Anyway, if I get some time I might do some testing to see if this change has >> any influence. >> >> Another thought is if we need even store the size in the iova_magazine? mags >> in the depot are always full. As such, we only need worry about mags loaded >> in the cpu rcache and their sizes, so maybe we could have something like >> this: >> >> struct iova_magazine { >> - unsigned long size; >> unsigned long pfns[IOVA_MAG_SIZE]; >> }; >> >> @@ -631,6 +630,8 @@ struct iova_cpu_rcache { >> spinlock_t lock; >> struct iova_magazine *loaded; >> struct iova_magazine *prev; >> + int loaded_size; >> + int prev_size; >> }; >> >> I haven't tried to implement it though.. > I have very few knowledge of iova, so you can chose what's the better > solution. I just wanted to raise the problem and will be happy to see > it solved:) I quickly tested your patch for performance and saw no noticeable difference, which is no surprise. But I'll defer to Robin if he thinks that your patch is a better solution - I would guess that he does. For me personally I would prefer that this value was not changed, as I mentioned before. thanks, John