From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0A044C7EE43 for ; Tue, 28 Feb 2023 21:38:08 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id AA2F66B0089; Tue, 28 Feb 2023 16:37:48 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id A7A896B008C; Tue, 28 Feb 2023 16:37:48 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 919CD6B0092; Tue, 28 Feb 2023 16:37:48 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 7B7386B0089 for ; Tue, 28 Feb 2023 16:37:48 -0500 (EST) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 37F36140D6B for ; Tue, 28 Feb 2023 21:37:48 +0000 (UTC) X-FDA: 80518013016.22.2CBE54E Received: from casper.infradead.org (casper.infradead.org [90.155.50.34]) by imf02.hostedemail.com (Postfix) with ESMTP id 8C1F180019 for ; Tue, 28 Feb 2023 21:37:46 +0000 (UTC) Authentication-Results: imf02.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=rMDBeLPm; spf=none (imf02.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1677620266; a=rsa-sha256; cv=none; b=XZYoo726akMNv88UCGQ88D/HkfqORJCSQqx8/whRS0k1c/HRMZ7lV+8CoqKAH+P72SMhoj 4GKEwvmxgLvogu5DfeMjJx5yDwowrtHzZNi4fczEynGJf+lfZxaK5kg4ijJVqF/TGavsID 4FK5+MNGlOpYmE4jg4l4yCF7chGbrWo= ARC-Authentication-Results: i=1; imf02.hostedemail.com; dkim=pass header.d=infradead.org header.s=casper.20170209 header.b=rMDBeLPm; spf=none (imf02.hostedemail.com: domain of willy@infradead.org has no SPF policy when checking 90.155.50.34) smtp.mailfrom=willy@infradead.org; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1677620266; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=OsGw+Kta3YWjQfJb2PytPQ2Q1ww6/aja6t5dfRe0Qq4=; b=Tdd7DZ6GyCkoxmH2nLiTi3NaMHOflFpktR9NfxDJcZH3iDLjQscmQWNdaKRMbU4jG6dPNj 8N8tef73gz349phvXxnxJMismmkER/sHyRnpMFif+inM8OyAUieXr4sj30Q7yhztGJ5kId /3TS7B+Mdm7+/bKpvti0p3pgLGsSMiI= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=casper.20170209; h=Content-Transfer-Encoding:MIME-Version: References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender:Reply-To: Content-Type:Content-ID:Content-Description; bh=OsGw+Kta3YWjQfJb2PytPQ2Q1ww6/aja6t5dfRe0Qq4=; b=rMDBeLPmVy/kg7VjEW0+V+mfrZ lKyuBvqhfx1BjW9Zuwx44oDQcbTer4re2OMXNroGqqGxQhEAf2SSYunPi/vpenpVcDBDCoVE1Snen 1eFC9Wns0R6xq9fq2jKRtj6r6IO0MxL6T/YimB5wQY8ItbD2uI7GphlMWfK5Y7sVrwoOF/1WhR34z Y8HnMMK0+lAeaswImqwwHTbCM4jjuUw+7MST7gy/EVKYwTvAaLoR6N7jGY3p+YwvhpVCH5lyC7B+U MnToir81ROGosZPKkD/HG2y3Q9I/Jag2e1EmeqAYvNGojQTho3bVX8Zp8n8qvubagR8ZVl/B+IUhB kfLELGYA==; Received: from willy by casper.infradead.org with local (Exim 4.94.2 #2 (Red Hat Linux)) id 1pX7fJ-0018q2-M1; Tue, 28 Feb 2023 21:37:41 +0000 From: "Matthew Wilcox (Oracle)" To: linux-mm@kvack.org, linux-arch@vger.kernel.org Cc: "Matthew Wilcox (Oracle)" , linux-kernel@vger.kernel.org, Heiko Carstens , Vasily Gorbik , Alexander Gordeev , Christian Borntraeger , Sven Schnelle , linux-s390@vger.kernel.org Subject: [PATCH v3 21/34] s390: Implement the new page table range API Date: Tue, 28 Feb 2023 21:37:24 +0000 Message-Id: <20230228213738.272178-22-willy@infradead.org> X-Mailer: git-send-email 2.37.1 In-Reply-To: <20230228213738.272178-1-willy@infradead.org> References: <20230228213738.272178-1-willy@infradead.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspam-User: X-Rspamd-Queue-Id: 8C1F180019 X-Rspamd-Server: rspam01 X-Stat-Signature: xqgaxkb6hzsifj7qr8hwic8nxno5h3yw X-HE-Tag: 1677620266-69089 X-HE-Meta: U2FsdGVkX19qOH89xnsJzC3wXcTxxwPek/tlRohZf8kNnVslDTsNhheNwN7/7CDeN0frqGod9XnTxd70oKhhAhcaodbP9Kl8G2hy75DOKLHrHDsn4DFrH6WPrtLiMfOi6tXnlJtLqxYIm2fSfgxHRcg3ui7w0RrIOfAhVb/V1AtmEjhbBeXWe7+VMRUgicG78Da6nFPltXiPbDw6K0sbSnlNFHMlZKLNWAMW8TOgamjTLIzH7MglKlbSxtNHZ8FxR5bLUdtgHBYo/7OhJwDl21lkTkBdh1uvQ6BMTA9o7xrz5kjfEzsWo4hPAIw6EXY4eU9WGKSAMovhu2uOT7IYkLVHgAa0a9M0FhqW3InAB+qA4u6+qOz5BLmUudU5jHYPwVWjxpWSwCeU5ByQHxMBGQo7CpUE1RN37dryjEU8HLQ0daZvlETK+74qkpySvc34VhS8Hy9xXomuB2AIVjmPchN0nhgkxyHR8hXER8UL49QYguOlyrYLobn0CIVHPAYUdQbV07/ZPOtS//oiFbfqDNwukNSj7UyiaNQc9UlPh83mM0PYA4Vm1cMJyI64g0Yn6XQOGQTF9OsUyRTgXhngBMvZNU0t8XW0mGtKv9iGEls2MP5C8liz+ztcz8qlgRPXTMOeR8GRLuLzWKvasM+tu88kqbKdViUV34x0H/FHL1mISVbvqHVuODakpAdcIWCvrJbBECYQEaf+sYcKVbcerWb0HpeK+wN/MjHZgdMcpQdOpeQN0i8zYsAG7wzL1Jv79jgwjYJxbb9YqD/1Xv4SehjzLApWPT82feWDdvOqAnF0vML9wC5FaWMY+SRi6TQucXU2EFVOJMKnpZTQv114vqpLur8lcU8QkHFG3DvV69yayDTDSfInfyogf++vzy2C/Sb2oxayvs6Gu+XyD5fCK6Kj7Vpbo5x7N/eKOeBMdam1H3JVLSlJ/JGq01DZQRQCThHtRvdPMIZUWtemStw wn2cOZhI 0NGp6BsMnTbj+CZ3PWI0Ka6iAmbbI14/Fef1WWCWfer8SMm6rxD3wQ26H/Hg1MwSFDSaT61zhDeJ9n6iVuRkYarhvfKNBdgpia9Yf5EBbc9fUwY+U6594KLi3ollrsY6nMiYs9zYaL70L2h5IfVRJB0RxTvohxzKEfZYpp+yxXKXqjZ33fCyth/FI4m0mXDZ69wxLteXNRPk0gnM7rWSO58yWqGHH7zwy3MniExY1wip1lQKETj2Jtn7nfXzRaGSD35DlFtJ1IUaaO1SoOApxflEehQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Add set_ptes() and update_mmu_cache_range(). Signed-off-by: Matthew Wilcox (Oracle) Cc: Heiko Carstens Cc: Vasily Gorbik Cc: Alexander Gordeev Cc: Christian Borntraeger Cc: Sven Schnelle Cc: linux-s390@vger.kernel.org --- arch/s390/include/asm/pgtable.h | 34 ++++++++++++++++++++++++--------- 1 file changed, 25 insertions(+), 9 deletions(-) diff --git a/arch/s390/include/asm/pgtable.h b/arch/s390/include/asm/pgtable.h index 2c70b4d1263d..46bf475116f1 100644 --- a/arch/s390/include/asm/pgtable.h +++ b/arch/s390/include/asm/pgtable.h @@ -50,6 +50,7 @@ void arch_report_meminfo(struct seq_file *m); * tables contain all the necessary information. */ #define update_mmu_cache(vma, address, ptep) do { } while (0) +#define update_mmu_cache_range(vma, addr, ptep, nr) do { } while (0) #define update_mmu_cache_pmd(vma, address, ptep) do { } while (0) /* @@ -1317,21 +1318,36 @@ pgprot_t pgprot_writecombine(pgprot_t prot); pgprot_t pgprot_writethrough(pgprot_t prot); /* - * Certain architectures need to do special things when PTEs - * within a page table are directly modified. Thus, the following - * hook is made available. + * Set multiple PTEs to consecutive pages with a single call. All PTEs + * are within the same folio, PMD and VMA. */ -static inline void set_pte_at(struct mm_struct *mm, unsigned long addr, - pte_t *ptep, pte_t entry) +static inline void set_ptes(struct mm_struct *mm, unsigned long addr, + pte_t *ptep, pte_t entry, unsigned int nr) { if (pte_present(entry)) entry = clear_pte_bit(entry, __pgprot(_PAGE_UNUSED)); - if (mm_has_pgste(mm)) - ptep_set_pte_at(mm, addr, ptep, entry); - else - set_pte(ptep, entry); + if (mm_has_pgste(mm)) { + for (;;) { + ptep_set_pte_at(mm, addr, ptep, entry); + if (--nr == 0) + break; + ptep++; + entry = __pte(pte_val(entry) + PAGE_SIZE); + addr += PAGE_SIZE; + } + } else { + for (;;) { + set_pte(ptep, entry); + if (--nr == 0) + break; + ptep++; + entry = __pte(pte_val(entry) + PAGE_SIZE); + } + } } +#define set_pte_at(mm, addr, ptep, pte) set_ptes(mm, addr, ptep, pte, 1) + /* * Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to. -- 2.39.1