From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id AC754C761A6 for ; Tue, 21 Mar 2023 20:46:31 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1DF3C6B007E; Tue, 21 Mar 2023 16:46:29 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 09FA9900003; Tue, 21 Mar 2023 16:46:28 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id D243D900002; Tue, 21 Mar 2023 16:46:28 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id B20F16B007E for ; Tue, 21 Mar 2023 16:46:28 -0400 (EDT) Received: from smtpin26.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 7B549A97E8 for ; Tue, 21 Mar 2023 20:46:28 +0000 (UTC) X-FDA: 80594088456.26.7E80505 Received: from mail-wr1-f49.google.com (mail-wr1-f49.google.com [209.85.221.49]) by imf16.hostedemail.com (Postfix) with ESMTP id 76F7418001B for ; Tue, 21 Mar 2023 20:46:26 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=Si1QRuxn; spf=pass (imf16.hostedemail.com: domain of lstoakes@gmail.com designates 209.85.221.49 as permitted sender) smtp.mailfrom=lstoakes@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1679431586; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=b3A7zhEdmBF2TYjJBu5Iah25JwVoEB2AzBhKfUOeukc=; b=TO1X0xwMRyUIuKBBcUvgw20/yU5siSMwxr2jAqBD+4wkUG5lLD/D7aIAOl6V0JzzqwXBbv Al2epL3yw0XvDyciPpRy2AHimrzzhqLdZPLAFk5/GnwMHwtep5iHwQz7nwEK1jjMuyDA7V 85ZiwyH4Az1h3oM0yB2FK51M6l22jT4= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=Si1QRuxn; spf=pass (imf16.hostedemail.com: domain of lstoakes@gmail.com designates 209.85.221.49 as permitted sender) smtp.mailfrom=lstoakes@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1679431586; a=rsa-sha256; cv=none; b=DaTM2J5iy3Vm/9RCaPB0cU7dQEaenbv7lVAD/Htx8MKjVcAtFcC6CRC1ChKKxREe/K3Q6p ZYggzNxurnP1HEbY221Am+bsscHJoxAUKSLvC1onEukD842FhZ2q9/dQL0VsbZraaqjbYq Yl2a1RQBkKfPJbC7NMBG+DFVnfcajCI= Received: by mail-wr1-f49.google.com with SMTP id l27so6715747wrb.2 for ; Tue, 21 Mar 2023 13:46:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1679431585; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=b3A7zhEdmBF2TYjJBu5Iah25JwVoEB2AzBhKfUOeukc=; b=Si1QRuxn5Wu2XpFAVHrpMm1EIBmuD13xyfMdQ3T0gsrkBCvpixAW/BB8wP+A+sV7n3 raxCrwZ/uVQ6B/Yr02ncqpG5sVrOxxR9G9eX1kO2NJx0UwhhMJ56+9mcSAwx5KmHhhrx OmvKgHySY1tnqYuaI483mHiNOomaeG/w7rcfgzX41Rh8GYzd9Oc4+UW0T+HCJ4dXnj0R x0eQLjTkQezRhA2mi6Kl+ZSZi/X6ar/jV+W/jamlBwfbBchWUS60IORb7tbIO6YoP35p fgIcKI2i54YcmMelvTnmdF0RW8x5EXzwMNZaCLICviJ1bDe4404u2iJKJuHMMOf/N4mP jeWg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1679431585; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=b3A7zhEdmBF2TYjJBu5Iah25JwVoEB2AzBhKfUOeukc=; b=crE+dYTqEg/D/F1JxKXsQ1ZADP5KHSfhujFoEj6sKl9z49SbRylEk5nf8v5wZkaI0k FF8kv9S5QTpFSThbN3t1mxoNQy3F/X+46TttKjDeQicktCz77mPerM3vmwhZ+3vPwAaI v36T+zkXHIwXPdigZFJvjwD7IgvkJKrGccvrDU3/Ek6q/UqDpw/UoFmZeuU0b0gaJumF J7OBP612f0AMy+RpfNrEU4k/pwp3mY2L6KGVl+hK/zJE0ekNodJ8rZrWqKVyaMgh4eYC GGga2EckIBHNpcRQ3IFyfQQB49yE+Pa16yYBPohUxKMoL9LtDknWHzdHEiGsR5wgRUQL Xw4A== X-Gm-Message-State: AO0yUKU1YejSFBbrLk2zcMAoIiDCil92MC65dlXsRj0ASl4WTmca2mrn LeplcaHv6xCv8N0n1a0468lzWm/ROBo= X-Google-Smtp-Source: AK7set9W3aHUuRXYHcQuSsj9Z5fSBCLJOdxD6jMlO9xE5od0fFzPTWifeNMKlIUHmt3vnU5vOUODNw== X-Received: by 2002:a05:6000:152:b0:2cf:e3a9:c189 with SMTP id r18-20020a056000015200b002cfe3a9c189mr3835805wrx.3.1679431585581; Tue, 21 Mar 2023 13:46:25 -0700 (PDT) Received: from lucifer.home (host86-146-209-214.range86-146.btcentralplus.com. [86.146.209.214]) by smtp.googlemail.com with ESMTPSA id a4-20020adffb84000000b002d322b9a7f5sm12142491wrr.88.2023.03.21.13.46.24 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 21 Mar 2023 13:46:24 -0700 (PDT) From: Lorenzo Stoakes To: linux-mm@kvack.org, linux-kernel@vger.kernel.org, Andrew Morton Cc: David Hildenbrand , Matthew Wilcox , Vlastimil Babka , "Liam R . Howlett" , maple-tree@lists.infradead.org, Vernon Yang , Lorenzo Stoakes Subject: [PATCH v2 4/4] mm/mmap/vma_merge: init cleanup, be explicit about the non-mergeable case Date: Tue, 21 Mar 2023 20:45:58 +0000 Message-Id: X-Mailer: git-send-email 2.39.2 In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: 76F7418001B X-Rspam-User: X-Stat-Signature: 6c3xg89qyt96t9mme1ijdtj4qj6n556y X-HE-Tag: 1679431586-540371 X-HE-Meta: U2FsdGVkX18oK///FVCvBFuW3zmoekweTK3N+w9VdlP0mQCcVTWxOygBFosDCkS5hWCEvZVXu2qqIKJ9O/4UY9w8ePJvOXwLJ3oqDL0ngEBEkzpEeSjnBjZ4h2j0slm9aGAPM98ScxrWyO7DDL3pUOMnR+4nxiB0xPGtbUT/z2DfVafyYOC4dqvVfItb0lT0fdGI3nUZOckRK2Lg779Y6SprD6YAdfu+UaYZ9zGkmiaXmWJ/0C/f36oa+Yj2n+fxbAXqspZATJY//0WwGwSQ6OTsN1TBFjIXjf+naZ+8jCbiI1nsPSWgFK6xn7E16CViRFmv4z/vv0K5KUvyxi29vsRoIuIVrhJM+t3eIhh2CRZiB9wXLz4C015zcq3sOiubgK65QNSPi4eKtAT7ut7gjmlxoPPYKH3QOujbp0/7PM6NhVdr5/JnaqXl/woyJwfNn/itRpjYcH1SMcafLhDg0ZloD72/fssd13hg/IB/fPeI1S9NvhsXrAq/4KH9LxDGQP6r6Xv3lkpdi5u9P3O7mNcsm995uV17LIW7GSk6apCDJyvYH/LpMbM+DLBkqWgrrJXY346sx38X90LNmEgJlBZEdT3uukheVBAgaLyimePU4o/qR7Vrsrmj5g42TH+URY66xRDEGkM6ZpNDgcm7kCAL4RN9BCCodZ5RJVzjFaM/U/mliLAYMaW9yjGGlC1MVLFUHgbDAjJJW28N92KljXM/UIDqgBvDuu962oJsoewMG+60mnsMqKmDV1klSWXUPpsGr3vPL17Q22qsfkIMhqUvbXhQKCKIPU8MhK9b8ke/QQjj/qG/AzNNlp70ROkAhI2sWqOTYpKJtn/TwIKKRvVfpwvCiopkc1cRA81epY8jPwQh5pIvS08aHbPyk0uobmRuvkyt2m7T/f789XeX4T3Q/uD2AejLvedGgQHZ7sAMuu3bdlVTnLAuVf62YWvIPzNrsG8LITpKlRic3nB 3nZIJHPJ d4C2T2bfygA6dQkC2YWWVghH92gb50q1wSfhqeVonHCKaPCIkjurK8QjgWAvMrnWEH3/I8Ou7BvQ0kLsedIaM+RX39I94qWGQp33VyzI77tZeSBD4fdR9KL9vhhGVCNB8rG2EO6j7jCs58ZO+U+xtUHlbxTO28gR+jgSI3grCE+5OYygOZo9wCCRkXgsHqot6MgLRKcCVFioQr7owN21pTFhtkQ7U6b7UnuLgt8vkZa+qw/ZWJhT7PG0UMgJvwUe+6f9jGEsP2jyRugFX7hJUeqkw1B2tzGz45UPYAEj3CBSucvsPOcr8sFLMD32TPa92/jHsM85ZjMt1rCetvELP6iTDWK4dnwLdwQC9fXQ9fq+FUFj7/d1gD0ajOVVzaU4fPaHv8eZtevbHdrOQZkM1i+pXSUHEYR+OaYr7y6GqOnepJwGXoMfWJ4KHOtG3MYVRjiYvJUEhdlo9vF1DsSOZXGw2i030JBB6Tnk1tWpp2wtaRxEetJXsuugYdUXbIeVQaBIN X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Reorder the initial variables sensibly and set vma_start and vm_pgoff there rather than later so all initial values are set at the same time meaning we don't have to set these later. Rather than setting err = -1 and only resetting if we hit merge cases, explicitly check the non-mergeable case to make it abundantly clear that we only proceed with the rest if something is mergeable, default err to 0 and only update if an error might occur. Move the merge_prev, merge_next cases closer to the logic determining curr, next. This has no functional impact. Signed-off-by: Lorenzo Stoakes --- mm/mmap.c | 55 ++++++++++++++++++++++++++----------------------------- 1 file changed, 26 insertions(+), 29 deletions(-) diff --git a/mm/mmap.c b/mm/mmap.c index 7aec49c3bc74..d60cb0b7ae15 100644 --- a/mm/mmap.c +++ b/mm/mmap.c @@ -909,18 +909,18 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, struct vm_userfaultfd_ctx vm_userfaultfd_ctx, struct anon_vma_name *anon_name) { - pgoff_t pglen = (end - addr) >> PAGE_SHIFT; - pgoff_t vma_pgoff; struct vm_area_struct *curr, *next, *res; struct vm_area_struct *vma, *adjust, *remove, *remove2; - int err = -1; + struct vma_prepare vp; + int err = 0; bool merge_prev = false; bool merge_next = false; bool vma_expanded = false; - struct vma_prepare vp; + unsigned long vma_start = prev ? prev->vm_start : addr; unsigned long vma_end = end; + pgoff_t vma_pgoff = prev ? prev->vm_pgoff : 0; + pgoff_t pglen = (end - addr) >> PAGE_SHIFT; long adj_start = 0; - unsigned long vma_start = addr; validate_mm(mm); /* @@ -940,6 +940,23 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, /* Is there a VMA next to a hole (case 1 - 3) or prev (4)? */ next = vma_lookup(mm, end); + /* Can we merge the predecessor? */ + if (prev && addr == prev->vm_end && mpol_equal(vma_policy(prev), policy) + && can_vma_merge_after(prev, vm_flags, anon_vma, file, + pgoff, vm_userfaultfd_ctx, anon_name)) { + merge_prev = true; + vma_prev(vmi); + } + + /* Can we merge the successor? */ + merge_next = next && mpol_equal(policy, vma_policy(next)) && + can_vma_merge_before(next, vm_flags, + anon_vma, file, pgoff+pglen, + vm_userfaultfd_ctx, anon_name); + + if (!merge_prev && !merge_next) + return NULL; /* Not mergeable. */ + /* * By default, we return prev. Cases 3, 4, 8 will instead return next * and cases 3, 8 will also update vma to point at next. @@ -951,26 +968,6 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, VM_WARN_ON(curr && (addr != curr->vm_start || end > curr->vm_end)); VM_WARN_ON(addr >= end); - if (prev) { - vma_start = prev->vm_start; - vma_pgoff = prev->vm_pgoff; - /* Can we merge the predecessor? */ - if (prev->vm_end == addr && mpol_equal(vma_policy(prev), policy) - && can_vma_merge_after(prev, vm_flags, anon_vma, file, - pgoff, vm_userfaultfd_ctx, anon_name)) { - merge_prev = true; - vma_prev(vmi); - } - } - - /* Can we merge the successor? */ - if (next && mpol_equal(policy, vma_policy(next)) && - can_vma_merge_before(next, vm_flags, - anon_vma, file, pgoff+pglen, - vm_userfaultfd_ctx, anon_name)) { - merge_next = true; - } - remove = remove2 = adjust = NULL; /* Can we merge both the predecessor and the successor? */ if (merge_prev && merge_next && @@ -985,7 +982,7 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, err = dup_anon_vma(prev, curr); } } else if (merge_prev) { - err = 0; /* case 2 */ + /* case 2 */ if (curr) { err = dup_anon_vma(prev, curr); if (end == curr->vm_end) { /* case 7 */ @@ -995,7 +992,7 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, adj_start = (end - curr->vm_start); } } - } else if (merge_next) { + } else { /* merge_next */ res = next; if (prev && addr < prev->vm_end) { /* case 4 */ vma_end = addr; @@ -1011,7 +1008,7 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, vma_start = addr; vma_end = next->vm_end; vma_pgoff = next->vm_pgoff; - err = 0; + if (curr) { /* case 8 */ vma_pgoff = curr->vm_pgoff; remove = curr; @@ -1020,7 +1017,7 @@ struct vm_area_struct *vma_merge(struct vma_iterator *vmi, struct mm_struct *mm, } } - /* Cannot merge or error in anon_vma clone */ + /* Error in anon_vma clone. */ if (err) return NULL; -- 2.39.2