From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 775F1C43215 for ; Tue, 3 Dec 2019 06:03:32 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 15FC2206E0 for ; Tue, 3 Dec 2019 06:03:31 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=linaro.org header.i=@linaro.org header.b="rwTTgtN9" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 15FC2206E0 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linaro.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 7A4236B02B9; Tue, 3 Dec 2019 01:03:31 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 752636B02BA; Tue, 3 Dec 2019 01:03:31 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 61AFC6B02BB; Tue, 3 Dec 2019 01:03:31 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0246.hostedemail.com [216.40.44.246]) by kanga.kvack.org (Postfix) with ESMTP id 4CEF26B02B9 for ; Tue, 3 Dec 2019 01:03:31 -0500 (EST) Received: from smtpin05.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with SMTP id E99D72495 for ; Tue, 3 Dec 2019 06:03:30 +0000 (UTC) X-FDA: 76222788180.05.lamp22_18521bf8b403 X-HE-Tag: lamp22_18521bf8b403 X-Filterd-Recvd-Size: 6788 Received: from mail-ot1-f65.google.com (mail-ot1-f65.google.com [209.85.210.65]) by imf21.hostedemail.com (Postfix) with ESMTP for ; Tue, 3 Dec 2019 06:03:30 +0000 (UTC) Received: by mail-ot1-f65.google.com with SMTP id z25so1906737oti.5 for ; Mon, 02 Dec 2019 22:03:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=em0mwcnekNPSrQ/TlvXcfMqa65n+WTC4RKGqGuPqh0E=; b=rwTTgtN9QbUVjkYn/DftNihRoNzWlKozTXKK/Oz6EFiI5FCqNX3eA84Ik8dRuF6uYZ fCpfslNuibOwIMTM8B6vcT82vvAxvndKCEQVWFa/W7ZYPo5Jzzxwd4YYtTRhOccZ+sd0 v/KFd7bfR/bhY/p4sv6qW5SZLwZlHpEwTw59RoYxzG8SraSQxdLkXRL30s7tjJUFFcKZ qOTz6F+tUWH3tYfZC6ysvC5G4w28oNKF8gfoDV4lyrTARKXv8vUV2tB/AkcUPdmw2XbR h/huoCaLj6772I7cwpfHgH/ZdYGfc13dvkKgH3c9tA9IR/l8unPzFyY1pMcA42zsUTso /y+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=em0mwcnekNPSrQ/TlvXcfMqa65n+WTC4RKGqGuPqh0E=; b=G3Xeu3snGFM/M+c8vam51EacrJ3a6VssD2DHsHmXjWqcVNjQjIpab9A2ATd7IDkGLg qX9bvdMO0biceUVyVqt4zbAPYb2/kDrmG3vcY1st2YzVI/d9cUZIXleY6CDMiH8rJtuG 56UkzncWTPuiHfMTeV6lKmQTnYWJ0v04TxMLOg5qgxSdaWR7j0al9bExnC+BxxuNsguc wgIVeEWx1+J41wvl4b7HznoDZX4l5SVmuDa3apax7+5APnmQUTwZ1bLM4HW7nNoCTd9t Z1BcNrSQzysebpy0WL9jpXh2DXCKFYXEzYNJGDlEXI1PaKRw0iC4wyY9intqOjyAHLWY wFyw== X-Gm-Message-State: APjAAAVfKPIGtgJ9Esk7zTgzNp3tIDaDBbth0LF+PK4FjH3uag4RDLzp 5agyr5PjdSVaxG4JbDCiSfaWEQTDTVVwyCN2wR9Fiw== X-Google-Smtp-Source: APXvYqyUwjjUt6uilPV5TuiM+Ljl5ziWLr7U6mbVF1pTfEgj/j/jZ1ejlryeTCkLK1bytyv33a+7IyXMakumOsoc9E0= X-Received: by 2002:a9d:3af:: with SMTP id f44mr1989987otf.332.1575353009553; Mon, 02 Dec 2019 22:03:29 -0800 (PST) MIME-Version: 1.0 References: <20190911182546.17094-1-nsaenzjulienne@suse.de> <20190911182546.17094-4-nsaenzjulienne@suse.de> In-Reply-To: From: John Stultz Date: Mon, 2 Dec 2019 22:03:17 -0800 Message-ID: Subject: Re: [PATCH v6 3/4] arm64: use both ZONE_DMA and ZONE_DMA32 To: Nicolas Saenz Julienne Cc: Catalin Marinas , Christoph Hellwig , wahrenst@gmx.net, Marc Zyngier , Rob Herring , linux-arm-kernel , Florian Fainelli , Robin Murphy , lkml , linux-mm , mbrugger@suse.com, linux-rpi-kernel@lists.infradead.org, Will Deacon , Marek Szyprowski , Bjorn Andersson , Amit Pundir , Nicolas Dechense Content-Type: text/plain; charset="UTF-8" X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Dec 2, 2019 at 9:38 PM John Stultz wrote: > On Mon, Dec 2, 2019 at 9:08 PM John Stultz wrote: > > Hey Nicolas, > > Testing the db845c with linus/master, I found a regression causing > > system hangs in early boot: ... > > In the above log: > > [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: -188245 > > looks the most suspect, and going back to the working a573cdd7973d + > > build fix I see: > > [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 957419 > > > > Do you have any suggestions for what might be going wrong? > > Digging further, it seems the error is found in calculate_node_totalpages() > real_size = size - zone_absent_pages_in_node(pgdat->node_id, i, > node_start_pfn, node_end_pfn, > zholes_size); > > Where for zone DMA32 size is 262144, but real_size is calculated as -883520. > > I've not traced through to figure out why zone_absent_pages_in_node is > coming up with such a large number yet, but I'm about to crash so I > wanted to share. Ok, narrowing it down further, it seems its the following bit from the patch: > @@ -201,13 +212,18 @@ static void __init zone_sizes_init(unsigned long min, unsigned long max) > struct memblock_region *reg; > unsigned long zone_size[MAX_NR_ZONES], zhole_size[MAX_NR_ZONES]; > unsigned long max_dma32 = min; > + unsigned long max_dma = min; > > memset(zone_size, 0, sizeof(zone_size)); > > - /* 4GB maximum for 32-bit only capable devices */ > +#ifdef CONFIG_ZONE_DMA > + max_dma = PFN_DOWN(arm64_dma_phys_limit); > + zone_size[ZONE_DMA] = max_dma - min; > + max_dma32 = max_dma; > +#endif > #ifdef CONFIG_ZONE_DMA32 > max_dma32 = PFN_DOWN(arm64_dma32_phys_limit); > - zone_size[ZONE_DMA32] = max_dma32 - min; > + zone_size[ZONE_DMA32] = max_dma32 - max_dma; > #endif > zone_size[ZONE_NORMAL] = max - max_dma32; > > @@ -219,11 +235,17 @@ static void __init zone_sizes_init(unsigned long min, unsigned long max) > > if (start >= max) > continue; > - > +#ifdef CONFIG_ZONE_DMA > + if (start < max_dma) { > + unsigned long dma_end = min_not_zero(end, max_dma); > + zhole_size[ZONE_DMA] -= dma_end - start; > + } > +#endif > #ifdef CONFIG_ZONE_DMA32 > if (start < max_dma32) { > - unsigned long dma_end = min(end, max_dma32); > - zhole_size[ZONE_DMA32] -= dma_end - start; > + unsigned long dma32_end = min(end, max_dma32); > + unsigned long dma32_start = max(start, max_dma); > + zhole_size[ZONE_DMA32] -= dma32_end - dma32_start; > } > #endif > if (end > max_dma32) { The zhole_sizes end up being: zhole_size: DMA: 67671, DMA32: 1145664 NORMAL: 0 This seems to be due to dma32_start being calculated as 786432 each time - I'm guessing that's the max_dma value. Where dma32_end is around 548800, but changes each iteration (so we end up subtracting a negative value each pass, growing the size). thanks -john