From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-14.2 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 63741C07E95 for ; Wed, 7 Jul 2021 14:49:28 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id E30E461C72 for ; Wed, 7 Jul 2021 14:49:27 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E30E461C72 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=gmail.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 80A146B0036; Wed, 7 Jul 2021 10:49:27 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 7E1976B005D; Wed, 7 Jul 2021 10:49:27 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 683756B006C; Wed, 7 Jul 2021 10:49:27 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0151.hostedemail.com [216.40.44.151]) by kanga.kvack.org (Postfix) with ESMTP id 4664D6B0036 for ; Wed, 7 Jul 2021 10:49:27 -0400 (EDT) Received: from smtpin19.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay02.hostedemail.com (Postfix) with ESMTP id A32D625F22 for ; Wed, 7 Jul 2021 14:49:26 +0000 (UTC) X-FDA: 78336075132.19.035FD63 Received: from mail-lj1-f176.google.com (mail-lj1-f176.google.com [209.85.208.176]) by imf26.hostedemail.com (Postfix) with ESMTP id 4AAC420019D3 for ; Wed, 7 Jul 2021 14:49:26 +0000 (UTC) Received: by mail-lj1-f176.google.com with SMTP id t30so3032412ljo.5 for ; Wed, 07 Jul 2021 07:49:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:date:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=4Vn+em1ID7ATdxCUA5IBEHrTiU+3PNuM9csIImsnZbc=; b=Zlq24O50WWP45T38/kEVFhaAkqqzwT7Ed8S+ZwVjEDWxTuYEayH8ZTypGlpMTbkKf5 b0ZE32ZadrUa0l91Z+oMIhYvd74uIbmOW7Hctd9J7XpqoJAbiPM6iuDb0x1LW68IlAzw bAqg+Ly+Zft9sx/MhJ7qtnpaLEitgMryf2ypy+iQ/HofEPCWQDLEk0pVRbKchlA0ODgP 7JLVv8BVbTLuCzH5+jcDGaO2duzQ4KOt5iIFg/9JRKt8YQN9PXYWF5K2hYP/l0xQDtzp vF+yPPW+5lyzVRy+udzx2ncIj9e0lBzBTRvU2RFORziWLNYUXP/ERk+nLl8L+EzMX0MT lyjw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:date:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=4Vn+em1ID7ATdxCUA5IBEHrTiU+3PNuM9csIImsnZbc=; b=OdrJZV7q/BUgCuSkJyZyjUCEhDaEOwNRLX2hgGYqy6ghhnREHyKTwKSn/6yDkwcSp7 bT9U9pb2dHUA9PqLbHzGUq96zsobnkSkK7yBq66+Kk3tARjXJ9Aglb3QDTBgIC32Eq34 YzmYjOb+ZLwvFy3hyy4NaCUl8dF2zyQZMvKS/VWZv1/yJShhj4ciCeOLKl3RJmP64yan bkvAKhoCejqUBrO4XkqSfmEQ2K3yHQmuS5O1Is6S5YNhmF2zZBZV6RjL6ChUKhtWmSoT Q2kIIjRlDgwHPA3nvdKGAGR6uhqs0MvzyWXEYdTInL9cbhxoU0dwyQL9DObkigxM0slc Cquw== X-Gm-Message-State: AOAM533nv7yzz/IsOXdld+A+ratkbHtvi3YQpHC/JbAz1PGWp6L6C+rw LrHHtV6yuP4MQnPfmmuCNuk= X-Google-Smtp-Source: ABdhPJyJPXRoC4JT8C/knZ1R9nSnqASINy4wLHxvoEuE3hPsUPVsQiY/TIQxVS/ngtkA+4iQRcnCGg== X-Received: by 2002:a2e:8850:: with SMTP id z16mr2117588ljj.90.1625669363318; Wed, 07 Jul 2021 07:49:23 -0700 (PDT) Received: from pc638.lan (h5ef52e3d.seluork.dyn.perspektivbredband.net. [94.245.46.61]) by smtp.gmail.com with ESMTPSA id u11sm1506554lja.129.2021.07.07.07.49.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 07 Jul 2021 07:49:22 -0700 (PDT) From: Uladzislau Rezki X-Google-Original-From: Uladzislau Rezki Date: Wed, 7 Jul 2021 16:49:21 +0200 To: Andrew Morton Cc: "Uladzislau Rezki (Sony)" , linux-mm@kvack.org, LKML , Mel Gorman , Christoph Hellwig , Matthew Wilcox , Nicholas Piggin , Hillf Danton , Michal Hocko , Oleksiy Avramchenko , Steven Rostedt Subject: Re: [PATCH v2 1/2] mm/vmalloc: Use batched page requests in bulk-allocator Message-ID: <20210707144921.GC1863@pc638.lan> References: <20210705170537.43060-1-urezki@gmail.com> <20210706132653.8374852963b25989e360d599@linux-foundation.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210706132653.8374852963b25989e360d599@linux-foundation.org> User-Agent: Mutt/1.10.1 (2018-07-13) X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 4AAC420019D3 X-Stat-Signature: 5a53cn7bc5rurwzepmnfzew4dbcddpet Authentication-Results: imf26.hostedemail.com; dkim=pass header.d=gmail.com header.s=20161025 header.b=Zlq24O50; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf26.hostedemail.com: domain of urezki@gmail.com designates 209.85.208.176 as permitted sender) smtp.mailfrom=urezki@gmail.com X-HE-Tag: 1625669366-158523 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Tue, Jul 06, 2021 at 01:26:53PM -0700, Andrew Morton wrote: > On Mon, 5 Jul 2021 19:05:36 +0200 "Uladzislau Rezki (Sony)" wrote: > > > In case of simultaneous vmalloc allocations, for example it is 1GB and > > 12 CPUs my system is able to hit "BUG: soft lockup" for !CONFIG_PREEMPT > > kernel. > > > > > > ... > > > > are obtained, i.e. do batched page requests adding cond_resched() meanwhile > > to reschedule. Batched value is hard-coded and is 100 pages per call. > > > > Signed-off-by: Uladzislau Rezki (Sony) > > Can we please have a Fixes: for this? > > Is this fix important enough for 4.14-rcx? I think so... > > > --- a/mm/vmalloc.c > > +++ b/mm/vmalloc.c > > @@ -2785,10 +2785,32 @@ vm_area_alloc_pages(gfp_t gfp, int nid, > > * to fails, fallback to a single page allocator that is > > * more permissive. > > */ > > - if (!order) > > - nr_allocated = alloc_pages_bulk_array_node( > > - gfp, nid, nr_pages, pages); > > - else > > + if (!order) { > > + while (nr_allocated < nr_pages) { > > + int nr, nr_pages_request; > > + > > + /* > > + * A maximum allowed request is hard-coded and is 100 > > + * pages per call. That is done in order to prevent a > > + * long preemption off scenario in the bulk-allocator > > + * so the range is [1:100]. > > + */ > > + nr_pages_request = min(100, (int)(nr_pages - nr_allocated)); > > Yes, they types are all over the place. > > nr_pages: unsigned long > nr_allocated: unsigned int > nr, nr_pages_request: int > > Can we please choose the most appropriate type and use that > consistently? > Let me think over it to see what i can do. -- Vlad Rezki