From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7EBF1C48BC4 for ; Fri, 23 Feb 2024 09:34:46 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E04136B0071; Fri, 23 Feb 2024 04:34:45 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id DB3BC6B0072; Fri, 23 Feb 2024 04:34:45 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C7D156B0074; Fri, 23 Feb 2024 04:34:45 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id B4E396B0071 for ; Fri, 23 Feb 2024 04:34:45 -0500 (EST) Received: from smtpin25.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 827AF140CB5 for ; Fri, 23 Feb 2024 09:34:45 +0000 (UTC) X-FDA: 81822558930.25.019A749 Received: from mail-lf1-f49.google.com (mail-lf1-f49.google.com [209.85.167.49]) by imf09.hostedemail.com (Postfix) with ESMTP id 559B3140008 for ; Fri, 23 Feb 2024 09:34:43 +0000 (UTC) Authentication-Results: imf09.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=JNJkC3Eg; spf=pass (imf09.hostedemail.com: domain of urezki@gmail.com designates 209.85.167.49 as permitted sender) smtp.mailfrom=urezki@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1708680883; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=URjY1d9IzlvjqbTTQXHELWVs3EPiLz70xCmc8FLhHfE=; b=KZ9yc1OnrYOsMqCFo4U+GEBtz7onX6NEbnZYZYnwCAvZ+oLTkcv/OvX6CcJhMOJV1UWL1r X8g2xwvmOQ34+pGsqRE5GrS1fiikDRPeZFdp4fDjn8nNPNVZQUVKns0ZQerFFWIVwMMOsI ChNsdRlhhzYCLeZtGSRVWq76oFbs/k4= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1708680883; a=rsa-sha256; cv=none; b=5isIGTAF8dP5QrW1lAotzy1c1lGJv7ybIMIQMBNlds4Mw91MK9Gl7cz2icTw7c3e1adiw2 /3hUYegAE6U9HgHkJYd1ibzkhfkQ7YsR5XWcT6a1Z1IxCMf3URxItxLM/lc4qEzrRp+JtZ 2ioymkxn6e5YAgWgPwipUAU4LVpSP4Q= ARC-Authentication-Results: i=1; imf09.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=JNJkC3Eg; spf=pass (imf09.hostedemail.com: domain of urezki@gmail.com designates 209.85.167.49 as permitted sender) smtp.mailfrom=urezki@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-lf1-f49.google.com with SMTP id 2adb3069b0e04-512a65cd2c7so967641e87.0 for ; Fri, 23 Feb 2024 01:34:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1708680881; x=1709285681; darn=kvack.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:date:from:from:to :cc:subject:date:message-id:reply-to; bh=URjY1d9IzlvjqbTTQXHELWVs3EPiLz70xCmc8FLhHfE=; b=JNJkC3EgXA8B35yo0CWODSmxGC95mPH0cZU+H3MnhVz63JXxtvtEdDAT767wCaWQnh UEDdyAYJmIjbJ19IMPyumg+9zC6fiUJdNh6YU0iLO60m+PV3059lpa18Y4k17xr/kY5w VJr5xIQGuQOxuEboFPNags6fe/y7P4ZKd0/7rrp0C6RWCCCiZdTHQ2fhe0WcGMSorwok FLT1BR+8nhsUvN0mDgqXWkWRR9+kzGH5lCsWDkJK87Yt563vesruoaqGMZkYNdP01j5f 3JRiipaTv0SPPrdeKY1onfFXFVcQJCBUxyjWvHtUEu1mMrV0TIukTqEL8pp/tTl7OpqX DRMA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708680881; x=1709285681; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:date:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=URjY1d9IzlvjqbTTQXHELWVs3EPiLz70xCmc8FLhHfE=; b=QGxGj8O4dlOZ9Pa2VwR7p2+D4Hc8ZHTybTaoUa8wQA7+TQdO9DD9ZVvWJ14mIwine5 wFUYoHJWsnkSJVJh7NpXBdig0eA+j9ftK6Z2FWKAOmXO45GR1sb27FWAPhGygm1yZbe8 Xo0hkn4v8Kb5wQT83hSIolpWwDW3zD+VwoQ56oKOkv/WUZ5FvyUW5s0ZdyZwrPxv70Cp 9fgs+lOIC5TdPE0Dp9PNo3Dgn6tVqnTVQnF/3kCCZ9bdBWkDDBLn/nQPyk2pQilAhtse iaG++UQrPVP8YoZiPvUgB8tRzmXxKDLjMbPAL/k0FWmPkC15QQif7NkFvQh/1kW+wCf2 iFqA== X-Forwarded-Encrypted: i=1; AJvYcCXuKNoeIk1TmgnaYRJEYQ8fzNhN0fBHXAUFwyC0bu6uSRSIO5aivjT/NktH/NXasJYoNjDF/+xXetXDB5RaihYDyGo= X-Gm-Message-State: AOJu0YwKg/Wta/GPchV3B1cpfVCJNOAImcwOKIg0TjQeHm+19wtDnIOD j4EaAkkP4qbDEGOepKztEVR794sIhZ8AOozLKMBIvVFHhXXKolIL X-Google-Smtp-Source: AGHT+IGJd3oti1UYMtI8P32WOSvRQ26F7V5U1YuI/6f+U1Kr/lA344defddV3yuQs83g91ExLQHN7A== X-Received: by 2002:a05:6512:1308:b0:512:b915:606a with SMTP id x8-20020a056512130800b00512b915606amr1363676lfu.12.1708680881156; Fri, 23 Feb 2024 01:34:41 -0800 (PST) Received: from pc636 (host-90-233-206-150.mobileonline.telia.com. [90.233.206.150]) by smtp.gmail.com with ESMTPSA id z6-20020ac25de6000000b005119498ba1dsm2389717lfq.198.2024.02.23.01.34.39 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 23 Feb 2024 01:34:40 -0800 (PST) From: Uladzislau Rezki X-Google-Original-From: Uladzislau Rezki Date: Fri, 23 Feb 2024 10:34:36 +0100 To: Pedro Falcato Cc: Uladzislau Rezki , Matthew Wilcox , Mel Gorman , kirill.shutemov@linux.intel.com, Vishal Moola , Andrew Morton , LKML , Baoquan He , Lorenzo Stoakes , Christoph Hellwig , "Liam R . Howlett" , Dave Chinner , "Paul E . McKenney" , Joel Fernandes , Oleksiy Avramchenko , linux-mm@kvack.org Subject: Re: [PATCH v3 00/11] Mitigate a vmap lock contention v3 Message-ID: References: <20240102184633.748113-1-urezki@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Rspamd-Queue-Id: 559B3140008 X-Rspam-User: X-Rspamd-Server: rspam11 X-Stat-Signature: cc44h4gryproo3ne81zergmq5domnioa X-HE-Tag: 1708680883-296785 X-HE-Meta: U2FsdGVkX1+xcPblZQlhd2ZYcSxucW9xOZ351coO/TphLao5ny5jdWoOuQ2cUm8TzAU3eLrrmweQwq5vEZedhYUyelpMoTFIIEFUNt/Syxx/SVm3CAfbei88b+Uk0f/qlcRTSn8algiTz8qs2yPTc57LvKJxqwbG1A0nAe/x7RSx7dKxayqYa59mWOANVKG+gy3t2dEtHKCWAjlTdvjz7Zp+asvfAcC359W0zf/oCDg3DqQUZ9U5bZCAjHt3Lh6dGQwU3mdVkojdw5f8FOixBMsQNFETVzU0w7HOYorfQQtB61BwHuFX0ydlmYqBeHfVI9v42M9L6FpMwdCdNVb8oxDXtfkGPIHfy9KVEfyeSh2UjeHVd3Acly48vpM9bO9DMRgMycZoYFxr+d8wOBDbQq8ATx4XGAlkq1Y0WattqOFmlUCY5lrsA7PNllLCvUpkoLfyDLDguCVPA8cPzyotQBLKGLOA9vnJ1eBdn5r7oX+1egSIBYloYWUE7wgGSFdRqbfAdBHevPT0ayNCs9dp6bH8zNDJgYekOZ+nvLO/Xl0J2Ng2xMFVBBZ+WyDxeiZBafVQRRC82Kw8jSXyqNaXQ4d3r7lawW1aLNSFWHwQ5LzFGhi+E3dTO6QT9eiGLvVV4Md/O5Cm2rVFriOYx/gL6ZXaExzdzVsarlgY7j4eCm/86no0uFVGU9LObHfKBZErNYkYjnQxmwL3QvwWbO0VvIDRWDsnn8viiWRbwEdipl3YRc4EIax3mJkhmLKxQmVq+HSZrtYgOu/4W1aXg1Zxgtk1ibwW0ECHHl1YxN0NzRM4gxwqztIFK6j9rEGNcrJb02yIALylD7+HnXXaWN1DSykHS6hwq5la97WB+Xxr/WsL0W6vjMms7k3jbJCiMfZWHYNzOJ7C+Xq9/YJxdkhArASrAGZg+q+tlJaR9zcbv61/GmjTj72HDVEfrzaTpVLguFiL+LvgwH/teReRNSu rLA6hpm3 FALk1l/WVyV3PxM6YS2BSOjzfIn0g22kr528JHXGyVg5X8GRf5qcjjghxF0lsYx7Gh8oSGIXU7WGH7X1X9t5Y/n8CFjB/XYgExPvPT596fJiFPi2L9K6vA1DbpiYFNCH61H7Pkc4o3j4sMCDRDcA4pnTjNlqxjDa4NeKVWN9tFdLSYJG8V0TIL1Kt0WRaH/GMwRq0WJc9vnSP6bEzZ8YCukwlSjUBj3lgefp40/NQmw2i2+lO7D+nZVq46NrEdVVKvmOtJntjvJNDKzRhJoo/EbLJKTatridZg32dFEAkH6TqNSvNZZZjWPi84tPOhbU63ffTyIiW61X6dsO1Iy1LyDWgRq6WK4yIYFQaCBCh8pGmRnXFgsk6V9hZ5CQCVYZZlWiQgVULzU2DxI7kgKV9MySRG7QWlaXV6avcg53LtvTRoj5lrTiWw+kJsD+CtbzJFVnX8Osf1h/gISVupWqNyIGiIHJpPa0k0ImGiI2Z/yeSif/6qwfhMdNhvFSYhqaMOZ7sElwozXdvAZvgp+hDs05Vwg== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Thu, Feb 22, 2024 at 11:15:59PM +0000, Pedro Falcato wrote: > Hi, > > On Thu, Feb 22, 2024 at 8:35 AM Uladzislau Rezki wrote: > > > > Hello, Folk! > > > >[...] > > pagetable_alloc - gets increased as soon as a higher pressure is applied by > > increasing number of workers. Running same number of jobs on a next run > > does not increase it and stays on same level as on previous. > > > > /** > > * pagetable_alloc - Allocate pagetables > > * @gfp: GFP flags > > * @order: desired pagetable order > > * > > * pagetable_alloc allocates memory for page tables as well as a page table > > * descriptor to describe that memory. > > * > > * Return: The ptdesc describing the allocated page tables. > > */ > > static inline struct ptdesc *pagetable_alloc(gfp_t gfp, unsigned int order) > > { > > struct page *page = alloc_pages(gfp | __GFP_COMP, order); > > > > return page_ptdesc(page); > > } > > > > Could you please comment on it? Or do you have any thought? Is it expected? > > Is a page-table ever shrink? > > It's my understanding that the vunmap_range helpers don't actively > free page tables, they just clear PTEs. munmap does free them in > mmap.c:free_pgtables, maybe something could be worked up for vmalloc > too. > Right. I see that for a user space, pgtables are removed. There was a work on it. > > I would not be surprised if the memory increase you're seeing is more > or less correlated to the maximum vmalloc footprint throughout the > whole test. > Yes, the vmalloc footprint follows the memory usage. Some uses cases map lot of memory. Thanks for the input! -- Uladzislau Rezki