From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6A962CD13CF for ; Mon, 2 Sep 2024 11:05:53 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id DDFBF8D00BE; Mon, 2 Sep 2024 07:05:52 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id D90A28D0098; Mon, 2 Sep 2024 07:05:52 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id C58E78D00BE; Mon, 2 Sep 2024 07:05:52 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id A3A708D0098 for ; Mon, 2 Sep 2024 07:05:52 -0400 (EDT) Received: from smtpin13.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 2726081B35 for ; Mon, 2 Sep 2024 11:05:52 +0000 (UTC) X-FDA: 82519518144.13.6A59F56 Received: from mail-wm1-f53.google.com (mail-wm1-f53.google.com [209.85.128.53]) by imf06.hostedemail.com (Postfix) with ESMTP id 24FA618001F for ; Mon, 2 Sep 2024 11:05:49 +0000 (UTC) Authentication-Results: imf06.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=K2Wm2voO; spf=pass (imf06.hostedemail.com: domain of pedro.falcato@gmail.com designates 209.85.128.53 as permitted sender) smtp.mailfrom=pedro.falcato@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1725275056; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=0MbDosZfxJo/aZ3i5uv8U4qMY9umFFTn/RczrTPOoH0=; b=IIa+I8G/ZwT4OVMUOFKhVtRp1hwRxzypShfiF0mut+kCrSdGRX35NUZL8Nz8SJ95YkdiX9 9prw6Rwna7BkD28vl/O6y+oTsUIhxrExiTqFuqC9CxluNN8Oc5hVDy78gwSHRAcYChq6rH fnJQMGwo8kQOiYWmKTlyDsIgCpXEH+Q= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1725275056; a=rsa-sha256; cv=none; b=nRoEEOfgVXEY+GihBjF7iLR949La5pDSFI31WytrzM9nPP+Hzz93ocxDHMx/uDlk+qJ52t HMXcMFSKTAzdYOz8xYdDg20MrFJF92eOHODDXNVgkbxUAZJgmcIVdXdAA/0voT6nPWXxev R3A+6OXJPM9fRBnpWdw/owQZNjV7ZQ4= ARC-Authentication-Results: i=1; imf06.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=K2Wm2voO; spf=pass (imf06.hostedemail.com: domain of pedro.falcato@gmail.com designates 209.85.128.53 as permitted sender) smtp.mailfrom=pedro.falcato@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-f53.google.com with SMTP id 5b1f17b1804b1-428e0d184b4so33930225e9.2 for ; Mon, 02 Sep 2024 04:05:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1725275149; x=1725879949; darn=kvack.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:from:to :cc:subject:date:message-id:reply-to; bh=0MbDosZfxJo/aZ3i5uv8U4qMY9umFFTn/RczrTPOoH0=; b=K2Wm2voOXArD+ltJlc4/EespqQcyTDgV81XeldJ3S2lpegpQ3q0E22+vorcD4p3Ns6 PEln01d6GOdprfdhl+L24gztcqycjpgrs50uZDDBJPuS7qQVRov9jS/K8zEh256m6DBI RiyxjOVGLUwlFCmgquyRKE9200tAhuGlvObVH4Oa0fjWfQcjRHfsPmPTwk8/Crer73MB 7L0il8scilFCCD3YpEBjCtvhjRSfZ59w+nIz55lp9bokVFgY1CRID9j9MiHp/+9yYkTY m9jGVB70czXQR2p8p7qyHXdwninLMD0+IAgdjR2bxopFukVQvx2R+x2Cd1QSk9K8qKhc rZwQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1725275149; x=1725879949; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=0MbDosZfxJo/aZ3i5uv8U4qMY9umFFTn/RczrTPOoH0=; b=gme/MA/uiPYCikrfXJl0+5SViZDSmr7ITL3XQvKjn6DJXJlT7qWKNsReV4Sj9rti1C y80k3jMTa/Luo9OMAJs0EQLZJCZuzpr87JIWZ6Ecqks8NhbyRkMF+8vVvkDDN5DIakSU gU/CMyblaRg0lv7N0S1FehpgtVqbwOrNaa2BZsIDZ+GCUoYunBa+fAqcOn4Rvjc3A8YZ AzueI1e1FdLL5teUsP1dPVhtLsBpcU0qQjECrDlu636g/1/svgt08xcAxC9c1Zmbp5kU 2pwMN1uT6znycJna+xCi6kThjzzWf8lzIx76ti8XlQxWGzCNJXGBjXm98Jqqft4nlc/y Yh6w== X-Forwarded-Encrypted: i=1; AJvYcCWRPdyYeEV5Tht7fNjM8qMLmMt3orNFwPsjdmX1np2GIyap8RluS+l2Xu+OczD+nlfh0vBTIgbUyA==@kvack.org X-Gm-Message-State: AOJu0YwJBTUWMUEpWEftpTFG1fttODZa3XtTVzGPhjJf9/0fRMJWVb2W ITPHAJ/jhrLJMcM2KPUnH27IpHuG6mMBoNb5cgImzqmJiP1aRAlW1O6Jpw== X-Google-Smtp-Source: AGHT+IFFvPqy/K9IaGXdZE7unN870y208ZCBIaOopV8deE+8afqsjNIUrlfSXYKrzyO9FR7H5AnxYA== X-Received: by 2002:a05:600c:4e90:b0:42b:aecb:d280 with SMTP id 5b1f17b1804b1-42c7b5d8f4bmr43546835e9.27.1725275148025; Mon, 02 Sep 2024 04:05:48 -0700 (PDT) Received: from PC-PEDRO-ARCH ([2001:818:e92f:6400:96b:aa92:afc0:2d3d]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-42ba639671dsm169799185e9.5.2024.09.02.04.05.46 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 02 Sep 2024 04:05:47 -0700 (PDT) Date: Mon, 2 Sep 2024 12:05:45 +0100 From: Pedro Falcato To: Petr =?utf-8?B?xaBwYcSNZWs=?= Cc: Lorenzo Stoakes , linux-mm@kvack.org, linux-kernel@vger.kernel.org, Vlastimil Babka , Liam Howlett Subject: Re: [PATCH RFC] mm: mmap: Change DEFAULT_MAX_MAP_COUNT to INT_MAX Message-ID: <53f4ixl6heo5yvhp7j2c7j4q7ftai6nztmpc22jtaj2u3og5go@4kmzjef43hky> References: <20240830095636.572947-1-pspacek@isc.org> <90f07fec-3f46-4b38-86fd-07c9f8201904@lucifer.local> <82960a7e-9013-475e-9b80-7b29a5667482@lucifer.local> <5dca8600-0352-4b5b-acb0-0cd4f84733f4@isc.org> <2ff8d9c9-febc-4049-b79b-945efe8dcc78@isc.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <2ff8d9c9-febc-4049-b79b-945efe8dcc78@isc.org> X-Stat-Signature: do1179n4xf8m86z9aga3mmbsyh7rqhme X-Rspamd-Queue-Id: 24FA618001F X-Rspam-User: X-Rspamd-Server: rspam08 X-HE-Tag: 1725275149-527301 X-HE-Meta: U2FsdGVkX1+lEvLe/RfeegmooOI2Gh0jLq8yKEaQkVgwWDi+ibXYZgsAV2JeRZyBRBSg+lm1uD36Qr4erHyl6IlUh1RKhZ2rY8VMPvmCrcOVMdJujeLMN+6ItDbhZjMyNM1LZyX2k/r/eOHP2okeKFY01GOmcuQreoqRQc1sfcrn6Oxw0wX1MRPiTgx7URFSBx5eSmm8e46wvJSmdMAaW3zzRsCx23Cgmy1db0DLMHv4FdXH+TlDfBnF5uKGeOzYj8U9+8qE4+9EVQHm7mMPoiKTRidd7DpPf5XjF1KOv/I+8qS05NgcOmyDRFJlgAhPOMIbIQXImu7la3nRps/Bm8PPjHaJi29bceNiCgVk59lDk9CZYt32o+HFjIiuhp+QQGlrkEVDeW8/yX6jGd24GJNHuTriFNfgqnZjvlqZUOvap0lI+AqUZSisC0hdd+O0V3u9h4cqqTRx1vPDNiAqBdyx6FlDBYErZrmmf/rtJ6k5bVTZfmDxLznyiARoqatntG1+4hzUUoEk3TCb41mzCCSipNWq65BUQKoeLDr/K0OhEElhLfw37nnA+VryTCnqpZ5nzdWm4ngXTDbW9ruqPkBLog1PGMsBavKrrjg4u8QzaG2IewQcfgQDH9myd1yHUKVaTlUpuBvLIdvs8sF5RYdP14yft1eCMlFiMy1mm21b6whCREqmI/pFIDWo05jVF0LFhVqy+KrEfz7qAh8QeZ19GSQKLlktQBKp10U40R3eDntv44BCh0DIVMCMem6jfPMJj+O8Cmlhm5qfRDZj0nFH2FiXWL1chRAqSVHql5CoUZaXCgTZMurLWZIctddwDLVq3c/tAmUvQ2q38KeOOXZ5cL6Hzd/4IhXoH/NiNpJFg+Az1qL2d+parwVj0Hjl5Hf/Lq+Hz5yVGE3Z051kD33qm4exaPbJgk+Y4veQwZRQ/Xts68mPRuu3aHciknbthxILxEAsjxBfVOMMjyM /tfUpcXA g/tsiwlc66nEkYHzpNQqYGge0aPqsvJ4bFihTv9ZYCCvL2K6Pmt3g76gq5bYDhn9/eXh3lvpzP88yesp1fV94W5g/rDBtHYMv5sWPQgMh56jCTAri4onEZEKFMruoMi+g+ftB5kJaMvlTXkHaEU7a1o15B2Nvq7QjzT5QbXi9C6aFBX7mg4SY56veTXbvmhjNv6VHI1HugbJPIuV83NPQ9QAWQ8RvVM2rEHKFFWsDBfWT02+XOZ7AKZOG6Qr3f3qzlOdk8m2iPfa9NYhwEWopxGzGuHYTc62Bspp5eIgMj2377AQQwOO7LAJmWDcl8JjGjX88LXxK7Wet4Iz7wo/N69FAmsfI5WMx0ICGWBsDXj4sOhbZPgmJBhSsxIE49v7s0umPUfubsFeDwbMCztBjOHYq3iWnXIFpi18C1dI/EYanpuvaOwDUnY5nAMkINPClVvDAjXj6IZCwcCnsLrFPeNc1LpcnPvuL0P47s4vAQ9ARGpc3qZmvjIsp4gTB3d+3SrUK9e1Bem/7zB21WinnY86OMfdOPh7M//fxWkBqF5GgIdI3Az24pIgioDZ9bNfZ77t5XKsZSu0nnuMFK3do9e88ZF0EXocob5F6rQAkMvZmV8QNl/ZbO9kQWHMsW5D2vfJJ X-Bogosity: Ham, tests=bogofilter, spamicity=0.032632, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Mon, Sep 02, 2024 at 12:37:48PM GMT, Petr Špaček wrote: > On 30. 08. 24 19:00, Petr Špaček wrote: > > On 30. 08. 24 17:04, Pedro Falcato wrote: > > > On Fri, Aug 30, 2024 at 04:28:33PM GMT, Petr Špaček wrote: > > > > > > Can you get us a dump of the /proc//maps? It'd be interesting > > > to see how > > > exactly you're hitting this. > > https://users.isc.org/~pspacek/sf1717/bind-9.18.28-jemalloc-maps.xz > > RSS was about 8.9 GB when the snapshot was taken. > > I'm curious about your conclusions from this data. Thank you for your time! I'm not a jemalloc expert (maybe they could chime in) but a quick look suggests jemalloc is poking _a lot_ of holes into your memory map (with munmap). There were theories regarding jemalloc guard pages, but these don't even seem to be it. E.g: 7fa95d392000-7fa95d4ab000 rw-p 00000000 00:00 0 7fa95d4ac000-7fa95d4b7000 rw-p 00000000 00:00 0 7fa95d4b8000-7fa95d4dd000 rw-p 00000000 00:00 0 7fa95d4de000-7fa95d4f2000 rw-p 00000000 00:00 0 7fa95d4f3000-7fa95d4f9000 rw-p 00000000 00:00 0 7fa95d4fa000-7fa95d512000 rw-p 00000000 00:00 0 7fa95d513000-7fa95d53d000 rw-p 00000000 00:00 0 7fa95d53e000-7fa95d555000 rw-p 00000000 00:00 0 7fa95d556000-7fa95d5ab000 rw-p 00000000 00:00 0 7fa95d5ac000-7fa95d5b4000 rw-p 00000000 00:00 0 Where we have about a one page gap between every vma. Either jemalloc is a big fan of munmap on free(), or this is some novel guard page technique I've never seen before :) MADV_DONTNEED should work just fine on systems with overcommit on. -- Pedro