From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id AB176C47077 for ; Tue, 16 Jan 2024 12:09:34 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 268266B007B; Tue, 16 Jan 2024 07:09:34 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 2189C6B007D; Tue, 16 Jan 2024 07:09:34 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 0BAF56B007E; Tue, 16 Jan 2024 07:09:34 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id EF0006B007B for ; Tue, 16 Jan 2024 07:09:33 -0500 (EST) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id C7EC1140A5C for ; Tue, 16 Jan 2024 12:09:33 +0000 (UTC) X-FDA: 81685054626.14.38C79B5 Received: from mail-wm1-f43.google.com (mail-wm1-f43.google.com [209.85.128.43]) by imf20.hostedemail.com (Postfix) with ESMTP id DFAC51C000A for ; Tue, 16 Jan 2024 12:09:31 +0000 (UTC) Authentication-Results: imf20.hostedemail.com; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=kernel.org (policy=none); spf=pass (imf20.hostedemail.com: domain of jirislaby@gmail.com designates 209.85.128.43 as permitted sender) smtp.mailfrom=jirislaby@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1705406972; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=hGXJewiw59XAMvDFwR6jqOgJqi+EyE44/+IPiDuzAnc=; b=XL8q9ksohhc5x0pft5Oz8YGBg7cWPpn8z6r+h/0Pi6rf/IjP7HHyatKpx5BB1U6St9zKEf cEjXSzOyvRAMG8qc8+q/JDhZbQ07/oG37MuOH2u1h9XXVStpSgCpxnWLx51pA7nAZmVlpF 3jaQfmFMlnn1bjNXfxPCDpCpQoRkJNc= ARC-Authentication-Results: i=1; imf20.hostedemail.com; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=kernel.org (policy=none); spf=pass (imf20.hostedemail.com: domain of jirislaby@gmail.com designates 209.85.128.43 as permitted sender) smtp.mailfrom=jirislaby@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1705406972; a=rsa-sha256; cv=none; b=KcO1sp6L2xQtQ6Vzkh/GI20k9j61Y6a/XonOOKAcLADqFLURkC32r2jgA1BscjWUgvJrl4 UQUt5i3J2i3XyxaQyO6dX271tGGFYfgWi1uDgfMbRaMru0YCodFaVZva/xkNL9KBrpO1HD A+C5HA0Y/xbKg/vBYyfjtl+WAYAVCuU= Received: by mail-wm1-f43.google.com with SMTP id 5b1f17b1804b1-40d6b4e2945so110492785e9.0 for ; Tue, 16 Jan 2024 04:09:31 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705406970; x=1706011770; h=content-transfer-encoding:in-reply-to:autocrypt:references:cc:to :from:content-language:subject:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=hGXJewiw59XAMvDFwR6jqOgJqi+EyE44/+IPiDuzAnc=; b=p1i6b6/RwiWQIOCFnEKnea3sJv+Igp6EpnL4T9s/9KFUujwkfI6ZDYIIifGCRHIPgH mMbr+F9vG2K1VZLmuYcWA9cKCqhXxyB4hZ2TX6fduq55qlGg8IVOf8kLoMet5Seu/rcq 6Ruc9/rm2FWadtuJ479jCrzJskzbVUTLChfUtRyfIgC9Pkbll5ykOunaDl1xcxYKBLez 8KaCq/qpL7aOGASrRyE2CMQeMoJHWwW2VNCjwUEPyZeZjYDpjjhcZvW4aFzFW3FlYthS WvorH9jdsi4i1u+wa7fum+nc7gdAjBg1hO0mqJ/+T1JxtK5kGZDOr3xr9acQiF5zHb9+ brow== X-Gm-Message-State: AOJu0Yxs48sZZu8HAphc/CJDVZFtpwfpFVg8vJji0WHkGSvVHVbjsQTY XHmLnW8GPuiHuafDp5o6R4w= X-Google-Smtp-Source: AGHT+IGPn29RAnaLDYO7zw5NJ/+D5zoORI9C1iG1ha3W4PGgkY4a03AvrTZpuIl5+XU67V7a5mXhuw== X-Received: by 2002:a7b:cd0f:0:b0:40e:4a3d:83e with SMTP id f15-20020a7bcd0f000000b0040e4a3d083emr2478334wmj.22.1705406970374; Tue, 16 Jan 2024 04:09:30 -0800 (PST) Received: from ?IPV6:2a0b:e7c0:0:107::aaaa:59? ([2a0b:e7c0:0:107::aaaa:59]) by smtp.gmail.com with ESMTPSA id o8-20020a05600c510800b0040e624995f1sm17888703wms.8.2024.01.16.04.09.29 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 16 Jan 2024 04:09:30 -0800 (PST) Message-ID: <3193bf5b-4e22-412f-8c5b-68574942d9bc@kernel.org> Date: Tue, 16 Jan 2024 13:09:29 +0100 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2] mm: align larger anonymous mappings on THP boundaries Content-Language: en-US From: Jiri Slaby To: Rik van Riel , Andrew Morton Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, kernel-team@fb.com, Matthew Wilcox , Yang Shi , Christoph Lameter References: <20220809142457.4751229f@imladris.surriel.com> Autocrypt: addr=jirislaby@kernel.org; keydata= xsFNBE6S54YBEACzzjLwDUbU5elY4GTg/NdotjA0jyyJtYI86wdKraekbNE0bC4zV+ryvH4j rrcDwGs6tFVrAHvdHeIdI07s1iIx5R/ndcHwt4fvI8CL5PzPmn5J+h0WERR5rFprRh6axhOk rSD5CwQl19fm4AJCS6A9GJtOoiLpWn2/IbogPc71jQVrupZYYx51rAaHZ0D2KYK/uhfc6neJ i0WqPlbtIlIrpvWxckucNu6ZwXjFY0f3qIRg3Vqh5QxPkojGsq9tXVFVLEkSVz6FoqCHrUTx wr+aw6qqQVgvT/McQtsI0S66uIkQjzPUrgAEtWUv76rM4ekqL9stHyvTGw0Fjsualwb0Gwdx ReTZzMgheAyoy/umIOKrSEpWouVoBt5FFSZUyjuDdlPPYyPav+hpI6ggmCTld3u2hyiHji2H cDpcLM2LMhlHBipu80s9anNeZhCANDhbC5E+NZmuwgzHBcan8WC7xsPXPaiZSIm7TKaVoOcL 9tE5aN3jQmIlrT7ZUX52Ff/hSdx/JKDP3YMNtt4B0cH6ejIjtqTd+Ge8sSttsnNM0CQUkXps w98jwz+Lxw/bKMr3NSnnFpUZaxwji3BC9vYyxKMAwNelBCHEgS/OAa3EJoTfuYOK6wT6nadm YqYjwYbZE5V/SwzMbpWu7Jwlvuwyfo5mh7w5iMfnZE+vHFwp/wARAQABzSFKaXJpIFNsYWJ5 IDxqaXJpc2xhYnlAa2VybmVsLm9yZz7CwXcEEwEIACEFAlW3RUwCGwMFCwkIBwIGFQgJCgsC BBYCAwECHgECF4AACgkQvSWxBAa0cEnVTg//TQpdIAr8Tn0VAeUjdVIH9XCFw+cPSU+zMSCH eCZoA/N6gitEcnvHoFVVM7b3hK2HgoFUNbmYC0RdcSc80pOF5gCnACSP9XWHGWzeKCARRcQR 4s5YD8I4VV5hqXcKo2DFAtIOVbHDW+0okOzcecdasCakUTr7s2fXz97uuoc2gIBB7bmHUGAH XQXHvdnCLjDjR+eJN+zrtbqZKYSfj89s/ZHn5Slug6w8qOPT1sVNGG+eWPlc5s7XYhT9z66E l5C0rG35JE4PhC+tl7BaE5IwjJlBMHf/cMJxNHAYoQ1hWQCKOfMDQ6bsEr++kGUCbHkrEFwD UVA72iLnnnlZCMevwE4hc0zVhseWhPc/KMYObU1sDGqaCesRLkE3tiE7X2cikmj/qH0CoMWe gjnwnQ2qVJcaPSzJ4QITvchEQ+tbuVAyvn9H+9MkdT7b7b2OaqYsUP8rn/2k1Td5zknUz7iF oJ0Z9wPTl6tDfF8phaMIPISYrhceVOIoL+rWfaikhBulZTIT5ihieY9nQOw6vhOfWkYvv0Dl o4GRnb2ybPQpfEs7WtetOsUgiUbfljTgILFw3CsPW8JESOGQc0Pv8ieznIighqPPFz9g+zSu Ss/rpcsqag5n9rQp/H3WW5zKUpeYcKGaPDp/vSUovMcjp8USIhzBBrmI7UWAtuedG9prjqfO wU0ETpLnhgEQAM+cDWLL+Wvc9cLhA2OXZ/gMmu7NbYKjfth1UyOuBd5emIO+d4RfFM02XFTI t4MxwhAryhsKQQcA4iQNldkbyeviYrPKWjLTjRXT5cD2lpWzr+Jx7mX7InV5JOz1Qq+P+nJW YIBjUKhI03ux89p58CYil24Zpyn2F5cX7U+inY8lJIBwLPBnc9Z0An/DVnUOD+0wIcYVnZAK DiIXODkGqTg3fhZwbbi+KAhtHPFM2fGw2VTUf62IHzV+eBSnamzPOBc1XsJYKRo3FHNeLuS8 f4wUe7bWb9O66PPFK/RkeqNX6akkFBf9VfrZ1rTEKAyJ2uqf1EI1olYnENk4+00IBa+BavGQ 8UW9dGW3nbPrfuOV5UUvbnsSQwj67pSdrBQqilr5N/5H9z7VCDQ0dhuJNtvDSlTf2iUFBqgk 3smln31PUYiVPrMP0V4ja0i9qtO/TB01rTfTyXTRtqz53qO5dGsYiliJO5aUmh8swVpotgK4 /57h3zGsaXO9PGgnnAdqeKVITaFTLY1ISg+Ptb4KoliiOjrBMmQUSJVtkUXMrCMCeuPDGHo7 39Xc75lcHlGuM3yEB//htKjyprbLeLf1y4xPyTeeF5zg/0ztRZNKZicgEmxyUNBHHnBKHQxz 1j+mzH0HjZZtXjGu2KLJ18G07q0fpz2ZPk2D53Ww39VNI/J9ABEBAAHCwV8EGAECAAkFAk6S 54YCGwwACgkQvSWxBAa0cEk3tRAAgO+DFpbyIa4RlnfpcW17AfnpZi9VR5+zr496n2jH/1ld wRO/S+QNSA8qdABqMb9WI4BNaoANgcg0AS429Mq0taaWKkAjkkGAT7mD1Q5PiLr06Y/+Kzdr 90eUVneqM2TUQQbK+Kh7JwmGVrRGNqQrDk+gRNvKnGwFNeTkTKtJ0P8jYd7P1gZb9Fwj9YLx jhn/sVIhNmEBLBoI7PL+9fbILqJPHgAwW35rpnq4f/EYTykbk1sa13Tav6btJ+4QOgbcezWI wZ5w/JVfEJW9JXp3BFAVzRQ5nVrrLDAJZ8Y5ioWcm99JtSIIxXxt9FJaGc1Bgsi5K/+dyTKL wLMJgiBzbVx8G+fCJJ9YtlNOPWhbKPlrQ8+AY52Aagi9WNhe6XfJdh5g6ptiOILm330mkR4g W6nEgZVyIyTq3ekOuruftWL99qpP5zi+eNrMmLRQx9iecDNgFr342R9bTDlb1TLuRb+/tJ98 f/bIWIr0cqQmqQ33FgRhrG1+Xml6UXyJ2jExmlO8JljuOGeXYh6ZkIEyzqzffzBLXZCujlYQ DFXpyMNVJ2ZwPmX2mWEoYuaBU0JN7wM+/zWgOf2zRwhEuD3A2cO2PxoiIfyUEfB9SSmffaK/ S4xXoB6wvGENZ85Hg37C7WDNdaAt6Xh2uQIly5grkgvWppkNy4ZHxE+jeNsU7tg= In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam09 X-Rspamd-Queue-Id: DFAC51C000A X-Stat-Signature: 67zgtz5asmfb9gsw5ccs4r8uyruftfcb X-Rspam-User: X-HE-Tag: 1705406971-185585 X-HE-Meta: U2FsdGVkX18nQXLhXgpprlrQ0ooCxq821DNh8XRzi1+/DCPIEjbrm9BdLSW4+iw8iVKwrOn7pvSv2i/dF7Ni91tHP4UpXe9NhHHg0k/qvlgYKXzHAKRmFXY5dKMRBdTNEeoO/Zr5+w600Q60i6DZb0jOUk6qklT/H4mHuZ0KVoPzC7I7MCPYInVJlD8GkZvI8Pm3K2D/bQYE3HTrUmrjstn0n6c6AG/hFYUrS4pmcUJ6FV4qu4d9zUAIyUlPGtnMc2iawRYeWfC4zru5Z95vbAyhzijaCm+Ir2kZgRPGIEjcPDUkZ6ojzHjYMtzUkuTUIfg48msvLB8x0x4/HlxnlW4ZqyxuHd62/m2Ux9lHwOEj6gdnRlwbNnUS2hMMJPyfbhCRId4zyO0y8u2YD/OX4PPdYH04LzDeghIWk2zECB5N1utcuoI35q2ONaGby4pwgsnchvTfR4Z/1n62LLSbWgAcWYlPKVmYLytoiVxPQa7Y+2+i+LxjBm8rQXwr1CZNBsdI3PtMDoXlKkRlCKpeMxtJByomqCAHUxPuGJ/YfWHJWbdVaHpCOMjXAPJVkch0LLUAwwxa1A7QKdjeWyuNUXBpul9mpeFhSYFoTvU/V9EvRuMy1NtSMjwqHqTkBAw94GKCIkbmNPAxVR5b/aF/pYpCbnhW2NH04LkTxgf9d17ambPANzlEW6FNma/rdBQNvtsyq59/wqw/QNRSvSv7WyaTpH1JxfC3gFF/ctQKqcIt1mfgvlHGhMsdSuOIB3svt1ZPrv3oxtdoXrcyxyXtLAYBuflQKy8JCMAsasfI0tVX22JjTkFeFZTANg4LN9CxHL9M7CkqmQbBzzMfP25LzvXaunuAspIFIzVo9j1XC8sAQAeLfQq+ND0dGCdiQAZlINZSw5ZwpXlKEECS3JSrxNah2lhK0vL9PGb4t92Yz9nkCI+X75v7V+T9bF4cvcoS/vt6tlqWuDbRUFkCix5 uS5qI/f8 7r72hjc4Y6MHOclSSMW+nIk24M9UB3784W2eUosGvBOibhV2frBvu3NT0J3l7xymaouEOUK8w4DqX2Cw5BBo9OK45L/QyMDlE7YDlw9cuo1akmKEvG2MzbYumzsIBbKuoRQanxd7StrF1816WuS0VaX3mS/lApDqPLxSMVR/HTJEx5CzCc3aKflta4nQUunW0t2VmrqUXQ9ghm9FgQfZ1GuUvzqw6Fe7oU7T07qyua0tTxjzFPG82NLN87nLGtgeqBeXwdSpkdjO3IRtW/UVOhyR3K2/xBLzMqh5LXk7+r3UIy+F6V0i1UikkAvxKo+lUHwYS9mw7RhMxpclOT2DDdgam6v2kLunQ/FomjcjMoMwtPJZwZwE/rKDXrFvmRY3tnWP6mQMp3TRfdG0Z+swcwbf9wr1C/LL0tz67hw2M7nhqRoVthUqdq8WbTXsG0VieGWcStvFlp5m6XdsKqMVm9YWR9BcAvmA3JSmdM8W4KH8XQw2WMJCHylHbFNVtfSlKTS35H5hxtuzTBRw3pmLGGnY//ZH0+hzSYyKdxU4U1sb7fcfYqLhbLzfNMzi5lUX1UebDdHZXlxrs78AeEJPsf+kA9rVKDrmkfRmSaMfZTgy03MMOIFQQE0QUrPkvAiCPLZTtVYdeIUVDojNtz2NgLfaG6GTA8oEfoiX3Kqnn82/ObZA= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 16. 01. 24, 12:53, Jiri Slaby wrote: > Hi, > > On 09. 08. 22, 20:24, Rik van Riel wrote: >> Align larger anonymous memory mappings on THP boundaries by >> going through thp_get_unmapped_area if THPs are enabled for >> the current process. >> >> With this patch, larger anonymous mappings are now THP aligned. >> When a malloc library allocates a 2MB or larger arena, that >> arena can now be mapped with THPs right from the start, which >> can result in better TLB hit rates and execution time. > > This appears to break 32bit processes on x86_64 (at least). In > particular, 32bit kernel or firefox builds in our build system. > > Reverting this on top of 6.7 makes it work again. > > Downstream report: >  https://bugzilla.suse.com/show_bug.cgi?id=1218841 > > So running: > pahole -J --btf_gen_floats -j --lang_exclude=rust > --skip_encoding_btf_inconsistent_proto --btf_gen_optimized .tmp_vmlinux.btf > > crashes or errors out with some random errors: > [182671] STRUCT idr's field 'idr_next' offset=128 bit_size=0 type=181346 > Error emitting field > > strace shows mmap() fails with ENOMEM right before the errors: > 1223  mmap2(NULL, 5783552, PROT_READ|PROT_WRITE, > MAP_PRIVATE|MAP_ANONYMOUS, -1, 0 > ... > 1223  <... mmap2 resumed>)              = -1 ENOMEM (Cannot allocate > memory) > > Note the .tmp_vmlinux.btf above can be arbitrary, but likely large > enough. For reference, one is available at: > https://decibel.fi.muni.cz/~xslaby/n/btf > > Any ideas? This works around the problem, of course (but is a band-aid, not a fix): --- a/mm/mmap.c +++ b/mm/mmap.c @@ -1829,7 +1829,7 @@ get_unmapped_area(struct file *file, unsigned long addr, unsigned long len, */ pgoff = 0; get_area = shmem_get_unmapped_area; - } else if (IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE)) { + } else if (IS_ENABLED(CONFIG_TRANSPARENT_HUGEPAGE) && !in_32bit_syscall()) { /* Ensures that larger anonymous mappings are THP aligned. */ get_area = thp_get_unmapped_area; } thp_get_unmapped_area() does not take care of the legacy stuff... regards, -- js suse labs