From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C62F8C433EF for ; Fri, 24 Sep 2021 19:55:32 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 5F951610EA for ; Fri, 24 Sep 2021 19:55:32 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 5F951610EA Authentication-Results: mail.kernel.org; dmarc=fail (p=reject dis=none) header.from=google.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id CA366900002; Fri, 24 Sep 2021 15:55:31 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C52BD6B0072; Fri, 24 Sep 2021 15:55:31 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B4138900002; Fri, 24 Sep 2021 15:55:31 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0050.hostedemail.com [216.40.44.50]) by kanga.kvack.org (Postfix) with ESMTP id A0C5F6B0071 for ; Fri, 24 Sep 2021 15:55:31 -0400 (EDT) Received: from smtpin02.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with ESMTP id 481B38249980 for ; Fri, 24 Sep 2021 19:55:31 +0000 (UTC) X-FDA: 78623521662.02.D0CC19B Received: from mail-yb1-f171.google.com (mail-yb1-f171.google.com [209.85.219.171]) by imf04.hostedemail.com (Postfix) with ESMTP id 1748C50000B0 for ; Fri, 24 Sep 2021 19:55:30 +0000 (UTC) Received: by mail-yb1-f171.google.com with SMTP id z5so8140079ybj.2 for ; Fri, 24 Sep 2021 12:55:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=mime-version:from:date:message-id:subject:to; bh=sv+M0BOJ2CyaB00+hNHkCLSS2xHN3+av+4z9yo3LPH8=; b=gs5p96mQIvlnNYlX1YuC+o7hWnsMkEuevw83RyI2LlKKlsNV8XWjvVNMvIlbAEZ2Im UN7Gc+yYyvyhdcNwmIJDlOe8uxAB2i6sj9vio5sG1mDSxMXljjdpc2GyayZ06Oc5kSu+ CNXcVakfKw1GRNka9sVZVz1i6RLq/y+JqQqA34NVgWzpP24c3gj9QWN861uNUEujNwXl r3sOsUyGE6zN6rFlnBjk7fetrwsmBNO+NYoJeGIiuYcWX2Cl7wO9gsi5lX4kEU0Q1cii 7ext1OaDe+h9kekLUWHNLrgcKg64Tp4KEC+1rz2QGmb3apCV6bTGd7Rg68euYDQrLnBL AAxg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=sv+M0BOJ2CyaB00+hNHkCLSS2xHN3+av+4z9yo3LPH8=; b=zUCWO8Y+ONQIE/+4c6V0VhXqricYSPU98xrz8Wkq7V3kHUPnkRY5gam3+T42HjCejX hLqT2/mwHpbrVK6xhcY9U3P4sY7LBp5JiMEKFnFkvxz/G7i+wrOW0DHv8zJoGBv7voD5 ZqsmMjaaMvmQ5rrCJM3ND5Z9ZZF7rrP1CjQEWw0PL3e9ERq8iy2KufbGN4D5VPcLBnjM 2fBZqFi8btK2gyVHnnEpwPiSk/6rft+IMaXaAbCTyH+nrw9ar0Hz6OrvOeTDyAMBy43w aY5usm2ghnOkKpfP10CUOLkQvG3Q4FAoE0nZFDSQiVaWiZgLUtFUl8GGNokEhYeZkCSm YKXg== X-Gm-Message-State: AOAM531ivux8wYfSRJq1IaVEK0NMh4AfhKowX2XJkYLzio2MUmvP3Ths rL4Vq0srRGGAo2KUuoqYaHvD/lFHgiKRa0Hh1Bu35w== X-Google-Smtp-Source: ABdhPJzKWpf3iTCgtSpmKYrDwRovlFw5oJxH9hZvDkNFOp7yymIdTyhGkzoJZYIWF9OOdR+XKaPLHf7ktm1510JYkuo= X-Received: by 2002:a25:7c42:: with SMTP id x63mr2266276ybc.225.1632513329865; Fri, 24 Sep 2021 12:55:29 -0700 (PDT) MIME-Version: 1.0 From: Eric Dumazet Date: Fri, 24 Sep 2021 12:55:18 -0700 Message-ID: Subject: [BUG] numa spreading of large hash tables no longer a thing To: Andrew Morton , LKML , linux-mm Content-Type: text/plain; charset="UTF-8" X-Rspamd-Server: rspam03 X-Rspamd-Queue-Id: 1748C50000B0 X-Stat-Signature: 6gqgwhtswodyeqy98bn3yhd5egskwct7 Authentication-Results: imf04.hostedemail.com; dkim=pass header.d=google.com header.s=20210112 header.b=gs5p96mQ; dmarc=pass (policy=reject) header.from=google.com; spf=pass (imf04.hostedemail.com: domain of edumazet@google.com designates 209.85.219.171 as permitted sender) smtp.mailfrom=edumazet@google.com X-HE-Tag: 1632513330-529104 X-Bogosity: Ham, tests=bogofilter, spamicity=0.131320, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Andrew and mm experts It seems recent kernels lost the NUMA spreading of large hash tables allocated at boot time. Does it ring a bell, was it intentional ? Thanks Old behavior otrv5:~# grep alloc_large_system_hash /proc/vmallocinfo 0x000000006381d67a-0x000000009bc8465a 12288 alloc_large_system_hash+0xf1/0x290 pages=2 vmalloc N0=1 N1=1 0x000000009bc8465a-0x00000000b70c6dfc 12288 alloc_large_system_hash+0xf1/0x290 pages=2 vmalloc N0=1 N1=1 0x00000000b70c6dfc-0x00000000ab13330f 12288 alloc_large_system_hash+0xf1/0x290 pages=2 vmalloc N0=1 N1=1 0x000000008685d551-0x000000009ce0c789 12288 alloc_large_system_hash+0xf1/0x290 pages=2 vmalloc N0=1 N1=1 0x000000004d87acca-0x00000000781b44e4 266240 alloc_large_system_hash+0xf1/0x290 pages=64 vmalloc N0=32 N1=32 0x00000000dea0f2d2-0x00000000909e9fb3 268439552 alloc_large_system_hash+0xf1/0x290 pages=65536 vmalloc vpages N0=32768 N1=32768 0x00000000909e9fb3-0x00000000d23f4353 528384 alloc_large_system_hash+0xf1/0x290 pages=128 vmalloc N0=64 N1=64 0x00000000d23f4353-0x000000003913e8bc 134221824 alloc_large_system_hash+0xf1/0x290 pages=32768 vmalloc vpages N0=16384 N1=16384 0x000000003913e8bc-0x000000007a60bcd6 4198400 alloc_large_system_hash+0xf1/0x290 pages=1024 vmalloc vpages N0=512 N1=512 0x000000007a60bcd6-0x0000000001bc8bf9 4198400 alloc_large_system_hash+0xf1/0x290 pages=1024 vmalloc vpages N0=512 N1=512 0x0000000001bc8bf9-0x0000000022629b89 4198400 alloc_large_system_hash+0xf1/0x290 pages=1024 vmalloc vpages N0=512 N1=512 0x0000000022629b89-0x0000000027d1b0a7 1052672 alloc_large_system_hash+0xf1/0x290 pages=256 vmalloc N0=128 N1=128 0x0000000027d1b0a7-0x0000000027310068 4198400 alloc_large_system_hash+0xf1/0x290 pages=1024 vmalloc vpages N0=512 N1=512 0x0000000027310068-0x00000000a845050a 1052672 alloc_large_system_hash+0xf1/0x290 pages=256 vmalloc N0=128 N1=128 0x00000000a845050a-0x0000000028b8c1bc 2101248 alloc_large_system_hash+0xf1/0x290 pages=512 vmalloc N0=256 N1=256 0x0000000028b8c1bc-0x000000002aff2d3d 2101248 alloc_large_system_hash+0xf1/0x290 pages=512 vmalloc N0=256 N1=256 New behavior otrv6:~# grep alloc_large_system_hash /proc/vmallocinfo 0x00000000de22dded-0x000000006574cf88 12288 alloc_large_system_hash+0x18c/0x272 pages=2 vmalloc N0=2 0x000000006574cf88-0x00000000bc158a1d 12288 alloc_large_system_hash+0x18c/0x272 pages=2 vmalloc N0=2 0x00000000afa304a2-0x0000000009981fb8 12288 alloc_large_system_hash+0x18c/0x272 pages=2 vmalloc N0=2 0x00000000e3ab78c1-0x00000000ddbeadf2 528384 alloc_large_system_hash+0x18c/0x272 pages=128 vmalloc N0=128 0x0000000000cce551-0x0000000022096e73 12288 alloc_large_system_hash+0x18c/0x272 pages=2 vmalloc N0=2 0x0000000072a43217-0x00000000cf0c05f7 266240 alloc_large_system_hash+0x18c/0x272 pages=64 vmalloc N0=64 0x000000003f85e695-0x0000000042154f88 268439552 alloc_large_system_hash+0x18c/0x272 pages=65536 vmalloc vpages N0=65536 0x0000000042154f88-0x0000000066fcdca2 134221824 alloc_large_system_hash+0x18c/0x272 pages=32768 vmalloc vpages N0=32768 0x0000000066fcdca2-0x000000004074129c 4198400 alloc_large_system_hash+0x18c/0x272 pages=1024 vmalloc vpages N0=1024 0x000000004074129c-0x00000000ca32b7f9 4198400 alloc_large_system_hash+0x18c/0x272 pages=1024 vmalloc vpages N0=1024 0x00000000ca32b7f9-0x00000000a56b8117 4198400 alloc_large_system_hash+0x18c/0x272 pages=1024 vmalloc vpages N0=1024 0x00000000a56b8117-0x0000000089e9e39e 2101248 alloc_large_system_hash+0x18c/0x272 pages=512 vmalloc N0=512 0x0000000089e9e39e-0x0000000090a80b5a 1052672 alloc_large_system_hash+0x18c/0x272 pages=256 vmalloc N0=256 0x0000000090a80b5a-0x00000000e84776cb 4198400 alloc_large_system_hash+0x18c/0x272 pages=1024 vmalloc vpages N0=1024 0x00000000e84776cb-0x000000006cfc05bf 1052672 alloc_large_system_hash+0x18c/0x272 pages=256 vmalloc N0=256 0x000000006cfc05bf-0x00000000f6ce3623 1576960 alloc_large_system_hash+0x18c/0x272 pages=384 vmalloc N0=384 0x00000000f6ce3623-0x0000000002737823 2101248 alloc_large_system_hash+0x18c/0x272 pages=512 vmalloc N0=512 0x0000000002737823-0x00000000d4e74269 2101248 alloc_large_system_hash+0x18c/0x272 pages=512 vmalloc N0=512