From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id CE9A2EB64DC for ; Sat, 15 Jul 2023 00:14:34 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 611D06B0071; Fri, 14 Jul 2023 20:14:34 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 5C1A56B0072; Fri, 14 Jul 2023 20:14:34 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 489E36B0074; Fri, 14 Jul 2023 20:14:34 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 3ADE96B0071 for ; Fri, 14 Jul 2023 20:14:34 -0400 (EDT) Received: from smtpin11.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 0D7A2B06B2 for ; Sat, 15 Jul 2023 00:14:34 +0000 (UTC) X-FDA: 81011924868.11.C987216 Received: from mail-wr1-f41.google.com (mail-wr1-f41.google.com [209.85.221.41]) by imf08.hostedemail.com (Postfix) with ESMTP id 20289160006 for ; Sat, 15 Jul 2023 00:14:31 +0000 (UTC) Authentication-Results: imf08.hostedemail.com; dkim=pass header.d=cloudflare.com header.s=google header.b=W6GGyrjn; dmarc=pass (policy=reject) header.from=cloudflare.com; spf=pass (imf08.hostedemail.com: domain of ivan@cloudflare.com designates 209.85.221.41 as permitted sender) smtp.mailfrom=ivan@cloudflare.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1689380072; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=rHB6MmDpW6mOW/AgkDp+ObJjFMKRQPqgz5eDHwER+yU=; b=IDcd0Ded79rlhlm9EWJLSO7IiTgl0lODdgle8TRKsEfN3ly9Y99XRd+FEQyzJLYi30kvPo eU4J+kCapw+T++Npf27WH0/LBW8nzy1Phvx2+xF/g4XJ5Q9erz692ESyFfGd7O4kVgmUK2 zXeFDU6f/Y0OhfJ7WhqxBJQ36/Jmh+I= ARC-Authentication-Results: i=1; imf08.hostedemail.com; dkim=pass header.d=cloudflare.com header.s=google header.b=W6GGyrjn; dmarc=pass (policy=reject) header.from=cloudflare.com; spf=pass (imf08.hostedemail.com: domain of ivan@cloudflare.com designates 209.85.221.41 as permitted sender) smtp.mailfrom=ivan@cloudflare.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1689380072; a=rsa-sha256; cv=none; b=qRviSLM+C4A8GFLRcJSVJXTzzGi6t63A8dfKv1BXepXeRsfRGhP0l5mOK6JTiOUDW7Mj+z dNwD4Qi9dpi86j4U+FNo3PF1SpbTXNS9/KsItv0kAy/RvlxZhPIJh+MEJojTbs7peDApIB IRyhtIewwT/5SbmZVzcasdUCtcUiXfA= Received: by mail-wr1-f41.google.com with SMTP id ffacd0b85a97d-3159da54e95so2452567f8f.3 for ; Fri, 14 Jul 2023 17:14:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudflare.com; s=google; t=1689380070; x=1691972070; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=rHB6MmDpW6mOW/AgkDp+ObJjFMKRQPqgz5eDHwER+yU=; b=W6GGyrjngXNyfkKbzBP757uoR9/rxEagoiMv4f1IGMSJeGCDSjINCa5zj4OukJxmlx v8tWhz33W130IhEua5jQxOvZvUXYTWOPem8PhPVPjpiqqQoGCgraF3LsNYGKV4SQ/+Xn SbbRovXFK1Nzj4i3EBYMzf5xIjum6gRDURoHo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1689380070; x=1691972070; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=rHB6MmDpW6mOW/AgkDp+ObJjFMKRQPqgz5eDHwER+yU=; b=gYPHpO54E+UejyDljn1QlKAYQLo4Zkr2f7V0T5oJqrLAezWTjA+kK+jGKrpttqKfEu odhtJKsaU+MlT0LZcnCdnT07sz9VuqT/Rc6amJEt7FKT+0X8C3bOv1jy97QWlzJ/hP/E adR8zmD9UMsI0C6EDaqcS1tzbbKo0vSQ8Vou4TtMG71vmbctcydk+5h/+tQDRLEUJx7T tQIxAWSs0gCwvukkOVUAyIBHJBAuPot/AHQFPi3r41oXRG1+Nc/8bpDPSa51Qtlm8wAj h7lAeOLUr6L8leL3WlZHSepHo+OjfSQYu3myez3cBp7wBTGnzBjiobUH7RUnaE6VOCuV 7j7w== X-Gm-Message-State: ABy/qLapFhzLVWdM6KlH7Qp3G9t4I+5E9+0YFLowaHKTmUJZy1JSAXA9 gh+MK2VhHfWzO1VZQaTuNOoopgaPGGC080JIBbN8mQ== X-Google-Smtp-Source: APBJJlElw7WGo7L2Nkp8lIMM55qTMGczq+eOnpcSfNh0ZomFN+VdPKiCMfC1jCJnc1H+zHib3xVakiXNH9CD0E0N8Dw= X-Received: by 2002:a5d:5485:0:b0:313:ee69:fb21 with SMTP id h5-20020a5d5485000000b00313ee69fb21mr5399250wrv.62.1689380070674; Fri, 14 Jul 2023 17:14:30 -0700 (PDT) MIME-Version: 1.0 References: <20230706062045.xwmwns7cm4fxd7iu@google.com> In-Reply-To: From: Ivan Babrou Date: Fri, 14 Jul 2023 17:14:19 -0700 Message-ID: Subject: Re: Expensive memory.stat + cpu.stat reads To: Shakeel Butt Cc: cgroups@vger.kernel.org, Linux MM , kernel-team , Johannes Weiner , Michal Hocko , Roman Gushchin , Muchun Song , Andrew Morton , linux-kernel Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 20289160006 X-Rspam-User: X-Rspamd-Server: rspam05 X-Stat-Signature: e71c5z3g9ppchktss698r84uyypfnqbf X-HE-Tag: 1689380071-669627 X-HE-Meta: U2FsdGVkX1+YHaql1AIhm4bYcYkW1g7HqxJxg3pCnIEKK69QgzLWS3hg4ObRIkHK5q97YABfgV6DYt7FLBZO447nv8I7TzAY8rn1/QMTL6XjhBkppwkbjC+/EZur4bGx29DN828oC8gCBRoZrOAKfHPWBbrV/V60QpklqZveg+67TdRhM2OimMn4CuQzCpD9Gwgkb5qqxFAkq9a9nl2Lx8ODbjT5acpDQDr4oVzTEhurmULhmzKAOnPpvWi4b7mLyTEwPbwCQI2KoHnOGtIW1QnBv2OYGX7Ce5IChVyEWKUcAYuE3PGOin7z+h27jPKkdUJpaahP7lYWaERNBPJfKQlpW1OQ8lsNRzW2LSEA4kG66w2BhJCXMzi0ZAQPWOHmg3LMKCcDhVtGH0EGY1aPHIdPtu79PCXXjjrn5fM5LnKH8sZsUv3REFIoGEI0iNczIq14kbKlgbVa1JxRHsJnmcmAbwpxxRXnlX1qP7NdPCgCXjYBaLfLuMGhkyUla2+ZkRAYR2nSpkMiE/euoXF8w6Y6QhpgjyKLCvqaP7QBznM0Hi62v8JsLRda8Ftc1164oSD5qHrG2NBLK2bbOCJrBceJgnzgoiymmDB8XRf7Si7ic8/Da6TaVa0nPL/5yHAgWiS6A46fSW/EJYxgDuJ+hxUK0Z/QmQuGd8hgpffaTJZC9fs+aPGwPtpSV36OgUIPNN+LbVJXzDULmSEr7ib+lR9B71uZJGUsNkDrI61gLQq2jcrc2m8GGboLPkr+6PVlH49lq8b7uWKz8Ha87ebeNBEHV4DsaYsY40me7zM7EioVuXmD7SmuTSa3AZzbLHfmTtU1UmKz3j1c2tClkLY+fWpRJb3qgnB+ImLY+4F9MYOKdRKWNmM5v0+XHNID4ImamApcLYhIB8YumcUy0dYoKuOUH/jRKyAVJoveDQuRAccmHHwa8HBFqQWwZ7OC6hQQUs+UHGL4YlFlmXKikgK UcMCJZmr aVrMRakR8ZvIII6BkgvY/DpFcD4pZWTMEkaxrC3gR2r/iCF/D9OSZBxdvVGLvJWRaEJA+DcHcNiZ2DGGc0Sk4NnSqzVXTepx/A1owa9W/wc0JyvwYQ6YzYTBHmzWpc80F0YzwZOI5fCgnwX9n2MhU4tpMu0XFwlWDFuJZVKrdRZlu6jwhNwIAf5Ro9F/qHQ/kDVsfO4qpp7xCSCvCGS6Vv8eiMu4kGyE/b9pwmA19LK/qmLf5UFDIcKfQ3YMGCKe6AnqhD11PRnr5ZqS7/SE1UIB52Sm08xSlQ1HpWQ0rDXoZgiRY8m7v1gKYTa4lFw0vefrXWBGra4nh7sjCfhXlZe/RRKXEHGm9orO9zqL+wX2nAn01ngOeN9qw+wOSSAZw7lZSJv9aRACc4uQ= X-Bogosity: Ham, tests=bogofilter, spamicity=0.001930, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Jul 10, 2023 at 4:21=E2=80=AFPM Ivan Babrou w= rote: > The fast one is v6.1.37 and the slow one is v6.1.25. I'm not sure if > the kernel version makes a difference or if it's a matter of uptime / > traffic profile. The data is from two different locations. The fast > location has gone through an expansion, which meant a full reboot with > a kernel upgrade, so maybe that affected things: > > * https://i.imgur.com/x8uyMaF.png > > Let me try to reboot the slow location and see if there's any lasting > improvement. There is no correlation with the kernel version, v6.1.38 is slow too: completed: 23.09s [manual / cpu-stat + mem-stat] completed: 0.30s [manual / mem-stat] completed: 0.64s [manual / cpu-stat]