From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0DA59C77B6C for ; Thu, 13 Apr 2023 01:22:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 9691C900003; Wed, 12 Apr 2023 21:22:22 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 8F19D6B0074; Wed, 12 Apr 2023 21:22:22 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 7B8EC900003; Wed, 12 Apr 2023 21:22:22 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 6966B6B0072 for ; Wed, 12 Apr 2023 21:22:22 -0400 (EDT) Received: from smtpin01.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay08.hostedemail.com (Postfix) with ESMTP id 2DBC314026A for ; Thu, 13 Apr 2023 01:22:22 +0000 (UTC) X-FDA: 80674617324.01.35907AB Received: from mail-ed1-f54.google.com (mail-ed1-f54.google.com [209.85.208.54]) by imf22.hostedemail.com (Postfix) with ESMTP id 8C6FDC000F for ; Thu, 13 Apr 2023 01:22:20 +0000 (UTC) Authentication-Results: imf22.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=Qm1WsHGG; spf=pass (imf22.hostedemail.com: domain of mchonaker@gmail.com designates 209.85.208.54 as permitted sender) smtp.mailfrom=mchonaker@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1681348940; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=yuLz9iUc1y0EzGD8AvN7Y9hf2MbqyBOWJrZZ7t76bGM=; b=7tKGvQjGVh7dSimMp9Ma4HCpyfLt2jYMitwKn7fL01DL/arG21LAqsfl7sn7K52qGR5slE M/BwQj6vVxMUrQA9hanXVzA5LnrVCB4Gm4TtyL5AHxe2m1ue77EfuikkA0phPxt7SW1wMq zC4uj+JyRctt+XQYQD7rf/C6FEbBBGU= ARC-Authentication-Results: i=1; imf22.hostedemail.com; dkim=pass header.d=gmail.com header.s=20221208 header.b=Qm1WsHGG; spf=pass (imf22.hostedemail.com: domain of mchonaker@gmail.com designates 209.85.208.54 as permitted sender) smtp.mailfrom=mchonaker@gmail.com; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1681348940; a=rsa-sha256; cv=none; b=APZgvkz4nj8a6toz9l1I8kr4zBp5I1QXyBzX+jAY9WORhBZ/XGFRb4U1i/dOr1jpHO2Ye8 OU5kHH3RzNIeuykELc64/rujU7sT4AgEOMPKQboo2qxqq/fKZnNRbno1aww71g91SMjMem VyujhnjZ1WehuET3Hbxlzqspj5NOSO4= Received: by mail-ed1-f54.google.com with SMTP id 4fb4d7f45d1cf-504eb1155d3so5855427a12.1 for ; Wed, 12 Apr 2023 18:22:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1681348939; x=1683940939; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=yuLz9iUc1y0EzGD8AvN7Y9hf2MbqyBOWJrZZ7t76bGM=; b=Qm1WsHGG7Yawgtzf4UmTBwdzPBribr4bXLa944+d8dBqQyTYUQfDHQZajmMCidQnYP xxG5hyrsJ2DK2CdZYveJeig/i6zy/sZrjcBmabkbeSIMyEFp++itkqfydZVNXe1Xwalf GwmnvJaELevvy9wCBHSGrGpeZy3su2Ctk+vz0EeQ1emZnnqtL8VPrGgjv+EOD4tVAZKw K6KcRffpQddB4a3aHCnM2MLlY4SMpNcrxIF6I/VByUKw7OBIzoCx18lRrzYobBBdisIz 9efZAtqGXAEit6kb/SQ9r3xk8M9yDb40noKlzK+qv9CqBfC3IYeinDiA16mzgJPo4cEZ MlAA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1681348939; x=1683940939; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=yuLz9iUc1y0EzGD8AvN7Y9hf2MbqyBOWJrZZ7t76bGM=; b=BYTksITyphH1NJGjW8dbx42+QZFNmvyvzRAUsVxSzrMcCYYUeEFxbS1Ud4G28ZfSbe u+VkMc3s8gXtqmOzOZJX78LelhqyOuymwb8MmAVy5zKhQU1LxiTiNaArRYUSr6RtMK9M 1QfY3JS/A1lM5uil87KCB8vv4wLfmawKBfbkxbqqJu21RgEwSWnJWoO3TxeoxU84Qwjp Ea/fYc8execQRCIgpeipR596/w7zYkdqUXvNDWHrIWwUOtFq/u58Z5hgzsFj+fbLKJ9N TWQ/wK/DkNGs+NgcSoObFmwK7Iw+zbbcJn9m/OufUWkUGK9Ixegd2aznUYMqtUfJkFOz 6+zg== X-Gm-Message-State: AAQBX9dDI7V6EYsq0RLYtUoxQSHTjdywdT31r7aVtqVGtpV0XbVXwWL/ qLBpAaiyvfC/vVBPh1v6ZwJ2jYm39/+iG77HgEk= X-Google-Smtp-Source: AKy350ZCR0yfocrqiPD3KEzhJCl6DyZlu182JEmGvxfQAyWt9sTVsY/SoXRTXbWHu6sO0LksY8uE4weJ/1iG5eFv5RI= X-Received: by 2002:a05:6402:22f2:b0:506:6a99:ef53 with SMTP id dn18-20020a05640222f200b005066a99ef53mr949787edb.2.1681348939015; Wed, 12 Apr 2023 18:22:19 -0700 (PDT) MIME-Version: 1.0 From: Michael Honaker Date: Wed, 12 Apr 2023 21:22:07 -0400 Message-ID: Subject: cgroup: Clarification around usage_in_bytes and its relation to the page counter To: cgroups@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: 8C6FDC000F X-Stat-Signature: 4ofc3pnrhqs3eiy3rcjpt8q7ubfox19t X-Rspam-User: X-HE-Tag: 1681348940-441228 X-HE-Meta: U2FsdGVkX1+bc5YjoFdhUCXps6OdmZ+xCFTBqnqNU6UCEZRWrCMZoIiwIoZMSibXfKqMi2t1ocRjTPUJ1hBqE1JDkTRlBqYLVIvavUTrpf9jW7mySBFXyts1YG0/fLgAkehdeefmSgcypkWMLed4N9jfwUQ2ya/iCnf19KAgNkegW4RjTx2601a0Y1ilR8d63bs8YBjTonrOgLT+Q/blmkj3fCLI6qun15QI/0xlYQIH7+k7FxGTe7E1EIXYNCrHvjyZwaQqkNcdFlj5vQlYkBeHFnxQM58JTJKLhHdiO/HgHt6TQGfDs+mHprszxrT0HprnOWz758oT44+/9HGZjarSQRzntENOzJLhVx9klNNRowrMtpqYjraNkq9RQ62zP7wUb38XSytSxeABdXxfGlUunk1DG/9c3hKgQjxZZI2WYBC4pnhzgbkvDKpZiM8hnta0OlyBj7LlDnnXiTii4OF3sN9Ts+fRa2pOuJIJ+Ph6mx7itISfuoCU/l4vMz30xzcF1VFeEmVs3VgKT9TaKUu8gw2we8ea9ZyQk3rpn9VmaEk14oAyp4mQx8jBWPOGQ57IWwX6r5Zx9jXGuFKh+AyzgdHvNYHDGNbhzNYqAq6Y6RzfmrJkMRX8PDy8yigm1b8pbe1FFj1p66xX5wRuUvtUSap2TLk+7uf0sbtYjt+LV3vNdeGunua6oxpJStRxeKHbnmxQ0ArrmHXilY5Y/Ry3nR1nMZzM6RDZThSDKIkn8ma4FiGjeElaqaVsL+peAN6MH5wD9CX9FCAs0oxWKaPAZc0W35+g8pL9y3UU/xJ7u4dPFeSD8hxaYX1cub82SICAf3+lsJPNAp37Z/bfYmS0FxBGu3CN93PjWWp5l/xu42LfZUbr3RMq9nnzie9EkcRym1DU9lzBE2vk2dlFSUFlrUfZniKHmKCwNp0PMRzsGTC59Ms2qjuSQwSJXidzqXKm1mC96mXulasDj79 MyYAyAlZ Ep6v4krTNAQEIFq65+SLBYrHX943sB1oScwOCOJV8TnOPRInllZ83Npwceu/Psv/Mt4QJ5k/cWvVh6EF9s0rdCgyf4neteYCEF2hxUNHpNdD8G2OiIrLSqs8xyWjkBFwcKiJTAQcbX3I+dcPMRPV55xUD8PqHA9KfIZFLpwQ0JQI/zjEth+1mjC+07ZhrIqWxCpQdcDXYPRJxvAgdZZSzT4ksITR/Bf+MWsjl4R+1kk1YBmMfBx4zqMr5tsRUKVqZgfaQXWnuZozt1vyxKzzko2B7QFPau2AMFh+RxzHhExvBvsEC89laHDVGQteGgGKD+nPwWpdlRAiZxsOYZe6nDmqQy/fup+mHlJDGWh0l3qR/vKhpQ3D7AjhjrafQu69Zjhgy7eREkLCl1VeQVE/L8IuW1+nmju/nwWyjHd+eVW3unHzBcuPmMOErIw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hello, This is my first posting to the LKML, so please let me know if this should be asked elsewhere or if there is anything else wrong with my email. I'd like to confirm my understanding on an issue I've been encountering. I have been trying to get an accurate measurement of memory usage of a non-root cgroup, specifically a Kubernetes container, and noticed some inconsistencies when comparing the value of `memory.usage_in_bytes` with the information in `memory.stat`. After further investigation of the cgroup docs (/admin-guide/cgroups/memory.rst#usage_in_bytes) and an old LMKL thread ("real meaning of memory.usage_in_bytes"), I came to the understanding that `usage_in_bytes` actually shows the value of the resource counter which is an overestimation due to the counter being split into per-cpu chunks for caching, and that the real usage can be calculated from RSS+Cache gathered from `memory.stat`. I've created cadvisor issue #3286 (https://github.com/google/cadvisor/issues/3286) which goes into greater detail on my investigation with examples. Is the above understanding still correct with the new page counters? If so, could any memory allocations be reflected in `usage_in_bytes` but not in `stat` for child cgroups? I want to ensure I'm not missing anything by only monitoring the `stat` file. Thank you for any clarification or corrections.