From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E5A14E77188 for ; Tue, 14 Jan 2025 03:38:54 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 82C0C6B0088; Mon, 13 Jan 2025 22:38:54 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7DC616B0089; Mon, 13 Jan 2025 22:38:54 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6A3756B008A; Mon, 13 Jan 2025 22:38:54 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 4C0656B0088 for ; Mon, 13 Jan 2025 22:38:54 -0500 (EST) Received: from smtpin12.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id C779AAEEB9 for ; Tue, 14 Jan 2025 03:38:53 +0000 (UTC) X-FDA: 83004650946.12.5340F3A Received: from mail-ed1-f53.google.com (mail-ed1-f53.google.com [209.85.208.53]) by imf29.hostedemail.com (Postfix) with ESMTP id 07F6412000E for ; Tue, 14 Jan 2025 03:38:51 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=jynu+ajx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf29.hostedemail.com: domain of nspmangalore@gmail.com designates 209.85.208.53 as permitted sender) smtp.mailfrom=nspmangalore@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1736825932; a=rsa-sha256; cv=none; b=731bh30deSnoul6gJ+g+Q+nw3Mm45oEs1GGV06MOtslTND8V4RIaIK25G+9tCeZfqSGqS0 3b1cAiS0ENNvKJKVvEtH3jpskM5A6xrfapkZYE8I3VYcSFPW3f8YCvXxMQFbqe9uRVukzz vcqdH8sCuXAHQe9daht6PBnBKoywPLA= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=jynu+ajx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (imf29.hostedemail.com: domain of nspmangalore@gmail.com designates 209.85.208.53 as permitted sender) smtp.mailfrom=nspmangalore@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1736825932; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=Lj6/sApTY/jclvY2FM4RFLaJJCjQ4BwNOQGN06z90O0=; b=1X1XyxGmpKU41D/Bi8th57eNq6HN+OMeFCSqDVTnasJtUF35wpx88Skr500kCo0ImF1WTX Q4IJC1FTL6Y/WK8dcEPV1755fQzTVxNVxrSpVM579ZggQtQfaD4ZdwKW9kLOIf9w/BIsPP nDXTsHI9M6S6Unmfdl8/9uClKPO20eI= Received: by mail-ed1-f53.google.com with SMTP id 4fb4d7f45d1cf-5d3f28881d6so7451349a12.1 for ; Mon, 13 Jan 2025 19:38:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1736825930; x=1737430730; darn=kvack.org; h=cc:to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=Lj6/sApTY/jclvY2FM4RFLaJJCjQ4BwNOQGN06z90O0=; b=jynu+ajxg2g7aCgFnjJ8ISNO5xk1L6bV4pEEyeNpsSuCh6viXbYh4HZfxeu1/vAd7i RUjr17uelGQ9ECemxHwiQrlvSuebf2h9lEqi6QQtEXylVARr9HqJrMSeoS3spK3jqjJ/ eV5pVh6/J2i9IMDQNGthl/1vHjjA+/CCDTI54UC4bbeXvSgbsz+pUF0nSCmZvgf7hqQg /G5nMPSNy53A9tP4gObL2g5GgzrXiZOCM0AQcWdism7o4tQk2MsCz1gVLW8yNNjZ81ga omF1Q3QJ9R/GE5cVxvAgsD96etBxwZWXzoN9IlWBcerllldYbzyGw4xWup/YkfQgXeh8 AqXQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1736825930; x=1737430730; h=cc:to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=Lj6/sApTY/jclvY2FM4RFLaJJCjQ4BwNOQGN06z90O0=; b=fWe+xASSoOyDxLPsFVahlmfWAkEvDQAdpVdg9nAL1m6lHcHdweYAiV3V5adNhYp3SD CT9kYTwljJ52ycB7ysvp+ON+q9UaxeTKzzM+XJ4KGQmX+zM57qTrvbE3VCL7mySMdxM0 us3EUF+xnxFw8qcLD93BF3cwFNPpm0s099shhngPto5q4T+Ajv9CiTiIsXsKkVpd67uR Dnv11KJgYj52xRbq3hmUJVA7N+oAMINEWyDKnKxuJoDz2SXUCX4ve69rmYOHMlwU/lc5 GnZt8BuYEGUK9nBIoa5Mkm31fRysZ4oQXLppa5KPLW7o3hEzSfMF20ctl9aGm+C1TtcF G8Vw== X-Forwarded-Encrypted: i=1; AJvYcCX/flio2TAoOFzr+uW2yD7c3Ble1uwOUZdsRdj2Hcth7JRWvKNKPzd8hcCaUGkbSuNkL5Ok41JmLQ==@kvack.org X-Gm-Message-State: AOJu0Yz9MXHmOO7Nn3J74yZIOUKe9bHSPGXZT3dBAZszn7jF2vvOCmAn oDpJd1yxq+hOB9KaGfBjXmHPaSsiMTDwyfYUD/OPrlWNct30ZPCcMEDpMUCDlXyEfq6XKb+r3xQ wVW8OQo56Hqh1NZa1u+PxSmd4ybc= X-Gm-Gg: ASbGncvnxUB95Jtn9X3o6dTso/nNvUnDEkD6vkQwyzYQsUU0jVafdYDOZTK9eBOHepI WeV9NAsWi/4nh1yX740ZYIG7UVwKTULdCLyhobA== X-Google-Smtp-Source: AGHT+IGwhlxltsK3k4mQ5v0NzJn4zQS/1ltP+H7maDpZm7YlWye2Fd2UAsK7/NvNG+nsaOn3r/RMbcnhb1wDkFF7xoM= X-Received: by 2002:a05:6402:34c2:b0:5d3:ba42:e9fa with SMTP id 4fb4d7f45d1cf-5d972e1c568mr57738673a12.16.1736825930129; Mon, 13 Jan 2025 19:38:50 -0800 (PST) MIME-Version: 1.0 From: Shyam Prasad N Date: Tue, 14 Jan 2025 09:08:38 +0530 X-Gm-Features: AbW1kvbmNbycCq3IpxtuJB4ygP5JxCdoxJZwG4cXc_gbKFkw8Ygxe1HloKSuiTY Message-ID: Subject: [LSF/MM/BPF TOPIC] Predictive readahead of dentries To: lsf-pc@lists.linux-foundation.org, linux-fsdevel , linux-mm@kvack.org, brauner@kernel.org, Matthew Wilcox , David Howells , Jeff Layton , Steve French , trondmy@kernel.org Cc: Shyam Prasad N Content-Type: text/plain; charset="UTF-8" X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 07F6412000E X-Stat-Signature: stufgrcjijuc6x69ystmsbfuz1nhad7g X-Rspam-User: X-HE-Tag: 1736825931-206187 X-HE-Meta: U2FsdGVkX18VECwJi3GuRpo/ImBfwM4c2ueh4DeJ5lBc/OdKS0Ov8CZu37SZQNUtMZ1u7pZ18Jf09uoRqQqatpc6roxoRgBuIKw8n6Ntb2ZDB2YIivzi2v9W/xfr7f5UqTRjG9qfUC//kuEkO5xCIIqH+aYc6EBTTlFUGPxLz7UQ+aqbyh6ey+bz+2HsLWbpOz40I5sPQpE0zaNkxECoA2DjGxtJCLsfqumX1jB2OuE1TWnuFWJyNtpXOWwCLNR+sTUIXxxxe65OqIdrRwEALYzeH3ITFJ7j+ybCYlP6xrZ6+XN8xE9C4otcs5zZewSc/W7qVSY2Y5pRP8+OUimtc9KXC7lJ9dpsutsfQcRz734NOmpD67wYVZwO30+dEo9RUhLUDlE4zuK/Cf5lp6szJ09aiYdEqVxBO9r0D4sUMwpQtvTKmgTaRlrOTMa8YHm/cuf3k2ixc1QqsxJN4ndIBQkjvP/Ym6rGRMJhH1bjOCuqochylzx6ZKLQY30JlIAesFgtjeF9UPHG/EANKhELr58op5ZQ+bRhs6tHH8DGWWGznVH4KR53DgiWzWdk4OohW8Sct1XJFSTsYvlitrf/uBTierIK/WYGupUHnGhR6OaNMZZ6MHXtj/bJXRyl+sHcoub8rt6lvcsfNel5x/L9r31h0arq+h6RzKnt9CyukCHlWeDfj8e6NE6Ve0DT/9DA3P5ZqrCMaRKMoI92+FxR8VY4frBEIXJMQCz/LF42GOnUGmTO6rqt448XJXRuoSy1PpQGN8qvfD+fHWYfYKzyDQhxlUNKIYQx3cCEaSlpAL5cA/iDlzUxblX4qrNSDiH1ya0mS7cfSsr3iuga03huMJsmYSIIgOpkXzv3eH/0Vv29Qs3sS7mXyIr8ZPvGXGJHsEFrqt/SLb0hY99WDAVfrGDB1wqafHLTZXCMu7Ckxdnc/KLC+sID0A9x1xoECxvN0r0W1N1wwqA3jAZ2ZnN eXA+FDE6 KhXBry56nOQgevw84IiEUJc9Ywwd6qsbxx9caYNO185OtmFoUmnvPuKZr+qvfpaGUjo3yRbVjmBO79tV5ttDOl4O6ynLnbSeeijPvOiRYreHi6e1LutFX9lfGNa2tnW98HOzRNf1TKudhKLZx15/l98KitFWcYrStLS7aB2fATBNNASteHsU1Qj19C4SGQ5pf+GK0wqJkeYdxJlYIRJw0F/QFc/G2zROMeUfi7cFgY8ADz4M8mOZx/ct9HCTRuggczeieDEVwMbI/5qHnBDWke7AucmWGPPNJZ+/pVHvC0eMABG7vc++CkhlyT/rWv8Mc8ZUi X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: The Linux kernel does buffered reads and writes using the page cache layer, where the filesystem reads and writes are offloaded to the VM/MM layer. The VM layer does a predictive readahead of data by optionally asking the filesystem to read more data asynchronously than what was requested. The VFS layer maintains a dentry cache which gets populated during access of dentries (either during readdir/getdents or during lookup). This dentries within a directory actually forms the address space for the directory, which is read sequentially during getdents. For network filesystems, the dentries are also looked up during revalidate. During sequential getdents, it makes sense to perform a readahead similar to file reads. Even for revalidations and dentry lookups, there can be some heuristics that can be maintained to know if the lookups within the directory are sequential in nature. With this, the dentry cache can be pre-populated for a directory, even before the dentries are accessed, thereby boosting the performance. This could give even more benefits for network filesystems by avoiding costly round trips to the server. NFS client already does a simplistic form of this readahead by maintaining an address space for the directory inode and storing the dentry records returned by the server in this space. However, this dentry access mechanism is so generic that I feel that this can be a part of the VFS/VM layer, similar to buffered reads of a file. Also, VFS layer is better equipped to store heuristics about dentry access patterns. -- Regards, Shyam