From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6FFD6E7716B for ; Wed, 4 Dec 2024 15:53:12 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0A3516B0089; Wed, 4 Dec 2024 10:53:09 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id F41806B008A; Wed, 4 Dec 2024 10:53:08 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id DE3136B008C; Wed, 4 Dec 2024 10:53:08 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id BCDE36B0089 for ; Wed, 4 Dec 2024 10:53:08 -0500 (EST) Received: from smtpin28.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 6881DAED6C for ; Wed, 4 Dec 2024 15:53:08 +0000 (UTC) X-FDA: 82857720288.28.A450279 Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf03.hostedemail.com (Postfix) with ESMTP id 2AD4A20013 for ; Wed, 4 Dec 2024 15:52:59 +0000 (UTC) Authentication-Results: imf03.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b="MzTVy/46"; spf=pass (imf03.hostedemail.com: domain of cel@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=cel@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1733327573; a=rsa-sha256; cv=none; b=AbK3tM1pa/Tb5ZVtux27iJhsvoWtuHrrVsNqX+StzEZjluw5jr9htFPcV5FohtAnypwJVb NWArLd6uYpBaeL4SS+PYeLu1YFkOxRSuQd4Q01ELguq+hlVFRgLJqOUbAkQ9UHT2sYj9Zb +59c64f675LpYgktctonh7qwc1rzcGg= ARC-Authentication-Results: i=1; imf03.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b="MzTVy/46"; spf=pass (imf03.hostedemail.com: domain of cel@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=cel@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1733327573; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=WMzLT5z69BLA1X5osTSxIXe7QTXneqKtw7Kt5u79Nbo=; b=IVYm5EUan5FlMThiUD7tW4hgRz+7Jy71Oo5PMFMLrlSAtMF5YRZUNff9PmDM2iVEpe/8u/ TxrKh1HSslbLqSdjmmEpXsz2jQcR/QyH7KpZVPmoPcMb0PHFWcfOJpNNaGg6nCE3AzKURf ZnKCmvGJhauTfRIcANVJqh3Hz095/P4= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 07E395C6EB6; Wed, 4 Dec 2024 15:52:23 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id DCC74C4CEDD; Wed, 4 Dec 2024 15:53:04 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1733327585; bh=TsKe5WX9BiwgOVGJ1aGUhOHwVeN/D0/6ISUO68pxyBY=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=MzTVy/46mX0vtQ9cmM5USXoMMooJ1KLKQZkpf3oLyao/4qdPVY/7rtwZenbA2YDAY cX3TmG1nK4kY/xoSzqinYQ6TuE15iSm3PgFaFd0TNCbvFlErHAnNUQC5+da3lQvmR5 ANPRdGieOzXdv0BbgQU2g2rLaaccGk3PzVKuP203sRD9qmkuQiU4WNeU3goWstnVW+ 1TxqyAkImDkfOZa3eYwK6CROcOsupgBrH1o626gO/rs2rN3a4qF2fO0y3F0RaIE0SH +A4IeFU6F/XXfj70g/EzeqRNer66Ue79gfyuW1Cs2vIFg0B/H1l6X2ovepb5Yb1eJC Vn3ikyW1bNE6A== From: cel@kernel.org To: Hugh Dickens , Christian Brauner , Al Viro Cc: , , yukuai3@huawei.com, yangerkun@huaweicloud.com, Chuck Lever Subject: [PATCH v4 3/5] Revert "libfs: fix infinite directory reads for offset dir" Date: Wed, 4 Dec 2024 10:52:54 -0500 Message-ID: <20241204155257.1110338-4-cel@kernel.org> X-Mailer: git-send-email 2.47.0 In-Reply-To: <20241204155257.1110338-1-cel@kernel.org> References: <20241204155257.1110338-1-cel@kernel.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 2AD4A20013 X-Stat-Signature: ixt53g6ws3psx8sq5forsimgwsosxre1 X-Rspam-User: X-Rspamd-Server: rspam09 X-HE-Tag: 1733327579-553412 X-HE-Meta: U2FsdGVkX19C9BOhFHjIzaeJaDZUuzBBMYig6GVqDl3lnJlSxgI+U59jgqP8pDwoutY3gmxfC406Vqssqn/Af/ajUpTx0sMj9y3SRGXsC5BsUDtSJv25yw1BJnGZSQWnzd62tkZJayicDIGCR1JXGr210SJMswu4sunSCKxVRreGZqc7wa13ghYk+3ihk+PxXEIERs7N4opBy3pE96yEPPgkSVWYzsmcc2bnv3ol4rQtJKNc1dk7oXXo0lcwvljBAvCKY5mXYHlP+HLBD4znawn5EkkiNIg2foRmiNslioIBn0QMknNYkg5rWN4yKAhOfHMS0JVx0dLHISKnF2q2nJh5tVRcchZb7Vn0LXoQ+jpSTpIeyS9T3y4QLt2Mr2EZkp706otN2lQ+HfkLzzLMKOKACGwOmDe47T/xD+JMENJwh4T4xZa7Od8VxU94A0kCtD3iXtlNw9tkOtVdglvb4JoYZvSyDRFN7MGlS5aGbRihedkfmI17fM81FXFwBlFBFAuwc9Wdt0NYHzq52ADrFog+M4iw0aytv7g09moeP6Tv9nP7PjmflQJ6pMvKddejduRVt7+ig2LiDaWP0kwfuEkxwpMxrM9lV+ar4FLJOicPB80N5ovyJZkEegMDIYAEOSsFIl46D1NXgtGhOc+Dhav2eryCyIShROdk5/OtJZ/yaKbTiuczV440aOAsHnzfA4R+gJT4nmfBnrpITBe8POyvAsV9RxoP2R9l0COaOKH5A5k6t/VOEPx9lqpu+0f+u5tURFYgD0LjurQz2URnlQc6Kd8bkSKrsPq4nVcBzOa70aBeASA+GNaVUA4vAJEUFdpP4CksYxErbvfEwt1WW+lUbXvqdmyOq9vKRpgjaTsTntIHe9gS3250bvYFbISfdT+CKp/IZNH9S3fCcrgk5BQQ5TKRlcAat7Voan7gRJsRRgv4/hGgOTGxLlVaSXTFAB4n2/7dQs9VvnEvk3t 42f5Ca8Y /SBv1b/ttEwiv9vnNPDwn3XjmYn81fV9qXfriMxH3k7oWT8ZFYeO/ImryDMQzYTQzRQazNA7voqk9PnZnXRpajpPBghkH9F7eTsLadqlMcXCOml58q7Osy6+D4jTzF/xFXtumR77cwpJZXe08Rv54C7hhjKYjvf+Hu1zLoDYN7OnIJsQiKFDFiUzJigsjEMFMEU/066vSJ0B/CBhMk+K5Fz6nDsOsxGfALj9Mbpa4D4sr3v5odzq9xVwsnhOFaSRjaINt X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Chuck Lever The current directory offset allocator (based on mtree_alloc_cyclic) stores the next offset value to return in octx->next_offset. This mechanism typically returns values that increase monotonically over time. Eventually, though, the newly allocated offset value wraps back to a low number (say, 2) which is smaller than other already- allocated offset values. Yu Kuai reports that, after commit 64a7ce76fb90 ("libfs: fix infinite directory reads for offset dir"), if a directory's offset allocator wraps, existing entries are no longer visible via readdir/getdents because offset_readdir() stops listing entries once an entry's offset is larger than octx->next_offset. These entries vanish persistently -- they can be looked up, but will never again appear in readdir(3) output. The reason for this is that the commit treats directory offsets as monotonically increasing integer values rather than opaque cookies, and introduces this comparison: if (dentry2offset(dentry) >= last_index) { On 64-bit platforms, the directory offset value upper bound is 2^63 - 1. Directory offsets will monotonically increase for millions of years without wrapping. On 32-bit platforms, however, LONG_MAX is 2^31 - 1. The allocator can wrap after only a few weeks (at worst). Revert commit 64a7ce76fb90 ("libfs: fix infinite directory reads for offset dir") to prepare for a fix that can work properly on 32-bit systems and might apply to recent LTS kernels where shmem employs the simple_offset mechanism. Reported-by: Yu Kuai Signed-off-by: Chuck Lever --- fs/libfs.c | 35 +++++++++++------------------------ 1 file changed, 11 insertions(+), 24 deletions(-) diff --git a/fs/libfs.c b/fs/libfs.c index b668a4f5bbc9..461384fb6119 100644 --- a/fs/libfs.c +++ b/fs/libfs.c @@ -420,14 +420,6 @@ void simple_offset_destroy(struct offset_ctx *octx) mtree_destroy(&octx->mt); } -static int offset_dir_open(struct inode *inode, struct file *file) -{ - struct offset_ctx *ctx = inode->i_op->get_offset_ctx(inode); - - file->private_data = (void *)ctx->next_offset; - return 0; -} - /** * offset_dir_llseek - Advance the read position of a directory descriptor * @file: an open directory whose position is to be updated @@ -441,9 +433,6 @@ static int offset_dir_open(struct inode *inode, struct file *file) */ static loff_t offset_dir_llseek(struct file *file, loff_t offset, int whence) { - struct inode *inode = file->f_inode; - struct offset_ctx *ctx = inode->i_op->get_offset_ctx(inode); - switch (whence) { case SEEK_CUR: offset += file->f_pos; @@ -457,8 +446,7 @@ static loff_t offset_dir_llseek(struct file *file, loff_t offset, int whence) } /* In this case, ->private_data is protected by f_pos_lock */ - if (!offset) - file->private_data = (void *)ctx->next_offset; + file->private_data = NULL; return vfs_setpos(file, offset, LONG_MAX); } @@ -489,7 +477,7 @@ static bool offset_dir_emit(struct dir_context *ctx, struct dentry *dentry) inode->i_ino, fs_umode_to_dtype(inode->i_mode)); } -static void offset_iterate_dir(struct inode *inode, struct dir_context *ctx, long last_index) +static void *offset_iterate_dir(struct inode *inode, struct dir_context *ctx) { struct offset_ctx *octx = inode->i_op->get_offset_ctx(inode); struct dentry *dentry; @@ -497,21 +485,17 @@ static void offset_iterate_dir(struct inode *inode, struct dir_context *ctx, lon while (true) { dentry = offset_find_next(octx, ctx->pos); if (!dentry) - return; - - if (dentry2offset(dentry) >= last_index) { - dput(dentry); - return; - } + return ERR_PTR(-ENOENT); if (!offset_dir_emit(ctx, dentry)) { dput(dentry); - return; + break; } ctx->pos = dentry2offset(dentry) + 1; dput(dentry); } + return NULL; } /** @@ -538,19 +522,22 @@ static void offset_iterate_dir(struct inode *inode, struct dir_context *ctx, lon static int offset_readdir(struct file *file, struct dir_context *ctx) { struct dentry *dir = file->f_path.dentry; - long last_index = (long)file->private_data; lockdep_assert_held(&d_inode(dir)->i_rwsem); if (!dir_emit_dots(file, ctx)) return 0; - offset_iterate_dir(d_inode(dir), ctx, last_index); + /* In this case, ->private_data is protected by f_pos_lock */ + if (ctx->pos == DIR_OFFSET_MIN) + file->private_data = NULL; + else if (file->private_data == ERR_PTR(-ENOENT)) + return 0; + file->private_data = offset_iterate_dir(d_inode(dir), ctx); return 0; } const struct file_operations simple_offset_dir_operations = { - .open = offset_dir_open, .llseek = offset_dir_llseek, .iterate_shared = offset_readdir, .read = generic_read_dir, -- 2.47.0