From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7AF5AC433EF for ; Mon, 16 May 2022 10:51:42 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 1D3E76B0075; Mon, 16 May 2022 06:51:42 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 182B26B0078; Mon, 16 May 2022 06:51:42 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 04C166B007B; Mon, 16 May 2022 06:51:42 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id EC19B6B0075 for ; Mon, 16 May 2022 06:51:41 -0400 (EDT) Received: from smtpin22.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id C83FC3380E for ; Mon, 16 May 2022 10:51:41 +0000 (UTC) X-FDA: 79471290402.22.10EAC3A Received: from mail-pg1-f169.google.com (mail-pg1-f169.google.com [209.85.215.169]) by imf13.hostedemail.com (Postfix) with ESMTP id 5D1D5200C6 for ; Mon, 16 May 2022 10:51:20 +0000 (UTC) Received: by mail-pg1-f169.google.com with SMTP id a191so13744077pge.2 for ; Mon, 16 May 2022 03:51:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chromium.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=JMk8CHB5bcq3ReSzg2cgECR0dlKU/tAyeAvoi2QnfNE=; b=OKNynNPjFwGSD1DaPCEF49HEOaVfWkiddIt3TLXpzovZPm0w32mw1+sI5jGIZ53iqU DL9zHg/3+jPPwXL2vHoPtL1DSdVsyH7bZNV/hZuu9cmfO6L1xO1Gfss1yn77yPBo7s1z +wJTDMciFy2TsqHd/skAMTirRIHnkR7xPShJU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=JMk8CHB5bcq3ReSzg2cgECR0dlKU/tAyeAvoi2QnfNE=; b=pzFn9vHolaKPBAo9kJoVJInzRNVPssKf8+e5iEihM9dM/NE6VbdUEF4diN9SDRnggQ lP7B4Dne1e7gJGeCS+HF4+Xf7kyQFPu4+6Hawxdq1wiN0mK9QAf8RBUNtUU7Z1SAyi9a opucR2Zk+TUXX7f0BepsvKsZGYdXkMXJ/nrNrX+5BcoV7F+YGzcOxKeouAz+dwfYasDy Xg9doCV29iyzwkhmugbspsnZF5WEGGctb00j7cJwZQaQpVDtP0CWP1osgfUVsubXpCk1 r9tZQZZvJtr2W1yUQuZj86Xd1XlUIO+PBEWYVBDuUZhJ1XasYRLffR7z/HiBbzyqrhQM R8jA== X-Gm-Message-State: AOAM530DlED6WeSmJo8KkwPGRlYNsuL7lLuMLjyNeYqEwo23UGRr4T09 4hBCjtzaVtF5b1m+YIPRBsmElA== X-Google-Smtp-Source: ABdhPJxLUCazJwseAQ0wLAS5elWc0Q0J8Q3r6TfTavcCh6mUPnQw7yZb7qUH+IJgOAbR/PLOnZFxKw== X-Received: by 2002:a05:6a00:10cc:b0:506:e0:d6c3 with SMTP id d12-20020a056a0010cc00b0050600e0d6c3mr17147886pfu.33.1652698300335; Mon, 16 May 2022 03:51:40 -0700 (PDT) Received: from hsinyi-z840.tpe.corp.google.com ([2401:fa00:1:10:cdcb:c865:6f65:d875]) by smtp.gmail.com with ESMTPSA id o14-20020a655bce000000b003db8dd388afsm6332778pgr.10.2022.05.16.03.51.38 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 May 2022 03:51:40 -0700 (PDT) From: Hsin-Yi Wang To: Phillip Lougher , Matthew Wilcox , Xiongwei Song Cc: Zheng Liang , Zhang Yi , Hou Tao , Miao Xie , Andrew Morton , "linux-mm @ kvack . org" , "squashfs-devel @ lists . sourceforge . net" , linux-kernel@vger.kernel.org Subject: [PATCH 2/2] squashfs: implement readahead Date: Mon, 16 May 2022 18:51:03 +0800 Message-Id: <20220516105100.1412740-3-hsinyi@chromium.org> X-Mailer: git-send-email 2.36.0.550.gb090851708-goog In-Reply-To: <20220516105100.1412740-1-hsinyi@chromium.org> References: <20220516105100.1412740-1-hsinyi@chromium.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 5D1D5200C6 X-Stat-Signature: itsh71ybnxrzy9iijrombg3tfhysks55 X-Rspam-User: Authentication-Results: imf13.hostedemail.com; dkim=pass header.d=chromium.org header.s=google header.b=OKNynNPj; spf=pass (imf13.hostedemail.com: domain of hsinyi@chromium.org designates 209.85.215.169 as permitted sender) smtp.mailfrom=hsinyi@chromium.org; dmarc=pass (policy=none) header.from=chromium.org X-HE-Tag: 1652698280-971281 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Implement readahead callback for squashfs. It will read datablocks which cover pages in readahead request. For a few cases it will not mark page as uptodate, including: - file end is 0. - zero filled blocks. - current batch of pages isn't in the same datablock or not enough in a datablock. Otherwise pages will be marked as uptodate. The unhandled pages will be updated by readpage later. Signed-off-by: Hsin-Yi Wang --- Note that this patch was not formally sent to the list before. It's attached to email thread for discussion as it's still under development. - v1: The patch outline was suggested by Matthew. It went through a few reviews by Matthew offline. - v2: https://lore.kernel.org/linux-mm/Yn5Yij9pRPCzDozt@casper.infradead.org/t/#m442435c149d411c5c9d8019cff5915419b04bf10 This is a resend of v1. - v3: https://lore.kernel.org/linux-mm/Yn5Yij9pRPCzDozt@casper.infradead.org/t/#m55a709e6ba5ec59fe95323a67a7f3d6b1953e470 Fix page actor size to avoid a crash from squashfs_decompress(). Suggested by Phillip Lougher[1] [1] https://lore.kernel.org/linux-mm/Yn5Yij9pRPCzDozt@casper.infradead.org/t/#m687f82debb7667ff31982a05aef3eba081eb5039 - v4: https://lore.kernel.org/linux-mm/Yn5Yij9pRPCzDozt@casper.infradead.org/t/#mf93267690ec2e841dade6a494fe72c84b61328d9 Fix to free page after used. Suggested by Xiongwei Song[2] Refactor the skip page logic to possible improve the performance. Suggested by Phillip Lougher[3] [2] https://lore.kernel.org/linux-mm/Yn5Yij9pRPCzDozt@casper.infradead.org/t/#m0e7b33d167b1ef0eb39b9f41c32ed3f80dfced18 [3] https://lore.kernel.org/linux-mm/Yn5Yij9pRPCzDozt@casper.infradead.org/t/#m1e0a8f8e4a98d79d14c81b66e197b6dc0a3b77a1 --- fs/squashfs/file.c | 77 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 77 insertions(+) diff --git a/fs/squashfs/file.c b/fs/squashfs/file.c index a8e495d8eb86..91dfec792f4c 100644 --- a/fs/squashfs/file.c +++ b/fs/squashfs/file.c @@ -39,6 +39,7 @@ #include "squashfs_fs_sb.h" #include "squashfs_fs_i.h" #include "squashfs.h" +#include "page_actor.h" /* * Locate cache slot in range [offset, index] for specified inode. If @@ -495,7 +496,83 @@ static int squashfs_read_folio(struct file *file, struct folio *folio) return 0; } +static void squashfs_readahead(struct readahead_control *ractl) +{ + struct inode *inode = ractl->mapping->host; + struct squashfs_sb_info *msblk = inode->i_sb->s_fs_info; + size_t mask = (1UL << msblk->block_log) - 1; + size_t shift = msblk->block_log - PAGE_SHIFT; + loff_t req_end = readahead_pos(ractl) + readahead_length(ractl); + loff_t start = readahead_pos(ractl) &~ mask; + size_t len = readahead_length(ractl) + readahead_pos(ractl) - start; + struct squashfs_page_actor *actor; + unsigned int nr_pages = 0; + struct page **pages; + u64 block = 0; + int bsize, res, i, index; + int file_end = i_size_read(inode) >> msblk->block_log; + unsigned int max_pages = 1UL << shift; + + readahead_expand(ractl, start, (len | mask) + 1); + + if (readahead_pos(ractl) + readahead_length(ractl) < req_end || + file_end == 0) + return; + + pages = kmalloc_array(max_pages, sizeof(void *), GFP_KERNEL); + if (!pages) + return; + + actor = squashfs_page_actor_init_special(pages, max_pages, 0); + if (!actor) + goto out; + + for (;;) { + nr_pages = __readahead_batch(ractl, pages, max_pages); + if (!nr_pages) + break; + + if (readahead_pos(ractl) >= i_size_read(inode) || + nr_pages < max_pages) + goto skip_pages; + + index = pages[0]->index >> shift; + if ((pages[nr_pages - 1]->index >> shift) != index) + goto skip_pages; + + bsize = read_blocklist(inode, index, &block); + if (bsize == 0) + goto skip_pages; + + res = squashfs_read_data(inode->i_sb, block, bsize, NULL, + actor); + + if (res >= 0) + for (i = 0; i < nr_pages; i++) + SetPageUptodate(pages[i]); + + for (i = 0; i < nr_pages; i++) { + unlock_page(pages[i]); + put_page(pages[i]); + } + } + + kfree(actor); + kfree(pages); + return; + +skip_pages: + for (i = 0; i < nr_pages; i++) { + unlock_page(pages[i]); + put_page(pages[i]); + } + + kfree(actor); +out: + kfree(pages); +} const struct address_space_operations squashfs_aops = { .read_folio = squashfs_read_folio + .readahead = squashfs_readahead }; -- 2.36.0.550.gb090851708-goog