From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E6D69C38147 for ; Wed, 18 Jan 2023 12:14:07 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 24BDF6B0071; Wed, 18 Jan 2023 07:14:07 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 1D47D6B0072; Wed, 18 Jan 2023 07:14:07 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 09CBC6B0074; Wed, 18 Jan 2023 07:14:07 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id E81266B0071 for ; Wed, 18 Jan 2023 07:14:06 -0500 (EST) Received: from smtpin13.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id C11D01C5FA0 for ; Wed, 18 Jan 2023 12:14:06 +0000 (UTC) X-FDA: 80367811692.13.144F8FC Received: from mxct.zte.com.cn (mxct.zte.com.cn [183.62.165.209]) by imf09.hostedemail.com (Postfix) with ESMTP id 6BB70140015 for ; Wed, 18 Jan 2023 12:13:56 +0000 (UTC) Authentication-Results: imf09.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=zte.com.cn; spf=pass (imf09.hostedemail.com: domain of yang.yang29@zte.com.cn designates 183.62.165.209 as permitted sender) smtp.mailfrom=yang.yang29@zte.com.cn ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1674044038; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding:in-reply-to: references; bh=8jekTMm1haKnVHWfcPYGCH/5nN7juwwoFUHKR2RPzzo=; b=fdqwzkvbssJUAH35OimOZL4tYYBlqCpt4GFYZDpOxLkD4UA+2ECNPvyIyLCplfyH37aGUT Pc638W6PHf6xBv3NXDTprCrbIS1RCMQzpf3Fo8McGTFOtDb3rMRmryM7Ry4aWZszbffjyL Gao8oZZlptk6rj9TsjYwM9c2fVAQWZU= ARC-Authentication-Results: i=1; imf09.hostedemail.com; dkim=none; dmarc=pass (policy=none) header.from=zte.com.cn; spf=pass (imf09.hostedemail.com: domain of yang.yang29@zte.com.cn designates 183.62.165.209 as permitted sender) smtp.mailfrom=yang.yang29@zte.com.cn ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1674044038; a=rsa-sha256; cv=none; b=EnPmsVEN0Xbe/UoBR9XO0BVl4beleiHi4MMe+Cf9P8OAwkQmYkNM7D5sm0aeTF16DLpuIU yDhOgf21QPPZZNET8dO05lqHhpEInID6JP3I9nOm2ZijllnogHgT+NSaA5fk8ebSO/kbpy XbqfqO6ctpe9/BuFUQIn8Sc3wjxM/HE= Received: from mse-fl2.zte.com.cn (unknown [10.5.228.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mxct.zte.com.cn (FangMail) with ESMTPS id 4Nxl6J36nzz501Sc; Wed, 18 Jan 2023 20:13:44 +0800 (CST) Received: from szxlzmapp04.zte.com.cn ([10.5.231.166]) by mse-fl2.zte.com.cn with SMTP id 30ICD0IN038239; Wed, 18 Jan 2023 20:13:00 +0800 (+08) (envelope-from yang.yang29@zte.com.cn) Received: from mapi (szxlzmapp04[null]) by mapi (Zmail) with MAPI id mid14; Wed, 18 Jan 2023 20:13:03 +0800 (CST) Date: Wed, 18 Jan 2023 20:13:03 +0800 (CST) X-Zmail-TransId: 2b0663c7e24fffffffff983002a8 X-Mailer: Zmail v1.0 Message-ID: <202301182013032211005@zte.com.cn> Mime-Version: 1.0 From: To: , , , Cc: , , , Subject: =?UTF-8?B?W1BBVENIIGxpbnV4LW5leHQgdjRdIHN3YXBfc3RhdGU6IHVwZGF0ZSBzaGFkb3dfbm9kZXMgZm9yIGFub255bW91cyBwYWdl?= Content-Type: text/plain; charset="UTF-8" X-MAIL:mse-fl2.zte.com.cn 30ICD0IN038239 X-Fangmail-Gw-Spam-Type: 0 X-Fangmail-Anti-Spam-Filtered: true X-Fangmail-MID-QID: 63C7E278.000/4Nxl6J36nzz501Sc X-Rspam-User: X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 6BB70140015 X-Stat-Signature: uqwii8htkqwy6oidc516ghfsoffx7nn5 X-HE-Tag: 1674044036-81677 X-HE-Meta: U2FsdGVkX1/XwOR2EzfEoR/OzWWyedGrEMCSC10OX1TzzxhtjpNBQzZtwrj7w0fJDHypMD1A7qphP1Ir12yCmeJmMa4irYPVTkAOMNfBGPjnqU5OMpn/by8wnhTXNM/4css0iKdrl9LBhPQL2KhpRucfINdfjkmpwLNdS+QVawWAsaxD41gomz0pwg2BVi3EZ9ZEILiG9edbfu5R4kC7zZcTt/VwpFfK0mFDynF2+GfVHW3/U2mqdTv/LTgZgjojq/IOCWm55KsMgJUhBlAItlOtRS3deiWMHk+yXOcTjGLlmdkXNQiQ77R5Dg6tXUPGg+QwO1CpgzN5s8A9E39T5vYPqJ5Ot0ea4sixHFlAYCJjCaB2DJ6sUdIlaUCaqcSWtMr/baFKspq8i+o1OlIwAYfbuW0Yf/1cf+3vxWKXVV1gqhgGzjtumOATm8zPqUGI/O5RUzd2mDGEybJXC4r0WYl3QzDeh1yK9UeiHG8ajkFmTEF1RS2KX29CRcCLEAE9OThjtIEG1IjOq9LgnpGOcrAeXjbJlw1vYCDygS6LzyE9/COfd2UIULng0DqiuUCOfxtWAe5Bo8ACVmbcoHZ55fRM13//ixSfAFI5HTwHinrqe3w1w52xjI/XVmPEilB3zspRtAgGcoXyz6aWeEOGujAAZ+MHsYw59eXM36CO5b2PB4Jnup4dB6WBbDFScDKL8kibwv9TT64qT3tvT+2sJxpPSffqVS1mDaQQuRotyVWDXaIDoji+96g1QGnHrPmXQrHIInk0thiB7wMMCOf0zUEvm1CyaOng89XAei02FjpRNgUxMaF1o1K1R2V1T+9Q7+XZKDQy0doWo83GaE4asKGu3bKoR0Fy0T+IVZtdX1VePYuw4ai7vu3Y6aEYoPXN+RaXRzCHqWTltvzzOCcVutTDrNuyQ2GkPRsJUPBJDAmB7wV7rv+/rvHTRGhQ9P7UQt39wJV/v2J7UmvlhQp rrFVXhjf ee3z/FkQDfUubE/W004gOPJHWe0iFqwK37QZm0ydFmKRqoqOdhZLDDV40LQhfRKLBBrsz17zH9fS9aizfpc2T/km+J/XgpfGuFm9xN11qr4SRIytcaGsrpyCzEIUBt8IUCGzDYGfDIWHv/b9X6tknSrcdZWcmVdX7OpZp1yIHflJOMThdWr6YYIAtvRpUoIs6FLkSnKzBmv8ujzQkA9IgWOZAn4206koNGKCJjBAaHsR4NXVcPr6tHdUHi5YXjs6zyQ/lpvDgZi7Rb3oKarblX64ztBgYStS5hXBYabx4c8cJSefDs1ojZtdAjGX6rIrLw+4EQb55F7Cfr3p6vVTe0Fu2XmAHcqs0eew+7cVh7vbV5BeMBngcbY+J8FBePH7yUOp4w/tr8ujltMhSeVu8ZwYSag== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: From: Yang Yang Shadow_nodes is for shadow nodes reclaiming of workingset handling, it is updated when page cache add or delete since long time ago workingset only supported page cache. But when workingset supports anonymous page detection, we missied updating shadow nodes for it. This caused that shadow nodes of anonymous page will never be reclaimd by scan_shadow_nodes() even they use much memory and system memory is tense. So update shadow_nodes of anonymous page when swap cache is add or delete by calling xas_set_update(..workingset_update_node). Fixes: aae466b0052e ("mm/swap: implement workingset detection for anonymous LRU") Signed-off-by: Yang Yang Reviewed-by: Ran Xiaokai --- change for v4 - Fix kernel panic while calling spin_trylock(&mapping->host->i_lock) in shadow_lru_isolate(). For anonymous page mapping->host is NULL, so add a check. Thanks to Matthew Wilcox. change for v3 - Modify git log of explain of what this patch do in imperative mood. Thanks to Bagas Sanjaya. change for v2 - Include a description of the user-visible effect. Add fixes tag. Modify comments. Also call workingset_update_node() in clear_shadow_from_swap_cache(). Thanks to Matthew Wilcox. --- include/linux/xarray.h | 3 ++- mm/swap_state.c | 6 ++++++ mm/workingset.c | 21 +++++++++++++-------- 3 files changed, 21 insertions(+), 9 deletions(-) diff --git a/include/linux/xarray.h b/include/linux/xarray.h index 44dd6d6e01bc..741703b45f61 100644 --- a/include/linux/xarray.h +++ b/include/linux/xarray.h @@ -1643,7 +1643,8 @@ static inline void xas_set_order(struct xa_state *xas, unsigned long index, * @update: Function to call when updating a node. * * The XArray can notify a caller after it has updated an xa_node. - * This is advanced functionality and is only needed by the page cache. + * This is advanced functionality and is only needed by the page + * cache and swap cache. */ static inline void xas_set_update(struct xa_state *xas, xa_update_node_t update) { diff --git a/mm/swap_state.c b/mm/swap_state.c index cb9aaa00951d..7a003d8abb37 100644 --- a/mm/swap_state.c +++ b/mm/swap_state.c @@ -94,6 +94,8 @@ int add_to_swap_cache(struct folio *folio, swp_entry_t entry, unsigned long i, nr = folio_nr_pages(folio); void *old; + xas_set_update(&xas, workingset_update_node); + VM_BUG_ON_FOLIO(!folio_test_locked(folio), folio); VM_BUG_ON_FOLIO(folio_test_swapcache(folio), folio); VM_BUG_ON_FOLIO(!folio_test_swapbacked(folio), folio); @@ -145,6 +147,8 @@ void __delete_from_swap_cache(struct folio *folio, pgoff_t idx = swp_offset(entry); XA_STATE(xas, &address_space->i_pages, idx); + xas_set_update(&xas, workingset_update_node); + VM_BUG_ON_FOLIO(!folio_test_locked(folio), folio); VM_BUG_ON_FOLIO(!folio_test_swapcache(folio), folio); VM_BUG_ON_FOLIO(folio_test_writeback(folio), folio); @@ -252,6 +256,8 @@ void clear_shadow_from_swap_cache(int type, unsigned long begin, struct address_space *address_space = swap_address_space(entry); XA_STATE(xas, &address_space->i_pages, curr); + xas_set_update(&xas, workingset_update_node); + xa_lock_irq(&address_space->i_pages); xas_for_each(&xas, old, end) { if (!xa_is_value(old)) diff --git a/mm/workingset.c b/mm/workingset.c index f194d13beabb..00c6f4d9d9be 100644 --- a/mm/workingset.c +++ b/mm/workingset.c @@ -657,11 +657,14 @@ static enum lru_status shadow_lru_isolate(struct list_head *item, goto out; } - if (!spin_trylock(&mapping->host->i_lock)) { - xa_unlock(&mapping->i_pages); - spin_unlock_irq(lru_lock); - ret = LRU_RETRY; - goto out; + /* For page cache we need to hold i_lock */ + if (mapping->host != NULL) { + if (!spin_trylock(&mapping->host->i_lock)) { + xa_unlock(&mapping->i_pages); + spin_unlock_irq(lru_lock); + ret = LRU_RETRY; + goto out; + } } list_lru_isolate(lru, item); @@ -683,9 +686,11 @@ static enum lru_status shadow_lru_isolate(struct list_head *item, out_invalid: xa_unlock_irq(&mapping->i_pages); - if (mapping_shrinkable(mapping)) - inode_add_lru(mapping->host); - spin_unlock(&mapping->host->i_lock); + if (mapping->host != NULL) { + if (mapping_shrinkable(mapping)) + inode_add_lru(mapping->host); + spin_unlock(&mapping->host->i_lock); + } ret = LRU_REMOVED_RETRY; out: cond_resched(); -- 2.25.1