From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E31ABC433EF for ; Tue, 8 Mar 2022 17:41:16 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 767898D000E; Tue, 8 Mar 2022 12:41:16 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 721A88D0001; Tue, 8 Mar 2022 12:41:16 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5DE158D000E; Tue, 8 Mar 2022 12:41:16 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0067.hostedemail.com [216.40.44.67]) by kanga.kvack.org (Postfix) with ESMTP id 4EC418D0001 for ; Tue, 8 Mar 2022 12:41:16 -0500 (EST) Received: from smtpin20.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 7D1849636B for ; Tue, 8 Mar 2022 17:41:14 +0000 (UTC) X-FDA: 79221935268.20.0B5543C Received: from mail-pg1-f174.google.com (mail-pg1-f174.google.com [209.85.215.174]) by imf29.hostedemail.com (Postfix) with ESMTP id 0C624120011 for ; Tue, 8 Mar 2022 17:41:13 +0000 (UTC) Received: by mail-pg1-f174.google.com with SMTP id 27so17070195pgk.10 for ; Tue, 08 Mar 2022 09:41:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=fdTk4aYquZTIk9aPhP7DqM2Gxsxd3HuYNcTcih9MUlU=; b=iMAOKf3zl4qCHt1XZ0nGKGE65C8mjYz3b1xzdmyGig1ijiRkXw+4jB2MGTAUm4tfnd UebN0kQ9pXWaqUsDbrYmAaPJWO1+HvZJkI8QOuxs/8ND/tN1/23iPiiTr0yPnryDF0ZE IyaVTR3zBl1juxUvIaoC3IwfcyvgsYVm/8mJSlvDkPPg6cN4MBc4et4NxXb1yGSlvzCj hw9WcGUTWkvDQSUqLvOXTrp/ukeJklvFREOvYGC2d9yUOONeIjk+JM0v9zx17FR1dq33 oH4KG4rQHNlC7O3RsTowLVcorX42fFu6vfaCQRIEYnd8CndREhcUyNfXJ9OTXajpKST6 GjcQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=fdTk4aYquZTIk9aPhP7DqM2Gxsxd3HuYNcTcih9MUlU=; b=FUyETlJeHPY7RLOTWpgj8tWudOrsvB00FAWdT6B80AK2lfSj1cyY5MS5Z9uBd4FbgM 8bX0cRnkBxc86j5S5QaTOpiQBtYO8sm4I2JhoBScAsYobI1PRRWuEZ8//hNzIaX+8JL4 kjGe1SwhmDIu6uKSpHxoC/8U+LFtuwcvbj42OaVC6OevYKU5+2xrOdxuug9WsNlhOAV+ mjubjU2S26E6myhqVomi38dLrdFlS0QDuEw1v7cqa0qAgYQ66FcQXXVd33Aw3Qe9EhgI mccgSQKzG5gVZCfTloT+e+99Mhh63HkNqoho7PMDnBKoqMrGaTxPORATcCyw0ehwhkX6 0+tw== X-Gm-Message-State: AOAM5310LICa7BZKMC6C/WQ0uKcl77Zcr/0Moy3XcY28bmX7MCxu1JeV TmcNIymFR1HVJjJMYR/IzTY= X-Google-Smtp-Source: ABdhPJxXnwJGrLzNZwn6eQDyYjwzGGbh7RRKQ6ybShnYyN9Ay7t+rlTEHlZLzMTpuo+6FqqBqVQvPA== X-Received: by 2002:a63:ef4f:0:b0:375:6898:f6b8 with SMTP id c15-20020a63ef4f000000b003756898f6b8mr15186903pgk.59.1646761272552; Tue, 08 Mar 2022 09:41:12 -0800 (PST) Received: from google.com ([2620:15c:211:201:ec3e:a6ab:7b5b:ed81]) by smtp.gmail.com with ESMTPSA id b2-20020a056a000a8200b004f1111c66afsm22161988pfl.148.2022.03.08.09.41.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 08 Mar 2022 09:41:12 -0800 (PST) Date: Tue, 8 Mar 2022 09:41:09 -0800 From: Minchan Kim To: Marcelo Tosatti Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org, Matthew Wilcox , Mel Gorman , Nicolas Saenz Julienne , Juri Lelli , Thomas Gleixner , Sebastian Andrzej Siewior , "Paul E. McKenney" , Andrew Morton Subject: Re: [patch v4] mm: lru_cache_disable: replace work queue synchronization with synchronize_rcu Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspam-User: X-Rspamd-Server: rspam04 X-Rspamd-Queue-Id: 0C624120011 X-Stat-Signature: fgboixm6giwwqbexow6ji4wt4zfizqed Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=iMAOKf3z; spf=pass (imf29.hostedemail.com: domain of minchan.kim@gmail.com designates 209.85.215.174 as permitted sender) smtp.mailfrom=minchan.kim@gmail.com; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=kernel.org (policy=none) X-HE-Tag: 1646761273-722276 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, Mar 04, 2022 at 01:29:31PM -0300, Marcelo Tosatti wrote: > > On systems that run FIFO:1 applications that busy loop > on isolated CPUs, executing tasks on such CPUs under > lower priority is undesired (since that will either > hang the system, or cause longer interruption to the > FIFO task due to execution of lower priority task > with very small sched slices). > > Commit d479960e44f27e0e52ba31b21740b703c538027c ("mm: disable LRU > pagevec during the migration temporarily") relies on > queueing work items on all online CPUs to ensure visibility > of lru_disable_count. > > However, its possible to use synchronize_rcu which will provide the same > guarantees (see comment this patch modifies on lru_cache_disable). > > Fixes: > > [ 1873.243925] INFO: task kworker/u160:0:9 blocked for more than 622 seconds. > [ 1873.243927] Tainted: G I --------- --- 5.14.0-31.rt21.31.el9.x86_64 #1 > [ 1873.243929] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. > [ 1873.243929] task:kworker/u160:0 state:D stack: 0 pid: 9 ppid: 2 flags:0x00004000 > [ 1873.243932] Workqueue: cpuset_migrate_mm cpuset_migrate_mm_workfn > [ 1873.243936] Call Trace: > [ 1873.243938] __schedule+0x21b/0x5b0 > [ 1873.243941] schedule+0x43/0xe0 > [ 1873.243943] schedule_timeout+0x14d/0x190 > [ 1873.243946] ? resched_curr+0x20/0xe0 > [ 1873.243953] ? __prepare_to_swait+0x4b/0x70 > [ 1873.243958] wait_for_completion+0x84/0xe0 > [ 1873.243962] __flush_work.isra.0+0x146/0x200 > [ 1873.243966] ? flush_workqueue_prep_pwqs+0x130/0x130 > [ 1873.243971] __lru_add_drain_all+0x158/0x1f0 > [ 1873.243978] do_migrate_pages+0x3d/0x2d0 > [ 1873.243985] ? pick_next_task_fair+0x39/0x3b0 > [ 1873.243989] ? put_prev_task_fair+0x1e/0x30 > [ 1873.243992] ? pick_next_task+0xb30/0xbd0 > [ 1873.243995] ? __tick_nohz_task_switch+0x1e/0x70 > [ 1873.244000] ? raw_spin_rq_unlock+0x18/0x60 > [ 1873.244002] ? finish_task_switch.isra.0+0xc1/0x2d0 > [ 1873.244005] ? __switch_to+0x12f/0x510 > [ 1873.244013] cpuset_migrate_mm_workfn+0x22/0x40 > [ 1873.244016] process_one_work+0x1e0/0x410 > [ 1873.244019] worker_thread+0x50/0x3b0 > [ 1873.244022] ? process_one_work+0x410/0x410 > [ 1873.244024] kthread+0x173/0x190 > [ 1873.244027] ? set_kthread_struct+0x40/0x40 > [ 1873.244031] ret_from_fork+0x1f/0x30 > > Signed-off-by: Marcelo Tosatti Looks like great to me. Acked-by: Minchan Kim While I reviewed it, it seems I found a bug that br_lru_install needs to check lru_cache_disabled under bh_lru_lock. Let me cook the patch. Thanks!