From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id AE508CCFA03 for ; Fri, 31 Oct 2025 19:29:38 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id AB52A8E0088; Fri, 31 Oct 2025 15:29:37 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id A8C248E0068; Fri, 31 Oct 2025 15:29:37 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 97B768E0088; Fri, 31 Oct 2025 15:29:37 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 860278E0068 for ; Fri, 31 Oct 2025 15:29:37 -0400 (EDT) Received: from smtpin17.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 43B891A04F2 for ; Fri, 31 Oct 2025 19:29:37 +0000 (UTC) X-FDA: 84059398794.17.A3D1405 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf25.hostedemail.com (Postfix) with ESMTP id B7580A0016 for ; Fri, 31 Oct 2025 19:29:34 +0000 (UTC) Authentication-Results: imf25.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Cy3R+jqB; spf=pass (imf25.hostedemail.com: domain of llong@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=llong@redhat.com; dmarc=pass (policy=quarantine) header.from=redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1761938975; a=rsa-sha256; cv=none; b=Y55K0OhG7v7cZN1MWKSczEItUxb+Fnj1vfqE7BrW67G8DwMHo4pOFkpWtIEqjOy+YpsMUP d59iMzagNrCUcteq4llgl/xeFwChkjwgemRFx8WTMXzDazCJ7DWf99hdWltIG3pfkTfRad JSrzaKCajLrJ8Riirlbf0v/t8KQfiAQ= ARC-Authentication-Results: i=1; imf25.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=Cy3R+jqB; spf=pass (imf25.hostedemail.com: domain of llong@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=llong@redhat.com; dmarc=pass (policy=quarantine) header.from=redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1761938975; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=S5LPLyq7lQEV5yeoAq12Udobk8GGeNqbKub31AGenK0=; b=M/unPQ0K1Qc1h9U2HR0Puzx0oiN+3SPYEehmLNFQ0B4mVYGC/v4ePpKqm+sWDHIDY0dnJI 4Iv/if5Xim91IhatqAhFVXYLSyIQL3I0GQEfrcNmgyr8Fe0RGykDfAstYyoXdGUtD7sC/D 4uplBfQBmxX+lvO3FTYN2G/HcD2PgOY= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1761938974; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=S5LPLyq7lQEV5yeoAq12Udobk8GGeNqbKub31AGenK0=; b=Cy3R+jqBjD/Z3VQyAX1rX1Y7koSrpX147QaP5N8hJYCPS7/KmKpEt+cXe7jufChqHTltp7 qi2SUJSalt0scZHEHizzpedJMNDdFcDuK17Q1bW51Sddw6yhf/mp+GcnSisCsKOaXHtB3M /uHUKtIOMkeTpOuRu95seka292Q45kI= Received: from mail-qt1-f198.google.com (mail-qt1-f198.google.com [209.85.160.198]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-299-d2STNXUwO-C2gEisEfGZaQ-1; Fri, 31 Oct 2025 15:29:32 -0400 X-MC-Unique: d2STNXUwO-C2gEisEfGZaQ-1 X-Mimecast-MFC-AGG-ID: d2STNXUwO-C2gEisEfGZaQ_1761938972 Received: by mail-qt1-f198.google.com with SMTP id d75a77b69052e-4e892acc0b3so65068081cf.2 for ; Fri, 31 Oct 2025 12:29:32 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1761938972; x=1762543772; h=content-transfer-encoding:in-reply-to:content-language:references :cc:to:subject:user-agent:mime-version:date:message-id:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=S5LPLyq7lQEV5yeoAq12Udobk8GGeNqbKub31AGenK0=; b=Ufc/20HMuGmDC3TKkr5oMPfyrjWkcQ7ZkIChC2F1PDhltOkKeVtSO9q5Virt1DYGR0 il3ILtBiQY0zeXQQmGz5tgslg/hTE28e3vUeTJq4VxLzOBVrQWoyNpRdIxz2iZ/q+upB KggsKg02xuS1KfW0J8fNC47vWMqUbjRfkI55KH3k/leFYIwhu8bhlIgQy2nXJvXdT53c 1nFjFbttX6oAQIEsIsa+tiJfbkFB8dtwsncOxTpPE/8ZkrNfSX952YQ6tn9+h5Ed5MJI n/fGV97g8kEdO5sg2ZKx8J2XhMeVubYjqoKwt3llVESOIOo1DgUqOXYCT50TXZvGdo3J I8mg== X-Forwarded-Encrypted: i=1; AJvYcCUp8QkJsVODeWNOFnruDcGPMKQkp86xVSrXkwxcisrIkK8rbMXybDMbXn6pGzU++XhI/I/YJLnHfA==@kvack.org X-Gm-Message-State: AOJu0YyIMXU3PNxx3OMMgHLTT+u1bgoOMzuLSDKfU+QoOHg3ZbDgrP08 6D6ULX/oEngv2HTsXxp98zwhJkVhvt+zSw1qKNGYXxgK/WooLfs3/ibKeyN9R7sB5SoFw2EncJU 41/VjG6PM/Eqab+63n/zF+hrdQgEQImfExyts8rv6krANlm11tDDb X-Gm-Gg: ASbGnctRGxsYj9D/ZPXIqtICWfWmGuEvlW7a3lKyNmAidCJwe5hB0Tg2x0hCGVcpTtF fzoj1UxYFc6z4WW1eOxmLtjVb0lKHMYqND40KvW1HsovPEUnVu2ecoFLvxUt9sI8H1jr5SzR8so ztoq6oMUx7LJF+xvTrapCjxO9iYYIenU5gx6rrsFcN6r0b0ZnSox+bUqFPjPHxRLzJI39QFkaL3 dLh/l8Pu5KyQud3Fmq+11T0Ee9MV3e/zjP7vG95+81z14JBtnlBjWSTQQlkBRaskD/IB433osht Sd/A3IcSoEIrocxmmd+P8s5AxB3WxlRi68LZaSVjcHc25HWnlV1d9Y9pN8uxCDufx3ztr0NZy6g NH1yQCVqA9SyLtoqRU1LK488u9tmLwrGne8sMeXw7ku9Y0Q== X-Received: by 2002:a05:622a:2307:b0:4ec:f9c2:c1f2 with SMTP id d75a77b69052e-4ed30ddf142mr56740951cf.25.1761938972068; Fri, 31 Oct 2025 12:29:32 -0700 (PDT) X-Google-Smtp-Source: AGHT+IHsufGaMUA5MBhPpAao9g1sdBf7cQRBSBhg2O/Yxw8E8X+buRZx82UZZuHnveKzdlEADeGJAg== X-Received: by 2002:a05:622a:2307:b0:4ec:f9c2:c1f2 with SMTP id d75a77b69052e-4ed30ddf142mr56740481cf.25.1761938971569; Fri, 31 Oct 2025 12:29:31 -0700 (PDT) Received: from ?IPV6:2601:188:c102:b180:1f8b:71d0:77b1:1f6e? ([2601:188:c102:b180:1f8b:71d0:77b1:1f6e]) by smtp.gmail.com with ESMTPSA id d75a77b69052e-4ed3536a24bsm15383671cf.35.2025.10.31.12.29.29 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 31 Oct 2025 12:29:30 -0700 (PDT) From: Waiman Long X-Google-Original-From: Waiman Long Message-ID: <3a15d293-43b5-453d-9ba7-9b145aaba492@redhat.com> Date: Fri, 31 Oct 2025 15:29:28 -0400 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH 12/33] sched/isolation: Convert housekeeping cpumasks to rcu pointers To: Frederic Weisbecker , Waiman Long Cc: Chen Ridong , LKML , =?UTF-8?Q?Michal_Koutn=C3=BD?= , Andrew Morton , Bjorn Helgaas , Catalin Marinas , Danilo Krummrich , "David S . Miller" , Eric Dumazet , Gabriele Monaco , Greg Kroah-Hartman , Ingo Molnar , Jakub Kicinski , Jens Axboe , Johannes Weiner , Lai Jiangshan , Marco Crivellari , Michal Hocko , Muchun Song , Paolo Abeni , Peter Zijlstra , Phil Auld , "Rafael J . Wysocki" , Roman Gushchin , Shakeel Butt , Simon Horman , Tejun Heo , Thomas Gleixner , Vlastimil Babka , Will Deacon , cgroups@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-block@vger.kernel.org, linux-mm@kvack.org, linux-pci@vger.kernel.org, netdev@vger.kernel.org References: <20251013203146.10162-1-frederic@kernel.org> <20251013203146.10162-13-frederic@kernel.org> <510b0185-51d6-44e6-8c39-dfc4c1721e03@redhat.com> In-Reply-To: X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: fRtXTygjsdGakiTYiZIrviIdZN3pCn0femv7cQ_-z40_1761938972 X-Mimecast-Originator: redhat.com Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspam-User: X-Stat-Signature: e5ty959fchu1ytz1jp9sir5ayim7rext X-Rspamd-Queue-Id: B7580A0016 X-Rspamd-Server: rspam09 X-HE-Tag: 1761938974-990312 X-HE-Meta: U2FsdGVkX18ygkv0c3yYlY7j1Bp3BEUyBhTTzRYWol4Ms8BTsTmDME3bfhjc2pZLE3+yVFKVej2LVBGGsVISmsGpzZ4HpDAR7c8zt9Y5C3tMTo9Op/lZVtMIqerd4uyHekHJRqonJFQ3tjGMX3QqoALha8pN82YUdTcMsxtVwCl5KFsCSH+OuxUw+vg8kAD5wWqNkxxHEZC7NmJYpWHWib5ZUS91LafxLAJ/XEqMbTBNhiwiOFSFWju7x7EUTIyZWZeNJq6NE1l73T7LJUGr0lhdsqaQW7CrGF7mbVJtSk2f1YgwZKaUbcH4OpKunMWs41BicTRi0Dzl1GMUBHOyCHibpdR6ZNxHOVozNYYE79JNBPzDwdXvQtM3ykDv/F23qQd74atFaQInp8h+jR4YgBNtXwMe5TP2SjUShGzQKMFOqW8SXlII2IUiF5QkDyHw6t0bfht4M9QDZdESaeJuAOgleCYXcrkmUcNuU8oZFRxQimMqhudi0VAlddmIvqJVMa7vxqV39WWa1rrc5jWCRA4UI9yZ1TFXhqrM+CyQBS2g6hBn2lJmQun2sinLwFN0Dc0CgYLAlQsnbIxU0oNwaPGi1i+miyNEkCrM+XRudmQroskrzLLB+1Y9UrQ9MX+L3yyYigd0bJVvltzzL7BZ5GrKCq0kYIaodeReNBKiBtk1j4Z3KzktUdCPlnv95Sfq0rakWXsuJmgXVGKcGHPsXKh7f9TfZSdC8QmTuhLmne3Uozmfct69t6UzfZzUtE5t0wsptNRALK+BASXLUf+mNfQBfSao695DBkDstiMI89g+w0ik819ELVqWFuwv8vMJFjIfu8bY2pZO4PHredqcz4tK4ptgC5zVZGH+KbTMqaGrG1vj1XAHj+OvHF2ujXnwtSpCkJCHBrM/+D8ZnV8Dz8zk/+0gJT976EirnxrVzfz5uymeq+lc0py/t6UhYezUL+vWWSXK/TLyBRROmDI t/h0l+/c ATFa2GSVZIceHIkVrlcV+YsVAwso6LrS453c9uUfsj7FNKBOBGSx49QaVlaacMdikOgnFJFGcRAIfUfvHlCqHt07tQP6lWVqqjLrtlZmc3roINPDOVqVM3IwH4z5PvMRb6syHqZqllKRGHy6LuIGiFzpHVGGpjeMnLXVuT/+wPH8Ivmifq3xCucz7npPagJ00sB7MIGe7w1QIJED8AGeDAJsHwrknQHIEIaLsfdbSdwGL4OSnP9MZ1OwEzp1S96n/cy48LfoZR25iYRY7vuaWMCM3+StdJSpF4DJZ8tzkvWOSuh8d634FtGb2WW4EJkYg2lmTXnCkVIg8Cq2n340tnZtPGLObZhOPLi1RlMB2Jq+pr214sQJjnyWai74lWFA0yiyJltF8Ir2yNXkPDPu5Up6Hl+YwRj/UsKdVe8sn/0BaqazdNAk89q3K4zbbXZ9JPFjEvyNKXKbsXEcPr0RThhSaI0cV53oOjy5Kp6O2+V/KR2M4Xx4ZXQe9fSKAQK9DDuE7YLu+rqV+WP8mGrZiRMdhNG7pdVzDb5d5HGA0UK0YqIKbWP7p226mD1b6CnADEIm4 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On 10/31/25 12:17 PM, Frederic Weisbecker wrote: > Le Tue, Oct 21, 2025 at 12:03:05AM -0400, Waiman Long a écrit : >> On 10/20/25 9:46 PM, Chen Ridong wrote: >>> On 2025/10/14 4:31, Frederic Weisbecker wrote: >>>> HK_TYPE_DOMAIN's cpumask will soon be made modifyable by cpuset. >>>> A synchronization mechanism is then needed to synchronize the updates >>>> with the housekeeping cpumask readers. >>>> >>>> Turn the housekeeping cpumasks into RCU pointers. Once a housekeeping >>>> cpumask will be modified, the update side will wait for an RCU grace >>>> period and propagate the change to interested subsystem when deemed >>>> necessary. >>>> >>>> Signed-off-by: Frederic Weisbecker >>>> --- >>>> kernel/sched/isolation.c | 58 +++++++++++++++++++++++++--------------- >>>> kernel/sched/sched.h | 1 + >>>> 2 files changed, 37 insertions(+), 22 deletions(-) >>>> >>>> diff --git a/kernel/sched/isolation.c b/kernel/sched/isolation.c >>>> index 8690fb705089..b46c20b5437f 100644 >>>> --- a/kernel/sched/isolation.c >>>> +++ b/kernel/sched/isolation.c >>>> @@ -21,7 +21,7 @@ DEFINE_STATIC_KEY_FALSE(housekeeping_overridden); >>>> EXPORT_SYMBOL_GPL(housekeeping_overridden); >>>> struct housekeeping { >>>> - cpumask_var_t cpumasks[HK_TYPE_MAX]; >>>> + struct cpumask __rcu *cpumasks[HK_TYPE_MAX]; >>>> unsigned long flags; >>>> }; >>>> @@ -33,17 +33,28 @@ bool housekeeping_enabled(enum hk_type type) >>>> } >>>> EXPORT_SYMBOL_GPL(housekeeping_enabled); >>>> +const struct cpumask *housekeeping_cpumask(enum hk_type type) >>>> +{ >>>> + if (static_branch_unlikely(&housekeeping_overridden)) { >>>> + if (housekeeping.flags & BIT(type)) { >>>> + return rcu_dereference_check(housekeeping.cpumasks[type], 1); >>>> + } >>>> + } >>>> + return cpu_possible_mask; >>>> +} >>>> +EXPORT_SYMBOL_GPL(housekeeping_cpumask); >>>> + >>>> int housekeeping_any_cpu(enum hk_type type) >>>> { >>>> int cpu; >>>> if (static_branch_unlikely(&housekeeping_overridden)) { >>>> if (housekeeping.flags & BIT(type)) { >>>> - cpu = sched_numa_find_closest(housekeeping.cpumasks[type], smp_processor_id()); >>>> + cpu = sched_numa_find_closest(housekeeping_cpumask(type), smp_processor_id()); >>>> if (cpu < nr_cpu_ids) >>>> return cpu; >>>> - cpu = cpumask_any_and_distribute(housekeeping.cpumasks[type], cpu_online_mask); >>>> + cpu = cpumask_any_and_distribute(housekeeping_cpumask(type), cpu_online_mask); >>>> if (likely(cpu < nr_cpu_ids)) >>>> return cpu; >>>> /* >>>> @@ -59,28 +70,18 @@ int housekeeping_any_cpu(enum hk_type type) >>>> } >>>> EXPORT_SYMBOL_GPL(housekeeping_any_cpu); >>>> -const struct cpumask *housekeeping_cpumask(enum hk_type type) >>>> -{ >>>> - if (static_branch_unlikely(&housekeeping_overridden)) >>>> - if (housekeeping.flags & BIT(type)) >>>> - return housekeeping.cpumasks[type]; >>>> - return cpu_possible_mask; >>>> -} >>>> -EXPORT_SYMBOL_GPL(housekeeping_cpumask); >>>> - >>>> void housekeeping_affine(struct task_struct *t, enum hk_type type) >>>> { >>>> if (static_branch_unlikely(&housekeeping_overridden)) >>>> if (housekeeping.flags & BIT(type)) >>>> - set_cpus_allowed_ptr(t, housekeeping.cpumasks[type]); >>>> + set_cpus_allowed_ptr(t, housekeeping_cpumask(type)); >>>> } >>>> EXPORT_SYMBOL_GPL(housekeeping_affine); >>>> bool housekeeping_test_cpu(int cpu, enum hk_type type) >>>> { >>>> - if (static_branch_unlikely(&housekeeping_overridden)) >>>> - if (housekeeping.flags & BIT(type)) >>>> - return cpumask_test_cpu(cpu, housekeeping.cpumasks[type]); >>>> + if (housekeeping.flags & BIT(type)) >>>> + return cpumask_test_cpu(cpu, housekeeping_cpumask(type)); >>>> return true; >>>> } >>>> EXPORT_SYMBOL_GPL(housekeeping_test_cpu); >>>> @@ -96,20 +97,33 @@ void __init housekeeping_init(void) >>>> if (housekeeping.flags & HK_FLAG_KERNEL_NOISE) >>>> sched_tick_offload_init(); >>>> - >>>> + /* >>>> + * Realloc with a proper allocator so that any cpumask update >>>> + * can indifferently free the old version with kfree(). >>>> + */ >>>> for_each_set_bit(type, &housekeeping.flags, HK_TYPE_MAX) { >>>> + struct cpumask *omask, *nmask = kmalloc(cpumask_size(), GFP_KERNEL); >>>> + >>>> + if (WARN_ON_ONCE(!nmask)) >>>> + return; >>>> + >>>> + omask = rcu_dereference(housekeeping.cpumasks[type]); >>>> + >>>> /* We need at least one CPU to handle housekeeping work */ >>>> - WARN_ON_ONCE(cpumask_empty(housekeeping.cpumasks[type])); >>>> + WARN_ON_ONCE(cpumask_empty(omask)); >>>> + cpumask_copy(nmask, omask); >>>> + RCU_INIT_POINTER(housekeeping.cpumasks[type], nmask); >>>> + memblock_free(omask, cpumask_size()); >>>> } >>>> } >>>> static void __init housekeeping_setup_type(enum hk_type type, >>>> cpumask_var_t housekeeping_staging) >>>> { >>>> + struct cpumask *mask = memblock_alloc_or_panic(cpumask_size(), SMP_CACHE_BYTES); >>>> - alloc_bootmem_cpumask_var(&housekeeping.cpumasks[type]); >>>> - cpumask_copy(housekeeping.cpumasks[type], >>>> - housekeeping_staging); >>>> + cpumask_copy(mask, housekeeping_staging); >>>> + RCU_INIT_POINTER(housekeeping.cpumasks[type], mask); >>>> } >>>> static int __init housekeeping_setup(char *str, unsigned long flags) >>>> @@ -162,7 +176,7 @@ static int __init housekeeping_setup(char *str, unsigned long flags) >>>> for_each_set_bit(type, &iter_flags, HK_TYPE_MAX) { >>>> if (!cpumask_equal(housekeeping_staging, >>>> - housekeeping.cpumasks[type])) { >>>> + housekeeping_cpumask(type))) { >>>> pr_warn("Housekeeping: nohz_full= must match isolcpus=\n"); >>>> goto free_housekeeping_staging; >>>> } >>>> diff --git a/kernel/sched/sched.h b/kernel/sched/sched.h >>>> index 1f5d07067f60..0c0ef8999fd6 100644 >>>> --- a/kernel/sched/sched.h >>>> +++ b/kernel/sched/sched.h >>>> @@ -42,6 +42,7 @@ >>>> #include >>>> #include >>>> #include >>>> +#include >>>> #include >>>> #include >>>> #include >>> A warning was detected: >>> >>> ============================= >>> WARNING: suspicious RCU usage >>> 6.17.0-next-20251009-00033-g4444da88969b #808 Not tainted >>> ----------------------------- >>> kernel/sched/isolation.c:60 suspicious rcu_dereference_check() usage! >>> >>> other info that might help us debug this: >>> >>> >>> rcu_scheduler_active = 2, debug_locks = 1 >>> 1 lock held by swapper/0/1: >>> #0: ffff888100600ce0 (&type->i_mutex_dir_key#3){++++}-{4:4}, at: walk_compone >>> >>> stack backtrace: >>> CPU: 3 UID: 0 PID: 1 Comm: swapper/0 Not tainted 6.17.0-next-20251009-00033-g4 >>> Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.16.0-0-gd239 >>> Call Trace: >>> >>> dump_stack_lvl+0x68/0xa0 >>> lockdep_rcu_suspicious+0x148/0x1b0 >>> housekeeping_cpumask+0xaa/0xb0 >>> housekeeping_test_cpu+0x25/0x40 >>> find_get_block_common+0x41/0x3e0 >>> bdev_getblk+0x28/0xa0 >>> ext4_getblk+0xba/0x2d0 >>> ext4_bread_batch+0x56/0x170 >>> __ext4_find_entry+0x17c/0x410 >>> ? lock_release+0xc6/0x290 >>> ext4_lookup+0x7a/0x1d0 >>> __lookup_slow+0xf9/0x1b0 >>> walk_component+0xe0/0x150 >>> link_path_walk+0x201/0x3e0 >>> path_openat+0xb1/0xb30 >>> ? stack_depot_save_flags+0x41e/0xa00 >>> do_filp_open+0xbc/0x170 >>> ? _raw_spin_unlock_irqrestore+0x2c/0x50 >>> ? __create_object+0x59/0x80 >>> ? trace_kmem_cache_alloc+0x1d/0xa0 >>> ? vprintk_emit+0x2b2/0x360 >>> do_open_execat+0x56/0x100 >>> alloc_bprm+0x1a/0x200 >>> ? __pfx_kernel_init+0x10/0x10 >>> kernel_execve+0x4b/0x160 >>> kernel_init+0xe5/0x1c0 >>> ret_from_fork+0x185/0x1d0 >>> ? __pfx_kernel_init+0x10/0x10 >>> ret_from_fork_asm+0x1a/0x30 >>> >>> random: crng init done >>> >> It is because bh_lru_install() of fs/buffer.c calls cpu_is_isolated() >> without holding a rcu_read_lock. Will need to add a rcu_read_lock() there. > But this is called within bh_lru_lock() which should have either disabled > IRQs or preemption off. I would expect rcu_dereference_check() to automatically > verify those implied RCU read-side critical sections. > > Let's see, lockdep_assert_in_rcu_reader() checks preemptible(), which is: > > #define preemptible() (preempt_count() == 0 && !irqs_disabled()) > > Ah but if !CONFIG_PREEMPT_COUNT: > > #define preemptible() 0 > > Chen did you have !CONFIG_PREEMPT_COUNT ? > > Probably lockdep_assert_in_rcu_reader() should be fixed accordingly and consider > preemption always disabled whenever !CONFIG_PREEMPT_COUNT. Let me check that... Yes, !CONFIG_PREEMPT_COUNT could be the problem here. I thought it was missing rcu_read_lock(), but I didn't really check the code to ensure that. Cheers, Longman