From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 1B7A0C432C0 for ; Mon, 18 Nov 2019 15:27:43 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id BF65920857 for ; Mon, 18 Nov 2019 15:27:42 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org BF65920857 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=suse.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 26D046B0003; Mon, 18 Nov 2019 10:27:42 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 21F136B0006; Mon, 18 Nov 2019 10:27:42 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 15B9C6B0007; Mon, 18 Nov 2019 10:27:42 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0225.hostedemail.com [216.40.44.225]) by kanga.kvack.org (Postfix) with ESMTP id 005CA6B0003 for ; Mon, 18 Nov 2019 10:27:41 -0500 (EST) Received: from smtpin04.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with SMTP id 738D88249980 for ; Mon, 18 Nov 2019 15:27:41 +0000 (UTC) X-FDA: 76169777922.04.shirt16_7d4559a30ef56 X-HE-Tag: shirt16_7d4559a30ef56 X-Filterd-Recvd-Size: 4351 Received: from mx1.suse.de (mx2.suse.de [195.135.220.15]) by imf26.hostedemail.com (Postfix) with ESMTP for ; Mon, 18 Nov 2019 15:27:40 +0000 (UTC) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 22DD6AE55; Mon, 18 Nov 2019 15:27:39 +0000 (UTC) Date: Mon, 18 Nov 2019 16:27:38 +0100 From: Petr Mladek To: Qian Cai Cc: Sergey Senozhatsky , Steven Rostedt , Sergey Senozhatsky , Michal Hocko , Eric Dumazet , davem@davemloft.net, netdev@vger.kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: Re: [PATCH] net/skbuff: silence warnings under memory pressure Message-ID: <20191118152738.az364dczadskgimc@pathway.suse.cz> References:<20190904061501.GB3838@dhcp22.suse.cz> <20190904064144.GA5487@jagdpanzerIV> <20190904065455.GE3838@dhcp22.suse.cz> <20190904071911.GB11968@jagdpanzerIV> <20190904074312.GA25744@jagdpanzerIV> <1567599263.5576.72.camel@lca.pw> <20190904144850.GA8296@tigerII.localdomain> <1567629737.5576.87.camel@lca.pw> <20190905113208.GA521@jagdpanzerIV> <1573751570.5937.122.camel@lca.pw> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To:<1573751570.5937.122.camel@lca.pw> User-Agent: NeoMutt/20170912 (1.9.0) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu 2019-11-14 12:12:50, Qian Cai wrote: > On Thu, 2019-09-05 at 20:32 +0900, Sergey Senozhatsky wrote: > > On (09/04/19 16:42), Qian Cai wrote: > > > > Let me think more. > > > > > > To summary, those look to me are all good long-term improvement that would > > > reduce the likelihood of this kind of livelock in general especially for other > > > unknown allocations that happen while processing softirqs, but it is still up to > > > the air if it fixes it 100% in all situations as printk() is going to take more > > > time > > > > Well. So. I guess that we don't need irq_work most of the time. > > > > We need to queue irq_work for "safe" wake_up_interruptible(), when we > > know that we can deadlock in scheduler. IOW, only when we are invoked > > from the scheduler. Scheduler has printk_deferred(), which tells printk() > > that it cannot do wake_up_interruptible(). Otherwise we can just use > > normal wake_up_process() and don't need that irq_work->wake_up_interruptible() > > indirection. The parts of the scheduler, which by mistake call plain printk() > > from under pi_lock or rq_lock have chances to deadlock anyway and should > > be switched to printk_deferred(). > > > > I think we can queue significantly much less irq_work-s from printk(). > > > > Petr, Steven, what do you think? > > Sergey, do you still plan to get this patch merged? > > > > > Something like this. Call wake_up_interruptible(), switch to > > wake_up_klogd() only when called from sched code. > > > > --- > > diff --git a/kernel/printk/printk.c b/kernel/printk/printk.c > > index cd51aa7d08a9..89cb47882254 100644 > > --- a/kernel/printk/printk.c > > +++ b/kernel/printk/printk.c > > @@ -2027,8 +2027,11 @@ asmlinkage int vprintk_emit(int facility, int level, > > pending_output = (curr_log_seq != log_next_seq); > > logbuf_unlock_irqrestore(flags); > > > > + if (!pending_output) > > + return printed_len; > > + > > /* If called from the scheduler, we can not call up(). */ > > - if (!in_sched && pending_output) { > > + if (!in_sched) { > > /* > > * Disable preemption to avoid being preempted while holding > > * console_sem which would prevent anyone from printing to > > @@ -2043,10 +2046,11 @@ asmlinkage int vprintk_emit(int facility, int level, > > if (console_trylock_spinning()) > > console_unlock(); > > preempt_enable(); > > - } > > > > - if (pending_output) > > + wake_up_interruptible(&log_wait); I do not like this. As a result, normal printk() will always deadlock in the scheduler code, including WARN() calls. The chance of the deadlock is small now. It happens only when there is another process waiting for console_sem. We want to remove locks from printk() and not add them. Best Regards, Petr