From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E8A71C41514 for ; Wed, 4 Sep 2019 15:38:03 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id B677922CEA for ; Wed, 4 Sep 2019 15:38:03 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org B677922CEA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 402D56B0003; Wed, 4 Sep 2019 11:38:03 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 3B5816B0006; Wed, 4 Sep 2019 11:38:03 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2CA456B0007; Wed, 4 Sep 2019 11:38:03 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0213.hostedemail.com [216.40.44.213]) by kanga.kvack.org (Postfix) with ESMTP id 04CD56B0003 for ; Wed, 4 Sep 2019 11:38:02 -0400 (EDT) Received: from smtpin11.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with SMTP id 7F3EB181AC9B6 for ; Wed, 4 Sep 2019 15:38:02 +0000 (UTC) X-FDA: 75897644004.11.shape58_4626a955be44d X-HE-Tag: shape58_4626a955be44d X-Filterd-Recvd-Size: 3306 Received: from mx1.suse.de (mx2.suse.de [195.135.220.15]) by imf09.hostedemail.com (Postfix) with ESMTP for ; Wed, 4 Sep 2019 15:38:01 +0000 (UTC) X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 50AEAB01E; Wed, 4 Sep 2019 15:38:00 +0000 (UTC) Date: Wed, 4 Sep 2019 17:37:59 +0200 From: Michal Hocko To: Joel Fernandes Cc: linux-kernel@vger.kernel.org, Tim Murray , carmenjackson@google.com, mayankgupta@google.com, dancol@google.com, rostedt@goodmis.org, minchan@kernel.org, akpm@linux-foundation.org, kernel-team@android.com, "Aneesh Kumar K.V" , Dan Williams , Jerome Glisse , linux-mm@kvack.org, Matthew Wilcox , Ralph Campbell , Vlastimil Babka Subject: Re: [PATCH v2] mm: emit tracepoint when RSS changes by threshold Message-ID: <20190904153759.GC3838@dhcp22.suse.cz> References: <20190903200905.198642-1-joel@joelfernandes.org> <20190904084508.GL3838@dhcp22.suse.cz> <20190904153258.GH240514@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190904153258.GH240514@google.com> User-Agent: Mutt/1.10.1 (2018-07-13) X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Wed 04-09-19 11:32:58, Joel Fernandes wrote: > On Wed, Sep 04, 2019 at 10:45:08AM +0200, Michal Hocko wrote: > > On Tue 03-09-19 16:09:05, Joel Fernandes (Google) wrote: > > > Useful to track how RSS is changing per TGID to detect spikes in RSS and > > > memory hogs. Several Android teams have been using this patch in various > > > kernel trees for half a year now. Many reported to me it is really > > > useful so I'm posting it upstream. > > > > > > Initial patch developed by Tim Murray. Changes I made from original patch: > > > o Prevent any additional space consumed by mm_struct. > > > o Keep overhead low by checking if tracing is enabled. > > > o Add some noise reduction and lower overhead by emitting only on > > > threshold changes. > > > > Does this have any pre-requisite? I do not see trace_rss_stat_enabled in > > the Linus tree (nor in linux-next). > > No, this is generated automatically by the tracepoint infrastructure when a > tracepoint is added. OK, I was not aware of that. > > Besides that why do we need batching in the first place. Does this have a > > measurable overhead? How does it differ from any other tracepoints that we > > have in other hotpaths (e.g. page allocator doesn't do any checks). > > We do need batching not only for overhead reduction, What is the overhead? > but also for reducing > tracing noise. Flooding the traces makes it less useful for long traces and > post-processing of traces. IOW, the overhead reduction is a bonus. This is not really anything special for this tracepoint though. Basically any tracepoint in a hot path is in the same situation and I do not see a point why each of them should really invent its own way to throttle. Maybe there is some way to do that in the tracing subsystem directly. -- Michal Hocko SUSE Labs