From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ed1-f70.google.com (mail-ed1-f70.google.com [209.85.208.70]) by kanga.kvack.org (Postfix) with ESMTP id EC1E96B0010 for ; Fri, 3 Aug 2018 03:07:23 -0400 (EDT) Received: by mail-ed1-f70.google.com with SMTP id z5-v6so1502939edr.19 for ; Fri, 03 Aug 2018 00:07:23 -0700 (PDT) Received: from mx1.suse.de (mx2.suse.de. [195.135.220.15]) by mx.google.com with ESMTPS id f4-v6si2572331edn.256.2018.08.03.00.07.22 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 03 Aug 2018 00:07:22 -0700 (PDT) Date: Fri, 3 Aug 2018 09:07:20 +0200 From: Michal Hocko Subject: Re: [PATCH v1] mm:memcg: skip memcg of current in mem_cgroup_soft_limit_reclaim Message-ID: <20180803070720.GG27245@dhcp22.suse.cz> References: <1533275285-12387-1-git-send-email-zhaoyang.huang@spreadtrum.com> <20180803061817.GC27245@dhcp22.suse.cz> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Sender: owner-linux-mm@kvack.org List-ID: To: Zhaoyang Huang Cc: Steven Rostedt , Ingo Molnar , Johannes Weiner , Vladimir Davydov , "open list:MEMORY MANAGEMENT" , cgroups@vger.kernel.org, LKML , kernel-patch-test@lists.linaro.org On Fri 03-08-18 14:59:34, Zhaoyang Huang wrote: > On Fri, Aug 3, 2018 at 2:18 PM Michal Hocko wrote: > > > > On Fri 03-08-18 14:11:26, Zhaoyang Huang wrote: > > > On Fri, Aug 3, 2018 at 1:48 PM Zhaoyang Huang wrote: > > > > > > > > for the soft_limit reclaim has more directivity than global reclaim, we40960 > > > > have current memcg be skipped to avoid potential page thrashing. > > > > > > > The patch is tested in our android system with 2GB ram. The case > > > mainly focus on the smooth slide of pictures on a gallery, which used > > > to stall on the direct reclaim for over several hundred > > > millionseconds. By further debugging, we find that the direct reclaim > > > spend most of time to reclaim pages on its own with softlimit set to > > > 40960KB. I add a ftrace event to verify that the patch can help > > > escaping such scenario. Furthermore, we also measured the major fault > > > of this process(by dumpsys of android). The result is the patch can > > > help to reduce 20% of the major fault during the test. > > > > I have asked already asked. Why do you use the soft limit in the first > > place? It is known to cause excessive reclaim and long stalls. > > It is required by Google for applying new version of android system. > There was such a mechanism called LMK in previous ANDROID version, > which will kill process when in memory contention like OOM does. I > think Google want to drop such rough way for reclaiming pages and turn > to memcg. They setup different memcg groups for different process of > the system and set their softlimit according to the oom_adj. Their > original purpose is to reclaim pages gentlely in direct reclaim and > kswapd. During the debugging process , it seems to me that memcg maybe > tunable somehow. At least , the patch works on our system. Then the suggestion is to use v2 and the high limit. This is much less disruptive method for pro-active reclaim. Really softlimit semantic is established for many years and you cannot change it even when it sucks for your workload. Others might depend on the traditional behavior. I have tried to change the semantic in the past and there was a general consensus that changing the semantic is just too risky. So it is nice that it helps for your particular workload but this is not an upstream material, I am sorry. -- Michal Hocko SUSE Labs