From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pl0-f72.google.com (mail-pl0-f72.google.com [209.85.160.72]) by kanga.kvack.org (Postfix) with ESMTP id F08896B0003 for ; Mon, 16 Jul 2018 05:09:08 -0400 (EDT) Received: by mail-pl0-f72.google.com with SMTP id d22-v6so6682893pls.4 for ; Mon, 16 Jul 2018 02:09:08 -0700 (PDT) Received: from mx1.suse.de (mx2.suse.de. [195.135.220.15]) by mx.google.com with ESMTPS id w5-v6si151467ply.343.2018.07.16.02.09.07 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 16 Jul 2018 02:09:07 -0700 (PDT) Date: Mon, 16 Jul 2018 11:09:01 +0200 From: Michal Hocko Subject: Re: [PATCH v6 0/7] fs/dcache: Track & limit # of negative dentries Message-ID: <20180716090901.GG17280@dhcp22.suse.cz> References: <1531330947.3260.13.camel@HansenPartnership.com> <18c5cbfe-403b-bb2b-1d11-19d324ec6234@redhat.com> <1531336913.3260.18.camel@HansenPartnership.com> <4d49a270-23c9-529f-f544-65508b6b53cc@redhat.com> <1531411494.18255.6.camel@HansenPartnership.com> <20180712164932.GA3475@bombadil.infradead.org> <1531416080.18255.8.camel@HansenPartnership.com> <1531425435.18255.17.camel@HansenPartnership.com> <20180713003614.GW2234@dastard> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180713003614.GW2234@dastard> Sender: owner-linux-mm@kvack.org List-ID: To: Dave Chinner Cc: James Bottomley , Linus Torvalds , Matthew Wilcox , Waiman Long , Al Viro , Jonathan Corbet , "Luis R. Rodriguez" , Kees Cook , Linux Kernel Mailing List , linux-fsdevel , linux-mm , "open list:DOCUMENTATION" , Jan Kara , Paul McKenney , Andrew Morton , Ingo Molnar , Miklos Szeredi , Larry Woodman , "Wangkai (Kevin,C)" On Fri 13-07-18 10:36:14, Dave Chinner wrote: [...] > By limiting the number of negative dentries in this case, internal > slab fragmentation is reduced such that reclaim cost never gets out > of control. While it appears to "fix" the symptoms, it doesn't > address the underlying problem. It is a partial solution at best but > at worst it's another opaque knob that nobody knows how or when to > tune. Would it help to put all the negative dentries into its own slab cache? > Very few microbenchmarks expose this internal slab fragmentation > problem because they either don't run long enough, don't create > memory pressure, or don't have access patterns that mix long and > short term slab objects together in a way that causes slab > fragmentation. Run some cold cache directory traversals (git > status?) at the same time you are creating negative dentries so you > create pinned partial pages in the slab cache and see how the > behaviour changes.... Agreed! Slab fragmentation is a real problem we are seeing for quite some time. We should try to address it rather than paper over it with weird knobs. -- Michal Hocko SUSE Labs