From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.9 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SIGNED_OFF_BY, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id F066EC433DF for ; Tue, 9 Jun 2020 18:37:46 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id A467120691 for ; Tue, 9 Jun 2020 18:37:46 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=nitingupta.dev header.i=@nitingupta.dev header.b="VIHY8xLi" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org A467120691 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=nitingupta.dev Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 0D9516B0003; Tue, 9 Jun 2020 14:37:46 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 089726B0005; Tue, 9 Jun 2020 14:37:46 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E93956B0006; Tue, 9 Jun 2020 14:37:45 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0176.hostedemail.com [216.40.44.176]) by kanga.kvack.org (Postfix) with ESMTP id CCE186B0003 for ; Tue, 9 Jun 2020 14:37:45 -0400 (EDT) Received: from smtpin12.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay05.hostedemail.com (Postfix) with ESMTP id 83B02181ABEA0 for ; Tue, 9 Jun 2020 18:37:45 +0000 (UTC) X-FDA: 76910532090.12.cable33_63061fb26dc4 Received: from filter.hostedemail.com (10.5.16.251.rfc1918.com [10.5.16.251]) by smtpin12.hostedemail.com (Postfix) with ESMTP id CBB8218131691 for ; Tue, 9 Jun 2020 18:37:44 +0000 (UTC) X-HE-Tag: cable33_63061fb26dc4 X-Filterd-Recvd-Size: 3964 Received: from mail-lf1-f66.google.com (mail-lf1-f66.google.com [209.85.167.66]) by imf42.hostedemail.com (Postfix) with ESMTP for ; Tue, 9 Jun 2020 18:37:44 +0000 (UTC) Received: by mail-lf1-f66.google.com with SMTP id h188so13098689lfd.7 for ; Tue, 09 Jun 2020 11:37:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nitingupta.dev; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=BwHRiAPDtrkwECsv6SA7fU7H4zLVJKTcGFNk2QXOnhU=; b=VIHY8xLiHmbfAk+929GtvjqxvUF90uuWGK5L3c+gPpqDFRUpDiapReEG17Y3LutSww 3V4dWOmewogkwd+Eh2mmUpKoH16NlRQle+kI7Ko4/1uBuemv435R5GU4c4mZfT3By+vr SVqe2G5aySIYKw5hxgQiZjXAPzP+T8vokiag6aXGMR6sDZe5pPUDOq6HgWNca8MC52A7 s5P1ye0S5PDBu7AxhHFPbfcEVraz8m2ymqGLFoxZrFnyou69s91LmCHH95LIuM1OqCgh uMYv3citOqdRrf9huGay2dU3OYM+dmat6IejYUUbBgED5NkrInRwRjh2cXUyRAkBVYvk BSSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=BwHRiAPDtrkwECsv6SA7fU7H4zLVJKTcGFNk2QXOnhU=; b=Z+ufV5FeX0cAIREr5bAlpC2RSikaIAwJHlUpgaO2N8y+cDUvigAjTSu1Upvja4maKA Ng1jAtePGW7cY9xQxoXWKdtqG3C3IvDuFFjwziSS9qqFf/5axOrIEl+Ch/0QHL1kZGQy 7qnqWhvVsBpwg1lPNS61HxUJOsaJBl87SHJSipnW3LFJ3ivd+ajOmjnaWhNxjypN2PlC F+Fm9lPZbiInBlGuwZeno0n0CtkMCW6H4yujJUV+S3Zva0bMWviQ1yQyQ45ne8DI0va2 sv9OoXFxXL693XtROtW5CISMyhQdtjNECmm8U/FOLdVhng7TpNIjrvItgVoXNPdQiFJv qrUg== X-Gm-Message-State: AOAM532iyDAcrrYTkhaOqYk7GyQRg59Gg/UtMmkcgZ14g5V8K1rKdYSt sxpPYR65xGBp4UUrCH2YfxEh5kSAizB/DWLM27sMAw== X-Google-Smtp-Source: ABdhPJxuVElaiZy/wi7zPSnZaETNDw3REFYZMvBDEZDwQF9KjdWC3LmrzfRnNv5y4/4dmn7H2To75+SN/JnbU9vOoOw= X-Received: by 2002:a19:ae0f:: with SMTP id f15mr16495368lfc.142.1591727862693; Tue, 09 Jun 2020 11:37:42 -0700 (PDT) MIME-Version: 1.0 References: <20200601194822.30252-1-nigupta@nvidia.com> In-Reply-To: <20200601194822.30252-1-nigupta@nvidia.com> From: Nitin Gupta Date: Tue, 9 Jun 2020 11:37:31 -0700 Message-ID: Subject: Re: [PATCH v6] mm: Proactive compaction To: Vlastimil Babka , Andrew Morton Cc: Mel Gorman , Michal Hocko , Nitin Gupta , Matthew Wilcox , Mike Kravetz , Joonsoo Kim , David Rientjes , linux-kernel , linux-mm , Linux API , Khalid Aziz Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: CBB8218131691 X-Spamd-Result: default: False [0.00 / 100.00] X-Rspamd-Server: rspam05 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Mon, Jun 1, 2020 at 12:48 PM Nitin Gupta wrote: > > For some applications, we need to allocate almost all memory as > hugepages. However, on a running system, higher-order allocations can > fail if the memory is fragmented. Linux kernel currently does on-demand > compaction as we request more hugepages, but this style of compaction > incurs very high latency. Experiments with one-time full memory > compaction (followed by hugepage allocations) show that kernel is able > to restore a highly fragmented memory state to a fairly compacted memory > state within <1 sec for a 32G system. Such data suggests that a more > proactive compaction can help us allocate a large fraction of memory as > hugepages keeping allocation latencies low. > > Signed-off-by: Nitin Gupta > Reviewed-by: Vlastimil Babka (+CC Khalid) Can this be pipelined for upstream inclusion now? Sorry, I'm a bit rusty on upstream flow these days. Thanks, Nitin