From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.8 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6AD9BC433DB for ; Thu, 4 Mar 2021 10:08:29 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id EFE2864F2B for ; Thu, 4 Mar 2021 10:08:28 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EFE2864F2B Authentication-Results: mail.kernel.org; dmarc=fail (p=quarantine dis=none) header.from=amazon.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id 7E9E66B000C; Thu, 4 Mar 2021 05:08:28 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 7BFF06B000D; Thu, 4 Mar 2021 05:08:28 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 6886E6B000E; Thu, 4 Mar 2021 05:08:28 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0091.hostedemail.com [216.40.44.91]) by kanga.kvack.org (Postfix) with ESMTP id 502B86B000C for ; Thu, 4 Mar 2021 05:08:28 -0500 (EST) Received: from smtpin04.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 18C8F87F3 for ; Thu, 4 Mar 2021 10:08:28 +0000 (UTC) X-FDA: 77881767096.04.24F0D26 Received: from smtp-fw-2101.amazon.com (smtp-fw-2101.amazon.com [72.21.196.25]) by imf07.hostedemail.com (Postfix) with ESMTP id 4AAEAA0009D3 for ; Thu, 4 Mar 2021 10:08:27 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amazon.com; i=@amazon.com; q=dns/txt; s=amazon201209; t=1614852508; x=1646388508; h=from:to:cc:subject:date:message-id:in-reply-to: mime-version; bh=zjvvgWC6kbPk4Ox8xKpCrUziEcj1fMQtGf+j9LYto/E=; b=JFb9LIg8/lIY41Dvh2qT9fxWbtGIopfNVmL9HgiUvlB9WLhnNHfCaWFR QlcZTwrj4jXsyNVNHXy3FBf+Gzo+mrhFPqCAPr1y3hdS8SbWewcrktaRU wk2+x4gaAwv1a77GOdE1VJ+v+2h13bqDnDRC2LukVZnfqtGqE7VUjvbl+ E=; X-IronPort-AV: E=Sophos;i="5.81,222,1610409600"; d="scan'208";a="91330729" Received: from iad12-co-svc-p1-lb1-vlan3.amazon.com (HELO email-inbound-relay-1e-42f764a0.us-east-1.amazon.com) ([10.43.8.6]) by smtp-border-fw-out-2101.iad2.amazon.com with ESMTP; 04 Mar 2021 10:08:21 +0000 Received: from EX13D31EUA001.ant.amazon.com (iad12-ws-svc-p26-lb9-vlan2.iad.amazon.com [10.40.163.34]) by email-inbound-relay-1e-42f764a0.us-east-1.amazon.com (Postfix) with ESMTPS id 1A29CC0680; Thu, 4 Mar 2021 10:08:07 +0000 (UTC) Received: from u3f2cd687b01c55.ant.amazon.com (10.43.161.39) by EX13D31EUA001.ant.amazon.com (10.43.165.15) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 4 Mar 2021 10:07:51 +0000 From: SeongJae Park To: SeongJae Park CC: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , Subject: Re: [PATCH v24 00/14] Subject: Introduce Data Access MONitor (DAMON) Date: Thu, 4 Mar 2021 11:07:32 +0100 Message-ID: <20210304100732.7844-1-sjpark@amazon.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20210204153150.15948-1-sjpark@amazon.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [10.43.161.39] X-ClientProxiedBy: EX13D29UWC001.ant.amazon.com (10.43.162.143) To EX13D31EUA001.ant.amazon.com (10.43.165.15) X-Stat-Signature: 1y377pb5dbzcyfkhpppn5n6mqbrcuu39 X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 4AAEAA0009D3 Received-SPF: none (amazon.com>: No applicable sender policy available) receiver=imf07; identity=mailfrom; envelope-from=""; helo=smtp-fw-2101.amazon.com; client-ip=72.21.196.25 X-HE-DKIM-Result: pass/pass X-HE-Tag: 1614852507-972538 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, 4 Feb 2021 16:31:36 +0100 SeongJae Park wrote: > From: SeongJae Park [...] > > Introduction > ============ > > DAMON is a data access monitoring framework for the Linux kernel. The core > mechanisms of DAMON called 'region based sampling' and 'adaptive regions > adjustment' (refer to 'mechanisms.rst' in the 11th patch of this patchset for > the detail) make it > > - accurate (The monitored information is useful for DRAM level memory > management. It might not appropriate for Cache-level accuracy, though.), > - light-weight (The monitoring overhead is low enough to be applied online > while making no impact on the performance of the target workloads.), and > - scalable (the upper-bound of the instrumentation overhead is controllable > regardless of the size of target workloads.). > > Using this framework, therefore, several memory management mechanisms such as > reclamation and THP can be optimized to aware real data access patterns. > Experimental access pattern aware memory management optimization works that > incurring high instrumentation overhead will be able to have another try. > > Though DAMON is for kernel subsystems, it can be easily exposed to the user > space by writing a DAMON-wrapper kernel subsystem. Then, user space users who > have some special workloads will be able to write personalized tools or > applications for deeper understanding and specialized optimizations of their > systems. > [...] > > Baseline and Complete Git Trees > =============================== > > The patches are based on the v5.10. You can also clone the complete git > tree: > > $ git clone git://github.com/sjp38/linux -b damon/patches/v24 > > The web is also available: > https://github.com/sjp38/linux/releases/tag/damon/patches/v24 > > There are a couple of trees for entire DAMON patchset series. It includes > future features. The first one[1] contains the changes for latest release, > while the other one[2] contains the changes for next release. > > [1] https://github.com/sjp38/linux/tree/damon/master > [2] https://github.com/sjp38/linux/tree/damon/next For people who prefer LTS kernels, I decided to maintain two more trees that repectively based on latest two LTS kernels and contains backports of the latest 'damon/master' tree, as below. Please use those if you want to test DAMON but using LTS. - For v5.4.y: https://github.com/sjp38/linux/tree/damon/for-v5.4.y - For v5.10.y: https://github.com/sjp38/linux/tree/damon/for-v5.10.y Thanks, SeongJae Park