From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id E47FBC77B7A for ; Tue, 13 Jun 2023 06:49:00 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 4A3776B0074; Tue, 13 Jun 2023 02:49:00 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 453226B0075; Tue, 13 Jun 2023 02:49:00 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 2F4268E0002; Tue, 13 Jun 2023 02:49:00 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id 1F5CF6B0074 for ; Tue, 13 Jun 2023 02:49:00 -0400 (EDT) Received: from smtpin23.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay10.hostedemail.com (Postfix) with ESMTP id E872DC03DE for ; Tue, 13 Jun 2023 06:48:59 +0000 (UTC) X-FDA: 80896797198.23.1BF4903 Received: from mx0b-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by imf01.hostedemail.com (Postfix) with ESMTP id 7130440016 for ; Tue, 13 Jun 2023 06:48:57 +0000 (UTC) Authentication-Results: imf01.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=nto1vGxC; spf=pass (imf01.hostedemail.com: domain of piyushs@linux.ibm.com designates 148.163.158.5 as permitted sender) smtp.mailfrom=piyushs@linux.ibm.com; dmarc=pass (policy=none) header.from=ibm.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1686638937; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=gmG6z0AdC2J3asvww+4weYo/FbTqpbQY75lclW4dW5U=; b=0nNM/BVIg94EMmwnbpX2N15X41r1OVDfkEy7AAu0HK918UTdBfhkBl/J2OmOYWunRU5jH8 q1bEqmI8rdhq87QUVL83hhbpAH2dQJ8VCWvcFnrRdENCoWF3Un1hWFEum2qVDf05ChwpuJ Qyn4xfZJQTPnRC8Wn8hDFGk7crvX4og= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1686638937; a=rsa-sha256; cv=none; b=hgMj0TexaLqNHoEOS1kJapFF6yoj8aMhX0fLSHDxN/gTVP3HpD85uW2W62TLNRzS5mgQxW Dh01Q2AYYmfAOdDoZ8L/wphmI51BYBGs1St4zB7ErfkMMvlmuj+9zqOdq4aypqtfgrpm3X 3OpEItOFGrPKRY6p5g6NQEJjm3V33Cg= ARC-Authentication-Results: i=1; imf01.hostedemail.com; dkim=pass header.d=ibm.com header.s=pp1 header.b=nto1vGxC; spf=pass (imf01.hostedemail.com: domain of piyushs@linux.ibm.com designates 148.163.158.5 as permitted sender) smtp.mailfrom=piyushs@linux.ibm.com; dmarc=pass (policy=none) header.from=ibm.com Received: from pps.filterd (m0353722.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 35D6kFRI027368; Tue, 13 Jun 2023 06:48:55 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=message-id : date : to : cc : from : subject : content-type : content-transfer-encoding : mime-version; s=pp1; bh=gmG6z0AdC2J3asvww+4weYo/FbTqpbQY75lclW4dW5U=; b=nto1vGxCV/1509gKv0IuwXiaH9KoEIn/AuC1/ucd2yi/t493U6dMjPQ9FD94jO9NcXFy AMFdKrDCCunnwaE6Y45TqOj+/fvNOA50YXOwDmZ1ko3xKVzxDA9RPWC73OfGS2W7l8R1 4vlpaP2UhMr/9jXO+1rwSxMWRNVq47i6tQD9f8Ad012w/cgA0qQfkUWD4ky0lDxxarjA JkrwvS/nvWqFgGfydXPfqboDrJx73lUrrtvydLsJjQL0qkzy6pA0svy78ueOcLmWny7R DSXSK99XFbgNAPrvYgXUohWdWsM8KBpOQbe2Djd9b5K69pNC2cFBCDfYEuOpQt3ibRQw 6Q== Received: from ppma04ams.nl.ibm.com (63.31.33a9.ip4.static.sl-reverse.com [169.51.49.99]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3r6k0rgk9e-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 13 Jun 2023 06:48:54 +0000 Received: from pps.filterd (ppma04ams.nl.ibm.com [127.0.0.1]) by ppma04ams.nl.ibm.com (8.17.1.19/8.17.1.19) with ESMTP id 35D4rEvu017859; Tue, 13 Jun 2023 06:48:52 GMT Received: from smtprelay03.fra02v.mail.ibm.com ([9.218.2.224]) by ppma04ams.nl.ibm.com (PPS) with ESMTPS id 3r4gt51y2t-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 13 Jun 2023 06:48:52 +0000 Received: from smtpav06.fra02v.mail.ibm.com (smtpav06.fra02v.mail.ibm.com [10.20.54.105]) by smtprelay03.fra02v.mail.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 35D6mocb18285256 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 13 Jun 2023 06:48:50 GMT Received: from smtpav06.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 6BB5620049; Tue, 13 Jun 2023 06:48:50 +0000 (GMT) Received: from smtpav06.fra02v.mail.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 643B920040; Tue, 13 Jun 2023 06:48:49 +0000 (GMT) Received: from [9.109.218.210] (unknown [9.109.218.210]) by smtpav06.fra02v.mail.ibm.com (Postfix) with ESMTP; Tue, 13 Jun 2023 06:48:49 +0000 (GMT) Message-ID: Date: Tue, 13 Jun 2023 12:18:48 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Content-Language: en-US To: sjpark@amazon.de, damon@lists.linux.dev Cc: linux-mm@kvack.org, aneesh.kumar@linux.ibm.com From: Piyush Sachdeva Subject: DAMON testing and benchmarking Content-Type: text/plain; charset=UTF-8; format=flowed X-TM-AS-GCONF: 00 X-Proofpoint-GUID: PhxerfucwcE4aUzYIjSfEZV4N9KaVk59 X-Proofpoint-ORIG-GUID: PhxerfucwcE4aUzYIjSfEZV4N9KaVk59 Content-Transfer-Encoding: 7bit X-Proofpoint-UnRewURL: 0 URL was un-rewritten MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.957,Hydra:6.0.573,FMLib:17.11.176.26 definitions=2023-06-13_04,2023-06-12_02,2023-05-22_02 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 suspectscore=0 phishscore=0 bulkscore=0 clxscore=1011 adultscore=0 malwarescore=0 mlxscore=0 spamscore=0 mlxlogscore=773 impostorscore=0 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2305260000 definitions=main-2306130058 X-Rspamd-Queue-Id: 7130440016 X-Rspam-User: X-Stat-Signature: mdmf5mz4t3sggcf8j8kjxwoyzbqungmm X-Rspamd-Server: rspam03 X-HE-Tag: 1686638937-162970 X-HE-Meta: U2FsdGVkX19V5p0paxStwLCIARt/qE9oHbSxkCZI/+AoM6JTV3D9nmZ9d359OE+rO6XRKicNWB5Y5MEvVRdnKzwAvor2sPcYSSGLRWRPhttn0RZHUWuZ9JFe2Z5MWPGkTuz9kNYfLxpn7sOBnCEZpCrE2jPJtnD56/UOPF2NENkwFWRO+EA2knciGYPM0IaTwpDd5maT80UIKDYNRNHwjejvAkFd7e/VDCE4ItV//RXuonnI+63k0B/DmkHl791dUQJDlEgFz7elSqSk9WV0XYy0mmSf0tg+4rQQIsj2V6c9fODlOInVi8Mcw0H7jGKyVPuW0ufj+mxAfTnpRdnNFruk0lV+gheXbU+sASeV5HmDfNiS43W817Z+VFJQCuW4Rb1d/sKI0Ug2S0PxwLX74/bS7EsUdLdcDrEruU89zK0qgmJ2OvFDkFfbrUZKw/hwZk2ZXPzTcMQcNtQTlaWLChjWvGtEwxg8GEasEKWCnhbnQKlttH0UULeDys7C5d4DhTwXdhLKPKLc5CytVkEaqAGtlwVSVkoh8yu5Rm9JgZGldWH/9FbdFHth7lFZAvCr5gTDqgbduSonk+5UahTwi8l8iQPMewbXnniBUDTv3aCas9ecOYj+GaKkKppDaoG4ViI0JorHZrCaQX+HYe1vwAcE70uAQC06XoB9aMdnaRJg2P3zoeKynsMNo5drTh4nwth03bXpmAtJZQqCwnURgo9xMM6UdRSl4OGdJJPIBFJCAoSAtY1yklMS+ldA/5WqxoxDyAsGaudELN2IkdFpRb4EDzMT0T8VAj1LzKyUnXb4xFEWTO6XYKxNmPuXh1nHO5N8M7U2uihGOYgArg+1RgBrMXFUHj9eGfpaTUXxan8kPVmKduDzwk1gZc4pc5wCDqlzcMnL7mnzDO2vA9vhGCAYMg6ede91517MP8LNai8WrVXr5d9Fp7BvMljhTlJNlaRmFEWS1l7TK6TaP9J BXs6ssOZ IczJ24h5vP5vmKF9IfDeU4yCoZNh24PlxFaOUfHvJc77r1k+toDEzq0xlaWuZWUSK902ddVmXBzArFUPHSvccwp/LghPk8AyQXysuKHMqILjp3DbJF8VR3OFLZvSdgEbrvlaZMyik4o/njt+rnA8m1eGudXKzykHaPiGi9JekVvBbdYEgq2YyLyfgkw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Dear Mr. SeongJae Park, I hope this email finds you well. For the last few months, I have been looking at DAMON from an end-users perspective and a developer's PoV. Most recently, I was focusing on `lru_sort.c` module that uses the `lru_prio` and `lru_deprio` operations which result in a more precise reclaim. In my understanding, enabling the "lru_sort.c" module would make intelligent decisions based on the access frequency of the pages and end up preventing hot page swaps. Hence, when integrated with an LRU algorithm, it should improve it. If you could share any test/benchmark that you might have run to verify the above assumption? I did find the result numbers you posted (link below), but that doesn't mention the "plrus-*" scheme numbers. It also doesn't have numbers for running the `pageout` operation on the entire physical address space (paddr) i.e. the `pprcl` scheme. So, if you can link those too, it would be amazing. Can you also share any real-world (memory-management specific) workload results that you would have used with DAMON in your experiments? Like either MongoDB or memcached over Parsec3.0 (including splash2x) - which, in my understanding, is less memory intensive and more architecture inclined. I also had a question regarding schemes - A scheme is highly tweakable, and it's what the efficiency of DAMON rests upon. The more precise the scheme, the more efficient DAMON will be. Hence, I'd be thankful if you can help me derive a config that would provide the best results. Hope to hear from you soon. Test results: https://damonitor.github.io/test/result/perf/latest/html/ -- Regards, Piyush Sachdeva