From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.0 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,MSGID_FROM_MTA_HEADER, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 12B30C432BE for ; Wed, 1 Sep 2021 03:07:56 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 717E460F9E for ; Wed, 1 Sep 2021 03:07:55 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 717E460F9E Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=amperemail.onmicrosoft.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvack.org Received: by kanga.kvack.org (Postfix) id C9C618D0001; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C4C5D6B0071; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AC53C8D0001; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0194.hostedemail.com [216.40.44.194]) by kanga.kvack.org (Postfix) with ESMTP id 9C7D76B006C for ; Tue, 31 Aug 2021 23:07:54 -0400 (EDT) Received: from smtpin12.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay04.hostedemail.com (Postfix) with ESMTP id 4418D274DC for ; Wed, 1 Sep 2021 03:07:54 +0000 (UTC) X-FDA: 78537520068.12.73CAE4E Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on2124.outbound.protection.outlook.com [40.107.236.124]) by imf29.hostedemail.com (Postfix) with ESMTP id CE3299000247 for ; Wed, 1 Sep 2021 03:07:53 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=g+U6tvFpQelvSMNirbNnVFH90G5FCR/+dpGcx3izauWn+pDrLxCK5Ej8Dg++gXQQ5S4c/dDAEMxcko4hgYJip5Qhc0APf95SMmu+TLQaOmgFM2hqosKzgK/GyMu0++lnVVbYRuO5G0Pl2ju6m1OMFKUusuOZn3cS4PWZ0fg8tH7hWQX03I2JSAeUjOBYlenXxokxwVLVa8ifestJzLLPOMasG8RlHD3pMR2IH5Y2CzGRoM/Rhu+ArP3OCc+Q6KaZKo6KFmr0vhJP44+nQf+XrDhJTealO6ky3Y79sn5raWfc3qQoc+VE9Q1flWjtB1RT2ODlQYDSyklAj7VfgJbI8Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hiqgA1CtM/LYpBxz9qQVmXtP2iYf/EUzzURNb9iYblA=; b=LUjyX4PZJfsElwc690RY+zgezevcgMyTrxAh/jDMfIO97HgAPDZreD1TF+dLdOhIu6S+LvXtW6bZRBxVA64w1l2O0MQxqj7jCUFI6YyjeywwJ+RdmzrOibEL1xMVt0EVT26Sa47Ug5J5DqOF79xnTsPOOWNbByLSZI0NSCH9DZIdgAhHOd9i8CqLRvPjRdfEwlDC9j+Npw9sWo9R3SEZov2bnzxwUvbEqEv30myYoLR/BXrlUezlS+ABy6UHnQ72e3HpW0UiDsJZiF1CCZCe/VLUlg1K3h7CvoG48TQEOhmS4bqmSMPepqvWY+KecKHgVK6DLCVCTJhfhXy5hcvUuw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=os.amperecomputing.com; dmarc=pass action=none header.from=amperemail.onmicrosoft.com; dkim=pass header.d=amperemail.onmicrosoft.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amperemail.onmicrosoft.com; s=selector1-amperemail-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hiqgA1CtM/LYpBxz9qQVmXtP2iYf/EUzzURNb9iYblA=; b=TCkEmqebF4HYDLcImGtk7Yf71L6wW4/Auhdp2wkIjSx8Cdx55DtG3naEDrpmd4zdIVaN16wMeaEHW7o80h9F0RF/a+nMltuj6HTo7KhJL7jls9oa3+YA9r9cw+B979r8y3slImxuLjJfiL2KJZ8dApWgH/q98Dz8q8aG4U3FsgY= Received: from MWHPR0101MB3165.prod.exchangelabs.com (2603:10b6:301:2f::19) by MW4PR01MB6132.prod.exchangelabs.com (2603:10b6:303:7f::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4457.23; Wed, 1 Sep 2021 03:07:50 +0000 Received: from MWHPR0101MB3165.prod.exchangelabs.com ([fe80::ed89:1b21:10f4:ed56]) by MWHPR0101MB3165.prod.exchangelabs.com ([fe80::ed89:1b21:10f4:ed56%3]) with mapi id 15.20.4457.025; Wed, 1 Sep 2021 03:07:50 +0000 From: Shijie Huang Subject: Is it possible to implement the per-node page cache for programs/libraries? To: torvalds@linux-foundation.org, viro@zeniv.linux.org.uk, akpm@linux-foundation.org, linux-mm@kvack.org, song.bao.hua@hisilicon.com Cc: linux-kernel@vger.kernel.org, Frank Wang Message-ID: Date: Wed, 1 Sep 2021 11:07:41 +0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable X-ClientProxiedBy: HK2PR02CA0170.apcprd02.prod.outlook.com (2603:1096:201:1f::30) To MWHPR0101MB3165.prod.exchangelabs.com (2603:10b6:301:2f::19) MIME-Version: 1.0 X-MS-Exchange-MessageSentRepresentingType: 1 Received: from [10.30.33.15] (180.167.209.74) by HK2PR02CA0170.apcprd02.prod.outlook.com (2603:1096:201:1f::30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4478.19 via Frontend Transport; Wed, 1 Sep 2021 03:07:48 +0000 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: df315fab-8baf-4746-f198-08d96cf5ae7c X-MS-TrafficTypeDiagnostic: MW4PR01MB6132: X-MS-Exchange-Transport-Forked: True X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: Fl7tHaFQfA5ogAKA4yadsbfRZCJhL1gsK0lOpKLjLRjNzXhecuebhr+zHOhr7vC9GiVH6/NuEIB/63O/Ok5wlTo2G5+qRXiJOIHHExh9DQyQOnTtE+2jHkhlzef+JuxoglhxJrAmzHjYmnYZ4ClexmMftzDR6uA+DKsB8XXh8Fvw2dzYyaYQAHSqQZZXiPSApIJ8JVOCp/T58Lq67WIXrb8F+dJQun4S0KuKOaSyEPRlXU60ZnZcGe/opGjlsuVxTbCBBNQTnQsMqJy3PEopJnNGcC6tm65rmPulC/8CaM8Vh7bySGE7FTzOkQ8xIMtEGiPdaU59Ocv8KzWzTMYUXjbjMIoNch0MWOek+rtCO9bqaa/gDoOLZYXLsS06yANkym8Zqxp8g85Wk1JXW//cNtMg6KDc/Z01k7gX5UQxvd+UC3Kx9xG6g4vvC1PCdPvssX+Q7bAp53JhB3ZMygKN/xz4EGv7FVgboizwHrbY6QB+9WJOdHay6coWWzJxfOABRDf6X6SS/bCdH6dBGpiNKJ/H23MZ6xu/hTAGUy6TOQKf86tOj2e7dj+lQEBMUeEmvioFrR+4eRnOyrJ7vbKp3mkvkSqAP6rX2hOYk8JDR3CQbYNwnHyKW/Rfs8YESEvl8JS2+9VNhQJUQEP48stZkiQnECDkBeyPJ8QWKuzkdsaNC/GwUTjyfNN0tqhRSp5+eX09MplGf40auueDbnv65BGI5JIW/qmJ6RwNV9+3i1V4/bhyISKFSZuTtMmrj3+2f4+HFiO3ZUgs5z7Nf3n4ww== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:MWHPR0101MB3165.prod.exchangelabs.com;PTR:;CAT:NONE;SFS:(4636009)(366004)(31696002)(6486002)(26005)(42882007)(83380400001)(5660300002)(83170400001)(186003)(66946007)(316002)(16576012)(38350700002)(508600001)(38100700002)(66556008)(66476007)(8676002)(956004)(6666004)(2906002)(31686004)(107886003)(52116002)(2616005)(8936002)(4326008)(45980500001)(43740500002);DIR:OUT;SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?Q3V5TEl3T3FpUjZKTUsrbWlPTWRPaW9VZXh5S0J3ODhodWRHT1pxYkFDeC9v?= =?utf-8?B?RnJKRWlSeis2eU5aOXFxaWNPaXpWUFVKcmZGLzFWaDJtYU5CaTJaZ0RNQXdw?= =?utf-8?B?NXNIdTlTL1czZ04zb2hwR2pSVmVoaDliWHZMWUNWcy9TSHZldExmU1EzZ1NS?= =?utf-8?B?eit0LzFpMGhpdkxWN3RNRlBVb1hLNmNiU3BteTBDSHhiT3BjYThnYTNjUEhL?= =?utf-8?B?VDZrSHJCSDk4bEIyVWpWN21MTWNRK01pSVV3Tnl4cVdLK3hrWkpIUW04elVE?= =?utf-8?B?U0gvTzdpWldkYUh2MEg5akJzTFVXcFlPWDJMMVdIbmRMTzJjUVExS3Vqa3o4?= =?utf-8?B?Zjk0bzNQcWt0REFOSk1lZE9Fb1oxb3FVdHhIT2ZWcG5FU3RhbnJmUmowbGNh?= =?utf-8?B?VjRsd2lMMmtPcVlpdGI2aFRoNDUzb1ByZ0thdERFSHlETWMvRG1ETW1hWlpN?= =?utf-8?B?dzgwenhiT3l2TXNacktpcGdBV3pkTWtRdWtZd0dqVm43MmNNRlFCWTBLYUxM?= =?utf-8?B?TS92STNob0NUemdzL2lmZ3RPenBlY0NCU0ZFZXBDOXgrNDZzSHpyaksraW14?= =?utf-8?B?cUkyUmErVXRxMDFpT1hqYzgxS3Z5TllwQ21sck5iT3hBWW1MMVRCalQrMXRR?= =?utf-8?B?RzU5WUdUWm16OTZCSStrdjlCVzZvR09jdW1WZlNyOHlQcVBSTHBRaHRUaUt5?= =?utf-8?B?aldPTjhkdkswc0JJazliZVFIQXBpamJRZ0ZZRmVnYnUzcW1aRXdJc1l0MzRP?= =?utf-8?B?cHNMczVpekxpeHVyOTFHVWh5YXhQOS83eWg1Yi9sRXd6eXcxMnlEaVlHWlc2?= =?utf-8?B?OE5DU1ZIM2xqVnFqeTgxZmIvZ0JNZ1ZpWmdaNWtpd05WbWtjU0VqTGJUM21v?= =?utf-8?B?b20xbFFrK1ZjZXZWWnFGaFozODNRZ3NDeEp4MXBJU3RvdlZPN2tldm5oUEY0?= =?utf-8?B?N2l3MHRuMitOanNuRVdISFR1bkJ5cXg4R29MTUxuZzRuYmNUci9MdFk1SHVP?= =?utf-8?B?dnlaNDNYa3gyTVVnUVhQTkVxblFjNDUvd1UxWDlNNlVJTE45NzZLTElQcStx?= =?utf-8?B?REtPZUxnL0tKbEo2SnU1MWY2bVlreitPb3hyM0lOUVFVa2IrR3RtZlFFSkpE?= =?utf-8?B?OVRraDRVSmlRenhpSHljdWcyVFI2OHM5WjdnenBRU3FoZ0tiL3lQSS9ZMjJZ?= =?utf-8?B?RWpZaVlIYTNtMjMyT2Z6c2V6UHoyTllsYVRTcmluZVQ2QnlPeS93cGM1RlYx?= =?utf-8?B?c3QyK2JSTW0wdUpmbFZuMzJFdjVLWGltSDJ1VGNGTUY2c3RnQ1ZhbUNJc2Ez?= =?utf-8?B?NXhoN2I4NXA1Nk5KYUM0RFhSWkRMb1RydTZLNVo2OWpZSm1EV1ZLcUJyTThG?= =?utf-8?B?SVh0bWI2VXo2OXkyYkF2ZkgxU01MTGVLa3ZoaGtPTGhWaWVkUDcxVU9iNWRH?= =?utf-8?B?YkN5N1RjWHMwK2dhaUVnM0JpM054L3FhVWRGaHB5TlIyeHVJMTl6SDY3dGxV?= =?utf-8?B?UHBMM2w1KzR0amlROWlyckEvMk0zRlNRa0JGUmVRK3V3aFB3bkFGb2RVR2hO?= =?utf-8?B?bkI3cFRsODFRWWF0Qk9DamFTVEUrUEpiZUx4YmlldkZQMTFqNXA2SHc4eFU1?= =?utf-8?B?QU16TVZrSG9OTXI0YXBrRzUyMCthTDgrUTRxUHU0MXcvVUU1Ym9RcFNhYmts?= =?utf-8?B?R0xKbzI2YTkyK2VjNVlGdmp1VWhTQUo2eVJJNGhEZk5FMUZ3U3V4Zm5zdnN3?= =?utf-8?Q?TfDPomwAtb26XOSFYcp7DH7OfBJBmRkcQOrqBk5?= X-OriginatorOrg: amperemail.onmicrosoft.com X-MS-Exchange-CrossTenant-Network-Message-Id: df315fab-8baf-4746-f198-08d96cf5ae7c X-MS-Exchange-CrossTenant-AuthSource: MWHPR0101MB3165.prod.exchangelabs.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Sep 2021 03:07:50.2945 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3bc2b170-fd94-476d-b0ce-4229bdc904a7 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: sSnx1+1k7QJh+EK0FMGJo/1Oml5F0qMuBrFG9NxiTQBVTMoQVI1mNToIg56IX5jUG5kYI3SLYoYuLK0B/oSrDraW/oOwlFJzD4s4x7q1IJVX88FC2pgq3SJCQUPd3nZI X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW4PR01MB6132 Authentication-Results: imf29.hostedemail.com; dkim=none ("invalid DKIM record") header.d=amperemail.onmicrosoft.com header.s=selector1-amperemail-onmicrosoft-com header.b=TCkEmqeb; spf=pass (imf29.hostedemail.com: domain of Shijie@os.amperecomputing.com designates 40.107.236.124 as permitted sender) smtp.mailfrom=Shijie@os.amperecomputing.com; dmarc=none X-Rspamd-Server: rspam05 X-Rspamd-Queue-Id: CE3299000247 X-Stat-Signature: pa8x5ty7ez1tb7h31ojuz19ibxdgs4pb X-HE-Tag: 1630465673-363442 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000021, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Hi Everyone, In the NUMA, we only have one page cache for each file. For the program/shared libraries, the remote-access delays longer then the local-access. So, is it possible to implement the per-node page cache for programs/libraries? We can do it like this: 1.) Add a new system call to control specific files to NUMA-aware, such as: set_numa_aware("/usr/lib/libc.so", enable); After the system call, the page cache of libc.so has the flags "NUMA_ENABLED" 2.) When A new process tries to setup the MMU page table for libc.so, it will check if NUMA_ENABLED is set. If it set, the kernel will give a page which is bind to the process's NUMA node. By this way, we can eliminate the remote-access for programs/shared library. Is this proposal ok? Or do you have a better idea? Thanks Huang Shijie CONFIDENTIALITY NOTICE: This e-mail message, including any attachments, is = for the sole use of the intended recipient(s) and contains information that= is confidential and proprietary to Ampere Computing or its subsidiaries. I= t is to be used solely for the purpose of furthering the parties' business = relationship. Any unauthorized review, copying, or distribution of this ema= il (or any attachments thereto) is strictly prohibited. If you are not the = intended recipient, please contact the sender immediately and permanently d= elete the original and any copies of this email and any attachments thereto= .