From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.2 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6ECE1C33CA1 for ; Mon, 20 Jan 2020 10:24:54 +0000 (UTC) Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by mail.kernel.org (Postfix) with ESMTP id 3E1D92073D for ; Mon, 20 Jan 2020 10:24:54 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 3E1D92073D Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=virtuozzo.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=owner-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix) id C31E76B062E; Mon, 20 Jan 2020 05:24:53 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id BE2616B062F; Mon, 20 Jan 2020 05:24:53 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id B01F06B0630; Mon, 20 Jan 2020 05:24:53 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from forelay.hostedemail.com (smtprelay0098.hostedemail.com [216.40.44.98]) by kanga.kvack.org (Postfix) with ESMTP id 9A8C66B062E for ; Mon, 20 Jan 2020 05:24:53 -0500 (EST) Received: from smtpin12.hostedemail.com (10.5.19.251.rfc1918.com [10.5.19.251]) by forelay03.hostedemail.com (Postfix) with SMTP id 55B44824805A for ; Mon, 20 Jan 2020 10:24:53 +0000 (UTC) X-FDA: 76397629266.12.fowl52_81eeca298395f X-HE-Tag: fowl52_81eeca298395f X-Filterd-Recvd-Size: 4580 Received: from relay.sw.ru (relay.sw.ru [185.231.240.75]) by imf08.hostedemail.com (Postfix) with ESMTP for ; Mon, 20 Jan 2020 10:24:52 +0000 (UTC) Received: from dhcp-172-16-24-104.sw.ru ([172.16.24.104]) by relay.sw.ru with esmtp (Exim 4.92.3) (envelope-from ) id 1itUEW-0008Gw-6R; Mon, 20 Jan 2020 13:24:36 +0300 Subject: Re: [PATCH v2 2/5] mm: introduce external memory hinting API To: Michal Hocko , Minchan Kim Cc: Andrew Morton , LKML , linux-mm , linux-api@vger.kernel.org, oleksandr@redhat.com, Suren Baghdasaryan , Tim Murray , Daniel Colascione , Sandeep Patil , Sonny Rao , Brian Geffon , Johannes Weiner , Shakeel Butt , John Dias , christian.brauner@ubuntu.com, sjpark@amazon.de References: <20200116235953.163318-1-minchan@kernel.org> <20200116235953.163318-3-minchan@kernel.org> <20200117115225.GV19428@dhcp22.suse.cz> From: Kirill Tkhai Message-ID: Date: Mon, 20 Jan 2020 13:24:35 +0300 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.4.1 MIME-Version: 1.0 In-Reply-To: <20200117115225.GV19428@dhcp22.suse.cz> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On 17.01.2020 14:52, Michal Hocko wrote: > On Thu 16-01-20 15:59:50, Minchan Kim wrote: >> There is usecase that System Management Software(SMS) want to give >> a memory hint like MADV_[COLD|PAGEEOUT] to other processes and >> in the case of Android, it is the ActivityManagerService. >> >> It's similar in spirit to madvise(MADV_WONTNEED), but the information >> required to make the reclaim decision is not known to the app. Instead, >> it is known to the centralized userspace daemon(ActivityManagerService), >> and that daemon must be able to initiate reclaim on its own without >> any app involvement. >> >> To solve the issue, this patch introduces new syscall process_madvise(2). >> It uses pidfd of an external processs to give the hint. >> >> int process_madvise(int pidfd, void *addr, size_t length, int advise, >> unsigned long flag); >> >> Since it could affect other process's address range, only privileged >> process(CAP_SYS_PTRACE) or something else(e.g., being the same UID) >> gives it the right to ptrace the process could use it successfully. >> The flag argument is reserved for future use if we need to extend the >> API. >> >> I think supporting all hints madvise has/will supported/support to >> process_madvise is rather risky. Because we are not sure all hints make >> sense from external process and implementation for the hint may rely on >> the caller being in the current context so it could be error-prone. >> Thus, I just limited hints as MADV_[COLD|PAGEOUT] in this patch. >> >> If someone want to add other hints, we could hear hear the usecase and >> review it for each hint. It's more safe for maintainace rather than >> introducing a buggy syscall but hard to fix it later. > > I have brought this up when we discussed this in the past but there is > no reflection on that here so let me bring that up again. > > I believe that the interface has an inherent problem that it is racy. > The external entity needs to know the address space layout of the target > process to do anyhing useful on it. The address space is however under > the full control of the target process though and the external entity > has no means to find out that the layout has changed. So > time-to-check-time-to-act is an inherent problem. > > This is a serious design flaw and it should be explained why it doesn't > matter or how to use the interface properly to prevent that problem. Really, any address space manipulation, where more than one process is involved, is racy. Even two threads on common memory need a synchronization to manage mappings in a sane way. Managing memory from two processes is the same in principle, and the only difference is that another level of synchronization is required. I'm not fan and user for this feature (at least for now, nobody knows what will be in the future), but design flaw argument does not look fully valid. Regards, Kirill