From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id A8481C43334 for ; Wed, 15 Jun 2022 23:25:13 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 0F7046B0071; Wed, 15 Jun 2022 19:25:13 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 07FAB6B0072; Wed, 15 Jun 2022 19:25:13 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E14116B0074; Wed, 15 Jun 2022 19:25:12 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0014.hostedemail.com [216.40.44.14]) by kanga.kvack.org (Postfix) with ESMTP id CBE2E6B0071 for ; Wed, 15 Jun 2022 19:25:12 -0400 (EDT) Received: from smtpin14.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay07.hostedemail.com (Postfix) with ESMTP id 92B272135F for ; Wed, 15 Jun 2022 23:25:12 +0000 (UTC) X-FDA: 79582053264.14.0CC6E4D Received: from rtits2.realtek.com.tw (rtits2.realtek.com [211.75.126.72]) by imf27.hostedemail.com (Postfix) with ESMTP id 73C7140011 for ; Wed, 15 Jun 2022 23:25:11 +0000 (UTC) Authenticated-By: X-SpamFilter-By: ArmorX SpamTrap 5.73 with qID 25FNP2Qg8014168, This message is accepted by code: ctloc85258 Received: from mail.realtek.com (rtexh36505.realtek.com.tw[172.21.6.25]) by rtits2.realtek.com.tw (8.15.2/2.71/5.88) with ESMTPS id 25FNP2Qg8014168 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Thu, 16 Jun 2022 07:25:02 +0800 Received: from RTEXMBS03.realtek.com.tw (172.21.6.96) by RTEXH36505.realtek.com.tw (172.21.6.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.28; Thu, 16 Jun 2022 07:25:02 +0800 Received: from localhost.localdomain (172.21.177.191) by RTEXMBS03.realtek.com.tw (172.21.6.96) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2308.21; Thu, 16 Jun 2022 07:25:01 +0800 From: Edward Wu To: Andrew Morton , , CC: , , Subject: [PATCH v2] mm: cma: sync everything after EBUSY Date: Thu, 16 Jun 2022 07:24:55 +0800 Message-ID: <20220615232455.26451-1-edwardwu@realtek.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20220615021504.23358-1-edwardwu@realtek.com> References: <20220615021504.23358-1-edwardwu@realtek.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [172.21.177.191] X-ClientProxiedBy: RTEXH36504.realtek.com.tw (172.21.6.27) To RTEXMBS03.realtek.com.tw (172.21.6.96) X-KSE-ServerInfo: RTEXMBS03.realtek.com.tw, 9 X-KSE-AntiSpam-Interceptor-Info: trusted connection X-KSE-Antiphishing-Info: Clean X-KSE-Antiphishing-ScanningType: Deterministic X-KSE-Antiphishing-Method: None X-KSE-Antiphishing-Bases: 06/15/2022 23:03:00 X-KSE-AttachmentFiltering-Interceptor-Info: no applicable attachment filtering rules found X-KSE-Antivirus-Interceptor-Info: scan successful X-KSE-Antivirus-Info: =?big5?B?Q2xlYW4sIGJhc2VzOiAyMDIyLzYvMTUgpFWkyCAxMDowMTowMA==?= X-KSE-BulkMessagesFiltering-Scan-Result: protection disabled X-KSE-ServerInfo: RTEXH36505.realtek.com.tw, 9 X-KSE-Attachment-Filter-Triggered-Rules: Clean X-KSE-Attachment-Filter-Triggered-Filters: Clean X-KSE-BulkMessagesFiltering-Scan-Result: protection disabled ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1655335512; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=x6z7ksBfFdaqoHcyrmXW7nug22Uo0hOi3+tRR09iw1Y=; b=1LD/oyJTpwBAuOgzdpgYKD1wKe7ozpbn2fKgdKtMbhSAUNOLj4tYniLGVtgXAjvLv7tByP xY8EFeQFdHrprCsB5YP/ntOLUq07Nf7TCI+JoF3ql2PPygXMwOAOAOruYYiHY2YaeOFMJe W/hD8icNbOVpEHyvva8OA4B+aGAswAE= ARC-Authentication-Results: i=1; imf27.hostedemail.com; dkim=none; spf=pass (imf27.hostedemail.com: domain of edwardwu@realtek.com designates 211.75.126.72 as permitted sender) smtp.mailfrom=edwardwu@realtek.com; dmarc=none ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1655335512; a=rsa-sha256; cv=none; b=FqyJfbyfaBZ59E7VnKBJE2VW8Iais65xni1EAGkcfbZAKYdttiIgZb81wst2lYG3OcDV1i E8gaPgGocDXn5HyALmFqSfXCHAWCjpy8o/+R65T9Ejm8niAYy2T2nTzQp8p10wh2y0Sbhf C5XEW3JxBrfzr2gh9+cxAYKzBwD5hJQ= X-Stat-Signature: wo6w3ojgzcwk3qzkdwsugph5yji857c6 X-Rspamd-Queue-Id: 73C7140011 X-Rspamd-Server: rspam11 X-Rspam-User: Authentication-Results: imf27.hostedemail.com; dkim=none; spf=pass (imf27.hostedemail.com: domain of edwardwu@realtek.com designates 211.75.126.72 as permitted sender) smtp.mailfrom=edwardwu@realtek.com; dmarc=none X-HE-Tag: 1655335511-605980 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Since file-backed memory on CMA area could take long-term pinning. By Minchan Kim's debug commit 151e084af494 ("mm: page_alloc: dump migrate-failed pages only at -EBUSY") We know the pinned page comes from buffer_head, ext4 journal, FS metadata. Sync everything after EBUSY that can unpin most file-system pages. And raise the success rate at next time try. Link: https://lkml.kernel.org/r/20220615021504.23358-1-edwardwu@realtek.com Signed-off-by: Edward Wu --- v2: - Fix compile warning mm/cma.c | 25 +++++++++++++++++++++++++ 1 file changed, 25 insertions(+) diff --git a/mm/cma.c b/mm/cma.c index eaa4b5c920a2..28391f8ce0fd 100644 --- a/mm/cma.c +++ b/mm/cma.c @@ -31,6 +31,7 @@ #include #include #include +#include #include #include "cma.h" @@ -410,6 +411,24 @@ static void cma_debug_show_areas(struct cma *cma) static inline void cma_debug_show_areas(struct cma *cma) { } #endif +static inline void cma_sync_work(struct work_struct *work) +{ + ksys_sync(); + kfree(work); + pr_debug("%s(): EBUSY Sync complete\n", __func__); +} + +static void cma_ebusy_sync_pinned_pages(void) +{ + struct work_struct *work; + + work = kmalloc(sizeof(*work), GFP_ATOMIC); + if (work) { + INIT_WORK(work, cma_sync_work); + schedule_work(work); + } +} + /** * cma_alloc() - allocate pages from contiguous area * @cma: Contiguous memory region for which the allocation is performed. @@ -430,6 +449,7 @@ struct page *cma_alloc(struct cma *cma, unsigned long count, unsigned long i; struct page *page = NULL; int ret = -ENOMEM; + bool sys_synchronized = false; if (!cma || !cma->count || !cma->bitmap) goto out; @@ -480,6 +500,11 @@ struct page *cma_alloc(struct cma *cma, unsigned long count, if (ret != -EBUSY) break; + if (!sys_synchronized) { + sys_synchronized = true; + cma_ebusy_sync_pinned_pages(); + } + pr_debug("%s(): memory range at %p is busy, retrying\n", __func__, pfn_to_page(pfn)); -- 2.17.1