From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id C73BDC433EF for ; Fri, 27 May 2022 20:22:11 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 299ED8D0005; Fri, 27 May 2022 16:22:11 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 246108D0002; Fri, 27 May 2022 16:22:11 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 133768D0005; Fri, 27 May 2022 16:22:11 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id 062508D0002 for ; Fri, 27 May 2022 16:22:11 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id D97E535BDD for ; Fri, 27 May 2022 20:22:10 +0000 (UTC) X-FDA: 79512644820.19.5B01F9F Received: from mail-pg1-f171.google.com (mail-pg1-f171.google.com [209.85.215.171]) by imf17.hostedemail.com (Postfix) with ESMTP id 93EBB4003C for ; Fri, 27 May 2022 20:21:38 +0000 (UTC) Received: by mail-pg1-f171.google.com with SMTP id e66so4798458pgc.8 for ; Fri, 27 May 2022 13:22:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=jRAong5jtA1pQSCVCP1/ZwbMJygkfMZB0+KG9D3mR4U=; b=WHCzoPsH+JNM+zVbhXbv5AfrAcsChv1KHaqEOMJkVskHdHINDSY+0vBJFBs/qBrI/t I/uIAS1dv+i1pMC4J+dNpm9Fc++y/hTxvnR0/K9HGLarJCsecbR2aEWzZ+kfbZnWb/ri 3JbStY8FglN3+EawTFC2GcN3qiY+QPRPOiySv3XkXUZ8ftCA5KWrQPqroXAvkw27dgZe c04KIKVc31ICEU5D+dBkvqh1ClHY4ezB4sk8sR4KoesdlbDIsPGf+5tIIQ9kDeg2p3f8 NrNnbspC1Xmvo80qyIeUuUxReaJUlA9RC6Y0XccxflTHPcY90IRD1W7qIptETLxMZLVh 227Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=jRAong5jtA1pQSCVCP1/ZwbMJygkfMZB0+KG9D3mR4U=; b=yO54pib9sqHpQhSuZZcZnELFtK3n5B+zdf2u0LbQgWMxSmSTm6DP7vrMWj6DTKxW5l FQ97AHO4Fo8PfWDk2M2dsYXzAM8rGc8HT+JoRyDZfDVRuhuhDnOvayCXdEXSVn7G9JL9 e9Ild94C/CL0fDaVq/9QF2ePdSyzw0RQUVSYda+hPSJv7zQ3BxrmVROf+EbLzs2578hc hFSOM70bZuYXs8xdLVBuTQtHy7Pgw+rcprzRJrgeCmzqIXBMGqc1CD90GRRf4lCsWFYh Wj0ZjGHEF2j/bRZh3jpoNK0YeYkikWIqmqBtOULyM+4HW3suIqB78bP4huznDWHH5ftR YudA== X-Gm-Message-State: AOAM532rvCPrv1lEfbkgl68n1HM1JyJIUkMWCQspm3rVp4bhuKHwmYfg VcIp1SLJ9VC2ePZEhKzyfpjcRc9QdQldjmfsTXs= X-Google-Smtp-Source: ABdhPJzHHSHXonjBGIWo0LyNOnfD3+eKMKAs7YA2rFDiXQ8K4RtOqGvEx9xJyi+BXuYucmtO8CBAllPSialXomOA7vc= X-Received: by 2002:a62:e518:0:b0:4fa:9333:ddbd with SMTP id n24-20020a62e518000000b004fa9333ddbdmr45709859pff.11.1653682929374; Fri, 27 May 2022 13:22:09 -0700 (PDT) MIME-Version: 1.0 References: <20220527190731.322722-1-jiaqiyan@google.com> <20220527190731.322722-3-jiaqiyan@google.com> In-Reply-To: <20220527190731.322722-3-jiaqiyan@google.com> From: Yang Shi Date: Fri, 27 May 2022 13:21:57 -0700 Message-ID: Subject: Re: [PATCH v4 2/2] mm: khugepaged: recover from poisoned file-backed memory To: Jiaqi Yan Cc: Tong Tiangen , Tony Luck , =?UTF-8?B?SE9SSUdVQ0hJIE5BT1lBKOWggOWPoyDnm7TkuZ8p?= , "Kirill A. Shutemov" , Miaohe Lin , Jue Wang , Linux MM Content-Type: text/plain; charset="UTF-8" X-Stat-Signature: 7pccb9sw7mg18djrirauk8d5rbdc859t X-Rspam-User: Authentication-Results: imf17.hostedemail.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=WHCzoPsH; spf=pass (imf17.hostedemail.com: domain of shy828301@gmail.com designates 209.85.215.171 as permitted sender) smtp.mailfrom=shy828301@gmail.com; dmarc=pass (policy=none) header.from=gmail.com X-Rspamd-Server: rspam10 X-Rspamd-Queue-Id: 93EBB4003C X-HE-Tag: 1653682898-458045 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Fri, May 27, 2022 at 12:07 PM Jiaqi Yan wrote: > > Make collapse_file roll back when copying pages failed. > More concretely: > * extract copying operations into a separate loop > * postpone the updates for nr_none until both scanning and > copying succeeded > * postpone joining small xarray entries until both scanning and > copying succeeded > * postpone the update operations to NR_XXX_THPS > * for non-SHMEM file, roll back filemap_nr_thps_inc if scan > succeeded but copying failed > > Signed-off-by: Jiaqi Yan Reviewed-by: Yang Shi > --- > mm/khugepaged.c | 73 ++++++++++++++++++++++++++++++------------------- > 1 file changed, 45 insertions(+), 28 deletions(-) > > diff --git a/mm/khugepaged.c b/mm/khugepaged.c > index 0dd28ecc915d1..1ea485c315756 100644 > --- a/mm/khugepaged.c > +++ b/mm/khugepaged.c > @@ -1706,7 +1706,7 @@ static void collapse_file(struct mm_struct *mm, > { > struct address_space *mapping = file->f_mapping; > gfp_t gfp; > - struct page *new_page; > + struct page *new_page, *page, *tmp; > pgoff_t index, end = start + HPAGE_PMD_NR; > LIST_HEAD(pagelist); > XA_STATE_ORDER(xas, &mapping->i_pages, start, HPAGE_PMD_ORDER); > @@ -1762,7 +1762,7 @@ static void collapse_file(struct mm_struct *mm, > > xas_set(&xas, start); > for (index = start; index < end; index++) { > - struct page *page = xas_next(&xas); > + page = xas_next(&xas); > > VM_BUG_ON(index != xas.xa_index); > if (is_shmem) { > @@ -1934,10 +1934,7 @@ static void collapse_file(struct mm_struct *mm, > } > nr = thp_nr_pages(new_page); > > - if (is_shmem) > - __mod_lruvec_page_state(new_page, NR_SHMEM_THPS, nr); > - else { > - __mod_lruvec_page_state(new_page, NR_FILE_THPS, nr); > + if (!is_shmem) { > filemap_nr_thps_inc(mapping); > /* > * Paired with smp_mb() in do_dentry_open() to ensure > @@ -1948,40 +1945,44 @@ static void collapse_file(struct mm_struct *mm, > smp_mb(); > if (inode_is_open_for_write(mapping->host)) { > result = SCAN_FAIL; > - __mod_lruvec_page_state(new_page, NR_FILE_THPS, -nr); > filemap_nr_thps_dec(mapping); > goto xa_locked; > } > } > > - if (nr_none) { > - __mod_lruvec_page_state(new_page, NR_FILE_PAGES, nr_none); > - if (is_shmem) > - __mod_lruvec_page_state(new_page, NR_SHMEM, nr_none); > - } > - > - /* Join all the small entries into a single multi-index entry */ > - xas_set_order(&xas, start, HPAGE_PMD_ORDER); > - xas_store(&xas, new_page); > xa_locked: > xas_unlock_irq(&xas); > xa_unlocked: > > if (result == SCAN_SUCCEED) { > - struct page *page, *tmp; > - > /* > * Replacing old pages with new one has succeeded, now we > - * need to copy the content and free the old pages. > + * attempt to copy the contents. > */ > index = start; > - list_for_each_entry_safe(page, tmp, &pagelist, lru) { > + list_for_each_entry(page, &pagelist, lru) { > while (index < page->index) { > clear_highpage(new_page + (index % HPAGE_PMD_NR)); > index++; > } > - copy_highpage(new_page + (page->index % HPAGE_PMD_NR), > - page); > + if (copy_highpage_mc(new_page + (page->index % HPAGE_PMD_NR), page)) { > + result = SCAN_COPY_MC; > + break; > + } > + index++; > + } > + while (result == SCAN_SUCCEED && index < end) { > + clear_highpage(new_page + (page->index % HPAGE_PMD_NR)); > + index++; > + } > + } > + > + if (result == SCAN_SUCCEED) { > + /* > + * Copying old pages to huge one has succeeded, now we > + * need to free the old pages. > + */ > + list_for_each_entry_safe(page, tmp, &pagelist, lru) { > list_del(&page->lru); > page->mapping = NULL; > page_ref_unfreeze(page, 1); > @@ -1989,12 +1990,23 @@ static void collapse_file(struct mm_struct *mm, > ClearPageUnevictable(page); > unlock_page(page); > put_page(page); > - index++; > } > - while (index < end) { > - clear_highpage(new_page + (index % HPAGE_PMD_NR)); > - index++; > + > + xas_lock_irq(&xas); > + if (is_shmem) > + __mod_lruvec_page_state(new_page, NR_SHMEM_THPS, nr); > + else > + __mod_lruvec_page_state(new_page, NR_FILE_THPS, nr); > + > + if (nr_none) { > + __mod_lruvec_page_state(new_page, NR_FILE_PAGES, nr_none); > + if (is_shmem) > + __mod_lruvec_page_state(new_page, NR_SHMEM, nr_none); > } > + /* Join all the small entries into a single multi-index entry. */ > + xas_set_order(&xas, start, HPAGE_PMD_ORDER); > + xas_store(&xas, new_page); > + xas_unlock_irq(&xas); > > SetPageUptodate(new_page); > page_ref_add(new_page, HPAGE_PMD_NR - 1); > @@ -2010,8 +2022,6 @@ static void collapse_file(struct mm_struct *mm, > > khugepaged_pages_collapsed++; > } else { > - struct page *page; > - > /* Something went wrong: roll back page cache changes */ > xas_lock_irq(&xas); > mapping->nrpages -= nr_none; > @@ -2045,6 +2055,13 @@ static void collapse_file(struct mm_struct *mm, > xas_lock_irq(&xas); > } > VM_BUG_ON(nr_none); > + /* > + * Undo the updates of filemap_nr_thps_inc for non-SHMEM file only. > + * This undo is not needed unless failure is due to SCAN_COPY_MC. > + */ > + if (!is_shmem && result == SCAN_COPY_MC) > + filemap_nr_thps_dec(mapping); > + > xas_unlock_irq(&xas); > > new_page->mapping = NULL; > -- > 2.36.1.124.g0e6072fb45-goog >