From: David Hildenbrand <david@redhat.com>
To: Jason Gunthorpe <jgg@ziepe.ca>
Cc: Andrea Arcangeli <aarcange@redhat.com>,
Andrew Morton <akpm@linux-foundation.org>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Yu Zhao <yuzhao@google.com>, Andy Lutomirski <luto@kernel.org>,
Peter Xu <peterx@redhat.com>, Pavel Emelyanov <xemul@openvz.org>,
Mike Kravetz <mike.kravetz@oracle.com>,
Mike Rapoport <rppt@linux.vnet.ibm.com>,
Minchan Kim <minchan@kernel.org>, Will Deacon <will@kernel.org>,
Peter Zijlstra <peterz@infradead.org>,
Linus Torvalds <torvalds@linux-foundation.org>,
Hugh Dickins <hughd@google.com>,
"Kirill A. Shutemov" <kirill@shutemov.name>,
Matthew Wilcox <willy@infradead.org>,
Oleg Nesterov <oleg@redhat.com>, Jann Horn <jannh@google.com>,
Kees Cook <keescook@chromium.org>,
John Hubbard <jhubbard@nvidia.com>,
Leon Romanovsky <leonro@nvidia.com>, Jan Kara <jack@suse.cz>,
Kirill Tkhai <ktkhai@virtuozzo.com>,
Nadav Amit <nadav.amit@gmail.com>, Jens Axboe <axboe@kernel.dk>
Subject: Re: [PATCH 0/1] mm: restore full accuracy in COW page reuse
Date: Fri, 15 Jan 2021 20:46:48 +0100 [thread overview]
Message-ID: <a21e6fdf-5cac-6fda-242e-7909af96027a@redhat.com> (raw)
In-Reply-To: <20210115183721.GG4605@ziepe.ca>
>> 7) There is no easy way to detect if a page really was pinned: we might
>> have false positives. Further, there is no way to distinguish if it was
>> pinned with FOLL_WRITE or not (R vs R/W). To perform reliable tracking
>> we most probably would need more counters, which we cannot fit into
>> struct page. (AFAIU, for huge pages it's easier).
>
> I think this is the real issue. We can only store so much information,
> so we have to decide which things work and which things are broken. So
> far someone hasn't presented a way to record everything at least..
I do wonder how many (especially long-term) GUP readers/writers we have
to expect, and especially, support for a single base page. Do we have a
rough estimate?
With RDMA, I would assume we only need a single one (e.g., once RDMA
device; I'm pretty sure I'm wrong, sounds too easy).
With VFIO I guess we need one for each VFIO container (~ in the worst
case one for each passthrough device).
With direct I/O, vmsplice and other GUP users ?? No idea.
If we could somehow put a limit on the #GUP we support, and fail further
GUP (e.g., -EAGAIN?) once a limit is reached, we could partition the
refcount into something like (assume max #15 GUP READ and #15 GUP R/W,
which is most probably a horribly bad choice)
[ GUP READ ][ GUP R/W ] [ ordinary ]
31 ... 28 27 ... 24 23 .... 0
But due to saturate handling in "ordinary", we would lose further 2 bits
(AFAIU), leaving us "only" 22 bits for "ordinary". Now, I have no idea
how many bits we actually need in practice.
Maybe we need less for GUP READ, because most users want GUP R/W? No idea.
Just wild ideas. Most probably that has already been discussed, and most
probably people figured that it's impossible :)
--
Thanks,
David / dhildenb
next prev parent reply other threads:[~2021-01-15 19:47 UTC|newest]
Thread overview: 36+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-01-10 0:44 Andrea Arcangeli
2021-01-10 0:44 ` [PATCH 1/1] " Andrea Arcangeli
2021-01-10 2:54 ` Andrea Arcangeli
2021-01-11 14:11 ` Kirill A. Shutemov
2021-01-10 0:55 ` [PATCH 0/1] " Linus Torvalds
2021-01-10 1:19 ` Linus Torvalds
2021-01-10 1:37 ` Linus Torvalds
2021-01-10 3:24 ` Andrea Arcangeli
2021-01-10 2:51 ` Andrea Arcangeli
2021-01-10 3:51 ` Linus Torvalds
2021-01-10 19:30 ` Linus Torvalds
2021-01-11 1:18 ` Jason Gunthorpe
2021-01-11 7:26 ` John Hubbard
2021-01-11 12:42 ` Matthew Wilcox
2021-01-11 16:05 ` Jason Gunthorpe
2021-01-11 16:15 ` Michal Hocko
2021-01-11 19:19 ` Linus Torvalds
2021-01-11 22:18 ` Linus Torvalds
2021-01-12 17:07 ` Andy Lutomirski
2021-01-12 23:51 ` Jerome Glisse
2021-01-13 2:16 ` Matthew Wilcox
2021-01-13 2:43 ` Linus Torvalds
2021-01-13 3:31 ` Linus Torvalds
2021-01-13 8:52 ` David Hildenbrand
2021-01-13 8:57 ` David Hildenbrand
2021-01-13 12:32 ` Kirill A. Shutemov
2021-01-13 12:55 ` Matthew Wilcox
2021-01-13 19:54 ` Linus Torvalds
2021-01-13 23:54 ` Peter Xu
2021-01-11 15:52 ` Jason Gunthorpe
2021-01-15 8:59 ` David Hildenbrand
2021-01-15 18:37 ` Jason Gunthorpe
2021-01-15 19:46 ` David Hildenbrand [this message]
2021-01-15 19:53 ` Jason Gunthorpe
2021-01-16 3:40 ` John Hubbard
2021-01-16 11:42 ` David Hildenbrand
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=a21e6fdf-5cac-6fda-242e-7909af96027a@redhat.com \
--to=david@redhat.com \
--cc=aarcange@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=axboe@kernel.dk \
--cc=hughd@google.com \
--cc=jack@suse.cz \
--cc=jannh@google.com \
--cc=jgg@ziepe.ca \
--cc=jhubbard@nvidia.com \
--cc=keescook@chromium.org \
--cc=kirill@shutemov.name \
--cc=ktkhai@virtuozzo.com \
--cc=leonro@nvidia.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=luto@kernel.org \
--cc=mike.kravetz@oracle.com \
--cc=minchan@kernel.org \
--cc=nadav.amit@gmail.com \
--cc=oleg@redhat.com \
--cc=peterx@redhat.com \
--cc=peterz@infradead.org \
--cc=rppt@linux.vnet.ibm.com \
--cc=torvalds@linux-foundation.org \
--cc=will@kernel.org \
--cc=willy@infradead.org \
--cc=xemul@openvz.org \
--cc=yuzhao@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox