linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
	Konstantin Khlebnikov <koct9i@gmail.com>,
	Wu Fengguang <fengguang.wu@intel.com>,
	Arnaldo Carvalho de Melo <acme@redhat.com>,
	Borislav Petkov <bp@alien8.de>
Subject: Re: [PATCH 0/4] pagecache scanning with /proc/kpagecache
Date: Wed, 21 May 2014 22:19:55 -0400	[thread overview]
Message-ID: <537d5ee6.893d0f0a.1334.1ee2SMTPIN_ADDED_BROKEN@mx.google.com> (raw)
In-Reply-To: <20140521154250.95bc3520ad8d192d95efe39b@linux-foundation.org>

On Wed, May 21, 2014 at 03:42:50PM -0700, Andrew Morton wrote:
> On Tue, 20 May 2014 22:26:30 -0400 Naoya Horiguchi <n-horiguchi@ah.jp.nec.com> wrote:
> 
> > This patchset adds a new procfs interface to extrace information about
> > pagecache status. In-kernel tool tools/vm/page-types.c has already some
> > code for pagecache scanning without kernel's help, but it's not free
> > from measurement-disturbance, so here I'm suggesting another approach.
> 
> I'm not seeing much explanation of why you think the kernel needs this.
> The overall justification for a change is terribly important so please
> do spend some time on it.

OK. Now I'm developing a patchset which improves memory error (and IO error
in next version) reporting on dirty pagecache (to avoid bad-data consumption.)
The essense of this patchset is that we remember error information on page
cache tree and users need to know which page cache is affected by error.
This is the reason why I need this feature.
# I separate this part from memory error reporting patchset and posted at
# first because I noticed Konstantin's patch just a few days ago and I found
# the person who has the same interest of mine :)

I understand adding procfs interface itself needs much care, so I don't
persist in this specific interface if there're better options. Now I'm
reserching other options Konstantin suggesting.

> As I don't *really* know what the patch is for, I can't comment a lot
> further, but...
> 
> 
> A much nicer interface would be for us to (finally!) implement
> fincore(), perhaps with an enhanced per-present-page payload which
> presents the info which you need (although we don't actually know what
> that info is!).

page/pfn of each page slot and its page cache tag as shown in patch 4/4.

> This would require open() - it appears to be a requirement that the
> caller not open the file, but no reason was given for this.
> 
> Requiring open() would address some of the obvious security concerns,
> but it will still be possible for processes to poke around and get some
> understanding of the behaviour of other processes.  Careful attention
> should be paid to this aspect of any such patchset.

Sorry if I missed your point, but this interface defines fixed mapping
between file position in /proc/kpagecache and in-file page offset of
the target file. So we do not need to use seq_file mechanism, that's
why open() is not defined and default one is used.
The same thing is true for /proc/{kpagecount,kpageflags}, from which
I copied/pasted some basic code.

Thanks,
Naoya

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2014-05-22  2:20 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-05-21  2:26 Naoya Horiguchi
2014-05-21  2:26 ` [PATCH 1/4] radix-tree: add end_index to support ranged iteration Naoya Horiguchi
2014-05-21  8:21   ` Konstantin Khlebnikov
2014-05-21 19:26     ` Naoya Horiguchi
2014-05-21  2:26 ` [PATCH 2/4] fs/proc/page.c: introduce /proc/kpagecache interface Naoya Horiguchi
2014-05-21  2:26 ` [PATCH 3/4] tools/vm/page-types.c: rework on file cache scanning mode Naoya Horiguchi
2014-05-21  2:26 ` [PATCH 4/4] Documentation: update Documentation/vm/pagemap.txt Naoya Horiguchi
2014-05-21 22:42 ` [PATCH 0/4] pagecache scanning with /proc/kpagecache Andrew Morton
2014-05-22  2:19   ` Naoya Horiguchi [this message]
     [not found]   ` <537d5ee4.4914e00a.5672.ffff85d5SMTPIN_ADDED_BROKEN@mx.google.com>
2014-05-22  2:33     ` Andrew Morton
2014-05-22  9:50       ` Konstantin Khlebnikov
2014-05-22 10:36         ` Kirill A. Shutemov
2014-05-22 17:47           ` Naoya Horiguchi
2014-05-22 21:02             ` Naoya Horiguchi
2014-06-02  5:24       ` [RFC][PATCH 0/3] mm: introduce fincore() Naoya Horiguchi
2014-06-02  5:24         ` [PATCH 1/3] replace PAGECACHE_TAG_* definition with enumeration Naoya Horiguchi
2014-06-02 16:12           ` Dave Hansen
2014-06-02 16:37             ` Naoya Horiguchi
     [not found]             ` <1401727052-f7v7kykv@n-horiguchi@ah.jp.nec.com>
2014-06-02 16:45               ` Dave Hansen
2014-06-02 17:14                 ` Naoya Horiguchi
2014-06-02 18:19                   ` Dave Hansen
2014-06-02 18:48                     ` Naoya Horiguchi
2014-06-02 21:16             ` Andrew Morton
2014-06-02 21:51               ` Naoya Horiguchi
2014-06-02  5:24         ` [PATCH 2/3] mm: introduce fincore() Naoya Horiguchi
2014-06-02  6:42           ` Christoph Hellwig
2014-06-02 14:19             ` Naoya Horiguchi
2014-06-02  7:06           ` Michael Kerrisk
2014-06-02 14:21             ` Naoya Horiguchi
2014-06-02 12:23           ` Kirill A. Shutemov
2014-06-02 14:52             ` Naoya Horiguchi
2014-06-02 16:11           ` Dave Hansen
2014-06-02 16:22             ` Naoya Horiguchi
2014-06-02  5:24         ` [PATCH 3/3] selftest: add test code for fincore() Naoya Horiguchi

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=537d5ee6.893d0f0a.1334.1ee2SMTPIN_ADDED_BROKEN@mx.google.com \
    --to=n-horiguchi@ah.jp.nec.com \
    --cc=acme@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=bp@alien8.de \
    --cc=fengguang.wu@intel.com \
    --cc=koct9i@gmail.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox