linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Lukas Czerner <lczerner@redhat.com>
To: Jan Kara <jack@suse.cz>
Cc: Hugh Dickins <hughd@google.com>, Jan Kara <jack@suse.com>,
	Eric Sandeen <sandeen@redhat.com>,
	linux-mm@kvack.org, linux-fsdevel@vger.kernel.org
Subject: Re: [PATCH 0/2] [RFC] shmem: user and group quota support for tmpfs
Date: Wed, 9 Nov 2022 10:41:58 +0100	[thread overview]
Message-ID: <20221109094158.c2mubinj7g66iw6e@fedora> (raw)
In-Reply-To: <20221108174326.hkgtrt72rpkmelyq@quack3>

On Tue, Nov 08, 2022 at 06:43:26PM +0100, Jan Kara wrote:
> On Tue 08-11-22 14:30:08, Lukas Czerner wrote:
> > people have been asking for quota support in tmpfs many times in the past
> > mostly to avoid one malicious user, or misbehaving user/program to consume
> > all of the system memory. This has been partially solved with the size
> > mount option, but some problems still prevail.
> > 
> > One of the problems is the fact that /dev/shm is still generally unprotected
> > with this and another is administration overhead of managing multiple tmpfs
> > mounts and lack of more fine grained control.
> > 
> > Quota support can solve all these problems in a somewhat standard way
> > people are already familiar with from regular file systems. It can give us
> > more fine grained control over how much memory user/groups can consume.
> > Additionally it can also control number of inodes and with special quota
> > mount options introduced with a second patch we can set global limits
> > allowing us to replace the size mount option with quota entirely.
> > 
> > Currently the standard userspace quota tools (quota, xfs_quota) are only
> > using quotactl ioctl which is expecting a block device. I patched quota [1]
> > and xfs_quota [2] to use quotactl_fd in case we want to run the tools on
> > mount point directory to work nicely with tmpfs.
> > 
> > The implementation was tested on patched version of xfstests [3].
> > 
> > Thoughts?
> 
> Thanks for the work Lukas! I have one general note regarding this quota
> support: IMO it is pointless to try to retrofit how quota files work on
> block-based filesystems to tmpfs. All the bothering with converting between
> on-disk and in-mem representation, formatting of btree nodes is just
> pointless waste of CPU and code.

Hi Jan,

you're right and I did have some thoughts along the same lines. I wasn't
sure how the idea of quota on tmpfs is going to be received and so I
wanted to limit the scope of changes and make my job easier.
It works well as a proof-of-concept but I agree that storing quota data
in some in-memory representation is an ultimate way to go for tmpfs.

> 
> I think much simpler approach would be to keep some internal rbtree with
> quota structures carrying struct mem_dqblk and id. Then your .acquire_dquot
> handler will fill in quota information from the structure and
> .release_dquot will copy new data into the structure.
> 
> So basically all operations you'd need to provide in your implementation
> are .acquire_dquot, .release_dquot, and .get_next_id. And then you'll
> probably need to define new quota format with .read_file_info callback
> filling in some limits of the format (and some other stub callbacks doing
> nothing). If there's too much boilerplate code doing nothing, we can have a
> look into making quota core more clever to make life simpler for in-memory
> filesystems (hidden behind something like DQUOT_QUOTA_IN_MEMORY flag in
> struct quota_info) but currently I don't think it will be too bad.

Thanks for the insight and suggestions. I'll see what I can do with this
and prepare v2.

Thanks!
-Lukas

> 
> 								Honza
> 
> > [1] https://github.com/lczerner/quota/tree/quotactl_fd_support
> > [2] https://github.com/lczerner/xfsprogs/tree/quotactl_fd_support
> > [3] https://github.com/lczerner/xfstests/tree/tmpfs_quota_support
> > 
> -- 
> Jan Kara <jack@suse.com>
> SUSE Labs, CR
> 



      reply	other threads:[~2022-11-09  9:43 UTC|newest]

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-11-08 13:30 Lukas Czerner
2022-11-08 13:30 ` [PATCH 1/2] shmem: implement user/group " Lukas Czerner
2022-11-08 16:25   ` Darrick J. Wong
2022-11-08 16:52     ` Jan Kara
2022-11-09  9:30     ` Lukas Czerner
2022-11-08 20:03   ` Matthew Wilcox
2022-11-09  1:52   ` kernel test robot
2022-11-09 13:10   ` kernel test robot
2022-11-12  3:29   ` kernel test robot
2022-11-08 13:30 ` [PATCH 2/2] shmem: implement mount options for global quota limits Lukas Czerner
2022-11-08 16:35   ` Darrick J. Wong
2022-11-09  9:02     ` Lukas Czerner
2022-11-08 17:43 ` [PATCH 0/2] [RFC] shmem: user and group quota support for tmpfs Jan Kara
2022-11-09  9:41   ` Lukas Czerner [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20221109094158.c2mubinj7g66iw6e@fedora \
    --to=lczerner@redhat.com \
    --cc=hughd@google.com \
    --cc=jack@suse.com \
    --cc=jack@suse.cz \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=sandeen@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox