linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Kamezawa Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>
To: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	Andrew Morton <akpm@linux-foundation.org>
Cc: Davidlohr Bueso <davidlohr@hp.com>,
	Manfred Spraul <manfred@colorfullife.com>,
	aswin@hp.com, LKML <linux-kernel@vger.kernel.org>,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	"Gotou, Yasunori" <y-goto@jp.fujitsu.com>,
	chenhanxiao <chenhanxiao@cn.fujitsu.com>,
	Gao feng <gaofeng@cn.fujitsu.com>
Subject: Re: [PATCH] ipc,shm: increase default size for shmmax
Date: Wed, 02 Apr 2014 09:11:26 +0900	[thread overview]
Message-ID: <533B55AE.9090906@jp.fujitsu.com> (raw)
In-Reply-To: <CAHGf_=r03QWxw3Jg7BE3z37k4omgo_HRE9qCGw80ngtUD_iEeA@mail.gmail.com>

(2014/04/02 5:15), KOSAKI Motohiro wrote:
>>> Our middleware engineers has been complaining about this sysctl limit.
>>> System administrator need to calculate required sysctl value by making sum
>>> of all planned middlewares, and middleware provider needs to write "please
>>> calculate systcl param by....." in their installation manuals.
>>
>> Why aren't people just setting the sysctl to a petabyte?  What problems
>> would that lead to?
>
> I don't have much Fujitsu middleware knowledges. But I'd like to explain
> very funny bug I saw.
>
> 1. middleware-A suggest to set SHMMAX to very large value (maybe
> LONG_MAX, but my memory was flushed)
> 2. middleware-B suggest to set SHMMAX to increase some dozen mega byte.
>
> Finally, it was overflow and didn't work at all.
>
> Let's demonstrate.
>
> # echo 18446744073709551615 > /proc/sys/kernel/shmmax
> # cat /proc/sys/kernel/shmmax
> 18446744073709551615
> # echo 18446744073709551616 > /proc/sys/kernel/shmmax
> # cat /proc/sys/kernel/shmmax
> 0
>
> That's why many open source software continue the silly game. But
> again, I don't have knowledge about Fujitsu middleware. I'm waiting
> kamezawa-san's answer.
>

Nowadays, Middleware/application are required to be installed automatically without
any admin's operations. But the shmmax tends to be a value which admin needs to modify
by hand after installation. This is not the last one problem, but it is.

I says MW engineers "you, middleware/application, can modify it automatically
as you needed, there will be no pain".

But they tend not to do it. (in my guess) in application writer's way on thinking..
   - If there is a limit by OS, it should have some meaning.
     There may be an unknown, os internal reason which the system admin need to check it.
     For example, os will consume more resource when shmmax is enlarged.
   - If there is a limit by OS, it should be modified by admin.

I guess customer thinks so, too. There is no official information "increasing shmmax
will not cunsume any resource and will not cause any problem in the kernel inside."

Then, admins need to set it. Middleware needs to write "please modify the sysctl
value based on this calculation....." in their manual.

I think the worst problem about this "limit" is that it's hard to explain "why this limit
exists". I need to answer "I guess it's just legacy, hehe...."

Thanks,
-Kame

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  parent reply	other threads:[~2014-04-02  0:12 UTC|newest]

Thread overview: 57+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-03-31  3:06 Davidlohr Bueso
2014-03-31 21:32 ` Andrew Morton
2014-03-31 22:59   ` Davidlohr Bueso
2014-03-31 23:13     ` Andrew Morton
2014-03-31 23:25       ` Davidlohr Bueso
2014-04-01  0:05         ` Andrew Morton
2014-04-01  6:29           ` Kamezawa Hiroyuki
2014-04-01 19:19             ` Andrew Morton
2014-04-01 20:15               ` KOSAKI Motohiro
2014-04-01 20:26                 ` Davidlohr Bueso
2014-04-02  0:11                 ` Kamezawa Hiroyuki [this message]
2014-04-02  1:02               ` Kamezawa Hiroyuki
2014-04-02 14:55               ` One Thousand Gnomes
2014-04-02 23:47                 ` Kamezawa Hiroyuki
2014-04-01 17:01           ` Davidlohr Bueso
2014-04-01 18:10             ` KOSAKI Motohiro
2014-04-01 18:31               ` Davidlohr Bueso
2014-04-01 19:51                 ` KOSAKI Motohiro
2014-04-01 21:01                   ` Davidlohr Bueso
2014-04-01 21:12                     ` KOSAKI Motohiro
2014-04-01 21:29                       ` Andrew Morton
2014-04-01 21:41                         ` KOSAKI Motohiro
2014-04-01 21:48                           ` Andrew Morton
2014-04-01 22:02                             ` Davidlohr Bueso
2014-04-01 22:08                               ` Andrew Morton
2014-04-13 18:05                                 ` Manfred Spraul
2014-04-13 23:15                                   ` Davidlohr Bueso
2014-04-16 22:46                                   ` Andrew Morton
2014-04-16 23:19                                     ` Davidlohr Bueso
2014-04-17 10:41                                     ` Michael Kerrisk
2014-04-17 16:41                                       ` Manfred Spraul
2014-04-17 20:19                                         ` Michael Kerrisk (man-pages)
2014-04-01 22:49                             ` KOSAKI Motohiro
2014-04-01 23:28                               ` Davidlohr Bueso
2014-04-01 23:56                                 ` KOSAKI Motohiro
2014-04-02  0:40                                   ` Davidlohr Bueso
2014-04-02  1:08                                     ` Greg Thelen
2014-04-02  1:58                                       ` Kamezawa Hiroyuki
2014-04-02  2:11                                         ` Greg Thelen
2014-04-03  0:20                                   ` [PATCH] ipc,shm: disable shmmax and shmall by default Davidlohr Bueso
2014-04-03 14:07                                     ` Kamezawa Hiroyuki
2014-04-03 19:02                                     ` Manfred Spraul
2014-04-03 19:50                                       ` Davidlohr Bueso
2014-04-03 23:39                                         ` KOSAKI Motohiro
2014-04-04  5:00                                           ` Davidlohr Bueso
2014-04-05 18:24                                             ` KOSAKI Motohiro
2014-04-06  6:42                                               ` Manfred Spraul
2014-04-06 16:54                                                 ` Davidlohr Bueso
2014-04-03 22:29                                     ` KOSAKI Motohiro
2014-04-03 23:47                                     ` KOSAKI Motohiro
2014-04-11 18:28                                     ` Manfred Spraul
2014-04-11 20:27                                       ` Davidlohr Bueso
2014-04-11 20:48                                         ` Davidlohr Bueso
2014-04-12  8:50                                         ` Manfred Spraul
2014-04-12 15:33                                           ` Davidlohr Bueso
2014-04-01 21:43                       ` [PATCH] ipc,shm: increase default size for shmmax Davidlohr Bueso
2014-04-01 19:26             ` Andrew Morton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=533B55AE.9090906@jp.fujitsu.com \
    --to=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=akpm@linux-foundation.org \
    --cc=aswin@hp.com \
    --cc=chenhanxiao@cn.fujitsu.com \
    --cc=davidlohr@hp.com \
    --cc=gaofeng@cn.fujitsu.com \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=manfred@colorfullife.com \
    --cc=y-goto@jp.fujitsu.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox