linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
* Re: Numa Node Swapping
       [not found] <20041103132852.GC5203@linuxtx.org>
@ 2004-11-03 16:23 ` Christoph Lameter
  0 siblings, 0 replies; only message in thread
From: Christoph Lameter @ 2004-11-03 16:23 UTC (permalink / raw)
  To: Justin M. Forbes; +Cc: linux-mm

On Wed, 3 Nov 2004, Justin M. Forbes wrote:

> I am interested in the numa node swapping patches you have been working
> with, and what test code you were running.  What size was the anonymous
> allocation you are doing in relationship to the amount of memory per node?

Here is the script that I ran:

----------------------------------------------------------------------------------
echo "Off Node memory allocation test"
echo "-------------------------------"
uname -a
echo "Initial state:"
echo "--------------"
cat /sys/devices/system/node/node{2,3}/{meminfo,numastat}
echo
time taskset 20 dd if=/mnt/1gb of=/dev/null
echo
echo "State after copying 1gb file"
echo "----------------------------"
cat /sys/devices/system/node/node{2,3}/{meminfo,numastat}
time taskset 20 ./fatmem
echo "State after running 500Mb memalloc program"
echo "------------------------------------------"
cat /sys/devices/system/node/node{2,3}/{meminfo,numastat}
------------------------------------------------------------------------------------

fatmem allocates large section of memory and touches every page.

The output of a test run with /proc/sys/vm/node_swap set to 3:

Off Node memory allocation test
-------------------------------
Linux margin 2.6.10-rc1-ptoss #3 SMP Thu Oct 28 10:18:36 PDT 2004 ia64 ia64 ia64 GNU/Linux
Initial state:
--------------

Node 2 MemTotal:       933888 kB
Node 2 MemFree:        899840 kB
Node 2 MemUsed:         34048 kB
Node 2 Active:           5376 kB
Node 2 Inactive:         3712 kB
Node 2 HighTotal:           0 kB
Node 2 HighFree:            0 kB
Node 2 LowTotal:       933888 kB
Node 2 LowFree:        899840 kB
Node 2 HugePages_Total:     0
Node 2 HugePages_Free:      0
numa_hit 108398
numa_miss 0
numa_foreign 0
interleave_hit 85023
local_node 43887
other_node 64511

Node 3 MemTotal:       915696 kB
Node 3 MemFree:        883072 kB
Node 3 MemUsed:         32624 kB
Node 3 Active:           5904 kB
Node 3 Inactive:         3200 kB
Node 3 HighTotal:           0 kB
Node 3 HighFree:            0 kB
Node 3 LowTotal:       915696 kB
Node 3 LowFree:        883072 kB
Node 3 HugePages_Total:     0
Node 3 HugePages_Free:      0
numa_hit 143416
numa_miss 0
numa_foreign 0
interleave_hit 125500
local_node 48305
other_node 95111


State after copying 1gb file
----------------------------

Node 2 MemTotal:       933888 kB
Node 2 MemFree:          2816 kB
Node 2 MemUsed:        931072 kB
Node 2 Active:           1744 kB
Node 2 Inactive:       903536 kB
Node 2 HighTotal:           0 kB
Node 2 HighFree:            0 kB
Node 2 LowTotal:       933888 kB
Node 2 LowFree:          2816 kB
Node 2 HugePages_Total:     0
Node 2 HugePages_Free:      0
numa_hit 170992
numa_miss 0
numa_foreign 0
interleave_hit 85024
local_node 106480
other_node 64512

Node 3 MemTotal:       915696 kB
Node 3 MemFree:        883072 kB
Node 3 MemUsed:         32624 kB
Node 3 Active:           5904 kB
Node 3 Inactive:         3200 kB
Node 3 HighTotal:           0 kB
Node 3 HighFree:            0 kB
Node 3 LowTotal:       915696 kB
Node 3 LowFree:        883072 kB
Node 3 HugePages_Total:     0
Node 3 HugePages_Free:      0
numa_hit 143434
numa_miss 0
numa_foreign 0
interleave_hit 125502
local_node 48321
other_node 95113
State after running 500Mb memalloc program
------------------------------------------

Node 2 MemTotal:       933888 kB
Node 2 MemFree:        488160 kB
Node 2 MemUsed:        445728 kB
Node 2 Active:           1824 kB
Node 2 Inactive:       418048 kB
Node 2 HighTotal:           0 kB
Node 2 HighFree:            0 kB
Node 2 LowTotal:       933888 kB
Node 2 LowFree:        488160 kB
Node 2 HugePages_Total:     0
Node 2 HugePages_Free:      0
numa_hit 201401
numa_miss 0
numa_foreign 2429
interleave_hit 85024
local_node 136889
other_node 64512

Node 3 MemTotal:       915696 kB
Node 3 MemFree:        883136 kB
Node 3 MemUsed:         32560 kB
Node 3 Active:           5872 kB
Node 3 Inactive:         3200 kB
Node 3 HighTotal:           0 kB
Node 3 HighFree:            0 kB
Node 3 LowTotal:       915696 kB
Node 3 LowFree:        883136 kB
Node 3 HugePages_Total:     0
Node 3 HugePages_Free:      0
numa_hit 143434
numa_miss 2429
numa_foreign 0
interleave_hit 125502
local_node 48321
other_node 97542
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"aart@kvack.org"> aart@kvack.org </a>

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2004-11-03 16:23 UTC | newest]

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <20041103132852.GC5203@linuxtx.org>
2004-11-03 16:23 ` Numa Node Swapping Christoph Lameter

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox