Re: [patch 00/14] NUMA: Memoryless node support V3

Re: [patch 00/14] NUMA: Memoryless node support V3

[Nishanth Aravamudan]

On 03.08.2007 [20:01:00 -0700], Christoph Lameter wrote:
> V4->V5
> - Split N_MEMORY into N_NORMAL_MEMORY and N_HIGH_MEMORY to support
>   32 bit NUMA.
> - Mel tested it on 32bit NUMA
> - !NUMA Fixes
> - Tested on SMP and UP.
> 
> V3->V4 (by Lee)
> - Add fixes and testing.
> 
> V2->V3
> - Refresh patches (sigh)
> - Add comments suggested by Kamezawa Hiroyuki
> - Add signoff by Jes Sorensen
> 
> V1->V2
> - Add a generic layer that allows the definition of additional node bitmaps
> 
> This patchset is implementing additional node bitmaps that allow the system
> to track nodes that are online without memory and nodes that have processors.
> 
> Note that this patch is only the beginning. All code portions that assume that
> an online node has memory must be changed to use either N_NORMAL_MEMORY or
> N_HIGH_MEMORY.

I believe Andrew should drop the 9 memoryless node patches he had picked
up and take these instead. The NORMAL_MEMORY/HIGH_MEMORY distinction is
critical for booting 32-bit NUMA. I've rebased my stack of hugetlb
related patches on top of these and am testing now.

Thanks,
Nish

-- 
Nishanth Aravamudan <nacc@us.ibm.com>
IBM Linux Technology Center

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

Re: [patch 02/14] Memoryless nodes: introduce mask of nodes with memory

[Andrew Morton]

On Fri, 03 Aug 2007 20:01:02 -0700
Christoph Lameter <clameter@sgi.com> wrote:

> +/* Any regular memory on that node ? */
> +static void check_for_regular_memory(pg_data_t *pgdat)
> +{
> +#ifdef CONFIG_HIGHMEM
> +	enum zone_type zone;
> +
> +	for (zone = 0; zone <= ZONE_NORMAL; zone++)
> +		if (pgdat->node_zones[zone].present_pages)
> +			node_set_state(nid, N_NORMAL_MEMORY);
> +	}
> +#endif
> +}

mm/page_alloc.c: In function 'check_for_regular_memory':
mm/page_alloc.c:2427: error: 'nid' undeclared (first use in this function)
mm/page_alloc.c:2427: error: (Each undeclared identifier is reported only once
mm/page_alloc.c:2427: error: for each function it appears in.)
mm/page_alloc.c: At top level:
mm/page_alloc.c:2430: error: expected identifier or '(' before '}' token

OK, easily fixable with

/* Any regular memory on that node ? */
static void check_for_regular_memory(pg_data_t *pgdat)
{
#ifdef CONFIG_HIGHMEM
	enum zone_type zone_type;
	
	for (zone_type = 0; zone_type <= ZONE_NORMAL; zone_type++) {
		struct zone *zone = &pgdat->node_zones[zone_type];
		if (zone->present_pages)
			node_set_state(zone_to_nid(zone), N_NORMAL_MEMORY);
	}
#endif
}

but we continue to have some significant testing issues out there.		

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

Re: [patch 02/14] Memoryless nodes: introduce mask of nodes with memory

[Nishanth Aravamudan]

On 08.08.2007 [12:38:04 -0700], Andrew Morton wrote:
> On Fri, 03 Aug 2007 20:01:02 -0700
> Christoph Lameter <clameter@sgi.com> wrote:
> 
> > +/* Any regular memory on that node ? */
> > +static void check_for_regular_memory(pg_data_t *pgdat)
> > +{
> > +#ifdef CONFIG_HIGHMEM
> > +	enum zone_type zone;
> > +
> > +	for (zone = 0; zone <= ZONE_NORMAL; zone++)
> > +		if (pgdat->node_zones[zone].present_pages)
> > +			node_set_state(nid, N_NORMAL_MEMORY);
> > +	}
> > +#endif
> > +}
> 
> mm/page_alloc.c: In function 'check_for_regular_memory':
> mm/page_alloc.c:2427: error: 'nid' undeclared (first use in this function)
> mm/page_alloc.c:2427: error: (Each undeclared identifier is reported only once
> mm/page_alloc.c:2427: error: for each function it appears in.)
> mm/page_alloc.c: At top level:
> mm/page_alloc.c:2430: error: expected identifier or '(' before '}' token
> 
> OK, easily fixable with
> 
> /* Any regular memory on that node ? */
> static void check_for_regular_memory(pg_data_t *pgdat)
> {
> #ifdef CONFIG_HIGHMEM
> 	enum zone_type zone_type;
> 	
> 	for (zone_type = 0; zone_type <= ZONE_NORMAL; zone_type++) {
> 		struct zone *zone = &pgdat->node_zones[zone_type];
> 		if (zone->present_pages)
> 			node_set_state(zone_to_nid(zone), N_NORMAL_MEMORY);
> 	}
> #endif
> }
> 
> but we continue to have some significant testing issues out there.		

This would be because the patch that Christoph submitted here is not the
same as the patch that Mel and I tested...There was no
check_for_regular_memory() function in the kernels I was building.

Thanks,
Nish

-- 
Nishanth Aravamudan <nacc@us.ibm.com>
IBM Linux Technology Center

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

Re: [patch 02/14] Memoryless nodes: introduce mask of nodes with memory

[Nishanth Aravamudan]

On 08.08.2007 [12:55:14 -0700], Nishanth Aravamudan wrote:
> On 08.08.2007 [12:38:04 -0700], Andrew Morton wrote:
> > On Fri, 03 Aug 2007 20:01:02 -0700
> > Christoph Lameter <clameter@sgi.com> wrote:
> > 
> > > +/* Any regular memory on that node ? */
> > > +static void check_for_regular_memory(pg_data_t *pgdat)
> > > +{
> > > +#ifdef CONFIG_HIGHMEM
> > > +	enum zone_type zone;
> > > +
> > > +	for (zone = 0; zone <= ZONE_NORMAL; zone++)
> > > +		if (pgdat->node_zones[zone].present_pages)
> > > +			node_set_state(nid, N_NORMAL_MEMORY);
> > > +	}
> > > +#endif
> > > +}
> > 
> > mm/page_alloc.c: In function 'check_for_regular_memory':
> > mm/page_alloc.c:2427: error: 'nid' undeclared (first use in this function)
> > mm/page_alloc.c:2427: error: (Each undeclared identifier is reported only once
> > mm/page_alloc.c:2427: error: for each function it appears in.)
> > mm/page_alloc.c: At top level:
> > mm/page_alloc.c:2430: error: expected identifier or '(' before '}' token
> > 
> > OK, easily fixable with
> > 
> > /* Any regular memory on that node ? */
> > static void check_for_regular_memory(pg_data_t *pgdat)
> > {
> > #ifdef CONFIG_HIGHMEM
> > 	enum zone_type zone_type;
> > 	
> > 	for (zone_type = 0; zone_type <= ZONE_NORMAL; zone_type++) {
> > 		struct zone *zone = &pgdat->node_zones[zone_type];
> > 		if (zone->present_pages)
> > 			node_set_state(zone_to_nid(zone), N_NORMAL_MEMORY);
> > 	}
> > #endif
> > }
> > 
> > but we continue to have some significant testing issues out there.		
> 
> This would be because the patch that Christoph submitted here is not the
> same as the patch that Mel and I tested...There was no
> check_for_regular_memory() function in the kernels I was building.

To try and remedy this -- I'll regrab this stack and rebase my patches
again. Test everything and resubmit mine.

Thanks,
Nish

-- 
Nishanth Aravamudan <nacc@us.ibm.com>
IBM Linux Technology Center

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

Re: [patch 02/14] Memoryless nodes: introduce mask of nodes with memory

[Christoph Lameter]

On Wed, 8 Aug 2007, Nishanth Aravamudan wrote:

> > but we continue to have some significant testing issues out there.		
> 
> This would be because the patch that Christoph submitted here is not the
> same as the patch that Mel and I tested...There was no
> check_for_regular_memory() function in the kernels I was building.

Right. I added that to #ifdef out the HIGHMEM/NORMAL distinction for 
regular NUMA boxes. I only tested on regular NUMA and not on NUMAQ.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

Re: [patch 02/14] Memoryless nodes: introduce mask of nodes with memory

[Christoph Lameter]

On Wed, 8 Aug 2007, Nishanth Aravamudan wrote:

> To try and remedy this -- I'll regrab this stack and rebase my patches
> again. Test everything and resubmit mine.

Ummmm... These are the patches that you said you would test earlier.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

Re: [patch 02/14] Memoryless nodes: introduce mask of nodes with memory

[Nishanth Aravamudan]

On 08.08.2007 [13:05:12 -0700], Christoph Lameter wrote:
> On Wed, 8 Aug 2007, Nishanth Aravamudan wrote:
> 
> > To try and remedy this -- I'll regrab this stack and rebase my patches
> > again. Test everything and resubmit mine.
> 
> Ummmm... These are the patches that you said you would test earlier.

Yes, sorry, I had leafed through the patches and didn't see any changes
and didn't see any subject changes indicated UPDATED or a new version,
so I incorrectly assumed that the patches were the same as before.

This stack has now been successfully compile & boot-tested on:

4-node x86 (NUMAQ), 1-node x86 (NUMAQ), !NUMA x86, 2-node IA64, 4-node
ppc64 (2 memoryless nodes).

Thanks,
Nish

-- 
Nishanth Aravamudan <nacc@us.ibm.com>
IBM Linux Technology Center

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>