Lee Schermerhorn fc36b8d3d8 mempolicy: use MPOL_F_LOCAL to Indicate Preferred Local Policy ... Now that we're using "preferred local" policy for system default, we need to make this as fast as possible. Because of the variable size of the mempolicy structure [based on size of nodemasks], the preferred_node may be in a different cacheline from the mode. This can result in accessing an extra cacheline in the normal case of system default policy. Suspect this is the cause of an observed 2-3% slowdown in page fault testing relative to kernel without this patch series. To alleviate this, use an internal mode flag, MPOL_F_LOCAL in the mempolicy flags member which is guaranteed [?] to be in the same cacheline as the mode itself. Verified that reworked mempolicy now performs slightly better on 25-rc8-mm1 for both anon and shmem segments with system default and vma [preferred local] policy. Signed-off-by: Lee Schermerhorn <lee.schermerhorn@hp.com> Cc: Christoph Lameter <clameter@sgi.com> Cc: David Rientjes <rientjes@google.com> Cc: Mel Gorman <mel@csn.ul.ie> Cc: Andi Kleen <ak@suse.de> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2008-04-28 08:58:24 -07:00
..
allocpercpu.c	cpumask: Cleanup more uses of CPU_MASK and NODE_MASK	2008-04-19 19:44:58 +02:00
backing-dev.c	mm/backing-dev.c: fix percpu_counter_destroy call bug in bdi_init	2007-12-05 09:21:18 -08:00
bootmem.c	mm: allow reserve_bootmem() cross nodes	2008-04-26 22:51:08 +02:00
bounce.c	block: Initial support for data-less (or empty) barrier support	2007-10-16 11:03:56 +02:00
dmapool.c	dmapool: enable debugging for CONFIG_SLUB_DEBUG_ON too	2008-04-28 08:58:20 -07:00
fadvise.c	xip: support non-struct page backed memory	2008-04-28 08:58:23 -07:00
filemap_xip.c	xip: support non-struct page backed memory	2008-04-28 08:58:23 -07:00
filemap.c	mm: rotate_reclaimable_page() cleanup	2008-04-28 08:58:20 -07:00
fremap.c	mm: fix various kernel-doc comments	2008-03-19 18:53:35 -07:00
highmem.c	mm: highmem kernel-doc additions	2008-03-19 18:53:35 -07:00
hugetlb.c	mempolicy: rework mempolicy Reference Counting [yet again]	2008-04-28 08:58:24 -07:00
internal.h	Solve section mismatch for free_area_init_core.	2008-02-23 17:13:24 -08:00
Kconfig	PAGEFLAGS_EXTENDED and separate page flags for Head and Tail	2008-04-28 08:58:22 -07:00
maccess.c	kgdb: fix optional arch functions and probe_kernel_*	2008-04-17 20:05:39 +02:00
madvise.c	xip: support non-struct page backed memory	2008-04-28 08:58:23 -07:00
Makefile	uaccess: add probe_kernel_write()	2008-04-17 20:05:36 +02:00
memcontrol.c	memcg: fix node_state handling	2008-04-08 18:25:53 -07:00
memory_hotplug.c	hotplug-memory: make online_page() common	2008-04-28 08:58:17 -07:00
memory.c	mm: add vm_insert_mixed	2008-04-28 08:58:23 -07:00
mempolicy.c	mempolicy: use MPOL_F_LOCAL to Indicate Preferred Local Policy	2008-04-28 08:58:24 -07:00
mempool.c	spelling fixes: mm/	2007-10-20 01:27:18 +02:00
migrate.c	memcg: fix VM_BUG_ON from page migration	2008-03-04 16:35:14 -08:00
mincore.c	mm: remove nopage	2008-04-28 08:58:18 -07:00
mlock.c	do not limit locked memory when RLIMIT_MEMLOCK is RLIM_INFINITY	2007-07-16 09:05:37 -07:00
mmap.c	mempolicy: rename mpol_copy to mpol_dup	2008-04-28 08:58:23 -07:00
mmzone.c	mm: filter based on a nodemask as well as a gfp_mask	2008-04-28 08:58:19 -07:00
mprotect.c	fix mprotect vma_wants_writenotify prot	2007-10-23 08:32:06 -07:00
mremap.c	sparse pointer use of zero as null	2007-10-18 14:37:31 -07:00
msync.c	Detach sched.h from mm.h	2007-05-21 09:18:19 -07:00
nommu.c	nommu: add new vmalloc_user() and remap_vmalloc_range() interfaces.	2008-02-05 09:44:21 -08:00
oom_kill.c	mm: have zonelist contains structs with both a zone pointer and zone_idx	2008-04-28 08:58:18 -07:00
page_alloc.c	pageflags: eliminate PG_xxx aliases	2008-04-28 08:58:22 -07:00
page_io.c	mm: fix PageUptodate data race	2008-02-05 09:44:19 -08:00
page_isolation.c	memory hotremove: unset migrate type "ISOLATE" after removal	2007-11-14 18:45:38 -08:00
page-writeback.c	writeback: speed up writeback of big dirty files	2008-02-05 09:44:19 -08:00
pagewalk.c	mm: fix possible off-by-one in walk_pte_range()	2008-04-28 08:58:16 -07:00
pdflush.c	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/juhl/trivial	2008-04-21 16:36:46 -07:00
prio_tree.c	spelling fixes: mm/	2007-10-20 01:27:18 +02:00
quicklist.c	quicklists: Only consider memory that can be used with GFP_KERNEL	2008-01-14 08:52:22 -08:00
readahead.c	mm/readahead: fix kernel-doc notation	2008-03-19 18:53:37 -07:00
rmap.c	mm: remove nopage	2008-04-28 08:58:18 -07:00
shmem_acl.c	[PATCH] Fix typos in mm/shmem_acl.c	2006-10-11 11:14:23 -07:00
shmem.c	mempolicy: rework mempolicy Reference Counting [yet again]	2008-04-28 08:58:24 -07:00
slab.c	mm: move cache_line_size() to <linux/cache.h>	2008-04-28 08:58:19 -07:00
slob.c	slob: reduce external fragmentation by using three free lists	2008-02-05 09:44:19 -08:00
slub.c	mm: move cache_line_size() to <linux/cache.h>	2008-04-28 08:58:19 -07:00
sparse-vmemmap.c	NULL noise: fs/*, mm/*, kernel/*	2008-03-30 14:18:41 -07:00
sparse.c	hotplug memory remove: generic __remove_pages() support	2008-04-28 08:58:17 -07:00
swap_state.c	mm: fix various kernel-doc comments	2008-03-19 18:53:35 -07:00
swap.c	mm: rotate_reclaimable_page() cleanup	2008-04-28 08:58:20 -07:00
swapfile.c	mm: try both endianess when checking for endianess	2008-04-28 08:58:19 -07:00
thrash.c	Bug in mm/thrash.c function grab_swap_token()	2007-05-11 08:29:32 -07:00
tiny-shmem.c	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs-2.6	2008-03-25 08:57:47 -07:00
truncate.c	fix invalidate_inode_pages2_range() to not clear ret	2008-04-28 08:58:18 -07:00
util.c	fix mm/util.c:krealloc()	2007-11-14 18:45:41 -08:00
vmalloc.c	vmallocinfo: add caller information	2008-04-28 08:58:21 -07:00
vmscan.c	mm: have zonelist contains structs with both a zone pointer and zone_idx	2008-04-28 08:58:18 -07:00
vmstat.c	Subject: [PATCH] hugetlb: vmstat events for huge page allocations	2008-04-28 08:58:23 -07:00