Alex Shi d8dfe60d6d x86/tlb: fall back to flush all when meet a THP large page ... We don't need to flush large pages by PAGE_SIZE step, that just waste time. and actually, large page don't need 'invlpg' optimizing according to our micro benchmark. So, just flush whole TLB is enough for them. The following result is tested on a 2CPU * 4cores * 2HT NHM EP machine, with THP 'always' setting. Multi-thread testing, '-t' paramter is thread number: without this patch with this patch ./mprotect -t 1 14ns 13ns ./mprotect -t 2 13ns 13ns ./mprotect -t 4 12ns 11ns ./mprotect -t 8 14ns 10ns ./mprotect -t 16 28ns 28ns ./mprotect -t 32 54ns 52ns ./mprotect -t 128 200ns 200ns Signed-off-by: Alex Shi <alex.shi@intel.com> Link: http://lkml.kernel.org/r/1340845344-27557-4-git-send-email-alex.shi@intel.com Signed-off-by: H. Peter Anvin <hpa@zytor.com>		2012-06-27 19:29:09 -07:00
..
kmemcheck	bug.h: add include of it to various implicit C users	2012-02-29 17:15:08 -05:00
amdtopology.c	x86, NUMA: Enable CONFIG_AMD_NUMA on 32bit too	2011-05-02 17:24:48 +02:00
dump_pagetables.c	x86, mm: Create symbolic index into address_markers array	2010-07-20 16:56:19 -07:00
extable.c	x86, extable: Switch to relative exception table entries	2012-04-20 17:22:34 -07:00
fault.c	userns: Store uid and gid values in struct cred with kuid_t and kgid_t types	2012-05-03 03:28:38 -07:00
gup.c	thp: add compound tail page _mapcount when mapped	2011-12-09 07:50:28 -08:00
highmem_32.c	highmem: kill all __kmap_atomic()	2012-03-20 21:48:30 +08:00
hugetlbpage.c	hugetlb: remove prev_vma from hugetlb_get_unmapped_area_topdown()	2012-03-21 17:54:59 -07:00
init_32.c	Disintegrate asm/system.h for X86	2012-03-28 18:11:12 +01:00
init_64.c	Merge branch 'x86-mm-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2012-05-23 11:06:59 -07:00
init.c	x86/mm: Only add extra pages count for the first memory range during pre-allocation early page table space	2012-06-08 11:40:50 +02:00
iomap_32.c	mm: fix race in kunmap_atomic()	2010-10-27 18:03:05 -07:00
ioremap.c	ioremap: Delay sanity check until after a successful mapping	2011-04-29 08:02:47 +02:00
kmmio.c	x86, kmmio/mmiotrace: Fix double free of kmmio_fault_pages	2010-06-18 11:30:09 +02:00
Makefile	memblock, x86: Replace memblock_x86_reserve/free_range() with generic ones	2011-07-14 11:47:53 -07:00
memtest.c	memblock, x86: Replace memblock_x86_reserve/free_range() with generic ones	2011-07-14 11:47:53 -07:00
mmap.c	x86: Fix mmap random address range	2011-12-05 17:07:23 +01:00
mmio-mod.c	module_param: make bool parameters really bool (arch)	2012-01-13 09:32:18 +10:30
numa_32.c	memblock, x86: Replace memblock_x86_reserve/free_range() with generic ones	2011-07-14 11:47:53 -07:00
numa_64.c	memblock, x86: Make free_all_memory_core_early() explicitly free lowmem only	2011-07-14 11:47:49 -07:00
numa_emulation.c	x86: print physical addresses consistently with other parts of kernel	2012-05-29 16:22:21 -07:00
numa_internal.h	x86, NUMA: Initialize and use remap allocator from setup_node_bootmem()	2011-05-02 14:18:54 +02:00
numa.c	x86: print physical addresses consistently with other parts of kernel	2012-05-29 16:22:21 -07:00
pageattr-test.c	x86: Convert vmalloc()+memset() to vzalloc()	2011-05-28 19:53:57 +02:00
pageattr.c	Merge branch 'x86-mm-for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip	2012-01-11 19:12:10 -08:00
pat_internal.h	x86, pat: Fix memory leak in free_memtype	2010-05-26 11:26:04 -07:00
pat_rbtree.c	rbtree: Undo augmented trees performance damage and regression	2010-07-05 14:43:50 +02:00
pat.c	Merge branch 'x86/trampoline' into x86/urgent	2012-05-30 12:11:32 -07:00
pf_in.c	x86: Eliminate various 'set but not used' warnings	2011-05-21 19:10:33 +02:00
pf_in.h	x86 mmiotrace: move files into arch/x86/mm/.	2008-05-24 11:25:37 +02:00
pgtable_32.c	Disintegrate asm/system.h for X86	2012-03-28 18:11:12 +01:00
pgtable.c	x86: Flush TLB if PGD entry is changed in i386 PAE mode	2011-03-18 11:44:01 +01:00
physaddr.c	x86: split __phys_addr out into separate file	2009-09-10 11:48:55 -07:00
physaddr.h	x86: split __phys_addr out into separate file	2009-09-10 11:48:55 -07:00
setup_nx.c	x86, cpu: Only CPU features determine NX capabilities	2010-11-10 15:43:15 -08:00
srat.c	x86/numa: Set numa_nodes_parsed at acpi_numa_memory_affinity_init()	2012-06-06 11:58:39 +02:00
testmmiotrace.c	x86, kmmio/mmiotrace: Fix double free of kmmio_fault_pages	2010-06-18 11:30:09 +02:00
tlb.c	x86/tlb: fall back to flush all when meet a THP large page	2012-06-27 19:29:09 -07:00