David Miller f5c8ad4728 mm: thp: Use more portable PMD clearing sequenece in zap_huge_pmd(). ... Invalidation sequences are handled in various ways on various architectures. One way, which sparc64 uses, is to let the set_*_at() functions accumulate pending flushes into a per-cpu array. Then the flush_tlb_range() et al. calls process the pending TLB flushes. In this regime, the __tlb_remove_*tlb_entry() implementations are essentially NOPs. The canonical PTE zap in mm/memory.c is: ptent = ptep_get_and_clear_full(mm, addr, pte, tlb->fullmm); tlb_remove_tlb_entry(tlb, pte, addr); With a subsequent tlb_flush_mmu() if needed. Mirror this in the THP PMD zapping using: orig_pmd = pmdp_get_and_clear(tlb->mm, addr, pmd); page = pmd_page(orig_pmd); tlb_remove_pmd_tlb_entry(tlb, pmd, addr); And we properly accomodate TLB flush mechanims like the one described above. Signed-off-by: David S. Miller <davem@davemloft.net> Cc: Andrea Arcangeli <aarcange@redhat.com> Cc: Johannes Weiner <hannes@cmpxchg.org> Cc: Gerald Schaefer <gerald.schaefer@de.ibm.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2012-10-09 16:23:06 +09:00
..
backing-dev.c
bootmem.c	mm: fix-up zone present pages	2012-10-09 16:22:54 +09:00
bounce.c
cleancache.c
compaction.c	CMA: migrate mlocked pages	2012-10-09 16:23:00 +09:00
debug-pagealloc.c
dmapool.c
fadvise.c
failslab.c
filemap_xip.c	mm: move all mmu notifier invocations to be done outside the PT lock	2012-10-09 16:22:58 +09:00
filemap.c	readahead: fault retry breaks mmap file read random detection	2012-10-09 16:22:47 +09:00
fremap.c
frontswap.c
highmem.c
huge_memory.c	mm: thp: Use more portable PMD clearing sequenece in zap_huge_pmd().	2012-10-09 16:23:06 +09:00
hugetlb_cgroup.c
hugetlb.c	mm: document PageHuge somewhat	2012-10-09 16:23:03 +09:00
hwpoison-inject.c
init-mm.c
internal.h	mm, thp: fix mlock statistics	2012-10-09 16:23:03 +09:00
interval_tree.c	mm: add CONFIG_DEBUG_VM_RB build option	2012-10-09 16:22:42 +09:00
Kconfig	mm: enable CONFIG_COMPACTION by default	2012-10-09 16:22:53 +09:00
Kconfig.debug
kmemcheck.c
kmemleak-test.c
kmemleak.c
ksm.c	mm: wrap calls to set_pte_at_notify with invalidate_range_start and invalidate_range_end	2012-10-09 16:22:58 +09:00
maccess.c
madvise.c
Makefile
memblock.c	mm: avoid section mismatch warning for memblock_type_name	2012-10-09 16:23:01 +09:00
memcontrol.c	memcg: move mem_cgroup_is_root upwards	2012-10-09 16:22:55 +09:00
memory_hotplug.c	memory-hotplug: suppress "Trying to free nonexistent resource <XXXXXXXXXXXXXXXX-YYYYYYYYYYYYYYYY>" warning	2012-10-09 16:23:04 +09:00
memory-failure.c	mm anon rmap: replace same_anon_vma linked list with an interval tree.	2012-10-09 16:22:41 +09:00
memory.c	mm, thp: fix mapped pages avoiding unevictable list on mlock	2012-10-09 16:23:02 +09:00
mempolicy.c	mm: revert 0def08e3 ("mm/mempolicy.c: check return code of check_range")	2012-10-09 16:22:58 +09:00
mempool.c
migrate.c
mincore.c
mlock.c	mm, thp: fix mlock statistics	2012-10-09 16:23:03 +09:00
mm_init.c
mmap.c	mm: avoid taking rmap locks in move_ptes()	2012-10-09 16:22:42 +09:00
mmu_context.c
mmu_notifier.c	mm: wrap calls to set_pte_at_notify with invalidate_range_start and invalidate_range_end	2012-10-09 16:22:58 +09:00
mmzone.c
mprotect.c
mremap.c	mm: move all mmu notifier invocations to be done outside the PT lock	2012-10-09 16:22:58 +09:00
msync.c
nobootmem.c	mm: fix-up zone present pages	2012-10-09 16:22:54 +09:00
nommu.c
oom_kill.c
page_alloc.c	cma: decrease cc.nr_migratepages after reclaiming pagelist	2012-10-09 16:23:01 +09:00
page_cgroup.c
page_io.c
page_isolation.c	mm/page_alloc: refactor out __alloc_contig_migrate_alloc()	2012-10-09 16:22:52 +09:00
page-writeback.c
pagewalk.c
percpu-km.c
percpu-vm.c
percpu.c
pgtable-generic.c
process_vm_access.c
quicklist.c
readahead.c
rmap.c	mm: move all mmu notifier invocations to be done outside the PT lock	2012-10-09 16:22:58 +09:00
shmem.c
slab_common.c
slab.c
slab.h
slob.c
slub.c
sparse-vmemmap.c
sparse.c
swap_state.c
swap.c	mm: remove vma arg from page_evictable	2012-10-09 16:22:55 +09:00
swapfile.c
truncate.c	mm: use clear_page_mlock() in page_remove_rmap()	2012-10-09 16:22:56 +09:00
util.c
vmalloc.c	mm: use %pK for /proc/vmallocinfo	2012-10-09 16:23:03 +09:00
vmscan.c	CMA: migrate mlocked pages	2012-10-09 16:23:00 +09:00
vmstat.c	mm: remove unevictable_pgs_mlockfreed	2012-10-09 16:22:59 +09:00