Jason Baron 67347fe4e6 epoll: do not take global 'epmutex' for simple topologies ... When calling EPOLL_CTL_ADD for an epoll file descriptor that is attached directly to a wakeup source, we do not need to take the global 'epmutex', unless the epoll file descriptor is nested. The purpose of taking the 'epmutex' on add is to prevent complex topologies such as loops and deep wakeup paths from forming in parallel through multiple EPOLL_CTL_ADD operations. However, for the simple case of an epoll file descriptor attached directly to a wakeup source (with no nesting), we do not need to hold the 'epmutex'. This patch along with 'epoll: optimize EPOLL_CTL_DEL using rcu' improves scalability on larger systems. Quoting Nathan Zimmer's mail on SPECjbb performance: "On the 16 socket run the performance went from 35k jOPS to 125k jOPS. In addition the benchmark when from scaling well on 10 sockets to scaling well on just over 40 sockets. ... Currently the benchmark stops scaling at around 40-44 sockets but it seems like I found a second unrelated bottleneck." [akpm@linux-foundation.org: use `bool' for boolean variables, remove unneeded/undesirable cast of void*, add missed ep_scan_ready_list() kerneldoc] Signed-off-by: Jason Baron <jbaron@akamai.com> Tested-by: Nathan Zimmer <nzimmer@sgi.com> Cc: Eric Wong <normalperson@yhbt.net> Cc: Nelson Elhage <nelhage@nelhage.com> Cc: Al Viro <viro@zeniv.linux.org.uk> Cc: Davide Libenzi <davidel@xmailserver.org> Cc: "Paul E. McKenney" <paulmck@us.ibm.com> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org>		2013-11-13 12:09:25 +09:00
..
9p	FS-Cache: Provide the ability to enable/disable cookies	2013-09-27 18:40:25 +01:00
adfs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
affs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
afs	Merge branch 'fscache' of git://git.kernel.org/pub/scm/linux/kernel/git/dhowells/linux-fs into linux-next	2013-10-28 19:36:46 -04:00
autofs4	autofs4: close the races around autofs4_notify_daemon()	2013-09-16 19:16:38 -04:00
befs
bfs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
btrfs	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs	2013-10-18 16:46:21 -07:00
cachefiles	FS-Cache: Provide the ability to enable/disable cookies	2013-09-27 18:40:25 +01:00
ceph	FS-Cache: Provide the ability to enable/disable cookies	2013-09-27 18:40:25 +01:00
cifs	Merge branch 'for-linus' of git://git.samba.org/sfrench/cifs-2.6	2013-11-08 06:01:47 +09:00
coda
configfs
cramfs	cramfs: mark as obsolete	2013-11-13 12:09:12 +09:00
debugfs	debugfs: use list_next_entry() in debugfs_remove_recursive()	2013-11-13 12:09:24 +09:00
devpts
dlm
ecryptfs	eCryptfs: fix 32 bit corruption issue	2013-10-24 12:36:30 -07:00
efivarfs
efs
exofs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
exportfs
ext2	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
ext3	ext[34]: fix double put in tmpfile	2013-10-15 12:14:06 -04:00
ext4	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs	2013-10-16 17:18:18 -07:00
f2fs
fat	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
freevxfs
fscache	FS-Cache: Provide the ability to enable/disable cookies	2013-09-27 18:40:25 +01:00
fuse	fuse: no RCU mode in fuse_access()	2013-10-01 16:41:23 +02:00
gfs2	The main feature of interest this time is quota updates. There are	2013-11-11 07:11:00 +09:00
hfs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
hfsplus	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
hostfs
hpfs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
hppfs
hugetlbfs
isofs
jbd
jbd2
jffs2
jfs	Just a patch to fix an oops in an error path.	2013-10-22 09:01:11 +01:00
lockd
logfs
minix	fs/minix: Drop dependency on H8300	2013-09-16 18:20:25 -07:00
ncpfs
nfs	NFSv4.2: Remove redundant checks in nfs_setsecurity+nfs4_label_init_security	2013-11-04 16:42:52 -05:00
nfs_common
nfsd	Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs	2013-09-12 15:01:38 -07:00
nilfs2	nilfs2: fix issue with race condition of competition between segments for dirty blocks	2013-09-30 14:31:02 -07:00
nls
notify
ntfs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
ocfs2	ocfs2: simplify ocfs2_invalidatepage() and ocfs2_releasepage()	2013-11-13 12:09:02 +09:00
omfs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
openpromfs
proc	mm: factor commit limit calculation	2013-11-13 12:09:11 +09:00
pstore	pstore: Remove the messages related to compression failure	2013-09-16 09:28:29 -07:00
qnx4
qnx6
quota
ramfs	initmpfs: move rootfs code from fs/ramfs/ to init/	2013-09-11 15:59:37 -07:00
reiserfs	reiserfs: fix race with flush_used_journal_lists and flush_journal_list	2013-09-24 11:24:21 +02:00
romfs
squashfs
sysfs	Revert "sysfs: drop kobj_ns_type handling"	2013-11-07 20:47:28 +09:00
sysv	sysv: Add forgotten superblock lock init for v7 fs	2013-09-29 22:02:02 -04:00
ubifs	Just one patch which fixes the power-cut recovery testing mode.	2013-09-16 15:36:55 -04:00
udf	udf: Fortify LVID loading	2013-09-24 11:23:33 +02:00
ufs	truncate: drop 'oldsize' truncate_pagecache() parameter	2013-09-12 15:38:02 -07:00
xfs	writeback: do not sync data dirtied after sync start	2013-11-13 12:09:07 +09:00
aio.c	aio: fix use-after-free in aio_migratepage	2013-09-26 20:34:51 -04:00
anon_inodes.c
attr.c
bad_inode.c
binfmt_aout.c
binfmt_elf_fdpic.c
binfmt_elf.c	fs/binfmt_elf.c: prevent a coredump with a large vm_map_count from Oopsing	2013-09-30 14:31:01 -07:00
binfmt_em86.c
binfmt_flat.c
binfmt_misc.c
binfmt_script.c
binfmt_som.c
bio-integrity.c	Merge branch 'for-3.12/core' of git://git.kernel.dk/linux-block	2013-09-22 15:00:11 -07:00
bio.c	block: Fix bio_copy_data()	2013-09-24 14:41:42 -07:00
block_dev.c	a trivial writeback fix	2013-09-13 23:06:40 -04:00
buffer.c	fs: buffer: move allocation failure loop into the allocator	2013-10-16 21:35:53 -07:00
char_dev.c
compat_binfmt_elf.c
compat_ioctl.c
compat.c
coredump.c	coredump: add new %P variable in core_pattern	2013-09-11 15:59:01 -07:00
coredump.h
dcache.c	vfs: decrapify dput(), fix cache behavior under normal load	2013-10-31 15:43:02 -07:00
dcookies.c
direct-io.c
drop_caches.c
eventfd.c
eventpoll.c	epoll: do not take global 'epmutex' for simple topologies	2013-11-13 12:09:25 +09:00
exec.c	sched/numa: Call task_numa_free() from do_execve()	2013-10-09 14:48:00 +02:00
fcntl.c
fhandle.c
file_table.c	nfsd regression since delayed fput()	2013-10-20 08:44:39 -04:00
file.c
filesystems.c
fs_struct.c
fs-writeback.c	writeback: do not sync data dirtied after sync start	2013-11-13 12:09:07 +09:00
generic_acl.c
inode.c
internal.h
ioctl.c
ioprio.c
Kconfig
Kconfig.binfmt
libfs.c
locks.c
Makefile
mbcache.c
mount.h
mpage.c
namei.c	fs/namei.c: fix new kernel-doc warning	2013-10-22 12:02:40 +01:00
namespace.c	initmpfs: move rootfs code from fs/ramfs/ to init/	2013-09-11 15:59:37 -07:00
no-block.c
open.c	vfs: improve i_op->atomic_open() documentation	2013-09-16 19:17:24 -04:00
pipe.c
pnode.c
pnode.h
posix_acl.c
proc_namespace.c
read_write.c
readdir.c
select.c	Revert "select: use freezable blocking call"	2013-10-30 15:28:35 +01:00
seq_file.c	seq_file: always update file->f_pos in seq_lseek()	2013-10-25 10:46:40 -04:00
signalfd.c
splice.c
stack.c
stat.c
statfs.c	vfs: allow O_PATH file descriptors for fstatfs()	2013-10-12 13:12:31 -07:00
super.c	fs/super.c: fix lru_list leak for real	2013-10-01 13:11:21 -04:00
sync.c	writeback: do not sync data dirtied after sync start	2013-11-13 12:09:07 +09:00
timerfd.c
utimes.c
xattr_acl.c
xattr.c