Eric Dumazet 29f3490ba9 net: use indirect call wrappers for skb_copy_datagram_iter() ... TCP recvmsg() calls skb_copy_datagram_iter(), which calls an indirect function (cb pointing to simple_copy_to_iter()) for every MSS (fragment) present in the skb. CONFIG_RETPOLINE=y forces a very expensive operation that we can avoid thanks to indirect call wrappers. This patch gives a 13% increase of performance on a single flow, if the bottleneck is the thread reading the TCP socket. Fixes: 950fcaecd5 ("datagram: consolidate datagram copy to iter helpers") Signed-off-by: Eric Dumazet <edumazet@google.com> Acked-by: Paolo Abeni <pabeni@redhat.com> Acked-by: Willem de Bruijn <willemb@google.com> Signed-off-by: David S. Miller <davem@davemloft.net>		2020-03-25 11:30:40 -07:00
..
6lowpan
9p	9p pull request for inclusion in 5.4	2019-09-27 15:10:34 -07:00
802	net: 802: psnap.c: Use built-in RCU list checking	2020-02-24 13:02:53 -08:00
8021q	net: vlan: suppress "failed to kill vid" warnings	2020-02-17 14:30:54 -08:00
appletalk	appletalk: enforce CAP_NET_RAW for raw sockets	2019-09-24 16:37:18 +02:00
atm	proc: convert everything to "struct proc_ops"	2020-02-04 03:05:26 +00:00
ax25	net: Make sock protocol value checks more specific	2020-01-09 18:41:40 -08:00
batman-adv	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-03-12 22:34:48 -07:00
bluetooth	Bluetooth: Do not cancel advertising when starting a scan	2020-03-18 12:25:03 +01:00
bpf	bpf: Add selftests for BPF_MODIFY_RETURN	2020-03-04 13:41:06 -08:00
bpfilter	kbuild: rename hostprogs-y/always to hostprogs/always-y	2020-02-04 01:53:07 +09:00
bridge	net: bridge: vlan options: move the tunnel command to the nested attribute	2020-03-20 08:52:20 -07:00
caif	net: caif: Add lockdep expression to RCU traversal primitive	2020-03-11 22:55:25 -07:00
can	can: j1939: j1939_sk_bind(): take priv after lock is held	2019-12-08 11:52:02 +01:00
ceph	Merge branch 'merge.nfs-fs_parse.1' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs	2020-02-08 13:26:41 -08:00
core	net: use indirect call wrappers for skb_copy_datagram_iter()	2020-03-25 11:30:40 -07:00
dcb
dccp	Merge git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next	2020-02-29 15:53:35 -08:00
decnet	Remove DST_HOST	2020-03-23 21:57:44 -07:00
dns_resolver	Revert "Merge tag 'keys-acl-20190703' of git://git.kernel.org/pub/scm/linux/kernel/git/dhowells/linux-fs"	2019-07-10 18:43:43 -07:00
dsa	net: dsa: Implement flow dissection for tag_brcm.c	2020-03-23 21:48:59 -07:00
ethernet	net: remove eth_change_mtu	2020-01-27 11:09:31 +01:00
ethtool	ethtool: fix incorrect tx-checksumming settings reporting	2020-03-24 16:25:11 -07:00
hsr	hsr: fix refcnt leak of hsr slave interface	2020-03-05 11:59:47 -08:00
ieee802154	nl802154: add missing attribute validation for dev_type	2020-03-03 13:28:48 -08:00
ife	net: Fix Kconfig indentation	2019-09-26 08:56:17 +02:00
ipv4	Remove DST_HOST	2020-03-23 21:57:44 -07:00
ipv6	Remove DST_HOST	2020-03-23 21:57:44 -07:00
iucv	treewide: Use sizeof_field() macro	2019-12-09 10:36:44 -08:00
kcm	net: kcm: kcmproc.c: Fix RCU list suspicious usage warning	2020-03-16 17:14:02 -07:00
key
l2tp	l2tp: Replace zero-length array with flexible-array member	2020-02-28 12:08:37 -08:00
l3mdev
lapb
llc	af_llc: fix if-statement empty body warning	2020-02-26 20:38:13 -08:00
mac80211	mac80211: driver can remain on channel if not using chan_ctx	2020-03-20 14:42:21 +01:00
mac802154
mpls	net: mpls: Replace zero-length array with flexible-array member	2020-02-28 12:08:37 -08:00
mptcp	net: mptcp: don't hang in mptcp_sendmsg() after TCP fallback	2020-03-23 20:53:25 -07:00
ncsi	net/ncsi: Support for multi host mellanox card	2020-01-09 18:36:22 -08:00
netfilter	netfilter: revert introduction of egress hook	2020-03-18 16:35:48 -07:00
netlabel	netlabel_domainhash.c: Use built-in RCU list checking	2020-02-18 12:44:23 -08:00
netlink	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-03-12 22:34:48 -07:00
netrom	net: netrom: Add missing annotation for nr_neigh_stop()	2020-02-24 13:26:49 -08:00
nfc	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-03-12 22:34:48 -07:00
nsh
openvswitch	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-03-12 22:34:48 -07:00
packet	net/packet: tpacket_rcv: do not increment ring index on drop	2020-03-11 23:12:16 -07:00
phonet	net: Remove redundant BUG_ON() check in phonet_pernet	2020-01-03 12:25:50 -08:00
psample	net: psample: fix skb_over_panic	2019-11-26 14:40:13 -08:00
qrtr	net: qrtr: Fix FIXME related to qrtr_ns_init()	2020-03-03 17:52:21 -08:00
rds	net/rds: Track user mapped pages through special API	2020-02-16 18:37:09 -08:00
rfkill	rfkill: Fix incorrect check to avoid NULL pointer dereference	2019-12-16 10:15:49 +01:00
rose	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-01-26 10:40:21 +01:00
rxrpc	rxrpc: Fix call RCU cleanup using non-bh-safe locks	2020-02-07 11:20:57 +01:00
sched	net: sched: rename more stats_types	2020-03-23 20:54:23 -07:00
sctp	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-03-12 22:34:48 -07:00
smc	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-03-12 22:34:48 -07:00
strparser
sunrpc	xprtrdma: Fix DMA scatter-gather list mapping imbalance	2020-02-13 15:35:33 -05:00
switchdev	net: switchdev: do not propagate bridge updates across bridges	2020-02-26 20:58:33 -08:00
tipc	tipc: add NULL pointer check to prevent kernel oops	2020-03-15 00:07:00 -07:00
tls	net/tls: Annotate access to sk_prot with READ_ONCE/WRITE_ONCE	2020-03-21 20:08:17 -07:00
unix	net: datagram: drop 'destructor' argument from several helpers	2020-02-28 12:12:53 -08:00
vmw_vsock	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-02-27 18:31:39 -08:00
wimax	wimax: no need to check return value of debugfs_create functions	2019-08-10 15:25:47 -07:00
wireless	nl80211: clarify code in nl80211_del_station()	2020-03-20 14:42:20 +01:00
x25	net: x25: convert to list_for_each_entry_safe()	2020-02-16 18:59:42 -08:00
xdp	xdp: Replace zero-length array with flexible-array member	2020-02-28 12:08:37 -08:00
xfrm	Remove DST_HOST	2020-03-23 21:57:44 -07:00
compat.c	y2038: socket: use __kernel_old_timespec instead of timespec	2019-11-15 14:38:29 +01:00
Kconfig	net: disable BRIDGE_NETFILTER by default	2020-02-20 15:02:02 -08:00
Makefile	mptcp: Add MPTCP socket stubs	2020-01-24 13:44:07 +01:00
socket.c	socket: fix unused-function warning	2020-01-08 15:02:21 -08:00
sysctl_net.c