Dongdong Wang d9054a1ff5 lwt: Disable BH too in run_lwt_bpf() ... The per-cpu bpf_redirect_info is shared among all skb_do_redirect() and BPF redirect helpers. Callers on RX path are all in BH context, disabling preemption is not sufficient to prevent BH interruption. In production, we observed strange packet drops because of the race condition between LWT xmit and TC ingress, and we verified this issue is fixed after we disable BH. Although this bug was technically introduced from the beginning, that is commit 3a0af8fd61 ("bpf: BPF for lightweight tunnel infrastructure"), at that time call_rcu() had to be call_rcu_bh() to match the RCU context. So this patch may not work well before RCU flavor consolidation has been completed around v5.0. Update the comments above the code too, as call_rcu() is now BH friendly. Signed-off-by: Dongdong Wang <wangdongdong.6@bytedance.com> Signed-off-by: Alexei Starovoitov <ast@kernel.org> Reviewed-by: Cong Wang <cong.wang@bytedance.com> Link: https://lore.kernel.org/bpf/20201205075946.497763-1-xiyou.wangcong@gmail.com		2020-12-07 11:53:39 -08:00
..
bpf_sk_storage.c	bpf: Change bpf_sk_storage_*() to accept ARG_PTR_TO_BTF_ID_SOCK_COMMON	2020-09-25 13:58:01 -07:00
datagram.c	net: zerocopy: combine pages in zerocopy_sg_from_iter()	2020-08-20 16:12:50 -07:00
datagram.h	net/core: Allow the compiler to verify declaration and definition consistency	2019-03-27 13:49:44 -07:00
dev_addr_lists.c	net: core: add nested_level variable in net_device	2020-09-28 15:00:15 -07:00
dev_ioctl.c	treewide: Use fallthrough pseudo-keyword	2020-08-23 17:36:59 -05:00
dev.c	net, xsk: Avoid taking multiple skbuff references	2020-11-24 22:39:56 +01:00
devlink.c	devlink: Make sure devlink instance and port are in same net namespace	2020-11-25 17:26:34 -08:00
drop_monitor.c	genetlink: move to smaller ops wherever possible	2020-10-02 19:11:11 -07:00
dst_cache.c	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 152	2019-05-30 11:26:32 -07:00
dst.c	net: Correct the comment of dst_dev_put()	2020-09-10 13:28:57 -07:00
failover.c	failover: allow name change on IFF_UP slave interfaces	2019-04-10 22:12:26 -07:00
fib_notifier.c	net: fib_notifier: propagate extack down to the notifier block callback	2019-10-04 11:10:56 -07:00
fib_rules.c	fib: fix fib_rule_ops indirect call wrappers when CONFIG_IPV6=m	2020-09-08 20:09:08 -07:00
filter.c	net: Properly typecast int values to set sk_max_pacing_rate	2020-10-22 12:18:25 -07:00
flow_dissector.c	net: flow_dissector: avoid indirect call to DSA .flow_dissect for generic case	2020-09-26 14:17:59 -07:00
flow_offload.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2020-07-25 17:49:04 -07:00
gen_estimator.c	net_sched: gen_estimator: extend packet counter to 64bit	2019-11-06 21:51:36 -08:00
gen_stats.c	docs: networking: convert gen_stats.txt to ReST	2020-04-28 14:39:46 -07:00
gro_cells.c	gro_cells: reduce number of synchronize_net() calls	2020-11-25 11:28:12 -08:00
hwbm.c	net: hwbm: Make the hwbm_pool lock a mutex	2019-06-09 19:40:10 -07:00
link_watch.c	net: Add IF_OPER_TESTING	2020-04-20 12:43:24 -07:00
lwt_bpf.c	lwt: Disable BH too in run_lwt_bpf()	2020-12-07 11:53:39 -08:00
lwtunnel.c	net: ipv6: add rpl sr tunnel	2020-03-29 22:30:57 -07:00
Makefile	ethtool: move to its own directory	2019-12-12 17:07:05 -08:00
neighbour.c	net: Exempt multicast addresses from five-second neighbor lifetime	2020-11-13 14:24:39 -08:00
net_namespace.c	bpf, net: Rework cookie generator as per-cpu one	2020-09-30 11:50:35 -07:00
net-procfs.c	net-sysfs: add backlog len and CPU id to softnet data	2020-09-21 13:56:37 -07:00
net-sysfs.c	net-sysfs: Fix inconsistent of format with argument type in net-sysfs.c	2020-10-01 18:45:23 -07:00
net-sysfs.h	net-sysfs: add netdev_change_owner()	2020-02-26 20:07:25 -08:00
net-traces.c	page_pool: add tracepoints for page_pool with details need by XDP	2019-06-19 11:23:13 -04:00
netclassid_cgroup.c	cgroup, netclassid: remove double cond_resched	2020-04-21 15:44:30 -07:00
netevent.c	treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 152	2019-05-30 11:26:32 -07:00
netpoll.c	net: Have netpoll bring-up DSA management interface	2020-11-18 11:04:11 -08:00
netprio_cgroup.c	netprio_cgroup: Fix unlimited memory leak of v2 cgroups	2020-05-09 20:59:21 -07:00
page_pool.c	net: page pool: allow to pass zero flags to page_pool_init()	2020-03-29 21:49:20 -07:00
pktgen.c	pktgen: Fix inconsistent of format with argument type in pktgen.c	2020-10-01 18:45:23 -07:00
ptp_classifier.c	ptp: Add generic ptp v2 header parsing function	2020-08-19 16:07:49 -07:00
request_sock.c	tcp: add rcu protection around tp->fastopen_rsk	2019-10-13 10:13:08 -07:00
rtnetlink.c	rtnetlink: fix data overflow in rtnl_calcit()	2020-10-21 18:24:08 -07:00
scm.c	fs: Add receive_fd() wrapper for __receive_fd()	2020-07-13 11:03:44 -07:00
secure_seq.c	crypto: lib/sha1 - remove unnecessary includes of linux/cryptohash.h	2020-05-08 15:32:17 +10:00
skbuff.c	sock: set sk_err to ee_errno on dequeue from errq	2020-11-27 11:07:06 -08:00
skmsg.c	bpf, sockmap: Avoid failures from skb_to_sgvec when skb has frag_list	2020-11-18 00:14:04 +01:00
sock_diag.c	bpf, net: Rework cookie generator as per-cpu one	2020-09-30 11:50:35 -07:00
sock_map.c	net, sockmap: Don't call bpf_prog_put() on NULL pointer	2020-10-15 21:05:23 +02:00
sock_reuseport.c	udp: Copy has_conns in reuseport_grow().	2020-07-21 15:31:02 -07:00
sock.c	net: Properly typecast int values to set sk_max_pacing_rate	2020-10-22 12:18:25 -07:00
stream.c	tcp: make sure EPOLLOUT wont be missed	2019-08-19 13:07:43 -07:00
sysctl_net_core.c	net: add option to not create fall-back tunnels in root-ns as well	2020-08-28 06:52:44 -07:00
timestamping.c	net: Introduce a new MII time stamping interface.	2019-12-25 19:51:33 -08:00
tso.c	net: tso: add UDP segmentation support	2020-06-18 20:46:23 -07:00
utils.c	net: Fix skb->csum update in inet_proto_csum_replace16().	2020-01-24 20:54:30 +01:00
xdp.c	xdp: Handle MEM_TYPE_XSK_BUFF_POOL correctly in xdp_return_buff()	2020-11-30 23:00:26 +01:00