linux_dsm_epyc7002/drivers/infiniband/hw/mlx5
Max Gurtovoy 2563e2f30a RDMA/mlx5: Use PA mapping for PI handover
If possibe, avoid doing a UMR operation to register data and protection
buffers (via MTT/KLM mkeys). Instead, use the local DMA key and map the
SG lists using PA access. This is safe, since the internal key for data
and protection never exposed to the remote server (only signature key
might be exposed). If PA mappings are not possible, perform mapping
using MTT/KLM descriptors.

The setup of the tested benchmark (using iSER ULP):
 - 2 servers with 24 cores (1 initiator and 1 target)
 - ConnectX-4/ConnectX-5 adapters
 - 24 target sessions with 1 LUN each
 - ramdisk backstore
 - PI active

Performance results running fio (24 jobs, 128 iodepth) using
write_generate=1 and read_verify=1 (w/w.o patch):

bs      IOPS(read)        IOPS(write)
----    ----------        ----------
512   1266.4K/1262.4K    1720.1K/1732.1K
4k    793139/570902      1129.6K/773982
32k   72660/72086        97229/96164

Using write_generate=0 and read_verify=0 (w/w.o patch):
bs      IOPS(read)        IOPS(write)
----    ----------        ----------
512   1590.2K/1600.1K    1828.2K/1830.3K
4k    1078.1K/937272     1142.1K/815304
32k   77012/77369        98125/97435

Signed-off-by: Max Gurtovoy <maxg@mellanox.com>
Signed-off-by: Israel Rukshin <israelr@mellanox.com>
Suggested-by: Sagi Grimberg <sagi@grimberg.me>
Signed-off-by: Jason Gunthorpe <jgg@mellanox.com>
2019-06-24 11:49:28 -03:00
..
ah.c RDMA: Handle AH allocations by IB/core 2019-04-08 13:05:25 -03:00
cmd.c IB/mlx5: Add steering SW ICM device memory type 2019-05-06 12:51:51 -03:00
cmd.h IB/mlx5: Add steering SW ICM device memory type 2019-05-06 12:51:51 -03:00
cong.c infiniband: mlx5: no need to check return value of debugfs_create functions 2019-01-24 09:22:29 -07:00
cq.c RDMA: Check umem pointer validity prior to release 2019-06-20 15:17:59 -04:00
devx.c IB/mlx5: Verify DEVX general object type correctly 2019-05-14 10:22:09 -03:00
doorbell.c IB/{core,hw}: Have ib_umem_get extract the ib_ucontext from ib_udata 2019-01-10 17:07:45 -07:00
flow.c RDMA/mlx5: Allow DEVX and raw creation flow on reps 2019-04-22 15:24:05 -03:00
gsi.c RDMA, core and ULPs: Declare ib_post_send() and ib_post_recv() arguments const 2018-07-30 20:09:34 -06:00
ib_rep.c {IB,net}/mlx5: Constify rep ops functions pointers 2019-05-31 12:28:14 -07:00
ib_rep.h {IB,net}/mlx5: Constify rep ops functions pointers 2019-05-31 12:28:14 -07:00
ib_virt.c IB/mlx5: Restore IB guid/policy for virtual functions 2017-07-24 10:34:28 -04:00
Kconfig IB/{core,uverbs}: Move ib_umem_xxx functions from ib_core to ib_uverbs 2019-01-10 17:06:44 -07:00
mad.c RDMA/mad: Reduce MAD scope to mlx5_ib only 2019-01-15 10:02:29 +02:00
main.c RDMA/core: Rename signature qp create flag and signature device capability 2019-06-24 11:49:27 -03:00
Makefile net/mlx5: Move SRQ functions to RDMA part 2018-12-04 09:14:30 +02:00
mem.c RDMA/umem: Move page_shift from ib_umem to ib_odp_umem 2019-05-21 15:23:24 -03:00
mlx5_ib.h RDMA/mlx5: Use PA mapping for PI handover 2019-06-24 11:49:28 -03:00
mr.c RDMA/mlx5: Use PA mapping for PI handover 2019-06-24 11:49:28 -03:00
odp.c Merge remote-tracking branch 'mlx5-next/mlx5-next' into HEAD 2019-06-18 22:44:36 -04:00
qp.c RDMA/mlx5: Use PA mapping for PI handover 2019-06-24 11:49:28 -03:00
srq_cmd.c RDMA: Handle SRQ allocations by IB/core 2019-04-08 13:05:25 -03:00
srq.c RDMA: Handle SRQ allocations by IB/core 2019-04-08 13:05:25 -03:00
srq.h RDMA: Handle SRQ allocations by IB/core 2019-04-08 13:05:25 -03:00