mirror of
https://github.com/AuxXxilium/linux_dsm_epyc7002.git
synced 2025-02-08 13:05:12 +07:00
b094a36f90
When performing process affinity recommendations for MPI ranks, the current algorithm doesn't take into account multiple HFI units. Also, real cores and HT cores are not distinguished from one another. Therefore, all HT cores are recommended to be assigned first within the local NUMA node before recommending the assignments of cores in other NUMA nodes. It's ideal to assign all real cores across all NUMA nodes first, then all HT 1 cores, then all HT 2 cores, and so on to balance CPU workload. CPU cores in other NUMA nodes could be running interrupt handlers, and this is not taken into account. To balance the CPU workload for user processes, the following recommendation algorithm is used: For each user process that is opening a context on HFI Y: a) If all cores are assigned to user processes, start assignments all over from the first core b) Assign real cores first, then HT cores (First set of HT cores on all physical cores, then second set of HT cores, and, so on) in the following order: 1. Same NUMA node as HFI Y and not running an IRQ handler 2. Same NUMA node as HFI Y and running an IRQ handler 3. Different NUMA node to HFI Y and not running an IRQ handler 4. Different NUMA node to HFI Y and running an IRQ handler c) Mark core as assigned in the global affinity structure. As user processes are done, remove core assignments from global affinity structure. This implementation allows an arbitrary number of HT cores and provides support for multiple HFIs. This is being included in the kernel rather than user space due to the fact that user space has no way of knowing the CPU recommendations for contexts running as part of other jobs. Reviewed-by: Ira Weiny <ira.weiny@intel.com> Reviewed-by: Mitko Haralanov <mitko.haralanov@intel.com> Reviewed-by: Dennis Dalessandro <dennis.dalessandro@intel.com> Signed-off-by: Sebastian Sanchez <sebastian.sanchez@intel.com> Signed-off-by: Doug Ledford <dledford@redhat.com> |
||
|---|---|---|
| .. | ||
| affinity.c | ||
| affinity.h | ||
| aspm.h | ||
| chip_registers.h | ||
| chip.c | ||
| chip.h | ||
| common.h | ||
| debugfs.c | ||
| debugfs.h | ||
| device.c | ||
| device.h | ||
| dma.c | ||
| driver.c | ||
| efivar.c | ||
| efivar.h | ||
| eprom.c | ||
| eprom.h | ||
| file_ops.c | ||
| firmware.c | ||
| hfi.h | ||
| init.c | ||
| intr.c | ||
| iowait.h | ||
| Kconfig | ||
| mad.c | ||
| mad.h | ||
| Makefile | ||
| mmu_rb.c | ||
| mmu_rb.h | ||
| opa_compat.h | ||
| pcie.c | ||
| pio_copy.c | ||
| pio.c | ||
| pio.h | ||
| platform.c | ||
| platform.h | ||
| qp.c | ||
| qp.h | ||
| qsfp.c | ||
| qsfp.h | ||
| rc.c | ||
| ruc.c | ||
| sdma_txreq.h | ||
| sdma.c | ||
| sdma.h | ||
| sysfs.c | ||
| trace_ctxts.h | ||
| trace_dbg.h | ||
| trace_ibhdrs.h | ||
| trace_misc.h | ||
| trace_rc.h | ||
| trace_rx.h | ||
| trace_tx.h | ||
| trace.c | ||
| trace.h | ||
| twsi.c | ||
| twsi.h | ||
| uc.c | ||
| ud.c | ||
| user_exp_rcv.c | ||
| user_exp_rcv.h | ||
| user_pages.c | ||
| user_sdma.c | ||
| user_sdma.h | ||
| verbs_txreq.c | ||
| verbs_txreq.h | ||
| verbs.c | ||
| verbs.h | ||