File tree Expand file tree Collapse file tree 1 file changed +8
-8
lines changed Expand file tree Collapse file tree 1 file changed +8
-8
lines changed Original file line number Diff line number Diff line change 11.\" t
22.\" Automatically generated by Pandoc 2.9.2.1
33.\"
4- .TH "fi_cxi" "7" "2024\- 10\- 17 " "Libfabric Programmer\[cq ] s Manual" "#VERSION#"
4+ .TH "fi_cxi" "7" "2024\- 10\- 31 " "Libfabric Programmer\[cq ] s Manual" "#VERSION#"
55.hy
66.SH NAME
77.PP
@@ -529,14 +529,14 @@ Copy-on-write semantics are broken when using pinned memory.
529529See the Fork section for more information.
530530.PP
531531The CXI provider supports DMABUF for device memory registration.
532- If the ROCR and CUDA libraries support it, the CXI provider will default
533- to use DMA-buf.
532+ DMABUF is supported in ROCm 5.6+ and Cuda 11.7+ with nvidia open source
533+ driver 525+.
534+ Both \f[I] FI_HMEM_ROCR_USE_DMABUF \f[ R ] and \f[I] FI_HMEM_CUDA_USE_DMABUF
535+ are disabled by default in libfabric core but the CXI provider enables
536+ \f[ R ] FI_HMEM_ROCR_USE_DMABUF* by default if not specifically set.
534537There may be situations with CUDA that may double the BAR consumption.
535- Until this is fixed in the CUDA stack, the environment variable
536- \f[I] FI_CXI_DISABLE_DMABUF_CUDA \f[ R ] can be used to fall back to the
537- nvidia peer-memory interface.
538- Also, \f[I] FI_CXI_DISABLE_DMABUF_ROCR \f[ R ] can be used to fall back to
539- the amdgpu peer-memory interface.
538+ Until this is fixed in the CUDA stack, CUDA DMABUF will be disabled by
539+ default.
540540.SS Translation Cache
541541.PP
542542Mapping a buffer for use by the NIC is an expensive operation.
You can’t perform that action at this time.
0 commit comments