dnf install kmod-redhat-mlx5_core infiniband-diags perftest mstflint pciutils
- Find the ID of the device with
lspci
orlshw
lspci | egrep -i Mellanox
lshw | egrep -i -a5 -b5 mellanox
- e.g.,
04:00.0 Infiniband controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
- Query the selected card using
mstconfig
- e.g.,
mstconfig -d 04:00.0 q
- This will spit out configuration items about the card. You're interested in the
LINK_TYPE_P1
&LINK_TYPE_P2
items - e.g.,
LINK_TYPE_P1 IB(1)
LINK_TYPE_P2 IB(1)
- e.g.,
- Here, we see that the card is set to 1 mode, which is Infiniband-only.
- To use these cards with Ethernet, use
mstconfig
to update the config items for both P1 & P2 to use mode 2 which is Ethernet.mstconfig -d 04:00.0 set LINK_TYPE_P1=2
mstconfig -d 04:00.0 set LINK_TYPE_P2=2
- Say (y)es to applying a new configuration
- Once all the cards on the machine and all the LINK_TYPE_PX items are updated, reboot the machine
- On startup, you should be able to see the Mellanox interfaces as Ethernet. Go wild.
Information gathered from: https://access.redhat.com/articles/3082811
Specific categories