Current revision updated by gbriaud3 on
Originally created by gbriaud3 on
  1. dnf install kmod-redhat-mlx5_core infiniband-diags perftest mstflint pciutils
  2. Find the ID of the device with lspci or lshw
    1. lspci | egrep -i Mellanox
      
    2. lshw | egrep -i -a5 -b5 mellanox
    3. e.g., 04:00.0 Infiniband controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
  3. Query the selected card using mstconfig
    1. e.g., mstconfig -d 04:00.0 q
    2. This will spit out configuration items about the card. You're interested in the LINK_TYPE_P1 & LINK_TYPE_P2 items
    3. e.g.,
      LINK_TYPE_P1 IB(1)
      LINK_TYPE_P2 IB(1)
  4. Here, we see that the card is set to 1 mode, which is Infiniband-only.
  5. To use these cards with Ethernet, use mstconfig to update the config items for both P1 & P2 to use mode 2 which is Ethernet.
    1. mstconfig -d 04:00.0 set LINK_TYPE_P1=2
      mstconfig -d 04:00.0 set LINK_TYPE_P2=2
    2. Say (y)es to applying a new configuration
  6. Once all the cards on the machine and all the LINK_TYPE_PX items are updated, reboot the machine
  7. On startup, you should be able to see the Mellanox interfaces as Ethernet. Go wild.

Information gathered from: https://access.redhat.com/articles/3082811

Identifier Categories
Specific categories