SmartIO hot-add with single host

New in version 5.9.

This guide will help you set up SmartIO hot-add for cases where you have a single host and one or more transparent devices connected to the host adapter.

../_images/aafig-260bea1efc6a5c0ef9e88d321cea401ec4f39528.svg

System Requirements

The following are hard requirements:

  • Host system must run Linux.

  • Host system must have an PXH or MXH adapter.

In addition lack of the following features may cause issues:

Hardware setup

Install the host adapter in the system. Ensure that it’s configured for NTB mode. This is the factory default setting.

Connect the host adapter to the desired transparent device or devices. If this includes an MXS switch, ensure that the switch is set in transparent mode. If target adapter is used. Ensure that the dip settings is set to target mode.

Installing eXpressWare

Run installer with --enable-smartio --install-node. No other eXpressWare modules are required. After installation reboot the system. When the system has rebooted run dis_diag and verify the output.

[root@hammer ~]# dis_diag
================================================================================
  Dolphin diagnostic tool --  dis_diag version 5.12.0 (Wed Apr 24 09:58:57 CEST 2019)
================================================================================


dis_diag compiled in 64 bit mode
Driver : Dolphin IRM (GX) 5.12.0-d Mar 22nd 2019 (rev 47f63be759)
Date   : Mon 29 Apr 11:32:02 CEST 2019
System : Linux hammer 4.18.16-300.fc29.x86_64 #1 SMP Sat Oct 20 23:24:08 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

[WARN] dishosts.conf file does not exist /etc/dis/dishosts.conf
Number of configured local adapters found: 1


Adapter 0 > Type                       : PXH830
            Mode                       : NTB
            NodeId                     : 4
            Serial number              : PXH830-BC-000103
            PXH chip family            : PLX_DRACO_2
            PXH chip vendorId          : 0x10b5
            PXH chip device            : 0x8733
            PXH chip revision          : 0xCA
            EEPROM version             : 11
            EEPROM vendor info         : 0x0000
            EEPROM images              : 01
            Firmware version           : 8.4
            Card revision              : BC
            Topology type              : NT-Transparent
            Topology Autodetect        : Yes
            Number of enabled links    : 1
            Max payload size (MPS)     : 256
            Multicast group size       : 2 MB
            BAR2 (Prefetch space)      : 32768 MB
            BAR4                       : 64 MB
            BAR5                       : 8 MB
            Clock mode slot            : Port
            Clock mode link            : Global
            PCIe slot state            : x16, Gen3 (8 GT/s)
            PCIe slot capabilities     : x16, Gen3 (8 GT/s)


*************************  PXH ADAPTER 0 LINK 0 STATE  *************************

            Link 0 uptime              : 420174 seconds
            Link 0 state               : ENABLED
            Link 0 state               : x4, Gen3 (8 GT/s)
            Link 0 required            : x4, Gen3 (8 GT/s)
            Link 0 capabilities        : x16, Gen3 (8 GT/s)
            Link 0 cable inserted      : 1
            Link 0 active              : 1
            Link 0 configuration       : NTB


****************************  PXH ADAPTER 0 STATUS  ****************************

            Chip temperature           : 85 C
            Board temperature          : 51 C


***************  PXH ADAPTER 0, PARTNER INFORMATION FOR LINK 0  ***************

            Partner information not available



*****************************  TEST OF ADAPTER 0  *****************************

OK: PXH chip alive in adapter 0.
OK: Link alive in adapter 0.
==> Local adapter 0 has 1 warnings.
==> Local adapter 0 ok.

************************  TOPOLOGY SEEN FROM ADAPTER 0  ************************

Adapters found: 2
----- List of all nodes found:

Nodes detected:   0004  0032


***********************  SESSION STATUS FROM ADAPTER 0  ***********************


Node 4: Session valid


----------------------------------
dis_diag discovered 0 note(s).
dis_diag discovered 1 warning(s).
dis_diag discovered 0 error(s).
TEST RESULT: *PASSED*

MXH cards only

Check the current EEPROM version as reported by dis_diag. This must at least version 9. If the EEPROM version is not at version 9 or higher it must be upgraded. Follow the Upgrading Adapter Firmware guide.

Usage

See Hot-Add - directly attached devices for full usage guide.