Activating Virtual Functions

Virtual functions must be enabled after each system restart.

1. Load the vfio module and run the ntload.sh command.

   modprobe vfio-pci
   /opt/napatech3/bin/ntload.sh
   lsmod | grep vfio

   An output example:

   vfio_pci               41993  0
   vfio_iommu_type1       22440  0
   vfio                   32657  3 vfio_iommu_type1,vfio_pci
   irqbypass              13503  2 kvm,vfio_pci
   

2. Activate a number of virtual functions.

   DEV=$(lspci -Dd 18f4: | cut -d' ' -f1 | head -1)
   NUMVF=5
   echo $NUMVF > /sys/bus/pci/devices/$DEV/sriov_numvfs
   cat /sys/bus/pci/devices/$DEV/sriov_numvfs

   where:

   $NUMVF represents the number of virtual channels to VMs, plus one for OVS. Thus using NUMVF=3 will enable 3 channels for VMs. The current maximum supported Virtual Functions count is 128.

   Note: 33.00 or newer version FPGA images support SR-IOV capabilities. If the FPGA image of the SmartNIC has been switched from an older version to 33.00 or newer version, you must reboot the server to enumerate SR-IOV capabilities.
   If activating virtual functions fail with errors, see Common Problems and Solutions Activating Virtual Functions
3. Verify the Virtual Functions with the command lspci | grep Napatech.
   This is an example of the lspci | grep Napatech.

   # lspci | grep Napatech
   3b:00.0 Network controller: Napatech A/S NT200A02 Network Adapter
   
   # echo 3 > /sys/bus/pci/devices/0000:3b:00.0/sriov_numvfs
   
   # lspci | grep Napatech
   3b:00.0 Network controller: Napatech A/S NT200A02 Network Adapter
   3b:00.4 Network controller: Napatech A/S Device 051a
   3b:00.5 Network controller: Napatech A/S Device 051a
   3b:00.6 Network controller: Napatech A/S Device 051a
   3b:00.7 Network controller: Napatech A/S Device 051a
   3b:01.0 Network controller: Napatech A/S Device 051a

   Note: The Virtual Functions will be bound to devices XX:XX.4 and up.
4. Bind all Virtual Functions to the VFIO driver.
   • Enter the following command for an NT200A02 SmartNIC:

     echo 18f4 051a > /sys/bus/pci/drivers/vfio-pci/new_id

   • Enter the following command for an NT50B01 SmartNIC:

     echo 18f4 051b > /sys/bus/pci/drivers/vfio-pci/new_id

5. Verify the kernel driver using the command lspci -k | grep -A1 Napatech.

   # lspci -k | grep -A1 "Napatech"
   3b:00.0 Network controller: Napatech A/S Device 05a1
   	Subsystem: Napatech A/S Device 0001
   	Kernel driver in use: nt3gd
   3b:00.4 Network controller: Napatech A/S Device 051a
   	Subsystem: Napatech A/S Device 0001
   	Kernel driver in use: vfio-pci
   3b:00.5 Network controller: Napatech A/S Device 051a
   	Subsystem: Napatech A/S Device 0001
   	Kernel driver in use: vfio-pci
   3b:00.6 Network controller: Napatech A/S Device 051a
   	Subsystem: Napatech A/S Device 0001
   	Kernel driver in use: vfio-pci