Skip to content

OFED & DPDK installation

Roland Sipos edited this page Sep 19, 2022 · 10 revisions

Resources (OFED and DPDK) are under /opt on 021 and 022.:

OFED: /opt/MLNX_OFED/MLNX_OFED_LINUX-5.6-2.0.9.0-rhel8.5-x86_64

Installation arguments (will need some system packages installed: kernel-rpm-macros libtool createrepo_c):

./mlnxofedinstall --add-kernel-support --dpdk --umad-dev-rw

DPDK: /opt/dpdk/dpdk-22.03

Build steps (no special parameters here):

meson build
cd build
ninja
ninja install

After reboots we do the following hugepage setup for DPDK:

[root@np04-srv-021 opt]# pwd
/opt
[root@np04-srv-021 opt]# cat setup-100g.sh 
#!/bin/bash

ifconfig ens801f0np0 mtu 9000

/opt/dpdk/dpdk-22.03/usertools/dpdk-hugepages.py -c

echo 1024 > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepages
echo 1024 > /sys/devices/system/node/node1/hugepages/hugepages-2048kB/nr_hugepages

/opt/dpdk/dpdk-22.03/usertools/dpdk-hugepages.py -m

When we are running applications, we usually preload LD with the DPDK installation location:

export LD_LIBRARY_PATH=/usr/local/lib64/:$LD_LIBRARY_PATH
export DPDK_LIB=/usr/local/lib64

Then.... finally the goal is.... To run this app as np04daq or any user:

/opt/dpdk/dpdk-22.03/build/app/dpdk-testpmd

Tarballs for OFED and DPDK are under /opt/MLNX_OFED and /opt/dpdk/:

[root@np04-srv-021 MLNX_OFED]# ls
MLNX_OFED_LINUX-5.6-2.0.9.0-rhel8.5-x86_64
MLNX_OFED_LINUX-5.6-2.0.9.0-rhel8.5-x86_64.tgz
[root@np04-srv-021 dpdk]# ls
dpdk-22.03  dpdk-22.03.tar.gz