XCP-NG and PCIe NIC passthrough problem

Computer Hardware & Server Infrastructure Builds
1

I’m looking for help with setting up PCIe NIC passthrough to VM. I tried with several Linux distributions on clean XCP-NG 8.2 and 8.3 and with different 10GbE network cards (Intel/Emulex/Mellanox).

I’ve used Supermicro and Gigabyte server class motherboard and Xeon and Ryzen CPUs.

The outcome is the same in each case. The device is nicely passed to the VM it appears correctly and device seems to be operational at guest OS. The main problem is that I can’t communicate through those interfaces.
MAC addresses are visible on the switch, TX counters increase on VM OS side but all RX counters doesn’t show any activity on switch side.

Additionally despite the fact the I hided NIC for dom0 there are still bridge interfaces related with those passthrough interfaces operational and their MAC addresses are also visible on switch side.

I’ve posted at XCP-NG Forum for help including all details with screenshoots.

Can someone help me here?

THX in advance for sharing some of your wisdom.

2

Not sure if you have seen this video but maybe this might help.

3

I watched this tutorial but there is only showed that RTL NIC card has appeared on Windows VM there is no connectivity test done… I reached the same point I have devices on VM. They are visible in the system and I can address them reconfigure but no traffic passing those interfaces outside.

Does anyone managed to use passthrough NICs in real world?

I’ve tried on XCP-NG 8.2 and 8.3 with same result.

4

Problem has been solved in my case by adding the extra parameter to the kernel with command:

/opt/xensource/libexec/xen-cmdline --set-dom0 “pci=realloc=on”

1 Like