I have a setup with a couple of XCP-ng servers and a FreeNAS server.
All servers are connected to two Ubiquity switches, an 1 Gbit switch and a 10Gbit switch.
The 1 Gbit switch is used for the management interface, and the 10 Gbit for a SAN and eventually also for office connections.
I have a separate VLAN for SAN (VLAN80) and a VLAN for the office connection.
My problem is that I can’t ping all XCP-ng server or some VM’s running on those server over the SAN VLAN 80. I can ping all servers over the management interfaces.
For instance I can ping the following:
- 172.16.8.2 (FreeNAS) to 172.16.8.3 (XCP-ng)
- 172.16.8.2 (FreeNAS) to 172.16.8.4 (XCP-ng)
- 172.16.8.2 (FreeNAS) to 172.16.8.101 (Debinan VM @ 172.16.8.5)
- 172.16.8.5 ((XCP-ng) to 172.16.8.3 (XCP-ng)
- 172.16.8.5 ((XCP-ng) to 172.16.8.4 (XCP-ng)
- 172.16.8.5 ((XCP-ng) to 172.16.8.33 (Debinan VM @ 172.16.8.3)
- 172.16.8.5 ((XCP-ng) to 172.16.8.101 (Debinan VM @ 172.16.8.5)
But I CAN’T ping the following:
- 172.16.8.2 (FreeNAS) to 172.16.8.5 (XCP-ng)
- 172.16.8.2 (FreeNAS) to 172.16.8.33 (Debinan VM @ 172.16.8.3)
Yesterday I could ping form .8.2 to .8.33, but after some reboots I can’t anymore.
I’m running FreeNAS 11.3u1 and XCP-ng 8.1 RC1.
I chose the RC1 of 8.1 because we are building a new Server stack and I did not want to have to upgrade to a newer XCP-ng right after we were done setting up, and I anticipate the 8.1 will be final before we are completely done setting everyting up.
The Ubiquity switch are all configured with the correct VLAN’s.
I also set the MTU for the 10GBit interfaces to 9000, and enabled jumbo frames on the switches.
Has any one else had the same problem were some hosts on a vlan can’t be contacted by FreeNAS?
Below is a simple network diagram: