I’m looking for a little advice. I just converged 3 much smaller 4-disk physical NAS boxes (previously running Truenas SCALE 24.10) into a single refurbished 24-bay Supermicro SSG-6028R-E1CR24N running Truenas SCALE 25.04.0. I did this primarily for the 10Gbe SFP+ that it has built-in and to consolidate physical space, management, and rack-mounted goodness. Everything is fine and the host IS working at 10Gbe on both SFP+ ports. Other hardware in the mix is a TP-Link Omada SG3428X switch and a Netgate SG-4100 pfSense appliance handling all the VLAN and network traffic and all flashed with their respective latest release versions of firmware.
So, here’s my problem: I’m trying to change the network on the new-to-me Truenas host from 2 discreet ens5f0 & ens5f1 10GBe connections to a bridged network connection (no LAGG groups, just a br0) so I can run a single VM on the Truenas host that can communicate with the Truenas host itself. I don’t have any issue creating the virtual bridge on the host; what happens is, as soon as I tell Truenas to “test” the new configuration, my entire network goes down. By entire network, I’m talking about IoT devices on VLANs that don’t connect to Truenas at all, desktops, wifi, even some smart appliances (also on their own VLAN). The network DOES come back up after 2 or 3 minutes, once Truenas determines that the “test” phase isn’t successful and takes down the newly configured br0. I’ve reached out in the Truenas forums: Link to thread on Truenas forum, but so far everything is focused on the br0 creation itself and not any other potential causes for this weird behavior.
Other steps I’ve taken are to remove one of the SFP+ transceivers to use a single port (same results - network dies for that same 2-3 minutes), and even disconnecting the network entirely and doing the bridge creation via the BMC/IPMI console & CLI tools on Truenas, then plugging in the SFP+ transceivers to bring it up on the network; again, the network dies as soon as I plug in the first SFP+ transceiver.
My question is, what other places might I need to start looking at? Port settings on the switch? Something in pfSense? Could it even be the SFP+ modules themself? Is there something Truenas does differently with the br0 network that isn’t done on the “for lack of better terms” RAW ens5f0/ens5f1 networks directly?
Any help steering me in any direction that could help identify where/what might be happening would result in me owing you a full case of !
Thanks in advance for ANY suggestions!