[Solved] Xcp-ng pfsense vlan slow speed

Networking & Firewalls
1

Hi all, hope to get some help here.
running pfsense 2.5 on xcp-ng 8.2 on this hardware https://www.supermicro.com/en/products/system/1U/5019/SYS-5019C-FL.cfm
My internet speed is 300Mb/s

created VLANs on the xcp-ng side, configured DHCP server, and firewall on pfsense, able to connect to my VLANs and receive a proper IP.
So on the main LAN under the VPN speed test shows ~280Mb/s
If I connect to any VLAN, the speed test at the very beginning shows ~250Mb/s and then drops to ~90Mb/s
TX checksum is disabled.
Speed between xcp-ng and pfsense is:

[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 6.56 GBytes 5.64 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 6.56 GBytes 5.64 Gbits/sec receiver

iperf between wifi client connected to the VLAN and pfsense

Connecting to host 192.168.168.1, port 5201
[ 5] local 192.168.20.128 port 58425 connected to 192.168.168.1 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 23.5 MBytes 197 Mbits/sec
[ 5] 1.00-2.00 sec 26.6 MBytes 224 Mbits/sec
[ 5] 2.00-3.00 sec 23.6 MBytes 198 Mbits/sec
[ 5] 3.00-4.00 sec 25.5 MBytes 214 Mbits/sec
[ 5] 4.00-5.00 sec 24.9 MBytes 209 Mbits/sec
[ 5] 5.00-6.00 sec 24.8 MBytes 208 Mbits/sec
[ 5] 6.00-7.00 sec 24.1 MBytes 203 Mbits/sec
[ 5] 7.00-8.00 sec 23.8 MBytes 200 Mbits/sec
[ 5] 8.00-9.00 sec 26.5 MBytes 223 Mbits/sec
[ 5] 9.00-10.00 sec 24.9 MBytes 209 Mbits/sec

[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 248 MBytes 208 Mbits/sec sender
[ 5] 0.00-10.01 sec 248 MBytes 208 Mbits/sec receiver

iperf between wifi client on the main network and pfsense

[ 5] local 192.168.168.163 port 58164 connected to 192.168.168.1 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 37.3 MBytes 313 Mbits/sec
[ 5] 1.00-2.00 sec 37.8 MBytes 317 Mbits/sec
[ 5] 2.00-3.00 sec 38.2 MBytes 320 Mbits/sec
[ 5] 3.00-4.00 sec 38.2 MBytes 320 Mbits/sec
[ 5] 4.00-5.00 sec 38.6 MBytes 324 Mbits/sec
[ 5] 5.00-6.00 sec 37.6 MBytes 315 Mbits/sec
[ 5] 6.00-7.00 sec 37.6 MBytes 315 Mbits/sec
[ 5] 7.00-8.00 sec 37.2 MBytes 312 Mbits/sec
[ 5] 8.00-9.00 sec 37.9 MBytes 318 Mbits/sec
[ 5] 9.00-10.00 sec 36.1 MBytes 303 Mbits/sec

[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 376 MBytes 316 Mbits/sec sender
[ 5] 0.00-10.01 sec 376 MBytes 315 Mbits/sec receiver

from the wired client, there is no issue Oo

nuc@server:~$ hostname -I
192.168.20.130 172.17.0.1 172.20.0.1
nuc@server:~$ iperf3 -c 192.168.168.1
Connecting to host 192.168.168.1, port 5201
[ 5] local 192.168.20.130 port 56916 connected to 192.168.168.1 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 112 MBytes 940 Mbits/sec 0 445 KBytes
[ 5] 1.00-2.00 sec 112 MBytes 940 Mbits/sec 0 522 KBytes
[ 5] 2.00-3.00 sec 112 MBytes 936 Mbits/sec 0 522 KBytes
[ 5] 3.00-4.00 sec 110 MBytes 926 Mbits/sec 0 522 KBytes
[ 5] 4.00-5.00 sec 112 MBytes 942 Mbits/sec 0 522 KBytes
[ 5] 5.00-6.00 sec 110 MBytes 927 Mbits/sec 0 522 KBytes
[ 5] 6.00-7.00 sec 105 MBytes 881 Mbits/sec 0 783 KBytes
[ 5] 7.00-8.00 sec 111 MBytes 933 Mbits/sec 0 783 KBytes
[ 5] 8.00-9.00 sec 112 MBytes 944 Mbits/sec 0 783 KBytes
[ 5] 9.00-10.00 sec 111 MBytes 933 Mbits/sec 0 783 KBytes

[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.08 GBytes 930 Mbits/sec 0 sender
[ 5] 0.00-10.00 sec 1.08 GBytes 927 Mbits/sec receiver

iperf Done.
nuc@server:~$ speedtest

Speedtest by Ookla

 Server: Petroinform.net - Krakow (id = 28324)
    ISP: Firma Handlowa Giga Arkadiusz Kocma
Latency:     5.07 ms   (0.71 ms jitter)

Download: 245.84 Mbps (data used: 142.0 MB)
Upload: 29.56 Mbps (data used: 13.8 MB)
Packet Loss: 0.0%

Looks like this strange issue affects only WIFI clients.

Problem solved - AP was configured like Per-SSID 90Mbps :grinning:

2

At work they have the AP’s configured to 72mbps per client, which still probably swamps the switch they are all connected into since it only has a 10gb uplink to the core.

3

It is a home network, so no issues