Forcing haproxy frontend to use specific gateway

Good evening.

So i hit a brick wall with haproxy. I want to expose a few things but i dont want to expose it on my home connection so i got pfsense running in a digital ocean droplet. My router (also pfsense, acting as client) connects to the droplet (server) via openvpn and everything works as it should. Except haproxy, for some reason even though its bound to the vpn address it replies through the wan interface instead of the VPN. Tried to use a floating rule to force everything originating from the vpn address to use the vpn tunnel gateway but for some reason replies still go out through the wan…

Im pretty much out of ideas and google didnt help much.