I was able to fix this by:
- Switching virtual box network for the vm from NAT to Bridged
- Setting a static ip in opnsense for the new connection
- Adjusting other software to use the new ip