Messages

We have two GoWin GW-BS-1UR2-25G:
https://www.gowinfanless.com/products/network-device/1u-2u-server/gw-bs-1ur2-25g

It seems there is a bug in the ConnectX-4 Lx driver for FreeBSD.  Broadcasts are looped back to themselves so CARP won't work in multicast.

Symptoms: Both devices will stay in CARP Backup when using multicast and neither will become Master.  Switching to unicast allows CARP to work.

Constant Duplicate Address Detected (DAD) message in system log:
2025-04-13T09:37:45-07:00 <hostname goes here) kernel - - [meta sequenceId="1585"] <3>mce0: a looped back NS message is detected during DAD for fe80:a::526b:4bff:fef0:8058.  Another DAD probes are being sent.
<13>1 2025-04-13T09:37:47-07:00 <hostname goes here) kernel - - [meta sequenceId="1586"] <3>mce1: a looped back NS message is detected during DAD for fe80:b::526b:4bff:fef0:8059.  Another DAD probes are being sent.

Pinging the CARP IP results in a DUP! message.

Links I found with problems:
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=270859 (Disabling SRV-IO did not work for me)
https://network.nvidia.com/pdf/prod_software/Mellanox_FreeBSD_Release_Notes_3.0.0.pdf

Anyone know of any workarounds for the broadcast problem with the Mellanox ConnectX-4?

I'm currently on Starlink using the 40GB Business Priority plan which gives me a IPv6 /56 block and a single public IPv4 address.  Due to them changing my plan in 28 days that will force me to go behind CG-NAT, I need to come up with a solution that will allow external access to my server. 

There were a lot of recommendations to use Tailscale which I just go into this morning.  It solves a few of my problems but not for external access to my server.

So I initially thought I could go with something like NordVPN and a static IPv4 IP.  Got that all set up in Opnsense and found out I cannot port forward traffic down the VPN to my firewall.  So that's out.

Searching for VPNs that support port forwarding I found PIA VPN and that offers port forwarding.  But you have to use special scripts to make use of it, at least on PFSense.  Is there a VPN service that offers a public IPv4 IP and will port forward all traffic to a specific host?

Ideally, since I get a IPv6 /56 block from Starlink, if there was some service that would do a IPv4 to IPv6 gateway that would be ideal, but I could not find such a service.

All my DNS is on HE.net and I use them also for Dynamic DNS.

Thoughts?  Suggestions?

Set the "Optional Interface ID" (under "Track IPv6 Interface" in the Interface settings) to 1.

Perfect, thank you.

I have delegated IPv6 working from my WAN to my LAN.  The WAN receives a /56 delegated range.  The LAN interface is configured to Track the WAN interface to get it's delegated IPv6 /64 range.  Everything seems mostly happy.  My only issue is that I can't seem to figure out a way to manually assign suffix IP of the LAN interface. For example, my prefix is 2605:1111:2222:a300 and my suffix IP is: ::aab8:e0ff:fe01:e172 so the IP address for the LAN interface would be: 2605:1111:2222:a300:aab8:e0ff:fe01:e172.  I want to manually assign the suffix so it will be something like this: 2605:1111:2222:a300::1.

I've been going down a rabbit hole for hours trying to solve this.  Any ideas on what I'm missing?