Don't use bridge and CARP on the same interface!

[ednt]

We ran in a strange situation.

A working HA OPNsense installiation with master and slave (worked for 4 weeks without any problem).

Suddenly the master freezes latest after half an our of operation.

And if I say freeze, I mean freeze: no further input possible, no messages, nothing.
Since something like this can happen only by kernel stuff or by a big hardware failure we first completely changed the hardware.
No effect.

We went back to 20.1.0.
No effect.

After long time of searching we found:

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=200319

There is a bug in combination of CARP and bridge on the same interface.
And we added a bridge to reach our old server farm. 

The bad thing is that this bug is still available in FreeBSD 12.
So the bug is not fixed since 2015-05-19

This is more horrible than the qlogic driver problem of FreeBSD.
(Since we use HP servers and HP network card with qlogic chip, we are affected)
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=226217

We fixed this with a crontab entry @reboot.

Hope this helps someone to save time searching for this kind of problem.

[franco]

Hi there,

This is interesting how at least 4 people involved have been or are employed by pfSense since 2015... proposing working fixes and blocking them at the same time. *shrugs*

https://reviews.freebsd.org/D3133

And thanks for pointing out the issue to your crashes tot he community!


Cheers,
Franco