LAGG flapping at regular time intervals

[nero355]

update - I can confirm there might be an interoperability problem with Mikrotik devices and FreeBSD/OPNsense concerning LACP.

Since I changed the LACP timeout from 1s/fast to 30s/slow on both sides and disabled "strict" mode on the OPNsense side the connection now seems to be stable.
On the Mikrotik side there is nothing to adjust but the timeout. I also disabled flowid explicitly on OPNsense but if I am not mistaken that was the default all the time, anyway.

I think I can confirm this :

Yea the fast timeout cross vendor is always problematic.
This is not only applying for FBSD & Mikrotik, but as well other vendors.

When I use to build a lot of Linux Bonding LACP links we use to set this :

bond-lacp-rate rate
Denotes the rate of LACPDU requested from the peer.
The rate can be given as string or as numerical value.

Valid values are slow (0) and fast (1). The default is slow.

To SLOW too :)

And this :

bond-miimon interval
Denotes the MII link monitoring frequency in milliseconds.
This determines how often the link state of each slave is inspected for link failures.

A value of zero disables MII link monitoring. The default is 0.

Was always set at 100 IIRC...

_{Source : https://manpages.ubuntu.com/manpages/jammy/man5/interfaces-bond.5.html}

[Seimus]

Fast timeout is pain in Enterprise too.
At one point I had enough and enforced across company to use timeout slow (30s) for cross vendor connections.

Because the fast was constantly causing for example FW switchovers and other nonsense....

And thats the reason its in OPNsense docs too cause I was crying to Cedrik when he was writing it :)
https://github.com/opnsense/docs/pull/610#issuecomment-2424144823

Regards,
S.