[Solved] Losing Local Routing at Around 0400

[rhubarb]

Not every night but almost, I am losing local routing around 0400, and it knocks my cameras offline. Following are my General Logs.

It takes a few minutes to return to normal and everything works for 24 or 48 hours.

There are no cron jobs at this time.

Advice would be appreciated.

2021-05-15T03:58:59   kernel   pflog0: promiscuous mode enabled   
2021-05-15T03:58:59   kernel   pflog0: promiscuous mode disabled   
2021-05-15T03:58:58   opnsense[91295]   /usr/local/etc/rc.filter_configure: ROUTING: keeping current default gateway 'xxx.xxx.176.1'   
2021-05-15T03:58:49   kernel   pflog0: promiscuous mode enabled   
2021-05-15T03:58:49   kernel   pflog0: promiscuous mode disabled   
2021-05-15T03:58:47   opnsense[801]   /usr/local/etc/rc.filter_configure: Ignore down inet6 gateways : PIAUSTX_VPNV4   
2021-05-15T03:58:47   opnsense[801]   /usr/local/etc/rc.filter_configure: ROUTING: keeping current default gateway 'xxx.xxx.176.1'   
2021-05-15T03:58:47   opnsense[801]   /usr/local/etc/rc.filter_configure: Ignore down inet gateways : PIAUSTX_VPNV4   
2021-05-15T03:58:46   kernel   pflog0: promiscuous mode enabled   
2021-05-15T03:58:46   kernel   pflog0: promiscuous mode disabled   
2021-05-15T03:58:45   opnsense[48654]   /usr/local/etc/rc.filter_configure: Ignore down inet6 gateways : PIAUSTX_VPNV4   
2021-05-15T03:58:45   opnsense[48654]   /usr/local/etc/rc.filter_configure: ROUTING: keeping current default gateway 'xxx.xxx.176.1'   
2021-05-15T03:58:45   opnsense[48654]   /usr/local/etc/rc.filter_configure: Ignore down inet gateways : PIAUSTX_VPNV4   
2021-05-15T03:57:41   kernel   pflog0: promiscuous mode enabled   
2021-05-15T03:57:41   kernel   pflog0: promiscuous mode disabled   
2021-05-15T03:57:40   opnsense[24697]   /usr/local/etc/rc.filter_configure: Ignore down inet6 gateways : WAN_DHCP,PROTONCO7_VPNV4,PIAUSTX_VPNV4   
2021-05-15T03:57:40   opnsense[24697]   /usr/local/etc/rc.filter_configure: Ignore down inet gateways : WAN_DHCP,PROTONCO7_VPNV4,PIAUSTX_VPNV4   
2021-05-15T03:57:39   kernel   pflog0: promiscuous mode enabled   
2021-05-15T03:57:39   kernel   pflog0: promiscuous mode disabled   
2021-05-15T03:57:37   opnsense[41353]   /usr/local/etc/rc.filter_configure: Ignore down inet6 gateways : PROTONCO7_VPNV4,PIAUSTX_VPNV4   
2021-05-15T03:57:37   opnsense[41353]   /usr/local/etc/rc.filter_configure: ROUTING: keeping current default gateway 'xxx.xxx.176.1'   
2021-05-15T03:57:37   opnsense[41353]   /usr/local/etc/rc.filter_configure: Ignore down inet gateways : PROTONCO7_VPNV4,PIAUSTX_VPNV4   
2021-05-15T03:57:37   kernel   pflog0: promiscuous mode enabled   
2021-05-15T03:57:37   kernel   pflog0: promiscuous mode disabled   
2021-05-15T03:57:36   opnsense[79105]   /usr/local/etc/rc.filter_configure: Ignore down inet6 gateways : PROTONCO7_VPNV4,PIAUSTX_VPNV4   
2021-05-15T03:57:36   opnsense[79105]   /usr/local/etc/rc.filter_configure: ROUTING: keeping current default gateway 'xxx.xxx.176.1'   
2021-05-15T03:57:36   opnsense[79105]   /usr/local/etc/rc.filter_configure: Ignore down inet gateways : PROTONCO7_VPNV4,PIAUSTX_VPNV4

[rhubarb]

This problem continues. 

It appears to only happen when there is a problem with a gateway.  I use a gateway group.  When an issue arises with a gateway, it causes VLAN -> VLAN routing to also fail.  I have one rule on that VLAN to allow traffic to my DVR and has Gateway set to Default.

Why would a Gateway problem affect local routing?

[rhubarb]

I think this was an issue with Unifi cameras not doing proper TCP when states get reset.  I put them on the same VLAN to circumvent the issue.