Disconnection of physical port igc1 LAN2

[Robertomcat]

Hello, good morning.

Yesterday for the first time I installed OPNsense on a dedicated mini PC with four network interfaces.
The configuration is as follows:
igc3 WAN via DHCP
igc2 LAN1 192.168.1.1
igc1 LAN2 192.168.10.1

I was checking that everything was working correctly, and I was really happy because I would think that I would have some problem in the configuration, but it went very well.

The computers that are on LAN2 have static IP addresses through the MAC. To this same LAN2 I put a rule in the firewall so that they could not connect to LAN1, as well as they could not have access to the graphical interface of the router, by blocking the IP address, and I could verify that everything worked correctly, since connecting through the Windows remote desktop to the other computers, I could not access the graphical interface through the browser.

I also created some IPS rules and was able to verify that everything was still working correctly.

But this morning when I tried to access with the Windows remote desktop to the computers on LAN2 while my computer was on LAN1, I got no response, and then I checked that the eight computers that are on LAN2 igc1 have disappeared from the ARP table. From the igc2 LAN1 interface I do not have any Internet problems.

I do not know how to interpret the logs, but from these logs that I put below, the Link down - Link up started to appear. What could have been the problem?

(At the moment I was going to publish this message, I disconnected and connected the unmanaged switch Cisco CBS100 16p directly connected to the router port igc1 LAN2, and automatically I had access to the network and all the devices appeared in the ARP table).

Code Select Expand

2024-08-29T15:52:19 Notice kernel <6>igc1: link state changed to DOWN
2024-08-29T15:52:19 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for opt1(igc1)
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns ()
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp ()
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,opt1))
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (,opt1)
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: ROUTING: entering configure using 'opt1'
2024-08-29T15:51:58 Notice kernel <6>igc1: link state changed to UP
2024-08-29T15:51:58 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for opt1(igc1)
2024-08-29T15:51:45 Notice kernel <6>igc1: link state changed to DOWN
2024-08-29T15:51:45 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for opt1(igc1)
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns ()
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp ()
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,opt1))
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (,opt1)
2024-08-29T15:51:08 Notice kernel <6>igc1: link state changed to UP
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: ROUTING: entering configure using 'opt1'
2024-08-29T15:51:08 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for opt1(igc1)
2024-08-29T15:51:02 Notice kernel <6>igc1: link state changed to DOWN
2024-08-29T15:51:02 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for opt1(igc1)
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns ()
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp ()
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,opt1))
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (,opt1)
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: ROUTING: entering configure using 'opt1'
2024-08-29T15:50:31 Notice kernel <6>igc1: link state changed to UP
2024-08-29T15:50:31 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for opt1(igc1)
2024-08-29T15:50:26 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for opt1(igc1)
2024-08-29T15:50:25 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())
2024-08-29T15:50:25 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())
2024-08-29T15:50:25 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns ()
2024-08-29T15:50:24 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
2024-08-29T15:50:24 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp ()
2024-08-29T15:50:24 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,opt1))
2024-08-29T15:50:24 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (,opt1)
2024-08-29T15:50:24 Notice opnsense /usr/local/etc/rc.linkup: ROUTING: entering configure using 'opt1'
2024-08-29T15:50:24 Notice kernel <6>igc1: link state changed to DOWN
2024-08-29T15:50:24 Notice kernel <6>igc1: link state changed to UP
2024-08-29T15:50:24 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for opt1(igc1)
2024-08-29T15:50:19 Notice kernel <6>igc1: link state changed to DOWN
2024-08-29T15:50:19 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for opt1(igc1)
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dns ()
2024-08-29T15:46:40 Notice kernel <6>igc1: link state changed to UP
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure dhcp ()
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,opt1))
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: plugins_configure ipsec (,opt1)
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: ROUTING: entering configure using 'opt1'
2024-08-29T15:46:40 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for opt1(igc1)
2024-08-29T15:44:31 Notice kernel <6>igc2: link state changed to DOWN
2024-08-29T15:44:31 Notice opnsense /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for lan(igc2)
2024-08-29T23:38:55 Notice kernel <118>               XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
2024-08-29T23:38:55 Notice kernel <118> HTTPS: sha256 XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
2024-08-29T23:38:55 Notice kernel <118>
2024-08-29T23:38:55 Notice kernel <118> WIFImenjador (igc0) -> v4: 192.168.2.1/24
2024-08-29T23:38:55 Notice kernel <118> WAN (igc3)      -> v4/DHCP4: XXXXXXXXXXXXX
2024-08-29T23:38:55 Notice kernel <118> MQL5 (igc1)     -> v4: 192.168.10.1/24
2024-08-29T23:38:55 Notice kernel <118> LAN (igc2)      -> v4: 192.168.1.1/24
2024-08-29T23:38:55 Notice kernel <118>
2024-08-29T23:38:55 Notice kernel <118>*** OPNsense.localdomain: OPNsense 24.7 ***
2024-08-29T23:38:55 Notice kernel <118>
2024-08-29T23:38:54 Notice kernel <118>Thu Aug 29 23:38:54 CEST 2024
2024-08-29T23:38:54 Notice kernel <118>Root file system: zroot/ROOT/default
2024-08-29T23:38:53 Error opnsense /usr/local/etc/rc.newwanip: The command '/usr/sbin/daemon -f -p '/var/run/updaterrd.pid' '/var/db/rrd/updaterrd.sh'' returned exit code '3', the output was 'daemon: process already running, pid: 13317'
2024-08-29T23:38:53 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : wireguard_sync(,wan))
2024-08-29T23:38:53 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : webgui_configure_do(,wan))
2024-08-29T23:38:53 Notice opnsense /usr/local/etc/rc.newwanip: plugins_configure newwanip (execute task : vxlan_configure_do())

[dseven]

Something to do with the physical link between the NIC and the switch. If it keeps happening, try a different cable, different switch port, the fourth NIC on the mini-PC, different switch (if you have one)....

[Robertomcat]

Something to do with the physical link between the NIC and the switch. If it keeps happening, try a different cable, different switch port, the fourth NIC on the mini-PC, different switch (if you have one)....

The thing is, when I turned off the power cord to the switch and plugged it back in, everything went back to normal. All afternoon yesterday it was working without any problem, as it is now after rebooting the switch. :(

[dseven]

Could be something marginal in the connection, and once it fails, it requires a reset to bring the link back up. It's always tricky when the issue relates to the physical link between devices - especially an unmanaged switch, as you can't really tell much about what's going on on that end of the link.

[dseven]

There is this, too: https://forum.opnsense.org/index.php?topic=42240.0

[Robertomcat]

There is this, too: https://forum.opnsense.org/index.php?topic=42240.0

Yes, the topic seems interesting and could be a solution. The hardware where I have installed OPNsense is new, so the BIOS configuration could be a solution (if in the BIOS there is the ASPM configuration). The device has been running for two days now and this problem I reported here has not happened to me so far. I'll have to wait a few days to see if it happens again or it has simply been solved by turning the switch off and on. Thanks for the link.