Messages

1

General Discussion / Re: Intermittent connectivity issues with LAN interface

« on: December 15, 2023, 08:30:34 pm »

When physical interfaces are bonded or bridged, they form one logical interface that only extends over more than one physical link. What you try to do is two logical interfaces with the same subnet. This happens on another OSI layer.

There must be routing in place between logical interfaces - how could that work if both have the same IP range?

Static routes with priority weighting.

This is basic networking knowledge. It won't work like you tried. Period.

It does in fact work.

Both when one interface is connected and when both are.

The issue is that after multiple days one will become unresponsive; then plugging in the other wakes up the former. So will concede that perhaps the config is causing some kind of issue with the routing engine that takes numerous days to manifest.

Thanks for the response.

2

General Discussion / Re: Intermittent connectivity issues with LAN interface

« on: December 15, 2023, 12:16:24 pm »

You cannot have two interfaces with different IP addresses in the same network. That explains all your problems.

Why is this? Please, elaborate.

Whilst not present in my config/setup right now, there can be bonded/grouped interfaces and 1 network across multiple NICs.

Understood that the way in which I've configured my setup is non-standard, which may lead to some unexpected problems. I wouldn't have thought this would be the culprit; but I guess such is the nature of unexpected problems! 

The original plan (and current implementation) was to have only the WebUI and management aspects be performed off the MGMT interface; with other equipment in my network performing the vlan separation. As mentioned before I was thinking of removing this interface altogether for simplicity - but have made a slight change to the power configuration (was on 'hiadaptive', but now set to 'maximum') and will soak test for a few days.

If the problem returns, I'll swap MGMT to another address range and test again.

3

General Discussion / Re: Intermittent connectivity issues with LAN interface

« on: December 15, 2023, 11:46:47 am »

All, further to the below, the logs from the DHCPv4 service are of interest.

For note, I'm running this service on re1 (LAN) interface, but not em0 (MGMT) interface. Understood the reasons that it might display a warning about a possible collision; but wouldn't think an ERROR is the right logging level/tag.

I was considering removing the MGMT interface entirely, but it has come in handy when "resolving" this issue.

Date           Severity            Process      Line
2023-12-15T18:07:22   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T18:07:22   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:56:14   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:56:14   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:47:03   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:47:03   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:46:59   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:46:59   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:34:07   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:34:07   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:33:48   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:33:48   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:33:39   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:33:39   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T17:33:17   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T17:33:17   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T16:59:24   Error   dhcpd   icmp_echorequest 192.168.1.136: Network is down   
2023-12-15T16:56:10   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0   
2023-12-15T16:56:10   Error   dhcpd   Multiple interfaces match the same subnet: re1 em0   
2023-12-15T16:55:50   Error   dhcpd   Multiple interfaces match the same shared network: re1 em0

Furthermore, seems to be a commonly shared problem - noting a few other forum posts, which leads me to think this is a result from a default/out-of-the-box config somewhere.

4

General Discussion / Re: Intermittent connectivity issues with LAN interface

« on: December 15, 2023, 08:35:06 am »

I should note that MGMT is defined as 'opt1(em0)'

5

General Discussion / Re: Intermittent connectivity issues with LAN interface

« on: December 15, 2023, 08:34:29 am »

Dump from the system logs > general

Date                          Severity    Process       Line
2023-12-15T18:10:14   Notice   kernel   <6>em0: link state changed to DOWN   
2023-12-15T18:10:14   Notice   opnsense   /usr/local/etc/rc.linkup: DEVD: Ethernet detached event for opt1(em0)   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure dns (execute task : unbound_configure_do())   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure dns (execute task : dnsmasq_configure_do())   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure dns ()   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure dhcp (execute task : dhcpd_dhcp_configure())   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure dhcp ()   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure ipsec (execute task : ipsec_configure_do(,opt1))   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: plugins_configure ipsec (,opt1)   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: ROUTING: entering configure using 'opt1'   
2023-12-15T18:07:22   Notice   kernel   <6>em0: link state changed to UP   
2023-12-15T18:07:22   Notice   opnsense   /usr/local/etc/rc.linkup: DEVD: Ethernet attached event for opt1(em0)

6

General Discussion / Intermittent connectivity issues with LAN interface

« on: December 15, 2023, 08:27:17 am »

Hi all,

Fairly new to OPNsense - so this issue could just be a config error on my part, but equally I'm wondering if something funky is going on with my interface cards.

Setup is as follows:

Dell Optiplex running OPNsense 23.7.10_1 and three interfaces; the motherboard is MGMT and there are two 1Gbps StarTech interface cards plugged into the PCIe slots (one as LAN and the other as WAN).

Both LAN and MGMT share the same IP space (192.168.1.1, with MGMT being .200 and LAN being .249).

The WAN setup is solid - RJ45 runs into a modem which is set up in bridge mode and OPNsense performs PPoE flawlessly.

The issue is on the LAN side, which also serves up DHCP. Now all clients can get addresses assigned, no problem there. But occassionally the gateway (192.168.1.249) becomes unresponsive and will stop passing traffic, won't respond to ICMP, can't raise the webUI, etc.

Until I plug in MGMT and then everything returns to normal. Not only can I hit .200 and pull up the webUI, but clients will start communicating with internet resources again.... The first few times this happened, I thought I had some kind of routing issue and that MGMT interface was acting as a gateway (and that clients were passing through it to get out the WAN), but I can disconnect the MGMT link and traffic still passes.

It's like the LAN address space is sleeping or something and that connecting in another link via the MGMT port wakes it up.

Ive scoured the config, but can't find anything obvious - perhaps there's a setting somewhere that I've missed?

7

General Discussion / Re: OPNSense Update - No route to host

« on: December 12, 2023, 06:50:54 am »

Hi Jimbeam128,

I had a very similar problem today, but managed to get it resolved with some of the info here and making some config changes - perhaps what I did will help you or some others.

In short, I had to update the 'point-to-point' devices to select my WAN port as the PPPoE interface. This was done by editing the PPPoE interface under 'Interfaces > Point-to-point > Devices' and then changing the 'Link Interfaces' to that of both my 'WAN' and the physical adapter (re0, in my instance).

The longer version is that the setup wizard when i first commissioned the box had also assigned a IPv6 config (or perhaps I'd accidentally set it, can't recall). Either way I'd had both a IPv4 and IPv6 config on my WAN since first run and whilst the tunnel would establish - it was creating some issues with connectivity (OPNsense updating was one of those).

After finding this thread I thought I'll clear up my stale IPv6 config once and for all; but didn't follow the cardinal rule......take a backup first! So this lead me down a ~30 minute rabbit hole to try and diagnose why the PPPoE config in the 'Interfaces > WAN' page was correct, but not establishing. It wasn't until I tried the 'Advances and MLPPP' link that lead me through to 'Interfaces > Point-to-point > Devices' that I saw the PPPoE interface was only bound to /dev/cu2. A quick edit to that config and connectivity resolved immediately.

Returning to perform a package update - the mirror addresses resolved straight away and updates are flowing! (for note, migrating from v23.1 to v23.7.9).

Might not fix your issue - but thought I'd mention what worked for me.