Messages

1

24.7 Production Series / Re: [SOLVED] Intel I226-V NICs going down randomly without obvious reason

« on: August 31, 2024, 12:39:46 pm »

Small Update on this thread, seems like intel did an upstream fix of the issue related to i-226-x ethernet controllers, watch out for new BIOS versions, my oem (Shuttle) released one in July which resolved ALL issues with stability (NIC's going down etc.).

2

24.7 Production Series / Re: Weird network behaviour

« on: August 29, 2024, 05:07:09 pm »

Little Update here,

@imk82
I don't know how much to thank you, but the BIOS update for the faulty i226 ethernet ports actually solved my issues, I did actually search for a bios update, but before the new version was released .

3

24.7 Production Series / Re: Weird network behaviour

« on: August 28, 2024, 09:15:51 am »

Thanks!

It's called Uptime - Kuma, https://github.com/louislam/uptime-kuma

4

24.7 Production Series / Re: Weird network behaviour

« on: August 28, 2024, 07:10:40 am »

Thanks for the idea with the LAN Ports, due to the BSD issue, I came on the path with the BIOS, and there is actually a new Bios update online, since around a Month, with you call it, "Improved LAN stability"

https://global.shuttle.com/products/productsDownload?pn=DL30N%20SERIES

At least I got lucky, when choosing the vendor.
I'll first test the bios, then later check on the power options.

5

24.7 Production Series / Re: Weird network behaviour

« on: August 28, 2024, 07:04:28 am »

Thanks imk82

That is fitting my exact scenario very well, for me it also occured after switching to a Intel N100 based Mini-PC, with Intel NIC's, also for me it surprisingly often occurs when there is high load on the LAN interface. Also funnily enough I also have Intel-i226-LM NIC's.

I'll update as soon as I could look at the bios.

Hi Gauss23
Thanks for the suggestion with SPanning-Tree-Protocol, I don't have anything particularly set up in this direction.
As I don't have a console cable, I can only guess here, but mostly the opnsense seems online, just really sluggish, and sometimes not on all interfaces.

6

24.7 Production Series / Re: [SOLVED] Intel I226-V NICs going down randomly without obvious reason

« on: August 28, 2024, 06:57:30 am »

Thanks!

Seems I have the exact same problem!

7

24.7 Production Series / Re: Weird network behaviour

« on: August 27, 2024, 05:39:55 pm »

Issue definitely keep occurring, I now have to physically reboot my opnsense around every 5 hours.

Most likely it's always the opnsense that becomes offline first, then my other Proxmox Nodes all become really sluggish, reachable/the other second not, login through proxmox webgui is then mostly not possible etc.

This seems really odd to me, where could I start to debug this?

Is that some package/ip conflict?
Hardware fault? (Opnsense has Intel NIC's and manufacturer labeled as opnsense good)
Config Error?
Problems with other Networking gear?
Problem with VLANs?

I can't seem to find any real trace here, not even any of the debug logs on opnsense tell me anything.
Also weirdly enough, all my web-applications, that are proxied through my reverseproxy are always online and fully accessible (except opnsense).

has anyone some idea where I could start?

8

24.7 Production Series / Re: Weird network behaviour

« on: August 25, 2024, 11:44:28 am »

So I've just further looked into this and even physically replaced the suspected broken switch.

After replacing the switch, the issue kep occuring, so I can now definitely say that opnsense is the problem.

Anyone got ideas on how to further troubleshoot here?

9

24.7 Production Series / Re: Weird network behaviour

« on: August 22, 2024, 07:31:26 pm »

Hi

Yeah you are right!

Sorry about that, the images embed di not work correctly due to me not using the correct RAW iamge url, just fixed it.

Edit: altough the uptime-kuma board shows they are partually online, they are inaccessible for a normal browser, during that time.

For the reverse proxy, it's run inside a LXC inside Proxmox with an IP inside VLAN 20, it's nginxreverseproxy.

Feel free to let me know what else I shall provide.

10

24.7 Production Series / Re: Weird network behaviour

« on: August 22, 2024, 05:23:26 pm »

Well what else could it be then?

Can't really imagine of the hosts themselves bening the problem here.

I imagined the switch, but could not get a single idea, even with the help of cisco support/forum.

11

24.7 Production Series / Re: Weird network behaviour

« on: August 22, 2024, 05:07:31 pm »

Thanks!

Yes that's exactly how I set it up.

Also there are no unassigned interfaces.

Any other ideas, how I could further troubleshoot these weird issues ?

12

24.7 Production Series / Re: Weird network behaviour

« on: August 22, 2024, 07:01:00 am »

Hi Cookiemonster, thanks for your reply!

What's the best view to see that?

I've wanted to do that as well, however due to the nature of proxmox, that runs on the same Port as the VM's / LXC's will run, I had issues in getting Proxmox itself work in a VLAN with only 1 LAN connection.

Also I'm not really sure if it has to do with the VLAN, I just noticed, that the devices in VLAN 1 are getting somewhat inaccessible.

To my opnsense node:
https://www.shuttle.eu/de/products/slim/dl30n
Intel N100
16 GB DDR5
2x 2.5GB Intel Ports

13

24.7 Production Series / Re: OPNsense suddenly unreachable - How to debug

« on: August 21, 2024, 08:03:05 pm »

What are the boot logs showing?

14

24.7 Production Series / [SOLVED] Weird network behaviour

« on: August 21, 2024, 08:01:13 pm »

Hi

I'm experiencing some weird network issues, a part of my homelab behind opnsense becomes incassible almost daily.
I'm trying to wrap my head around this for weeks.

Nearly daily everything in my VLAN 1 (so default network) behind opnsense becomes inacessible / behaving very weirdly, a reboot of opnsene or a reboot of any device between like switch/ISP router fixes every single problem magically.

Tough everything boils down to opnsense, as soon as opnsense becomes inaccessible to PING my network begins to behave weirdly.

This probably explains everthing the best:



- Ping is working to everything except opnsense. (most of the time ping is also not working and looks fully red on uptime-kuma.)
- OPNsense is reachable through IP:Port, however not through reverseproxy
- physical hosts are inaccessible through reverseproxy
- every single web-service running in vlan20 is fully accessible through the same reverseproxy

My current network layout:

- Physical Hosts: 10.50.20.x Subnet, VLAN 1
- VM/LXC: 10.10.20.x Subnet, VLAN 20

On my Switch I tagged each port for a physical host as VLAN 1 and 20 TAGGED

I dug through every log avaiable on opnsense but sadly have not yet found anything roughly matching with the timeframe opnsense/network becoming offline.

I'm really at the end of my knowledge on how to go on in this error/ how to troubleshoot, and really really hope for some help.

THANKS!

EDIT: Problems were also before upgrade to 24.7
EDIT: Fixed images

15

24.7 Production Series / Opnsense needs a weekly reboot

« on: August 06, 2024, 03:50:46 pm »

Hi

It's very difficult to explain, but around weekly, to half weekly I have to reboot my opnsense, because some of my LXC's in my proxmox cluster loose internet connectivity-> nslookup works, outside ping not. I've found this very difficult to track down, finally I ended up at opnsense/my isp router, mostly a reboot of opnsense solves this.

My home network is structured the following: isp-router with home lan->opnsense it's own subnet->clients as peoxmox.


I'm not really sure how to debug this and hope for some guidance on how to advance to this, thanks!

Let me know if any more details are needed.
Thanks a lot!