OPNsense
  • Home
  • Help
  • Search
  • Login
  • Register

  • OPNsense Forum »
  • English Forums »
  • 22.7 Legacy Series »
  • [update] after 22.7.9 update the gateway suddenly dies after 1 day or so
« previous next »
  • Print
Pages: [1] 2 3 ... 6

Author Topic: [update] after 22.7.9 update the gateway suddenly dies after 1 day or so  (Read 5950 times)

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
[update] after 22.7.9 update the gateway suddenly dies after 1 day or so
« on: December 03, 2022, 11:19:45 pm »
I have been running 22.7.8 (and all before) without issues for 9 months. Did a lot of version upgrades. Even from 22.6 to 22.7

Now with the last update I did on Friday I find that after 24hrs or so the internet dies and I see the gateway status "offline". First I thought it was the ISP router or cables. Lost 1 hour checking all. BUT the issue was OPNsense because after a reboot all OK again.
Now again after 24hrs out of the blue the same happened again.

These seems to be an issue with 22.7.9 which I'm at a loss to explain or check.

I have reverted to 22.7.8 (running on proxmox) and did a fresh upgrade again.
Let's see.
« Last Edit: December 26, 2022, 03:28:06 pm by manilx »
Logged

slackadelic

  • Full Member
  • ***
  • Posts: 123
  • Karma: 9
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #1 on: December 03, 2022, 11:33:45 pm »
FYI, there's an older post that this is being discussed in already here: https://forum.opnsense.org/index.php?topic=31322.0
Logged

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #2 on: December 04, 2022, 11:47:41 am »
Hi

I don't think this is a problem with Unbound.

The Gateway turned "red" and my router couldn't be pinged.

I also rebooted after the upgrade. And also after the problem appeared the 1st time and it reappeared.

Must be something different!
Logged

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #3 on: December 04, 2022, 12:11:28 pm »
https://www.reddit.com/r/opnsense/comments/zbt3il/after_2279_update_the_gateway_suddenly_dies_after/

Posted here to. And there seems to be an issue with the last update!

Suricata may be to blame. I didn't check if it was running when the gateway was lost....
Logged

peltz

  • Newbie
  • *
  • Posts: 2
  • Karma: 1
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #4 on: December 04, 2022, 12:53:23 pm »
I had the same issue here, firewall (Shuttle DH270) suddenly unreachable after update to 22.7.9 after ~1 hour.
Not pingable on either interface, but could be rebooted with power button (no monitor, keyboard attached)
After reboot, everything worked normally, but froze again after ~30min

Reverted the kernel -> no success
Reverted base, opnsense and suricata -> stable for 24+ hours

Strongly suspect suricata, but there is nothing to be found in the logs
Logged

Wirrkopf

  • Newbie
  • *
  • Posts: 4
  • Karma: 2
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #5 on: December 04, 2022, 02:24:14 pm »
It has to do with Suricata.

As soon as I put a lot of load on my opnsense 22.7.9 box, the interface which I use starts to stop responding to pings, etc. I have another interface on my opnsense box and that is still working. When I restart the suricata service, the ping replies start working again.

I have tried this by using a few speediest-cli calls in parallel and that will bring the relevant interface to a halt.
Logged

chknpikr

  • Newbie
  • *
  • Posts: 16
  • Karma: 0
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #6 on: December 04, 2022, 05:41:22 pm »
This problem is definitely related to Suricata after Opnsense 22.7.9 upgrade.  I can freeze my Opnsense box (all interfaces drop offline, web GUI freezes and requires hardware reboot with power button), immediately after saturating the line (1Gbps lines) with nzbget (TLS/SSL).  No issues with Suricata service stopped.  Suricata is configured in promiscuous mode, ips enabled, monitoring LAN interface.  This configuration has worked flawlessly for at least a year, previous to this upgrade.
Logged

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #7 on: December 04, 2022, 06:21:16 pm »
I have now locked Suricata at v6.0.8 and upgraded as suggested in https://www.reddit.com/r/opnsense/comments/zbt3il/after_2279_update_the_gateway_suddenly_dies_after/

Will report if it keeps stable.
Logged

Colt45

  • Newbie
  • *
  • Posts: 18
  • Karma: 1
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #8 on: December 04, 2022, 10:40:02 pm »
Our issues are the same. Im running Suricata as well. For some reason on mine, unbound is the first victim and so thats what I was focused on.
I ran a speedtest (I have 250/250) and got 250 down, up 85, and it actually quit before it finished the upload test. I restarted suricata and unbound and everything is working again.
Logged

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #9 on: December 04, 2022, 11:28:08 pm »
Hope @franco or someone is reading this ans already fixing......
Logged

pmhausen

  • Hero Member
  • *****
  • Posts: 2544
  • Karma: 227
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #10 on: December 04, 2022, 11:33:58 pm »
Quote from: manilx on December 04, 2022, 11:28:08 pm
Hope @franco or someone is reading this ans already fixing......
Shouldn't that be up to the Suricata folks to fix? And best reported in the appropriate subforum?
Logged
Supermicro A2SDi-4C-HLN4F mainboard and SC101F chassis
16 GB ECC memory
Crucial MX300 275 GB SATA 2.5" plus
Crucial MX300 275 GB SATA M.2 (ZFS mirror)
People who think they know everything are a great annoyance to those of us who do. (Isaac Asimov)

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #11 on: December 04, 2022, 11:49:52 pm »
As I don't know if this is the problem, simple user here, I hope someone with more experience will take this up....
Logged

cookiemonster

  • Hero Member
  • *****
  • Posts: 590
  • Karma: 35
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #12 on: December 05, 2022, 12:03:30 am »
Quote from: manilx on December 04, 2022, 11:49:52 pm
As I don't know if this is the problem, simple user here, I hope someone with more experience will take this up....
Can you try to get digging in logs for clues?. If indeed there's a problem with Suricata, which this thread has no proof of yet, as pmhausen wrote, it is not for the OPN devs to try to reproduce your setup by guessing.
Logged

manilx

  • Jr. Member
  • **
  • Posts: 88
  • Karma: 4
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #13 on: December 05, 2022, 12:53:16 am »
Looks like on reddit the problem was solved by not updating suricata or by having to restart it

I have upgraded again but blocked suricata from doing so. Waiting for the issue to not appear again. If it does I can look at the logs (which ones).
Logged

chknpikr

  • Newbie
  • *
  • Posts: 16
  • Karma: 0
    • View Profile
Re: after 22.7.9 update the gateway suddenly dies after 1 day or so
« Reply #14 on: December 05, 2022, 01:01:40 am »
Can confirm it's Suricata 6.0.9.  Have spent many hours the last two days testing numerous settings and scenarios.

Reverted to Suricata 6.0.8 on Opnsense 22.7.9 and the problem stopped.  The logs did not show anything other than this: "/usr/local/etc/rc.linkup: DEVD: Ethernet detached event for dynamic wan(em0)" Each time it happened.  Problem was easily reproduced with nzbget (will saturate download pipeline; seems to be related to multiple, parallel high bandwidth connections occurring simultaneously; saw no unusual problems during normal daily network activity, so I'm sure most users will not notice anything amiss).  Dropped the entire network within seconds.

Protectli box, intel NIC, i5, 16GB dual channel.  Suricata running IPS, Promiscuous, on LAN.  Platform and config have been rock solid until this upgrade.

And, there are no hardware problems with the NIC, cable, ISP modem or switch.
« Last Edit: December 05, 2022, 01:40:23 am by chknpikr »
Logged

  • Print
Pages: [1] 2 3 ... 6
« previous next »
  • OPNsense Forum »
  • English Forums »
  • 22.7 Legacy Series »
  • [update] after 22.7.9 update the gateway suddenly dies after 1 day or so
 

OPNsense is an OSS project © Deciso B.V. 2015 - 2023 All rights reserved
  • SMF 2.0.19 | SMF © 2021, Simple Machines
    Privacy Policy
    | XHTML | RSS | WAP2