OPNsense Forum

English Forums => Zenarmor (Sensei) => Topic started by: lrosenman on January 10, 2022, 03:43:07 am

Title: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 10, 2022, 03:43:07 am
I finally got to the bottom of my IPv6 all of a sudden NOT working from my LAN.  If I turn OFF the Zenarmor Packet Engine it works as it's supposed to. if I turn ON the Packet Engine, my IPv6 doesn't work any more.

I filed a bug report from the UI, but wanted to post here as well.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: athurdent on January 10, 2022, 05:37:58 am
Other than turning off Zenarmor, how did you verify it’s actually caused by that? Do your clients have a global IPv6? Which NIC? Did you try passive operation or native/emulated netmap?
I never had a problem with my IPv6 tests a few weeks back. Held off on using it until DHCPv6 in OPNsense gets fixed though.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 10, 2022, 03:35:55 pm
I have global IPv6 addresses from ATT, and with Zenarmor on, I can't get past the OPNSense router.  A ping gets nothing.  Turn off Zenarmor and it works fine.

EM nics
using NETMAP, AFAIK (Protectli FW6b HW).

Code: [Select]
em0@pci0:1:0:0: class=0x020000 card=0x00008086 chip=0x150c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82583V Gigabit Network Connection'
    class      = network
    subclass   = ethernet
em1@pci0:2:0:0: class=0x020000 card=0x00008086 chip=0x150c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82583V Gigabit Network Connection'
    class      = network
    subclass   = ethernet
em2@pci0:3:0:0: class=0x020000 card=0x00008086 chip=0x150c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82583V Gigabit Network Connection'
    class      = network
    subclass   = ethernet
em3@pci0:4:0:0: class=0x020000 card=0x00008086 chip=0x150c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82583V Gigabit Network Connection'
    class      = network
    subclass   = ethernet
em4@pci0:5:0:0: class=0x020000 card=0x00008086 chip=0x150c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82583V Gigabit Network Connection'
    class      = network
    subclass   = ethernet
em5@pci0:6:0:0: class=0x020000 card=0x00008086 chip=0x150c8086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82583V Gigabit Network Connection'
    class      = network
    subclass   = ethernet

Code: [Select]
root@home-fw:~ # dmesg|grep -i netmap
000.000054 [4344] netmap_init               netmap: loaded module
em0: netmap queues/slots: TX 1/1024, RX 1/1024
em1: netmap queues/slots: TX 1/1024, RX 1/1024
em2: netmap queues/slots: TX 1/1024, RX 1/1024
em3: netmap queues/slots: TX 1/1024, RX 1/1024
em4: netmap queues/slots: TX 1/1024, RX 1/1024
em5: netmap queues/slots: TX 1/1024, RX 1/1024
root@home-fw:~ #
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: athurdent on January 10, 2022, 04:18:52 pm
What do Zenarmor‘s logs show for that IP you try to ping? Your policy configuration might simply block it.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 10, 2022, 04:49:05 pm
nothing in the logs.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: athurdent on January 10, 2022, 05:25:42 pm
NOTHING.
Good luck getting further help with that yelling attitude.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 10, 2022, 05:28:37 pm
NOTHING.
Good luck getting further help with that yelling attitude.

softened the wording.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: sy on January 10, 2022, 06:59:44 pm
Hi,

Looking into via ticket. I will also update here.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: sy on January 11, 2022, 06:57:04 pm
Hi,

The reason for the loss of connectivity is that when Zenarmor packet engine opens the interface in the netmap mode, netmap re-initializes that interface, causing a DOWN/UP link event.
Seeing an interface DOWN/UP event, OPNsense fires IPv4/IPv6 address re-configuration. For IPv4, this takes milliseconds, bur for IPv6, due to auto-configuration, WAN tracking etc, this process might take about 15-60 seconds during which time you might lose WAN connectivity.
After this, everything should be back to normal.
We’re aware of this issue, however the solution involves working with 3rd parties (netmap team, OPNsense team etc).
For the final solution, several options are on the table and we’re working on them.
I hope this helps clarify the situation
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 11, 2022, 07:00:38 pm
As I said in my ticket reply, even after the connectivity is fixed, IPv6 packets don't make it past OPNSense with the packet engine running.

What else can I provide?
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: athurdent on January 11, 2022, 07:11:25 pm
Hi,

The reason for the loss of connectivity is that when Zenarmor packet engine opens the interface in the netmap mode, netmap re-initializes that interface, causing a DOWN/UP link event.
Seeing an interface DOWN/UP event, OPNsense fires IPv4/IPv6 address re-configuration. For IPv4, this takes milliseconds, bur for IPv6, due to auto-configuration, WAN tracking etc, this process might take about 15-60 seconds during which time you might lose WAN connectivity.
After this, everything should be back to normal.
We’re aware of this issue, however the solution involves working with 3rd parties (netmap team, OPNsense team etc).
For the final solution, several options are on the table and we’re working on them.
I hope this helps clarify the situation

Awesome, thanks for the insights!
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: almodovaris on January 13, 2022, 01:54:36 pm
That's quite true, Zenarmor chokes IPv6 if you have hardware checksum offload and/or hardware TCP segmentation offload enabled.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 13, 2022, 02:05:03 pm
even with all the offload stuff turned off, I still can't get IPv6 packets to traverse the firewall
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: Patrick M. Hausen on January 13, 2022, 03:09:27 pm
That's quite true, Zenarmor chokes IPv6 if you have hardware checksum offload and/or hardware TCP segmentation offload enabled.
Then turn off hardware offload. HW offload is only useful on a system where the TCP connection terminates. Which is practically never the case for a firewall unless you explicitly use proxies. As long as you push packets and filter with pf, the endpoints of TCP connections are always systems on either side of the firewall.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 13, 2022, 03:16:34 pm
As I said, even with the offload stuff OFF, it still blocks IPv6 traversing the Firewall.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 14, 2022, 12:15:54 am
@SunnyValley: Is this now a dead ticket, and I need to cancel my subscription and remove the software? 
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: almodovaris on January 14, 2022, 01:13:05 pm
Have you upgraded to 22.1.r1? Maybe it behaves differently.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 14, 2022, 04:14:11 pm
IIRC 22.1 is NOT ready for SunnyValley, so no.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: sy on January 14, 2022, 06:06:31 pm
Hi,

22.1 repo is published.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 14, 2022, 06:10:09 pm
Are there changes in 22.1 (Either OPNSense or Zenarmor) that would possibly affect this issue?

Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 14, 2022, 10:12:12 pm
per private email, it was worth a try, and:

SUCCESS

it's working, modulo the fact that pkg update doesn't like to talk to the IPv6 repos.
(Other IPv6 works fine).

I wonder if there's a way to force pkg -4 for the OPNSense / SunnyValley stuff?

Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: lrosenman on January 15, 2022, 02:39:01 am
another user suggested setting the IPv4 preferred over IPv6 and running the updates, which DID upgrade more code.

Now that it's on:
OPNsense 22.1.r1-amd64

and removing the 4 over 6 preference it's still working, and my IPv6 issue is GONE.

Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: JasMan on November 03, 2022, 10:27:40 am
Hi,

The reason for the loss of connectivity is that when Zenarmor packet engine opens the interface in the netmap mode, netmap re-initializes that interface, causing a DOWN/UP link event.
Seeing an interface DOWN/UP event, OPNsense fires IPv4/IPv6 address re-configuration. For IPv4, this takes milliseconds, bur for IPv6, due to auto-configuration, WAN tracking etc, this process might take about 15-60 seconds during which time you might lose WAN connectivity.
After this, everything should be back to normal.
We’re aware of this issue, however the solution involves working with 3rd parties (netmap team, OPNsense team etc).
For the final solution, several options are on the table and we’re working on them.
I hope this helps clarify the situation


So happy to read this explanation.  :)
I thought that I'd a missconfiguration in my OPNsense due to the long "outages" during IFs down/up.
Title: Re: Zenarmor & IPv6: Bad Combo (At least on ATT Fiber/US)
Post by: walkerx on January 15, 2023, 12:31:09 am
If you can, get a static ipv6 and set opnsense to use static ipv6 and setup dhcpv6 and router assists, this will allow ipv6 to continue working.

i had this similar issue with a uk based isp and if set dhcpv6 to track ipv4 and wan i lost ipv6 when zenarmour was activated. i raised this with zenarmour around apr-may 2022.