[isolated: see #91] PPPoE reconnect loop

Started by schnipp, February 11, 2018, 02:46:04 PM

Previous topic - Next topic
Just to rule something out are you're running in a VM?
OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

February 18, 2018, 12:13:21 PM #31 Last Edit: February 18, 2018, 12:18:26 PM by elektroinside
Nope, OPNsense runs on a physical machine.
On that particular machine, I can't do a clean setup for a number of reasons. What I could try is to set up another physical machine, but I'm uncertain if the results will be relevant (different hw, different drivers)...
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

Not one of my finest work, but this will be the test setup :-)
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

Nah... looks pretty reasonable to me.  8)

We're only doing what your tag suggests.

Now, what I can do is that i have a Qotom i5 based unit which is fine, I also have two APU's, one APU1 and one APU2, I will configure them and try them with my ISP using pppoe dhcp6 rather than static and see if I get any issues. Might take a day or two as I have to do it when my better half is not working and online.
OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

February 18, 2018, 02:38:59 PM #34 Last Edit: February 18, 2018, 03:29:06 PM by elektroinside
So.. new setup, clean install 18.1, updated to 18.1.2, no import of backups.

Here's what I found so far:

1. WAN IPv4 only
- no reconnect loops after multiple disconnects
- LAN client has internet connectivity

2.  WAN IPv4 + IPv6 (happened once)
- IPv6 exactly like here https://forum.opnsense.org/index.php?topic=7267.0
- no reconnect loops, but my only LAN client, which is a laptop directly connected to the LAN interface of the OPNsense box, will lose internet connectivity
- even so, pinging and stuff work on the OPNsense box and I do receive IPv4 + IPv6 from the ISP

3. WAN IPv4 + IPv6 (happened most of the times)
- no reconnect loops
- LAN client has internet connectivity
- WAN loses IPv6

4.  WAN IPv4 + IPv6
- IDS + IPS enabled (with all rules set to 'alert' only)
- no reconnect loops
- LAN client has internet connectivity
- WAN loses IPv6

5.  WAN IPv4 + IPv6
- IDS + IPS enabled (with all rules set to 'drop')
- no reconnect loops
- LAN client has internet connectivity
- WAN loses IPv6

6. WAN IPv4 + IPv6
- OpenVPN settings imported from backup
- no reconnect loops
- LAN client has internet connectivity
- WAN loses IPv6
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

So what we are seeing now with IDS & IPS is NO loops but loss of IPv6?

Well that's different, not sure how to account for that. However, look at the dhcp6c logs and see if anything strange is happening there. Do you have 'Prevent Release' and 'Use IPv4 Connectivity' set?
OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

February 18, 2018, 03:31:34 PM #36 Last Edit: February 18, 2018, 03:35:01 PM by elektroinside
(I'll keep updating my previous post with my findings)

Use IPv4 is checked (WAN won't receive an IPv6 otherwise), and prevent release is right now unchecked.

But i had the IPv6 loss with my other box as well, it's not new.. not in my case at least.
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

OK, what's appearing in dhcp6c logs, is it being signalled to exit?
OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

Ok, finally nailed it!

The culprit for both the PPPoE reconnect loop and the IPv6 loss was (in my case):

- custom MTU (1492)
- custom MSS (1452)

... both configured on the WAN of course.

Although both are correct for PPPoE (as far as I know), manually configuring them caused the PPPoE loop and the IPv6 loss. After deleting both, the loop is gone and IPv6 is also back :)

I'm not sure if this is a bug or a misconfiguration.

Thank you for all your help marjohn56!
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

February 18, 2018, 05:05:41 PM #39 Last Edit: February 18, 2018, 05:07:30 PM by marjohn56
Excellent!! :)

Never touched my MTU or MSS, I let the system work it out.

Now let's see if its the same thing for others too.

OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

A fixed value could let to a CONFNAK on the provider LNS when the client insist of the value

Quote from: mimugmail on February 18, 2018, 05:12:53 PM
A fixed value could let to a CONFNAK on the provider LNS when the client insist of the value

So if on PPPoE best to leave it to work it out itself?
OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

Quote from: mimugmail on February 18, 2018, 05:12:53 PM
A fixed value could let to a CONFNAK on the provider LNS when the client insist of the value

Even if the fixed values are the ones the ISP would require anyways?
OPNsense v18 | HW: Gigabyte Z370N-WIFI, i3-8100, 8GB RAM, 60GB SSD, | Controllers: 82575GB-quad, 82574, I221, I219-V | PPPoE: RDS Romania | Down: 980Mbit/s | Up: 500Mbit/s

Team Rebellion Member

You don't want to believe what the ISP says.  :)
OPNsense 24.7 - Qotom Q355G4 - ISP - Squirrel 1Gbps.

Team Rebellion Member

Quote from: elektroinside on February 18, 2018, 06:24:20 PM
Quote from: mimugmail on February 18, 2018, 05:12:53 PM
A fixed value could let to a CONFNAK on the provider LNS when the client insist of the value

Even if the fixed values are the ones the ISP would require anyways?

If I remember correctly I had the same issue with a Cisco Router as LNS with an early 15.0 release and Client was also Cisco, so this might bei unrelated to OPNsense