PPPoE over an unassigned VLAN no longer connects after upgrading to 26.7.3

[johndoeuser]

I want to chime in to this thread. I seem to have exactly the same issue as OP. A (Dutch) KPN fiber connection. PPPoE configured over vlan6 tagged interface. PPPoE works flawlessly up to version OPNsense 26.7.1_1-amd64. At the moment I have a cold stand-by with a clean install and upgraded to OPNsense 26.7.8_2-amd64. I only configured PPPoE which still doesn't want to start working. Help?! ;-)

[fanski]

Hi fanski,

> In 26.7.1 the vlan0.35 was not the first VLAN to be created.

Previously the VLANs were created in a batch before interfaces were brought up, but that changed in .3 with the support of VLANs on top of bridges.

We haven't seen many oddities, but there were a few.  Some hidden in the old code and some apparently in drivers.  I need to recheck the code I gave you, but it feels like the kernel is lying to us here.

At the moment I need to release 26.7.7 though so I'll try to get back to this later this week.


Cheers,
Franco

Hi Franco,

I guess you are really busy at the moment, I just wanted to ask if you think you will have the time to look at this again or if you see another option?
Currently I'm a little bit blocked with my VoIP as it's not working without the siproxd which seems not available in version 26.7.1 (OPNSense tells me to upgrade to get the plugin running again and I need it as my ISP is not really accepting STUN as it seems because I can't login anymore after some time). And additionally I would really like to keep my software up to date, especially the firewall :)

Many thanks,

Fanski

[franco]

Hi,

Yes, sorry for dropping the ball here somewhat.  I prepared some changes for PPPoE today to defer dialling to after bootup completes (which is already on the development branch).  Most of the backports will be in 26.7.9 on Wednesday.  I'll then do a call for testing on that defer dialling patch.  Feel free to ping again as soon as 26.7.9 is out.


Cheers,
Franco

[johndoeuser]

Will have a go at it asap. You're the best, tnx.

[fanski]

Hi Franco,

I tested it with 26.7.9 and it still has the same behavior. So if I can help with testing just give me a hint what to do :)

Many thanks,

Fanski

[franco]

Hi fanski,

Yes this was expected.  Now we can try this:

# opnsense-patch https://github.com/opnsense/core/commit/39cca4ca785

Instead of trying to debug the down state we can try shift the timing to a more favourable point. This would have several benefits if it works well enough.


Cheers,
Franco

[fanski]

Hi Franco,

so I don't know how to say this but yes. It's working now, but I don't really know why, because I didn't install the patch...
I did this:

1. download the patch with opnsense-patch -d 39cca4ca785
2. copied the patch from /var/cache/opnsense-patch/core-39cca4ca785 to /root/39cca4ca785.patch
3. checked if the patch is working with  patch -d /usr/local -p2 --dry-run < /root/39cca4ca785.patch
4. upgraded to 26.7.9
5. reload
6. PPPoE working again

I have no idea why it works now because I did the upgrade to 26.7.9 yesterday and it didn't work. I checked the /usr/local/etc/inc/interfaces.inc and searched for example for "PPP start deferred" which was not in it so I guess I didn't have the patch installed, except it is somehow used during boot in a cache???

But hey: YES!! it's working :D
I also did some reboots to be sure that it will still work and everything is fine now.

I checked the logs and maybe the source of the problem is here:

not working

Code Select Expand

<13>1 2026-11-11T19:49:05+01:00 fw-KG.XYZ opnsense 441 - [meta sequenceId="213"] /usr/local/etc/rc.bootup: Device vlan0.35 required by WAN(wan), configuring now
<13>1 2026-11-11T19:49:05+01:00 fw-KG.XYZ kernel - - [meta sequenceId="214"] <118>[30] Configuring Uplink_switch_KG_10G interface...done.
<13>1 2026-11-11T19:49:05+01:00 fw-KG.XYZ kernel - - [meta sequenceId="215"] <6>[30] ix1: link state changed to UP
<13>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ kernel - - [meta sequenceId="216"] <6>[30] igb0: link state changed to DOWN
<13>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ kernel - - [meta sequenceId="217"] <6>[30] vlan0: changing name to 'vlan0.35'
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="218"] Multi-link PPP daemon for FreeBSD
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="219"]
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="220"] process 54366 started, version 5.9
<13>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ kernel - - [meta sequenceId="221"] <118>[31] Configuring WAN interface...
<13>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ kernel - - [meta sequenceId="222"] <6>[31] igb1: link state changed to UP
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="223"] web: web is not running
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="224"] [wan] Bundle: Interface ng0 created
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="225"] [wan_link0] Link: OPEN event
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="226"] [wan_link0] LCP: Open event
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="227"] [wan_link0] LCP: state change Initial --> Starting
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="228"] [wan_link0] LCP: LayerStart
<13>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ kernel - - [meta sequenceId="229"] <6>[31] ng0: changing name to 'pppoe0'
<29>1 2026-11-11T19:49:06+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="230"] [wan_link0] PPPoE: Connecting to ''
<13>1 2026-11-11T19:49:10+01:00 fw-KG.XYZ kernel - - [meta sequenceId="231"] <6>[35] igb0: link state changed to UP
<13>1 2026-11-11T19:49:10+01:00 fw-KG.XYZ kernel - - [meta sequenceId="232"] <6>[35] vlan0.35: link state changed to UP
<29>1 2026-11-11T19:49:15+01:00 fw-KG.XYZ ppp 54366 - [meta sequenceId="233"] [wan_link0] PPPoE connection timeout after 9 seconds
working

Code Select Expand

<13>1 2026-11-12T18:59:11+01:00 fw-KG.XYZ opnsense 435 - [meta sequenceId="213"] /usr/local/etc/rc.bootup: Device vlan0.35 required by WAN(wan), configuring now
<13>1 2026-11-12T18:59:11+01:00 fw-KG.XYZ kernel - - [meta sequenceId="214"] <118>[32] Configuring Uplink_switch_KG_10G interface...done.
<13>1 2026-11-12T18:59:11+01:00 fw-KG.XYZ kernel - - [meta sequenceId="215"] <6>[32] ix1: link state changed to UP
<13>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ kernel - - [meta sequenceId="216"] <6>[32] igb0: link state changed to DOWN
<13>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ kernel - - [meta sequenceId="217"] <6>[32] vlan0: changing name to 'vlan0.35'
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="218"] Multi-link PPP daemon for FreeBSD
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="219"]
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="220"] process 62154 started, version 5.9
<13>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ kernel - - [meta sequenceId="221"] <6>[33] igb1: link state changed to UP
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="222"] web: web is not running
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="223"] [wan] Bundle: Interface ng0 created
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="224"] [wan_link0] Link: OPEN event
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="225"] [wan_link0] LCP: Open event
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="226"] [wan_link0] LCP: state change Initial --> Starting
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="227"] [wan_link0] LCP: LayerStart
<13>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ kernel - - [meta sequenceId="228"] <118>[33] Configuring WAN interface...
<13>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ kernel - - [meta sequenceId="229"] <6>[33] ng0: changing name to 'pppoe0'
<29>1 2026-11-12T18:59:12+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="230"] [wan_link0] PPPoE: Connecting to ''
<13>1 2026-11-12T18:59:16+01:00 fw-KG.XYZ kernel - - [meta sequenceId="231"] <6>[37] igb0: link state changed to UP
<13>1 2026-11-12T18:59:16+01:00 fw-KG.XYZ kernel - - [meta sequenceId="232"] <6>[37] vlan0.35: link state changed to UP
<29>1 2026-11-12T18:59:18+01:00 fw-KG.XYZ ppp 62154 - [meta sequenceId="233"] PPPoE: rec'd ACNAME "Bras-gare-100g"
The part "Configuring WAN interface" now starts later, after we have some wan/wan_link0 messages.

If needed I can provide more logs. But for now many many thanks for your help!

Regards,

Fanski

[franco]

Hmm, we didn't change much.  Just a bit of non-functional plumbing for PPP actually.

The order of the patching is wrong though:

> 4. upgraded to 26.7.9

As soon as you upgrade the local patches get lost.  The sequence is:

1. Update to 26.7.9.
2. run patch command once which does everything for you: # opnsense-patch 39cca4ca785

Given you're using igb perhaps you saw a side effect of https://github.com/opnsense/src/issues/329 which was introduced in 26.7.4 and fixed in 26.7.9 in the kernel. It's strange but it could be.

Nevertheless you should try the PPP deferral patch because I think we should go ahead with this.


Cheers,
Franco

[fanski]

The order of the patching is wrong though:

> 4. upgraded to 26.7.9

As soon as you upgrade the local patches get lost.  The sequence is:

1. Update to 26.7.9.
2. run patch command once which does everything for you: # opnsense-patch 39cca4ca785

Yes, I didn't run the patch at all, I just did a dry-run to see the output (output was hunk 2 did not work in 26.7.1) and then did the upgrade and it directly worked but as I said, I did the same update yesterday and the result was different so I'm totally confused.

I installed the patch now and it still works.

Regards,

Fanski

[franco]

Hi Fanski,

Ok, thanks for testing.  I'll do an official call for testing patch today for everyone else with PPPoE who wants to try it.

Happy that it works for you again even if this wasn't directly intended (yet).


Cheers,
Franco