No link with Intel E810 on Opnsense 26.7 / FreeBSD 15 when DDP loaded

[tuto2]

I don't have any further insight or experience to contribute at this stage, but what module coding and link partners have been tested? We don't have a non-production DEC appliance, but we do have DACs, AOCs, and SR/LR SFP28 modules on hand that we can recode at will, so if there's a specific combination that hasn't been tested (or needs validation) I might be able to provide another test case.

This seems to be the culprit: https://github.com/opnsense/src/commit/27ffeba0e6b5b8d8ebb8eec9d2566f56421ee946

There's a test kernel available if you want to give it a go:

# opnsense-update -zkr 26.7.8-next

Reboot afterwards, link should come up immediately on boot without the tunable.

[redge]

I don't have any further insight or experience to contribute at this stage, but what module coding and link partners have been tested? We don't have a non-production DEC appliance, but we do have DACs, AOCs, and SR/LR SFP28 modules on hand that we can recode at will, so if there's a specific combination that hasn't been tested (or needs validation) I might be able to provide another test case.

This seems to be the culprit: https://github.com/opnsense/src/commit/27ffeba0e6b5b8d8ebb8eec9d2566f56421ee946

There's a test kernel available if you want to give it a go:

# opnsense-update -zkr 26.7.8-next

Reboot afterwards, link should come up immediately on boot without the tunable.

Yup, that seems to have done the trick! Updated the kernel, removed the FEC tunables from ice0/ice1, rebooted, and the link came up with no intervention, exactly as expected.

Code Select Expand

[1] ice0: Link is up, 25 Gbps Full Duplex, Requested FEC: RS-FEC, Negotiated FEC: FC-FEC/BASE-R, Autoneg: False, Flow Control: None
...
[3] ice1: Link is up, 25 Gbps Full Duplex, Requested FEC: RS-FEC, Negotiated FEC: FC-FEC/BASE-R, Autoneg: False, Flow Control: None

Skimming dmesg, I did notice a few VLAN errors on those NICs (which I also saw in @paoba's post #31), but I couldn't tell you whether these existed prior to either 26.10 or this patched kernel, so I just thought I'd mention it.

Code Select Expand

[48] ice0: Failed to add VLAN filters:
[48] ice0: - vlan 1011, status -14
[48] ice0: Failure adding VLAN 1011 to main VSI, err ICE_ERR_ALREADY_EXISTS aq_err OK
[48] ice1: Failed to add VLAN filters:
[48] ice1: - vlan 1011, status -14
[48] ice1: Failure adding VLAN 1011 to main VSI, err ICE_ERR_ALREADY_EXISTS aq_err OK
[48] ice0: Failed to add VLAN filters:
[48] ice0: - vlan 1010, status -14
[48] ice0: Failure adding VLAN 1010 to main VSI, err ICE_ERR_ALREADY_EXISTS aq_err OK
[48] ice1: Failed to add VLAN filters:
[48] ice1: - vlan 1010, status -14
[48] ice1: Failure adding VLAN 1010 to main VSI, err ICE_ERR_ALREADY_EXISTS aq_err OK


[franco]

Yup, that seems to have done the trick! Updated the kernel, removed the FEC tunables from ice0/ice1, rebooted, and the link came up with no intervention, exactly as expected.

That's good news for 26.7.9 and 26.10.0p1.  :)


Cheers,
Franco