Trouble getting Fiber Internet to work on DEC740

[pemdu]

Hi,

I recently moved into a new place and now have an active fiber connection (FTTH AON), no passive GPON, with a small local ISP.
Before I had a DSL connection with a modem in Bridge mode and Opnsense handling PPPoE and Vlan tagging.
Along with the Fiber connection my ISP provided me with a media converter and an SFP Module.

Media Converter: TP-Link MC220L
SFP Module: [FIBER – LR BiDi] SFP-GE-BX 1000BASE SFP 1310/1550 20Km (FS)
Opnsense: 22.7.2

My current setup looks like this:
Fiber -> SFP on Media converter -> RJ45 on Media converter -> WAN Opnsense (igb1)

This setup works pretty much out of the box, no PPPoE or Vlan tagging required, and I receive my IPs via DHCP.

Since the DEC740 has SFP slots I would like to move the SFP module directly to the DEC740 to reduce the number of devices, cables and save a little electricity.

My desired setup looks like this:
Fiber -> SFP on WAN Opnsense (ax1)

When i plug in the SFP module it gets recognized by Opnsense and when I plug in the fiber cable the link is shown as up however I don't receive any IPs. My ISPs tech support also confirmed that the link is up and looking good.

I asked them if I needed to provide them with a mac address or spoof a mac address, they said no.
I asked them if I needed to set a vlan tag, they said no.
I asked them if I needed to pass any special Parameters in the DHCP request, they said no.
They suggested I try PPPoE and provided me with the credentials however I just receive PPPoE timeouts.
I also disconnected the link and waited 4+ hours for the end of the DHCP lease, without success.
I also tried setting the IPs manually without luck.

While researching my problem I came across this issue here:
https://www.reddit.com/r/PFSENSE/comments/pd2kbf/no_ip_on_wan_with_new_isp/
Using packet capture in Opnsense I couldn't rule out having this problem because I only see DHCP Discover Packets sent by Opnsense and no Offer.

In the general log I did notice this error:

Code Select Expand

/usr/local/opnsense/scripts/shell/setports.php: The command '/sbin/dhclient -c '/var/etc/dhclient_wan.conf' -p '/var/run/dhclient.ax1.pid' 'ax1'' returned exit code '15', the output was 'ax1: no link ... got link DHCPDISCOVER on ax1 to 255.255.255.255 port 67 interval 1 DHCPDISCOVER on ax1 to 255.255.255.255 port 67 interval 2 DHCPDISCOVER on ax1 to 255.255.255.255 port 67 interval 5 DHCPDISCOVER on ax1 to 255.255.255.255 port 67 interval 14'

Do you have any thoughts on what I'm missing or how I could proceed?

ifconfig output for ax1:

Code Select Expand

ax1: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: WAN
options=4800028<VLAN_MTU,JUMBO_MTU,NOMAP>
capabilities=4f503bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWFILTER,VLAN_HWTSO,NETMAP,RXCSUM_IPV6,TXCSUM_IPV6,NOMAP>
ether xx:xx:xx:xx:xx:xx
inet6 fe80::xxxx:xxxx:xxxx:xxxx%ax1 prefixlen 64 scopeid 0x5
inet 0.0.0.0 netmask 0xff000000 broadcast 255.255.255.255
media: Ethernet autoselect (1000Base-SGMII <full-duplex,rxpause,txpause>)
status: active
supported media:
media autoselect
media 100M-SGMII
media 100baseTX
media 1000Base-SGMII
media 1000baseT
media 1000baseSX
media 1000baseLX
media 1000baseCX
media 1000Base-KX
media 10GBase-SFI
media 10Gbase-T
media 10GBase-KR
nd6 options=23<PERFORMNUD,ACCEPT_RTADV,AUTO_LINKLOCAL>

[Spoonman2002]

"returned exit code '15', the output was 'ax1: no link"

I'm no expert, but this looks not good, while your ISP says the link is up.....
OPNsense has a list of working fiber modules:

Supported SFP(+) Modules

When using SFP+Modules, do not mix 2.5/5Gbps and 10Gbps link-speed as the hardware does not support mixing these due to different frequencies.

While most standard LC-LC OM3 SFP+ modules and SFP+ Direct Attached Cables are likely to function we advise to select one of of the known compliant modules from the following list:

SFP+ (Up to 10G)

————————————————————————————–

TESTED & WORKING:

     [FIBER – SR] UP-TR-SR-CI 10G SFP+ 850nm 300m DOM  (Uptimed)
     [DAC] ARUBA 10G SFP+ 1m DAC  (Aruba)
     [DAC] CISCO SFP-H10GB-CU1M 1m Direct Attach  (Cisco)
     [DAC] NETGEAR AXC761 10G SFP+ PASSIVE COPPER CABLE 1M (MOST RECENT VERSION)
     [FIBER – LR] SFP-10GLR-31 1/10G SFP+ 1310nm 10km  (FS)
     [FIBER – SR] SFP-10GSR-85 10G SFP+ 850nm 300m  (FS)
     [DAC] STARTECH DACSFP10G1M (Startech)
     [DAC] SFPP-PC02 10G SFP+ DAC 2M (FS)
     [DAC] SFPP-PC005 10G SFP+ DAC 0.5M  (FS)
     [RJ45] SFP-10G-T 10GBASE-T SFP+ 30m  (FS)
     [FIBER – SR] IBM FTLX8571D3BCL-IC 850nm
     [FIBER – SR] UBIQUITI UF-MM-10G 300m 850nm
     [DAC] UBIQUITI 10G 1M DAC
     [FIBER-SR] Mellanox MFM1T01A-SR (Mellanox)

SFP (Up to 1G)

————————————————————————————–

TESTED & WORKING:

    [RJ45] SFP-GB-GE-T 10/100/1000BASE-T SFP 100m TESTED WITH S/N: F1940333300 (FS)
    [FIBER – LR BiDi] SFP-GE-BX 1000BASE SFP 1310/1490 10Km (FS)
    [FIBER – LR BiDi] SFP-GE-BX 1000BASE SFP 1490/1310 10Km (FS)

[hoehoe]

did you get it sorted ?
I had a similar problem with a sfp modem connecting to vdsl.

i got it working by manually setting speed and duplex manually, not autoselect and ticking 'This interface does not require an intermediate system to act as a gateway'