Qlogic 57810 10Gbit Ethernet

[thecrankygamer]

Anyone have an idea how to get this to work?
Opnsense recognizes the nic's but they get a 00:00:00:00:00 mac address, and are unusable in OpnSense.

Code Select Expand


bxe0: ERROR: Invalid SHMEM Validity signature: 0x0000008
bxe0: ERROR: Invalid phy config in NVRAM (PHY1=0x0000008 PHY2=0x0000008)
bxe0: Uknown media
bxe0: IFMEDIA flags: 20
bxe0: using defaults for TSO: 65518/35/2048
bxeo: ERROR FW failed to respond!
bxe0: ERROR MCP response failure, aborting
bxe0: ERROR Failed to unload previous driver! time_counter 10 rc -1



And even more...

[thecrankygamer]

Noone that has a clue?

[cookiemonster]

if I were you, I'd verify that firmware on the card is as it should be by booting it onto a vanilla freebsd of the same OPN version and on a linux one.
Cases like these can be down to corrupted or wrong firmware like a bad crssflash. Booting to other OS can help verify in a non-destructive way.

[thecrankygamer]

if I were you, I'd verify that firmware on the card is as it should be by booting it onto a vanilla freebsd of the same OPN version and on a linux one.
Cases like these can be down to corrupted or wrong firmware like a bad crssflash. Booting to other OS can help verify in a non-destructive way.

Thats actually helpful, im going to try this this weekend, thnx

[borgobio]

if I were you, I'd verify that firmware on the card is as it should be by booting it onto a vanilla freebsd of the same OPN version and on a linux one.
Cases like these can be down to corrupted or wrong firmware like a bad crssflash. Booting to other OS can help verify in a non-destructive way.

Thats actually helpful, im going to try this this weekend, thnx

Hi, did you find a solution? I have the same exact output from dmesg on opnsense.

[thecrankygamer]

if I were you, I'd verify that firmware on the card is as it should be by booting it onto a vanilla freebsd of the same OPN version and on a linux one.
Cases like these can be down to corrupted or wrong firmware like a bad crssflash. Booting to other OS can help verify in a non-destructive way.

Thats actually helpful, im going to try this this weekend, thnx

Hi, did you find a solution? I have the same exact output from dmesg on opnsense.

I havent tested yet cause my uplink is only 500mbit, but im going to go to 8gb Fiber next week so im going to reinveestigate coming week

[thecrankygamer]

I cant even get it to work when using vmxnet, so i think the 10gb card has a bad firmware, or, is just broken

[Patrick M. Hausen]

I cant even get it to work when using vmxnet, so i think the 10gb card has a bad firmware, or, is just broken

What do you mean by "when using vmxnet"? Is this a virtualised installation? Have you tried booting OPNsense or FreeBSD 13 on bare metal with this card present?

PCIe passthrough is not guaranteed to work in all hardware configurations, even ESXi is particularly picky.

[aab]

I am in similar kind of problem, my 10G card is QLogic 577xx/578xx 10 Gigabit Ethernet (BCM57840) and I have used the iommu to map it to my virtual machine which runs opnsense, when I boot my opnsense I get following errors (one interface works but the other doesn't).  The problem is not with the card, if I switch it to a different PCI slot the bxe1 starts working and bxe0 gives the same error. The following logs are with bxe0 working and bxe1 with errors. I cleared the NVRAM on the server but nothing helped.

Code Select Expand

bxe0: <QLogic NetXtreme II BCM57840 4x10GbE (B1) BXE v:1.78.91> mem 0x380000000000-0x3800007fffff,0x380000800000-0x380000ffffff,0x380002000000-0x38000200ffff irq 11 at device 8.0 on pci0
bxe0: PCI BAR0 [10] memory allocated: 0x380000000000-0x3800007fffff (8388608) -> 0xfffffe008d400000
bxe0: PCI BAR2 [18] memory allocated: 0x380000800000-0x380000ffffff (8388608) -> 0xfffffe008dc00000
bxe0: PCI BAR4 [20] memory allocated: 0x380002000000-0x38000200ffff (65536) -> 0xfffffe0084678000
bxe0: Found 10Gb Fiber media.
bxe0: IFMEDIA flags : 20
bxe0: Using defaults for TSO: 65518/35/2048
bxe0: Ethernet address: d4:5d:64:09:0b:6a
bxe0: MSI-X vectors Requested 2 and Allocated 2
bxe1: <QLogic NetXtreme II BCM57840 4x10GbE (B1) BXE v:1.78.91> mem 0x380001000000-0x3800017fffff,0x380001800000-0x380001ffffff,0x380002010000-0x38000201ffff irq 10 at device 9.0 on pci0
bxe1: PCI BAR0 [10] memory allocated: 0x380001000000-0x3800017fffff (8388608) -> 0xfffffe008e800000
bxe1: PCI BAR2 [18] memory allocated: 0x380001800000-0x380001ffffff (8388608) -> 0xfffffe008f000000
bxe1: PCI BAR4 [20] memory allocated: 0x380002010000-0x38000201ffff (65536) -> 0xfffffe0084688000
bxe1: ERROR: Invalid SHMEM validity signature: 0x00010008
bxe1: ERROR: Invalid phy config in NVRAM (PHY1=0x00010008 PHY2=0x00010008)
bxe1: Unknown media!
bxe1: IFMEDIA flags : 20
bxe1: Using defaults for TSO: 65518/35/2048
bxe1: ERROR: FW failed to respond!
bxe1: ERROR: MCP response failure, aborting
bxe1: ERROR: Failed to unload previous driver! time_counter 10 rc -1
acpi_syscontainer0: <System Container> on acpi0
acpi_syscontainer1: <System Container> port 0xaf00-0xaf0b on acpi0
acpi_syscontainer2: <System Container> port 0xafe0-0xafe3 on acpi0
acpi_syscontainer3: <System Container> port 0xae00-0xae17 on acpi0

Has it got anything to do with memory addresses ? the addresses gotten allocated for port 1(bxe0), then the same memory addresses are tried to be allocated for the port 2 (bxe1) which can't happen, could this be something like that ?

[thecrankygamer]

I cant even get it to work when using vmxnet, so i think the 10gb card has a bad firmware, or, is just broken

What do you mean by "when using vmxnet"? Is this a virtualised installation? Have you tried booting OPNsense or FreeBSD 13 on bare metal with this card present?

PCIe passthrough is not guaranteed to work in all hardware configurations, even ESXi is particularly picky.

Yes its virtualised with pcie passtrough, ill try a bare metal run with opnsense this weekend.