2 Switch 1 WAN

[Julien]

Dear all,

i am trying to archive some setup and dont know how to do it.
the situation as next :
our ISP have two switch for us which configured to act as one. switches are layer 3.
We have one opnsense hardware behind "OPNsense A10 Dual Core SSD rack Gen2" a opnsense hardware which we are happy with.
So i want to have two WAN cables from each switch, so Switch 1 to WAN1 and Switch 2 to WAN2 and configure WAN1 and WAN2 as LACP.
is this even possible in opnsense ?

Thank you

[Julien]

i tried to draw it a bit. hopefully its a bit clear thank you

[liceo]

Should work. You can aggregate multiple interfaces. The settings are under "Interfaces" > "Other Types" > LAGG. In the "LAGG proto" field you can choose LACP.

[Gauss23]

Should work. You can aggregate multiple interfaces. The settings are under "Interfaces" > "Other Types" > LAGG. In the "LAGG proto" field you can choose LACP.

I don't think LACP will work for multiple (individual) switches. Did the ISP say that LACP is possible? It depends on the switches if it's possible. What manufacturer is it and what model?

Otherwise "failover" would be an option for protocol.

[Julien]

Should work. You can aggregate multiple interfaces. The settings are under "Interfaces" > "Other Types" > LAGG. In the "LAGG proto" field you can choose LACP.

I don't think LACP will work for multiple (individual) switches. Did the ISP say that LACP is possible? It depends on the switches if it's possible. What manufacturer is it and what model?

Otherwise "failover" would be an option for protocol.

thank you for your answer.
the switches are Brocade ICX7250-48P and support LACP, we are using one for the LAN to do LCAP with our VMware servers,

[Gauss23]

The question was not if a single switch of yours is able to do LACP. The question is, if connecting the ports to different switches will work with LACP.

It makes a difference if you connect one device to two switch ports of the same switch or to individual switches. The switches need to be aware of that fact.

[Julien]

The question was not if a single switch of yours is able to do LACP. The question is, if connecting the ports to different switches will work with LACP.

It makes a difference if you connect one device to two switch ports of the same switch or to individual switches. The switches need to be aware of that fact.

i understand your question correctly, both switch are LAG, they operating as one switch. we LAG them using 10GB ports.

Our ESXI has 2X10GB NICS so each NIC is connected to different switch and acting as a LCAP on the vCenter. Port 1 is at Switch 1 Port 4 and Port 2 is at Switch 2 Port 4 and so on...

the only remain question is can OPN combine both interfaces as LCAP.

Thank you

[Gauss23]

Yes, then it works like liceo said.

[Julien]

Yes, then it works like liceo said.

it wouldnt need any extra configuration after LAG the interfaces? this what i am wondering.

[Julien]

one more question I hope someone can point me to the right way of doing.
LAG has 3 modes.

LACP
FAILOVER
FEC
LOANDBALANCING
ROUNDROBIN.

The idea behind our setup is to have our connection redundant means if switch 1 goes down the connections will remain up.
each switch will have 10GB up link connected to it.

which set up is the best to use for this purpose.

thank you for your respond

[Gauss23]

As you said your switches are stacked and they support LACP. So this could be one solution. What happens if one of the stack members fails? Did/can you try that?

Usually for redundancy you would use two individual switches and connect the firewall to both of them. Then you would configure a bridge with STP/RSTP including both interfaces. You’ll lose the increased bandwidth in comparison to the LACP way.

I’m not an expert on STP though, so maybe another member has more to say about that.

[Julien]

As you said your switches are stacked and they support LACP. So this could be one solution. What happens if one of the stack members fails? Did/can you try that?

Usually for redundancy you would use two individual switches and connect the firewall to both of them. Then you would configure a bridge with STP/RSTP including both interfaces. You’ll lose the increased bandwidth in comparison to the LACP way.

I’m not an expert on STP though, so maybe another member has more to say about that.

Today we have been trying to archive this. however it didnt works.

I have created a LAGG with two free interfaces using LACP, on the Switch we have LACP for two interfaces port 1 of switch 1 and port 1 of switch as LACP ports.

whenever we conenct the cables on the switches on the OPNs console start popping up " interface stopped distributing possible flapping"


when i connect our NAS on the same ports it works.

can someone please advies what have we done wrong?